3DPFIX: Improving Remote Novices' 3D Printing Troubleshooting through Human-AI Collaboration Design

Nahyun Kwon, Tong Steven Sun, Yuyang Gao, Liang Zhao, Xu Wang, Jeeeun Kim, Sungsoo Ray Hong

Introduction

3D printing has become increasingly accessible, yet it maintains a notoriously steep learning curve. When a print fails, novices often find themselves at a loss, primarily due to a "lexical barrier." Without the technical vocabulary to describe specific issues—such as "ghosting," "pillowing," or "under-extrusion"—beginners struggle to search for solutions in existing community archives. This creates a "supply-and-demand" crisis in online forums like Reddit’s r/FixMyPrint, where the volume of novice requests far outpaces the availability of human experts to provide custom advice.

To address this, we present 3DPFIX, a human-AI collaborative system that transforms years of community knowledge into an interactive diagnostic tool. By utilizing image-based AI classifiers and curated solution paths, 3DPFIX allows novices to bypass the lexical barrier, identifying failures faster and learning domain-specific jargon in the process.

System Design and Methodology

3DPFIX was developed through a multi-stage pipeline focused on bridging the gap between raw community data and actionable novice guidance:

  1. Formative Study: A survey of 76 users was conducted to pinpoint specific pain points in remote troubleshooting, confirming that the inability to name failures was a primary hurdle.
  2. AI Diagnosis: The system employs ResNet18 binary classifiers trained to detect five of the most common 3D printing failure types: Stringing, Layer Shifting, Under-extrusion, Warping, and Blobs.
  3. Explainable AI (XAI): To build user trust, 3DPFIX utilizes Grad-CAM saliency maps. These maps highlight the specific pixels the AI analyzed to reach its conclusion, helping users understand the visual reasoning behind a diagnosis and identify when the AI might be distracted by background clutter.
  4. Social Annotation Transfer: Rather than generating new content, the system extracts high-quality advice and "clues" from upvoted Reddit comments. These "social annotations" are mapped to specific failure types to provide expert-level solutions.
  5. Interactive Interface: The UI features a progressive disclosure workflow, offering generic solutions first before moving to case-specific details, and includes "hover-over" definitions for technical terms to facilitate learning.

Data and Evaluation

The system is powered by the FixMyPrint Dataset, a newly compiled multi-modal resource consisting of 28,030 images sourced from over 30,000 Reddit posts (2014–2021). While the authors identified 20 distinct failure types within community discourse, the current iteration of 3DPFIX focuses on the five most prevalent categories.

To evaluate the system, a benchmark study was conducted with 13 novice users, comparing 3DPFIX against standard troubleshooting practices (e.g., manual Google and Reddit searches).

Key Insights

  • Bypassing the Lexical Barrier: The study confirmed that image-based search is a powerful substitute for technical terminology. By allowing the AI to "name" the problem based on a photo, novices can access solutions they previously couldn't find.
  • Transparency and Trust: The inclusion of saliency maps was critical. Users felt more confident in the system when they could see the AI's focus. Conversely, if the AI highlighted the background instead of the print, users knew to disregard the result, preventing the frustration often associated with "black box" AI.
  • Pedagogical Benefits: 3DPFIX functions as a learning tool. Users demonstrated better retention of 3D printing terminology and a more logical troubleshooting flow after using the system compared to those using traditional search methods.
  • Community Knowledge as a Scalable Resource: The research demonstrates that upvotes and social annotations are viable metrics for semi-automatically building expert-level solution pools in niche technical domains.

Results

  • Efficiency: Users reached a correct diagnosis roughly 50% faster on average than the control group.
  • Accuracy: In blind expert reviews, the solutions identified via 3DPFIX were rated as significantly more accurate and viable than those found through standard searching.
  • User Experience: Participants reported significantly lower cognitive load and effort when using 3DPFIX.
  • AI Performance: The binary classifiers achieved over 80% accuracy for most categories, though "layer shifting" remained a challenge (approx. 73%) due to its visual variability.

Limitations and Future Work

While 3DPFIX represents a significant step forward, it is currently sensitive to environmental factors like poor lighting or cluttered backgrounds. Future work will focus on expanding the failure dictionary to include all 20 identified types and incorporating multimodal data—such as audio to detect mechanical grinding or real-time video to catch failures as they occur. Ultimately, the researchers envision a human-in-the-loop system where user feedback continuously improves the AI, keeping the tool current as 3D printing technology evolves.

Summary updated

BibTeX
@article{kwon2024dpfix,
  author = {Nahyun Kwon and Tong Steven Sun and Yuyang Gao and Liang Zhao and Xu Wang and Jeeeun Kim and Sungsoo Ray Hong},
  title = {{3DPFIX: Improving Remote Novices' 3D Printing Troubleshooting through Human-AI Collaboration Design}},
  journal = {Proc. ACM Hum. Comput. Interact.},
  year = {2024},
  doi = {10.1145/3637288},
}
Figure