Towards modeling of human skilling for electrical circuitry using augmented reality applications

Ana Villanueva, Ziyi Liu, Yoshimasa Kitaguchi, Zhengzhe Zhu, Kylie Peppler, Thomas S. Redick, Karthik RamaniInternational Journal of Educational Technology in Higher Education 2021 · DOI

Abstract

Augmented reality (AR) is a unique, hands-on tool to deliver information. However, its educational value has been mainly demonstrated empirically so far. In this paper, we present a modeling approach to provide users with mastery of a skill, using AR learning content to implement an educational curriculum. We illustrate the potential of this approach by applying this to an important but pervasively misunderstood area of STEM learning, electrical circuitry. Unlike previous cognitive assessment models, we break down the area into microskills—the smallest segmentation of this knowledge—and concrete learning outcomes for each. This model empowers the user to perform a variety of tasks that are conducive to the acquisition of the skill. We also provide a classification of microskills and how to design them in an AR environment. Our results demonstrated that aligning the AR technology to specific learning objectives paves the way for high quality assessment, teaching, and learning.

Introduction

While Augmented Reality (AR) has shown significant promise in educational settings, its implementation often lacks a rigorous theoretical framework. Many educators utilize AR primarily as a visualization tool, which can lead to "information overload"—a state where students are overwhelmed by digital overlays that are not relevant to their immediate cognitive needs. This paper addresses this gap by proposing a systematic modeling approach to teach complex STEM skills, specifically focusing on electrical circuitry, a subject where students frequently harbor persistent misconceptions.

The Microskill Modeling Approach

To move beyond empirical implementation, the researchers employed Q-matrix theory, a cognitive assessment approach typically used in standardized testing. The core of this methodology involves:

  1. Decomposition: Breaking down the complex skill of circuit building into 10 distinct "microskills," such as understanding polarity, breadboard logic, and reading resistor color codes.
  2. Mapping: Creating a Q-matrix—a Boolean table—that maps every step of a physical task to the specific microskills required for its completion.
  3. Hierarchy: Establishing a hierarchy of these skills using a "reachability matrix" (R-matrix), ensuring that foundational concepts (like current flow) are mastered before advanced ones (like series circuits).

AR Design and Scaffolding

The researchers categorized AR content into three functional types to align with these microskills: Perceptual (highlighting physical objects), Cognitive (visualizing invisible phenomena like current flow), and Motor (guiding physical manipulation).

Conceptual framework for AR-based circuitry education, illustrating the transition from unguided component assembly to structured, module-based learning.

By structuring the AR environment into modules—such as Polarity, Circuit Intro, and Parallel Connections—the system can provide targeted scaffolding. This allows for a "Partial-AR" approach where students only receive digital assistance for the specific microskills they have yet to master, preventing cognitive clutter.

Experimental Evaluation

The study involved 20 undergraduate students with no prior background in electrical circuitry. Participants were divided into two groups: Full-AR (receiving all available digital information) and Partial-AR (receiving scaffolded information targeted at their specific knowledge gaps). Over two sessions, students performed nine distinct circuit-building tasks.

Basic LED circuit task used in the study, featuring a 3V coin battery, resistors in series, and an LED.

Key Results and Insights

The study yielded several critical findings regarding the efficacy of scaffolded AR:

  • Scaffolding Superiority: The Partial-AR group significantly outperformed the Full-AR group in the second session, achieving an average score of 9.34/10 compared to 7.98/10. This confirms that providing too much information can distract students from the core concepts.
  • Difficulty Mapping: The assessment identified "breadboard logic"—understanding the internal connections of the board—as the most difficult microskill for novices to acquire.
  • Technical Solutions: To address the "occlusion" challenge (where virtual overlays hide the user's hands), the authors developed a transparent shader, allowing users to see the physical board while interacting with digital cues.
  • Conceptual Transfer: Both groups scored approximately 90% on a final written exam, indicating that the AR-based curriculum successfully transferred theoretical knowledge, not just procedural following.

Conclusion

This research demonstrates that aligning AR technology with specific cognitive learning objectives through microskill modeling paves the way for higher quality STEM education. By focusing on scaffolding and theoretical grounding, AR can move from being a mere visualization tool to a robust platform for skill mastery. Future work will look to scale this model to larger populations and more diverse fields such as chemistry and mechanical repair.

Summary updated

Abstract

Abstract Augmented reality (AR) is a unique, hands-on tool to deliver information. However, its educational value has been mainly demonstrated empirically so far. In this paper, we present a modeling approach to provide users with mastery of a skill, using AR learning content to implement an educational curriculum. We illustrate the potential of this approach by applying this to an important but pervasively misunderstood area of STEM learning, electrical circuitry. Unlike previous cognitive assessment models, we break down the area into microskills—the smallest segmentation of this knowledge—and concrete learning outcomes for each. This model empowers the user to perform a variety of tasks that are conducive to the acquisition of the skill. We also provide a classification of microskills and how to design them in an AR environment. Our results demonstrated that aligning the AR technology to specific learning objectives paves the way for high quality assessment, teaching, and learning.
BibTeX
@article{villanueva2021towards,
  author = {Ana Villanueva and Ziyi Liu and Yoshimasa Kitaguchi and Zhengzhe Zhu and Kylie Peppler and Thomas S. Redick and Karthik Ramani},
  title = {{Towards modeling of human skilling for electrical circuitry using augmented reality applications}},
  journal = {International Journal of Educational Technology in Higher Education},
  year = {2021},
  doi = {10.1186/s41239-021-00268-9},
}
Figure