Integrating Competency-Based Education in Interactive Learning Systems

Maximilian Sölch, Moritz Aberle, Stephan KruschearXiv 2023 · DOI · arXiv

Introduction

Competency-Based Education (CBE) represents a paradigm shift in pedagogy, moving away from time-bound instructional models toward a system that prioritizes the demonstration of specific skills and knowledge. While theoretically sound, implementing CBE at scale in digital environments remains a challenge. This paper explores the integration of CBE principles into Artemis, an interactive learning platform utilized by over 10,000 students. By leveraging structured competency relations and intuitive visual feedback, the system aims to provide personalized, adaptive learning paths that cater to individual student needs.

The Challenge of Linear Learning

Traditional Learning Management Systems (LMS) typically organize course content as linear sequences. This "one-size-fits-all" approach fails to account for the diverse backgrounds and varying learning speeds of students. Instructors often lack the tools to verify whether a student has truly mastered a concept or has simply completed the required reading. To address this, there is a need for systems that understand the underlying dependencies between topics and offer a transparent roadmap of a student's progress toward mastery.

Methodology: Mapping and Visualizing Competencies

The researchers implemented a three-pillar approach within the Artemis platform to facilitate CBE.

1. Competency Relation Graphs

To move beyond linear content, instructors can define semantic relationships between competencies. The system supports four primary relation types: assumes (prerequisites), extends (adding depth), relates (general connection), and matches (identical concepts). These relations form a directed graph, which the system uses to generate personalized learning recommendations.

Figure 1: The Competency Relation interface allows instructors to map dependencies like 'assumes' and 'extends' between topics such as Software Design and Testing.

2. Automated Progress Tracking

To ensure the system remains scalable and low-friction, progress tracking is automated. "Lecture units" are marked as complete based on specific interaction triggers, such as downloading course materials, clicking external links, or engaging with video content for a minimum of five minutes. This data feeds directly into the student's competency profile.

3. The "Fitness Ring" Visualization

A central innovation of this work is the use of a visual metaphor inspired by the Apple Watch fitness rings. Each competency is represented by three concentric rings that provide a multi-dimensional view of student achievement:

  • Inner Ring (Blue): Represents Progress, or the percentage of learning resources completed.
  • Middle Ring (Green): Represents Confidence, calculated as the average score on related exercises relative to a mastery threshold.
  • Outer Ring (Red): Represents Mastery, a weighted function combining both progress and confidence.
Figure 2: The competency list view features 'fitness rings' to visualize progress and mastery, alongside icons representing cognitive levels from Bloom’s Taxonomy.

Additionally, the interface incorporates icons based on Bloom’s revised taxonomy (e.g., "Analyze") to help students identify the cognitive task required.

Evaluation and Results

The system was evaluated through a user study with seven students at the Technical University of Munich (TUM). Using the Short User Experience Questionnaire (UEQ-S), the researchers measured two key dimensions:

  • Hedonic Quality (Innovativeness/Appeal): Scored 2.06 (on a scale of -3 to +3). This high score suggests that the "fitness ring" metaphor and the overall interface were highly engaging and visually appealing to students.
  • Pragmatic Quality (Efficiency/Usability): Scored 0.714. While positive, this lower score indicated that some aspects of the interface were not immediately intuitive without further explanation.

The overall usability score was 1.37, reflecting a generally positive reception of the CBE integration.

Discussion and Future Work

While the initial results are promising, several areas for improvement were identified. Participants noted a "legend gap," where the specific meaning of the red mastery ring versus the blue progress ring was not always clear. Future iterations will include better on-boarding and legends to clarify these metrics.

Furthermore, the current model treats mastery as a permanent state. The authors propose incorporating "knowledge decay" algorithms to reflect how skills diminish over time without practice. Finally, while the system provides excellent individual feedback, future work will focus on developing instructor-facing analytics to visualize how entire cohorts are navigating the complex competency graphs.

Conclusion

By transforming static course content into a dynamic graph of competencies and providing students with familiar, gamified visual feedback, the Artemis platform successfully demonstrates the potential of CBE in modern interactive learning environments. This approach not only clarifies the learning path for students but also provides a more nuanced metric for true academic mastery.

Summary updated

Abstract

Artemis is an interactive learning system that organizes courses, hosts lecture content and interactive exercises, conducts exams, and creates automatic assessments with individual feedback. Research shows that students have unique capabilities, previous experiences, and expectations. However, the course content on current learning systems, including Artemis, is not tailored to a student's competencies. The main goal of this paper is to describe how to make Artemis capable of competency-based education and provide individual course content based on the unique characteristics of every student. We show how instructors can define relations between competencies to create a competency relation graph, how Artemis measures and visualizes the student's progress toward mastering a competency, and how the progress can generate a personalized learning path for students that recommends relevant learning resources. Finally, we present the results of a user study regarding the usability of the newly designed competency visualization and give an outlook on possible improvements and future visions.
BibTeX
@misc{solch2023integrating,
  author = {Maximilian Sölch and Moritz Aberle and Stephan Krusche},
  title = {{Integrating Competency-Based Education in Interactive Learning Systems}},
  year = {2023},
  eprint = {2309.12343},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2309.12343},
}
Figure