Abstract: Concerns over the quality of teaching in massive open online courses devoted to language learning (LMOOCs) have prompted extensive research on learning behavior in such courses. The purpose of this study is to gain a better understanding of autonomous learning check-ins – that is, individuals sharing their own learning records and/or other information about their learning-related experience – a novel behavior that has not been studied in previous LMOOC research. Using learning analytics, we found that just 6.2% (n = 699) of a sample of 11,293 learners autonomously engaged in check-in behavior, and that the content of these learners’ check-ins varied considerably according to their contexts and the language skills they were seeking to acquire. We further found (1) a positive association between check-in behavior and LMOOC completion; (2) that students who chose to check in earned relatively low grades on unit quizzes, especially in their early stage of learning, but outperformed the non-check-in group significantly in final exam scores; and (3) that those who checked in engaged with a significantly wider array of in-LMOOC learning components than those who did not, and thus accessed a wider system of language-learning experiences. Taken together, these results confirm that check-in behavior can aid the process of learning in an LMOOC and further highlight this behavior’s wider potential to aid self-directed autonomous online learning.
Introduction
Massive Open Online Courses (MOOCs), particularly for language learning (LMOOCs), often struggle with low completion rates and limited learner autonomy. While research typically focuses on "canonical" behaviors like video consumption, this study investigates "autonomous check-in behavior"—the act of learners voluntarily sharing their progress or learning records in discussion forums. This practice, popular in mobile apps but understudied in formal MOOC environments, serves as a potential indicator of self-directed learning and academic success.
Methodology
The researchers employed Learning Analytics (LA) to analyze trace data from the "University English for Academic Purposes" course on the XuetangX platform. The dataset included 11,293 enrolled learners and over 800,000 behavioral records. Content analysis was performed on 2,224 forum posts to identify "check-ins," and statistical modeling (Logistic Regression and Mann-Whitney U tests) was used to establish the predictive power of these behaviors on learning outcomes.
Key Results
Completion and Engagement
A primary finding was the powerful association between check-in behavior and course completion. Although only 6.2% of learners engaged in check-ins, they were significantly more likely to complete the course.
Statistical modeling revealed that the odds of completing the course increased by a factor of 43.06 for learners who checked in. Furthermore, these learners watched more videos and viewed more slides across all course units compared to their peers.
Academic Performance and Growth
Interestingly, check-in learners initially earned lower grades on unit quizzes, suggesting that "vulnerable" or lower-proficiency learners may use check-ins as a compensatory strategy to build momentum. However, this group ultimately outperformed the non-check-in group in final exam scores (97.69 vs. 94.98), demonstrating significant academic growth.
Content Diversity
Check-ins were not limited to the MOOC curriculum; they often bridged the gap between the course and the learner's external environment.
While 42.8% of check-ins focused on LMOOC progress, a substantial portion covered vocabulary (21.9%), listening (18.1%), and reading (16.9%) activities performed outside the platform.
Discussion and Conclusion
Check-in behavior serves as a rare, observable proxy for "proactive autonomy." By voluntarily sharing their progress, learners take responsibility for their learning journey. These results confirm that check-in behavior can aid the learning process and highlight its potential to support self-directed online learning.
Future MOOC designs should consider embedding dedicated "check-in" features to encourage this beneficial behavior. While limited by a lack of demographic data and context specificity, this study provides a foundation for understanding how social signaling can drive academic success in digital environments.
Summary updated