Evaluation and Supervision System of College Students' English Listening Study Based on Data Analysis

Mei-lin Qu, Li Zeng, Hui Tang, Fei JiaProceedings of the 2018 2nd International Conference on Management, Education and Social Science (ICMESS 2018) 2018 · DOI

Abstract

This study designed a college English listening evaluation and supervision system based on data analysis to improve students' listening proficiency. A four-month comparative experiment involving 124 college students was conducted to test the effectiveness of the system alongside team-based learning. Results indicate that the system effectively improves English listening ability by providing structured oversight. The findings suggest that when educators leverage data analysis to adjust teaching plans, the overall quality of instruction is significantly enhanced.

Introduction

Listening accounts for approximately 42% of time spent in language communication, yet it is frequently the most neglected skill in formal classroom settings due to limited contact hours. Research identifies a significant "performance gap": while students recognize listening as a critical area for improvement, nearly 49% cite "study inertia" as their primary obstacle, and over 70% fail to maintain consistent study habits.

Existing digital tools often act as passive repositories for audio files without providing the accountability necessary for habit formation. This paper introduces a data-driven supervision and evaluation system designed to bridge this gap by tracking extracurricular practice and providing automated feedback.

Methodology

The researchers developed a real-name registration platform where students formulate weekly listening goals. The system's core functionality includes credential tracking of materials and duration, automated evaluation of time distribution, and human-in-the-loop assessment by project team members.

To validate the system, a longitudinal study was conducted from September 2017 to January 2018 with 124 freshmen. Before the intervention, statistical analysis was performed to ensure the experimental and control groups were comparable in their baseline abilities.

Statistical analysis of pretest scores ensuring baseline equivalence between groups.

As shown in the pretest data, the high p-values (e.g., 0.912 for the system group) confirm that there were no statistically significant differences between the groups at the start of the experiment, providing a valid baseline for measuring the system's impact.

Key Results and Discussion

The quantitative analysis, performed via SPSS using independent and paired sample t-tests, yielded notable improvements in student performance. The experimental group utilizing the supervision system saw their average scores rise from 70.67 to 74.88, while the control group remained relatively stagnant.

Comparison of sample sizes, average scores, and variance across pretest and post-test results.

Key insights from the data include:

  • Overcoming Inertia: The primary value of the system is the "supervision effect." Knowing that time distribution and material choices are tracked helps students overcome the psychological barrier of inertia.
  • Stability of Gains: The variance in scores for the experimental group remained stable (71.40 to 72.32), suggesting the system benefited a broad range of students rather than just high performers.
  • Individual vs. Social Learning: While the "Listening Partner" team group improved, the data suggests that for listening—a largely solitary cognitive task—structured individual accountability may be more effective than social interaction alone.

Conclusion

The study demonstrates that a data-driven supervision system can effectively mitigate study inertia in English listening. By moving toward "evidence-based" education, instructors can use system-generated data to adjust teaching plans in real-time. Future work may involve integrating Natural Language Processing (NLP) to automatically assess the difficulty of student-selected materials, further streamlining the oversight process.

Summary updated

Abstract

This study designed a college English listening evaluation and supervision system based on data analysis, in order to improve college students' English listening ability through this system. At the same time, 124 college students were randomly selected for a 4-month comparative experiment to test the effectiveness of using this system and team learning. The result of the data analysis shows that, this system can effectively improve students' English listening ability. If educators can analyze data appropriately and adjust the teaching plan, the quality of teaching can be improved.
BibTeX
@inproceedings{qu2018evaluation,
  author = {Mei-lin QU and Li Zeng and Hui Tang and Fei Jia},
  title = {{Evaluation and Supervision System of College Students' English Listening Study Based on Data Analysis}},
  booktitle = {Proceedings of the 2018 2nd International Conference on Management, Education and Social Science (ICMESS 2018)},
  year = {2018},
  doi = {10.2991/icmess-18.2018.324},
}
Figure