Implementing a Web-Based Peer grading System and Experiment the Learning Effect

Il‐Min Kim, Sae-Hong Cho, Jong wook KimInternational Journal of Software Engineering and Its Applications 2015 · DOI

TL;DR

This paper introduces a web-based peer grading system designed to enhance online learning by facilitating idea-sharing and peer feedback among students. The system was tested on computer science students and showed a positive impact on knowledge construction compared to traditional grading methods.

What Problem Does This Paper Address?

The paper addresses the challenge of fostering active learning and knowledge construction in online educational environments, particularly within the context of Korean universities where students tend to be passive learners. Traditional one-way learning, where students primarily absorb information from instructors, is seen as insufficient for developing critical thinking and idea generation. The authors propose a social learning approach, leveraging web technologies to enable students to learn from and interact with each other, thereby improving their understanding and the quality of their work.

Methods

The core of the paper is the design and implementation of a web-based peer grading system. This system was built using Java Server Pages (JSP) and Tomcat for the server-side, with HTML5 and JavaScript for the client-side. A MySQL database was used to store student assignments. The system allows students to upload their assignments, anonymously review and grade a set number of their peers' submissions, and provide comments. An Android application was also developed to allow users to view public notices. The experiment involved computer science major students who were tasked with uploading and then reviewing assignments across three types: programming, essay, and problem-solving. The experiment also included a comparative study where one group received traditional grading and another received peer review.

Datasets

The paper does not explicitly mention or introduce any formal datasets for training or evaluation. The "dataset" in this context refers to the assignments submitted by computer science major students at Hansung University for the experiment.

Key Insights and Ideas

  • Social Learning as a Catalyst: The paper highlights that social learning, where individuals learn through observation and interaction with peers, can be a powerful tool for enhancing educational outcomes, especially in contexts where passive learning is prevalent.
  • Peer Feedback Drives Improvement: The system's design emphasizes the value of peer feedback. By anonymously reviewing and commenting on each other's work, students are motivated to improve their own submissions and gain insights from different approaches.
  • Beyond Traditional Grading: The authors argue that traditional grading systems, often one-sided and instructor-centric, can be augmented or replaced by peer-based systems that reduce instructor burden and foster a more collaborative learning environment.
  • Adaptability Across Assignment Types: The system was tested on programming, essay, and problem-solving assignments, suggesting its potential applicability across various academic disciplines and task formats.

Key Results

The experimental results indicated a positive learning effect from the web-based peer grading system. Specifically:

  • Improved Assignment Quality: After the second assignment, students showed increased effort to improve their work, with many learning from imitating others' assignments.
  • Enhanced Expression Skills: For essay assignments, students demonstrated improvements in their ability to use clearer and more definite expressions.
  • Deeper Problem Understanding: In problem-solving assignments, students appeared to grasp the solutions more easily and clearly.
  • Superior to Traditional Methods: The paper concludes that the web-based grading system showed a better educational effect than traditional grading systems, particularly in knowledge construction.

Limitations and Future Work

  • Limited Scope of Comparison: While the paper mentions comparing the experiment results of the three assignment types, the detailed comparison is not fully presented.
  • Further Research Needed: The authors explicitly state that "More experiment and clearer results will be given in further researches," indicating that the current findings are preliminary and require more extensive validation.
  • Anonymity and Identification: While anonymity was maintained for reviewers and assignments, the paper doesn't delve into potential issues arising from this or how to manage them effectively in larger-scale implementations.
  • Mobile Functionality: While an Android app was developed, its functionality was limited to checking public notices, not uploading or reviewing assignments, suggesting room for improvement in mobile integration.

Summary updated

Abstract

The popularity of online edcation technology has resulted in increase of interests on social learning network and online training aids for traditional class educations. In this paper, we designed and implemented a peer report grading system and studied the educational effect of the grading system. Instead of traditional one-sided evaluation done by professors, the system reduced the burden of grading and evaluating assinments and facilitated idea-sharing among students. We took advantage of web technology to maximize the effectiveness of peer feedback. In this paper, we concluded that the web based grading ststem showed better educational effect than traditional grading systems.
BibTeX
@article{kim2015implementing,
  author = {Il‐Min Kim and Sae-Hong Cho and Jong wook Kim},
  title = {{Implementing a Web-Based Peer grading System and Experiment the Learning Effect}},
  journal = {International Journal of Software Engineering and Its Applications},
  year = {2015},
  doi = {10.14257/ijseia.2015.9.6.13},
}
Figure