Research on the Reform of Professional Practice Course Evaluation Model for Comprehensive Ability

Shouhua Chen, Weiwei Liu, Bo Zhang2016 · DOI

Abstract: For the problems of insufficient of professional practice courses traditional examination mode in capability evaluation and weak directivity, according with the actual typical curriculum design courses in our unit, the present situation of the curriculum assessment model is expounded, the existing problems is analyzed, the suggestions of professional practice course examination mode reform program are proposed. The theory with the actual engineering application to the student, teamwork and innovation practice comprehensive ability evaluation is researched, in order to provide feedback to improve the teaching quality.

Introduction

In professional practice courses—such as "systems engineering course design"—traditional examination methods often fall short. Unlike theoretical courses where a written exam suffices, practice-based learning requires evaluating "comprehensive abilities" like teamwork, innovation, and the application of theory to real-world engineering.

Existing evaluation systems suffer from three major pain points. First is subjectivity, where process assessments are often based on a teacher's vague impression rather than rigorous criteria. Second is the "Group Score Trap", where every team member receives the same grade regardless of their actual workload, discouraging high-performers and allowing "free riders" to coast. Finally, there is randomness in defenses; if a weak communicator is randomly selected for an oral reply, the entire group’s grade may suffer despite excellent technical work.

The Granular Assessment Framework

To address these issues, a Detailed Evaluation Index System was developed to break down the final grade into specific, weighted components. This model shifts the focus from a single final output to a continuous evaluation of the learning process.

Figure 1: The hierarchical structure of the proposed course assessment model, detailing weights for process and final examinations.

As shown in the assessment hierarchy, the grade is split into two primary categories:

  • Process Assessment (30%): This includes "Classroom Performance" (10%) and "Usual Score" (20%). Classroom performance utilizes a "basis point" system where points are deducted for absences or poor note-taking and added for active participation. The usual score is a weighted average of term-long homework assignments.
  • Final Examination (70%): This covers the "Course Practice Report" (35%) and the "Oral Reply" (35%). To ensure fairness, reports are scored by 3–5 different teachers based on content, quality, and formatting, while the oral reply is evaluated on manners, expression, and technical accuracy.

Quantifying Individual Contribution

The most significant innovation in this model is the introduction of the Contribution Coefficient ($k$). To solve the group-grading dilemma, the team leader assigns a "contribution degree" ($D_i$) to each member, representing their share of the total team effort (totaling 100%).

Figure 3: A sample task undertaking table used to determine personal contribution (Di) for each team member across different project stages.

This $D_i$ value is then used to calculate the individual multiplier: $$k = 1 + (D_i - 1/n)$$ (where $n$ is the number of team members).

This $k$ factor acts as a multiplier for the group’s average score. For example, in a 5-person team ($1/n = 20\%$), a student who contributed 25% of the work receives a higher final mark than a peer who only contributed 15%. This forces teams to be transparent about their internal labor division and ensures that individual excellence is rewarded within the spirit of group success.

Implementation and Results

This model was applied to the "Systems Engineering Course Design" curriculum at The Academy of Armored Forces Engineering in Beijing. The implementation led to several key improvements:

  1. Increased Engagement: Students shifted from passive to active learning, knowing that specific behaviors like note-taking and classroom participation directly impacted their GPA.
  2. Fairness and Differentiation: The $k$ coefficient successfully differentiated student grades within the same group, with multipliers typically ranging from 0.95 to 1.05.
  3. Improved Documentation Quality: Standardized formatting and multi-teacher validation led to significantly higher-quality technical reports.
  4. Feedback Loops: The granular data provided teachers with insights into which specific curriculum areas students struggled with most, allowing for targeted instructional improvements.

Conclusion

While the model effectively addresses subjectivity and the group score trap, it relies heavily on the integrity of team leaders to assign contribution degrees fairly. Future work will focus on refining these peer-review mechanisms to prevent bias and exploring ways to scale the administrative overhead of multi-teacher grading for larger class sizes. Overall, the reform provides a robust framework for evaluating the comprehensive abilities required in modern engineering practice.

Summary updated

Abstract

For the problems of insufficient of professional practice courses traditional examination mode in capability evaluation and weak directivity, according with the actual typical curriculum design courses in our unit, the present situation of the curriculum assessment model is expounded, the existing problems is analyzed, the suggestions of professional practice course examination mode reform program are proposed. The theory with the actual engineering application to the student, teamwork and innovation practice comprehensive ability evaluation is researched, in order to provide feedback to improve the teaching quality.
BibTeX
@misc{chen2016research,
  author = {Shouhua Chen and Weiwei Liu and Bo Zhang},
  title = {{Research on the Reform of Professional Practice Course Evaluation Model for Comprehensive Ability}},
  year = {2016},
  doi = {10.2991/iceemt-16.2016.67},
}
Figure