AHP-BP fusion model based on university education evaluation model and proposal

Meili WangInternational Journal of New Developments in Education 2023 · DOI

This paper presents a hybrid computational approach to one of the most contentious areas in academia: how we evaluate the performance of students and teachers. Moving beyond simple test scores and publication counts, the author proposes a fusion of traditional decision-making logic with neural networks to create a more holistic, objective evaluation framework.

TL;DR

The paper proposes an AHP-BP fusion model that combines the structured hierarchy of the Analytic Hierarchy Process (AHP) with the non-linear processing power of Back Propagation (BP) neural networks. This hybrid approach aims to reduce human subjectivity in university evaluations while incorporating diverse metrics like moral character, emotional learning, and social contribution.

What Problem Does This Paper Address?

Traditional university evaluation systems often suffer from "utilitarianism"—a hyper-focus on quantifiable but narrow metrics like exam scores for students or "titles and hats" (prestigious awards and publication counts) for teachers.

The author identifies two main challenges:

  1. Metric Narrowness: Existing systems ignore "soft" but vital qualities like civic literacy, teacher ethics, and student innovation.
  2. Subjectivity: Traditional weighting methods (like simple AHP) rely heavily on expert opinion, which can introduce bias and randomness into the results.

Methods

The researchers developed a two-stage "fusion" model:

  1. Analytic Hierarchy Process (AHP): This is used to build the evaluation architecture. The problem is decomposed into a hierarchy (e.g., "Character Development" leads to "Social Responsibility"). AHP is used to generate initial weights for these indicators through pairwise comparison matrices.
  2. BP Neural Network: The weights and quantified indicator data from the AHP stage serve as inputs for a BP neural network. By simulating the human brain's learning process, the network performs non-linear transformations and iterative learning. This process is designed to "filter out" the subjective biases inherent in the initial AHP weights, leading to a more objective and stable final evaluation score.

The model evaluates students across 21 secondary indicators (grouped into 5 tiers) and teachers across 12 secondary indicators (grouped into 4 tiers).

Datasets

The study utilized a small-sample simulation based on data collected from the Internet. While the paper does not name a specific public benchmark, it uses this collected data to train the BP network and validate its predictive accuracy.

Key Insights and Ideas

  • The "Subjectivity Filter": The core innovation is using the neural network as a corrective layer. While AHP provides the necessary human-centric structure, the BP network’s autonomous learning helps eliminate the "randomness and subjectivity" of the human experts who initially assigned weights.
  • Holistic Indicators: The paper argues for a radical expansion of what we measure. For students, this includes "learning about emotions" and "aesthetic sensibility." For teachers, it emphasizes "involvement in student work" and "social contribution" over just academic output.
  • Non-Linearity in Education: The authors recognize that educational quality isn't just a sum of its parts. The use of a neural network allows the model to capture complex, non-linear relationships between different performance indicators that a simple weighted average would miss.

Key Results

  • High Convergence and Accuracy: In MATLAB simulations, the model's Mean Squared Error (MSE) reached an optimal state after only 4 iterations. By the 9th iteration, training accuracy was close to 100%.
  • Strong Correlation: The model achieved an R-value near 1, indicating an extremely tight relationship between the sample output values and the target expectations.
  • Practical Weighting: The paper provides specific point assignments (e.g., "Scientific Evaluation" accounts for 40% of a teacher's initial tier-1 weight, while "Character Development" and "Academic Development" each take 30% for students).

Limitations and Future Work

  • Sample Size: The authors acknowledge that the simulation was conducted on a "small sample." To be truly robust, the model needs testing against much larger, multi-institutional datasets.
  • Contextual Flexibility: One of the paper's own suggestions is that the state should provide a general direction while allowing individual schools to "make moderate adjustments" to the model. How the BP network handles these localized variations without losing its objective "filtering" edge remains a question for future implementation.
  • Data Quantization: The paper mentions quantifying "teaching evaluation indexes into definite data," but the specific methodology for turning a qualitative trait like "teacher ethics" into a hard number for neural network input is a complex process that warrants further detail.

Summary updated

Abstract

In this paper, through the study of the policy and frontier theoretical changes in the educational evaluation of students and teachers in colleges and universities in recent years, a comprehensive analysis is made to summarize the primary indicators about educational evaluation, and then subdivide the secondary indicators downwards to quantitatively analyze and evaluate their rationalization. In order to improve the accuracy and scientific of education evaluation, this study proposes an AHP-BP education evaluation rationalization model based on the fusion of hierarchical analysis (AHP) and BP neural network. Firstly, the hierarchical analysis method is used to construct an evaluation index system, construct a comparison matrix, and after the initial weights of the evaluation indexes are derived from a two-by-two comparison, they are used as the input of the BP neural network. Finally, the BP neural network simulation results are used, and the model quantifies the concept of teaching evaluation indexes into definite data as the input of the network, and the simulation comprehensive evaluation results are used as the output. The hierarchical analysis method has strong subjective factors, and the neural network, by simulating the working principle of the human brain, has functions such as autonomous learning and non-linear transformation, which can effectively exclude randomness and subjectivity, and is an innovation in conducting educational evaluation. Therefore, the learning simulation process of BP neural network eliminates most of the subjective factors of the hierarchical analysis method in the process of continuous iteration, and obtains satisfactory evaluation results It has wide applicability. Finally, we conducted a small sample simulation based on some of the data collected on the Internet, and the results obtained were relatively small in error and met expectations, and the educational evaluation model could be put into use. Based on the AHP-BP education evaluation rationalization model and the understanding of the current situation of education evaluation, three main suggestions are made: 1. Encourage university evaluation to pay more attention to the process, and eliminate utilitarian evaluation indicators should be more decentralized indicator scores; 2. Suggest that the state should supervise in the general direction, and the specific situation of specific schools is different, and make moderate adjustments to the evaluation model; 3. Vigorously support teacher and student co-education The policy of activities to create a corresponding educational atmosphere resonates with the community and can promote the healthy development of university education.
BibTeX
@article{wang2023ahp,
  author = {Meili Wang},
  title = {{AHP-BP fusion model based on university education evaluation model and proposal}},
  journal = {International Journal of New Developments in Education},
  year = {2023},
  doi = {10.25236/ijnde.2023.050315},
}
Figure