The Performance appraisal Research of Manufacturing Department Based on AHP

Di Liang, Guizhi Sun, Shuang WuAdvances 2015 · DOI

Abstract

X company mainly produces electric locomotive and urban rail vehicles. This paper takes the locomotive department of X company as the research object. It builds a performance management system by using AHP and fuzzy evaluation method. It constructs the index system by using the idea of BSC, questionnaire survey and expert interviews method. It analyzes the correlation of index combined the MINITAB software. It set evaluation scales by using cluster analysis, then conducts fuzzy comprehensive evaluation. Building performance evaluation system of X company's manufacturing system can solve the problems of department performance evaluation effectively.

Introduction

In large-scale manufacturing sectors, such as the production of electric locomotives and urban rail vehicles, performance appraisal often degrades into a mere formality. This research addresses a critical gap: while general corporate performance tools are common, they frequently fail to account for the specific operational nuances of production-heavy departments.

Existing systems at "Company X" suffered from fragmented communication, insufficient training, and the absence of a complete management loop. The objective of this study was to transform performance appraisal from a simple checklist into a strategic tool that aligns departmental output with broader corporate goals, such as customer satisfaction and investment efficiency.

Methodology

The researchers employed a multi-stage methodology to construct a "Production System Performance Measurement System":

  1. Index Construction (BSC & KPI): Utilizing the Balanced Scorecard (BSC) framework, four primary indices were identified: Cost, Quality, Production and Equipment, and Staff System.
  2. Statistical Refinement: To eliminate redundancy, the team used Minitab and factor analysis to prune sub-indices. For instance, eight initial cost indicators were narrowed down to three key drivers: total cost control, investment control, and single consumption costs.
  3. Weight Determination (AHP & Delphi): Through the Analytic Hierarchy Process (AHP), judgment matrices were built based on expert interviews (the Delphi method). This allowed for the mathematical calculation of the relative importance of each metric.
  4. Fuzzy Comprehensive Evaluation (FCE): To handle the inherent subjectivity of human performance (e.g., the nuance between "satisfactory" and "very satisfactory"), fuzzy logic was used to assign membership degrees to evaluation grades, resulting in a standardized scalar score.
Hierarchical structure of the Production System Performance Index System

Analysis and Results

The application of the AHP model revealed critical insights into the operational priorities of the locomotive department.

Key Insights

  • Production as the Primary Driver: The weighting process identified "Production and Equipment" as the most critical factor, carrying a weight of 0.580. This is significantly higher than Quality (0.178) or Cost (0.111), highlighting that throughput and equipment uptime are the primary success drivers in this manufacturing context.
  • Quantifying Subjectivity: The use of Fuzzy Evaluation successfully converted professional intuition into hard data. By assigning membership degrees to expert ratings, the system generated a final performance score of 83.04 out of 100.
  • Efficiency through Pruning: Factor analysis proved that more data is not always better; by eliminating duplicate information among level-2 indexes, the researchers created a leaner, more actionable management tool.
Calculated weights for Level 1 and Level 2 performance indices

Evaluation Outcome

The locomotive department's final score of 83.04 indicates that goals and tasks were "done better completely" according to the defined scale. All judgment matrices passed the consistency check (C.R. < 0.1), confirming the reliability of the expert-derived weights.

Conclusion

While the system effectively addresses the needs of Company X, its reliance on the Delphi method means results are dependent on the quality of the expert panel. Future research should focus on expanding this framework to other manufacturing sectors to test its generalizability and integrating the feedback loop more tightly into continuous improvement training processes.

Summary updated

Abstract

X company mainly produces electric locomotive and urban rail vehicles. This paper takes the locomotive department of X company as the research object. It builds a performance management system by using AHP and fuzzy evaluation method. It constructs the index system by using the idea of BSC, questionnaire survey and expert interviews method. It analyzes the correlation of index combined the MINITAB software. It set evaluation scales by using cluster analysis, then conducts fuzzy comprehensive evaluation. Building performance evaluation system of X company's manufacturing system can solve the problems of department performance evaluation effectively.
BibTeX
@inproceedings{liang2015performance,
  author = {Di Liang and Guizhi Sun and Shuang Wu},
  title = {{The Performance appraisal Research of Manufacturing Department Based on AHP}},
  booktitle = {Advances},
  year = {2015},
  doi = {10.2991/asei-15.2015.149},
}
Figure