A Unified Decision Model for Evaluation and Selection of MES Software

Chao Liang, Qing LiOpenalex Unknown 2006 · DOI · OpenAlex

Abstract

In this paper, we explore the potential of applying the analytic network process (ANP) to evaluate and select MES software. Different from AHP, ANP allows feedback and interdependence between factors. In our decision model, we consider MES’ unique attribute as an information hub related to nearly all of the other information systems. In addition, the relationships among functionalities which MES software performs are also taken into consideration. Finally, we validate the decision model through a test.

Introduction

Manufacturing Execution Systems (MES) serve as the critical "information hub" of modern factories, bridging the gap between high-level Enterprise Resource Planning (ERP) and shop-floor operations. Because these systems integrate with nearly every facet of production, selecting the right software is a high-stakes decision involving complex trade-offs between technical features, vendor reliability, and long-term costs.

Traditional decision-making tools like the Analytic Hierarchy Process (AHP) often fall short because they assume criteria—such as cost, support, and functionality—are independent. In reality, these factors are deeply interconnected. This paper proposes a unified selection model using the Analytic Network Process (ANP) to account for the feedback loops and dependencies inherent in industrial software procurement.

Methodology: The Analytic Network Process

Unlike hierarchical models that follow a linear, top-down structure, the ANP framework treats decision criteria as a network or "web." The proposed model categorizes requirements into two primary clusters:

  1. Software Requirements (SOR): Encompassing core functionalities (e.g., data collection, performance analysis) and Information Technology Requirements (ITR) like flexibility, security, and compatibility.
  2. Vendor Requirements (VER): Focusing on implementation time, total cost of ownership, support services, and the vendor’s implementation capability.
The ANP model for MES software selection showing interdependencies between software and vendor requirements.

The strength of this model lies in its ability to map interdependencies. It accounts for two-way relationships between software and vendor attributes (e.g., specific vendors offering unique feature sets) and intra-dependent relationships within clusters (e.g., how "Data Collection" serves as a prerequisite for "Product Tracking").

Quantifying Interdependencies

To move from qualitative expert judgment to a mathematical decision, the model utilizes a "supermatrix." This matrix captures the relative weights and influence of each factor on others within the network. For instance, the model recognizes that a lower initial software price (Cost) might be offset by higher long-term support requirements.

A snippet of the supermatrix used to quantify the relationships between decision criteria.

By linking clusters like "Cost," "Support," and "Time," the model provides a more accurate representation of the total lifecycle value of the software. This approach ensures that "compatibility"—often overlooked in simpler models—is prioritized as a key driver for extracting value from the entire IT stack.

Case Study and Results

The model was validated through a case study involving an IT manager with over a decade of experience in software integration. Three software alternatives (Alt1, Alt2, and Alt3) were evaluated. After populating the supermatrix with expert pairwise comparisons and normalizing the results, the final priorities were calculated:

  • Alternative 1 (Alt1): 0.469
  • Alternative 2 (Alt2): 0.232
  • Alternative 3 (Alt3): 0.299

Alt1 emerged as the superior choice. The results aligned with the expert's intuitive professional assessment, confirming that the ANP model provides a rigorous, defensible framework for complex industrial decisions.

Conclusion and Limitations

While the ANP model offers a sophisticated way to quantify "gut feelings" and manage complexity, it is not without challenges. The process of performing numerous pairwise comparisons can be labor-intensive for decision-makers. Additionally, the model assumes that the fundamental decision to "buy" has already been made and that requirements remain stable throughout the selection phase. Future research may focus on streamlining the comparison process and making the model more dynamic to accommodate evolving project scopes.

Summary updated

Abstract

In this paper, we explore the potential of applying the analytic network process (ANP) to evaluate and select MES software. Different from AHP, ANP allows feedback and interdependence between factors. In our decision model, we consider MES’ unique attribute as an information hub related to nearly all of the other information systems. In addition, the relationships among functionalities which MES software performs are also taken into consideration. Finally, we validate the decision model through a test.
BibTeX
@inproceedings{liang2006unified,
  author = {Chao Liang and Qing Li},
  title = {{A Unified Decision Model for Evaluation and Selection of MES Software}},
  booktitle = {Openalex Unknown},
  year = {2006},
  doi = {10.1007/0-387-34403-9\_96},
}
Figure