Cooperative Efficiency Evaluation System for Intelligent Transportation Facilities Based on the Variable Weight Matter Element Extension

Kailei Li, Han Bai, Xiang Yan, Liang Zhao, Xiu‐Guang WangSustainability 2023 · DOI

TL;DR

This paper introduces a novel system for evaluating the cooperative efficiency of intelligent transportation facilities by developing a dynamic model that accounts for changing index importance. By applying this system to key road sections in Jinan, China, the researchers identified varying levels of cooperative efficiency and pinpointed critical factors influencing performance, offering valuable insights for urban planning and facility management.

What Problem Does This Paper Address?

As urban transportation systems become increasingly complex and integrated with intelligent technologies, evaluating the cooperative efficiency of various facilities has become crucial. Current challenges include fragmented development, information silos, and a lack of holistic assessment methods that can capture the dynamic interplay between different facilities. Existing evaluation systems often rely on static weights, failing to account for how the importance of certain factors might change based on real-time conditions or the overall performance of the system. This paper aims to bridge this gap by proposing a dynamic evaluation framework that can better reflect the actual cooperative performance of intelligent transportation facilities.

Methods

The core of this research lies in a novel evaluation model that combines two key methodologies:

  • Variable Weight Theory: Unlike traditional methods that assign fixed weights to evaluation indexes, this approach dynamically adjusts the weights based on the performance of each index. This means that indexes performing poorly receive a greater "punishment" in the overall score, reflecting their increased importance in driving down cooperative efficiency. This is achieved through a state variable weight vector that modifies the constant weights based on an equilibrium function.
  • Matter-Element Extension Method: This method is employed to handle the multi-attribute and potentially conflicting nature of the evaluation indexes. It allows for the quantitative evaluation of complex systems by analyzing the "closeness" of an object's characteristics to different evaluation grades (excellent, good, medium, poor). The paper extends this by incorporating the variable weights into the closeness calculation, making the evaluation more sensitive to dynamic changes.

The researchers also developed a structural model of cooperative development elements, categorizing them into four key areas: functional cooperation, operational cooperation, information cooperation, and business cooperation. This model guided the selection of 36 specific evaluation indexes.

Datasets

The study utilized data collected from various sources for the Jinan area, including:

  • Jinan Statistical Yearbook
  • Jinan Lixia District Statistical Yearbook
  • China Urban Construction Statistical Yearbook
  • Jinan Urban and Rural Transport Bureau statistics
  • Publicly available data on representative facilities.

Additionally, the researchers conducted key informant interviews and distributed questionnaires to gather expert opinions and validate the evaluation system.

Key Insights and Ideas

  • Dynamic Weights Matter: The most significant insight is the demonstration that a dynamic weighting system, which adjusts index importance based on performance, provides a more nuanced and realistic assessment of cooperative efficiency compared to static weighting.
  • Identifying Sensitive Indexes: The study successfully identified specific indexes that have a disproportionately large impact on cooperative efficiency. These are the ones that, when performing poorly, significantly drag down the overall score.
  • Cooperative Efficiency Varies Greatly: The application of the model to real-world road sections revealed substantial differences in cooperative efficiency, highlighting that not all parts of a transportation network perform equally well in a coordinated manner.
  • Beyond Individual Facility Performance: The research emphasizes that the effectiveness of intelligent transportation facilities is not just about how well each individual component functions, but how well they work together.

Key Results

The study evaluated ten road sections along Jingshi Road in Jinan. The findings indicated:

  • Performance Distribution:
    • 5 sections were rated as "Excellent" performance.
  • 3 sections were rated as "Good" performance.
  • 2 sections were rated as "Poor" performance.
  • Most Sensitive Indexes: The indexes with the most significant impact on cooperative efficiency and thus the most sensitive to changes were identified as:
  • Vertical cooperative construction
    • Functional scheduling level
    • Information element completeness
    • Multi-departmental information integration level
  • Least Sensitive Indexes: The indexes with the least impact were:
  • Plan executability
    • Functional ease of upgrading
    • Space-time alignment rate
  • Model Validation: The variable weight matter-element extension method showed a strong correlation (0.853) and high agreement (0.866) with the constant weight method, but provided more insightful evaluations for sections with poor performance, aligning better with practical management judgments.

Limitations and Future Work

  • Limitations:
    • The study acknowledges that the "critical line of excellent and non-excellent performance" and other thresholds for standardization were determined through expert empirical methods, which could introduce some subjectivity.
  • While the model shows good adaptability, further research is needed to quantify qualitative indexes and grades within the evaluation system.
  • Future Work:
    • The authors suggest enhancing the precision of qualitative index evaluation and developing models to quantify these aspects.
  • Further research into constructing models that can quantify qualitative and quantitative indexes is proposed.
  • Expanding the application of this model to a wider range of intelligent transportation facilities and urban contexts would be beneficial.

Summary updated

Abstract

In order to effectively evaluate the cooperative efficiency of intelligent transportation facilities, a structural model of four cooperative development elements, including functional cooperative, operational cooperative, information cooperative, and operation cooperative, is constructed with the guidance of system coordination and a cooperative efficiency evaluation system is established based on it. Then, a dynamic efficiency evaluation model based on variable weight and matter-element extension method was constructed to describe the cooperative efficiency of intelligent transportation facilities and analyze the cooperative efficiency of key road sections in the Jinan area as an example. The results show that of the ten sections, two are in poor performance status, three are in good performance status, and five are in excellent performance status. The four indexes of vertical cooperative construction, functional scheduling level, information element completeness, and multi-departmental information integration level have the most significant impact on facility cooperative efficiency and are the most sensitive; the three indexes of plan executability, functional ease of upgrading, and space–time alignment rate have the most negligible impact on facility cooperative efficiency and are the least sensitive.
BibTeX
@inproceedings{li2023cooperative,
  author = {Kailei Li and Han Bai and Xiang Yan and Liang Zhao and Xiu‐Guang Wang},
  title = {{Cooperative Efficiency Evaluation System for Intelligent Transportation Facilities Based on the Variable Weight Matter Element Extension}},
  booktitle = {Sustainability},
  year = {2023},
  doi = {10.3390/su15032411},
}
Figure