A Novel Performance Evaluation Framework for Sponge City Construction

Le Luo, Lei Yang, Wang JiangBuildings 2025 · DOI

TL;DR

This paper introduces a novel, comprehensive framework for evaluating the performance of "sponge city" construction projects. By integrating subjective expert opinions with objective data analysis and employing a multi-objective gray target decision-making model, the framework provides a more robust and reliable assessment than previous methods, aiding city managers in optimizing construction plans and resource allocation.

What Problem Does This Paper Address?

Rapid urbanization leads to significant water-related challenges like flooding, declining water quality, and insufficient supply. Sponge cities, designed to mimic natural hydrological processes, offer a solution by managing rainwater through green infrastructure. However, evaluating the effectiveness of these complex projects is challenging due to difficulties in data acquisition, a lack of standardized indicators, and the inability of traditional models to handle incomplete or fuzzy data. This paper aims to address these issues by developing a scientific and comprehensive performance evaluation framework.

Methods

The authors propose a multi-stage approach:

  1. Indicator System Development: A hierarchical indicator system with 5 primary and 15 secondary indicators was established through literature review and expert interviews, covering ecological environment improvement, water resource management, water disaster prevention, social and economic benefits, and technological/management innovation.
  2. Subjective Weighting (FAHP): Fuzzy Analytic Hierarchy Process (FAHP) was used to quantify expert judgments and determine subjective weights for the indicators. This involves pairwise comparisons and constructing fuzzy complementary judgment matrices.
  3. Objective Weighting (Projection Pursuit & DCS): A Projection Pursuit model, optimized by the Differentiated Creative Search (DCS) algorithm, was employed to determine objective weights based on data characteristics. This method is adept at handling high-dimensional, nonlinear data.
  4. Combined Weighting (Game Theory): Game theory was used to combine the subjective and objective weights, creating a more balanced and reliable set of comprehensive weights.
  5. Performance Evaluation (Multi-Objective Gray Target Decision-Making): An interval number multi-objective gray target decision-making model was applied. This model is designed to handle interval data (representing uncertainty) and can effectively assess performance by calculating distances to positive and negative target centers, ultimately assigning an evaluation grade.

Datasets

The study utilized data from 11 typical sponge cities in China for case study analysis. Specific data for each city's indicators were collected and transformed into interval numbers for the evaluation model. The paper does not introduce a new benchmark dataset but rather applies its framework to existing sponge city projects.

Key Insights and Ideas

  • Holistic Evaluation is Crucial: Previous evaluation methods often focused on single aspects (e.g., hydrology), neglecting the broader impacts of sponge city construction. This paper's five-dimensional indicator system provides a more comprehensive view.
  • Bridging Subjectivity and Objectivity: Combining FAHP (expert-driven) with Projection Pursuit (data-driven) and then harmonizing them with game theory offers a more robust weighting mechanism than relying on either method alone.
  • Handling Uncertainty: The use of interval numbers and the gray target decision-making model is particularly valuable for real-world sponge city data, which is often uncertain or qualitative.
  • Indicator Significance: The study highlights the importance of indicators like biodiversity enhancement and storm waterlogging mitigation for ecological health, while also pointing out areas like rainwater utilization green space rate as potential weaknesses in current projects.

Key Results

The developed framework was applied to 11 sponge cities, yielding varied performance grades:

  • Excellent: Xi'an Xixian New District
  • Good: Tianshui City, Xining City, Xinjiang Nova City
  • Medium: Pingliang City, Lanzhou City, Golmud City, Weinan City
  • Poor: Urumqi, Yan'an, Qingyang

The results indicated that while many cities show strong performance in water resource management and ecological improvement (e.g., biodiversity, flood mitigation), there are often shortcomings in areas like rainwater utilization efficiency. The framework successfully differentiated performance levels among the cities.

Limitations and Future Work

  • Data Acquisition Challenges: Obtaining accurate data for certain indicators, such as soil porosity and permeability, remains difficult, costly, and potentially biased.
  • Subjectivity in Evaluation: The determination of positive/negative bull's-eye interval values and the division of evaluation levels still involve some subjective influence, potentially affecting comparability.
  • Limited Scope: The study did not cover all types of sponge city construction projects, which might limit the universality of the findings.

Future work suggested includes:

  • Optimizing the indicator system by selecting indicators with more accessible data.
  • Introducing machine learning into the evaluation model to reduce subjective influence and improve accuracy.
  • Expanding the case study scope to enhance the framework's adaptability.

Summary updated

Abstract

As sponge city construction is gradually promoted globally, it is very important to construct a scientific and reasonable performance evaluation framework. This paper establishes an indicator system with 5 primary indicators and 15 secondary indicators, calculates subjective weights by fuzzy hierarchical analysis, determines objective weights by a projection tracing model, calculates comprehensive weights of indicators by combining game theory, and finally determines the city’s evaluation level based on the interval-counting multi-objective gray target decision-making model. Eleven typical sponge cities were selected for the case study analysis, which verified that the research framework of this paper can effectively deal with complex data and the reliability of the evaluation results, providing new ideas for the evaluation of sponge city construction performance. It also helps city managers to optimize the construction plan and resource allocation in a timely manner, thus enhancing the comprehensive benefits of the city and providing a scientific basis for the long-term development of sponge cities.
BibTeX
@inproceedings{luo2025novel,
  author = {Le Luo and Lei Yang and Wang Jiang},
  title = {{A Novel Performance Evaluation Framework for Sponge City Construction}},
  booktitle = {Buildings},
  year = {2025},
  doi = {10.3390/buildings15111814},
}
Figure