Abstract
In order to clearly evaluate city intelligence capabilities for the construction of smart-city spatiotemporal information cloud platforms and evaluate their effectiveness, this study proposed a general framework and evaluation elements for construction evaluation-index systems suited for such platforms. Tests for selected cities were scored so that they may provide support for smart-city construction. This study was according to in accordance with the National Evaluation-Index Systems of Smart Cities and its requirements for the establishment of departmental evaluation indices. According to the test results, we modified and improved the indices. This may now be used to guide and promote cities to conduct construction of spatiotemporal information cloud platforms in a purposeful, well-planned, and step-by-step manner.
Introduction
As China rapidly scales its "smart city" initiatives, the transition from "Digital Cities" (focused on static geospatial data) to "Smart Cities" (focused on real-time, intelligent cloud services) has led to a massive construction boom. Over 300 prefecture-level cities are currently upgrading their infrastructure. However, without a standardized evaluation system, it is difficult to determine if these platforms are actually "smart" or just expensive digital maps. This paper addresses the lack of a specific, technical evaluation framework for spatiotemporal cloud platforms by creating a specialized set of metrics that administrative departments can use to plan, implement, and audit these high-tech platforms.
Methodology
The researchers developed a hierarchical Evaluation-Index System derived from China’s national standards (SAC and NDRC guidelines).
The framework consists of 7 Primary Indices and 41 Secondary Indices:
- Information Resource: Focuses on basic geographic, thematic, and perception data.
- Management Service: Evaluates the platform's role as a resource reservoir and service engine.
- Cloud Environment: Assesses computation, storage, and virtualization capacities.
- Information Security: Covers data classification, security devices, and management systems.
- Mechanism Ensurance: Looks at policy-making, financing, and talent teams.
- Application Effectiveness: Measures user convenience, ubiquity, and problem-solving efficiency.
- Innovative Feature: Prioritizes domestic technology adoption and intelligent technology levels.
The framework uses a weighted linear combination to calculate a final score ($E$): $$E = \sum_{i=1}^{n} W_i \times S_i$$ Where $W_i$ is the weight of the secondary index and $S_i$ is the score (on a 100-point scale) assigned by experts. Ratings are categorized as Excellent ($\ge$ 85), Good (75–85), Passing (60–75), or Failing (< 60).
Results and Case Study
The system was tested and refined using data from over 20 pilot cities across China. A detailed case study of an anonymous city in eastern China demonstrates the scoring process.
In the case study, the city achieved an overall score of 89.75, placing it in the "Excellent" category. Key findings include:
- The highest-weighted primary index was Management Service (25% total weight), highlighting that the platform's ability to serve other departments is more critical than raw data volume.
- The system identified specific areas for improvement, such as "Smart perception data" and "Financing modes," which scored lower than infrastructure-heavy metrics.
- The framework balances "capability" (e.g., computation capacity) with "effectiveness" (e.g., user convenience).
Conclusion
This research provides a standardized "measuring stick" to move smart city development from vague buzzwords to measurable, data-driven performance. While the system is still under modification based on ongoing feedback, it offers a clear path for cities to conduct construction in a purposeful and well-planned manner. Future work involves refining the "innovative" indices as technology like AI and IoT evolves and transitioning this framework into a formal national or industrial criterion.
Summary updated