Research on Foundation Model for Spatial Data Intelligence: China's 2024 White Paper on Strategic Development of Spatial Data Intelligence

Shaohua Wang, Xing Xie, Yong Li, Danhuai Guo, Zhi Cai, Yu Liu, Yang Yue, Xiao Pan, Feng Lu, Huayi Wu, Zhipeng Gui, Zhiming Ding, Bolong Zheng, Fuzheng Zhang, Tao Qin, Jingyuan Wang, Chuang Tao, Zhengchao Chen, Hao Lu, Jiayi Li, Hongyang Chen, Peng Yue, Wenhao Yu, Yao Yao, Leilei Sun, Yong Zhang, Longbiao Chen, Xiaoping Du, Xiang Li, Xueying Zhang, Kun Qin, Zhaoya Gong, Weihua Dong, Xiaofeng Meng

Abstract

This report focuses on spatial data intelligent large models, delving into the principles, methods, and cutting-edge applications of these models. It provides an in-depth discussion on the definition, development history, current status, and trends of spatial data intelligent large models, as well as the challenges they face. The report systematically elucidates the key technologies of spatial data intelligent large models and their applications in urban environments, aerospace remote sensing, geography, transportation, and other scenarios. Additionally, it summarizes the latest application cases of spatial data intelligent large models in themes such as urban development, multimodal systems, remote sensing, smart transportation, and resource environments. Finally, the report concludes with an overview and outlook on the development prospects of spatial data intelligent large models.

Introduction: The Era of Spatial Intelligence

The 2024 White Paper from ACM SIGSPATIAL China marks a pivotal transition in geographic analysis: the shift from traditional Geospatial Artificial Intelligence (GeoAI) to the era of "Spatial Intelligence." While traditional GeoAI focused on specific, fragmented tasks—such as identifying buildings in satellite imagery or predicting local traffic—the new paradigm leverages foundation models to create a unified "brain" for planetary-scale data. These large-scale models, trained on massive datasets, are revolutionizing urban planning, remote sensing, and environmental monitoring by moving beyond simple data mining toward autonomous, multi-modal reasoning.

The Problem: Fragmentation and Geographic Bias

Historically, GeoAI has been limited by the development of "small models" designed for narrow applications. These models often lacked "spatial thinking"—the inherent ability to understand 3D navigation, topological relationships, and the complex interplay between disparate data types like text, vector maps, and trajectories.

Furthermore, general-purpose Large Language Models (LLMs) like GPT-4, while proficient in natural language, exhibit significant "geographic bias." They often favor data-rich regions and struggle with the precise geometric accuracy required for high-stakes decisions in disaster response or urban infrastructure. This paper establishes a strategic roadmap for creating specialized Spatial Data Intelligent Foundation Models that bake geographic rules directly into their architecture.

Methodological Innovations

The transition to spatial intelligence requires a shift from Spatial Implicit models (where coordinates are treated as generic numbers) to Spatial Explicit models. Key methodologies identified in the White Paper include:

  • Multi-Modal Fusion: Treating "Map as a Modality." By integrating vector data, satellite imagery, and textual descriptions as co-equal inputs, models can navigate and interpret the world similarly to human experts.
  • Agent-Based Systems: Moving from simple chat interfaces to autonomous agents like Geo-JARVIS and MapGPT. These systems use LLMs as controllers that can call specialized GIS software or simulation engines to solve complex spatial queries.
  • Self-Supervised Learning: Utilizing Masked Autoencoders (MAE) and Vision Transformers (ViT) to train on vast amounts of unlabeled satellite data. This allows models to learn the "grammar" of the Earth's surface before being fine-tuned for specific tasks.
  • Advanced Causal Inference: Implementing Geographical Convergent Cross Mapping (GCCM) to identify cause-and-effect relationships, such as the direct impact of urban layouts on regional traffic congestion.

Data Foundations and Benchmarks

The development of these models is fueled by massive, specialized datasets that provide the necessary scale for training:

  • SkySense: Trained on 21.5 million multi-modal remote sensing time series.
  • RingMo: A generative model trained on 2 million high-resolution images (0.1m to 30m resolution).
  • RS5M: A dataset featuring 5 million image-text matching pairs specifically for remote sensing applications.
  • Global SIC Database: A compilation of over 223,000 measurements from 55,077 soil profiles used for global carbon mapping.

Key Insights: Actionable Wisdom and Scaling Laws

The authors argue that the core value of spatial intelligence is "Actionable Wisdom"—the transformation of visual and spatial information into concrete navigation and decision-making. However, the paper notes a "Scaling Law Contradiction." While general AI benefits from simply increasing data and parameters, spatial data hits a "complexity wall." Because of spatial heterogeneity—the fact that geographic rules in one region may not apply to another—models must incorporate Geographic Knowledge Graphs (GKG). These graphs provide the AI with structured facts and "common sense" (e.g., hydrological flow directions), which helps prevent the "hallucinations" common in standard LLMs.

State-of-the-Art Results

The White Paper showcases several high-impact applications where spatial foundation models have achieved State-of-the-Art (SOTA) performance:

  • Weather Forecasting: Huawei’s Pangu-Weather achieved a 10,000x speedup over traditional supercomputer simulations, marking the first AI-based forecast to exceed numerical methods.
  • Remote Sensing: SkySense outperformed 18 recent models in land-cover classification and object localization, showing average improvements of up to 3.6%.
  • Urban Damage Assessment: The TKDS-PtNet model, used in conflict zones like Syria and Ukraine, achieved an F1 score 2.5 times higher than standard ResNet models by incorporating temporal knowledge.
  • Traffic Management: TrafficGPT demonstrated the ability to deconstruct natural language requests into actionable traffic signal control plans.

Limitations and Future Outlook

Despite these advancements, several hurdles remain. Current models are heavily biased toward contemporary data and developed nations, often failing in data-poor regions or historical contexts. Furthermore, the "black box" nature of these models poses a challenge for interpretability; city managers require transparent reasoning before making infrastructure changes.

Future research is directed toward "brain-like" or neuromorphic computing. This approach aims to make spatial models more energy-efficient and capable of real-time learning at the "edge," such as within autonomous vehicles or drones, ensuring that spatial intelligence is both sustainable and ubiquitous.

Summary updated

Abstract

This report focuses on spatial data intelligent large models, delving into the principles, methods, and cutting-edge applications of these models. It provides an in-depth discussion on the definition, development history, current status, and trends of spatial data intelligent large models, as well as the challenges they face. The report systematically elucidates the key technologies of spatial data intelligent large models and their applications in urban environments, aerospace remote sensing, geography, transportation, and other scenarios. Additionally, it summarizes the latest application cases of spatial data intelligent large models in themes such as urban development, multimodal systems, remote sensing, smart transportation, and resource environments. Finally, the report concludes with an overview and outlook on the development prospects of spatial data intelligent large models.
BibTeX
@misc{wang2024research,
  author = {Shaohua Wang and Xing Xie and Yong Li and Danhuai Guo and Zhi Cai and Yu Liu and Yang Yue and Xiao Pan and Feng Lu and Huayi Wu and Zhipeng Gui and Zhiming Ding and Bolong Zheng and Fuzheng Zhang and Tao Qin and Jingyuan Wang and Chuang Tao and Zhengchao Chen and Hao Lu and Jiayi Li and Hongyang Chen and Peng Yue and Wenhao Yu and Yao Yao and Leilei Sun and Yong Zhang and Longbiao Chen and Xiaoping Du and Xiang Li and Xueying Zhang and Kun Qin and Zhaoya Gong and Weihua Dong and Xiaofeng Meng},
  title = {{Research on Foundation Model for Spatial Data Intelligence: China's 2024 White Paper on Strategic Development of Spatial Data Intelligence}},
  year = {2024},
  eprint = {2405.19730},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2405.19730},
}
Figure