TopoST: Topology-Conditioned Node Specialization for Urban Spatio-Temporal Foundation Models

Kaiyun Wei, Yue Xu, Wenying Duan, Zichen Xu, Shuai Ma, Xiaoxi HearXiv 2026 · arXiv

TL;DR

TopoST is a spatio-temporal foundation model that enables high-performance zero-shot forecasting in new cities by learning a universal rule to specialize model parameters based on local graph topology. By mapping identity-independent structural features to specific model weights, it bridges the gap between general knowledge sharing and the unique, heterogeneous dynamics of individual urban sensors.

What Problem Does This Paper Address?

Urban spatio-temporal forecasting—predicting things like traffic flow, speed, or taxi demand—is notoriously difficult to generalize. Every city has a unique layout (topology), and even within a single city, two sensors just a block apart might exhibit vastly different behaviors (heterogeneity).

Existing Spatio-Temporal Foundation Models (STFMs) try to learn reusable patterns across cities, but they face a fundamental trade-off:

  1. Uniformity: Treating all nodes the same way, which ignores local dynamics.
  2. Identity-Dependence: Learning specific "embeddings" for each node, which makes it impossible to transfer the model to a new city where those node identities don't exist.

The authors of TopoST ask: Can we learn a generalizable rule for constructing node-specific dependency models in unseen urban scenarios?

Methods

The core innovation of TopoST is Topology-Conditioned Node Specialization. Instead of learning what a specific node is, the model learns how a node should behave based on where it sits in the graph.

  1. Local Spatio-Temporal Units: The model doesn't look at a whole city at once. It uses METIS partitioning to break graphs into small, manageable subgraphs. This allows the model to focus on recurring local patterns (like intersections or corridors) that are common across different cities.
  2. Structural Descriptors: For every node, the model calculates identity-independent features like degree, clustering coefficients, and neighborhood statistics (Statistical Structural Encoding).
  3. Topology Encoder: A Graph Isomorphism Network (GIN) processes these structural features into "node codes." Because GIN is permutation-equivariant, it ensures that the model's understanding of a node depends only on its structural context, not its arbitrary ID.
  4. Parameter Generation: These node codes act as keys to a shared "parameter pool." The model generates unique weights for each node's Temporal Attention (how it relates to its own history) and Spatial GCN (how it interacts with neighbors).
Overview of the TopoST architecture, showing the transition from local subgraphs to topology-conditioned parameter generation and the final forecasting backbone.

Datasets

The authors utilized a massive collection of data for pretraining and evaluation:

  • Pretraining: 20 source datasets spanning traffic flow (e.g., PEMS04, PEMS08), traffic speed (e.g., METR-LA), and taxi demand (NYC-TAXI), totaling over 151 million observations.
  • Zero-Shot Evaluation: 6 target datasets excluded from pretraining, covering cross-region transfer (California), cross-city transfer (Shanghai, Chicago), and even cross-category transfer (NYC-BIKE demand).

Key Insights and Ideas

  • Local Structure Recurrence: The authors analyzed 20+ datasets and found that while global city graphs are unique, local structures repeat constantly. For example, 84.4% of 1-hop neighborhoods in one dataset have an exact structural match in another.
  • Persistent Heterogeneity: Even within these recurring structures, nodes behave differently. Within-subgraph differences account for over 70% of the variation in temporal behavior. This proves that "one-size-fits-all" models are destined to fail.
Analysis of structure recurrence and node heterogeneity across 20+ urban datasets, justifying the need for node-specific specialization.
  • Transferable Specialization: The "aha moment" is realizing that node specialization itself can be a transferable rule. If you know how a node in a specific structural context behaves in City A, you can apply that logic to a structurally similar node in City B without ever having seen City B before.

Key Results

TopoST demonstrates state-of-the-art performance in zero-shot settings:

  • Superior Accuracy: It outperformed existing foundation models like OpenCity, UrbanFM, and UniST across all 18 dataset-metric combinations tested. On average, it reduced error (MAE) by ~10% compared to the next best foundation model.
  • Efficiency: TopoST is remarkably compact, with only 2.16M parameters. It uses ~90% less training memory than UrbanFM.
  • Scalability: The model supports a parallel execution mode (TopoST-P) that achieves nearly 50x speedups in inference latency for larger graphs compared to sequential processing.
Inference scaling results showing that parallel execution (TopoST-P) maintains low latency even as the number of nodes increases.

Limitations and Future Work

  • The Zero-Shot Gap: While TopoST is the best foundation model, there is still a performance gap between zero-shot models and "expert" models trained specifically on a single target dataset (full-shot). The authors show that few-shot adaptation (fine-tuning on just 10% of target data) significantly closes this gap.
  • Static vs. Dynamic Topology: The current framework assumes the graph structure is fixed. Future iterations could explore how to handle dynamic graphs where connections change over time (e.g., road closures).
  • Broader Modalities: While the model handles flow, speed, and demand, extending this topology-conditioned approach to other urban modalities like air quality or energy consumption remains an open direction.

Summary updated

Abstract

Urban spatio-temporal foundation models must share knowledge across diverse urban scenarios while accommodating heterogeneous node dynamics. Our analysis of 20+ datasets spanning diverse urban scenarios reveals recurring local graph structures across datasets alongside substantial node heterogeneity within local subgraphs. Motivated by these observations, we propose TopoST, which combines shared learning over local subgraphs with topology-conditioned node specialization. The key insight is to make node specialization itself transferable through a shared topology-to-parameter mapping. This mapping uses identity-independent topological representations to generate node-specific temporal and spatial dependency parameters, enabling direct specialization for unseen nodes without target-specific embeddings or model updates. Extensive experiments demonstrate that TopoST achieves remarkable zero-shot generalization across unseen cities and tasks, highlighting topology-conditioned node specialization as an effective mechanism for transferable urban spatio-temporal foundation models. Code is available at https://github.com/weikaiyun/TopoST.
BibTeX
@misc{wei2026topost,
  author = {Kaiyun Wei and Yue Xu and Wenying Duan and Zichen Xu and Shuai Ma and Xiaoxi He},
  title = {{TopoST: Topology-Conditioned Node Specialization for Urban Spatio-Temporal Foundation Models}},
  year = {2026},
  eprint = {2611.15440},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.15440},
}
Figure