STGAN: Spatial-Temporal Graph Autoregression Network for Pavement Distress Deterioration Prediction

Shilin Tong, Difei Wu, Xiaona Liu, Le Zheng, Yuchuan Du, Difan Zou

TL;DR

Predicting when a road will crumble is notoriously difficult because real-world inspection data is "messy"—collected at irregular intervals and different locations. STGAN (Spatial-Temporal Graph Autoregression Network) solves this by treating time as a dimension within a unified graph and framing deterioration as a sequential "graph growth" problem, significantly outperforming traditional models on sparse, crowdsourced datasets.

What Problem Does This Paper Address?

Maintaining road infrastructure is a multi-billion dollar challenge. While we have sensors and cameras to detect cracks and potholes, the data they produce is rarely "clean." Most existing spatial-temporal AI models (like DCRNN) require data to be collected at regular intervals (e.g., every hour) and across all locations simultaneously.

In reality, pavement data is often collected via crowdsourcing—inspection vehicles or buses driving different routes at different times. This results in datasets that are:

  1. Irregular: Inspections don't happen on a fixed schedule.
  2. Asynchronous: Location A might be checked on Monday, while Location B is checked on Wednesday.
  3. Sparse: Many road segments have very few historical records.

The authors address the gap between these "messy" real-world datasets and the rigid requirements of standard deep learning models.

Methods

The core innovation of STGAN is how it structures the data. Instead of a static spatial graph that changes over time steps, the authors propose a unified spatial-temporal graph.

  • Nodes as Tuples: Each node in the graph represents a specific (location, time) tuple. If a road segment is inspected five times, it appears as five distinct nodes in the graph.
  • Connection Mechanisms: To handle sparsity, they use two types of edges:
  • Hard Connections: Links nodes that are physically close and close in time based on a fixed threshold.
  • TOP Connections: Ensures every node connects to at least its $K$ nearest neighbors, preventing "isolated" data points in sparse regions.
  • Graph Autoregression: Prediction is treated as an autoregressive task. To predict a future state, a "new" node is added to the graph, and the model uses an attention-based mechanism to aggregate information from its historical "neighbor" nodes.
  • Feature-Aware Attention: The model uses a specialized attention mechanism that considers the time difference between nodes, recognizing that more recent data is generally more relevant for predicting future decay.

Datasets

The study utilizes the ConTrack dataset, a high-frequency observational dataset of pavement distress in Shanghai, China.

  • Scope: Covers over 350 km of urban roads and highways.
  • Collection: Data gathered by inspection vehicles, buses, and logistics trucks.
  • Scale: The preprocessed version used in the paper contains 17,200 nodes.
  • Features: Includes 11 features across four dimensions: spatial (GPS), temporal (timestamps), environmental (humidity, wind, precipitation), and road distress (crack types, severity).

Key Insights and Ideas

  • Time as Space: By embedding the temporal domain directly into the spatial graph, the model bypasses the need for synchronized time steps, making it naturally resilient to irregular sampling.
  • The "Lonely Node" Problem: Standard graph models fail when data is sparse because nodes have no neighbors to learn from. The TOP connection mechanism acts as a safety net, forcing connections to the most relevant historical data points regardless of strict distance thresholds.
  • Environmental Sensitivity: The ablation studies revealed that visibility, precipitation, and cloud cover are the most critical environmental factors for prediction, while temperature had a surprisingly lower impact on short-term deterioration in this specific dataset.

Key Results

STGAN was compared against several baselines, including MLPs, GCNs, and Graph Attention Networks (GAT).

  • Accuracy: STGAN consistently achieved the lowest error rates. For example, in the "0-2000" data segment, STGAN achieved a Mean Absolute Error (MAE) of 0.1759, compared to 0.4609 for the next-best model (GAT) and 0.7129 for a standard MLP.
  • Classification: When used to classify road health (Healthy, Good, Severe, Very Severe), the model achieved an AUC of 0.93 for the first three classes, though it struggled slightly more with the "Very Severe" class (AUC 0.75) due to the rarity of such extreme cases in the training data.
  • Efficiency: Despite its complexity, STGAN's inference time is comparable to standard GNNs, making it viable for real-time decision support.

Limitations and Future Work

The authors highlight a few key hurdles:

  • Visual vs. Reality: There is sometimes a discrepancy between how "bad" a crack looks in a photo and its actual structural severity (the "DetectInfo" value). Environmental lighting and camera angles can introduce noise.
  • Data Imbalance: The dataset has fewer examples of "Very Severe" distress, making it harder for the model to predict rapid, catastrophic failures accurately.
  • Traffic Load: The current model does not explicitly account for the weight and volume of traffic (ESALs), which is a primary driver of pavement wear. The authors plan to integrate multi-scale data fusion (combining traffic and maintenance records) in future iterations to improve long-term forecasting.

Summary updated

Abstract

Pavement distress significantly compromises road integrity and poses risks to drivers. Accurate prediction of pavement distress deterioration is essential for effective road management, cost reduction in maintenance, and improvement of traffic safety. However, real-world data on pavement distress is usually collected irregularly, resulting in uneven, asynchronous, and sparse spatial-temporal datasets. This hinders the application of existing spatial-temporal models, such as DCRNN, since they are only applicable to regularly and synchronously collected data. To overcome these challenges, we propose the Spatial-Temporal Graph Autoregression Network (STGAN), a novel graph neural network model designed for accurately predicting irregular pavement distress deterioration using complex spatial-temporal data. Specifically, STGAN integrates the temporal domain into the spatial domain, creating a larger graph where nodes are represented by spatial-temporal tuples and edges are formed based on a similarity-based connection mechanism. Furthermore, based on the constructed spatiotemporal graph, we formulate pavement distress deterioration prediction as a graph autoregression task, i.e., the graph size increases incrementally and the prediction is performed sequentially. This is accomplished by a novel spatial-temporal attention mechanism deployed by STGAN. Utilizing the ConTrack dataset, which contains pavement distress records collected from different locations in Shanghai, we demonstrate the superior performance of STGAN in capturing spatial-temporal correlations and addressing the aforementioned challenges. Experimental results further show that STGAN outperforms baseline models, and ablation studies confirm the effectiveness of its novel modules. Our findings contribute to promoting proactive road maintenance decision-making and ultimately enhancing road safety and resilience.
BibTeX
@article{tong2025stgan,
  author = {Shilin Tong and Difei Wu and Xiaona Liu and Le Zheng and Yuchuan Du and Difan Zou},
  title = {{STGAN: Spatial-Temporal Graph Autoregression Network for Pavement Distress Deterioration Prediction}},
  journal = {IEEE Trans. Intell. Transp. Syst.},
  year = {2025},
  doi = {10.1109/tits.2025.3547883},
}

Loading related content...

Figure