XXLTraffic: Expanding and Extremely Long Traffic forecasting beyond test adaptation

Du Yin, Hao Xue, Arian Prabowo, Shuang Ao, Flora Salim

TL;DR

XXLTraffic is a massive new open-source dataset for traffic forecasting that spans up to 23 years, dwarfing existing benchmarks in both duration and spatial scale. It introduces a novel "beyond test adaptation" framework, challenging models to predict traffic patterns across multi-year gaps to better simulate real-world urban evolution and infrastructure shifts.

What Problem Does This Paper Address?

Most current traffic forecasting research relies on datasets that are temporal "snapshots"—often covering only a few months or, at most, five years. While deep learning models have become excellent at capturing short-term spatio-temporal patterns, they struggle with the distribution shifts inherent in growing cities.

Over a decade, a city changes: new highways are built, populations surge, and vehicle usage patterns evolve. Furthermore, real-world sensors often suffer from long-term downtimes. Existing benchmarks don't account for these "extremely long" temporal gaps or the continuous evolution of the road network. The authors argue that we need to move "beyond test adaptation"—where a single model is tweaked to fit a new domain—toward models that can inherently generalize across the multifaceted impacts of demographic and vehicular growth over decades.

Figure 1: Test-time adaptation in time-series forecasting in- volves training a single model to fit different test domains, horizons, or gaps. The figure above illustrates this using a gap example. In contrast, the figure below shows our ’beyond test adaptation’ where we train separate models for various gap settings.

Methods

The researchers established a benchmarking framework focused on Extremely Long Prediction with Gaps. Unlike standard forecasting where the input and output are contiguous, this task introduces a gap ($g$) of 1, 1.5, or 2 years between the observation period and the prediction target.

They evaluated a wide array of architectures to see how they handle these massive shifts:

  • General Time-Series Models: Informer, Autoformer, iTransformer, DLinear, and the state-space model Mamba.
  • Traffic-Specific Models: STGCN, ASTGCN, GWN, AGCRN, and PDFor.

The benchmark includes both hourly and daily aggregated data, providing a multi-scale perspective on how temporal granularity affects long-term predictability.

Visual definition of the problem, highlighting the multi-year gaps between training and testing.

Datasets

The paper introduces XXLTraffic, the largest public traffic dataset to date.

  • Sources: Data was curated from the California Department of Transportation (PeMS) and Transport for NSW (Australia).
  • Scale: It covers 9 districts in California and major roads in New South Wales, spanning from 2001 to 2024.
  • Evolution: Unlike static datasets, XXLTraffic shows the network growing from a few hundred sensors to over 21,000 nodes over two decades.
Figure 2: Our dataset is evolving and longer than existing datasets. Existing datasets are either limited by short tempo- ral spans or insufficient spatial nodes. In contrast, our dataset features an evolving growth of spatial nodes and spans over 20 years.

Key Insights and Ideas

  • Urban Evolution as Domain Shift: The authors demonstrate that sensors at the exact same location can have completely different data distributions in 2005 versus 2024. This confirms that long-term traffic forecasting is not just a time-series problem, but a domain adaptation problem.
  • The "Aha" Moment for MICN: Interestingly, the MICN (Multi-scale Local and Global Context Network) model, which often underperforms on standard short-term benchmarks, emerged as a top performer in the "gap" setting. This suggests that models focusing on intrinsic data correlations and multi-scale patterns are more robust to long-term shifts than those relying on tight temporal dependencies.
  • History Matters: The ablation studies showed that increasing the input sequence length (the "look-back" window) significantly improves performance even when predicting across a two-year gap. More historical context helps the model navigate the noise of long-term distribution shifts.

Key Results

  • Performance Degradation: Nearly all SOTA models saw a significant drop in accuracy when faced with multi-year gaps, highlighting that current "leaderboard kings" are not yet ready for long-term urban planning applications.
  • Efficiency Benchmarks: The researchers provided a comprehensive look at training costs. DLinear proved to be the most efficient (training in seconds), while graph-based models like AGCRN were computationally intensive, taking hours per epoch on the larger sub-datasets.
  • Scale Invariance: Surprisingly, training on only 10% of the data yielded similar results to using the full dataset for some models, suggesting that the primary challenge is the difficulty of the task itself (the distribution shift) rather than a lack of data volume.
Comparison of training times across different models, showing the high computational cost of some SOTA architectures.

Limitations and Future Work

The primary limitation is the computational burden. The sheer size of 23 years of high-resolution traffic data makes it difficult for many researchers to train complex models without massive hardware resources.

The authors suggest that future work should focus on:

  1. Efficient Subsampling: Finding ways to represent 20 years of data without processing every single 5-minute interval.
  2. Foundation Models: Leveraging the scale of XXLTraffic to pre-train large-scale traffic foundation models that can be fine-tuned for specific cities or new road networks.
  3. Scalable Algorithms: Developing new architectures that can handle tens of thousands of evolving nodes over decades without hitting memory walls.

Summary updated

Abstract

Traffic forecasting is crucial for smart cities and intelligent transportation initiatives, where deep learning has made significant progress in modeling complex spatio-temporal patterns in recent years. However, current public datasets have limitations in reflecting the distribution shift nature of real-world scenarios, characterized by continuously evolving infrastructures, varying temporal distributions, and long temporal gaps due to sensor downtimes or changes in traffic patterns. These limitations inevitably restrict the practical applicability of existing traffic forecasting datasets. To bridge this gap, we present XXLTraffic, largest available public traffic dataset with the longest timespan collected from Los Angeles, USA, and New South Wales, Australia, curated to support research in extremely long forecasting beyond test adaptation. Our benchmark includes both typical time-series forecasting settings with hourly and daily aggregated data and novel configurations that introduce gaps and down-sample the training size to better simulate practical constraints. We anticipate the new XXLTraffic will provide a fresh perspective for the time-series and traffic forecasting communities. It would also offer a robust platform for developing and evaluating models designed to tackle the extremely long forecasting problems beyond test adaptation. Our dataset supplements existing spatio-temporal data resources and leads to new research directions in this domain.
BibTeX
@inproceedings{yin2025xxltraffic,
  author = {Du Yin and Hao Xue and Arian Prabowo and Shuang Ao and Flora Salim},
  title = {{XXLTraffic: Expanding and Extremely Long Traffic forecasting beyond test adaptation}},
  booktitle = {SIGSPATIAL/GIS},
  year = {2025},
  doi = {10.1145/3748636.3762762},
}
Figure