A Diffusion-based Foundation Model for Irregular Spatio-Temporal Trajectories

Bohao Qu, Zhang Wanbing, Hongwei Wang, Di Lin, Ivor Tsang, Xiuju Fu, Qing GuoOpenReview 2026 · Submission to ICLR 2026 · Rejected · OpenReview

TL;DR

GeoDiffusion is a new diffusion-based foundation model designed to handle the messy, irregular nature of maritime trajectory data. By combining a novel spatio-temporal encoding with latent diffusion, it unifies trajectory prediction, imputation, and route planning into a single pretrained model that outperforms specialized state-of-the-art tools.

What Problem Does This Paper Address?

Tracking global maritime movement via the Automatic Identification System (AIS) is a data scientist's nightmare. Unlike a clean GPS trace from a smartphone, AIS data is notoriously "irregular": sensors fail, signals drop for days during intercontinental voyages, and sampling rates vary wildly. Furthermore, ships don't move in a vacuum; they are constrained by coastlines, shipping lanes, and port regulations.

Current AI approaches usually tackle these issues in silos. You might train one model for prediction (where is the ship going?), another for imputation (filling in the gaps of a broken signal), and a third for route planning (how should a ship get from A to B?). Training these task-specific models is computationally expensive and fails to capture the underlying "physics" of maritime mobility in a way that generalizes. The authors argue we need a foundation model—a single, generative backbone that understands the "grammar" of ship movement and can be applied to any downstream task without retraining.

Methods

The authors introduce GeoDiffusion, which treats trajectory modeling as a generative process using Latent Diffusion Models (LDMs). The architecture consists of three main pillars:

  1. Spatio-Temporal Offset Encoding (STOE): Standard models often struggle with irregular time gaps. STOE explicitly encodes the relative spatial distance and logarithmic time intervals between consecutive points. This allows the model to distinguish between a ship that is stationary and one that has simply stopped reporting its position for twelve hours.
  2. Transformer-based Latent Diffusion: Instead of working directly on raw coordinates, GeoDiffusion maps trajectories into a compressed latent space. A Transformer-based denoising network then learns to "reverse" Gaussian noise into plausible vessel paths. Because it uses self-attention, the model can simultaneously weigh global navigational intent (long-range routes) and fine-grained local maneuvers (docking at a port).
  3. Training-free Conditional Inference: This is the "foundation" secret sauce. To perform different tasks, the authors don't retrain the model. For prediction, they provide the start of a path and let the model denoise the "future" tokens. For imputation, they noise the missing segments and let the model fill them in while keeping the known points fixed.

Datasets

The model was evaluated using a mix of massive private and public datasets:

  • Pre-training Dataset: A private dataset containing AIS records from over 3,500 oil tankers (January to June 2022), covering global shipping routes and intercontinental trade corridors.
  • Downstream Evaluation:
    • DAM Dataset: AIS trajectories from vessels near the Danish coastline.
  • US Coast Dataset: Records from the US MarineCadastre, focusing on the United States coastline.

These datasets provide a rigorous test of the model's ability to generalize from global tanker patterns to specific regional traffic.

Key Insights and Ideas

  • Diffusion > Autoregression: Most trajectory models are autoregressive (predicting the next point based on the last). These suffer from "exposure bias," where a single small error early on snowballs into a nonsensical path. Diffusion models look at the whole sequence at once, leading to much higher "geo-temporal consistency"—meaning the ships actually stay in the water and follow realistic curves.
  • The Power of Offsets: By focusing on the change in time and space (offsets) rather than absolute coordinates, the model gains a stronger inductive bias. It learns the "velocity" and "rhythm" of maritime travel, which is more transferable across different parts of the globe than raw latitude/longitude.
  • Zero-Shot Versatility: The most impressive feat is that the same weights used for global pre-training can perform route planning between two arbitrary ports (like Taipei to Puerto La Cruz) with high fidelity, respecting landmasses without ever being explicitly "taught" a map.

Key Results

GeoDiffusion achieved state-of-the-art (SOTA) results across all three primary tasks:

  • Trajectory Prediction: Consistently outperformed strong baselines like TimesNet and GPT-ST in Path Overlap Ratio (POR) and Jaccard Similarity, especially on long-horizon forecasts.
  • Imputation: Even with high missing data rates (e.g., 40 days of a voyage with 20 days missing), GeoDiffusion maintained high topological fidelity, significantly outperforming specialized models like DAISTIN.
  • Route Planning: In "random-point" routing tests, GeoDiffusion showed a massive advantage over diffusion baselines like DiffTraj, proving it has a superior "global" understanding of maritime geography.

Limitations and Future Work

The authors identify one primary limitation: the current model is trained exclusively on tanker trajectories. While tankers represent a huge portion of global trade, other vessels—like high-speed passenger liners or erratic fishing boats—exhibit very different movement patterns.

Future work aims to incorporate multi-vessel types into the pre-training mix. Additionally, while the model respects coastlines well, explicitly integrating "hard" geographic constraints (like digital elevation models or port maps) into the denoising process could further reduce the rare instances where a generated path might clip a landmass.

Summary updated

Abstract

Maritime mobility provides a representative yet extremely challenging setting for spatio-temporal sequence modeling. Global AIS trajectories are inherently irregular and noisy, spanning intercontinental routes as well as fine-grained near-port maneuvers, and are constrained by coastlines, shipping lanes, and regulations. These characteristics not only complicate trajectory prediction but also generalize to other irregular spatio-temporal domains such as urban mobility and autonomous navigation. Moreover, maritime applications involve diverse downstream tasks, including forecasting, imputation, and route planning, where training separate task-specific models is computationally costly and undermines scalability. This motivates the development of a foundation-level generative framework that can unify irregular sequence modeling across tasks. We propose GeoDiffusion, a diffusion-based foundation model for maritime trajectory modeling. GeoDiffusion introduces three core components: a Spatio-Temporal Offset Encoding (STOE) to robustly capture irregular sampling and missing data, a Transformer-based denoising network to learn both global and local dynamics, and a training-free conditional inference strategy that enforces geo-temporal consistency and unifies multiple tasks within a single pretrained model. Experiments on large-scale global AIS datasets demonstrate that GeoDiffusion achieves state-of-the-art performance across trajectory prediction, imputation, and planning, while generalizing robustly to unseen distributions. These results highlight GeoDiffusion as both a practical solution for maritime mobility and a blueprint for irregular spatio-temporal foundation models.
BibTeX
@misc{qu2026diffusion,
  author = {Bohao Qu and Zhang Wanbing and Hongwei Wang and Di Lin and Ivor Tsang and Xiuju Fu and Qing Guo},
  title = {{A Diffusion-based Foundation Model for Irregular Spatio-Temporal Trajectories}},
  year = {2026},
  url = {https://openreview.net/forum?id=w7xpNeFIbb},
  howpublished = {OpenReview},
  note = {Submitted to ICLR 2026},
}
Figure