Revitalizing Canonical Pre-Alignment for Irregular Multivariate Time Series Forecasting

Ziyu Zhou, Yiming Huang, Yanyun Wang, Yuankai Wu, James T. Kwok, Yuxuan Liang

Introduction

Irregular multivariate time series (IMTS) are a common challenge in real-world sensor networks, such as ICU monitoring and weather stations. These datasets are characterized by uneven sampling intervals and asynchronous recording across different variables. Historically, researchers used Canonical Pre-Alignment (CPA) to align all variables onto a shared temporal grid via zero-padding. While effective for alignment, CPA causes a "length explosion" that leads to prohibitive memory and compute costs, prompting many modern models to abandon it. This paper introduces KAFNet, an architecture that revitalizes CPA by using smart compression and frequency-domain attention to achieve state-of-the-art performance with high efficiency.

The KAFNet Architecture

KAFNet is designed to maintain the structural benefits of CPA while neutralizing its computational bloat. The model processes data through a specialized pipeline that includes pre-convolution for smoothing and Temporal Kernel Aggregation (TKA) to compress the sequence.

The architecture's core innovations include:

  1. Temporal Kernel Aggregation (TKA): This module places learnable Gaussian kernels across a normalized timeline to pool the bloated CPA sequence into fixed temporal "buckets." This drastically reduces sequence length while preserving irregular timing information.
  2. Frequency Linear Attention (FLA): By moving inter-variate attention to the frequency domain via FFT, KAFNet captures global correlations with linear $O(N)$ complexity, avoiding the quadratic costs of standard attention mechanisms.

Experimental Results

KAFNet was evaluated on four standard IMTS benchmarks: PhysioNet, MIMIC, Human Activity, and USHCN. The results demonstrate that KAFNet consistently outperforms a wide range of baselines, including ODE-based models and recent graph neural networks like tPatchGNN.

Key performance metrics highlight the model's efficiency:

  • Accuracy: Achieved state-of-the-art Mean Squared Error (MSE) and Mean Absolute Error (MAE) across all datasets.
  • Parameter Efficiency: Required 7.2x fewer parameters than leading graph-based alternatives.
  • Speed: Achieved an 8.4x acceleration in both training and inference times.
  • Compute: Operated at a fraction of the FLOPs required by competitors, making it highly suitable for resource-constrained deployments.

Conclusion

KAFNet proves that the abandonment of Canonical Pre-Alignment was premature. By engineering a way to handle CPA's length explosion through Gaussian kernel aggregation and frequency-domain processing, KAFNet provides a highly efficient and accurate framework for irregular time series forecasting. Future work will expand the model's capabilities to tasks such as classification, anomaly detection, and missing value interpolation.

Summary updated

Abstract

Irregular multivariate time series (IMTS), characterized by uneven sampling and inter-variate asynchrony, fuel many forecasting applications yet remain challenging to model efficiently. Canonical Pre-Alignment (CPA) has been widely adopted in IMTS modeling by padding zeros at every global timestamp, thereby alleviating inter-variate asynchrony and unifying the series length, but its dense zero-padding inflates the pre-aligned series length, especially when numerous variates are present, causing prohibitive compute overhead. Recent graph-based models with patching strategies sidestep CPA, but their local message passing struggles to capture global inter-variate correlations. Therefore, we posit that CPA should be retained, with the pre-aligned series properly handled by the model, enabling it to outperform state-of-the-art graph-based baselines that sidestep CPA. Technically, we propose KAFNet, a compact architecture grounded in CPA for IMTS forecasting that couples (1) Pre-Convolution module for sequence smoothing and sparsity mitigation, (2) Temporal Kernel Aggregation module for learnable compression and modeling of intra-series irregularity, and (3) Frequency Linear Attention blocks for the low-cost inter-series correlations modeling in the frequency domain. Experiments on multiple IMTS datasets show that KAFNet achieves state-of-the-art forecasting performance, with a 7.2$\times$ parameter reduction and a 8.4$\times$ training-inference acceleration.
BibTeX
@misc{zhou2025revitalizing,
  author = {Ziyu Zhou and Yiming Huang and Yanyun Wang and Yuankai Wu and James T. Kwok and Yuxuan Liang},
  title = {{Revitalizing Canonical Pre-Alignment for Irregular Multivariate Time Series Forecasting}},
  year = {2025},
  eprint = {2508.01971},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2508.01971},
}
Figure