AsyTO: Asymmetric Temporal Operator for Parameter-Efficient Multivariate Time Series Forecasting

Xiachong Lin, Du Yin, Hao Xue, Wen Hu, Imran Razzak, Arian Prabowo, Matthew Amos, Flora D. SalimarXiv 2026 · arXiv

TL;DR

AsyTO breaks the classic trade-off between parameter efficiency and model flexibility in multivariate time series forecasting by compressing the forecasting operator rather than the data series. By decoupling history-reading and future-writing into distinct, shared temporal factors with variable-specific gains, it achieves state-of-the-art accuracy among lightweight models while scaling linearly with the number of variables.

What Problem Does This Paper Address?

When forecasting multivariate time series, researchers face a structural dilemma. On one hand, sharing a single temporal predictor across all variables is highly parameter-efficient but forces completely different variables (e.g., temperature vs. humidity) to follow an identical history-to-future mapping. On the other hand, learning an independent predictor for each variable preserves unique behaviors but causes the parameter count to explode quadratically with the product of the variable count, context length, and forecast horizon ($O(C \times L \times H)$).

Existing lightweight models try to mitigate this by compressing the time-series data using spectral methods or downsampling. However, they typically use the same mathematical object (like a symmetric kernel or basis set) to handle both the past and the future. The authors argue that this structural symmetry is fundamentally flawed: reading historical evidence is an extraction problem that focuses on specific informative lags, whereas writing a future forecast requires coordinating an entire trajectory.

Methods

AsyTO (Asymmetric Temporal Operator) resolves this dilemma through a multi-stage architecture that isolates periodic trends and factorizes the remaining residual mapping:

  1. Low-Rank Periodic Prototype ($Q = UV^\top$): The model first extracts recurring seasonal patterns shared across variables, leaving a periodicity-exclusive residual.
  2. Asymmetric Temporal Operator (AsyTO): Instead of materializing a massive dense operator tensor, AsyTO uses CANDECOMP/PARAFAC (CP) factorization to split the operator into three distinct components:
  3. History-side factors ($\Psi$): Shared across variables to read historical patterns.
  4. Future-side factors ($\Phi$): Shared across variables to write the future trajectory. Crucially, $\Psi \neq \Phi$, allowing for history-future asymmetry.
  5. Variable-mode response ($G$): Variable-specific gains that dictate how strongly each variable responds to a given temporal mode.
  6. Cycle-Separable Temporal Factorization (CeST): To prevent the shared temporal factors from dominating the parameter budget, CeST factorizes them into a Kronecker product of a cycle-index factor (how many cycles ago) and a within-cycle phase factor (where in the cycle).
  7. Residual Echo: A simple gating mechanism that passes a phase-conditioned copy of the observation from exactly one cycle prior as a direct local cue.
Figure 1: AsyTO. A low-rank periodic prototype Q = UV⊤is removed from the history and restored on the future axis by phase lookup; the periodicity-exclusive residual is transported by an asymmetric operator whose history and future factors (Ψ, Φ) are separate and shared across variables, with a per-variable modal response G. Both temporal factors are further compressed into a cycle-index and a within-cycle phase factor (CeST), and G reuses the prototype’s variable coordinates, so each additional variable costs only Rp parameters.

Datasets

The model was evaluated across 11 standard multivariate time-series benchmarks:

  • ETT Family: ETTh1, ETTh2, ETTm1, ETTm2 (Electricity Transformer Temperature)
  • Electricity
  • Weather
  • Traffic
  • PEMS Datasets: PEMS03, PEMS04, PEMS07, PEMS08 (Public California transportation data)

No new datasets were introduced in this paper.

Key Insights and Ideas

  • The Necessity of Asymmetry: Forcing history-reading and future-writing operators to be symmetric ($\Psi = \Phi$) consistently harms performance. The paper demonstrates that history modes tend to be highly localized in time, whereas future modes spread smoothly across the forecasting horizon.
  • Compressing Operators over Series: Instead of trying to compress the input data streams, compressing the underlying forecasting operator preserves the target-only property (predicting a variable solely from its own history) while keeping compute requirements minimal.
  • Plug-and-Play Transferability: Remarkably, the low-rank periodic prototype and CeST modules can be attached to frozen weights of other independent lightweight backbones (like PhaseFormer or MixLinear). Doing so yields significant error reductions (up to 68.4% on PEMS datasets) without updating any backbone weights, proving that these modules provide a universally transferable structural correction.

Key Results

AsyTO achieves the best lightweight error in 30 out of 44 dataset-horizon settings, firmly establishing itself on the accuracy-compute Pareto frontier.

  • Compute and Parameter Efficiency: On the Electricity dataset, AsyTO uses 47.5×, 62.2×, and 590.4× fewer MACs than TQNet, iTransformer, and PatchTST, respectively. Its parameter footprint is 155× smaller than iTransformer.
  • Linear Scaling: Because the temporal factors are shared, adding a new variable to the model configuration scales linearly, costing only a handful of parameters ($Rp$) to update the prototype coordinate map.
Figure 2: Visualization of accuracy vs. compute Pareto on ETTm1, Weather, Electricity under the setting of L = 720 →H = 96. The bubble size indicates the scale of the trainable parameters, where the dashed step in grey indicates the Pareto frontier.

Limitations and Future Work

The primary limitation of AsyTO stems from its channel-independent design. Each variable is predicted strictly from its own historical context. While this keeps the model lightweight and prevents overfitting, it fails on datasets where cross-variable information sharing is vital.

For instance, AsyTO consistently underperformed on the Traffic dataset (which contains 862 highly correlated sensors). The authors acknowledge this boundary and suggest that incorporating selective cross-variable interaction is the most natural next step for future iterations of the architecture.

Summary updated

Abstract

Multivariate time-series forecasting faces a structural dilemma: sharing one temporal predictor across variables is parameter-efficient but forces heterogeneous variables through an identical history-to-future map, whereas learning an independent predictor per variable restores flexibility at a cost that grows with the product of variable count, context length, and horizon. We argue that this dilemma dissolves once the object being compressed is the forecasting operator rather than the observed series. Auditing per-variable linear history-to-future maps across standard benchmarks, we find that a phase-locked seasonal component paired with a compact residual operator outperforms a dense phase-blind reference in most audited settings. The residual transport is also directional: lag-invariant alternatives consistently underperform asymmetric history-to-future maps. Guided by this structure, we propose AsyTO, an Asymmetric Temporal Operator that factorizes the tensor of per-variable operators into shared but distinct history-reading and future-writing temporal modes with per-variable mode-wise gains, complemented by a low-rank periodic prototype and a cycle-separable factorization of the temporal modes. Each forecast reads only its own variable's history, so parameters and compute grow linearly in the number of variables. Across eleven benchmarks and multiple forecast horizons, AsyTO attains the best lightweight error in 30 of 44 dataset-horizon settings, locating at the accuracy-compute Pareto frontier.
BibTeX
@misc{lin2026asyto,
  author = {Xiachong Lin and Du Yin and Hao Xue and Wen Hu and Imran Razzak and Arian Prabowo and Matthew Amos and Flora D. Salim},
  title = {{AsyTO: Asymmetric Temporal Operator for Parameter-Efficient Multivariate Time Series Forecasting}},
  year = {2026},
  eprint = {2608.16098},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2608.16098},
}
Figure