Dilated Causal Convolutions for Temporal Modeling

You are reading version 1 of this direction, frozen 2026-10-04. The latest version is version 2.

Version 1 of 2286 papers351 conceptsfrozen 2026-10-04

For years, Recurrent Neural Networks (RNNs) and their gated variants like LSTMs were the default choice for sequential data. The intuition was simple: to understand the present, a model must maintain a "memory" of the past that it updates step-by-step. However, this sequential nature is also a bottleneck—it prevents parallelization and often struggles to retain information over very long horizons.

A growing body of research suggests a more efficient alternative: treating time series not as a chain of states, but as a 1D signal to be processed via Temporal Convolutional Networks (TCNs). By combining two specific mechanisms—causality and dilation—these models capture long-range dependencies with the speed and stability of convolutional architectures.

The Constraint of Causality

In standard image processing, a convolution looks at pixels both to the left and right of a target. In time-series forecasting, this is "cheating." A model cannot use information from $t+1$ to predict $t$.

As noted by Konstantinos Benidis and colleagues in their comprehensive roadmap, causal convolutions solve this by shifting the filter so that the output at time $t$ is convolved only with elements from time $t$ and earlier in the previous layer. This ensures a strict "arrow of time," a requirement for physical systems like seismic wave propagation Tarje Nissen‐Meyer or hemodynamic stress monitoring Chufan Gao.

Expanding the Receptive Field via Dilation

The primary challenge for any convolutional model is its "receptive field"—how far back in time it can "see." A standard convolution has a linear receptive field; to see 1,000 steps back, you would need a prohibitively deep network.

Dilated convolutions overcome this by skipping input steps at a regular interval (the dilation factor). By doubling the dilation factor at each layer (e.g., 1, 2, 4, 8...), the receptive field grows exponentially rather than linearly. This allows a relatively shallow network to capture massive historical windows.

This mechanism is particularly vital in high-frequency domains:

Why It Works: Parallelism and Gradient Stability

The shift toward TCNs isn't just about accuracy; it's about training dynamics. Unlike RNNs, which must wait for the previous time step's calculation to finish, convolutions can be computed in parallel across the entire sequence. This leads to massive speedups, as seen in the work of Eliu A. Huerta, whose team processed a month of gravitational wave data in seconds Inference-Optimized AI and High Performance Computing for Gravitational Wave Detection at Scale.

Furthermore, TCNs avoid the "vanishing gradient" problem inherent in backpropagating through long temporal chains. Because the path from the output to a distant past input is logarithmic (thanks to dilation) rather than linear, the signal remains stable. This stability is why Sarmad Mehrdad and Farah E. Shamout found TCNs superior for predicting COVID-19 patient deterioration Deep learning for deterioration prediction of COVID-19 patients based on time-series of three vital signs.

Beyond Supervised Forecasting

The architecture's ability to compress long sequences into fixed-length "signatures" has opened doors for unsupervised learning. Aymeric Dieuleveut and Jean-Yves Franceschi demonstrated that dilated causal encoders can learn universal embeddings for multivariate time series without any labels Unsupervised Scalable Representation Learning for Multivariate Time Series. Similarly, Addison Weatherhead used this approach to map messy ICU sensor data into "patient state" vectors that predict cardiac arrest hours in advance Learning Unsupervised Representations for ICU Timeseries.

Whether identifying a driver's behavioral fingerprint Jingbo Yang or automating the tuning of industrial controllers Cristian R. Rojas, the core intuition remains: by replacing the "hidden state" of recurrence with the "receptive field" of dilated convolutions, we gain a more scalable, stable, and parallelizable way to model the passage of time.

Papers in this version

Showing 60 of 286 papers.

History & citationVersion 2 · 2026-10-04

Current · Permanent link

  1. Version 2 (latest) · 2026-10-04 · 166 papers
  2. Version 1 · 2026-10-04 · 286 papers
Cite this direction

Latest version (a living page):

@misc{lacuna_dilated_causal_convolutions_1fa1d17a,
  title = {dilated causal convolutions},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/dilated-causal-convolutions/rdr_1fa1d17abbae4f8ab0b60408306139d4},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-22},
}

This exact version (version 1, frozen text):

@misc{lacuna_dilated_causal_convolutions_for_temporal_1fa1d17a_v1,
  title = {Dilated Causal Convolutions for Temporal Modeling},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/dilated-causal-convolutions-for-temporal-modeling/rdr_1fa1d17abbae4f8ab0b60408306139d4/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-22},
}