Deep Wavelet Scattering for Stable Invariant Representations

You are reading version 1 of this direction, frozen 2026-10-04. The latest version is version 2.

Version 1 of 2124 papers156 conceptsfrozen 2026-10-04

In the standard deep learning paradigm, convolutional neural networks (CNNs) learn thousands of filters to extract features from data. While effective, these "black box" models require massive amounts of data to learn basic geometric properties like translation invariance and stability to small deformations.

The Wavelet Scattering Transform (WST), pioneered by Stéphane Mallat and Joan Bruna in Classification with Scattering Operators, offers a "white box" alternative. It replaces learned convolutional layers with a cascade of fixed, mathematically designed wavelet transforms. By doing so, it provides a representation that is inherently invariant to translations and robust to the "stretching" or "warping" of signals, all without requiring a single training parameter in its feature extraction layers.

The Problem: Why Averaging Isn't Enough

To make a representation invariant to small translations (like shifting an image by a few pixels), the simplest mathematical operation is a local average (low-pass filtering). However, averaging is a destructive process. If you average a high-frequency signal, you lose all the fine-grained structural information—the very details needed for classification.

The Scattering Transform solves this by using a three-step recursive mechanism:

  1. Wavelet Transform: Instead of a simple average, the signal is convolved with a bank of wavelets at different scales and orientations. This captures the high-frequency details that an average would kill.
  2. Modulus Nonlinearity: The complex modulus is applied to the wavelet coefficients. This acts like a "rectifier" that removes the phase (which changes rapidly with translation) but keeps the amplitude (the energy of the signal at that scale).
  3. Low-pass Filtering: The resulting modulus is then averaged to create an invariant coefficient.

Recovering Lost Information through Cascades

The genius of the scattering transform lies in its deep architecture. When we apply the low-pass filter in step 3, we still lose the high-frequency information of the modulus itself. To recover this, the WST "scatters" the signal into a second layer.

As Michael Eickenberg and colleagues demonstrated in Second Order Scattering Descriptors Predict fMRI Activity Due to Visual Textures, these second-order coefficients capture complex patterns like textures and "vibrato" that first-order transforms miss. By cascading these operations, the network builds a hierarchical representation that preserves signal energy while becoming increasingly invariant to transformations.

Stability to Deformations

Beyond simple shifts, real-world data is often "deformed." A handwritten '7' might be slightly slanted, or an ECG signal might be stretched due to a changing heart rate. Standard Fourier transforms are notoriously unstable to these small "diffeomorphisms"—a tiny stretch in time can lead to a massive change in high-frequency Fourier coefficients.

Stéphane Mallat showed in Deep Learning by Scattering that scattering transforms are Lipschitz continuous to deformations. This means that if the input changes slightly, the representation changes only slightly. This stability is why Ruizhe Zheng and others used the transform in ScatterFormer to detect epileptic discharges across different patients; the transform ignores the "noise" of individual physiological differences while focusing on the underlying signal structure.

Hybrid Networks: The Best of Both Worlds

A recurring theme in recent research is that we don't need to choose between wavelets and deep learning. Instead, we can use the Scattering Transform as a fixed "front-end" for a neural network.

Beyond Images: Molecules and Manifolds

The principles of scattering are now being applied to non-Euclidean data. Nicolas Poilvert and Matthew J. Hirn applied these transforms to quantum chemistry in Quantum Energy Regression using Scattering Transforms, using the transform's inherent rotation and translation invariance to predict molecular energy levels. Similarly, Joyce A. Chew extended the idea to high-dimensional point clouds in The Manifold Scattering Transform, proving that the intuition of "wavelet + modulus + average" is a universal tool for stable feature extraction across any domain.

Papers in this version

Showing 60 of 124 papers.

History & citationVersion 2 · 2026-10-04

Current · Permanent link

  1. Version 2 (latest) · 2026-10-04 · 97 papers
  2. Version 1 · 2026-10-04 · 124 papers
Cite this direction

Latest version (a living page):

@misc{lacuna_wavelet_scattering_transform_5789c93a,
  title = {wavelet scattering transform},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/wavelet-scattering-transform/rdr_5789c93aaa9c459ab143614c7ed774f8},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_deep_wavelet_scattering_for_stable_invar_5789c93a_v1,
  title = {Deep Wavelet Scattering for Stable Invariant Representations},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/deep-wavelet-scattering-for-stable-invariant-representations/rdr_5789c93aaa9c459ab143614c7ed774f8/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}