Spectral Analysis on Manifolds and Meshes

This direction is split into other directions: spectral domain perturbation. Its last version stays readable and citable here.

Version 1 of 180 papers90 conceptsfrozen 2026-10-04

To understand a signal on a flat grid, we use the Fourier Transform. It decomposes complex waves into simple sines and cosines, allowing us to talk about "low frequencies" (the big picture) and "high frequencies" (the fine details). But how do you perform this analysis on the surface of a 3D-scanned dragon, a human brain, or a social network?

The research direction across these papers centers on generalizing signal processing to non-Euclidean domains—manifolds and graphs—by leveraging the Laplace-Beltrami Operator (LBO). By treating a 3D shape as a vibrating drum, researchers can find its "natural frequencies" and use them as a universal coordinate system for everything from generative modeling to adversarial defense.

The Intuition: Geometry as Vibration

The core mechanism is the spectral decomposition of the LBO. In Euclidean space, the Laplacian measures the second derivative (curvature). On a manifold, the LBO captures how a function varies across a curved surface.

As Andrei Zaharescu, Edmond Boyer, and Radu Horaud describe in Scale-space representation of scalar functions on 2D manifolds, the eigenfunctions of this operator serve as a "Fourier-like" basis.

Think of these eigenfunctions as the standing waves of a vibrating object. The first few eigenfunctions (low eigenvalues) represent the global structure—the "silhouette" of the shape. Higher eigenfunctions represent increasingly fine surface details. This allows researchers to treat 3D geometry as a digital signal:

Why It Works: Intrinsic Invariance

The reason this spectral approach is so powerful for 3D vision is that it is intrinsic. If a person bends their arm, the Euclidean distance between their hand and shoulder changes, but the "vibrational modes" of their skin (the manifold) remain largely the same.

This property is the foundation of Functional Maps. Instead of trying to match thousands of individual points between two shapes, Anastasia Dubrovina and Ron Kimmel show in Spectral Generalized Multi-Dimensional Scaling that you can align shapes by matching their spectral signatures. This turns a massive combinatorial problem into a small matrix optimization. Zorah Lähner and Emanuele Rodolà even extend this to match 2D sketches to 3D models by treating the sketch as a flat manifold.

From Geometry to Neural Networks

If we can define "frequency" on a manifold, we can define "convolution." Traditional Convolutional Neural Networks (CNNs) rely on a fixed grid, which doesn't exist on a curved surface. Manifold Neural Networks (MNNs) solve this by performing convolutions in the spectral domain.

Zhiyang Wang, Alejandro Ribeiro, and Luana Ruiz have proven that these networks are stable to deformations. This means a model trained on one mesh will still work if the mesh is slightly stretched or noisy. Furthermore, Deanna Needell and Joyce A. Chew demonstrated in A Convergence Rate for Manifold Neural Networks that as we sample more points from a surface, the discrete graph-based network mathematically converges to a continuous manifold operator.

New Frontiers: Generative Models and Attacks

The spectral perspective is now moving beyond static analysis into dynamic generation and security:

  1. Generative Flows: Ricky T. Q. Chen and Yaron Lipman use spectral distances to guide Flow Matching on General Geometries, allowing models to "flow" data distributions across complex 3D meshes without expensive geodesic calculations.
  2. Spectral Adversaries: Attackers are also using this "frequency" logic. Daizong Liu and Wei Hu developed GSDA and 3DHacker, which fool 3D classifiers by perturbing only specific spectral components. Because these attacks happen in the frequency domain, they can be devastating to the model while remaining invisible to the human eye, as they don't create the "jagged" outliers typical of coordinate-based attacks.
  3. Intrinsic Neural Fields: Lukas Koestler and Zorah Lähner introduced Intrinsic Neural Fields, which use LBO eigenfunctions as input features for MLPs. This allows neural networks to learn textures and functions directly on surfaces, making them naturally invariant to how the object is posed in 3D space.

By shifting the problem from "where are the points?" to "how does the surface vibrate?", this research direction provides a mathematically rigorous bridge between classical signal processing and modern geometric deep learning.

Papers in this version

Showing 60 of 80 papers.

History & citationVersion 1 · 2026-10-04

Split into other directions · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_spectral_analysis_on_manifolds_and_meshe_48ebd7ea,
  title = {Spectral Analysis on Manifolds and Meshes},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/spectral-analysis-on-manifolds-and-meshes/rdr_48ebd7ea364e4da99ae0230f4502e961},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 1, frozen text):

@misc{lacuna_spectral_analysis_on_manifolds_and_meshe_48ebd7ea_v1,
  title = {Spectral Analysis on Manifolds and Meshes},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/spectral-analysis-on-manifolds-and-meshes/rdr_48ebd7ea364e4da99ae0230f4502e961/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}