Guest Editorial: Non-Euclidean Machine Learning

Stefanos Zafeiriou, Michael M. Bronstein, Taco Cohen, Oriol Vinyals, Le Song, Jure Leskovec, Pietro Liò, Joan Bruna, Marco GoriIEEE TPAMI 2022 · DOI · OpenReview

Introduction

The last decade of deep learning has been dominated by models like Convolutional Neural Networks (CNNs), which operate on the assumption that data resides on a flat, Euclidean grid. While this paradigm has revolutionized image and signal processing, it fails to capture the intrinsic geometry of many real-world datasets. Social networks, protein structures, and medical scans of curved organs exist on graphs, manifolds, or 3D meshes. Forcing such "non-Euclidean" data into standard grid-based architectures leads to a loss of critical structural information. This guest editorial for IEEE TPAMI explores the emerging field of Geometric Deep Learning, synthesizing twelve groundbreaking papers that develop unified frameworks and specialized architectures to respect and exploit the natural geometry of complex data.

Methodological Pillars

The featured research can be categorized into two primary methodological pillars: Graph Neural Networks and manifold-valued architectures.

Graph Neural Networks (GNNs)

GNNs extend deep learning to irregular graph structures by moving beyond simple message-passing schemes. Key innovations highlighted in this section include:

  • Constrained Optimization: One approach formulates GNN learning as a Lagrangian framework, allowing for the joint estimation of node states and model parameters, which provides a more rigorous optimization path than traditional iterative methods.
  • Structure-Attribute Transformers (SAT): This model addresses the challenge of missing node attributes by decoupling graph structure from content. By matching their distributions, the SAT can infer missing data without compromising the structural integrity of the graph.
  • Partial Permutation Invariance (PINE): To capture local neighborhood dependencies without losing structural information, the PINE method introduces a framework applicable to both homogeneous and heterogeneous graphs, ensuring that the model remains sensitive to the specific topology of the network.

Manifold-valued Networks

These architectures redefine fundamental operations like convolution for curved surfaces, known as Riemannian manifolds. Standard linear operations fail here because the sum of two points on a manifold often falls off the manifold.

  • ManifoldNet: This network utilizes the Weighted Fréchet Mean (wFM) instead of standard linear combinations. This ensures that intermediate representations remain on the manifold as they flow through the network layers.
  • VolterraNet: This model extends convolutions to higher-order functional samples on Riemannian spaces. A key focus is ensuring equivariance—consistency under geometric transformations like rotations or shifts—which is essential for robust feature extraction on curved surfaces.

Applications and Benchmarking

The theoretical advancements in Geometric Deep Learning are validated across a wide range of practical applications and datasets:

  • Computer Vision and Omni-directional Imagery: Spherical CNNs utilize spherical polyhedrons to process 360-degree images directly. This avoids the severe distortions caused by flattening spherical data into rectangular grids. These models have outperformed state-of-the-art Euclidean methods in depth estimation tasks.
  • Medical Imaging and Neuroanalysis: New graph pooling techniques designed for brain surface analysis aggregate nodes based on spectral embeddings. This allows for more biologically relevant feature reduction than simple spatial proximity. These methods have shown significant improvements in classifying Alzheimer’s disease stages and regressing cortical region sizes from 3D brain scans.
  • Social and Biological Networks: Research in this area focuses on node completion and link prediction, utilizing datasets that model complex interactions where Euclidean assumptions are fundamentally invalid.
  • 3D Graphics and Facial Dynamics: Manifold-valued GANs have been applied to videos of facial expressions and 3D meshes for object modeling, demonstrating the power of geometric priors in generative tasks.

Key Insights and Theoretical Advancements

Several recurring themes emerge across the featured works, pointing toward a more mature mathematical foundation for the field:

  • The Centrality of Equivariance: For a model to generalize effectively on a manifold, its internal representations must be equivariant to the manifold's isometries. This ensures that if the input data is rotated or shifted, the network's internal representation transforms accordingly rather than breaking.
  • Decoupling Structure and Content: Treating the "shape" (links) and "content" (node attributes) of a graph as distinct entities allows for more robust handling of incomplete data. This separation enables models to learn the underlying distribution of attributes independently of the connectivity.
  • The Utility of Synthetic Data: Research suggests that synthetic data can serve as a valid proxy for real data in complex statistical group difference tests. This is particularly valuable in neuroimaging, where acquiring large, high-quality datasets is often difficult.

Future Directions

Despite these successes, the field faces ongoing challenges. There is a pressing need to unify disparate efforts in graph and manifold learning into a cohesive "Geometric Deep Learning" theory. Furthermore, scaling these mathematically elegant models to massive, real-world datasets—such as the global web graph—remains a significant computational hurdle. Future research must also address the problem of missing structural data (edges) with the same rigor currently applied to missing node attributes.

Summary updated

Abstract

Over the past decade, deep learning has had a revolutionary impact on a broad range of fields such as computer vision and image processing, computational photography, medical imaging and speech and language analysis and synthesis etc. Deep learning technologies are estimated to have added billions in business value, created new markets, and transformed entire industrial segments. Most of today’s successful deep learning methods such as Convolutional Neural Networks (CNNs) rely on classical signal processing models that limit their applicability to data with underlying Euclidean grid-like structure, e.g., images or acoustic signals. Yet, many applications deal with non-Euclidean (graph- or manifold-structured) data. For example, in social network analysis the users and their attributes are generally modeled as signals on the vertices of graphs. In biology protein-to-protein interactions are modeled as graphs. In computer vision & graphics 3D objects are modeled as meshes or point clouds. Furthermore, a graph representation is a very natural way to describe interactions between objects or signals. The classical deep learning paradigm on Euclidean domains falls short in providing appropriate tools for such kind of data. Until recently, the lack of deep learning models capable of correctly dealing with non-Euclidean data has been a major obstacle in these fields. This special section addresses the need to bring together leading efforts in non-Euclidean deep learning across all communities. From the papers that the special received twelve were selected for publication. The selected papers can naturally fall in three distinct categories: (a) methodologies that advance machine learning on data that are represented as graphs, (b) methodologies that advance machine learning on manifold-valued data, and (c) applications of machine learning methodologies on non-Euclidean spaces in computer vision and medical imaging. We briefly review the accepted papers in each of the groups.
BibTeX
@article{zafeiriou2022guest,
  author = {Stefanos Zafeiriou and Michael M. Bronstein and Taco Cohen and Oriol Vinyals and Le Song and Jure Leskovec and Pietro Liò and Joan Bruna and Marco Gori},
  title = {{Guest Editorial: Non-Euclidean Machine Learning}},
  journal = {IEEE Trans. Pattern Anal. Mach. Intell.},
  year = {2022},
  doi = {10.1109/tpami.2021.3129857},
}
Figure