Generalizations of the Normalized Radon Cumulative Distribution Transform for Limited Data Recognition

Matthias Beckmann, Robert Beinert, Jonas BrescharXiv 2025 · DOI · arXiv

Introduction

In the era of "Big Data," many critical domains—such as identifying historical watermarks or diagnosing rare medical conditions—face a persistent "Small Data" challenge. Deep learning models typically require massive datasets to generalize across variations in rotation, scale, or shear. When only a handful of examples are available, these models often struggle to perform.

Beckmann et al. propose a solution in their paper, "Generalizations of the Normalized Radon Cumulative Distribution Transform for Limited Data Recognition." By merging the geometry of the Radon transform with the physics of Optimal Transport, the authors develop a mathematical framework that is inherently invariant to affine transformations. This approach creates a feature space where recognition is possible even with extremely limited training data.

Methodology

The framework builds upon the Radon Cumulative Distribution Transform (R-CDT) by introducing a novel "h-normalization" process. This method ensures that the final representation of an object remains identical regardless of whether it has been rotated, scaled, or sheared.

The Radon Transform

The process begins with the Radon transform, which represents a 2D image as a collection of 1D projections or "slices" taken from various angles. This effectively converts a 2D spatial problem into a series of 1D signal problems.

Geometry of the Radon transform showing projections at angle $\theta$.

Optimal Transport and h-Normalization

Each 1D slice is mapped to a reference signal using a Monge map, a tool from Optimal Transport. However, affine transformations cause these slices to shift, scale, and reorder. The authors introduce a flexible aggregation function ($h$) to process these slices. As shown in the mathematical derivations below, specific transformations like rotation and scaling have predictable effects on the Radon transform that can be neutralized through this normalization.

Mathematical effects of various affine transformations on the Radon transform.

This "h-normalization" allows the transform to collapse an entire class of transformed objects (e.g., all possible rotations of a specific shape) into a single point in the feature space. This makes classification trivial, often requiring only a simple linear boundary.

Experimental Evaluation

The authors validated their method across diverse datasets, including synthetic 2D symbols, MNIST digits under affine transforms (LinMNIST), historical watermarks, and 3D meshes.

  • One-Shot Learning: On synthetic datasets, the model achieved 100% accuracy using only a single training sample per class.
  • Real-World Robustness: For historical watermarks (filigranology), the proposed tvNR-CDT (Total Variation normalization) reached 92% accuracy, significantly outperforming standard Euclidean baselines.
  • 3D Generalization: The framework was extended to 3D point clouds and the SO(3) rotation group. In 3D animal recognition, the generalized transform achieved perfect classification (1.00), while non-invariant versions hovered around 0.25.

Discussion and Conclusion

The primary advantage of this method is its mathematical guarantee of invariance. Unlike neural networks that must learn to ignore rotations through data augmentation, this transform is "blind" to them by design. This makes it exceptionally efficient for "Small Data" scenarios.

However, limitations remain. The framework currently requires data to be represented as probability measures and is specifically designed for affine distortions. Non-linear warping (like a flag waving) is not yet covered. Despite these constraints, the h-normalized R-CDT offers a rigorous mathematical alternative to brute-force data augmentation.

Summary updated

Abstract

The Radon cumulative distribution transform (R-CDT) exploits one-dimensional Wasserstein transport and the Radon transform to represent prominent features in images. It is closely related to the sliced Wasserstein distance and facilitates classification tasks, especially in the small data regime, like the recognition of watermarks in filigranology. Here, a typical issue is that the given data may be subject to affine transformations caused by the measuring process. To make the R-CDT invariant under arbitrary affine transformations, a two-step normalization of the R-CDT has been proposed in our earlier works. The aim of this paper is twofold. First, we propose a family of generalized normalizations to enhance flexibility for applications. Second, we study multi-dimensional and non-Euclidean settings by making use of generalized Radon transforms. We prove that our novel feature representations are invariant under certain transformations and allow for linear separation in feature space. Our theoretical results are supported by numerical experiments based on 2d images, 3d shapes and 3d rotation matrices, showing near perfect classification accuracies and clustering results.
BibTeX
@misc{beckmann2025generalizations,
  author = {Matthias Beckmann and Robert Beinert and Jonas Bresch},
  title = {{Generalizations of the Normalized Radon Cumulative Distribution Transform for Limited Data Recognition}},
  year = {2025},
  eprint = {2512.08099},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2512.08099},
}
Figure