Shape-Adaptive Subspace-Constrained Quadratic Matrix Factorization

Zheng Zhai, Zhuan Liang, Sujun GuoarXiv 2026 · arXiv

Fitting low-dimensional manifolds to high-dimensional data is a cornerstone of modern data science, but it usually comes with a catch: you have to guess the noise distribution. If you assume Gaussian noise (using a standard $L_2$ loss) but your data has heavy-tailed outliers, your model will likely fail.

A new paper, "Shape-Adaptive Subspace-Constrained Quadratic Matrix Factorization," introduces a framework called AMLE-SQMF that solves this by letting the data tell the model what the noise looks like.

TL;DR

AMLE-SQMF is a manifold learning method that jointly estimates a quadratic surface and the underlying noise distribution using a Generalized Gaussian model. By automatically adapting its loss function to the data's specific "tail behavior," it achieves state-of-the-art robustness in denoising and reconstructing complex, nonlinear structures.

What Problem Does This Paper Address?

Most manifold learning techniques rely on local linear or quadratic approximations. While quadratic models are excellent at capturing curvature, their performance is tethered to the choice of loss function.

The "residual"—the difference between your data point and the fitted manifold—isn't just random sensor noise; it also includes the error from truncating higher-order geometric terms. Consequently, these residuals rarely follow a perfect Gaussian distribution. Existing methods that fix the loss function (like Mean Squared Error) lack the flexibility to handle diverse noise regimes, such as the heavy tails found in the Laplace distribution or the "peaky" distributions of real-world image data.

Methods

The authors propose an Alternating Maximum Likelihood Estimation (AMLE) framework. The core components include:

  1. Generalized Gaussian Distribution (GGD) Modeling: Instead of a fixed loss, they model residuals using a GGD. This distribution features a shape parameter $p$. When $p=2$, you get Gaussian noise; when $p=1$, you get Laplace noise. AMLE-SQMF treats $p$ as a variable to be learned.
  2. Profile Likelihood: To simplify the math, the authors analytically "profile out" the scale parameter of the noise. This reduces the complex joint optimization problem into a more manageable one involving only the manifold parameters and the shape parameter $p$.
  3. Geometric Constraints: The model explicitly preserves the orthonormality of tangent and normal bases. This ensures the resulting quadratic model is geometrically interpretable (capturing the center, tangent space, and curvature).
  4. Immediate Residual Gradient Update (IRGU): Standard gradient descent can be slow. The authors introduced IRGU, which refreshes the residual matrix immediately after each parameter block is updated. This "on-the-fly" adjustment significantly accelerates convergence.
Fig. 1. Illustration of local quadratic surface fitting to noisy sphere samples using IRGU. The blue sphere shows the original unit sphere, and the colored patches show the fitted quadratic surfaces. Circles and crosses represent noisy samples and their Euclidean projections onto the fitted surfaces, respectively. Diamonds and stars represent the noisy neighborhood centers and their projections, respectively.

Datasets

The authors validated their approach on a mix of synthetic and real-world benchmarks:

  • Synthetic Manifolds: A unit sphere in $\mathbb{R}^3$ and a 2D quadratic manifold embedded in high-dimensional spaces (up to $\mathbb{R}^{150}$).
  • Frey Face: A classic dataset of face images used to test parameter estimation accuracy.
  • Isomap Face Dataset: Used to evaluate reconstruction performance under various noise types (Gaussian, Logistic, and Student-$t$).
  • Yale Face Database B: Used to demonstrate latent-space interpolation and lighting variation modeling.

Key Insights and Ideas

  • The Shape Matters: The paper demonstrates that the estimation of the shape parameter $p$ becomes more accurate as the ambient dimension ($D$) and sample size ($n$) increase. Interestingly, increasing the dimension $D$ often has a stronger positive effect on $p$-estimation than simply adding more samples.
  • Adaptive Loss Selection: By learning $p$, the model effectively chooses the optimal "norm" (e.g., $L_1$ vs $L_2$) for the fitting task automatically.
  • Efficiency Gains: The IRGU strategy isn't just a minor tweak; it consistently outperforms standard gradient descent across different noise regimes, reaching the optimum in fewer iterations.
Fig. 2. Objective function value F versus iteration number for GD and IRGU when fitting a local quadratic surface to noisy sphere samples. Panels (a)–(d) use p = 1.25, 1.5, 1.75, 2, respectively, for both the noise shape and the fitting loss exponent.

Key Results

  • Computational Speed: In sphere-fitting tests, IRGU was significantly faster than standard Gradient Descent. For instance, at $p=1.25$, IRGU took 2.32 seconds compared to 13.91 seconds for standard GD.
  • Reconstruction Accuracy: On the Isomap Face dataset, AMLE-SQMF achieved the lowest Mean Squared Error (MSE) across almost all noise conditions. It notably outperformed fixed-exponent models when the noise was non-Gaussian (e.g., Logistic or Student-$t$ noise).
  • Robustness: The method proved highly resilient to outliers. Even when the true noise wasn't strictly Generalized Gaussian (like Student-$t$), the adaptive nature of the GGD model provided an effective "best fit" loss function that maintained high reconstruction quality.

Limitations and Future Work

While powerful, the authors note a few areas for growth:

  • Structured Noise: The current model assumes residuals are independent and identically distributed (i.i.d.). In many real-world scenarios, noise might be correlated or structured.
  • Higher-Order Geometry: The framework is currently limited to quadratic approximations. Extending this to higher-order local manifold representations could capture even more complex geometries.
  • Theoretical Guarantees: While the algorithm converges in practice, establishing stronger theoretical proofs for the statistical consistency of the shape parameter estimator remains an open challenge.

Summary updated

Abstract

Quadratic manifold fitting provides a flexible framework for modeling nonlinear low-dimensional structures embedded in high-dimensional spaces. However, existing methods typically employ prescribed noise models or fixed loss functions, limiting their adaptability to varying noise characteristics. To address this limitation, we propose an alternating maximum likelihood estimation method for subspace-constrained quadratic matrix factorization, termed AMLE-SQMF, which jointly estimates the quadratic manifold and the underlying noise distribution. Specifically, we model the residuals using a generalized Gaussian distribution (GGD), whose shape parameter controls the tail behavior and determines the associated fitting loss. By exploiting the closed-form maximum likelihood estimator of the scale parameter, we eliminate the scale variable and derive a profile negative log-likelihood. Based on this formulation, we develop an alternating optimization algorithm that iteratively updates the manifold parameters and estimates the noise shape parameter. This enables adaptive loss selection within a unified likelihood-based framework, without requiring prior specification of the noise characteristics. Experiments on synthetic and real-world datasets demonstrate the effectiveness of AMLE-SQMF in quadratic manifold fitting and its robustness to diverse noise distributions.
BibTeX
@misc{zhai2026shape,
  author = {Zheng Zhai and Zhuan Liang and Sujun Guo},
  title = {{Shape-Adaptive Subspace-Constrained Quadratic Matrix Factorization}},
  year = {2026},
  eprint = {2611.11313},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.11313},
}
Figure