Abstract
This paper establishes a new theoretical foundation for solving Separable Nonlinear (SNL) inverse problems—where data is a linear combination of nonlinear functions—using convex optimization. While standard Compressed Sensing (CS) relies on randomness and "incoherence," this work proves that exact recovery is possible in deterministic, highly correlated settings. The core finding is that recovery is guaranteed if the underlying parameters are sufficiently separated relative to the "correlation decay" of the measurement operator.
Introduction
Many scientific and engineering challenges involve extracting discrete parameters from nonlinear measurements. These are often categorized as Separable Nonlinear (SNL) problems, where a signal is composed of a sum of components, each defined by a linear weight (amplitude) and a nonlinear parameter (such as location or frequency). Common examples include deconvolution in seismology, super-resolution in imaging, and source localization in physics.
Traditionally, these problems are approached via nonlinear least-squares, which are notoriously difficult to optimize due to non-convexity and local minima. A more robust alternative is "linearizing" the problem by treating it as a sparse recovery task on a continuous domain, solved via Total-Variation (TV) norm minimization.
Theoretical Framework: Embracing Correlation
Standard Compressed Sensing theory often fails to explain the success of TV-norm minimization in SNL problems because it requires "incoherent" measurement operators, typically achieved through randomness. In contrast, SNL measurements are deterministic and highly correlated—small changes in a parameter lead to small changes in the measurement signature.
The authors propose a framework based on the correlation structure of the measurement operator. They define three critical conditions on the correlation function:
- Near Condition: Local concavity and smoothness at the peak.
- Intermediate Condition: Bounding the correlation away from the peak.
- Decay Condition: Predictable drop-off (e.g., exponential) as parameters separate.
By constructing a novel "correlation-based dual certificate," the authors prove that exact recovery is guaranteed if the true parameters meet a minimum separation distance $\Delta$. This distance is derived directly from the constants governing the correlation decay and its derivatives, rather than relying on stochastic properties.
Applications and Validation
The theory was validated using simulations across diverse physical domains, most notably in EEG brain activity localization and heat-source detection.
EEG Brain Activity
Using the ICBM152 template to model complex head geometry, the researchers simulated brain activity from 256 sensors. The method successfully recovered three distinct sources across the occipital, temporal, and frontal lobes. This demonstrates that the theory holds even in the presence of the complex, non-uniform geometry of the human cortex.
Heat-Source Localization
In tests involving non-uniform thermal conductivity, the authors found that "correlation-aware" separation was a significantly more accurate predictor of recovery success than simple physical distance. This highlights the importance of accounting for local resolution variations in real-world physics.
Conclusion and Future Work
This work shifts the paradigm of sparse recovery from a reliance on randomness to a reliance on parameter separation and correlation decay. While solving these problems on high-dimensional grids remains computationally intensive, the framework provides a rigorous foundation for applying convex optimization to complex nonlinear inverse problems. Future research directions include improving computational efficiency through machine learning and refining the stability analysis for noisy environments.
Summary updated