Compressive Imaging Reconstruction via Tensor Decomposed Multi-Resolution Grid Encoding

Zhenyu Jin, Yisi Luo, Xile Zhao, Deyu MengarXiv 2025 · DOI · arXiv

Introduction

Compressive Imaging (CI) is a powerful technique for capturing high-dimensional data—such as 3D video or 4D medical scans—using low-dimensional sensors. However, reconstructing the original signal from these compressed measurements remains a significant challenge. Traditional approaches often struggle with either the need for massive supervised datasets, the "spectral bias" of implicit neural representations (INRs) leading to blurry results, or the exponential scaling of grid-based methods like InstantNGP.

The authors introduce GridTD (Tensor Decomposed multi-resolution Grid encoding), an unsupervised framework designed to overcome the "curse of dimensionality." GridTD combines the high-frequency detail preservation of multi-resolution grids with the efficiency of tensor decomposition, enabling high-quality reconstruction with linear scaling in parameters and computation.

Methodology: The GridTD Framework

The core innovation of GridTD lies in its unique architecture that avoids the exponential memory growth typical of high-dimensional grids.

Overview of the GridTD framework architecture, illustrating coordinate decomposition, 1D multi-resolution grids, and CP-based tensor fusion.

The framework consists of several key components:

  1. Coordinate Decomposition: Input coordinates are decomposed into $D$ independent 1D coordinates.
  2. 1D Multi-resolution Grids: Instead of a single $D$-dimensional grid, GridTD employs lightweight 1D grids for each dimension. Features are interpolated along these lines, significantly reducing memory overhead.
  3. Tensor Fusion: Inspired by Canonical Polyadic (CP) decomposition, these 1D features are fused via element-wise products to form a unified feature vector.
  4. Temporal Affine Adapter: For video tasks, a specialized module learns motion patterns (rotation, scaling, translation) to effectively reuse temporal features across frames.
  5. PnP-ADMM Integration: The model is optimized within a Plug-and-Play Alternating Direction Method of Multipliers (PnP-ADMM) framework, ensuring spatial-temporal smoothness and principled reconstruction.

Experimental Evaluation

GridTD was evaluated across three challenging high-dimensional imaging tasks:

  • Video Snapshot Compressive Imaging (SCI): Reconstructing grayscale benchmark videos (e.g., Aerial, Vehicle, Kobe) at $256 \times 256 \times 8$ resolution.
  • Spectral SCI: Recovering 31 spectral bands from a single 2D measurement using the KAIST hyperspectral dataset.
  • Dynamic MRI: Cardiac cine imaging using the OCMR dataset to simulate various scan acceleration factors.

Key Results and Insights

GridTD demonstrates a significant advantage over existing methods, particularly as the dimensionality of the data increases.

Visual comparison of reconstruction quality for D=1, 2, and 3. GridTD maintains high fidelity and sharp edges compared to InstantNGP as dimensionality increases.

Efficiency and Scalability

The most critical finding is the shift from exponential to linear scaling. While InstantNGP's parameter count grows as $O(N^D)$, GridTD scales as $O(D)$. In a 3D toy task, GridTD achieved superior results using only 0.02M parameters—a fraction of InstantNGP’s 3.12M—while running nearly 30x faster (1.31s vs 38.05s).

Reconstruction Quality

  • Video SCI: GridTD improved average PSNR by approximately 1 dB over previous unsupervised state-of-the-art methods.
  • Spectral SCI: With an average PSNR of 36.99 dB, it outperformed the best unsupervised competitor (LRSDN) and even surpassed some supervised transformer-based models.
  • MRI: In cardiac imaging, GridTD was over 50% faster than InstantNGP and provided better preservation of structural edges during heart motion.

Theoretical Stability

The authors proved that GridTD’s Lipschitz constant scales linearly with dimension, whereas InstantNGP’s scales exponentially. This theoretical foundation explains GridTD’s increased stability and superior generalization in high-dimensional spaces.

Conclusion and Future Work

GridTD represents a major advancement in unsupervised compressive imaging. By leveraging tensor decomposition, it effectively bypasses the curse of dimensionality, offering a fast, memory-efficient, and high-fidelity solution for complex reconstruction tasks.

While the per-image optimization process remains a limitation compared to the instant inference of supervised models, the unsupervised nature of GridTD makes it invaluable for domains where ground-truth data is scarce. Future research will explore extending this framework to even higher-dimensional tasks, such as 4D+ super-resolution and hyperspectral-multispectral fusion.

Summary updated

Abstract

Compressive imaging (CI) reconstruction, such as snapshot compressive imaging (SCI) and compressive sensing magnetic resonance imaging (MRI), aims to recover high-dimensional images from low-dimensional compressed measurements. This process critically relies on learning an accurate representation of the underlying high-dimensional image. However, existing unsupervised representations may struggle to achieve a desired balance between representation ability and efficiency. To overcome this limitation, we propose Tensor Decomposed multi-resolution Grid encoding (GridTD), an unsupervised continuous representation framework for CI reconstruction. GridTD optimizes a lightweight neural network and the input tensor decomposition model whose parameters are learned via multi-resolution hash grid encoding. It inherently enjoys the hierarchical modeling ability of multi-resolution grid encoding and the compactness of tensor decomposition, enabling effective and efficient reconstruction of high-dimensional images. Theoretical analyses for the algorithm's Lipschitz property, generalization error bound, and fixed-point convergence reveal the intrinsic superiority of GridTD as compared with existing continuous representation models. Extensive experiments across diverse CI tasks, including video SCI, spectral SCI, and compressive dynamic MRI reconstruction, consistently demonstrate the superiority of GridTD over existing methods, positioning GridTD as a versatile and state-of-the-art CI reconstruction method.
BibTeX
@misc{jin2025compressive,
  author = {Zhenyu Jin and Yisi Luo and Xile Zhao and Deyu Meng},
  title = {{Compressive Imaging Reconstruction via Tensor Decomposed Multi-Resolution Grid Encoding}},
  year = {2025},
  eprint = {2507.07707},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2507.07707},
}
Figure