Computational imaging based on single-photon detection: a survey

Yanyun Pu, Chengyuan Zhu, Gongxin Yao, Chao Li, Yu Pan, Kaixiang Yang, Qinmin Yang

Introduction

The field of single-photon computational imaging is undergoing a rapid transformation, bridging the gap between advanced hardware and sophisticated reconstruction algorithms. By utilizing detectors capable of sensing individual light particles with picosecond precision, researchers can now generate high-fidelity 3D images from sparse and noisy data. This survey, published in Artificial Intelligence Review, provides a comprehensive roadmap of these developments.

The Challenge of Single-Photon Data

Traditional imaging systems often fail in extreme conditions such as low light, heavy scattering (fog, underwater), or when targets are obscured. Single-photon detectors (SPDs) like Single-Photon Avalanche Diodes (SPADs) and Superconducting Nanowire Single-Photon Detectors (SNSPDs) offer the ultimate sensitivity required for these scenarios. However, they introduce significant data challenges.

The raw output of an SPD is typically a "click" indicating a photon arrival. Constructing an image requires measuring the Time-of-Flight (ToF) for millions of these events, resulting in "sparse" data volumes with extremely low Signal-to-Background Ratios (SBR). The core research question is how to efficiently extract meaningful 3D structures and reflectivity maps from just a few detected photons per pixel.

Methodology and Research Landscape

The authors categorize the field into three primary pillars:

  1. Hardware Evolution: The transition from bulky Photomultiplier Tubes (PMTs) to compact SPADs and high-efficiency SNSPDs.
  2. Bibliometric Analysis: Using tools like CiteSpace, the authors quantitatively mapped the research landscape. As shown in the chart below, the number of publications in this field has seen a steady and significant increase over the last decade, with key contributions from institutions like Heriot-Watt University and the Chinese Academy of Sciences.
Annual distribution of publications on single-photon imaging from 2012 to 2023.
  1. Algorithmic Taxonomy: Reconstruction techniques are divided into:
  2. Photon-efficient algorithms: Utilizing Bayesian inference and "first-photon" logic for minimal data reconstruction.
  3. Deep Learning (DL): Employing CNNs and GANs (e.g., SPADnet, flimGANE) for end-to-end denoising and super-resolution.
  4. Sparse Characteristic Algorithms: Implementing sparse convolutions to process 3D data cubes efficiently by ignoring empty voxels.

Key Insights and Applications

  • The Sparsity Advantage: Sparse Convolution allows neural networks to process high-resolution 3D frames in real-time by focusing only on active regions.
  • Hardware-Software Co-design: "Smart" scanning techniques, such as sub-pixel scanning combined with inverse convolution, can surpass the physical resolution limits of detector arrays.
  • Non-Line-of-Sight (NLOS) Imaging: By timing "three-bounce" photons (Laser → Wall → Hidden Object → Wall → Detector), algorithms can reconstruct objects hidden around corners.
  • Accelerated Bioimaging: In Fluorescence Lifetime Imaging (FLIM), deep learning models achieve speeds up to 2800x faster than traditional methods, enabling real-time biological monitoring.

Performance Benchmarks

The survey highlights several record-breaking results:

  • Extreme Sensitivity: Algorithms like PRS-Net can reconstruct depth images with an average of only 1 photon per pixel at an SBR of 0.01.
  • Long-Range Sensing: Single-photon LiDAR range has progressed from 1 km in 2013 to over 200 km in 2021.
  • Obscurant Penetration: Systems can now acquire 3D profiles through five attenuation lengths of smoke or fog, conditions that would typically cause a total white-out for conventional sensors.

Future Outlook and Limitations

Despite significant progress, several hurdles remain. High-performance SNSPDs require cryogenic cooling, limiting portability. Additionally, scaling SPAD arrays creates a data bandwidth bottleneck, with timing data reaching gigabits per second. Deep learning models also face generalization issues when moving from simulated to real-world noise.

Future research is expected to focus on multimodal fusion—combining single-photon data with standard RGB or thermal imaging—and the development of on-chip processing to handle data directly at the source.

Summary updated

Abstract

The rapid advancements in single-photon detectors with picosecond timing resolution over the past decade have significantly driven the development of time-correlated single-photon counting (TCSPC) for computational imaging applications, including bioimaging and remote sensing. In this review, we utilize the CiteSpace tool to create knowledge maps and perform a bibliometric analysis of this research area. Furthermore, we provide a comprehensive overview of the key challenges associated with computational imaging using temporal single-photon counting. We also highlight how these challenges have been addressed under extreme conditions to establish a reference model for future imaging solutions. We examine the performance evaluation parameters of single-photon detectors to enhance the understanding of detector array scaling and their application in constructing efficient computational imaging systems. Lastly, we aim to elucidate the current technical challenges in single-photon detector-based computational imaging and explore their potential future developments.
BibTeX
@article{pu2025computational,
  author = {Yanyun Pu and Chengyuan Zhu and Gongxin Yao and Chao Li and Yu Pan and Kaixiang Yang and Qinmin Yang},
  title = {{Computational imaging based on single-photon detection: a survey}},
  journal = {Artif. Intell. Rev.},
  year = {2025},
  doi = {10.1007/s10462-025-11252-4},
}
Figure