Invertible Neural Networks for Uncertainty Quantification in Photoacoustic Imaging

Jan-Hinrich Nölke, Tim Adler, Janek Gröhl, Thomas Kirchner, Lynton Ardizzone, Carsten Rother, Ullrich Köthe, Lena Maier-Hein

Introduction

Multispectral Photoacoustic Imaging (PAI) is a non-invasive technique that utilizes laser pulses to generate ultrasound waves, enabling the mapping of internal biological structures and functional parameters such as blood oxygenation ($sO_2$). However, the reconstruction of these properties is fundamentally "ill-posed" due to light scattering and fluence loss within tissue. Standard deep learning approaches typically provide point estimates—single "best guesses"—which can be misleading in ambiguous scenarios. If two distinct physiological states produce similar pressure measurements, a standard model may average them into a physically impossible result or arbitrarily select one. This research introduces a framework using Conditional Invertible Neural Networks (cINNs) to quantify this uncertainty by generating full posterior probability distributions.

Methodology: Conditional Invertible Neural Networks

To address the limitations of point estimation, the authors employ Conditional Invertible Neural Networks (cINNs). Unlike traditional feed-forward networks, INNs are bijective and mathematically reversible. The architecture utilized in this study consists of 20 blocks with GLOW coupling layers.

The model maps the target parameter ($sO_2$) to a latent space following a standard normal distribution, while being conditioned on the observed initial pressure spectrum. During inference, the latent space is sampled multiple times for a given pressure spectrum, allowing for the reconstruction of the full posterior probability density. To automate the detection of ambiguous results, the researchers developed a multi-mode score based on kernel density estimation, which identifies when the output distribution contains multiple peaks (modes).

Experimental Setup and Scenarios

The study was conducted in silico using the Monte Carlo eXtreme (MCX) framework to ensure access to ground truth data. Simulations involved $10^7$ photons across 26 wavelengths (700 nm to 950 nm). Three primary scenarios were tested:

  • S1 (Single Vessel): A baseline scenario featuring a single blood vessel in muscle tissue.
  • S2 (Multiple Vessels, Single IU): Designed to create ambiguity, where one vessel shields another from a single illumination unit (IU).
  • S3 (Multiple Vessels, Multiple IUs): A complex setup with three simultaneous illumination units to test if hardware redundancy can resolve ambiguity.

Results: Quantifying and Resolving Ambiguity

A key insight from the study is that uncertainty in PAI is often multi-modal rather than merely "fuzzy." In the S2 scenario, the posterior distribution frequently exhibited two distinct peaks, indicating that the model recognized two likely but different oxygenation levels.

Effect of probe positioning on posterior distribution modality.

The researchers demonstrated that this ambiguity is not just a software challenge but a design problem. By optimizing the hardware configuration—specifically by moving from a single light source (S2) to three (S3)—the multi-modal peaks collapsed into a single, accurate peak corresponding to the ground truth. Furthermore, the model's uncertainty estimates were found to be "well-calibrated," with a median calibration error of less than 1.5 percentage points (p.p.), meaning the predicted confidence intervals accurately reflected the true probability of correctness.

Comparison of posterior distributions across single-vessel (S1), multi-vessel (S2), and multi-illumination (S3) setups.

Conclusion and Future Work

This work highlights the power of cINNs in providing a transparent view of uncertainty in medical imaging. By identifying multi-modal distributions, clinicians can recognize when a measurement is unreliable and adjust the acquisition process accordingly. While the current study is limited to simulations, it lays the groundwork for "smart" photoacoustic probes. Future research will focus on translating these findings to real-world experimental settings and potentially integrating reinforcement learning to enable probes to automatically find the optimal "pose" for maximum certainty.

Summary updated

Abstract

Multispectral photoacoustic imaging (PAI) is an emerging imaging modality that enables the recovery of functional tissue parameters such as blood oxygenation. However, the underlying inverse reconstruction problems are potentially ill-posed, meaning that radically different tissue properties may-in theory-yield comparable measurements. In this work, we present a new approach for handling this specific type of uncertainty using conditional invertible neural networks. We propose going beyond commonly used point estimates for tissue oxygenation and convert single-pixel initial pressure spectra to the full posterior probability density. This way, the inherent ambiguity of a problem can be encoded with multiple modes in the output. Based on the presented architecture, we demonstrate two use cases that leverage this information to not only detect and quantify but also to compensate for uncertainties: (1) photoacoustic device design and (2) optimization of photoacoustic image acquisition. Our in silico studies demonstrate the potential of the proposed methodology to become an important building block for uncertainty-aware reconstruction of physiological parameters with PAI.
BibTeX
@inproceedings{nolke2021invertible,
  author = {Jan-Hinrich Nölke and Tim Adler and Janek Gröhl and Thomas Kirchner and Lynton Ardizzone and Carsten Rother and Ullrich Köthe and Lena Maier-Hein},
  title = {{Invertible Neural Networks for Uncertainty Quantification in Photoacoustic Imaging}},
  booktitle = {Bildverarbeitung für die Medizin},
  year = {2021},
  doi = {10.1007/978-3-658-33198-6\_80},
}
Figure