Deep Learning Diffuse Optical Tomography

Jae Jun Yoo, Sohail Sabir, Duchang Heo, Kee Hyun Kim, Abdul Wahab, Yoonseok Choi, Seul-I Lee, Eun Young Chae, Hak Hee Kim, Young Min Bae, Young-Wook Choi, Seungryong Cho, Jong Chul YeIEEE TMI 2020 · OpenReview

TL;DR

This paper introduces a novel deep learning approach for Diffuse Optical Tomography (DOT) that directly learns the complex, non-linear physics of photon scattering. By inverting the Lippman-Schwinger equation using a specialized convolutional framelet network, they achieve accurate 3D reconstruction of optical anomalies in phantoms and live animals, outperforming traditional methods.

What Problem Does This Paper Address?

Diffuse Optical Tomography (DOT) is a promising non-invasive imaging technique, particularly for detecting changes in hemoglobin oxidation levels relevant to breast cancer. However, DOT faces significant challenges due to the highly non-linear and ill-posed nature of photon scattering within biological tissues. This complexity makes conventional reconstruction algorithms sensitive to imaging parameters and often requires extensive manual tuning. The core problem is accurately reconstructing the internal optical properties of tissues from limited surface measurements, a task made difficult by the diffusive nature of light and the resulting scattering.

Methods

The authors propose a deep learning framework designed to directly learn the inversion of the Lippman-Schwinger integral equation, which mathematically describes photon propagation in scattering media. Unlike typical "black-box" deep learning methods, their network is inspired by the mathematical theory of deep convolutional framelets. This approach leads to a structured network architecture:

  • Fully Connected Layer: Acts as an initial, albeit noisy, inversion of the forward operator.
  • Convolutional Encoder-Decoder Structure: This core component, built using paired encoder and decoder filters derived from convolutional framelets, refines the initial inversion to produce a clean 3D reconstruction. This structure is designed to capture the specific physics of the problem.
  • Training Strategy: The network is trained using simulated data generated from the diffusion equation. Importantly, the training incorporates additive Gaussian noise and dropout to enhance generalization and robustness.

Datasets

  • Training Data: Generated using the Finite Element Method (FEM) solver NIRFAST. This involved creating 1500 simulated 3D datasets with randomly placed spherical heterogeneities of varying sizes and optical properties, mimicking biomimetic and breast-mimetic phantoms.
  • Evaluation Data: The trained network was evaluated on:
  • Numerical phantoms (used for training and hyperparameter tuning).
  • Biomimetic phantoms (polypropylene with a cylindrical cavity).
  • Breast-mimetic phantoms (custom-made chamber with blood-filled polymer tubes mimicking tumors).
  • In vivo animal experiments (mice, both normal and tumor-bearing).

Key Insights and Ideas

  • Physics-Informed Deep Learning: The network's architecture is not arbitrary but is derived from the mathematical formulation of the inverse scattering problem (Lippman-Schwinger equation). This "top-down" design principle allows the network to learn the underlying physics more effectively than a purely data-driven approach.
  • Generalization from Simulation: The network, trained solely on simulated data, demonstrates remarkable performance on real-world phantoms and in vivo experiments, suggesting strong generalization capabilities. This is attributed to the physics-informed architecture and robust training techniques (noise, dropout).
  • End-to-End Inversion: The proposed method directly reconstructs the 3D optical anomaly distribution from raw measurement data, bypassing the need for iterative procedures or manual parameter tuning common in conventional methods.
  • Robustness to Noise and Mismatches: The network shows resilience to varying signal-to-noise ratios (SNR) and even to mismatches in boundary conditions between training and testing data, highlighting its practical utility.

Key Results

  • Quantitative Performance: The proposed deep learning method consistently outperformed conventional algorithms (Rytov iterative LM and sparse recovery with L1 penalty) across various metrics, including Root Mean Square Error (RMSE), Pearson correlation, Structural Similarity Index (SSIM), and Contrast-to-Noise Ratio (CNR), especially in challenging scenarios like boundary condition mismatches.
  • Qualitative Reconstruction: The network accurately recovered the location and relative sizes of anomalies in biomimetic and breast-mimetic phantoms. For in vivo experiments, it successfully identified high absorption values at expected locations (e.g., spine, tumor on thigh) while avoiding spurious high-intensity artifacts seen in conventional methods.
  • Speed: The deep learning approach processes data in milliseconds, a significant speedup compared to the minutes required by conventional iterative methods.

Limitations and Future Work

  • Clinical Applicability: The authors acknowledge that the current method still relies on flux measurements from a homogeneous background, which can be difficult to obtain in clinical settings. Extending the approach to handle non-homogeneous backgrounds or absolute absorption coefficient quantitation is a key future direction.
  • Hyperparameter Tuning: While the convolutional framelet theory provides a global perspective, specific hyperparameters (number of channels, filter sizes, nonlinearities) still require trial-and-error tuning.
  • Hardware Limitations: The current DOT system has limitations, such as reliance on few fibers and the need for liquid in the imaging tank, which can affect signal quality. The proposed algorithm's generality means it can be adapted to different hardware systems.
  • Handling Large Absorption Changes: While the method shows promise, recovering very large absorption changes and being robust to significant deviations in light propagation models remain challenges for DOT in general.

Summary updated

Abstract

Diffuse optical tomography (DOT) has been investigated as an alternative imaging modality for breast cancer detection thanks to its excellent contrast to hemoglobin oxidization level. However, due to the complicated non-linear photon scattering physics and ill-posedness, the conventional reconstruction algorithms are sensitive to imaging parameters such as boundary conditions. To address this, here we propose a novel deep learning approach that learns non-linear photon scattering physics and obtains an accurate three dimensional (3D) distribution of optical anomalies. In contrast to the traditional black-box deep learning approaches, our deep network is designed to invert the Lippman-Schwinger integral equation using the recent mathematical theory of deep convolutional framelets. As an example of clinical relevance, we applied the method to our prototype DOT system. We show that our deep neural network, trained with only simulation data, can accurately recover the location of anomalies within biomimetic phantoms and live animals without the use of an exogenous contrast agent.
BibTeX
@article{yoo2020deep,
  author = {Jae Jun Yoo and Sohail Sabir and Duchang Heo and Kee Hyun Kim and Abdul Wahab and Yoonseok Choi and Seul-I Lee and Eun Young Chae and Hak Hee Kim and Young Min Bae and Young-Wook Choi and Seungryong Cho and Jong Chul Ye},
  title = {{Deep Learning Diffuse Optical Tomography}},
  journal = {IEEE Trans. Medical Imaging},
  year = {2020},
  url = {https://openreview.net/forum?id=PrPOcZA86g},
}
Figure