Abstract
Tissue oxygenation ($StO_2$) is a critical biomarker for assessing tissue viability in conditions such as sepsis, diabetes, and surgical recovery. While Spatial Frequency Domain Imaging (SFDI) provides a non-contact method for mapping $StO_2$, conventional multi-image acquisition is slow and motion-sensitive. This work introduces OxyGAN, an end-to-end deep learning framework using conditional generative adversarial networks (cGANs) to map $StO_2$ from a single snapshot of structured light. OxyGAN achieves over 96% accuracy and enables 25Hz video-rate imaging, outperforming traditional physics-based and hybrid methods by approximately 25%.
Introduction
Mapping tissue oxygenation ($StO_2$) over a wide field of view is essential for real-time clinical assessment. Spatial Frequency Domain Imaging (SFDI) is a leading technique for this purpose, but its reliance on multiple sequential images creates a bottleneck, making it susceptible to patient movement and unsuitable for high-speed applications. Single-snapshot methods (SSOP) attempt to solve this but often suffer from image artifacts and reduced accuracy.
Methods
OxyGAN utilizes a conditional Generative Adversarial Network (cGAN) to directly map raw structured-light images to $StO_2$ maps. The generator is a fusion network combining U-Net's spatial context capabilities with ResNet's residual learning efficiency, allowing the model to learn both local features and high-level spatial structures.
The model processes a three-channel input: structured-light images at 659 nm and 851 nm, and a reference "checkerboard" channel to account for hardware system drift. By employing an end-to-end learning strategy, OxyGAN avoids the compounding errors typical of multi-step "hybrid" models that first calculate intermediate optical properties like absorption coefficients. To achieve real-time performance, the model was optimized using NVIDIA TensorRT, reaching an inference latency of approximately 0.04s.
Results and Discussion
The model demonstrated high accuracy (96.5%) on human feet and maintained strong performance (93.0%) on unseen tissue types, such as pig colon and human hands across various skin types. OxyGAN significantly reduced "fringe" artifacts common in single-snapshot imaging by learning the underlying distribution of tissue structures rather than relying on simple frequency filtering.
Compared to traditional SSOP and hybrid deep learning models, OxyGAN provided a performance gain of approximately 25%. The ability to produce clean, accurate oxygenation maps at 25Hz enables its use in dynamic environments like the operating room for real-time surgical guidance.
Conclusion
OxyGAN provides a robust, high-speed solution for tissue oxygenation mapping. By integrating adversarial learning with a simplified snapshot acquisition protocol, it bridges the gap between high-fidelity multi-image SFDI and the speed requirements of clinical practice. Future work will explore more diverse datasets and alternative illumination strategies to further enhance the system's accessibility and robustness.
Summary updated