Diffusion-Based Virtual Staining from Polarimetric Mueller Matrix Imaging

Xiaoyu Zheng, Jing Wen, Jiaxin Zhuang, Yao Du, Jing Cong, Limei Guo, Lin Luo, Chao He, Hao Chen

Abstract

Polarization imaging offers a non-invasive method to visualize microscopic tissue structures, such as collagen alignment and cell membrane integrity, which are often invisible under standard bright-field microscopy. However, the resulting 16-channel Mueller Matrix (MM) data is complex and difficult for clinicians to interpret. This paper presents the Regulated Bridge Diffusion Model (RBDM), a novel approach to "virtually stain" these complex physical datasets into standardized Hematoxylin and Eosin (H&E) and fluorescence formats. To facilitate this research, we introduce the Multi-modality Polarization Pathology Dataset (MPPD), a benchmark of 18,000 registered image patches. Our results demonstrate that diffusion-based models significantly outperform traditional Generative Adversarial Networks (GANs) in maintaining structural fidelity and image realism.

Introduction

In clinical pathology, the gold standard for diagnosis remains the examination of chemically stained tissue samples. While polarization imaging provides rich physical information about tissue architecture through the Mueller Matrix (MM), pathologists are not trained to interpret these 16-channel mathematical representations. Virtual staining—the computational translation of raw optical data into familiar histological formats—offers a bridge between advanced optical physics and clinical practice.

Previous attempts at virtual staining have largely relied on Generative Adversarial Networks (GANs). However, GANs often struggle with training stability and can produce "hallucinations" or blurry boundaries that compromise diagnostic utility. This work explores the application of diffusion models, which have shown superior performance in high-fidelity image synthesis, to the task of translating complex polarimetric data into clinically actionable images.

The Multi-modality Polarization Pathology Dataset (MPPD)

A significant barrier to progress in polarimetric virtual staining has been the lack of high-quality, registered datasets. We address this by releasing the Multi-modality Polarization Pathology Dataset (MPPD). This dataset consists of 18,000 high-resolution (600×600 pixels) image patches derived from seven breast cancer patient samples.

Each patch contains three perfectly aligned modalities:

  1. 16-channel Mueller Matrix data: Capturing the full polarimetric response of the tissue.
  2. H&E Staining: The standard histological reference.
  3. Fluorescence Imaging: Providing additional molecular structural details.

To ensure pixel-perfect alignment across these modalities, we employed a sophisticated registration pipeline using the SuperPoint algorithm for feature matching and B-spline modeling for non-rigid registration.

Methodology: Regulated Bridge Diffusion Model (RBDM)

The core of our approach is the Regulated Bridge Diffusion Model (RBDM). Unlike standard diffusion models that generate images from Gaussian noise, the Bridge model—based on the Brownian Bridge process—learns a direct stochastic mapping between two distinct domains (e.g., from Polarization data to H&E images).

Mueller Matrix Dimension Reduction

Mueller Matrices contain 16 channels, whereas standard histological images contain three. To bridge this gap, we utilize a trainable auto-encoder to compress the high-dimensional physical data into a latent space compatible with the diffusion process, preserving the essential physical features while reducing computational complexity.

Structural Guardrails: SSR and RR

To maintain biological accuracy, we introduced two regulation mechanisms:

  • Starting State Regulation (SSR): This uses a perceptual loss (via a pre-trained VGG network) to ensure the model’s estimated starting image remains consistent with the original tissue structure, preventing the loss of "ground truth" details during diffusion.
  • Route Regulation (RR): This ensures the diffusion path is logically consistent. By applying Multi-Scale Structural Similarity (MS-SSIM) loss, the model is forced to maintain structural similarity to both the source and target domains throughout the intermediate steps of the denoising process.

Experimental Results

The RBDM was evaluated against state-of-the-art GAN baselines, including Pix2Pix and PyramidPix2pix. The diffusion-based approach demonstrated a clear quantitative and qualitative advantage.

Polarization to H&E Translation

In the H&E translation task, RBDM achieved a Structural Similarity Index (SSIM) of 0.53, significantly higher than the 0.41 achieved by the leading GAN baseline. More impressively, the Fréchet Inception Distance (FID) improved from 62.02 (GAN) to 19.67 (RBDM), indicating a massive leap in image realism and distribution matching.

Polarization to Fluorescence Translation

Translating polarization data to fluorescence is traditionally more difficult due to the complexity of the target modality. Nevertheless, RBDM outperformed baselines with a Peak Signal-to-Noise Ratio (PSNR) of 18.52 and an FID of 43.03. Qualitative analysis confirmed that RBDM captures sharper cellular boundaries and more accurate color distributions, avoiding the artifacts common in GAN-generated images.

Discussion and Conclusion

Our findings suggest that the iterative denoising process inherent in diffusion models is better suited for the fine-grained requirements of pathology than one-shot GAN generation. The rich physical information in polarization data—such as birefringence and depolarization—contains sufficient structural information to reconstruct complex biological stains when guided by proper regulation (SSR and RR).

Limitations and Future Work

Despite these promising results, several challenges remain. The current dataset is limited to seven breast cancer patients; expanding this to a more diverse range of cancer types and larger cohorts is essential for clinical validation. Additionally, diffusion models are computationally intensive, requiring approximately 100 sampling steps for inference. Future work will focus on model distillation to achieve the real-time speeds necessary for clinical workflows and conducting "Turing tests" with pathologists to evaluate the diagnostic equivalence of virtual versus chemical stains.

Summary updated

Abstract

Polarization, as a new optical imaging tool, has been explored to assist in the diagnosis of pathology. Moreover, converting the polarimetric Mueller Matrix (MM) to standardized stained images becomes a promising approach to help pathologists interpret the results. However, existing methods for polarization-based virtual staining are still in the early stage, and the diffusion-based model, which has shown great potential in enhancing the fidelity of the generated images, has not been studied yet. In this paper, a Regulated Bridge Diffusion Model (RBDM) for polarization-based virtual staining is proposed. RBDM utilizes the bidirectional bridge diffusion process to learn the mapping from polarization images to other modalities such as H&E and fluorescence. And to demonstrate the effectiveness of our model, we conduct the experiment on our manually collected dataset, which consists of 18,000 paired polarization, fluorescence and H&E images, due to the unavailability of the public dataset. The experiment results show that our model greatly outperforms other benchmark methods. Our data and code are available at https://github.com/xiaoyu-z/RBDM/
BibTeX
@inproceedings{zheng2025diffusion,
  author = {Xiaoyu Zheng and Jing Wen and Jiaxin Zhuang and Yao Du and Jing Cong and Limei Guo and Lin Luo and Chao He and Hao Chen},
  title = {{Diffusion-Based Virtual Staining from Polarimetric Mueller Matrix Imaging}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2025},
  url = {https://openreview.net/forum?id=u40ol36wVv},
}
Figure