Enhancing Uncertainty Estimation in Semantic Segmentation via Monte-Carlo Frequency Dropout

Tal Zeevi, Lawrence H. Staib, John A. Onofrey

Introduction

Deep learning models have revolutionized medical image segmentation, yet their deployment in clinical settings remains hindered by a lack of reliable uncertainty quantification. Standard models are often overconfident, even when making significant errors. To address this, Monte-Carlo (MC) Dropout is frequently employed to estimate predictive uncertainty. However, traditional "Signal Dropout" in convolutional neural networks (CNNs) acts as spatial impulse noise, randomly zeroing out pixels or feature nodes. In the context of medical imaging—where fine edges, textures, and structural continuity are paramount—this pixel-level disruption can lead to biased uncertainty estimates and degraded segmentation performance.

Methodology: Frequency-Domain Dropout

To overcome the limitations of spatial-domain dropout, researchers have proposed Monte-Carlo Frequency Dropout. This method shifts the dropout operation from the spatial (signal) domain to the frequency domain.

The process involves three primary steps:

  1. Transformation: The feature map is converted into the frequency domain using a Fast Fourier Transform (FFT).
  2. Masking: A binary dropout mask is applied to the frequency components, stochastically attenuating specific frequencies rather than individual pixels.
  3. Reconstruction: The modified frequency map is transformed back to the spatial domain via an Inverse FFT (iFFT).
Comparison of Signal and Frequency Dropout on feature maps and gradients.

By operating in the frequency domain, the model introduces global textural variations while maintaining the underlying anatomical structures. As shown in the figure above, traditional Signal Dropout creates "jagged" gradients and artificial edges. In contrast, Frequency Dropout ensures that the "noise" follows the natural anatomy of the image, preserving critical boundaries like organ edges.

Experimental Setup

The efficacy of Frequency Dropout was evaluated across three distinct medical imaging modalities and segmentation tasks:

  • MRI: Segmentation of the peripheral and transitional zones of the prostate.
  • CT: Delineation of the liver and liver tumors in contrast-enhanced scans.
  • X-ray: Lung segmentation in chest radiographs.

The experiments utilized industry-standard architectures, including nnU-Net for 3D volumes (CT/MRI) and the MedSAM transformer for 2D X-rays. The study explored various placement strategies, including Encoder Dilution, Decoder Dilution, and Global Dilution.

Results and Discussion

Calibration and Stability

A primary goal of uncertainty estimation is "calibration"—ensuring that a model's reported uncertainty correlates with its actual error rate. Frequency Dropout consistently achieved lower Expected Uncertainty Calibration Error (UCE) compared to traditional Signal Dropout. This indicates that the "doubt" expressed by the model is a more reliable predictor of segmentation mistakes.

Furthermore, Frequency Dropout demonstrated superior stability in segmentation accuracy, measured by the Dice Similarity Coefficient (DSC). While traditional dropout often degrades performance (e.g., an 11-14% drop in liver tumor segmentation), Frequency Dropout maintained or even improved accuracy (a 3.54% gain in the same liver task).

Qualitative Analysis

Visually, the uncertainty maps generated by Frequency Dropout are more "semantic." They naturally highlight anatomical boundaries and regions of genuine ambiguity.

Qualitative comparison of segmentation errors and uncertainty maps across MRI, X-ray, and CT.

As illustrated in the qualitative results, Frequency Dropout produces uncertainty maps that are better aligned with actual segmentation errors (red regions) compared to the noisier, less focused maps produced by Signal Dropout.

Conclusion

Monte-Carlo Frequency Dropout represents a significant advancement in making medical AI more reliable. By preserving structural integrity through frequency-domain operations, it provides better-calibrated uncertainty estimates without sacrificing segmentation accuracy. While the computational overhead of FFT operations is a factor, the gains in clinical safety and model reliability make it a compelling alternative to traditional dropout methods.

Summary updated

BibTeX
@inproceedings{zeevi2025enhancing,
  author = {Tal Zeevi and Lawrence H. Staib and John A. Onofrey},
  title = {{Enhancing Uncertainty Estimation in Semantic Segmentation via Monte-Carlo Frequency Dropout}},
  booktitle = {ISBI},
  year = {2025},
  doi = {10.1109/isbi60581.2025.10980684},
}
Figure