Clinically-Guided Counterfactuals (C³): Physics and Pathology-Aware Augmentation and Evaluation for Robust Medical Imaging Models

Ismail Lamaakal, Chaymae Yahyati, Yassine Maleh, Khalid El Makkaoui, Ibrahim OuahbiOpenReview 2025 · Submission to EurIPS 2025 Workshop MedEurIPS · OpenReview

Abstract

Clinical deployment of imaging AI remains fragile: routine distribution shifts—scanner vendor and reconstruction kernel, MRI protocol updates, dose and slice profile changes, patient positioning and demographics, and device optics—can degrade performance in ways that standard leaderboards and generic augmentations fail to predict. We ask whether robustness and calibration can be improved, without compromising clinical validity, by training and evaluating models against \emph{label-preserving, clinically grounded counterfactuals}. We introduce \textit{Clinically-Guided Counterfactuals (C$^3$)}, a framework that (i) unifies physics-informed acquisition perturbations with tightly constrained, pathology-preserving semantic edits; (ii) screens all counterfactuals through a conservative validity gate; and (iii) reports \emph{shift-stable utility}, a worst-case case-level score complementary to AUROC, Dice, ECE, and Brier. Across chest X-ray (CheXpert$\to$MIMIC-CXR), MS brain MRI segmentation (multi-site$\to$held-out site), and diabetic retinopathy grading (EyePACS$\to$Messidor-2), C$^3$ delivers consistent OOD gains (e.g., macro-AUROC $+0.035$ on CXR; lesion-wise Dice $+0.044$ on MRI; DR AUROC $+0.036$), tighter calibration, reduced prediction volatility under realistic shifts, and interpretable robustness diagnostics suitable for deployment checks.
BibTeX
@misc{lamaakal2025clinically,
  author = {Ismail Lamaakal and Chaymae Yahyati and Yassine Maleh and Khalid El Makkaoui and Ibrahim Ouahbi},
  title = {{Clinically-Guided Counterfactuals (C³): Physics and Pathology-Aware Augmentation and Evaluation for Robust Medical Imaging Models}},
  year = {2025},
  url = {https://openreview.net/forum?id=Tle57HRCdB},
  howpublished = {OpenReview},
  note = {Submitted to EurIPS 2025 Workshop MedEurIPS},
}

Loading related content...

Figure