From Pretraining to Pathology: How Noise Leads to Catastrophic Inheritance in Medical Models

Hao Sun, Zhongyi Han, Hao Chen, Jindong Wang, Xin Gao, Yilong YinNeurIPS 2025 · OpenReview

TL;DR

Medical AI models often "inherit" structural flaws from the noisy web data used during their pretraining, a phenomenon called catastrophic inheritance. This paper reveals that pretraining noise "flattens" a model's feature space—reducing its skewness and kurtosis—and introduces a lightweight fine-tuning strategy (SKD) that restores these statistical properties to significantly boost accuracy and robustness in clinical tasks.

What Problem Does This Paper Address?

Modern medical AI rarely starts from scratch. Instead, researchers use "Foundation Models" (like CLIP or BERT) pretrained on massive, often messy, web-scale datasets. While this provides a strong starting point, these models carry "baggage" from their training data.

The authors investigate catastrophic inheritance: the tendency of models to perform well on data similar to their training set but fail miserably when faced with "out-of-distribution" (OOD) shifts—which are the norm in medicine (e.g., different hospitals, scanners, or patient demographics). Specifically, they look at how label noise in pretraining (like a mislabeled image on Twitter) propagates through the model, making it brittle for high-stakes tasks like histopathology or radiology.

Methods: Uncovering and Fixing Structural Collapse

The researchers first conducted controlled "stress tests," injecting varying levels of label noise (0% to 30%) into pretraining datasets to observe the effect on downstream medical tasks. They discovered a "structural collapse" in the representation space: as noise increases, the distributions of the model's features become more symmetric and less peaked.

Drop in skewness and kurtosis as pretraining noise increases

To fix this, they proposed SKD (Skewness-Kurtosis-Disagreement), a fine-tuning objective that adds three components to the standard task loss:

  1. Skewness Regularization: Forces the feature distributions to be more asymmetric, preventing the "flattening" caused by noise.
  2. Kurtosis Regularization: Encourages "peakedness" and heavy tails in the distribution, helping the model capture the fine-grained, localized details essential for medical diagnosis.
  3. Disagreement Loss: A logit-level penalty that sharpens the margins between the correct prediction and incorrect alternatives.

Crucially, this method is "backbone-agnostic"—it doesn't require changing the core architecture of the model and adds negligible computational overhead.

Datasets

The study utilized a massive array of datasets across vision and language:

  • Pretraining: ImageNet-1K (supervised) and YFCC15M (contrastive/CLIP-style).
  • Medical Vision (OOD Evaluation): Camelyon17 (histopathology), HAM10000 (dermatology), and NIHChestXray (radiology).
  • Medical Foundation Models: PLIP (pathology-specific CLIP) and PubMedBERT (biomedical NLP).
  • Downstream Pathology Benchmarks: Kather colon, PanNuke, DigestPath, and WSSS4LUAD.
  • Biomedical NLP: 32 Named Entity Recognition (NER) datasets, including BC2GM and NCBI-disease.

Key Insights and Ideas

  • The Geometry of Noise: The most striking finding is that noise doesn't just lower accuracy; it physically changes the geometry of the feature space. By measuring higher-order statistics (skewness and kurtosis), the authors found a compact "marker" for model degradation.
  • Why "Flat" is Bad: In medical imaging, critical signals (like a small cluster of cancer cells) are often subtle and localized. A "flat" feature space lacks the discriminative detail needed to separate these subtle cues from the background.
  • Inheritance is Universal: This isn't just a vision problem. The authors demonstrated that biomedical language models (like PubMedBERT) suffer from the same structural collapse when adapted to clinical text.
  • Lightweight Recovery: You don't need to retrain a billion-parameter model from scratch to fix this. By simply "reshaping" the distribution during the final fine-tuning stage, you can recover much of the robustness lost during pretraining.

Key Results

  • Vision Gains: On the Camelyon17 dataset, using a CLIP backbone with 30% pretraining noise, the SKD method achieved 86.65% accuracy, compared to just 80.18% for standard linear probing—an average gain of 6.51% across noise levels. Similar resilience was observed on the HAM10000 dataset.
Accuracy improvements using SKD across varying noise ratios
  • Pathology SOTA: When applied to the PLIP model (trained on noisy Twitter data), SKD consistently outperformed previous state-of-the-art methods. For example, on the Kather colon dataset, it improved the F1 score from 0.931 to 0.959.
  • NLP Robustness: In biomedical NER tasks, SKD improved the F1 score on the BC2GM dataset from 0.9053 to 0.9459, showing that the method generalizes well beyond images.
  • Efficiency: On the PanNuke dataset, SKD took 150 seconds to train compared to 20 seconds for basic linear probing. While slower, it remains highly practical compared to the weeks required for full pretraining.

Limitations and Future Work

  • Model Scale: The authors primarily tested mid-sized models (ResNet-50, ViT-B). They acknowledge that testing on massive architectures like LLaVA-Med or larger ViT-L models is a necessary next step.
  • Noise Complexity: The study focused largely on "uniform" random noise. Real-world web noise is often "structured" (e.g., confusing a Husky for a Wolf). While they did a preliminary test on hierarchical noise, more work is needed here.
  • Adaptive Targets: Currently, the "target" skewness and kurtosis are fixed. Future work could explore instance-adaptive constraints that adjust based on the complexity of the specific medical image or text being processed.

Summary updated

Abstract

Foundation models pretrained on web-scale data drive contemporary transfer learning in vision, language, and multimodal tasks. Recent work shows that mild label noise in these corpora may lift in-distribution accuracy yet sharply reduce out-of-distribution generalization, an effect known as catastrophic inheritance. Medical data is especially sensitive because annotations are scarce, domain shifts are large, and pretraining sources are noisy. We present the first systematic analysis of catastrophic inheritance in medical models. Controlled label-corruption experiments expose a clear structural collapse: as noise rises, the skewness and kurtosis of feature and logit distributions decline, signaling a flattened representation space and diminished discriminative detail. These higher-order statistics form a compact, interpretable marker of degradation in fine-grained tasks such as histopathology. Guided by this finding, we introduce a fine-tuning objective that restores skewness and kurtosis through two scalar regularizers added to the task loss. The method leaves the backbone unchanged and incurs negligible overhead. Tests on PLIP models trained with Twitter pathology images, as well as other large-scale vision and language backbones, show consistent gains in robustness and cross-domain accuracy under varied noise levels.
BibTeX
@inproceedings{sun2025from,
  author = {Hao Sun and Zhongyi Han and Hao Chen and Jindong Wang and Xin Gao and Yilong Yin},
  title = {{From Pretraining to Pathology: How Noise Leads to Catastrophic Inheritance in Medical Models}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2025},
  url = {https://openreview.net/forum?id=9c8J2C7ajq},
}
Figure