Adversarial Evaluation of Large Language Models for Patient-Friendly Radiology Report Summarization

Magdalini Paschali, Asad Aali, Arogya Koirala, Andrew Johnston, Katherine McNamara, Richard Gaus, Roxana Daneshjou, David B. Larson, Akshay S. ChaudhariarXiv 2026 · arXiv

TL;DR

Researchers have developed a scalable "stress test" for Large Language Models (LLMs) summarizing radiology reports by using clinically grounded adversarial edits. The study reveals that while top-tier models like GPT-5-mini lead the pack, even the best models frequently miss critical clinical modifiers—such as changing "mild" to "severe"—and exhibit hallucination rates as high as 30%.

What Problem Does This Paper Address?

In the U.S., the 21st Century Cures Act has granted patients direct access to their electronic health records, including radiology reports. However, these reports are often dense with medical jargon, leading to patient anxiety and confusion. While LLMs offer a promising solution by translating these reports into "patient-friendly" summaries, they are prone to "hallucinations" and factual errors.

The core challenge is evaluation. Manual review by radiologists is the gold standard but is impossible to scale. Traditional NLP metrics like ROUGE or BERTScore often fail to capture clinical nuances—a summary might be linguistically similar to the original but clinically dangerous if it omits a "no" before "evidence of malignancy." This paper introduces a framework to automatically and robustly evaluate how well LLMs preserve clinical facts under adversarial pressure.

Methods

The authors introduced a clinically grounded adversarial framework that "stresses" LLMs using two primary strategies:

  1. Term Substitution: Using a radiologist-validated dictionary of 247 terms, the researchers systematically swapped words across eight semantic categories (e.g., pathology, anatomy, descriptors, and confidence terms). For example, "mild" might be replaced with "severe" to see if the LLM summary reflects this change in intensity.
  2. Impression Removal: The framework identifies and removes the most "keyword-dense" sentences or points from the original report's impression section to test if the LLM summary remains complete.

To evaluate the resulting summaries, the team employed an LLM-as-a-judge framework (primarily using GPT-5). This judge operates in two stages: first, it extracts clinical findings into a structured schema (Condition, Location, Severity, Certainty); second, it compares the original and adversarial versions to score the summary on Factual Faithfulness, Sensitivity to Changes, Certainty Fidelity, and Hallucination Rate.

Table 2: Language Models Used for Summary Generation and as Judge

Datasets

The study utilized a diverse corpus of 13,801 radiology report impressions sourced from three public datasets to ensure generalizability across modalities and body regions:

  • Merlin: 5,125 abdominal CT reports.
  • INSPECT: 3,676 chest CTPA (Computed Tomography Pulmonary Angiography) reports.
  • MIMIC-IV: 5,000 MRI reports covering the spine, brain, breast, and extremities.
Table 1: Overview of Datasets Used in the Study

Key Insights and Ideas

  • Nuance is the Achilles' Heel: Models were generally good at identifying primary pathologies but struggled significantly with "clinical modifiers." Failure rates were highest for anatomical modifiers (23.7% missed) and descriptors like "substantial" or "suspicious." This suggests that LLMs might downplay the urgency or specific location of a finding during simplification.
  • Hallucinations are Pervasive: Even the highest-performing model, GPT-5-mini, hallucinated in roughly 28-30% of cases under term substitution. Most of these weren't fabricated diseases but rather "unsupported follow-up recommendations" or "added reasoning" not present in the original report.
  • The "Judge" is Competent: The automated LLM judge showed a macro-F1 agreement score of 0.55–0.56 with human radiologists. Crucially, this was comparable to the agreement between the two human radiologists themselves (0.53), suggesting that LLM-based evaluation is a viable, scalable alternative to expert manual review.
  • Prompting Matters Less Than Model Choice: While detailed prompts (assigning a "medical specialist" persona) were tested against concise ones, the choice of the underlying model had a much larger impact on robustness than the specific wording of the instructions.

Key Results

  • Top Performer: GPT-5-mini achieved the highest factual faithfulness (0.851) and certainty fidelity. Claude Sonnet 4.5 followed closely, while open-source models like Llama 3.1 and Qwen 3 struggled, often scoring below 0.50 in faithfulness.
  • Sensitivity Gap: Models were much better at handling "Impression Removal" (detecting that something was missing) than "Term Substitution" (detecting that a specific detail had changed). GPT-5-mini reflected changes in ~90% of removal cases but only ~40% of substitution cases.
  • Failure Modes: A deep dive into specific terms showed that the word "suspicious" had a failure rate of over 50% for both GPT-5-mini and Claude, meaning the models often failed to convey the radiologist's level of concern to the patient.

Limitations and Future Work

The authors acknowledge several limitations:

  • Synthetic Edits: The adversarial changes are programmed and may not capture the full, messy spectrum of real-world dictation errors or complex multi-finding inaccuracies.
  • Scope: The study focused only on the "Impression" section; future work should extend this to the "Findings" section for a more comprehensive assessment.
  • Patient Impact: The study evaluated clinical accuracy but did not directly measure whether patients actually understood the summaries better or if the summaries changed their clinical behavior.
  • Subjectivity of Hallucinations: The low agreement between humans on what constitutes a "hallucination" highlights the inherent subjectivity in simplifying medical text, suggesting a need for better rater calibration in future studies.

Summary updated

Abstract

Purpose: To develop and validate a scalable adversarial evaluation framework for assessing the robustness of large language models (LLMs) that generate patient-friendly summaries of radiology reports. Methods: We introduced a clinically grounded adversarial framework that uses controlled term substitutions and impression removals across intensity levels. Using a radiologist-validated adversarial dictionary, we generated adversarial variants of CT and MRI reports. Six LLMs summarized original and adversarial impressions using 2 prompt styles, yielding 18,000 evaluation pairs. Robustness was evaluated with an automated LLM-as-a-judge framework scoring factual faithfulness, sensitivity to adversarial edits, certainty fidelity, and hallucination rate. Failure mode analysis quantified vulnerabilities in incorporating clinical modifiers. Agreement with two radiologists was assessed on 105 cases. Results: GPT-5-mini achieved the highest factual faithfulness and certainty fidelity under both adversarial edits. Under term substitution, hallucinations occurred in 28.1-30.1% of GPT-5-mini summaries, compared with 35.3-36.4% for Claude Sonnet 4.5 and 41.4-41.9% for MedGemma. Impression-removal edits were handled more robustly than term substitutions. Even for the highest-scoring summarizer, substitutions of anatomical terms were not reflected in 23.7% of summaries, diagnostic certainty in 22.3%, and descriptor terms (e.g., "substantial") in 21.2%. Judge-radiologist agreement (macro-F1: 0.55-0.56) was comparable to inter-radiologist agreement (0.53). Conclusions: Adversarial evaluation exposes clinically meaningful failure modes, including missed anatomical modifiers, altered diagnostic certainty, and omitted severity descriptors.
BibTeX
@misc{paschali2026adversarial,
  author = {Magdalini Paschali and Asad Aali and Arogya Koirala and Andrew Johnston and Katherine McNamara and Richard Gaus and Roxana Daneshjou and David B. Larson and Akshay S. Chaudhari},
  title = {{Adversarial Evaluation of Large Language Models for Patient-Friendly Radiology Report Summarization}},
  year = {2026},
  eprint = {2611.10277},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.10277},
}
Figure