Human-AI Collaboration in Large Language Model-Assisted Brain MRI Differential Diagnosis: A Usability Study

Su Hwan Kim, Severin Schramm, Cornelius Berberich, Enrike Rosenkranz, Lena Schmitzer, Kerem Serguen, Christopher Klenk, Nicolas Lenhart, Claus Zimmer, Benedikt Wiestler, Dennis M. HedderichmedRxiv 2024 · DOI

TL;DR

This usability study demonstrates that pairing junior radiology residents with a Large Language Model (LLM) significantly improves diagnostic accuracy for challenging brain MRI cases compared to traditional internet searches. While accuracy jumped from 42% to 64%, the study highlights that the "human-in-the-loop" remains a critical bottleneck, as poor image descriptions by humans and "hallucinations" by AI can still lead to diagnostic errors.

What Problem Does This Paper Address?

Radiological differential diagnosis—the process of weighing various possibilities for a patient's symptoms or imaging findings—is a high-stakes task requiring years of specialized training. While recent research has shown that LLMs like GPT-4 can perform remarkably well on medical exams in isolation, we don't live in a world where AI works alone.

In a clinical setting, a radiologist acts as the "human-in-the-loop," interpreting an image, describing it to the AI, and then vetting the AI's suggestions. This paper addresses the "usability gap": Does collaborating with an LLM actually make a radiologist better or faster, or does it introduce new risks like automation bias (blindly trusting the machine) or frustration from AI "hallucinations"?

Methods

The researchers conducted a retrospective usability study with a randomized crossover-like design:

  • Participants: Six radiology residents with less than six months of experience in neuroradiology (the group most likely to need diagnostic assistance).
  • The Tool: Perplexity AI, powered by GPT-4. This specific interface was chosen because it provides real-time web access and, crucially, cites its sources.
  • The Task: Participants were given 20 "challenging but definitive" brain MRI cases. For half the cases, they used conventional internet searches; for the other half, they used the LLM.
  • Scoring: Accuracy was measured using a binary system (was the correct diagnosis in the top three?) and a numeric system (0–3 points based on the rank of the correct diagnosis). They also tracked "interpretation time" and "level of confidence" via Likert scales.

Datasets

The study utilized a curated internal dataset:

  • Brain MRI Cases: 20 cases selected from a local imaging database (2016–2023).
  • Criteria: All cases involved adult patients with focal findings and a confirmed "gold standard" diagnosis. The researchers specifically chose "non-trivial, less common conditions" to ensure the cases were difficult enough to require research.

Key Insights and Ideas

  • The "Description" Bottleneck: The AI is only as good as the human's prompt. If a resident failed to mention a specific "bubbly" texture or "multinodular" morphology in their text prompt, the LLM was often led astray. This highlights that "prompt engineering" in medicine requires high-level observational skills.
  • Irrelevant Clinical Bias: LLMs can be "distracted" by irrelevant data. In one case, mentioning a patient's history of a kidney transplant caused the LLM to focus on transplant-related complications, missing the actual diagnosis of a brain syndrome (PRES).
  • The Verification Loop: Participants didn't use the LLM in a vacuum. They often used the LLM to get a broad list of possibilities and then jumped to "trusted" sites like Radiopaedia to verify those suggestions against actual reference images.
  • Hallucinations are Real (and Weird): In a striking example of technical failure, when a user asked for sample images of a specific brain disease (PML), the LLM returned images of the Prime Minister of India.

Key Results

  • Superior Accuracy: The LLM-assisted workflow was significantly more accurate. Residents found the correct diagnosis in 64.4% (38/59) of cases using the LLM, compared to only 42.4% (25/59) using conventional search ($p = 0.03$).
  • No Speed Boost: Interestingly, the LLM did not save time. Interpretation took about 8.12 minutes with the AI versus 7.96 minutes without it. The time saved in searching was likely spent on formulating prompts and verifying AI claims.
  • Confidence Gap: Despite being more accurate with the AI, the residents' self-reported confidence levels did not increase. This suggests they remained appropriately skeptical of the AI's output.

Limitations and Future Work

The authors acknowledge several limitations:

  1. Sample Size: The study was small (6 residents, 20 cases), meaning the results might not generalize to all radiologists.
  2. Controlled Environment: The study didn't account for the "chaos" of a real clinic—interruptions, high workloads, and fatigue.
  3. General vs. Specialized Models: The study used a general-purpose LLM (GPT-4). The authors suggest that models specifically fine-tuned for medicine (like Med-PaLM or GlassAI) might perform even better.
  4. The Move to Multimodal: The biggest future leap will be moving from text-based prompts to multimodal LLMs that can "see" the MRI directly. This would eliminate the human error involved in describing image findings, potentially closing the gap between AI potential and clinical reality.

Summary updated

Abstract

Abstract Background Prior studies have shown the potential of large language models (LLMs) to support in differential diagnosis in radiology. However, the interaction of human users with LLMs in this context has not been evaluated. Purpose To investigate the impact of human-LLM collaboration on accuracy and efficiency of brain MRI differential diagnosis. Methods In this retrospective study, twenty brain MRI cases with a challenging but definitive diagnosis were selected and randomized into two groups. Six inexperienced radiology residents were instructed to determine the three most likely differential diagnoses for each of these cases via conventional internet search or utilizing an LLM-based search engine (© Perplexity AI, powered by GPT-4). Accuracy of suggested differential diagnoses was analyzed using the chi-square test and Mann-Whitney U test. Interpretation times were analyzed using the student’s t-test. Benefits and challenges in human-LLM interaction were derived from observations and participant feedback. Results LLM-assisted brain MRI differential diagnosis yielded superior accuracy (38/59 [LLM-assisted] vs 25/59 [conventional] correct diagnoses, p = 0.03). No difference in interpretation time (8.12 +/- 3.22 min [LLM-assisted] vs 7.96 +/- 2.65 min [conventional], p = 0.76) or level of confidence (median of 2.5 [LLM-assisted] vs 3.0 [conventional], p = 0.96) was observed. Several challenges related to human errors and technical limitations were identified. Conclusion Human-LLM collaboration has the potential to improve brain MRI differential diagnosis. Yet, several challenges must be addressed to ensure effective adoption and user acceptance.
BibTeX
@misc{kim2024human,
  author = {Su Hwan Kim and Severin Schramm and Cornelius Berberich and Enrike Rosenkranz and Lena Schmitzer and Kerem Serguen and Christopher Klenk and Nicolas Lenhart and Claus Zimmer and Benedikt Wiestler and Dennis M. Hedderich},
  title = {{Human-AI Collaboration in Large Language Model-Assisted Brain MRI Differential Diagnosis: A Usability Study}},
  year = {2024},
  doi = {10.1101/2024.02.05.24302099},
  howpublished = {medRxiv},
}
Figure