The effect of prior experience on diagnostic reasoning: exploration of availability bias

Sandra Monteiro, Jonathan Sherbino, Jonathan S. Ilgen, Emily M. Hayden, Elizabeth Howey, Geoff NormanDiagnosis 2020 · DOI

Abstract

Diagnostic reasoning is often influenced by prior similar cases, a phenomenon frequently labeled as "availability bias." This study investigated whether such exposure leads to diagnostic error or serves as a helpful priming mechanism across different levels of expertise. Using a two-phase experimental design with clinical vignettes, researchers compared the performance of medical students, residents, and staff physicians. Results indicated that while experts maintained high accuracy regardless of recent exposure, medical students' accuracy improved significantly after priming, suggesting that recent experience acts as a beneficial cognitive scaffold for novices rather than a source of error.

Introduction

In clinical practice, "availability bias" is often viewed as a cognitive pitfall where recent or memorable cases disproportionately influence current judgment, potentially leading to premature closure and diagnostic error. However, the cognitive mechanisms underlying this effect—and how they vary with clinical expertise—remain poorly understood. This study sought to determine if prior exposure triggers bias through superficial patient features or underlying clinical pathology, and whether expertise provides a "shield" against such influences.

Methods

The researchers employed a two-phase experimental design to systematically manipulate participant experience. The study included 32 medical students, 34 residents, and 35 staff physicians.

Study design flowchart showing the Exposure and Test phases across four conditions.
  1. Exposure Phase: Participants verified diagnoses for eight clinical vignettes, priming their mental models with specific diagnostic categories.
  2. Test Phase: Participants diagnosed 10 "equiprobable" vignettes—cases designed so that two different diagnoses were equally plausible based on clinical data.

The relationship between exposure and test cases was varied across four conditions to test the influence of context versus pathology:

  • Condition a: Similar patient context and similar clinical pathology.
  • Condition b: Dissimilar context but similar pathology.
  • Condition c: Similar context but dissimilar pathology.
  • Condition d (Control): No prior exposure to the diagnostic category.

Key Results

The study revealed a clear distinction between novice and expert performance. Faculty and residents demonstrated a "ceiling effect," maintaining near-perfect accuracy (~98%) across all conditions, showing no significant influence from the priming phase.

In contrast, medical students showed a significant "priming" effect. Their diagnostic accuracy on ambiguous cases was significantly higher when they had prior exposure to the diagnostic category (averaging 85% across conditions a-c) compared to the control condition (73% in condition d).

Diagnostic accuracy across expertise levels and conditions, highlighting the performance boost for medical students in primed conditions (a-c) versus control (d).

Statistical analysis confirmed a significant interaction between expertise level and condition ($F(2, 712) = 3.55, p < 0.002$), indicating that the benefit of prior experience is most pronounced for those still developing their clinical knowledge base.

Discussion and Conclusion

These findings challenge the traditional view of availability bias as a purely negative influence. For medical students, recent experience functioned as category priming, facilitating the retrieval and application of relevant knowledge to ambiguous cases. Interestingly, this effect was driven by clinical pathology rather than superficial patient features, suggesting that even early learners focus on relevant clinical patterns.

For experts, the lack of influence suggests that their deep, structured knowledge is robust enough to resist the sway of a single recent case in a controlled setting. While availability bias may still pose risks in high-pressure, real-world environments with "misleading" primes, this study highlights its role as a helpful cognitive mechanism for those in the early stages of clinical training.

Summary updated

Abstract

Objectives Diagnostic reasoning has been shown to be influenced by a prior similar patient case. However, it is unclear whether this process influences diagnostic error rates or whether clinicians at all experience levels are equally susceptible. The present study measured the influence of specific prior exposure and experience level on diagnostic accuracy. Methods To create the experience of prior exposure, participants (pre-clerkship medical students, emergency medicine residents, and faculty) first verified diagnoses of clinical vignettes. The influence of prior exposures was measured using equiprobable clinical vignettes; indicating two diagnoses. Participants diagnosed equiprobable cases that were: 1) matched to exposure cases (in one of three conditions: a) similar patient features, similar clinical features; b) dissimilar patient features, similar clinical features; c) similar patient features, dissimilar clinical features), or 2) not matched to any prior case (d) no exposure). A diagnosis consistent with a matched exposure case was scored correct. Cases with no prior exposure had no matched cases, hence validated the equiprobable design. Results Diagnosis A represented 47% of responses in condition d, but there was no influence of specific similarity of patient characteristics for Diagnosis A, F(3,712)=7.28, p=0.28 or Diagnosis B, F(3,712)=4.87, p=0.19. When re-scored based on matching both equiprobable diagnoses, accuracy was high, but favored faculty (n=40) 98%, and residents (n=39) 98% over medical students (n=32) 85%, F(2,712)=35.6, p<0.0001. Accuracy for medical students was 84, 87, 94, and 73% for conditions a-d, respectively, interaction F(2,712)=3.55, p<0.002. Conclusions The differential diagnosis of pre-clerkship medical students improved with prior exposure, but this was unrelated to specific case or patient features. The accuracy of medical residents and staff was not influenced by prior exposure.
BibTeX
@inproceedings{monteiro2020effect,
  author = {Sandra Monteiro and Jonathan Sherbino and Jonathan S. Ilgen and Emily M. Hayden and Elizabeth Howey and Geoff Norman},
  title = {{The effect of prior experience on diagnostic reasoning: exploration of availability bias}},
  booktitle = {Diagnosis},
  year = {2020},
  doi = {10.1515/dx-2019-0091},
}
Figure