Trends in Emergency Medicine Resident Procedural Reporting Over a 10-Year Period

Michael Gottlieb, Jaime Jordan, Sara Kryzaniak, Alexandra Mannix, Andrew J. King, Robert Cooney, Megan Fix, Eric ShappellWestern 2023 · DOI

Introduction

To graduate from an accredited residency, Emergency Medicine (EM) residents must demonstrate competency in a wide array of life-saving procedures. The Accreditation Council for Graduate Medical Education (ACGME) currently manages this by setting minimum volume requirements for "Key Index" procedures. However, medical practice is not static; it evolves alongside technological advancements and shifting clinical guidelines.

While these requirements are intended to ensure a baseline of experience, most existing data on resident procedural volumes are derived from single institutions over short durations. This makes it difficult to determine if national trends are shifting or if current ACGME requirements still accurately reflect the clinical reality of modern emergency departments. This study addresses this gap by analyzing a decade of procedural data across multiple diverse programs to identify long-term trends in resident clinical activity.

Methods

The researchers conducted a retrospective review of procedure logs from eight ACGME-accredited EM residency programs. To ensure the findings were representative of national trends, the study included sites with varying program lengths (3-year vs. 4-year formats), different institutional types (academic vs. community), and diverse geographic locations.

The study tracked the "Key Index" procedures defined by the ACGME for residents graduating between 2013 and 2022. The primary dataset consisted of 914 residents, with 881 meeting final inclusion criteria after excluding those with incomplete data or transfers. The research team calculated the mean number of procedures performed per resident and established 95% confidence intervals to identify statistically significant shifts over the ten-year window.

Results

The analysis revealed that while the core "procedural DNA" of EM training has remained remarkably stable, there are significant outliers that suggest a changing clinical landscape.

Mean procedural volumes and 95% confidence intervals for EM residents (2013–2022) across various key index procedures.

The Rise of Ultrasound and the Decline of the Lumbar Puncture

The most prominent upward trend observed was in point-of-care ultrasound (POCUS). As shown in the longitudinal data, POCUS reporting frequency increased significantly over the decade. This reflects a broader paradigm shift where ultrasound has moved from a specialized skill to a fundamental diagnostic tool utilized in nearly every shift.

Conversely, lumbar punctures (LPs) showed a clear and steady downward trend. In 2013, the mean number of LPs per resident was approximately 27; by 2022, this had dropped to 19. This decline is likely attributable to the increasing sensitivity and availability of advanced imaging (CT and MRI), which often obviates the need for an LP in the workup of conditions like subarachnoid hemorrhage.

The Challenge of Rare Procedures

The study also highlighted a persistent issue with high-stakes, low-frequency procedures. Interventions such as pericardiocentesis, cricothyroidotomy, and cardiac pacing remain exceedingly rare in clinical practice. The data indicates that a resident might only perform a handful of these procedures—or in some cases, none at all on live patients—during their entire training period. This raises significant questions regarding how competency is defined and maintained for procedures that are critical for survival but rarely encountered.

Discussion

The findings of this 10-year study suggest that residency programs and accrediting bodies may need to rethink how they track and define procedural competency. The stability of most procedures (such as intubations and central lines) suggests that the general volume of procedural work in EM is consistent. However, the specific mix of procedures is changing.

Implications for Training

The decline in LPs and the rarity of other "Key Index" procedures suggest that clinical volume alone may no longer be a sufficient proxy for competency. If residents are not seeing enough "reps" in the clinical environment, programs must lean more heavily on simulation-based training. High-fidelity simulators can provide the necessary practice for rare procedures like cricothyroidotomy, ensuring that residents are prepared for life-saving moments despite limited clinical exposure.

Limitations

The authors acknowledge several limitations, primarily the reliance on self-reported data. Procedure logs are subject to reporting bias, where residents may forget to log procedures or may log failed attempts differently. Additionally, current logging systems often fail to distinguish between procedures performed on live patients versus those performed in a simulation lab.

Conclusion

As Emergency Medicine continues to evolve, so too must the standards for resident education. This longitudinal data provides a necessary foundation for future ACGME requirement adjustments, suggesting a move toward a more nuanced approach that balances clinical volume with robust simulation for rare, essential skills.

Summary updated

Abstract

Background: Adaptive expertise is the ability to transfer existing skills to novel situations.Error Management Training (EMT) improves transfer of skills and adaptive expertise by making learners solve difficult problems and produce errors before being shown how to solve them.While EMT been used in procedural skills training, its impact on transfer of cognitive skills in medical training is underexplored.Objective: To compare the effects of EMT and Error Avoidance Training (EAT) on the transfer of cognitive skills, using head computed tomography (CT) interpretation as a model.We hypothesized that EMT, compared to EAT, would improve skills transfer when used to teach head CT interpretation to emergency medicine (EM) residents.Methods: We conducted a prospective, randomized controlled study in six EM residency programs.Residents completed an online head CT curriculum using either an EMT or EAT strategy, followed by a head CT interpretation test we previously validated.Two experimental cohorts (EMT-1 and EMT-2) scrolled through head CT cases without guidance and tried to identify critical findings before receiving didactic explanation.The EMT-1 cohort encountered difficult questions leading to errors whereas EMT-2 encountered easy questions.The EAT cohort received didactic instruction before scrolling through head CT cases.The post-test included novel cases to assess transfer and familiar cases to assess direct application.Our primary outcome was transfer of head CT interpretation skill.We compared post-test scores by ANOVA.Results: We enrolled 119 residents (Table ).The EMT-1 cohort outperformed both EMT-2 and EAT cohorts on the novel cases assessing transfer, with a large effect size (Figure).There was no difference on the direct application cases.Conclusions: EMT improves transfer of head CT interpretation skill.These findings support its efficacy to develop adaptive expertise with other cognitive skills in EM education.
BibTeX
@inproceedings{gottlieb2023trends,
  author = {Michael Gottlieb and Jaime Jordan and Sara Kryzaniak and Alexandra Mannix and Andrew J. King and Robert Cooney and Megan Fix and Eric Shappell},
  title = {{Trends in Emergency Medicine Resident Procedural Reporting Over a 10-Year Period}},
  booktitle = {Western},
  year = {2023},
  doi = {10.5811/westjem.60930},
}
Figure