An updated analysis of the content and accessibility of hand surgery fellowship websites and fellowship directories

Scott A Wu, Manish P. Mehta, Alisha Ho, Kelly Wun, Erik B. Gerlach, John Carney, Peter R. Swiatek, Chirag ShahJournal of Orthopaedic Experience & Innovation 2024 · DOI

Abstract

Background: Recent changes to the hand surgery fellowship application process and the pandemic-related transition to virtual interviews necessitate updated analyses of fellowship websites’ and directories’ content and accessibility. The study aims are to identify deficits in hand fellowship website and fellowship directory content and accessibility and compare current findings to those previously reported. Methods: A list of all accredited hand fellowship programs was queried from the ASSH fellowship directory in January 2022. Data for each program were recorded on 38 metrics across four different categories: General Overview, Accessibility Information, Educational Information, and Recruitment Information. Results: 92 program websites were analyzed. Only 53 (58%) ASSH links and 12 (13%) FREIDA links directly connected users to the website. Content accuracy was poor with just 13% of websites containing updated interview date information. Mean educational and recruitment information scores were 6.8±2.1 and 5.0±1.5 out of 10, respectively. Conclusions: Though improved, the accessibility, comprehensiveness, and accuracy of information found on hand fellowship websites remains poor and outdated.

Introduction

In the wake of the COVID-19 pandemic, the "first impression" for medical fellowship applicants shifted entirely from in-person hospital tours to program websites. For hand surgery—a highly competitive sub-specialty—this digital storefront is now the primary tool for candidates to evaluate program fit, curriculum, and recruitment requirements. However, previous research from 2015 suggested these websites were severely lacking. This study investigates whether the transition to virtual interviews and the adoption of a universal application process by the American Society for the Surgery of the Hand (ASSH) prompted programs to improve their digital presence in terms of accessibility, comprehensiveness, and accuracy.

Methods

The researchers conducted a cross-sectional audit of all 92 accredited hand surgery fellowship programs in the U.S. as of January 2022. Programs were identified via the ASSH directory. Each program was evaluated on 38 specific metrics divided into four categories: General Overview, Accessibility, Educational Information (e.g., call requirements, research opportunities), and Recruitment Information (e.g., salary, selection criteria). Statistical analysis utilized Fisher’s exact tests for categorical data and unpaired t-tests/ANOVA for continuous variables to identify predictors of high-quality websites.

Results

Accessibility and Directory Integration

A significant barrier to information remains the "broken link" bottleneck. Despite being the official starting point for applicants, only 58% of ASSH links and a dismal 13% of FREIDA links connected users directly to the relevant fellowship page. Many links were either broken or required extensive manual navigation through general department pages, a finding that has shown no significant improvement since 2015.

Accessibility of fellowship websites via ASSH and FREIDA directory links.

Content Comprehensiveness

While educational content scores (mean 6.8 ± 2.1) have seen some improvement, recruitment information remains stagnant and significantly less comprehensive (mean 5.0 ± 1.5). Programs frequently fail to provide basic "quality of life" data. For instance, less than half of the programs listed salary information (48%) or details on current fellows (49%).

Prevalence of recruitment information across hand surgery fellowship websites.

The Accuracy Crisis

Information rot is a major issue across the board. Only 13% of websites had updated their interview dates for the current cycle, and 11% still listed obsolete paper application instructions. Furthermore, of the 33% of programs requiring supplemental application materials, only 17% actually listed those requirements on the official ASSH directory page, creating "hidden" hurdles for applicants.

Discussion

The study reveals a "homogeneity in mediocrity" across programs, regardless of geographic region or institutional prestige. Interestingly, program size was a predictor of quality; programs with more than one fellow per year tended to have significantly higher scores for educational content, likely due to greater administrative resources.

The lack of accurate, up-to-date information is particularly concerning given the shift to virtual recruitment. Applicants are forced to rely on "digital ghosts"—outdated or missing information—when making career-defining decisions. The authors suggest that programs should look to "template" high-scoring websites, such as those from Emory or Wake Forest, to improve their own.

Conclusion

While the number of hand surgery fellowships has increased by 16% since 2015, the quality of their digital presence has not kept pace. The accessibility, comprehensiveness, and accuracy of information on fellowship websites remain poor. Governing bodies like the ASSH should consider implementing stricter standards for directory maintenance to ensure a fair and transparent application process in the digital age.

Summary updated

Abstract

Background Recent changes to the hand surgery fellowship application process and the pandemic-related transition to virtual interviews necessitate updated analyses of fellowship websites’ and directories’ content and accessibility. The study aims are to identify deficits in hand fellowship website and fellowship directory content and accessibility and compare current findings to those previously reported. Methods A list of all accredited hand fellowship programs was queried from the ASSH fellowship directory in January 2022. Data for each program were recorded on 38 metrics across four different categories: General Overview, Accessibility Information, Educational Information, and Recruitment Information. Fisher’s exact test was used to assess differences between categorical variables. Unpaired t-test and analysis of variance (ANOVA) were used to compare continuous variables for two or more potential predictors, respectively. Results 92 program websites were analyzed. Only 53 (58%) ASSH links and 12 (13%) FREIDA links directly connected users to the website, with no improvement from prior investigation. Content accuracy was poor with just 13% of websites containing updated interview date information and 11% listing obsolete paper application information. Of the 30 program websites (33%) with supplemental application requirements listed, only 5 (17%) also listed these requirements on their corresponding ASSH page. Mean educational and recruitment information scores were 6.8±2.1 and 5.0±1.5 out of 10, respectively. Conclusions Though improved, the accessibility, comprehensiveness, and accuracy of information found on hand fellowship websites remains poor and outdated. Educational content and recruitment content are largely homogenous among programs.
BibTeX
@article{wu2024updated,
  author = {Scott A Wu and Manish P. Mehta and Alisha Ho and Kelly Wun and Erik B. Gerlach and John Carney and Peter R. Swiatek and Chirag Shah},
  title = {{An updated analysis of the content and accessibility of hand surgery fellowship websites and fellowship directories}},
  journal = {Journal of Orthopaedic Experience \& Innovation},
  year = {2024},
  doi = {10.60118/001c.84082},
}
Figure