TL;DR
This paper introduces and validates a new observational tool, the FootyFirst Observational Tool (FOT), to objectively measure how accurately athletes perform injury prevention exercises. The study found that a significant portion of players did not perform exercises as prescribed, highlighting the importance of direct observation for ensuring the effectiveness of such programs.
What Problem Does This Paper Address?
Sports injury prevention programs (SIPPs) are designed to reduce injuries, but their effectiveness hinges on players performing the prescribed exercises correctly. This is known as "exercise fidelity." While many SIPPs rely on coaches and participants to ensure exercises are done right, there's a lack of objective methods to measure this fidelity. Previous evaluations often depend on self-reported data, which can be prone to recall bias or social desirability bias. This paper addresses the critical need for a reliable, observational tool to assess exercise fidelity in community sports settings, specifically within an Australian football context.
Methods
The researchers developed the FootyFirst Observational Tool (FOT), a paper-based checklist designed for direct visual observation of players performing exercises. The FOT breaks down each exercise into essential performance criteria, focusing on technique, volume, and intensity. These criteria were meticulously defined by the research team and refined through an iterative consensus process. The FOT was then trialled by two accredited exercise physiologists who were familiar with the FootyFirst program. They independently observed 70 players across eight clubs, rating each exercise criterion as "yes" or "no." Inter-rater reliability was assessed using Kappa statistics to determine the consistency of their observations.
Datasets
Not discussed in the paper. The study involved direct observation of participants in a real-world setting.
Key Insights and Ideas
- The "just doing it" mentality isn't enough: Simply participating in an exercise program doesn't guarantee benefits. The quality of performance is paramount for injury prevention.
- Observational tools are crucial: Self-reported compliance is insufficient. Direct observation, as facilitated by the FOT, provides a more accurate picture of exercise fidelity.
- Fidelity varies significantly: The study revealed that a substantial number of players did not perform exercises as prescribed, raising concerns about whether they were receiving the intended injury prevention benefits.
- Warm-up exercises are more consistently performed: Players were more likely to perform warm-up exercises correctly compared to the more advanced strength and conditioning exercises. This might be due to the familiarity of warm-up routines.
- Volume is a common issue: Rater comments indicated that incorrect volume (too many or too few repetitions) was a frequent cause of incorrect exercise performance.
Key Results
- The FootyFirst Observational Tool (FOT) demonstrated high inter-rater reliability, with raters agreeing on 87% of observations (Kappa = 0.72).
- Of the 61 observations where raters agreed, 67% of players performed the observed exercises correctly.
- Conversely, 33% of exercises were performed incorrectly by players, as indicated by at least one essential criterion not being met.
- Analysis of warm-up exercises specifically showed higher agreement (90%) and a higher rate of correct performance (67% of players).
Limitations and Future Work
The authors acknowledge that the raters' familiarity with the program and their background in exercise physiology might have influenced their agreement. They also note that coaches were aware of the observation, which could have led to participants performing exercises to a higher standard than they would in unobserved practice. This suggests that the reported rate of incorrect performance might be an underestimate.
Future work could explore extending the FOT as a tool for assessing changes in exercise fidelity over time. Additionally, the paper suggests investigating the relationship between varying degrees of exercise fidelity and actual injury outcomes to understand what level of fidelity is necessary for effective injury prevention. Further research could also examine how to improve the translation of correct technique, especially for more complex exercises.
Summary updated