The Australian Traumatic Brain Injury Initiative: Statement of Working Principles and Rapid Review of Methods to Define Data Dictionaries for Neurological Conditions

Matthew K. Bagg, Amelia J. Hicks, Sarah C. Hellewell, Jennie Ponsford, Natasha A. Lannin, Terence J. O’Brien, Peter Cameron, D. James Cooper, Nick Rushworth, Belinda J. Gabbe, Melinda Fitzgerald, Australian Traumatic Brain Injury Initiative Investigators**Neurotrauma 2024 · DOI

TL;DR

This paper reviews existing methods for creating data dictionaries for neurological conditions, finding a lack of standardized approaches. The Australian Traumatic Brain Injury (AUS-TBI) Initiative is using these findings to develop a robust data dictionary for improving TBI outcome prediction and care.

What Problem Does This Paper Address?

Traumatic Brain Injury (TBI) is a significant global health issue, impacting millions annually with devastating long-term consequences and substantial economic costs. To improve outcomes, researchers and clinicians need a standardized way to collect and analyze data. A crucial component of this is a "data dictionary," which defines common data elements (CDEs) for consistent data collection. However, before the AUS-TBI initiative, there was no comprehensive review of how such data dictionaries were developed for neurological conditions, leaving a gap in best practices and guidance.

Methods

The authors conducted a rapid systematic review to identify and characterize methods used in initiatives that defined data dictionaries for neurological conditions. They searched multiple databases (MEDLINE, Embase, Emcare, PsycINFO, CINAHL) from their inception until October 2021. Records were screened in two stages (title/abstract, then full-text) against specific criteria. Data extraction focused on the consensus-making process, stakeholders involved, and the types of data elements defined. A second reviewer checked a random subset of records for quality assurance. The findings were then used to inform the development of the AUS-TBI data dictionary.

Datasets

Not applicable. This paper is a systematic review of existing literature and does not involve the creation or use of new datasets for training or evaluation.

Key Insights and Ideas

  • No Standardized Method Exists: Despite numerous initiatives to create data dictionaries for neurological conditions, the review found no single established or recommended method for their definition and development. This highlights a significant area for improvement in the field.
  • Sparse Reporting: A major challenge was the lack of detailed reporting on the methods used in these initiatives. Eighty percent of the reported initiatives lacked explicit descriptions of their processes, making it difficult to fully understand and replicate their approaches.
  • Stakeholder Inclusion Varies Greatly: While researchers and clinicians were frequently involved, the inclusion of individuals with lived experience of the condition and their carers was notably low (only 6% and 4% of initiatives, respectively). This is a critical area for improvement, as patient perspectives are vital for comprehensive data collection.
  • Diverse Consensus Processes: Initiatives employed a wide range of consensus-making methods, including Delphi methodologies, facilitated discussions, and iterative processes. While this diversity suggests flexibility, it also underscores the absence of a guiding framework.
  • "Living" Reviews for Future Work: The authors advocate for a "living" evidence approach for future systematic reviews to maintain currency and accuracy in the rapidly evolving field of TBI research.

Key Results

The review identified 39 initiatives across 29 neurological conditions that aimed to define data dictionaries. Of these, nine initiatives conducted systematic reviews to gather information before their consensus process, and 37 reported achieving consensus on data elements. Consultation with end-users was common (37 initiatives), often through roundtable discussions (76.9%) and in-person meetings (69.2%). However, the reporting of specific methods, stakeholder selection, and the definition of "consensus" was highly variable and often sparse.

Limitations and Future Work

The authors acknowledge several limitations:

  • Data extracted from primary records might not fully represent all linked records for an initiative.
  • Neurological conditions were taken directly from sampled records without consolidating synonyms.
  • Some conditions classified under ICD-11 as neurological might have been missed.
  • The search was limited to published scientific literature and did not include clinical fields outside of neurology.
  • The search might have missed some initiatives or key records.

Future work will involve updating this review to create a "living" synthesis. The findings directly inform the AUS-TBI initiative's approach, emphasizing the importance of systematic reviews, diverse stakeholder involvement (including those with lived experience), and facilitated, iterative consensus processes. The AUS-TBI initiative will address TBI within six distinct study areas, aiming to build a comprehensive data dictionary for improved outcome prediction and treatment.

Summary updated

Abstract

The Australian Traumatic Brain Injury Initiative (AUS-TBI) aims to develop a health informatics approach to collect data predictive of outcomes for persons with moderate-severe TBI across Australia. Central to this approach is a data dictionary; however, no systematic reviews of methods to define and develop data dictionaries exist to-date. This rapid systematic review aimed to identify and characterize methods for designing data dictionaries to collect outcomes or variables in persons with neurological conditions. Database searches were conducted from inception through October 2021. Records were screened in two stages against set criteria to identify methods to define data dictionaries for neurological conditions (International Classification of Diseases, 11th Revision: 08, 22, and 23). Standardized data were extracted. Processes were checked at each stage by independent review of a random 25% of records. Consensus was reached through discussion where necessary. Thirty-nine initiatives were identified across 29 neurological conditions. No single established or recommended method for defining a data dictionary was identified. Nine initiatives conducted systematic reviews to collate information before implementing a consensus process. Thirty-seven initiatives consulted with end-users. Methods of consultation were "roundtable" discussion (<i>n</i> = 30); with facilitation (<i>n</i> = 16); that was iterative (<i>n</i> = 27); and frequently conducted in-person (<i>n</i> = 27). Researcher stakeholders were involved in all initiatives and clinicians in 25. Importantly, only six initiatives involved persons with lived experience of TBI and four involved carers. Methods for defining data dictionaries were variable and reporting is sparse. Our findings are instructive for AUS-TBI and can be used to further development of methods for defining data dictionaries.
BibTeX
@inproceedings{bagg2024australian,
  author = {Matthew K. Bagg and Amelia J. Hicks and Sarah C. Hellewell and Jennie Ponsford and Natasha A. Lannin and Terence J. O’Brien and Peter Cameron and D. James Cooper and Nick Rushworth and Belinda J. Gabbe and Melinda Fitzgerald and Australian Traumatic Brain Injury Initiative Investigators**},
  title = {{The Australian Traumatic Brain Injury Initiative: Statement of Working Principles and Rapid Review of Methods to Define Data Dictionaries for Neurological Conditions}},
  booktitle = {Neurotrauma},
  year = {2024},
  doi = {10.1089/neur.2023.0116},
}
Figure