Measurement invariance of six language versions of the post-traumatic stress disorder checklist for DSM-5 in civilians after traumatic brain injury

Fabian Bockhop, Marina Zeldovich, Katrin Cunitz, Dominique Van Praag, Marjolein van der Vlegel, Tim Beißbarth, York Hagmayer, Nicole von Steinbüechel, Cecilia Åkerlund, Krisztina Amrein, Nada Anđelić, Lasse Andreassen, Audny Anke, Anna Antoni, Gérard Audibert, Philippe Azouvi, Maria Luisa Azzolini, Ronald Bartels, Pál Barzó, Romuald Beauvais, Ronny Beer, Bo‐Michael Bellander, Antonio Belli, Habib Benali, Maurizio Berardino, Luigi Beretta, Morten Blaabjerg, Peter Bragge, Alexandra Bražinová, Vibeke Brinck, Joanne Brooker, Camilla Brorsson, András Büki, Monika Bullinger, Manuel Cabeleira, Alessio Caccioppola, Emiliana Calappi, Maria Rosa Calvi, Peter Cameron, Guillermo Carbayo Lozano, Marco Carbonara, Simona Cavallo, Giorgio Chevallard, Arturo Chieregato, Giuseppe Citerio, Hans Clusmann, Mark Coburn, Jonathan Coles, D. James Cooper, Marta Correia, Amra Čović, Nicola Curry, Endre Czeiter, Marek Czosnyka, Claire Dahyot‐Fizelier, Paul Dark, Helen Dawes, Véronique De Keyser, Vincent Degos, Françesco Della Corte, Hugo den Boogert, Bart Depreitere, Đula Đilvesi, Abhishek Dixit, Emma Donoghue, Jens P. Dreier, Guy‐Loup Dulière, Ari Ercole, Patrick Esser, Erzsébet Ezer, Martin Fabricius, Valery L. Feigin, Kelly Foks, Shirin Frisvold, Alex Furmanov, Pablo Gagliardo, Damien Galanaud, Dashiell Gantner, Guoyi Gao, Pradeep George, Alexandre Ghuysen, Lelde Giga, Ben Glocker, Jagoš Golubović, Pedro A. Gómez, Johannes Gratz, Benjamin Gravesteijn, Francesca Grossi, Russell L. Gruen, Deepak Gupta, Juanita A. Haagsma, Iain Haitsma, Raimund Helbok, Eirik Helseth, Lindsay Horton, Jilske Huijben, Peter J. Hutchinson, Bram Jacobs, Stefan Jankowski, Mike JarrettScientific 2022 · DOI

Abstract

Traumatic brain injury (TBI) is frequently associated with neuropsychiatric impairments such as symptoms of post-traumatic stress disorder (PTSD), which can be screened using self-report instruments such as the Post-Traumatic Stress Disorder Checklist for DSM-5 (PCL-5). The current study aims to inspect the factorial validity and cross-linguistic equivalence of the PCL-5 in individuals after TBI with differential severity. Data for six language groups (n ≥ 200; Dutch, English, Finnish, Italian, Norwegian, Spanish) were extracted from the CENTER-TBI study database. Factorial validity of PTSD was evaluated using confirmatory factor analyses (CFA), and compared between four concurrent structural models. A multi-group CFA approach was utilized to investigate the measurement invariance (MI) of the PCL-5 across languages. All structural models showed satisfactory goodness-of-fit with small between-model variation. The original DSM-5 model for PTSD provided solid evidence of MI across the language groups. The current study underlines the validity of the clinical DSM-5 conceptualization of PTSD and demonstrates the comparability of PCL-5 symptom scores between language versions in individuals after TBI.

Introduction

Traumatic brain injury (TBI) is a global health challenge, often accompanied by complex neuropsychiatric issues like post-traumatic stress disorder (PTSD). Diagnosing PTSD in TBI patients is notoriously difficult because symptoms often overlap—headaches, irritability, and sleep disturbances can result from the physical brain injury, the psychological trauma, or both.

To screen for PTSD, clinicians use the PCL-5, a 20-item self-report tool. However, a tool developed in one language or for one specific population might not translate perfectly to others. If the "weight" of a specific question changes when translated, or if patients with severe injuries interpret questions differently than those with mild ones, the resulting scores are biased. This paper addresses the challenge of measurement invariance (MI): proving that the PCL-5 measures the same "latent construct" of PTSD regardless of the language spoken or the severity of the brain injury.

Methods and Datasets

The study utilized data from the CENTER-TBI project (Collaborative European NeuroTrauma Effectiveness Research in TBI), a massive, high-quality multicenter study. The total sample consisted of 1,776 individuals across six language subgroups: Dutch, English, Finnish, Italian, Norwegian, and Spanish. Inclusion criteria required participants to be adults (≥16 years) with a clinical diagnosis of TBI and a CT scan, assessed 6 months post-injury.

Table 1: Demographic and clinical characteristics of the study sample by language group.

The researchers employed Confirmatory Factor Analysis (CFA) to test how well the data fit the theoretical structure of PTSD. They compared four competing structural models: the original 4-factor DSM-5 model, the 4-factor Dysphoria model, the 6-factor Anhedonia model, and the 7-factor Hybrid model. To test for measurement invariance across groups, they used a multi-group CFA approach with a robust weighted least square mean and variance (WLSMV) estimator, testing for configural, threshold, and loading invariance.

Key Results

The study found that all structural models showed "satisfactory goodness-of-fit," with Comparative Fit Index (CFI) and Tucker-Lewis Index (TLI) values consistently above 0.99. While more complex models (like the 7-factor Hybrid model) showed slightly better statistical fit, the original 4-factor DSM-5 model provided solid evidence of MI across the language groups.

Table 2: Standardized factor loadings for the four structural models of PTSD.

As shown in Table 2, factor loadings were strong across all items, supporting the validity of the clinical DSM-5 conceptualization. Likelihood ratio tests for the multi-group CFA showed no significant differences between models ($p > .99$ for both thresholds and loadings), providing strong evidence for the structural equivalence of the PCL-5 across languages.

PTSD was common across the board, with 10.7% of the total sample meeting the screening cutoff (PCL-5 ≥ 31). Rates varied by region, being highest in the Italian sample (17.24%) and lowest in the Finnish sample (7.08%).

Discussion

The establishment of measurement invariance is a major milestone for international TBI research. It confirms that data from different countries can be aggregated and compared directly without fear of translation bias. A high score in one language reflects the same underlying psychological distress as in another.

Interestingly, the tool worked just as well for "ultra-mild" TBI cases (those who fully recovered) as it did for those with severe, life-altering injuries. This indicates the PCL-5 is a versatile tool across the entire clinical spectrum of TBI. However, cultural nuances were observed; for example, in Finnish and Norwegian groups, participants rarely used the "extremely impaired" category for items like "Flashbacks," requiring researchers to collapse response categories for statistical analysis.

Limitations and Future Work

Despite these successes, untangling TBI-related symptoms from PTSD-related ones remains a challenge due to their inherent overlap. Furthermore, while language and injury severity were covered, the study did not explicitly test for invariance across age or gender. Future studies should compare TBI patients against a truly non-injured general population to further refine the tool's specificity and improve clinical care for individuals suffering from PTSD symptoms after TBI.

Summary updated

Abstract

Traumatic brain injury (TBI) is frequently associated with neuropsychiatric impairments such as symptoms of post-traumatic stress disorder (PTSD), which can be screened using self-report instruments such as the Post-Traumatic Stress Disorder Checklist for DSM-5 (PCL-5). The current study aims to inspect the factorial validity and cross-linguistic equivalence of the PCL-5 in individuals after TBI with differential severity. Data for six language groups (n ≥ 200; Dutch, English, Finnish, Italian, Norwegian, Spanish) were extracted from the CENTER-TBI study database. Factorial validity of PTSD was evaluated using confirmatory factor analyses (CFA), and compared between four concurrent structural models. A multi-group CFA approach was utilized to investigate the measurement invariance (MI) of the PCL-5 across languages. All structural models showed satisfactory goodness-of-fit with small between-model variation. The original DSM-5 model for PTSD provided solid evidence of MI across the language groups. The current study underlines the validity of the clinical DSM-5 conceptualization of PTSD and demonstrates the comparability of PCL-5 symptom scores between language versions in individuals after TBI. Future studies should apply MI methods to other sociodemographic (e.g., age, gender) and injury-related (e.g., TBI severity) characteristics to improve the monitoring and clinical care of individuals suffering from PTSD symptoms after TBI.
BibTeX
@inproceedings{bockhop2022measurement,
  author = {Fabian Bockhop and Marina Zeldovich and Katrin Cunitz and Dominique Van Praag and Marjolein van der Vlegel and Tim Beißbarth and York Hagmayer and Nicole von Steinbüechel and Cecilia Åkerlund and Krisztina Amrein and Nada Anđelić and Lasse Andreassen and Audny Anke and Anna Antoni and Gérard Audibert and Philippe Azouvi and Maria Luisa Azzolini and Ronald Bartels and Pál Barzó and Romuald Beauvais and Ronny Beer and Bo‐Michael Bellander and Antonio Belli and Habib Benali and Maurizio Berardino and Luigi Beretta and Morten Blaabjerg and Peter Bragge and Alexandra Bražinová and Vibeke Brinck and Joanne Brooker and Camilla Brorsson and András Büki and Monika Bullinger and Manuel Cabeleira and Alessio Caccioppola and Emiliana Calappi and Maria Rosa Calvi and Peter Cameron and Guillermo Carbayo Lozano and Marco Carbonara and Simona Cavallo and Giorgio Chevallard and Arturo Chieregato and Giuseppe Citerio and Hans Clusmann and Mark Coburn and Jonathan Coles and D. James Cooper and Marta Correia and Amra Čović and Nicola Curry and Endre Czeiter and Marek Czosnyka and Claire Dahyot‐Fizelier and Paul Dark and Helen Dawes and Véronique De Keyser and Vincent Degos and Françesco Della Corte and Hugo den Boogert and Bart Depreitere and Đula Đilvesi and Abhishek Dixit and Emma Donoghue and Jens P. Dreier and Guy‐Loup Dulière and Ari Ercole and Patrick Esser and Erzsébet Ezer and Martin Fabricius and Valery L. Feigin and Kelly Foks and Shirin Frisvold and Alex Furmanov and Pablo Gagliardo and Damien Galanaud and Dashiell Gantner and Guoyi Gao and Pradeep George and Alexandre Ghuysen and Lelde Giga and Ben Glocker and Jagoš Golubović and Pedro A. Gómez and Johannes Gratz and Benjamin Gravesteijn and Francesca Grossi and Russell L. Gruen and Deepak Gupta and Juanita A. Haagsma and Iain Haitsma and Raimund Helbok and Eirik Helseth and Lindsay Horton and Jilske Huijben and Peter J. Hutchinson and Bram Jacobs and Stefan Jankowski and Mike Jarrett},
  title = {{Measurement invariance of six language versions of the post-traumatic stress disorder checklist for DSM-5 in civilians after traumatic brain injury}},
  booktitle = {Scientific},
  year = {2022},
  doi = {10.1038/s41598-022-20170-2},
}
Figure