Visual Cognitive Assessment Test (VCAT): A language‐neutral test to detect mild cognitive impairment and dementia in multinational cohorts

Kok Pin Ng, Gwen Cui Fann Ong, Seyed Ehsan Saffari, Marina Musse Bernardes, Antonella Brun de Carvalho, Lucas Porcello Schilling, Anandhi Ranganathan, Rema Raghu, Pedro Rosa‐Neto, Serge Gauthier, Yidan Liu, Xiaofeng Li, Min Jae Baek, SangYun Kim, Nagaendran KandiahAlzheimer 2024 · DOI

TL;DR

This paper introduces the Visual Cognitive Assessment Test (VCAT), a language-neutral visual assessment designed to detect mild cognitive impairment (MCI) and dementia across diverse linguistic backgrounds. VCAT demonstrates strong performance in distinguishing between cognitively normal individuals and those with MCI or dementia, proving comparable to established tests like MoCA and MMSE in multinational cohorts.

What Problem Does This Paper Address?

Diagnosing mild cognitive impairment (MCI) and dementia is crucial for timely intervention and care. However, many existing cognitive assessment tools are developed and validated primarily in English-speaking populations. This presents a significant challenge when applying these tests to multilingual and multicultural groups, as translation can alter test psychometrics and lead to inaccurate assessments. The authors address this gap by developing and evaluating VCAT, a visual-based assessment designed to bypass language barriers and provide a more equitable and reliable diagnostic tool for a global population.

Methods

The study employed a multinational approach to evaluate the Visual Cognitive Assessment Test (VCAT). Participants from Brazil, Canada, China, India, Korea, and Singapore were recruited, totaling 670 individuals (294 cognitively normal (CN), 244 with MCI, and 132 with dementia). The administration of VCAT, along with two established screening tests, the Montreal Cognitive Assessment (MoCA) and the Mini-Mental State Examination (MMSE), was standardized across all study sites. The primary method for assessing VCAT's performance was the area under the curve (AUC) analysis, which measures the test's ability to discriminate between MCI+Dementia and CN individuals within each country.

Datasets

The study utilized data from 670 participants recruited across six countries: Brazil, Canada, China, India, Korea, and Singapore. This multinational cohort included individuals diagnosed as cognitively normal (CN), with mild cognitive impairment (MCI), or with dementia. No new benchmarks were introduced; instead, VCAT's performance was compared against existing benchmarks (MoCA and MMSE) within these diverse populations.

Key Insights and Ideas

  • Bridging the Language Divide: The core innovation is VCAT's language-neutral design, which is critical for accurate cognitive assessment in a globalized world where linguistic diversity is the norm. This approach directly tackles the psychometric challenges posed by translating traditional verbal tests.
  • Visual Assessment as a Universal Tool: By relying on visual stimuli, VCAT offers a promising avenue for standardized cognitive screening across cultures, potentially leveling the playing field for individuals from non-English speaking backgrounds.
  • Cross-Cultural Validation is Key: The study's multinational design is crucial. It moves beyond single-country validation to demonstrate VCAT's potential utility in a variety of linguistic and cultural contexts, highlighting the importance of such diverse evaluations for diagnostic tools.

Key Results

VCAT demonstrated strong discriminative validity across the multinational cohorts. The AUCs for VCAT in detecting MCI+Dementia versus CN were as follows: Brazil (0.979), China (0.929), Korea (0.956), India (0.808), Canada (0.708), and Singapore (0.731). These results indicate VCAT's effectiveness in distinguishing between cognitive states. Furthermore, VCAT's performance was comparable to that of MoCA and MMSE in these diverse groups. For instance, MoCA's AUCs ranged from 0.771 (Brazil) to 0.964 (Korea), and MMSE's AUCs ranged from 0.721 (Canada) to 0.896 (Brazil).

Limitations and Future Work

The authors acknowledge that while VCAT showed satisfactory discriminative validity, further analysis in a larger cohort is planned to validate its global utility. The current study, while multinational, is still a step towards a comprehensive global validation. Future work will likely focus on expanding the cohort size and diversity to further solidify VCAT's role as a universal cognitive assessment tool.

Summary updated

Abstract

VCAT showed satisfactory discriminative validity in differentiating MCI+Dementia from CN participants within multinational, multilingual cohorts. VCAT was also comparable to the MoCA and MMSE. Further analysis in a larger cohort within our study will be performed to validate the utility of VCAT globally.
BibTeX
@inproceedings{ng2024visual,
  author = {Kok Pin Ng and Gwen Cui Fann Ong and Seyed Ehsan Saffari and Marina Musse Bernardes and Antonella Brun de Carvalho and Lucas Porcello Schilling and Anandhi Ranganathan and Rema Raghu and Pedro Rosa‐Neto and Serge Gauthier and Yidan Liu and Xiaofeng Li and Min Jae Baek and SangYun Kim and Nagaendran Kandiah},
  title = {{Visual Cognitive Assessment Test (VCAT): A language‐neutral test to detect mild cognitive impairment and dementia in multinational cohorts}},
  booktitle = {Alzheimer},
  year = {2024},
  doi = {10.1002/alz.090328},
}
Figure