A Fully-Immersive and Automated Virtual Reality System to Assess the Six Domains of Cognition: Protocol for a Feasibility Study

Jie En Lim, Wei Teen Wong, Tuan Ann Teh, Soon Huat Lim, John Carson Allen, Joanne Hui Min Quah, Rahul Malhotra, Ngiap Chuan TanFrontiers in Aging Neuroscience 2021 · DOI

TL;DR

This paper introduces CAVIRE, a novel, fully-immersive virtual reality (VR) system designed to assess the six core domains of cognitive function. The study protocol outlines a feasibility assessment of CAVIRE in a primary care setting, aiming to establish its potential as an accessible and comprehensive tool for cognitive screening, particularly for dementia and mild cognitive impairment.

What Problem Does This Paper Address?

Dementia is a growing global health concern, particularly in aging populations. Current methods for assessing cognitive function, such as questionnaires, often fall short in comprehensively evaluating all cognitive domains in real-time and may not accurately reflect an individual's performance in everyday tasks. Existing VR-based cognitive assessments also tend to have limited scope. This study addresses the need for a more immersive, automated, and comprehensive tool that can accurately assess the six key cognitive domains (perceptual-motor, executive, attention, social cognition, learning/memory, and language) in a standardized manner.

Methods

The core of this research is the development and proposed feasibility testing of the CAVIRE (Cognitive Assessment by Virtual Reality) system. CAVIRE is a fully-immersive VR system that utilizes a head-mounted device and incorporates automated audio-visual instructions. It features an automated scoring matrix designed to assess the six cognitive domains across 13 different task segments. These tasks are designed to mimic everyday activities such as domestic chores, memory recall, shopping, and social interactions. The system also includes a tutorial session to familiarize participants with the VR environment and controls. The feasibility study will involve participants undergoing both traditional cognitive assessments (MoCA, AMT, MMSE, BADLs, IADLs) and the CAVIRE VR assessment.

Datasets

Not discussed in the paper. The study is a protocol for a feasibility study and does not present results from a completed dataset.

Key Insights and Ideas

  • Immersive VR for Comprehensive Cognition: The paper highlights the potential of fully-immersive VR to move beyond the limitations of traditional questionnaires by simulating real-world scenarios for cognitive assessment.
  • Automated and Standardized Assessment: The integration of automated audio-visual instructions and an automated scoring matrix in CAVIRE aims to standardize the assessment process, reducing inter-rater variability and increasing efficiency.
  • Bridging the Gap in Cognitive Assessment: CAVIRE is proposed as a novel modality to complement existing tools, offering a more holistic evaluation of cognitive function across multiple domains.
  • Feasibility as a Crucial First Step: The study's focus on feasibility is a pragmatic approach, recognizing that before widespread adoption, a new assessment tool must demonstrate its practicality and user acceptance.

Key Results

As this is a protocol for a feasibility study, no quantitative results are presented. The study aims to:

  • Feasibility: Determine if at least 90% of participants in each age group can complete the entire CAVIRE assessment.
  • Time Efficiency: Compare the time taken to complete CAVIRE with traditional questionnaire-based assessments, hypothesizing that CAVIRE will be equal to or less than the traditional methods.
  • Discriminatory Power: Compare CAVIRE performance indices (completion time and scores) between younger (35-64) and older (65-84) cognitively healthy adults, and between cognitively healthy and impaired older adults. The hypothesis is that younger and cognitively healthy individuals will perform better.
  • Acceptability: Evaluate participant acceptance of CAVIRE through feedback forms, with the expectation of a positive overall response.

Limitations and Future Work

  • Potential for Motion Sickness/Discomfort: The authors acknowledge that participants might drop out due to headache, nausea, or giddiness during the VR assessment.
  • Language Barrier: Currently, CAVIRE uses English as the medium of instruction. Future development aims to incorporate other local languages.
  • Selection Bias: Due to the nature of a feasibility study, random sampling is not possible, potentially leading to selection bias. Future studies will aim for random sampling if results are favorable.
  • Younger Participants' Advantage: Younger participants may have an advantage due to prior experience with gaming and VR. The tutorial session is intended to mitigate this.
  • Future Work: If feasibility is confirmed, the next phase will involve content validation. Further studies will examine the implementation and scalability of CAVIRE in healthcare settings. The authors also plan to explore the application of medical technology for novel cognitive assessment modalities.

Summary updated

Abstract

<b>Introduction:</b> Dementia is increasing in prevalence in aging populations. Current questionnaire-based cognitive assessments may not comprehensively assess cognitive function and real-time task-performance. Virtual reality (VR) technology has been used in cognitive assessments but existing systems have limited scope in evaluating all cognitive domains. We have developed a novel, fully-immersive VR system (CAVIRE: Cognitive Assessment by VIrtual REality), which incorporates automated audio-visual instructions. An automated scoring matrix to assess the six cognitive domains-perceptual-motor function, executive function, complex attention, social cognition, learning and memory, and language-is embedded in the CAVIRE system. <b>Aims:</b> The primary aim is to evaluate the feasibility of using the CAVIRE system to assess cognitive function of participants across different age groups from 35 to 84 years old. The secondary aims are to determine the CAVIRE performance-indices (completion time and scores) of the participants and to assess their acceptability toward the use of CAVIRE as a modality for cognitive assessment. <b>Methods:</b> One hundred and seventy-five participants will be assessed by CAVIRE at a primary care clinic in Singapore. They will be first assessed using questionnaires: Montreal Cognitive Assessment (MoCA), Abbreviated Mental Test (AMT), Mini-Mental State Examination (MMSE), Basic Activities of Daily Living (BADLs), Instrumental Activities of Daily Living (IADLs). Those aged 65-84 years will be grouped into cognitively intact (<i>n</i> = 50, MoCA score ≥ 26) and cognitively impaired (<i>n</i> = 50, MoCA < 26). The CAVIRE performance-indices of cognitively healthy younger participants aged 35-64 years (<i>n</i> = 75) will serve as benchmark references. CAVIRE auto-computes the participant's performance-indices in 13 different segments. The tasks include domestic chores, memory, shopping, and social interactions. The proportion of participants who complete the entire VR assessment in each age group will be evaluated as feasibility indicators. The CAVIRE performance-indices will be compared across the different age groups. Feedback on the acceptability of the CAVIRE system will be collated and compared among the participants across the age groups. <b>Significance:</b> CAVIRE is designed to assess the six domains of cognitive function using VR. The results of this feasibility study will provide insights for the implementation of the CAVIRE system as an alternative modality of cognitive assessment in the community.
BibTeX
@inproceedings{lim2021fully,
  author = {Jie En Lim and Wei Teen Wong and Tuan Ann Teh and Soon Huat Lim and John Carson Allen and Joanne Hui Min Quah and Rahul Malhotra and Ngiap Chuan Tan},
  title = {{A Fully-Immersive and Automated Virtual Reality System to Assess the Six Domains of Cognition: Protocol for a Feasibility Study}},
  booktitle = {Frontiers in Aging Neuroscience},
  year = {2021},
  doi = {10.3389/fnagi.2020.604670},
}
Figure