TL;DR
This paper introduces the Hong Kong Grocery Shopping Dialog Task (HK-GSDT), a novel, brief, and ecologically valid screening tool for neurocognitive disorders (NCDs). The HK-GSDT demonstrates good reliability and validity, performing comparably to established tests and even improving screening accuracy when used in combination with them.
What Problem Does This Paper Address?
Neurocognitive disorders (NCDs), including dementia, are a growing global health concern. Early and accurate screening is crucial for timely intervention and management. Existing screening tools, while valuable, often have limitations such as being time-consuming, having low ecological validity (i.e., not reflecting real-world cognitive demands), or neglecting certain cognitive domains like social cognition or non-verbal episodic memory. The authors identified a need for a quick, easy-to-administer, and comprehensive screening test that addresses these gaps, particularly for the diverse range of NCDs.
Methods
The HK-GSDT is a structured dialog task designed to simulate a common instrumental activity of daily living: grocery shopping. Participants are asked to identify ingredients for a dish, describe the cooking steps, and then verbally narrate the process of purchasing those ingredients in a hypothetical grocery store. The task takes approximately 10 minutes to administer. Performance is scored across five items, including correctly identifying ingredients and aisles, and recalling locations.
To validate the HK-GSDT, the researchers conducted a study with 545 older adults in Hong Kong, categorized into three groups: normal aging, mild NCD (m-NCD), and major NCD (M-NCD). They assessed:
- Reliability: Internal consistency was measured using Cronbach's alpha and McDonald's omega.
- Structural Validity: Exploratory factor analysis was used to confirm that the test items loaded onto a single cognitive function factor.
- Convergent and Divergent Validity: Correlations were examined between HK-GSDT scores and scores on established cognitive tests (e.g., MoCA, HKLLT, digit span, mBNT) and measures of demographic variables and non-cognitive factors (e.g., GDS, CCT, AD8).
- Criterion Validity: Receiver operating characteristic (ROC) analyses were used to evaluate the HK-GSDT's ability to discriminate between different cognitive groups, both as a standalone test and in combination with other NCD screening tools.
- Test Bias: The influence of demographic factors (age, gender, education) on HK-GSDT performance was investigated.
Datasets
The study utilized data from 545 older adults in Hong Kong. These participants were classified into three cognitive health conditions:
- Major NCD (M-NCD): 42 participants
- Mild NCD (m-NCD): 39 participants
- Normal Aging: 464 participants
The study also employed several established neurocognitive tests for comparison and validation, including:
- Montreal Cognitive Assessment (MoCA) - full and 5-min versions
- Hong Kong List Learning Test (HKLLT) 2nd Edition
- Wechsler's backward/forward digit span tasks
- Wechsler's logical memory recognition task
- Modified Boston Naming Test (mBNT) with 30 items
- Eight-item Interview to Differentiate Aging and Dementia (AD8)
- Color Trails Test (CTT)
- Geriatric Depression Scale (GDS) - 5-item version
No new benchmark datasets were introduced; rather, the HK-GSDT was evaluated against existing measures.
Key Insights and Ideas
- Ecological Validity Matters: The HK-GSDT's strength lies in its simulation of a familiar, everyday activity (grocery shopping), which likely reduces test bias related to unfamiliarity and better reflects real-world cognitive competence compared to abstract laboratory tasks.
- Dialog is Key: The task's reliance on dialog and conversational interaction is a novel approach for NCD screening, capturing language and communication nuances often missed by other tests.
- Comprehensive Coverage: Despite its brevity, the HK-GSDT taps into multiple cognitive domains, including perceptual-motor function, attention, learning and memory (verbal and non-verbal episodic), executive function, and language production/comprehension.
- Early Detection Potential: The HK-GSDT's ability to explain additional variance in cognitive status when combined with other tests suggests it can contribute to more accurate and earlier detection of NCDs, particularly mild forms.
Key Results
- Reliability: The HK-GSDT demonstrated acceptable internal reliability (Cronbach's α = 0.70, McDonald's ω = 0.79).
- Structural Validity: A single latent factor, "cognitive function," accounted for 47.1% of the variance in the test items.
- Convergent Validity: HK-GSDT scores showed medium to strong correlations with established tests measuring similar cognitive functions, indicating good convergent validity.
- Divergent Validity: HK-GSDT scores had low correlations with demographic variables and tests measuring dissimilar constructs, suggesting good divergent validity.
- Criterion Validity (Standalone): The HK-GSDT performed comparably to MoCA and HKLLT in discriminating between major NCDs and other conditions, and between major NCDs and mild NCDs. However, like other tests, it struggled to differentiate between normal aging and mild NCDs.
- Criterion Validity (Combined): When used in conjunction with other tests (MoCA, HKLLT, AD8), the HK-GSDT significantly improved model fit and explained an additional 3%-12% of the variance in cognitive status, enhancing overall screening accuracy.
- Test Bias: While age showed a moderate correlation with HK-GSDT scores, gender and education did not significantly bias performance. The test appeared to be equally effective across different ages, genders, and education levels.
Limitations and Future Work
- Distinguishing Mild NCD from Normal Aging: The study acknowledges that the HK-GSDT, like other tested instruments, was not highly effective in distinguishing between normal aging and mild NCD. This might be due to the tasks being too easy for these groups or the sample size of the m-NCD group being insufficient.
- Cultural Adaptation: While the chosen dish is familiar in Hong Kong, the authors suggest that for use in other cultures, the specific dish and grocery items might need modification to maintain ecological validity.
- Culinary Knowledge Influence: Participants' existing culinary knowledge could potentially influence their performance, although the authors attempted to mitigate this by using a common dish and not scoring cooking procedure descriptions.
- Future Directions:
- Investigate the HK-GSDT's ability to differentiate between specific types of NCDs (e.g., AD, FTD, VD) with a larger sample.
- Administer the HK-GSDT to a larger, more diverse population to establish reliable cut-off points and norms.
- Examine the HK-GSDT's applicability and potential modifications for use in different cultures.
- Explore its use as an outcome measure in intervention studies.
- Investigate the underlying neural mechanisms of the HK-GSDT using neuroimaging techniques.
- Increase task difficulty in future adaptations to better distinguish between normal aging and m-NCDs.
- Integrate spoken language data analysis (text and audio) with the HK-GSDT for potentially higher screening accuracy, leveraging advancements in machine learning.
Summary updated