Using Naturalistic Driving Data to Predict Mild Cognitive Impairment and Dementia: Preliminary Findings from the Longitudinal Research on Aging Drivers (LongROAD) Study

Xuan Di, Rongye Shi, Carolyn DiGuiseppi, David W. Eby, Linda Hill, Thelma J. Mielenz, Lisa J. Molnar, David Strogatz, Howard Andrews, Terry E. Goldberg, Brian Hung‐Hin Lang, Minjae Kim, Guohua LiGeriatrics 2021 · DOI

TL;DR

This study leverages naturalistic driving data from older adults to predict mild cognitive impairment (MCI) and dementia using machine learning. By analyzing 29 driving behavior variables, researchers developed a model that can predict MCI/dementia with 88% accuracy, offering a promising non-invasive tool for early detection.

What Problem Does This Paper Address?

As the population ages, the number of older drivers increases, raising concerns about driving safety due to age-related cognitive and functional declines. Crucially, subtle changes in driving behavior may serve as early indicators of cognitive impairment, such as Mild Cognitive Impairment (MCI) and dementia, potentially preceding more overt clinical symptoms. However, identifying these early signs is challenging. Traditional methods often rely on clinical assessments, which can be invasive and may not detect impairment until it's more advanced. This paper aims to bridge this gap by exploring the utility of passively collected, naturalistic driving data, combined with machine learning, as a non-invasive and potentially earlier method for detecting MCI and dementia in older adults.

Methods

The core of this study lies in applying Random Forests (RF), a powerful ensemble learning algorithm, to classify participants' cognitive status. RFs were chosen for their versatility, computational efficiency, and interpretability. The researchers experimented with five different model configurations, systematically varying the input covariates:

  1. Age only: A baseline model using only age.
  2. Demographic characteristics only: Including age, sex, race/ethnicity, and education.
  3. Driving variables only: Utilizing 29 distinct driving behavior metrics.
  4. Age and driving variables: Combining age with the driving metrics.
  5. Demographic characteristics and driving variables: The most comprehensive model, integrating all demographic factors with driving behaviors.

To handle the significant class imbalance (many more healthy participants than those with MCI/dementia), the researchers employed the Synthetic Minority Oversampling Technique (SMOTE) to rebalance the training data. Performance was evaluated using metrics like precision, recall, F1 score, and AUC. Feature importance analysis was conducted to identify which driving and demographic variables were most predictive.

Datasets

The primary dataset used is from the Longitudinal Research on Aging Drivers (LongROAD) study. This is a large, multisite, prospective cohort study involving active drivers aged 65-79 at enrollment.

  • Naturalistic Driving Data: Monthly driving data were collected for up to 45 months from 2977 participants using in-vehicle recording devices. This data was processed to derive 29 variables related to driving behaviors, space, and performance.
  • Incident MCI/Dementia Cases: 64 participants were identified as incident MCI or dementia cases through medical record reviews and annual interviews during the follow-up period.
  • Data Split: The dataset was split into training and testing sets. The training set was rebalanced using SMOTE, resulting in approximately 39,401 records (19,220 healthy, 20,181 MCI/dementia). The test set consisted of 77 healthy and 102 MCI/dementia data points.

Key Insights and Ideas

  • Driving Behavior as a Biomarker: The study strongly supports the idea that subtle, objective changes in driving patterns can serve as early, non-invasive biomarkers for cognitive decline, potentially preceding clinical diagnosis.
  • Machine Learning's Predictive Power: Random Forests, when applied to naturalistic driving data, demonstrate a remarkable ability to distinguish between individuals with and without MCI/dementia.
  • Synergy of Demographics and Driving Data: Combining basic demographic information with detailed driving behavior metrics significantly boosts predictive accuracy, suggesting a holistic approach is most effective.
  • Specific Driving Predictors: The analysis highlights that not all driving behaviors are equally predictive. Features related to driving space (e.g., distance from home), driving time, and instances of aggressive maneuvers (hard braking) are particularly informative.

Key Results

The study found that:

  • A model using demographic characteristics alone achieved an F1 score of 0.48.
  • A model using driving variables alone achieved a significantly higher F1 score of 0.66.
  • The most comprehensive model, combining demographic characteristics and driving variables, achieved the highest F1 score of 0.88.
  • Age was identified as the single most important predictor.
  • Among driving variables, the percentage of trips within 15 miles of home (indicating restricted driving space), minutes per trip chain, minutes per trip, and the number of hard braking events (deceleration rates ≥ 0.35 g) were among the top predictors.

Limitations and Future Work

  • Modest Number of Cases: The study acknowledges a limitation in the relatively small number of incident MCI and dementia cases (n=64). This led to the inclusion of driving features across all participants without specifying individual time-series sequences, which could be a more nuanced approach.
  • Oversampling Bias: While SMOTE was necessary to address data imbalance, the authors note that results from the rebalanced dataset may not be entirely generalizable to the real-world, highly imbalanced setting.
  • MCI vs. Dementia Distinction: The study classified MCI and dementia together as a binary outcome. Future work should aim to develop separate prediction models for MCI and dementia, and potentially for progression from MCI to dementia.
  • Lack of Detailed Diagnostic Data: The LongROAD protocol did not include detailed neurological tests or imaging biomarkers, limiting the ability to link driving behavior directly to specific pathological changes.
  • Future Directions: The authors propose developing personalized, time-dependent classifiers using individual-level longitudinal driving data. They envision integrating these algorithms into smartphone apps or other devices for early detection of MCI and dementia in older drivers.

Summary updated

Abstract

Emerging evidence suggests that atypical changes in driving behaviors may be early signals of mild cognitive impairment (MCI) and dementia. This study aims to assess the utility of naturalistic driving data and machine learning techniques in predicting incident MCI and dementia in older adults. Monthly driving data captured by in-vehicle recording devices for up to 45 months from 2977 participants of the Longitudinal Research on Aging Drivers study were processed to generate 29 variables measuring driving behaviors, space and performance. Incident MCI and dementia cases (n = 64) were ascertained from medical record reviews and annual interviews. Random forests were used to classify the participant MCI/dementia status during the follow-up. The F1 score of random forests in discriminating MCI/dementia status was 29% based on demographic characteristics (age, sex, race/ethnicity and education) only, 66% based on driving variables only, and 88% based on demographic characteristics and driving variables. Feature importance analysis revealed that age was most predictive of MCI and dementia, followed by the percentage of trips traveled within 15 miles of home, race/ethnicity, minutes per trip chain (i.e., length of trips starting and ending at home), minutes per trip, and number of hard braking events with deceleration rates ≥ 0.35 g. If validated, the algorithms developed in this study could provide a novel tool for early detection and management of MCI and dementia in older drivers.
BibTeX
@inproceedings{di2021using,
  author = {Xuan Di and Rongye Shi and Carolyn DiGuiseppi and David W. Eby and Linda Hill and Thelma J. Mielenz and Lisa J. Molnar and David Strogatz and Howard Andrews and Terry E. Goldberg and Brian Hung‐Hin Lang and Minjae Kim and Guohua Li},
  title = {{Using Naturalistic Driving Data to Predict Mild Cognitive Impairment and Dementia: Preliminary Findings from the Longitudinal Research on Aging Drivers (LongROAD) Study}},
  booktitle = {Geriatrics},
  year = {2021},
  doi = {10.3390/geriatrics6020045},
}
Figure