A machine learning approach to predict tau positivity using clinical features in amyloid‐positive individuals

Daniel Arnold, Wyllians Vendramini Borelli, Luiza Santos Machado, Nesrine Rahmouni, Joseph Therriault, Stijn Servaes, Jenna Stevenson, Arthur C. Macedo, Artur Francisco Schumacher Schuh, Christian Mattjie, Rodrigo C. Barros, Marco Antônio De Bastiani, Firoza Z Lussier, Mira Chamoun, Gleb Bezgin, Andréa Lessa Benedet, Tharick A. Pascoal, Pedro Rosa‐Neto, Eduardo R. Zimmer, Alzheimer's Disease Neuroimaging Initiative (adni)Alzheimer 2024 · DOI

TL;DR

This paper presents a machine learning model that can predict tau positivity in individuals already confirmed to have amyloid pathology, using only readily available clinical and cognitive data. This approach could significantly streamline participant selection for Alzheimer's disease clinical trials, reducing reliance on expensive tau PET scans.

What Problem Does This Paper Address?

Clinical trials for Alzheimer's disease (AD) therapies often target individuals with both amyloid and tau pathology, as this combination is strongly linked to cognitive decline. However, current trial inclusion criteria typically only require amyloid positivity, often confirmed through PET scans or CSF analysis. This means many participants might be included who don't have the tau pathology that the therapy is designed to address, leading to potentially diluted trial results and increased costs. The challenge is to efficiently identify which amyloid-positive individuals are also likely to be tau-positive without requiring extensive and costly tau-specific imaging for everyone.

Methods

The researchers employed a machine learning approach, specifically using an XGBoost model. This is a powerful gradient boosting algorithm known for its performance in classification tasks. They trained and validated this model on a dataset of amyloid-positive individuals, aiming to predict their tau status. The model was trained on a portion of the data, tuned using a validation set, and then evaluated on a separate test set. To understand which clinical features were most influential in the model's predictions, they utilized SHAP (SHapley Additive exPlanations) values, a technique that provides a unified measure of feature importance.

Datasets

The study utilized data from three major longitudinal AD research initiatives:

  • ADNI (Alzheimer's Disease Neuroimaging Initiative)
  • TRIAD
  • PPMI (Parkinson's Progression Markers Initiative)

These datasets were pooled to create a combined cohort of 1191 amyloid-positive participants. The tau status was determined using either tau PET imaging or CSF p-tau181 levels, while amyloid positivity was confirmed via amyloid PET or CSF AB42.

Key Insights and Ideas

  • Clinical Data is Powerful: The most striking insight is that basic clinical and cognitive information (age, diagnosis, and MOCA scores) can be highly predictive of tau positivity, even in individuals already known to be amyloid-positive. This suggests that tau pathology might manifest in predictable ways through these observable metrics.
  • Efficiency Gains: By using a machine learning model on readily available clinical data, researchers can potentially "pre-screen" participants for tau positivity. This could significantly reduce the number of individuals who need to undergo expensive tau PET scans, making trial recruitment more efficient and cost-effective.
  • Understanding Feature Importance: The SHAP analysis revealed that age, current diagnosis (Cognitive Normal vs. MCI vs. Dementia), and MOCA scores were the top predictors. This aligns with the general understanding that tau pathology tends to accumulate with age and is more pronounced in individuals with more advanced cognitive impairment.

Key Results

The XGBoost model achieved a strong performance in predicting tau positivity:

  • Area Under the Curve (AUC): 0.81, indicating good discriminative ability.
  • Sensitivity: 0.76 (correctly identifying tau-positive individuals).
  • Specificity: 0.86 (correctly identifying tau-negative individuals).
  • Accuracy: 0.83 (overall correct predictions).

The top three most impactful features identified by SHAP analysis were:

  1. Age
  2. Diagnosis (specifically, being cognitively normal - CN)
  3. MOCA score

Limitations and Future Work

Limitations: * The study focused on individuals already confirmed to be amyloid-positive. The model's performance in a broader, unselected population is not discussed. * The definition of tau positivity relied on either tau PET or CSF p-tau181. While these are standard, they represent different biological measures.

Future Work: The authors suggest several avenues for future research:

  • Expand Cohorts: Incorporating more individuals and data from diverse cohorts to further optimize the model's generalizability.
  • Include More Variables: Investigating the predictive power of additional clinical and demographic variables.
  • Clinical Trial Application: Testing the model's performance in real-world clinical trial settings and evaluating its impact on recruitment efficiency and trial outcomes.
  • Two-Step Workflow: Implementing a two-step screening process where clinical variables are used first, followed by tau-specific tests only for those predicted to be tau-positive.

Summary updated

Abstract

Abstract Background Anti‐amyloid therapy appears to have an increased effect on reducing cognitive decline in amyloid‐ and tau‐positive individuals. However, clinical trials inclusion criteria require solely amyloid positivity. Herein, we developed a machine‐learning prediction model to identify tau positivity in amyloid‐positive individuals using clinical variables. Method We selected 1191 amyloid‐positive participants and tau status from ADNI, TRIAD, PPMI databases. Commonly shared clinical features selected between datasets were age, total MOCA scores, clinical diagnosis, sex, education, BMI, heart disease, stroke, hyperlipidemia and diabetes. Amyloid positivity was defined by amyloid‐PET (PIB‐PET, FBB‐PET or AZD4694‐PET) or CSF AB42 and Tau positivity defined by Tau‐PET (MK6240‐PET or AV1451‐PET) or CSF p‐tau181. The dataset was split into training (49%), validation (21%), and testing datasets (30%). A XGBoost model was tuned, and then used to predict the tau status outcome in the testing dataset. Result A total of 647 men and 544 women were included with mean age 66.1 ± 10.4 (mean ± SD) years, MOCA 25.1 ± 4.1 scores and education 16.1 ± 3.2 years (Table). The population consisted of 794 controls, 271 MCI and 126 dementia individuals. Tau status was negative for 854 individuals and positive for 337. The receiver‐operator characteristic (ROC) analysis showed that the area under the curve (AUC) was 0.81 for discriminating tau‐negative vs. tau‐positive, with 0.76 as sensitivity, specificity as 0.86, and accuracy as 0.83. The top 3 most impactful features were found to be age, diagnosis‐CN and MOCA score through a SHAP value analysis (Figure). Conclusion Predicting tau positivity with clinical and cognitive variables may improve the selection of individuals for AD trials. A two‐step workflow using this approach may significantly reduce the need for tau‐PET exams in trials by screening individuals using clinical variables. The following steps should include adding more individuals and other clinical variables through different cohorts to optimize the model applicability and test their performance in outcomes of clinical trials.
BibTeX
@inproceedings{arnold2024machine,
  author = {Daniel Arnold and Wyllians Vendramini Borelli and Luiza Santos Machado and Nesrine Rahmouni and Joseph Therriault and Stijn Servaes and Jenna Stevenson and Arthur C. Macedo and Artur Francisco Schumacher Schuh and Christian Mattjie and Rodrigo C. Barros and Marco Antônio De Bastiani and Firoza Z Lussier and Mira Chamoun and Gleb Bezgin and Andréa Lessa Benedet and Tharick A. Pascoal and Pedro Rosa‐Neto and Eduardo R. Zimmer and Alzheimer's Disease Neuroimaging Initiative (ADNI)},
  title = {{A machine learning approach to predict tau positivity using clinical features in amyloid‐positive individuals}},
  booktitle = {Alzheimer},
  year = {2024},
  doi = {10.1002/alz.088325},
}
Figure