Introduction
Early detection of Alzheimer’s Disease (AD) is a critical clinical goal, yet traditional diagnostic methods remain resource-intensive and expensive. While deep learning models utilizing spontaneous speech transcripts offer a non-invasive alternative, they are severely hampered by the scarcity of medical data. Standard datasets often contain fewer than 200 samples, leading to overfitting in complex architectures like BERT. To address this, researchers have proposed Contrastive Data Augmentation (CDA), a novel framework that simulates cognitive decline to improve model generalization.
Methodology
The CDA framework enhances the training process by teaching the model to recognize the specific linguistic markers of cognitive degradation. The architecture consists of three primary components: text encoding, sample generation, and a specialized loss function.
1. Negative Sample Generation (Random Deletion)
To mimic the word-finding difficulties and loss of semantic coherence typical in AD patients, the method employs Random Deletion (RD). By removing a proportion of words (e.g., 30%) from original transcripts, the system creates "corrupted" negative samples. These are logically expected to appear "more like AD" than the original text.
2. Positive Sample Generation (R-Drop)
To ensure feature stability, the model uses R-Drop. The same input is passed through the network twice with different dropout masks. A Kullback-Leibler (KL) divergence loss penalizes inconsistencies between these two outputs, forcing the model to learn more robust representations.
3. Contrastive Margin Loss
The core innovation is the Contrastive Margin Loss. The model is trained to ensure that the prediction for an original transcript is "healthier" than its corrupted counterpart by at least a predefined margin ($m$). This directional constraint forces the model to learn the process of decline rather than just static patterns.
Dataset
The study was evaluated using the ADReSS Challenge dataset, derived from the DementiaBank’s English Pitt Corpus. It consists of transcripts from 156 participants (78 AD, 78 non-AD) describing the "Cookie Theft" picture. The dataset is balanced for age and gender to minimize demographic bias.
Results and Discussion
The CDA method achieved state-of-the-art performance on the ADReSS benchmark. A single CDA-enhanced model reached 87.5% accuracy, while an ensemble of five models achieved 91.7% accuracy with 100% precision for the AD class. This outperforms larger models like ERNIE 3.0 and multimodal approaches that utilize raw audio features.
An ablation study highlights the critical role of the Random Deletion module. As shown in the table below, removing RD leads to a significant drop in accuracy from 77.5% to 72.3%, confirming that simulating cognitive impairment is the primary driver of the model's success.
Conclusion
CDA demonstrates that domain-specific data augmentation—specifically simulating the symptoms of the target disease—is more effective than generic NLP techniques for small-scale medical datasets. While currently focused on text transcripts, future work could integrate acoustic features to further capture the nuances of AD speech patterns. Although not yet a clinical diagnostic tool, CDA provides a powerful foundation for non-invasive AD screening research.
Summary updated