Learning Differences Between Visual Scanning Patterns Can Disambiguate Bipolar and Unipolar Patients

Jonathan Chung, Moshe Eizenman, Uros Rakita, Roger S. McIntyre, Peter GiacobbeAAAI 2018 · DOI

Introduction

Distinguishing between Bipolar Disorder (BD) and Major Depressive Disorder (MDD) represents a significant clinical hurdle in modern psychiatry. During depressive episodes, the symptomatic presentation of both disorders is often indistinguishable. However, the therapeutic implications are starkly different: administering standard antidepressants to a patient with undiagnosed bipolar disorder can exacerbate their condition, potentially inducing manic episodes or rapid cycling.

Currently, misdiagnosis rates exceed 25%, largely because clinicians lack objective biological markers and must rely on subjective patient histories. This research explores the potential of eye-tracking technology and deep learning to provide a non-invasive, physiological biomarker for disambiguating these conditions.

Methodology: Encoding Visual Attention

The core hypothesis of this study is that visual scanning patterns—the specific sequences of fixations used to process emotional stimuli—reflect underlying neural differences between BD and MDD. To test this, researchers recorded the eye movements of 73 depressed participants (47 MDD, 26 BD) as they viewed happy and sad faces from the Karolinska Directed Emotional Faces (KDEF) database.

The study compared three distinct methods for encoding these fixation sequences into a Long Short-Term Memory (LSTM) Recurrent Neural Network (RNN):

  1. Semantic Regions of Interest (RoIs): Experts manually defined key facial features such as the eyes, nose, and mouth.
  2. Grid-based RoIs: A semi-automated approach where the image is divided into a 3x3 or 4x4 grid.
  3. Fully Automated (LRCN): A novel data-driven approach using a Long-term Recurrent Convolutional Network. This method generates saliency maps for each fixation and uses a Convolutional Neural Network (CNN) to extract features automatically, requiring no manual labeling.
Figure 1: Comparison of manual semantic RoIs and semi-automated grid-based RoIs used to encode fixation sequences.

The automated LRCN approach is particularly promising for clinical scalability, as it bypasses the need for expert annotation by learning directly from the visual data.

Figure 6: Saliency maps generated for the fully automated LRCN model, highlighting the features extracted by the CNN.

Results: The Power of Temporal Sequences

The findings underscore that the temporal sequence of fixations—the "how" and "when" of looking—contains significantly more diagnostic information than simple spatial statistics (the "where").

Traditional logistic regression models, which merely count fixations within regions, performed poorly (AUC ~0.45–0.60). In contrast, the RNN-based models, which capture the order and timing of gaze, achieved high accuracy. The semantic RoI model reached an AUC of 0.878, while the fully automated LRCN model achieved a nearly identical AUC of 0.879.

Notably, these eye-tracking classifiers outperformed several existing models based on neuroimaging data (fMRI or structural MRI), which typically report AUC values around 0.79. This suggests that behavioral scanning patterns may be a more sensitive indicator of the underlying pathology than expensive and invasive imaging techniques.

Discussion and Future Directions

While these results are promising, several limitations must be addressed before clinical implementation. The sample size, though substantial for a clinical eye-tracking study, is relatively small for deep learning. Future research should involve larger, multi-site cohorts to ensure the model's generalizability. Additionally, the potential confounding effects of medication and the use of static versus dynamic stimuli warrant further investigation.

By leveraging the interaction between spatial and temporal gaze data, this framework offers a robust, objective tool that could significantly reduce misdiagnosis rates and improve treatment outcomes for patients suffering from mood disorders.

Summary updated

BibTeX
@inproceedings{chung2018learning,
  author = {Jonathan Chung and Moshe Eizenman and Uros Rakita and Roger S. McIntyre and Peter Giacobbe},
  title = {{Learning Differences Between Visual Scanning Patterns Can Disambiguate Bipolar and Unipolar Patients}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2018},
  doi = {10.1609/aaai.v32i1.11289},
}
Figure