Passive sensing data predicts stress in university students: a supervised machine learning method for digital phenotyping

Artur Shvetcov, Joost Funke Kupper, Wu-Yi Zheng, Aimy Slade, Jin Han, Alexis E. Whitton, Michael J. Spoelma, Leonard Hoon, Kon Mouzakis, Rajesh Vasa, Sunil Gupta, Svetha Venkatesh, Jill M. Newby, Helen ChristensenFrontiers in Psychiatry 2024 · DOI

Abstract: Australia New Zealand Clinical Trials Registry (ANZCTR), identifier ACTRN12621001223820.

Introduction

University students are a high-risk group for chronic stress, which often serves as a precursor to depression and burnout. While digital mental health tools are increasingly common, they typically rely on "active" data collection, such as manual surveys, which can be burdensome and prone to bias. The emerging field of digital phenotyping seeks to utilize "passive sensing"—leveraging the sensors already present in smartphones (e.g., GPS, accelerometers)—to detect mental health shifts without user intervention. However, transforming noisy, raw sensor data into meaningful psychological insights remains a significant challenge. This study proposes a robust methodological pipeline to bridge this gap.

Methodology

The researchers developed a two-stage feature extraction pipeline designed to handle GPS inaccuracies and data drift:

  1. Spatial Filtering: Coordinates were grouped into 5000m² "nodes." This reduces noise by treating movement within a small area (like an apartment or cafe) as a single location.
  2. Mobility Matrices: The pipeline constructed directed, edge-weighted multigraphs to represent user movement. This allowed for the extraction of complex features such as the number of unique places visited, visit frequency to specific hubs, and path weights (route frequency).
Figure 1: The two-stage feature extraction pipeline, transforming raw GPS data into mobility matrices and usable features.

These features were then tested against several supervised machine learning algorithms, including Random Forests, K-Nearest Neighbor (KNN), and Artificial Neural Networks (ANN).

Dataset and Ground Truth

The study utilized data from the Vibe Up study, involving 409 university students in Australia. Participants provided 30 days of continuous passive sensor data. Ground truth stress levels were established using the stress subscale of the Depression and Stress Scale (DASS), converted into standardized z-scores.

Key Results and Insights

Initial modeling struggled to distinguish between low and moderate stress levels, likely due to the heterogeneous nature of moderate stress (e.g., eustress vs. distress). However, predictive power increased significantly when comparing "No Stress" groups against "Severe Stress" groups (z-score > 2.2).

  • Model Performance: The Artificial Neural Network (ANN) was the top performer, achieving an AUC of 0.90, with a precision of 0.93 and recall of 0.87.
  • Mobility Signatures: Students experiencing high stress exhibited distinct mobility patterns. A higher number of unique locations visited and increased daily visit frequency were positively correlated with higher stress levels, suggesting that hectic physical movement may mirror hectic mental states.
Figure 2: Correlation between Stress Z-scores and mobility features, specifically the number of nodes and node visit frequency.

Interestingly, while mobility increased with stress, physical activity (step counts) showed a weak negative correlation, indicating that stressed movement is not necessarily synonymous with healthy exercise.

Discussion and Future Work

While promising, the study notes limitations including a gender imbalance (76% female) and reliance on self-reported ground truth rather than clinical diagnoses. Furthermore, the model currently lacks the sensitivity to detect the transition from healthy stress to moderate distress. Future research aims to refine this pipeline to power Just-In-Time Adaptive Interventions (JITAIs), which could automatically offer support or suggest breaks when a user's digital phenotype indicates an impending crisis.

Summary updated

Abstract

Australia New Zealand Clinical Trials Registry (ANZCTR), identifier ACTRN12621001223820.
BibTeX
@inproceedings{shvetcov2024passive,
  author = {Artur Shvetcov and Joost Funke Kupper and Wu-Yi Zheng and Aimy Slade and Jin Han and Alexis E. Whitton and Michael J. Spoelma and Leonard Hoon and Kon Mouzakis and Rajesh Vasa and Sunil Gupta and Svetha Venkatesh and Jill M. Newby and Helen Christensen},
  title = {{Passive sensing data predicts stress in university students: a supervised machine learning method for digital phenotyping}},
  booktitle = {Frontiers in Psychiatry},
  year = {2024},
  doi = {10.3389/fpsyt.2024.1422027},
}
Figure