Identification of Temporal Transition of Functional States Using Recurrent Neural Networks from Functional MRI

Hongming Li, Yong Fan

TL;DR

This paper introduces a data-driven framework using Long Short-Term Memory (LSTM) recurrent neural networks to detect transitions between brain functional states in fMRI data. By framing change-point detection as an anomaly detection task—where high prediction error signals a state shift—the authors successfully identify temporal boundaries in both task-based and resting-state brain activity with higher accuracy than traditional statistical models.

What Problem Does This Paper Address?

The human brain is not static; its functional connectivity (FC)—how different regions talk to one another—shifts dynamically over time. Understanding these transitions is crucial for mapping cognitive processes.

Traditionally, researchers use "sliding-window" methods to look at these changes, but these are limited by fixed window sizes that may not match the brain's actual timing. More advanced "change-point" detection methods exist, but they often rely on rigid mathematical assumptions (like the data following a Gaussian distribution) that don't always hold true for complex, noisy fMRI signals. The authors sought a flexible, data-driven way to find these "boundaries" without pre-defining what the brain's signals should look like.

Methods

The authors proposed a deep learning framework based on LSTM-RNNs, which are specifically designed to model sequences and time-series data.

  1. Feature Extraction: They used a technique called "collaborative sparse brain decomposition" to condense raw fMRI data into time courses for 90 distinct functional networks.
  2. The Prediction Task: They trained an LSTM (2 hidden layers, 256 nodes each) to predict the functional profile of the next time point based on all preceding time points.
  3. Anomaly Detection: The core logic is simple: if the brain is in a stable functional state, the next moment should be predictable. If the brain suddenly switches states (e.g., from resting to performing a task), the LSTM’s prediction error will spike.
  4. Refinement: To handle the high noise (low SNR) of fMRI data, they applied a 1D Gaussian convolutional filter to smooth the prediction errors. Change points were then identified as local maxima in this error signal that exceeded a specific threshold.

Datasets

The study utilized high-quality data from the Human Connectome Project (HCP):

  • Subjects: 490 total (400 for training, 50 for validation/parameter tuning, 40 for testing).
  • Task fMRI: Motor tasks (moving hands, feet, tongue) and Working Memory tasks (0-back and 2-back tests). These provided a "ground truth" because the researchers knew exactly when the tasks changed.
  • Resting-state fMRI: Data where subjects simply lay in the scanner, used to see if the model could find spontaneous state transitions.

Key Insights and Ideas

  • Predictability as a Proxy for Stability: The most elegant "aha" moment here is treating a failure in temporal prediction as evidence of a state transition. It turns a complex clustering problem into a straightforward regression and anomaly detection problem.
  • Moving Beyond "Windows": Unlike sliding-window methods that are "blind" to what happens inside the window, the RNN considers the entire preceding history, allowing for more nuanced detection of transitions.
  • Robustness to Noise: By using 1D convolutions to smooth the error signal, the authors accounted for the inherent "jitter" in fMRI data, ensuring that a single noisy data point wouldn't be mistaken for a major functional shift.

Key Results

  • Higher Accuracy: On task fMRI data, the LSTM method outperformed state-of-the-art Bayesian inference methods. It showed significantly lower distance errors between predicted and actual change points (sensitivity) and fewer false positives (specificity).
  • Functional Relevance: In resting-state data, the segments identified by the model weren't just random; two-sample covariance matrix testing confirmed that the functional connectivity patterns in the segments before a change point were statistically different from those after ($p < 0.05$).
  • Temporal Precision: The model successfully matched the starting and ending points of various motor and memory task blocks, even when accounting for the "hemodynamic lag" (the delay between brain activity and blood flow changes).

Limitations and Future Work

While the model is data-driven, it still requires some manual tuning. Specifically, the parameters $\lambda$ (threshold) and $\sigma$ (smoothing kernel) must be optimized using a validation dataset.

Additionally, while the paper proves the model can find when a transition happens, it doesn't focus on what those resting-state segments represent biologically. Future work could involve clustering these identified segments across different subjects to see if there are "universal" resting-state transitions common to all humans. Finally, the authors suggest that exploring different neural network architectures might further improve detection in even noisier environments.

Summary updated

Abstract

Dynamic functional connectivity analysis provides valuable information for understanding brain functional activity underlying different cognitive processes. Besides sliding window based approaches, a variety of methods have been developed to automatically split the entire functional MRI scan into segments by detecting change points of functional signals to facilitate better characterization of temporally dynamic functional connectivity patterns. However, these methods are based on certain assumptions for the functional signals, such as Gaussian distribution, which are not necessarily suitable for the fMRI data. In this study, we develop a deep learning based framework for adaptively detecting temporally dynamic functional state transitions in a data-driven way without any explicit modeling assumptions, by leveraging recent advances in recurrent neural networks (RNNs) for sequence modeling. Particularly, we solve this problem in an anomaly detection framework with an assumption that the functional profile of one single time point could be reliably predicted based on its preceding profiles within a stable functional state, while large prediction errors would occur around change points of functional states. We evaluate the proposed method using both task and resting-state fMRI data obtained from the human connectome project and experimental results have demonstrated that the proposed change point detection method could effectively identify change points between different task events and split the resting-state fMRI into segments with distinct functional connectivity patterns.
BibTeX
@inproceedings{li2018identification,
  author = {Hongming Li and Yong Fan},
  title = {{Identification of Temporal Transition of Functional States Using Recurrent Neural Networks from Functional MRI}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2018},
  url = {https://openreview.net/forum?id=CxH2X0E3BbFc},
}

Loading related content...

Figure