Mixtures of large-scale dynamic functional brain network modes

Chetan Gohil, Evan Roberts, Ryan C. Timms, Alex Skates, Cameron Higgins, Andrew Quinn, Usama Pervaiz, Joost van Amersfoort, Pascal Notin, Yarin Gal, Stanislaw Adaszewski, Mark W. Woolrich

TL;DR

This paper introduces DyNeMo, a novel generative model for brain network dynamics that overcomes the limitations of traditional methods by allowing for overlapping, "mixed" brain states. This approach leads to more accurate modeling of functional connectivity, particularly for fast temporal dynamics and spectral properties, offering a more nuanced understanding of brain function.

What Problem Does This Paper Address?

Understanding how the brain's functional networks operate over time is crucial for deciphering cognition. Traditional methods for analyzing time-varying functional connectivity (FC), like Hidden Markov Models (HMMs) and clustering approaches, often assume that brain states are mutually exclusive. This assumption, while simplifying analysis, may hinder the accurate capture of complex, dynamic brain processes where multiple networks might be active simultaneously. The authors aim to develop a model that can represent brain activity as a flexible mixture of underlying "modes," allowing for a richer and more realistic temporal description.

Methods

The core of this paper is the introduction of DyNeMo (Dynamic Network Modes), a generative model that treats functional connectivity as a time-varying linear mixture of spatially distributed statistical "modes."

  • Generative Model: DyNeMo models the time-varying mean and covariance of neuroimaging data as a linear combination of static spatial "modes." These modes represent underlying brain network patterns.
  • Recurrent Neural Network (RNN): The temporal evolution of the mixing coefficients (how much each mode contributes at a given time) is governed by a unidirectional RNN. This allows DyNeMo to capture long-range temporal dependencies.
  • Bayesian Inference: The model is trained using a Bayesian framework, specifically employing amortized inference adapted from variational autoencoders. This involves an "inference network" (a bidirectional RNN) that learns to map observed data to the parameters of the variational posterior distribution of the model's latent variables (logits).
  • Reparameterization Trick: This technique is used to enable efficient sampling from the variational posterior distribution, allowing for stochastic gradient descent optimization.
  • Loss Function: The model is optimized by minimizing the variational free energy, which is decomposed into a log-likelihood term (ensuring the model fits the data) and a KL divergence term (acting as a regularizer).

Datasets

The authors used a combination of simulated and real neuroimaging data for training and evaluation:

  • Simulation 1: Long-range dependencies: Data generated using a Hidden Semi-Markov Model (HSMM) to specifically test DyNeMo's ability to learn long-range temporal dependencies.
  • Simulation 2: Linear mode mixing: Data generated to assess DyNeMo's capability in inferring a linear mixture of co-activating modes, contrasting with HMM's mutual exclusivity assumption.
  • Real MEG Data:
    • Resting-state dataset: MEG recordings from 55 healthy participants.
  • Task dataset: MEG recordings from 51 healthy participants performing a visuomotor task.

Key Insights and Ideas

  • Overlapping Brain States: The most significant insight is that brain activity can be more accurately modeled as a linear mixture of underlying modes rather than mutually exclusive states. This allows for a more nuanced representation of dynamic brain function.
  • Long-Range Temporal Dependencies: DyNeMo, through its RNN component, can capture temporal dependencies that extend over longer periods than traditional HMMs, which are primarily Markovian. This is crucial for understanding brain processes that unfold over time.
  • Spectral Properties: The model's ability to capture dynamic spectral properties (e.g., power at different frequencies) is improved compared to HMMs, suggesting a more accurate representation of the underlying neural dynamics.
  • Mode Interpretability: The inferred modes correspond to plausible functional networks (e.g., visual, sensorimotor, default mode network), providing interpretable components of brain activity.
  • Background Mode: The analysis revealed a "background mode" that is often anti-correlated with other active modes, suggesting a mechanism where specific network activations suppress a general baseline activity.

Key Results

  • Simulation 1: DyNeMo successfully inferred long-range temporal dependencies from simulated data, capturing non-exponential state lifetimes, which an HMM could not replicate from sampled data.
  • Simulation 2: DyNeMo accurately inferred linear mixtures of modes, outperforming an HMM in reconstructing time-varying covariance with a significantly smaller Riemannian distance.
  • Resting-State MEG Data: DyNeMo identified plausible resting-state networks with distinct spectral properties. Mode activations were found to be short-lived (100-150 ms), consistent with previous findings but not attributed to the mutual exclusivity assumption. The model also demonstrated learning of long-range temporal correlations.
  • Task MEG Data: DyNeMo inferred modes that showed task-dependent evoked responses without prior knowledge of task timing, demonstrating its ability to capture task-related neural activity.
  • Spectral Accuracy: DyNeMo showed a modest but significant improvement in modeling dynamic spectral properties compared to an HMM, with lower reconstruction error for spectrograms.

Limitations and Future Work

  • Hyperparameter Sensitivity: DyNeMo, like many deep learning models, has a large number of hyperparameters that need careful specification. The authors note that the number of modes is a critical hyperparameter affecting interpretability.
  • Initialisation Sensitivity: The model's performance was found to be sensitive to the initialisation of trainable parameters, particularly for mode covariances. The authors addressed this by training from scratch with multiple initialisations.
  • PCA Impact: The PCA step in data preprocessing might filter out high-frequency spectral content, leading to errors in modeling high-frequency spectral content in task MEG data. Future work could explore spectral pre-whitening techniques.
  • Future Applications: The authors suggest future work could involve:
  • Applying DyNeMo to other datasets and modalities (fMRI, EEG, ECOG).
  • Modifying the architecture for semi-supervised learning and decoding tasks.
  • Exploring transfer learning capabilities to leverage large datasets for smaller cohorts.
  • Using the model for dynamic sensor-level covariance estimation in source reconstruction.
  • Investigating autoregressive models for temporal correlations and hierarchical modeling of inter-subject variability.

Summary updated

Abstract

Abstract Accurate temporal modelling of functional brain networks is essential in the quest for understanding how such networks facilitate cognition. Researchers are beginning to adopt time-varying analyses for electrophysiological data that capture highly dynamic processes on the order of milliseconds. Typically, these approaches, such as clustering of functional connectivity profiles and Hidden Markov Modelling (HMM), assume mutual exclusivity of networks over time. Whilst a powerful constraint, this assumption may be compromising the ability of these approaches to describe the data effectively. Here, we propose a new generative model for functional connectivity as a time-varying linear mixture of spatially distributed statistical “modes”. The temporal evolution of this mixture is governed by a recurrent neural network, which enables the model to generate data with a rich temporal structure. We use a Bayesian framework known as amortised variational inference to learn model parameters from observed data. We call the approach DyNeMo (for Dynamic Network Modes), and show using simulations it outperforms the HMM when the assumption of mutual exclusivity is violated. In resting-state MEG, DyNeMo reveals a mixture of modes that activate on fast time scales of 100-150 ms, which is similar to state lifetimes found using an HMM. In task MEG data, DyNeMo finds modes with plausible, task-dependent evoked responses without any knowledge of the task timings. Overall, DyNeMo provides decompositions that are an approximate remapping of the HMM’s while showing improvements in overall explanatory power. However, the magnitude of the improvements suggests that the HMM’s assumption of mutual exclusivity can be reasonable in practice. Nonetheless, DyNeMo provides a flexible framework for implementing and assessing future modelling developments.
BibTeX
@article{gohil2022mixtures,
  author = {Chetan Gohil and Evan Roberts and Ryan C. Timms and Alex Skates and Cameron Higgins and Andrew Quinn and Usama Pervaiz and Joost van Amersfoort and Pascal Notin and Yarin Gal and Stanislaw Adaszewski and Mark W. Woolrich},
  title = {{Mixtures of large-scale dynamic functional brain network modes}},
  journal = {NeuroImage},
  year = {2022},
  doi = {10.1016/j.neuroimage.2022.119595},
}
Figure