Structure–function coupling and decoupling during movie watching and resting state: Novel insights bridging EEG and structural imaging

Venkatesh Subramani, Giulia Lioi, Karim Jerbi, Nicolas Farrugia

TL;DR

This study uses a novel Graph Signal Processing (GSP) framework to quantify how the brain's physical structure (connectome) influences its electrical activity (EEG) during naturalistic tasks like watching movies and resting. They found that sensory areas are tightly "coupled" to structure, while higher-order areas are more flexible, and this coupling is generally stronger during movie watching than during rest.

What Problem Does This Paper Address?

The brain's structure is known to constrain its function, but the precise relationship between an individual's unique brain anatomy and their real-time electrical activity (EEG) is not fully understood. While previous studies have looked at this link using fMRI or during specific, brief events, this paper aims to bridge this gap by examining continuous EEG data alongside individual structural imaging. They want to understand how the brain's "wiring diagram" shapes its electrical signals during more naturalistic states, like watching a movie, and how this relationship changes with behavior.

Methods

The core of this research lies in the application of Graph Signal Processing (GSP). Here's a breakdown:

  • Structural Connectome: Individual Diffusion-Weighted Imaging (DWI) data was used to reconstruct each participant's unique brain "wiring diagram" – the structural connectome. This represents connections between different brain regions.
  • Graph Laplacian Eigenmodes: The structural connectome was modeled as a graph, and its Laplacian matrix was decomposed into eigenvectors (eigenmodes). These eigenmodes act like "harmonics" or "frequencies" of the brain's structure, capturing different spatial patterns of connectivity.
  • Graph Fourier Transform (GFT): The GFT was used to express the EEG activity (source-localized cortical signals) in terms of these structural eigenmodes. This allows researchers to see how much of the EEG signal aligns with different structural patterns.
  • Structure-Function Coupling Metric (SDI): A key metric called the Structure-Decoupling Index (SDI) was developed. It quantifies how "coupled" (aligned) or "decoupled" (flexible) the EEG activity is with the underlying structural graph. Essentially, it's a ratio of "decoupled" to "coupled" activity.
  • Time-Resolved and Frequency-Resolved Analysis: The SDI was analyzed not just globally, but also over time and across different EEG frequency bands (theta, alpha, beta, gamma) to understand the dynamic and spectral nature of structure-function coupling.
  • Neurosynth Meta-Analysis: To interpret the functional meaning of the SDI maps, a meta-analysis was performed using Neurosynth, linking brain regions with specific cognitive functions.

Datasets

The study utilized data from the Healthy Brain Network (HBN). This dataset includes:

  • High-density EEG: Recorded from 128 channels at 500 Hz.
  • Diffusion-Weighted Imaging (DWI): Used for structural connectome reconstruction.

Participants were aged 14-21.8 years, and data was collected during three conditions: resting with eyes open, watching a clip from "Despicable Me 2" (Video 1), and watching a clip from "Fun with Fractals" (Video 2).

Key Insights and Ideas

  • Anatomy is a Blueprint, but Not a Straitjacket: The brain's structure strongly influences its electrical activity, especially in sensory areas. However, higher-order cognitive areas show more flexibility, meaning their activity isn't as rigidly dictated by their physical connections.
  • Movies Engage the Brain More Deeply: Watching videos leads to stronger structure-function coupling, particularly in sensory regions, compared to resting. This suggests that engaging with dynamic visual content actively recruits and aligns brain activity with its underlying architecture.
  • Sensory Systems are Stable, Higher-Order Systems are Dynamic: Sensory regions exhibit consistent structure-function coupling over time, indicating a stable reliance on their anatomical wiring. In contrast, transmodal (higher-order) systems show more temporal fluctuations, reflecting their adaptability to different cognitive demands.
  • Frequency Bands Speak a Similar Language: The relationship between structure and function appears remarkably consistent across different EEG frequency bands. This suggests that the underlying anatomical constraints influence brain activity similarly, regardless of whether it's fast or slow oscillations.

Key Results

  • Sensorimotor Cortex is Highly Coupled: EEG activity in the sensorimotor cortex showed strong coupling with brain structure in both resting and movie-watching states.
  • Higher-Order Systems are More Flexible: Regions like the Parahippocampal Area and inferior frontal sulcal area showed more decoupling, indicating greater flexibility.
  • Movie Watching Enhances Coupling: Regions like the visual area 7 (V7) and inferior parietal cortex exhibited stronger coupling during movie watching compared to resting state.
  • Temporal Stability in Sensory Areas: Regions like the sensorimotor cortex showed minimal temporal fluctuation in their structure-function association.
  • Transmodal Systems Show Temporal Fluctuations: Regions associated with higher-order processing generally displayed more temporal fluctuations in their coupling, with the exception of the Posterior Cingulate Cortex (PCC).
  • Consistent Topography Across Frequencies: The spatial patterns of structure-function coupling were similar across theta, alpha, beta, and gamma EEG rhythms.
  • Functional Decoding: Meta-analysis revealed that unimodal systems (visual, motor) were strongly coupled, while higher-order systems (memory, emotion) showed a broader range of coupling and decoupling patterns.

Limitations and Future Work

  • Source Estimation Limitations: The authors acknowledge that EEG source localization methods can introduce spatial smoothing, potentially concentrating power in lower eigenmodes and influencing the interpretation of coupling. Future work could explore different source reconstruction techniques.
  • Template vs. Individual Parcellation: The study used a standard atlas (HCP-MMP) for defining brain regions. Future research could investigate how using individually defined parcels or hyper-alignment methods might alter the results.
  • Frequency Band Analysis Nuances: While consistent topography was found across frequency bands, the authors note that previous studies suggested differences. They suggest that future work could explore re-parameterizing the EEG power spectrum using aperiodic and periodic components, or investigate shorter time windows, to potentially reveal more subtle differences.
  • Hemispheric Asymmetries: The study noted some hemispheric asymmetries in the contrast between video and rest, suggesting further investigation into these differences.
  • Broader Cognitive States: The authors suggest extending this framework to study structure-function coupling across a wider range of cognitive and conscious states, including altered states of consciousness.

Summary updated

Abstract

The intricate structural and functional architecture of the brain enables a wide range of cognitive processes ranging from perception and action to higher order abstract thinking. Despite important progress, the relationship between the brain's structural and functional properties is not yet fully established. In particular, the way the brain's anatomy shapes its electrophysiological dynamics remains elusive. The electroencephalography (EEG) activity recorded during naturalistic tasks is thought to exhibit patterns of coupling with the underlying brain structure that vary as a function of behavior. Yet these patterns have not yet been sufficiently quantified. We address this gap by jointly examining individual Diffusion-Weighted Imaging (DWI) scans and continuous EEG recorded during video watching and resting state, using a Graph Signal Processing (GSP) framework. By decomposing the structural graph into eigenmodes and expressing the EEG activity as an extension of anatomy, GSP provides a way to quantify the structure-function coupling. We elucidate how the structure shapes function during naturalistic tasks such as movie watching and how this association is modulated by tasks. We quantify the coupling relationship in a region-, time-, and frequency-resolved manner. First of all, our findings indicate that the EEG activity in the sensorimotor cortex is strongly coupled with brain structure, while the activity in higher order systems is less constrained by anatomy, that is, shows more flexibility. In addition, we found that watching videos was associated with stronger structure-function coupling in the sensorimotor cortex, as compared with resting-state data. Second, time-resolved analysis revealed that the unimodal systems undergo minimal temporal fluctuation in structure-function association, and the transmodal system displays the highest temporal fluctuations, with the exception of PCC seeing low fluctuations. Lastly, our frequency-resolved analysis revealed a consistent topography across different EEG rhythms, suggesting a similar relationship with the anatomical structure across frequency bands. Together, this unprecedented characterization of the link between structure and function using continuous EEG during naturalistic behavior underscores the role of anatomy in shaping ongoing cognitive processes. Taken together, by combining the temporal and spectral resolution of EEG and the methodological advantages of GSP, our work sheds new light on the anatomo-functional organization of the brain.
BibTeX
@inproceedings{subramani2025structurefunction,
  author = {Venkatesh Subramani and Giulia Lioi and Karim Jerbi and Nicolas Farrugia},
  title = {{Structure–function coupling and decoupling during movie watching and resting state: Novel insights bridging EEG and structural imaging}},
  booktitle = {Imaging},
  year = {2025},
  doi = {10.1162/imag\_a\_00448},
}
Figure