Perception and Memory Retrieval States are Reflected in Distributed Patterns of Background Functional Connectivity

Y. Peeta Li, Yida Wang, Nicholas B. Turk‐Browne, Brice A. Kuhl, Ben HutchinsonbioRxiv 2022 · DOI

TL;DR

This study reveals that distinct patterns of "background" brain connectivity, independent of immediate sensory input, reliably differentiate between perception and memory retrieval states. This suggests that these cognitive states are maintained by sustained network configurations, offering a new way to understand how the brain switches between processing the external world and internal thought.

What Problem Does This Paper Address?

The same visual stimulus can be perceived or used to retrieve a memory, depending on whether our attention is directed outward or inward. While neuroimaging studies have identified brain regions involved in each process, it's less clear if distinct neural states, independent of the stimulus itself, underpin perception versus memory retrieval. Traditional fMRI analysis often focuses on stimulus-evoked activity, which can obscure these sustained states. This paper aims to uncover these distinct neural states by analyzing "background" functional connectivity – the ongoing, low-level communication between brain regions even in the absence of direct stimulus response.

Methods

The researchers employed Full Correlation Matrix Analysis (FCMA), a sophisticated whole-brain technique that analyzes connectivity between all possible pairs of voxels. To isolate "background" connectivity, they first modeled and regressed out stimulus-evoked activity from the fMRI data, leaving the residual, ongoing activity. FCMA was then applied to this residual data to build connectivity matrices for each task epoch. To make these complex matrices interpretable and identify key brain regions, they combined FCMA with a clustering approach. This involved selecting the most informative voxels based on their connectivity patterns and then grouping them into clusters. Finally, they used machine learning classifiers (Support Vector Machines - SVMs) to test how accurately these background connectivity patterns could distinguish between perception and retrieval states. They also performed generalization tests to see if the learned patterns were specific to cognitive state differences versus other confounds like task difficulty or visual content.

Datasets

The study used fMRI data collected from 24 healthy adult participants. The stimuli consisted of 64 scene images and 64 face images.

Key Insights and Ideas

  • Cognitive states have distinct "background" neural signatures: Perception and memory retrieval aren't just about processing a stimulus differently; they involve sustained, distinct patterns of brain-wide communication.
  • Background connectivity is "state-related," not "stimulus-related": Unlike activity directly triggered by a stimulus, background connectivity seems to reflect the ongoing cognitive mode the brain is in. This is a crucial distinction for understanding sustained mental states.
  • FCMA + Clustering is a powerful tool for brain network analysis: This combination allowed the researchers to move beyond simple seed-based analyses and explore whole-brain connectivity in a way that is both comprehensive and interpretable, identifying key brain regions and their interactions.
  • The brain has distinct "external" and "internal" processing networks: The findings align with models suggesting separate networks for processing external sensory information (Control Network) and internal thought (Default Mode Network - DMN), with the Retrosplenial Cortex (RSC) acting as a bridge.

Key Results

  • High accuracy in distinguishing perception from retrieval: SVM classifiers trained on background FC patterns could differentiate perception (Perceive and Scramble conditions) from retrieval epochs with high accuracy (e.g., AUC of 0.87 for Perceive vs. Retrieve).
  • Key brain networks involved: The Control Network showed stronger internal connectivity during perception, while the Default Mode Network (DMN) showed stronger internal connectivity during retrieval.
  • RSC's dynamic role: The Retrosplenial Cortex (RSC) acted as a flexible hub, shifting its connectivity from the Control Network during retrieval to the DMN during perception.
  • Background FC is independent of stimulus-evoked activity: Pattern analysis on residual activity (background FC) was successful in discriminating states, while analysis on stimulus-evoked activity alone did not show this state-specific differentiation.
  • Hybrid classifiers outperform individual measures: Combining background FC and evoked activity in hybrid classifiers yielded better performance than either measure alone, suggesting they capture complementary information.

Limitations and Future Work

  • Hippocampal subfield limitations: The study's whole-brain, group-level voxel mask approach may have missed subtle but important interactions within hippocampal subfields, which are known to be involved in memory. Future work could involve subject-specific hippocampal segmentation.
  • Interpretability of FCMA: While the FCMA-then-clustering approach improved interpretability, the sheer complexity of whole-brain connectivity remains a challenge.
  • RSC's role is speculative: The precise function of RSC in bridging external and internal states is still not fully understood, and further research is needed to characterize its role in establishing perception and retrieval states.
  • Exploring other FC measures: The study focused on background FC derived by regressing out stimulus-evoked activity. Future work could investigate other FC measures (e.g., those not regressing out evoked activity, or stimulus-evoked parametric measures) to see if they capture different aspects of cognitive processes.

Summary updated

Abstract

ABSTRACT The same visual input can serve as the target of perception or as a trigger for memory retrieval depending on whether cognitive processing is externally oriented (perception) or internally oriented (memory retrieval). While numerous human neuroimaging studies have characterized how visual stimuli are differentially processed during perception versus memory retrieval, perception and memory retrieval may also be associated with distinct neural states that are independent of stimulus-evoked neural activity. Here, we combined human fMRI with full correlation matrix analysis (FCMA) to reveal potential differences in “background” functional connectivity across perception and memory retrieval states. We found that perception and retrieval states could be discriminated with high accuracy based on patterns of connectivity across (1) the control network, (2) the default mode network (DMN), and (3) retrosplenial cortex (RSC). In particular, clusters in the control network increased connectivity with each other during the perception state, whereas clusters in the DMN were more strongly coupled during the retrieval state. Interestingly, RSC switched its coupling between networks as the cognitive state shifted from retrieval to perception. Finally, we show that background connectivity 1) was fully independent from stimulus-related variance in the signal and, further, 2) captured distinct aspects of cognitive states compared to traditional classification of stimulus-evoked responses. Together, our results reveal that perception and memory retrieval are associated with sustained cognitive states that manifest as distinct patterns of connectivity among large-scale brain networks.
BibTeX
@misc{li2022perception,
  author = {Y. Peeta Li and Yida Wang and Nicholas B. Turk‐Browne and Brice A. Kuhl and Ben Hutchinson},
  title = {{Perception and Memory Retrieval States are Reflected in Distributed Patterns of Background Functional Connectivity}},
  year = {2022},
  doi = {10.1101/2022.09.14.507854},
  howpublished = {bioRxiv},
}
Figure