Revealing Whole-Brain Causality Networks During Guided Visual Searching

Christian M. Kiefer, Junji Ito, Ralph Weidner, Frank Boers, N. Jon Shah, Sonja Grün, Jürgen DammersFrontiers in Neuroscience 2022 · DOI

Abstract

Active vision involves the continuous sampling of visual information through eye movements. While fundamental to human behavior, the neural mechanisms coordinating this process under different goal-directed conditions remain poorly understood. This study utilized magnetoencephalography (MEG) combined with eye-tracking in 31 participants to investigate interregional brain interactions during free viewing and guided visual search. We identified a core bilateral network in the temporoparietal region. During visual search, the right supramarginal gyrus (SMG) transformed into a central information hub, with its activity directly correlating with search efficiency. Our findings suggest the right SMG plays a critical role in updating the brain's internal priority maps to guide attention.

Introduction

Most neuroscientific models of visual processing are derived from passive experiments where subjects maintain fixation on a static point. However, natural vision is "active," characterized by rapid eye movements (saccades) and fixations occurring approximately four times per second. Tracking the rapid information flow between brain regions during these movements requires both high temporal and spatial resolution. This study addresses this challenge by combining MEG with eye-tracking to map the "causality networks"—the directed flow of neural information—that govern goal-directed visual behavior.

Methods and Materials

The study recruited 31 participants to view 90 natural scene images, such as gardens and rooms, each containing five naturally embedded "foreign" objects (e.g., tools or animals). Participants engaged in two primary tasks: Free Viewing (FV), involving aimless browsing, and Visual Search (VS), where they were tasked with locating a specific target object.

Figure 1: Experimental paradigms for the search, memory, and free viewing tasks. Each task involved presenting a natural scene for 6 seconds.

Data Acquisition and Analysis

Neural activity was recorded using MEG, while gaze was monitored via an EyeLink 1000 tracker. The analysis focused on Fixation-Related Evoked Activity (FRA), aligning brain signals to the onset of each fixation. Source localization was performed using dynamic statistical parametric mapping (dSPM) to identify Regions of Interest (ROIs). To determine the direction of information flow between these regions, the researchers employed Generalized Partial Directed Coherence (GPDC), a frequency-domain measure of causality.

Results

The Temporoparietal Network

The study identified a core bilateral cluster of four regions active during both tasks: the posterior insula, transverse temporal gyri, superior temporal gyrus, and supramarginal gyrus. This network appears to be the primary engine for processing visual information during active vision.

The Right SMG as a Central Hub

While the network was relatively symmetric during free viewing, the visual search task induced a significant shift toward right-hemisphere dominance. Specifically, the right supramarginal gyrus (SMG) emerged as a central node with the highest degree of connectivity (both incoming and outgoing) across multiple frequency bands, particularly in the gamma range (30–40 Hz).

Behavioral Correlation

The functional importance of the right SMG was confirmed by behavioral data. It was the only region where neural activity during the first fixation on a search target significantly correlated with faster response times ($r = -0.141, p < 0.05$). This suggests that the efficiency of the right SMG directly impacts how quickly a target is identified.

Discussion

The researchers hypothesize that the right SMG acts as a bridge between sensory processing and attentional control. Specifically, they observed a directed connection from the right SMG to the right Supplementary Eye Field (SEF). This connection likely serves to update the brain's "priority map"—the internal representation used to determine the next location for eye movements—based on the visual information gathered during the current fixation.

Interestingly, the communication between the SMG and eye-movement controllers occurred in lower frequency bands (delta, theta, alpha), which align with the physical rhythm of saccades. This suggests that the brain's internal communication is temporally tuned to the mechanical speed of the eyes.

Conclusion and Limitations

This study provides a high-resolution map of the causality networks underlying active vision, highlighting the right SMG as a critical command center for goal-directed searching. While MEG offers excellent temporal resolution, its spatial precision for deep brain structures remains a limitation. Future research should explore how the brain suppresses "distractor" information during search tasks and further investigate the lateralization of the temporoparietal junction.

Summary updated

Abstract

In our daily lives, we use eye movements to actively sample visual information from our environment ("active vision"). However, little is known about how the underlying mechanisms are affected by goal-directed behavior. In a study of 31 participants, magnetoencephalography was combined with eye-tracking technology to investigate how interregional interactions in the brain change when engaged in two distinct forms of active vision: freely viewing natural images or performing a guided visual search. Regions of interest with significant fixation-related evoked activity (FRA) were identified with spatiotemporal cluster permutation testing. Using generalized partial directed coherence, we show that, in response to fixation onset, a bilateral cluster consisting of four regions (posterior insula, transverse temporal gyri, superior temporal gyrus, and supramarginal gyrus) formed a highly connected network during free viewing. A comparable network also emerged in the right hemisphere during the search task, with the right supramarginal gyrus acting as a central node for information exchange. The results suggest that all four regions are vital to visual processing and guiding attention. Furthermore, the right supramarginal gyrus was the only region where activity during fixations on the search target was significantly negatively correlated with search response times. Based on our findings, we hypothesize that, following a fixation, the right supramarginal gyrus supplies the right supplementary eye field (SEF) with new information to update the priority map guiding the eye movements during the search task.
BibTeX
@inproceedings{kiefer2022revealing,
  author = {Christian M. Kiefer and Junji Ito and Ralph Weidner and Frank Boers and N. Jon Shah and Sonja Grün and Jürgen Dammers},
  title = {{Revealing Whole-Brain Causality Networks During Guided Visual Searching}},
  booktitle = {Frontiers in Neuroscience},
  year = {2022},
  doi = {10.3389/fnins.2022.826083},
}
Figure