Control of Visual Selection during Visual Search in the Human Brain

Manuel C. Olma, Tobias H. Donner, Stephan A. BrandtJournal of Eye Movement Research 2007 · DOI

TL;DR

This paper investigates the neural mechanisms behind visual search using fMRI, revealing that the frontoparietal attention network, including the frontal eye fields (FEF) and specific parietal regions (AIPS, PIPS, IPTO), is crucial for selecting targets in cluttered scenes. The findings suggest these areas play distinct roles, with some regions being essential even without distractors, while others rely on their presence.

What Problem Does This Paper Address?

We constantly navigate complex visual environments, needing to efficiently locate specific objects amidst a sea of irrelevant information. This process, known as visual search, can be broadly categorized. When a target object has a unique, "salient" feature (like a distinct color), we can often find it quickly and in parallel, without consciously directing our attention. However, when the target is defined by a combination of features (e.g., a red, vertical bar among red horizontal and blue vertical bars) or lacks a unique salient feature, we must engage in a more deliberate, serial search process. The fundamental question this paper addresses is: what are the underlying neural mechanisms in the human brain that support these different modes of visual selection during search? Specifically, it aims to identify the brain regions involved and understand their functional roles, particularly in "covert" visual search (where attention is directed without eye movements).

Methods

The researchers employed functional Magnetic Resonance Imaging (fMRI) to study brain activity during visual search tasks. The core experimental design involved comparing brain activity between difficult and easy visual search conditions. To isolate the neural activity related to the search process itself, they ensured that participants performed the tasks without making eye movements (covert attention). The difficult search conditions included "conjunction search" (target defined by a combination of features) and "hard feature search" (target defined by a feature, but with reduced salience relative to distractors). These were contrasted with an "easy feature search" condition, which served as a baseline and was matched for visual stimulation and motor requirements. By analyzing the differences in fMRI signals between these conditions, the researchers could pinpoint brain regions differentially activated by the more demanding search tasks. They also conducted further experiments to investigate the role of distractors and feature conjunctions in activating these brain areas.

Datasets

Not discussed in the paper. The study relies on experimental data collected from human participants performing visual search tasks.

Key Insights and Ideas

  • A Unified Frontoparietal Network for Visual Search: The study strongly implicates a network of brain regions, including the frontal eye fields (FEF) and specific areas within the intraparietal sulcus (AIPS, PIPS, IPTO), as being generally engaged in covert visual selection during search. This supports the idea of a coordinated "frontoparietal attention network."
  • Differential Roles Within the Network: While all four key nodes are involved, they don't act identically. The findings suggest a functional specialization, with different sub-processes of visual search potentially being handled by distinct regions.
  • Distractors Matter for Some Regions: A crucial finding is that the posterior part of the intraparietal sulcus (PIPS) appears to require the presence of distractors to be activated during visual search. This suggests PIPS might be involved in suppressing irrelevant information or in competition-based selection.
  • Feature Conjunctions Are Not Always Necessary: The study demonstrates that the frontoparietal network's engagement in visual search is not solely dependent on the need to "bind" features together. A difficult feature search (without conjunction requirements) also activates these regions, indicating that task difficulty and salience play significant roles.
  • AIPS and IPTO are More General: In contrast to PIPS, the anterior intraparietal sulcus (AIPS) and the junction of the intraparietal with the transverse occipital sulcus (IPTO) are involved in visual search even when distractors are absent. This suggests these areas might be more broadly involved in directing attention or maintaining focus on a target.

Key Results

  • Differential Activation: Conjunction search and hard feature search consistently led to differential fMRI signal activations in the FEF and three parietal regions (AIPS, PIPS, IPTO) compared to easy feature search.
  • PIPS Specificity: Only in PIPS was the modulation strength of activation found to be indistinguishable between conjunction search and hard feature search, suggesting it is strongly tied to search difficulty.
  • Distractor Dependence: AIPS and IPTO were involved in visual conjunction search even in the absence of distractors, whereas PIPS's involvement appeared to depend on their presence.
  • Hemispheric Asymmetry: While the frontoparietal network is generally bilateral, there was a tendency for greater activation in the right hemisphere, particularly in the posterior parietal cortex, which aligns with previous findings on the right hemisphere's role in spatial attention.

Limitations and Future Work

  • Spatial Resolution: The authors acknowledge that standardizing brains for group analysis can reduce spatial discriminatory power, leading to fused activations. They addressed this with multi-regression analysis on individual data for finer-grained mapping.
  • Functional Dissociation Complexity: The co-activation of multiple sub-regions within the parietal lobe complicates attempts to fully understand its functional organization. The authors suggest that subtle task variations might be needed to reveal these differential functional repertoires.
  • Future Directions: The paper concludes by emphasizing that further research using subtle task variations can help reveal the differential functional roles of these cortical association areas within the frontoparietal attention network. This could lead to a more nuanced understanding of sub-processes like spatial attention direction, feature binding, and distractor suppression.

Summary updated

Abstract

How do we find a target object in a cluttered visual scene? Targets carrying unique salient features can be found in parallel without directing attention, whereas targets defined by feature conjunctions or non-salient features need to be scrutinized in a serial attentional process in order to be identified. In this article, we review a series of experiments in which we used fMRI to probe the neural basis of this active search process in the human brain. In all experiments, we compared the fMRI signal between a difficult and an easy visual search (each performed without eye movements) in order to isolate neural activity reflecting the search process from other components such as stimulus responses and movement-related activity. The difficult search was either a conjunction search or a hard feature search and compared with an easy feature search, matched in visual stimulation and motor requirements. During both, the conjunction search and the hard feature search the frontal eye fields (FEF) and three parietal regions located in the intraparietal sulcus (IPS) were differentially activated: the anterior and posterior part of the intraparietal sulcus (AIPS, PIPS) as well as the junction of the intraparietal with the transverse occipital sulcus (IPTO). Only in PIPS, the modulation strength was most indistinguishable between conjunction and hard feature search. In a further experiment we showed that AIPS and IPTO are involved in visual conjunction search even in the absence of distractors; by contrast, the involvement of PIPS seems to depend on the presence of distractors. Taken together, these findings from these experiments demonstrate that all four key nodes of the human ’frontoparietal attention network’ are generally engaged in the covert selection process of visual search. But they also suggest that these areas play differential roles, perhaps reflecting different sub-processes in active search. We conclude by discussing a number of such sub-processes, such as the direction of spatial attention, visual feature binding, and the active suppression of distractors.
BibTeX
@article{olma2007control,
  author = {Manuel C. Olma and Tobias H. Donner and Stephan A. Brandt},
  title = {{Control of Visual Selection during Visual Search in the Human Brain}},
  journal = {Journal of Eye Movement Research},
  year = {2007},
  doi = {10.16910/jemr.1.1.4},
}
Figure