Pop-in: the inversion of pop-out for a feature dimension during visual search in area V4 of the monkey cortex

P. Christiaan Klink, Rob R. M. Teeuwen, Jeannette A. M. Lorteije, Pieter R. RoelfsemabioRxiv 2022 · DOI

TL;DR

This paper reveals a neural mechanism called "pop-in" in monkey V4, where the brain actively suppresses salient, but irrelevant, visual distractors. This "pop-in" process, which follows an initial "pop-out" of the distractor, is crucial for efficient goal-directed visual search, especially when distractors are highly noticeable.

What Problem Does This Paper Address?

When we search for something, our brains need to do two things simultaneously: find the target and ignore everything else. This is especially tricky when some of the "everything else" are highly noticeable – they "pop out" and grab our attention. This phenomenon, known as attentional capture, can significantly hinder our ability to find what we're looking for. While we know that targets are often represented more strongly in the brain, the mechanisms by which the brain actively suppresses these attention-grabbing distractors, particularly when they are defined by a different feature than the target, are less understood. This paper investigates how the visual cortex (specifically area V4 in monkeys) handles a salient distractor that pops out due to its color, while the search target is defined by its shape.

Methods

The researchers trained two macaque monkeys to perform a visual search task. In this task, the monkeys had to find a target shape (e.g., a square among circles) and make an eye movement to it. The visual display included several non-salient distractors (same shape as the target, different from the target's shape) and one salient distractor that differed in color from all other items, causing it to "pop out."

Key techniques included:

  • Behavioral Training: Monkeys were extensively trained on the visual search task.
  • Electrophysiology: Multi-unit activity (MUA) was recorded from neurons in area V4 using implanted microelectrode arrays.
  • Stimulus Presentation: A controlled visual display with varying shapes and colors was presented.
  • Eye-Tracking: Monkey eye movements were precisely tracked to ensure they were performing the task correctly.
  • Data Analysis: Neuronal responses were analyzed to understand how V4 activity changed over time in relation to target enhancement and distractor suppression. This involved calculating response modulations and fitting functions to estimate latencies of these processes.

Datasets

The study did not introduce new benchmark datasets. Instead, it utilized data collected from the monkeys during the described visual search task. The raw data and analysis code are made available on GIN (https://gin.g-node.org/ChrisKlink/NHP VisualSearch Pop-in).

Key Insights and Ideas

  • "Pop-in" as a Counterpart to "Pop-out": The study demonstrates that the brain doesn't just ignore distractors; it actively suppresses them. This "pop-in" mechanism inverts the initial "pop-out" signal of a salient distractor.
  • Feature-Dimension Specificity: The "pop-in" mechanism can operate on a feature dimension (color) that is irrelevant to the search goal (shape), showing a sophisticated level of control.
  • Temporal Dynamics of Suppression: Distractor suppression isn't instantaneous. There's an initial brief enhancement of the distractor's representation ("pop-out") followed by a sustained period of suppression ("pop-in"). This suggests a two-stage process.
  • Role of Training: The observed "pop-in" effect, especially for unpredictable distractors, likely emerges with extensive training, indicating the brain's plasticity in adapting to task demands.
  • Behavioral Avoidance: The neural findings are mirrored in behavior, with monkeys actively avoiding the salient color distractor, even when it initially pops out.

Key Results

  • Behavioral: Monkeys accurately selected the target shape and actively avoided the salient color distractor, choosing it less often than non-salient distractors.
  • Neuronal (V4 Activity):
    • Responses to the target shape were enhanced.
  • Responses to the salient color distractor were initially briefly enhanced (pop-out) but then significantly suppressed below the level of non-salient distractors ("pop-in").
  • The latency of target enhancement was around 112 ms, while the latency of salient distractor suppression was later, around 158 ms.
  • This "pop-in" effect was observed even when the distractor's color was unpredictable across trials.

Limitations and Future Work

  • Source of "Pop-in" Signal: The study acknowledges that the exact source of the "pop-in" signal is unknown but speculates it might involve feedback projections, potentially strengthened by training. Future work could investigate these feedback pathways.
  • Generalizability: While the study focused on V4, future research could explore how this "pop-in" mechanism is implemented across other brain regions involved in visual attention and selection.
  • Predictability of Distractors: The study used unpredictable distractor colors. Investigating how predictability influences the "pop-in" mechanism could provide further insights into top-down control.
  • Species Differences: The authors note that their findings on reward quantity effects differ from some human studies, suggesting potential species differences or the impact of extensive training in their animal models.

Summary updated

Abstract

Abstract During visual search, it is important to reduce the interference of distracting objects in the scene. The neuronal responses elicited by the search target stimulus are typically enhanced. However, it is equally important to suppress the representations of distracting stimuli, especially if they are salient and capture attention. We trained monkeys to make an eye movement to a unique ‘pop-out’ shape stimulus among an array of distracting stimuli. One of these distractors had a salient color that varied across trials and differed from the color of the other stimuli, causing it to also pop-out. The monkeys were able to select the pop-out shape target with high accuracy and actively avoided the pop-out color distractor. This behavioral pattern was reflected in the activity of neurons in area V4. Responses to the shape targets were enhanced, while the activity evoked by the pop-out color distractor was only briefly enhanced, directly followed by a sustained period of pronounced suppression. These behavioral and neuronal results demonstrate a cortical selection mechanism that rapidly inverts a pop-out signal to ‘pop-in’ for an entire feature dimension thereby facilitating goal-directed visual search in the presence of salient distractors. Significance statement Goal-directed behaviors like visual search involve both the selection of behaviorally relevant targets and the suppression of task-irrelevant distractors. This is especially important if distractors are salient and capture attention. Here we demonstrate that non-human primates suppress a salient color distractor while searching for a target that is defined by shape, i.e. another feature dimension. The neuronal activity of V4 neurons revealed the temporal evolution of target selection and distractor suppression. The neuronal responses elicited by the pop-out target stimuli were enhanced whereas responses elicited by salient pop-out color distractors were suppressed, after an initial brief phase of response enhancement. Our results reveal a ‘pop-in’ mechanism by which the visual cortex inverts an attentional capture signal into suppression to facilitate visual search.
BibTeX
@misc{klink2022pop,
  author = {P. Christiaan Klink and Rob R. M. Teeuwen and Jeannette A. M. Lorteije and Pieter R. Roelfsema},
  title = {{Pop-in: the inversion of pop-out for a feature dimension during visual search in area V4 of the monkey cortex}},
  year = {2022},
  doi = {10.1101/2022.06.23.497353},
  howpublished = {bioRxiv},
}
Figure