Differential effects of visual attention and working memory on binocular rivalry

Lisa Scocchia, Matteo Valsecchi, Karl R. Gegenfurtner, Jochen TrieschJournal of Vision 2014 · DOI

TL;DR

This study investigates how visual working memory (WM) and sustained attention influence binocular rivalry, a phenomenon where perception alternates between two competing images. The researchers found that while WM had little to no effect on rivalry, sustained attention, particularly when engaged in a tracking task, significantly biased perception, suggesting a dissociation between these two cognitive processes.

What Problem Does This Paper Address?

Binocular rivalry is a fascinating perceptual phenomenon where the brain struggles to reconcile two different images presented to each eye, leading to a fluctuating perception. For decades, researchers have explored how various cognitive factors, like attention and memory, can influence this perceptual competition. While it's known that attention can affect rivalry, the specific role of visual working memory (WM) – the ability to hold and manipulate visual information in mind – remained largely unexplored. This paper aims to fill that gap by systematically comparing the effects of holding visual information in WM versus actively attending to it on binocular rivalry. The core question is whether actively "remembering" an image can bias what we "see" during rivalry, and how this compares to the influence of focused attention.

Methods

The researchers conducted four experiments using a delayed match-to-sample task to manipulate visual working memory and a tracking task to manipulate sustained attention.

  • Binocular Rivalry Setup: Participants viewed two different images (e.g., a house and a face) simultaneously, one presented to each eye. They continuously reported which image they perceived at any given moment.
  • Visual Working Memory (WM) Manipulation: In Experiments 1-3, participants were first shown an image (the "memory sample") and instructed to hold it in memory. After a delay, they performed a match-to-sample task to ensure they were actively maintaining the image. During the WM retention interval, they experienced binocular rivalry.
  • Sustained Attention Manipulation: In Experiment 4, participants were instructed to actively track one of the two rival images while simultaneously monitoring for a subtle change within that image. This task was designed to engage sustained endogenous attention.
  • Stimuli: A variety of stimuli were used, including houses, faces, airplanes, and oriented gratings, to test for category-specific or feature-specific effects. Grayscale stimuli were used in later experiments to rule out color priming as an explanation for any observed effects.
  • Data Analysis: Dominance proportions (the ratio of exclusive perceptual responses) were calculated for each participant and condition. The "first percept" (the initial dominant image at the start of rivalry) was also analyzed.

Datasets

The paper does not introduce new benchmark datasets. Instead, it utilizes existing image databases for stimuli:

  • House and Airplane Stimuli: Publicly available images from www.flickr.com.
  • Face Stimuli: Images from the Georgia Tech face database (Nefian, 1999) and the Max-Planck Institute for Biological Cybernetics in Tuebingen, Germany.

Key Insights and Ideas

  • WM vs. Attention Dissociation: The most striking finding is the clear dissociation between the effects of visual WM and sustained attention on binocular rivalry. While WM showed minimal influence, sustained attention, particularly when actively engaged, had a significant impact.
  • Rivalry as an Early-Stage Process: The results suggest that binocular rivalry, especially with complex stimuli like houses and faces, reflects competition at an early stage of visual processing. This stage appears to be less susceptible to the top-down influence of WM compared to more complex, higher-level perceptual tasks.
  • Task Matters: The type of task used to engage cognitive resources is crucial. A simple WM task (holding an image in mind) did not significantly alter rivalry, but actively tracking one of the rival images did. This highlights the importance of how attention is deployed.
  • Color Priming as an Alternative Explanation: In Experiment 1, an initial effect of category match was observed, but this was later attributed to color priming, as the effect disappeared when color information was removed from the stimuli in Experiment 2. This underscores the need to carefully control for low-level stimulus properties.
  • Sustained Attention is Key: The study strongly supports the idea that sustained endogenous attention, especially when directed towards one of the rival stimuli through a tracking task, can significantly bias both the initial perception and the overall dominance during binocular rivalry.

Key Results

  • Experiments 1-3 (WM): No significant effect of visual WM contents on binocular rivalry dominance was found. The only observed effect in Experiment 1 (category match) was likely due to color priming and disappeared when color was removed.
  • Experiment 4 (Sustained Attention): When participants actively tracked one of the rival images (house or face), it significantly increased its dominance. Specifically, tracking the "house" image led to a decrease in "house" responses by about 30% compared to when they tracked the "house" image. This effect was observed for both overall dominance and the first dominant percept.
  • Accuracy: Participants performed well on the WM tasks (around 74% accuracy in Exp 2) and the attention tracking task (around 88% accuracy in Exp 4), indicating the tasks were sufficiently challenging to engage cognitive resources.

Limitations and Future Work

  • Null Results for WM: The authors acknowledge that drawing conclusions from null results requires caution. The lack of WM effects might be specific to the experimental paradigms used or the type of stimuli.
  • Stimulus Complexity: While the study used both complex (faces, houses) and simple (gratings) stimuli, the WM effects were absent across the board. However, the authors note that WM has been shown to influence other types of bistable perception, like structure-from-motion, suggesting that the type of bistable stimulus matters.
  • Future Directions: The authors suggest that future research should continue to explore the differences in how WM and attention modulate different types of bistable perception. They also highlight the importance of the specific task used to engage attention, suggesting that active tracking is more influential than passive instruction. Further investigation into the neural mechanisms underlying these dissociations is also warranted.

Summary updated

Abstract

The investigation of cognitive influence on binocular rivalry has a long history. However, the effects of visual WM on rivalry have never been studied so far. We examined top-down modulation of rivalry perception in four experiments to compare the effects of visual WM and sustained selective attention: In the first three experiments we failed to observe any sustained effect of the WM content; only the color of the memory probe was found to prime the initially dominant percept. In Experiment 4 we found a clear effect of sustained attention on rivalry both in terms of the first dominant percept and of the overall dominance when participants were involved in a tracking task. Our results provide an example of dissociation between visual WM and selective attention, two phenomena which otherwise functionally overlap to a large extent. Furthermore, our study highlights the importance of the task employed to engage cognitive resources: The observed perceptual epiphenomena of binocular rivalry are indicative of visual competition at an early stage, which is not affected by WM but is still susceptible to attention influence as long as the observer’s attention is constrained to one of the two rival images via a specific concomitant task.
BibTeX
@article{scocchia2014differential,
  author = {Lisa Scocchia and Matteo Valsecchi and Karl R. Gegenfurtner and Jochen Triesch},
  title = {{Differential effects of visual attention and working memory on binocular rivalry}},
  journal = {Journal of Vision},
  year = {2014},
  doi = {10.1167/14.5.13},
}
Figure