Noise masking of White's illusion exposes the weakness of current spatial filtering models of lightness perception

Torsten Betz, Robert Shapley, Felix A. Wichmann, Marianne MaertensJournal of Vision 2015 · DOI

TL;DR

This paper challenges the prevailing spatial filtering models of human lightness perception by demonstrating their inability to replicate the specific masking effects of narrowband noise on White's illusion. The findings suggest that current models are fundamentally inadequate and point towards luminance edges as a more crucial low-level mechanism for lightness perception.

What Problem Does This Paper Address?

Human lightness perception, our ability to perceive the intrinsic reflectance of a surface regardless of illumination, is a complex phenomenon. For decades, a dominant class of computational models has attempted to explain this by proposing that the visual system employs spatial filtering operations, akin to applying various frequency-tuned filters to an image. These models are popular because they can often predict the outcomes of various lightness illusions, like White's illusion, and their proposed mechanisms bear a superficial resemblance to early visual processing.

However, a key question remained: do these models truly capture the underlying mechanisms, or are they merely successful at predicting outcomes in simplified scenarios? This paper addresses this by testing the robustness of these spatial filtering models against a specific psychophysical phenomenon: the effect of narrowband noise. Previous research showed that adding noise within a specific spatial frequency range (1-5 cycles per degree, cpd) significantly reduces the perceived strength of certain lightness illusions, while noise outside this range has little to no effect. The authors use White's illusion as a test case to see if current spatial filtering models can replicate this frequency-specific noise masking effect. If they can't, it suggests a fundamental flaw in their mechanistic assumptions.

Methods

The researchers employed a two-pronged approach:

  1. Psychophysical Experiment: They replicated and extended previous findings on the noise masking of White's illusion. Participants performed a lightness matching task where they adjusted a comparison patch to match the perceived lightness of a test patch embedded in a White's illusion stimulus. This was done under various conditions of narrowband noise, systematically varying the noise's center spatial frequency and the grating's spatial frequency.
  2. Computational Modeling: They implemented and tested four prominent spatial filtering models:
  3. The Oriented Difference of Gaussians (ODOG) model (Blakeslee & McCourt, 1999).
  4. The Frequency-Specific Locally Normalized ODOG (FLODOG) model (Robinson et al., 2007).
  5. The Dakin and Bex (2003) model, which uses isotropic log Gabor filters.
  6. The Brightness Induction Wavelet Model (BIWAM) (Otazu et al., 2008).

    These models were fed the same stimuli used in the psychophysical experiment, and their outputs were analyzed to see if they predicted the observed noise masking effects.

Datasets

Not discussed in the paper. The stimuli were generated computationally for the experiment and model simulations.

Key Insights and Ideas

  • Noise as a "Mechanism Probe": The core idea is that narrowband noise, by selectively interfering with specific spatial frequency channels, acts as a powerful tool to probe the underlying mechanisms of lightness perception. If a model relies on those specific channels, the noise should affect its output in a predictable way.
  • Failure of Current Models: The most striking insight is that none of the tested spatial filtering models could reproduce the psychophysically observed frequency-specific noise masking effect on White's illusion. This suggests these models, despite their popularity and predictive success in simpler cases, are fundamentally flawed in their mechanistic assumptions.
  • Beyond Simple Filtering: The failure implies that lightness perception isn't solely about filtering image components at different spatial frequencies. The specific way noise interacts with the visual system points to something more nuanced.
  • Edge Importance: The results strongly support the idea that luminance contrast at surface boundaries (edges) plays a critical role in lightness perception, a mechanism not adequately captured by current spatial filtering approaches.

Key Results

  • Psychophysical Replication: The study successfully replicated the finding that narrowband noise between 1 and 5 cpd significantly reduces White's illusion, while noise outside this range has minimal impact. This effect was observed across different grating frequencies, though the most effective masking frequency showed some scaling with the grating frequency, but not proportionally.
  • Model Failures:
    • The ODOG model failed to show any frequency-specific masking, abolishing the illusion at most noise frequencies.
  • The FLODOG model showed a frequency-specific effect, but predicted the most effective masking frequency to be much lower than observed and scaled too proportionally with grating frequency.
  • The Dakin and Bex model predicted the opposite effect of low-frequency noise.
  • The BIWAM model predicted a frequency-specific effect but at the wrong frequencies and with an incorrect scaling relationship.
  • Quantitative Summary: Figure 6 visually summarizes the discrepancy, showing that while observers' most effective noise frequencies clustered around a certain range and scaled non-proportionally with grating frequency, the models predicted different ranges and steeper scaling.

Limitations and Future Work

  • Model Inadequacy: The primary limitation highlighted is the inadequacy of the current class of spatial filtering models. The authors argue that these models are not just incomplete but qualitatively wrong in their mechanistic assumptions.
  • Filling-in Problem: Spatial filtering models sidestep the "filling-in" problem (how the visual system perceives uniform surfaces based on edge information). The authors suggest that future work needs to address this, potentially through edge-based models.
  • Edge-Based Models: The paper advocates for reconsidering edge-based approaches to lightness perception, citing previous work and their own findings on contour adaptation. They acknowledge that integrating edge information across an entire image can be computationally challenging, but suggest it's a more promising avenue.
  • Replication Difficulties: The authors note challenges in replicating previous psychophysical studies due to high observer variability, suggesting that the task itself might be perceptually ill-defined under certain noise conditions, potentially linking to image segmentation.
  • Future Directions: The authors propose that future research should focus on models that explicitly incorporate luminance edges and address the filling-in problem, moving beyond the limitations of current spatial filtering approaches.

Summary updated

Abstract

Spatial filtering models are currently a widely accepted mechanistic account of human lightness perception. Their popularity can be ascribed to two reasons: They correctly predict how human observers perceive a variety of lightness illusions, and the processing steps involved in the models bear an apparent resemblance with known physiological mechanisms at early stages of visual processing. Here, we tested the adequacy of these models by probing their response to stimuli that have been modified by adding narrowband noise. Psychophysically, it has been shown that noise in the range of one to five cycles per degree (cpd) can drastically reduce the strength of some lightness phenomena, while noise outside this range has little or no effect on perceived lightness. Choosing White's illusion (White, 1979) as a test case, we replicated and extended the psychophysical results, and found that none of the spatial filtering models tested was able to reproduce the spatial frequency specific effect of narrowband noise. We discuss the reasons for failure for each model individually, but we argue that the failure is indicative of the general inadequacy of this class of spatial filtering models. Given the present evidence we do not believe that spatial filtering models capture the mechanisms that are responsible for producing many of the lightness phenomena observed in human perception. Instead we think that our findings support the idea that low-level contributions to perceived lightness are primarily determined by the luminance contrast at surface boundaries.
BibTeX
@article{betz2015noise,
  author = {Torsten Betz and Robert Shapley and Felix A. Wichmann and Marianne Maertens},
  title = {{Noise masking of White's illusion exposes the weakness of current spatial filtering models of lightness perception}},
  journal = {Journal of Vision},
  year = {2015},
  doi = {10.1167/15.14.1},
}
Figure