Predicting Cortical Dark/Bright Asymmetries from Natural Image Statistics and Early Visual Transforms

Emily A. Cooper, Anthony M. NorciaPLOS Computational Biology 2015 · OpenReview

TL;DR

This paper investigates why our visual system processes bright and dark features differently. By analyzing natural images and modeling early visual processing, the authors show that inherent statistical differences between bright and dark regions in natural scenes lead to asymmetric inputs to the visual cortex, potentially explaining observed perceptual biases.

What Problem Does This Paper Address?

The visual system is remarkably adept at processing the complex information in natural scenes. While much research has focused on the statistical regularities of visual features like contrast, spatial frequency, and orientation, these studies often treat bright and dark components of images similarly. However, recent physiological and psychophysical evidence suggests that the visual system exhibits a "dark bias," processing dark features differently (and often more strongly) than bright ones. This paper aims to bridge this gap by exploring whether asymmetries in natural image statistics between bright and dark regions can explain these observed dark biases in visual processing.

Methods

The authors employ a multi-pronged approach:

  • Image Segmentation: Natural images are processed using Difference of Gaussians (DOG) filters to separate them into "bright" (positive contrast) and "dark" (negative contrast) components.
  • Statistical Analysis: They compute probability distributions for features like Weber contrast, spatial frequency, orientation, and relative depth for both bright and dark image components, and then analyze the ratios between these distributions.
  • Noise Image Analysis: To isolate the sources of these asymmetries, they generate synthetic noise images (e.g., Gaussian white noise, naturalistic noise with specific statistical properties) and perform the same analysis. This helps determine if asymmetries arise from general image statistics or specific scene content.
  • Retinal Ganglion Cell (RGC) Modeling: They simulate the responses of RGCs (parvocellular and magnocellular pathways, ON and OFF divisions) to these image statistics. This involves modeling their receptive fields and non-linear contrast response functions.
  • Cortical Input Simulation: The simulated RGC outputs are then used to estimate the statistical patterns of input to the primary visual cortex.
  • Perceptual Modeling: Finally, they use a population model of complex cells to predict how these input asymmetries might translate into perceptual biases, specifically focusing on discrimination thresholds.

Datasets

  • Natural Images:
    • Van Hateren Dataset (200 images, 1536x1024 pixels)
    • McGill Calibrated Color Image Database (80 images, 768x576 pixels)
  • Depth Maps: A dataset of 31 depth maps from natural scenes.
  • Noise Images: Five classes of synthetic noise images were generated for comparison.

Key Insights and Ideas

  • Natural Scenes Aren't Neutral: The fundamental statistical distributions of visual features like contrast and spatial frequency are not the same for bright and dark regions in natural images. This is a crucial "second-order" regularity.
  • Darkness Dominates at Low Frequencies and High Contrast: Dark features are more prevalent at lower spatial frequencies and become increasingly dominant as contrast increases.
  • Early Visual Pathways Amplify Asymmetries: The ON and OFF pathways in the retina, with their distinct response properties and receptive field sizes, don't just passively transmit these image asymmetries; they actively shape and potentially amplify them before they reach the cortex.
  • "Dark Advantage" in Perception: The simulated cortical input asymmetries can explain why we often exhibit a "dark advantage" in perceptual tasks, meaning we can detect or discriminate dark features more easily than bright ones. This suggests our visual system is optimized for the statistical realities of the natural world.
  • Energy Models Need Refinement: The observed dark bias in cortical responses challenges classic "energy models" of visual processing, which often assume symmetric processing of positive and negative contrast. This work suggests that the asymmetry is rooted in earlier visual processing stages.

Key Results

  • Natural images show a consistent bias towards dark features, with dark amplitude exceeding bright by a factor of 1.4 overall.
  • This dark bias increases with visual contrast and is more pronounced at lower spatial frequencies.
  • Simulations predict a greater afferent signal to primary visual cortex for dark stimuli compared to bright stimuli of equal magnitude (e.g., a dark bar produced 1.9 times greater signal than a bright bar in one simulation).
  • The model predicts a dark advantage in perceptual discrimination, with discrimination thresholds for dark stimuli being approximately 40% lower than for bright stimuli, consistent with psychophysical findings.

Limitations and Future Work

  • Contrast Definition Sensitivity: The authors acknowledge that the precise definition of "local contrast" and the size of the normalization pool can influence the observed asymmetries, particularly for spatial frequency.
  • RGC Response Modeling: Relating laboratory measurements of RGC responses to their responses in complex natural scenes remains an open question.
  • Spatial Orientation and Depth: While some asymmetries were observed for orientation and depth, these were less pronounced or noisier than for contrast and spatial frequency.
  • Future Directions:
    • Develop more detailed models of early visual pathways, incorporating how mean luminance affects RGC responses.
  • Investigate how visual statistics vary with retinal eccentricity and eye movements.
  • Extend the analysis to the temporal domain to understand motion processing asymmetries.
  • Generate 3D synthetic scenes to better understand the role of shadows and geometric properties in creating dark/bright biases.
  • Explore if similar adaptive asymmetries exist in other sensory modalities (olfactory, auditory).

Summary updated

Abstract

The nervous system has evolved in an environment with structure and predictability. One of the ubiquitous principles of sensory systems is the creation of circuits that capitalize on this predictability. Previous work has identified predictable non-uniformities in the distributions of basic visual features in natural images that are relevant to the encoding tasks of the visual system. Here, we report that the well-established statistical distributions of visual features -- such as visual contrast, spatial scale, and depth -- differ between bright and dark image components. Following this analysis, we go on to trace how these differences in natural images translate into different patterns of cortical input that arise from the separate bright (ON) and dark (OFF) pathways originating in the retina. We use models of these early visual pathways to transform natural images into statistical patterns of cortical input. The models include the receptive fields and non-linear response properties of the magnocellular (M) and parvocellular (P) pathways, with their ON and OFF pathway divisions. The results indicate that there are regularities in visual cortical input beyond those that have previously been appreciated from the direct analysis of natural images. In particular, several dark/bright asymmetries provide a potential account for recently discovered asymmetries in how the brain processes visual features, such as violations of classic energy-type models. On the basis of our analysis, we expect that the dark/bright dichotomy in natural images plays a key role in the generation of both cortical and perceptual asymmetries.
BibTeX
@article{cooper2015predicting,
  author = {Emily A. Cooper and Anthony M. Norcia},
  title = {{Predicting Cortical Dark/Bright Asymmetries from Natural Image Statistics and Early Visual Transforms}},
  journal = {PLOS Computational Biology},
  year = {2015},
  url = {https://openreview.net/forum?id=PW95XKrJdd},
}
Figure