Modeling a space-variant cortical representation for apparent motion

J. Wurbs, Ennio Mingolla, A. YazdanbakhshJournal of Vision 2013 · DOI

TL;DR

This paper presents a neural model of the early visual system (retina to V1) that successfully explains why our perception of motion, specifically the maximum distance we can perceive motion over (Dmax), increases with eccentricity. The model demonstrates that the inherent "space-variant" nature of our visual processing, including cortical magnification and receptive field properties, is sufficient to account for this phenomenon without needing to invoke higher visual areas.

What Problem Does This Paper Address?

The human visual system processes information in a non-uniform way across the visual field, a phenomenon known as "space-variance." This means that our fovea (central vision) and periphery have different processing characteristics. Specifically, it's known that the maximum displacement over which we can perceive apparent motion (Dmax) increases linearly with eccentricity (how far from the fovea we are looking). While this behavioral observation is well-established, the underlying neural mechanisms, particularly within the early visual pathway (retina to V1), have not been fully understood. Researchers have debated whether this eccentricity dependence of Dmax is solely due to early visual processing or if it requires input from higher visual areas like MT. This paper aims to disentangle these contributions by building a computational model that incorporates known space-variant properties of the early visual system and testing if it can replicate the observed Dmax behavior.

Methods

The authors developed a neural model that simulates the early visual pathway, from retinal sampling to V1 processing. The model incorporates several key space-variant features:

  • Cortical Magnification Factor (CMF): The model accounts for the fact that a larger area of the visual cortex is dedicated to processing the fovea compared to the periphery.
  • Receptive Field Size: It models the observation that receptive field sizes increase with eccentricity.
  • Receptive Field Overlap: The model assumes a constant overlap between receptive fields across the visual field, a constraint derived from biological data.
  • Cortical Receptive Field Scatter: This accounts for the slight deviations in receptive field centroids within a cortical column.
  • Spatiotemporal Response: The model allows for eccentricity-dependent changes in the temporal response characteristics of neurons.

The model takes a two-flash stimulus as input and generates a "cortical activity profile." To determine Dmax, the model calculates a discriminability index (a Euclidean distance metric) between the activity profile generated by a continuous motion input and the activity profile generated by the discrete two-flash input. A threshold on this index is set to match psychophysical data, allowing the model to predict Dmax.

Datasets

Not discussed in the paper. The study relies on existing psychophysical data from Baker and Braddick (1985) and Todd and Norman (1995) for model validation and comparison.

Key Insights and Ideas

  • Early Visual System Sufficiency: The most significant insight is that the early visual pathway (retina to V1), with its inherent space-variant properties, is sufficient to explain the qualitative linear increase of Dmax with eccentricity. This challenges the necessity of invoking higher visual areas for this basic phenomenon.
  • Interplay of Space-Variant Factors: The model highlights how the combined effects of cortical magnification and changes in receptive field properties (size, scatter) create the observed eccentricity dependence.
  • Limited Role of Cortical Scatter: The study suggests that cortical receptive field scatter, while present, plays a minimal role in determining Dmax, acting more like a low-pass filter.
  • Number of Frames vs. Dmax: The model's inability to replicate the effect of the number of frames on Dmax (as observed by Todd and Norman) suggests that this particular aspect of motion perception likely relies on higher-level processing, possibly involving temporal integration over longer timescales.

Key Results

  • The model successfully replicates the observed linear increase of Dmax as a function of eccentricity, consistent with Baker and Braddick (1985) data.
  • Varying the overlap parameter (within a reasonable range) had no significant effect on the Dmax eccentricity dependence, suggesting that the constancy of overlap is more important than its precise value.
  • The model showed a negligible increase in Dmax with an increasing number of input frames, indicating that early visual processing alone cannot explain this phenomenon. This suggests a role for higher visual areas with potentially longer temporal integration capabilities.
  • The authors found that the eccentricity dependence of Dmax increased with increasing eccentricity dependence of other parameters (like temporal response time, τ), further supporting the model's ability to capture these relationships.

Limitations and Future Work

  • Higher Level Visual Areas: While the model demonstrates the sufficiency of the early visual system for the qualitative Dmax eccentricity dependence, it acknowledges that higher visual areas (like MT) might play a role in determining the exact quantitative value of Dmax or in explaining phenomena like the number-of-frames effect.
  • Number of Frames Effect: The model's failure to account for the influence of the number of frames on Dmax is a clear limitation, pointing towards the need for models that incorporate higher-level temporal processing.
  • Future Work: The authors suggest that future research should explore the role of higher visual areas, particularly motion-specific areas like MT, in modulating Dmax. They also propose further investigation into how cortical scatter might contribute to visual refinement. The paper also hints at the need for models that can integrate information over longer temporal scales to explain phenomena like the number-of-frames effect.

Summary updated

Abstract

Receptive field sizes of neurons in early primate visual areas increase with eccentricity, as does temporal processing speed. The fovea is evidently specialized for slow, fine movements while the periphery is suited for fast, coarse movements. In either the fovea or periphery discrete flashes can produce motion percepts. Grossberg and Rudd (1989) used traveling Gaussian activity profiles to model long-range apparent motion percepts. We propose a neural model constrained by physiological data to explain how signals from retinal ganglion cells to V1 affect the perception of motion as a function of eccentricity. Our model incorporates cortical magnification, receptive field overlap and scatter, and spatial and temporal response characteristics of retinal ganglion cells for cortical processing of motion. Consistent with the finding of Baker and Braddick (1985), in our model the maximum flash distance that is perceived as an apparent motion (Dmax) increases linearly as a function of eccentricity. Baker and Braddick (1985) made qualitative predictions about the functional significance of both stimulus and visual system parameters that constrain motion perception, such as an increase in the range of detectable motions as a function of eccentricity and the likely role of higher visual processes in determining Dmax. We generate corresponding quantitative predictions for those functional dependencies for individual aspects of motion processing. Simulation results indicate that the early visual pathway can explain the qualitative linear increase of Dmax data without reliance on extrastriate areas, but that those higher visual areas may serve as a modulatory influence on the exact Dmax increase.
BibTeX
@article{wurbs2013modeling,
  author = {J. Wurbs and Ennio Mingolla and A. Yazdanbakhsh},
  title = {{Modeling a space-variant cortical representation for apparent motion}},
  journal = {Journal of Vision},
  year = {2013},
  doi = {10.1167/13.10.2},
}
Figure