Representational untangling by the firing rate nonlinearity in V1 simple cells

Merse E Gáspár, Pierre‐Olivier Polack, Peyman Golshani, Máté Lengyel, Gergő OrbáneLife 2019 · DOI

TL;DR

The visual system needs to "untangle" complex sensory information into easily decodable representations. This paper shows that even the earliest stage of visual processing, V1, achieves this "representational untangling" (RU) for orientation information, not through complex circuits, but through a fundamental cellular property: the thresholded firing rate nonlinearity of simple cells. Crucially, the firing thresholds observed in real V1 neurons are near-optimal for this untangling, suggesting that information reformatting, not just maximization, is a key goal of early visual processing.

What Problem Does This Paper Address?

The brain's visual system transforms raw sensory input into representations that allow us to understand and interact with the world. A key computational goal is "representational untangling" (RU), where complex, "tangled" information (like raw pixel data) is reformatted into a more linearly decodable format, making it easier for downstream areas to extract specific features (e.g., object identity). This process is thought to occur through hierarchical stages in higher visual cortices. However, the authors investigate whether RU for a basic visual feature like orientation might already be happening at the very first cortical stage, V1. They question whether a fundamental property of V1 neurons – their firing rate nonlinearity (FRNL) – could be responsible for this early untangling, especially in the face of "nuisance" parameters (like changes in stimulus phase or contrast) that make decoding difficult.

Methods

The researchers employed a canonical population coding model of V1 simple cells. This model simulates how neurons respond to visual stimuli. Key aspects include:

  • Stimulus Generation: Sine wave gratings with controlled orientation and nuisance parameters (phase, spatial period, contrast).
  • Neuron Model: Circular Gabor filters to mimic simple cell receptive fields, followed by additive Gaussian noise to simulate membrane potential variability.
  • Firing Rate Non-linearity (FRNL): A threshold-power-law function was applied to the membrane potential to generate the firing rate. This is the core mechanism investigated.
  • Decoding: A linear decoder was trained to estimate stimulus orientation from the population's firing rates or membrane potentials.
  • RU Quantification: Linear decodability was used as the primary measure of RU. The authors also used an optimal Bayesian decoder to assess total information content.
  • Experimental Validation: Intracellular recordings from awake behaving mice were used to measure V1 simple cell membrane potentials and estimate their FRNL parameters.

The novelty lies in focusing on the FRNL's contribution to RU at the V1 level and systematically exploring the trade-off between information loss and increased linear separability introduced by the threshold.

Datasets

The study primarily uses simulated data generated by their population coding model. For experimental validation, they utilized electrophysiological recordings from V1 simple cells in awake behaving mice. No new benchmark datasets were introduced.

Key Insights and Ideas

  • Early RU in V1: The FRNL of V1 simple cells, specifically its thresholding property, is sufficient to perform representational untangling of orientation information, even at this early stage of visual processing.
  • Trade-off is Key: The FRNL creates a trade-off: it discards information below the threshold (information loss) but makes the remaining supra-threshold responses more linearly separable (increased RU).
  • Optimal Threshold: There exists an optimal firing threshold that balances this trade-off, maximizing linear decodability. This optimum is not simply about maximizing total information.
  • V1 Specificity: This RU effect via FRNL is specific to V1; similar models of retinal or LGN cells (lacking orientation selectivity) did not show this untangling.
  • Near-Optimal Thresholds in Vivo: Critically, the firing thresholds measured in awake behaving V1 simple cells are found to be near this theoretically optimal value for RU.
  • Nuisance Parameter Robustness: The optimal threshold for RU is remarkably robust to variations in nuisance parameters (phase, contrast, spatial period) and other model parameters, suggesting a fundamental role.

Key Results

  • Phase Variability: When stimulus phase was variable (a nuisance parameter), linear decodability of orientation from membrane potentials became highly nonlinear and "tangled." However, decoding from firing rates, due to the FRNL, remained much more linearly separable, with a clear optimal threshold.
  • Optimal Threshold Location: The optimal firing threshold was found to be around -57 mV in their model, approximately 3 mV above the average membrane potential.
  • Experimental Validation: In vivo recordings showed that V1 simple cell thresholds fell within the "robust performance regime" for RU, meaning they were close to the optimal values predicted by the model, despite significant individual variability in cell parameters.
  • Contrast vs. Phase: While phase variability significantly entangled representations, contrast variability had a less detrimental effect on linear decodability, as responses scaled radially.
  • Retina/LGN vs. V1: Models of retinal and LGN cells did not exhibit RU from their FRNL when faced with phase variability, highlighting V1's unique role.

Limitations and Future Work

  • Stimulus Simplification: The study used simplified sine wave gratings, although natural image statistics were considered for nuisance parameter distributions. Future work could explore more complex natural stimuli.
  • Model Assumptions: The model assumes a specific form of FRNL (threshold-power-law) and Gaussian noise. While robust, exploring other nonlinearities or noise structures could be beneficial.
  • FRNL Exponent: The precise value of the FRNL exponent was difficult to estimate experimentally, leading to a "robust performance regime" for optimal thresholds rather than a single point.
  • Future Directions: The authors suggest that RU might be a general principle across the visual system, involving both cellular and circuit-level mechanisms. Further research could explore how this mechanism extends to higher-level features and how it interacts with other known V1 computations like contrast invariance. They also propose that this mechanism could be relevant for understanding complex cell function.

Summary updated

Abstract

An important computational goal of the visual system is 'representational untangling' (RU): representing increasingly complex features of visual scenes in an easily decodable format. RU is typically assumed to be achieved in high-level visual cortices via several stages of cortical processing. Here we show, using a canonical population coding model, that RU of low-level orientation information is already performed at the first cortical stage of visual processing, but not before that, by a fundamental cellular-level property: the thresholded firing rate nonlinearity of simple cells in the primary visual cortex (V1). We identified specific, experimentally measurable parameters that determined the optimal firing threshold for RU and found that the thresholds of V1 simple cells extracted from in vivo recordings in awake behaving mice were near optimal. These results suggest that information re-formatting, rather than maximisation, may already be a relevant computational goal for the early visual system.
BibTeX
@inproceedings{gaspar2019representational,
  author = {Merse E Gáspár and Pierre‐Olivier Polack and Peyman Golshani and Máté Lengyel and Gergő Orbán},
  title = {{Representational untangling by the firing rate nonlinearity in V1 simple cells}},
  booktitle = {eLife},
  year = {2019},
  doi = {10.7554/elife.43625},
}
Figure