Transformation of population code from dLGN to V1 facilitates linear decoding

N. Alex Cayco-Gajic, Séverine Durand, Michael A. Buice, Ramakrishnan Iyer, Clay Reid, Joel Zylberberg, Eric Shea‐BrownbioRxiv 2019 · DOI

TL;DR

The transformation of neural signals from the dLGN to V1 in the visual system makes information more linearly decodable by reshaping neural correlations, even while maintaining sparseness. This suggests a key computational principle for efficient information processing in the brain.

What Problem Does This Paper Address?

Understanding how the brain processes sensory information is a fundamental challenge in neuroscience. The visual pathway, from the dLGN (a relay station in the thalamus) to the primary visual cortex (V1), is a well-studied system that transforms visual input. Two prominent theories exist: sparse coding, which suggests V1 neurons represent local image features in a sparse manner, and theories proposing that the visual pathway increasingly separates information into linearly separable representations. This paper aims to bridge these theories by investigating how the dLGN-V1 transformation affects both sparseness and linear separability, particularly by examining the role of neural correlations.

Methods

The researchers used simultaneous electrophysiological recordings of neural activity from populations of neurons in the dLGN and V1 of awake and anesthetized mice. They presented visual stimuli in the form of drifting gratings with varying spatial and temporal frequencies.

Key analytical techniques included:

  • Population Sparseness: Quantifying how activity is distributed across neurons over time.
  • Noise Correlations: Measuring the trial-to-trial variability in spiking activity between pairs of neurons that is not explained by their tuning to stimuli.
  • Decoding Analysis: Training "decoders" (computational models) to predict visual stimuli (specifically grating direction) based on the recorded neural activity. They compared "correlated decoders" (which account for neural correlations) with "independent decoders" (which only use firing rates).
  • Linear vs. Quadratic Decoding: Assessing how well linear models (simpler, like a weighted sum) versus quadratic models (more complex, including interaction terms) could decode the neural activity.
  • Dimensionality Measurement: Estimating the intrinsic dimensionality of the neural representations using the eigenvalue participation ratio of the covariance matrix.

Datasets

The study utilized a dataset of simultaneously recorded dLGN and V1 neural activity from mice presented with drifting gratings. No new benchmark datasets were introduced; rather, the existing recordings were analyzed to compare the two brain regions.

Key Insights and Ideas

  • V1 is Sparsely Coded, but Correlations are Different: While V1 neurons exhibit sparser population activity than dLGN neurons, the surprising finding is that V1 neurons have slightly higher noise correlations. This challenges the intuition that sparser coding would necessarily lead to less correlated activity.
  • Correlations Matter for dLGN, Less for V1: The ability of a decoder to predict visual stimuli is significantly improved when it accounts for neural correlations in the dLGN. However, in V1, knowing these correlations offers little additional benefit for decoding.
  • dLGN-V1 Transformation "Linearizes" Information: The transformation from dLGN to V1 makes visual information more linearly separable. This is evidenced by the fact that linear decoders perform nearly as well as more complex quadratic decoders in V1, whereas in dLGN, quadratic decoders significantly outperform linear ones.
  • Reshaping Correlations for Decoding: The study suggests that the dLGN-V1 transformation reshapes correlated variability in a way that makes it less impactful for stimulus decoding, thereby facilitating more efficient downstream processing.

Key Results

  • V1 population activity was significantly sparser than dLGN activity across various time windows.
  • Average noise correlations between V1 units were slightly, but significantly, greater than in dLGN.
  • Decoding accuracy for grating direction was significantly improved in dLGN when using a "correlated decoder" compared to an "independent decoder." This effect increased with population size.
  • In V1, the difference in decoding accuracy between correlated and independent decoders was minimal.
  • Quadratic decoders significantly outperformed linear decoders in dLGN, indicating non-linear separability. In V1, the performance difference between linear and quadratic decoders was much smaller, suggesting increased linear separability.
  • The study observed a decrease in the embedding dimensionality of V1 representations compared to dLGN representations.

Limitations and Future Work

  • Subsampling for Dimensionality: The authors acknowledge that subsampling dLGN and V1 recordings to the same population size for dimensionality analysis might miss an increase in dimensionality that could occur due to the anatomical divergence of projections from dLGN to V1.
  • Simple vs. Complex Stimuli: The study focused on simple visual features (gratings). It is suggested that the dLGN-V1 pathway might use different strategies for transforming representations of complex stimuli (e.g., natural images) compared to simple ones.
  • Future Directions: The authors propose that future research using high-density electrophysiology and large-scale recordings could further investigate the interplay between dimensionality increase and correlation reshaping in making neural representations more separable. They also suggest that these mechanisms likely work in tandem to optimize visual stimulus representation.

Summary updated

Abstract

Summary How neural populations represent sensory information, and how that representation is transformed from one brain area to another, are fundamental questions of neuroscience. The dorsolateral geniculate nucleus (dLGN) and primary visual cortex (V1) represent two distinct stages of early visual processing. Classic sparse coding theories propose that V1 neurons represent local features of images. More recent theories have argued that the visual pathway transforms visual representations to become increasingly linearly separable. To test these ideas, we simultaneously recorded the spiking activity of mouse dLGN and V1 in vivo. We find strong evidence for both sparse coding and linear separability theories. Surprisingly, the correlations between neurons in V1 (but not dLGN) were shaped as to be irrelevant for stimulus decoding, a feature which we show enables linear separability. Therefore, our results suggest that the dLGN-V1 transformation reshapes correlated variability in a manner that facilitates linear decoding while producing a sparse code.
BibTeX
@misc{caycogajic2019transformation,
  author = {N. Alex Cayco-Gajic and Séverine Durand and Michael A. Buice and Ramakrishnan Iyer and Clay Reid and Joel Zylberberg and Eric Shea‐Brown},
  title = {{Transformation of population code from dLGN to V1 facilitates linear decoding}},
  year = {2019},
  doi = {10.1101/826750},
  howpublished = {bioRxiv},
}

Loading related content...

Figure