The nature-nurture transform underlying the emergence of reliable cortical representations

Sigrid Trägenap, David E. Whitney, David Fitzpatrick, Matthias KaschubebioRxiv 2022 · DOI

TL;DR

This paper reveals how the visual cortex transforms from a system with highly variable, experience-independent responses to one with reliable, experience-driven representations. They demonstrate that visual experience drives the alignment of feedforward and recurrent neural networks, leading to more efficient and stable information processing.

What Problem Does This Paper Address?

The development of reliable sensory representations in the brain is a fundamental question. Specifically, how does the visual cortex, which has a basic structure present before visual experience, learn to process visual information effectively after "eye-opening"? Before visual experience, neural activity is robust but highly variable, making it difficult to discriminate stimuli. After experience, representations become stable and low-dimensional. This paper investigates the "nature-nurture transform" – the process by which early, endogenous network structures are shaped by visual experience to form mature, reliable representations.

Methods

The researchers employed a multi-pronged approach:

  • In vivo calcium imaging: They used wide-field and two-photon calcium imaging in ferret visual cortex to observe neural activity at both population and single-neuron levels. This allowed them to track changes in neural responses before and after eye-opening.
  • Computational modeling: They developed a minimal linear recurrent neural network model to simulate the "feedforward-recurrent alignment hypothesis." This model allowed them to test how the alignment between incoming visual information (feedforward input) and the internal network structure (recurrent connections) affects key network properties.
  • Behavioral manipulation: They used binocular deprivation in some animals to experimentally control visual experience and assess its necessity for the observed developmental changes.

Datasets

The study utilized data from visually naïve and visually experienced ferrets. No new datasets were introduced; rather, existing experimental data was analyzed and compared across different developmental stages and experimental conditions (e.g., deprived vs. normally reared animals).

Key Insights and Ideas

  • Experience is key to reliability: The dramatic shift from unreliable to reliable visual responses is not an inherent property of the developing cortex but is actively driven by visual experience.
  • Alignment is the mechanism: The core insight is that visual experience promotes the alignment between feedforward visual input and the recurrent cortical network. This alignment allows the network to "resonate" with the input, amplifying relevant signals and suppressing noise.
  • Low dimensionality as a consequence: The alignment process leads to the development of low-dimensional representations. This means that the complex patterns of neural activity become organized along a few dominant dimensions, making them more efficient and easier to interpret.
  • Spontaneous activity as a guide: The study suggests that spontaneous activity, present before eye-opening, reflects the initial state of the recurrent network. Visual experience then guides the feedforward input to align with this existing network structure.

Key Results

  • Increased trial-to-trial correlation: After eye-opening, the correlation between responses to repeated presentations of the same stimulus increased significantly (p=0.0002).
  • Increased intra-trial stability: Responses became more stable within a single stimulation period after visual experience (p<0.001).
  • Reduced dimensionality: The complexity of evoked activity patterns decreased, indicating a more organized and efficient representation.
  • Alignment with spontaneous activity: Evoked responses became much more aligned with spontaneous network activity after visual experience.
  • Deprivation impairs development: Binocular deprivation prevented these developmental changes, highlighting the critical role of patterned visual input.

Limitations and Future Work

  • Model simplification: The computational model is a simplified representation of the visual cortex, using a linear recurrent network. It does not explicitly model changes in the selectivity of feedforward inputs, which are known to be critical for orientation representation.
  • Plasticity mechanisms: The precise neural circuit changes and plasticity mechanisms that drive feedforward-recurrent alignment remain to be determined.
  • Future directions: The authors suggest future studies should investigate the specific developmental changes that lead to this alignment and how activity-dependent synaptic plasticity contributes to strengthening these aligned circuits.

Summary updated

Abstract

Abstract The fundamental structure of cortical networks arises early in development prior to the onset of sensory experience. However, how endogenously generated networks respond to the onset of sensory experience, and how they form mature sensory representations with experience remains unclear. Here we examine this ‘nature-nurture transform’ using in vivo calcium imaging in ferret visual cortex. At eye-opening, visual stimulation evokes robust patterns of cortical activity that are highly variable within and across trials, severely limiting stimulus discriminability. Initial evoked responses are distinct from spontaneous activity of the endogenous network. Visual experience drives the development of low-dimensional, reliable representations aligned with spontaneous activity. A computational model shows that alignment of novel visual inputs and recurrent cortical networks can account for the emergence of reliable visual representations. One sentence summary The reliability of cortical representations emerges from experience-driven reorganization of endogenous networks
BibTeX
@misc{tragenap2022nature,
  author = {Sigrid Trägenap and David E. Whitney and David Fitzpatrick and Matthias Kaschube},
  title = {{The nature-nurture transform underlying the emergence of reliable cortical representations}},
  year = {2022},
  doi = {10.1101/2022.11.14.516507},
  howpublished = {bioRxiv},
}
Figure