Rectified activity-dependent population plasticity implicates cortical adaptation for memory and cognitive functions

Hong Xie, Kaiyuan Liu, Dong Li, Changshui Zhang, Claus C. Hilgetag, Ji‐Song GuanCommunications 2024 · DOI

TL;DR

Researchers have identified a new biological rule for how brain cells adapt over time, called Rectified Activity-dependent Population Plasticity (RAPP). This mechanism explains how the cortex thins out redundant information to create sparse, long-lasting memory traces and, when applied to artificial neural networks, significantly boosts performance in "few-shot" learning tasks where data is scarce.

What Problem Does This Paper Address?

A central mystery in neuroscience is the "stability-plasticity dilemma": how does the brain constantly rewire itself to learn new things without losing old memories or becoming over-saturated?

We know that sensory neurons often "adapt"—their response to a repeated stimulus gets weaker over time. Conversely, memory traces (engrams) must remain robust to be useful. The gap in our knowledge lies in the "middle management" of the cortex. We haven't had a clear mathematical rule describing how large populations of neurons change their activity levels across multiple days. The authors sought to find this rule and determine if it’s a bug (simple decay) or a feature (an optimization strategy).

Methods

The team employed a multi-disciplinary approach:

  • In Vivo Imaging: They used transgenic mice expressing a fluorescent protein (EGFP) tied to the Egr1 gene. Egr1 is an "immediate early gene" that acts as a proxy for recent neural activity. Using two-photon microscopy, they recorded the activity of nearly 30,000 neurons in the neocortex over several weeks.
  • Behavioral Paradigms: Mice were observed in neutral "homecage" environments and "conditioned" contexts (Contextual Fear Conditioning). They also performed hippocampal lesions to see how "top-down" memory signals interact with local cortical adaptation.
  • Computational Modeling: They built an Excitation-Inhibition (E/I) balanced integrate-and-fire network to simulate the biological findings.
  • AI Implementation: They integrated the RAPP rule into the backpropagation algorithm of a Convolutional Neural Network (CNN) as a novel momentum factor to test its utility in machine learning.

Datasets

  • Biological Data: A massive original dataset of cellular activity from 28,736 neurons across 10 different cortical areas in mice.
  • MNIST: The standard benchmark dataset of handwritten digits was used to evaluate the RAPP-enhanced artificial neural network, specifically focusing on small training subsets (50, 100, and 500 samples).

Key Insights and Ideas

  • The RAPP Rule: The researchers found that cortical adaptation isn't random. Previously highly active neurons reduce their activity but maintain a "residual potentiation" (they don't go back to zero). Crucially, their variability increases in proportion to their past activity.
  • "Rectified" Plasticity: Much like the ReLU (Rectified Linear Unit) activation function in AI, this biological rule is non-linear. It specifically targets the most active neurons for reduction, which naturally "distills" a dense population signal into a sparse, efficient memory trace.
  • The Inhibitory Knob: Simulation analysis suggests that local inhibitory connections are the primary drivers of this adaptation. By "tuning" the inhibition, the network can control how fast a memory pattern decays.
  • Hippocampal Intervention: The hippocampus acts as a "reset" button. In a conditioned context (learning), the hippocampus reverses the RAPP effect, preventing the memory trace from fading and reinstating the original activity pattern.

Key Results

  • Memory Decay Prediction: RAPP accurately predicts the power-law decay of context-induced activity patterns in the brain. It explains how a few "trace neurons" remain highly active for weeks while the rest of the population settles down.
  • Biological Validation: In mice with hippocampal lesions, cortical memory patterns decayed significantly faster, proving that the RAPP rule is an intrinsic cortical property that the hippocampus must actively fight against to preserve specific memories.
  • AI Performance Boost: When the RAPP rule was used as a momentum factor in a CNN, it outperformed the state-of-the-art Adam optimizer in small-sample tasks. For example, with only 50 or 100 training samples from MNIST, the RAPP-based network achieved significantly higher recognition accuracy and faster convergence.

Limitations and Future Work

While RAPP showed a clear advantage for "few-shot" learning (small datasets), the authors noted it actually showed a slight disadvantage when training samples were abundant (500+ samples). This suggests RAPP is specifically optimized for the "biological" constraint of learning from very few exposures.

Future work is needed to uncover the exact molecular mechanisms that allow a neuron to "remember" its previous activity level to scale its current variability. Additionally, exploring how RAPP might be integrated into more complex AI architectures (like Transformers) could open new doors for energy-efficient, small-sample machine learning.

Summary updated

Abstract

Cortical network undergoes rewiring everyday due to learning and memory events. To investigate the trends of population adaptation in neocortex overtime, we record cellular activity of large-scale cortical populations in response to neutral environments and conditioned contexts and identify a general intrinsic cortical adaptation mechanism, naming rectified activity-dependent population plasticity (RAPP). Comparing each adjacent day, the previously activated neurons reduce activity, but remain with residual potentiation, and increase population variability in proportion to their activity during previous recall trials. RAPP predicts both the decay of context-induced activity patterns and the emergence of sparse memory traces. Simulation analysis reveal that the local inhibitory connections might account for the residual potentiation in RAPP. Intriguingly, introducing the RAPP phenomenon in the artificial neural network show promising improvement in small sample size pattern recognition tasks. Thus, RAPP represents a phenomenon of cortical adaptation, contributing to the emergence of long-lasting memory and high cognitive functions.
BibTeX
@inproceedings{xie2024rectified,
  author = {Hong Xie and Kaiyuan Liu and Dong Li and Changshui Zhang and Claus C. Hilgetag and Ji‐Song Guan},
  title = {{Rectified activity-dependent population plasticity implicates cortical adaptation for memory and cognitive functions}},
  booktitle = {Communications},
  year = {2024},
  doi = {10.1038/s42003-024-07186-2},
}
Figure