Mesoscopic description of hippocampal replay and metastability in spiking neural networks with short-term plasticity

Bastian Pietras, Valentin Schmutz, Tilo Schwalger

TL;DR

Researchers have derived a new "bottom-up" mesoscopic model that explains how hippocampal replay—the brain's way of "replaying" memories during rest—emerges from the chaotic interaction between individual neuron spikes and synaptic fatigue. By accounting for the noise inherent in finite-sized neural networks, the model reveals a novel "fluctuation-driven" regime that better matches the high variability seen in real biological recordings compared to traditional deterministic models.

What Problem Does This Paper Address?

In neuroscience, we often see "metastability": neural populations that stay in a certain state (like a low-activity "Down" state) for a long time before suddenly jumping into another (like a high-activity "Up" state or a traveling wave of activity). A classic example is hippocampal replay, where sequences of "place cells" fire in order, effectively re-simulating a path an animal took while awake to help consolidate memories.

The challenge is modeling this. We have "microscopic" models that track every single spike of every neuron, but these are computationally expensive and hard to analyze mathematically. On the other end, we have "macroscopic" or mean-field models that describe the average behavior of millions of neurons. However, these big models often assume the network is infinitely large, which effectively "averages out" the noise. In the real brain, networks are finite, and that "noise" (stochastic spiking) isn't just a nuisance—it might be the engine driving the transitions between states. This paper aims to bridge that gap with a mesoscopic description that is simple enough to analyze but detailed enough to keep the noise.

Methods

The authors employ a rigorous bottom-up derivation starting from a microscopic network of Linear-Nonlinear Poisson (LNP) neurons equipped with Short-Term Plasticity (STP)—specifically, synaptic depression (where synapses "tire out" after heavy use).

To move from thousands of individual equations to a few population-level equations, they used:

  • Temporal Coarse-Graining: Following the "Gillespie approach" used in chemistry, they derived a Chemical Langevin Equation. This results in a stochastic neural mass model where the noise term is explicitly linked to the number of neurons ($N$) and the spiking rate.
  • Jump-Diffusion Model: For very small networks where Gaussian noise isn't enough to describe the "jumpy" nature of spikes, they developed a hybrid model that combines Poisson shot noise with Gaussian diffusion.
  • Phase-Plane Analysis: Because the resulting mesoscopic model is low-dimensional (only a few variables like average potential and synaptic state), the authors could use geometric analysis to find the "separatrix"—the tipping point where noise kicks the system from a quiet state into a replay event.

Datasets

The paper does not use external machine learning datasets. Instead, it relies on:

  • Microscopic Simulations: High-fidelity simulations of individual spiking neurons used as the "ground truth" to validate the mesoscopic model.
  • Synthetic Ring Attractor Networks: A circular environment model where place cells are arranged by their spatial preference.
  • Experimental Benchmarks: The results (such as replay event rates of ~10 per second) are compared against previously published experimental data from rodent studies.

Key Insights and Ideas

  • Noise as a Feature, Not a Bug: In the "fluctuation-driven" regime, replay events are triggered by random clusters of spikes that happen by chance in a finite network. This is fundamentally different from "fatigue-induced" models where the system must fire once synapses recover.
  • The $1/N$ Scaling: The model provides a precise mathematical link between the number of neurons ($N$) and the intensity of the fluctuations. As $N$ gets smaller, the "noise" gets louder, making state transitions more frequent.
  • Biological Realism through Variability: Traditional deterministic models produce very regular, predictable replay. The authors' stochastic model produces "jumpy," irregular trajectories with varying directions and timings. This high variability is a hallmark of real biological data and may be computationally useful for the brain to explore different memory associations.

Key Results

  • Statistical Fidelity: The mesoscopic model's power spectra and inter-spike interval (ISI) distributions matched the microscopic simulations almost perfectly, even for networks as small as $N=30$.
  • Replay Dynamics: The model successfully replicated "Sharp Wave Ripples" (SWRs) and showed that in a multi-environment setup (storing three different "maps"), the network randomly switches which map it replays, without any external bias.
  • Computational Efficiency: The Langevin equations provide a massive speedup over simulating thousands of individual spiking neurons while retaining the essential "stochastic backbone" of the network.

Limitations and Future Work

  • Lack of Refractoriness: The LNP neuron model used here is "memoryless"—it doesn't account for the brief period after a spike where a neuron cannot fire again (refractoriness). The authors note that adding this would change the noise statistics.
  • Simplified Connectivity: The current work assumes all-to-all or simple ring connectivity. Real hippocampal circuits have complex, sparse, and heterogeneous architectures.
  • Synaptic Stochasticity: While the spiking is noisy, the synaptic transmission itself is modeled deterministically. Future versions could incorporate "vesicle noise" to see if it further enhances metastability.

By providing a mathematically grounded way to "shrink" complex neural models without losing the vital spark of noise, this work offers a powerful new tool for researchers studying how the brain thinks, rests, and remembers.

Summary updated

Abstract

Bottom-up models of functionally relevant patterns of neural activity provide an explicit link between neuronal dynamics and computation. A prime example of functional activity pattern is hippocampal replay, which is critical for memory consolidation. The switchings between replay events and a low-activity state in neural recordings suggests metastable neural circuit dynamics. As metastability has been attributed to noise and/or slow fatigue mechanisms, we propose a concise mesoscopic model which accounts for both. Crucially, our model is bottom-up: it is analytically derived from the dynamics of finite-size networks of Linear-Nonlinear Poisson neurons with short-term synaptic depression. As such, noise is explicitly linked to spike noise and network size, and fatigue is explicitly linked to synaptic dynamics. To derive the mesosocpic model, we first consider a homogeneous spiking neural network and follow the temporal coarse-graining approach of Gillespie ("chemical Langevin equation"), which can be naturally interpreted as a stochastic neural mass model. The Langevin equation is computationally inexpensive to simulate and enables a thorough study of metastable dynamics in classical setups (population spikes and Up-Down states dynamics) by means of phase-plane analysis. This stochastic neural mass model is the basic component of our mesoscopic model for replay. We show that our model faithfully captures the stochastic nature of individual replayed trajectories. Moreover, compared to the deterministic Romani-Tsodyks model of place cell dynamics, it exhibits a higher level of variability in terms of content, direction and timing of replay events, compatible with biological evidence and could be functionally desirable. This variability is the product of a new dynamical regime where metastability emerges from a complex interplay between finite-size fluctuations and local fatigue.
BibTeX
@article{pietras2022mesoscopic,
  author = {Bastian Pietras and Valentin Schmutz and Tilo Schwalger},
  title = {{Mesoscopic description of hippocampal replay and metastability in spiking neural networks with short-term plasticity}},
  journal = {PLOS Computational Biology},
  year = {2022},
  doi = {10.1371/journal.pcbi.1010809},
}

Loading related content...

Figure