Dynamic stability of sequential stimulus representations in adapting neuronal networks

Renato Carlos Farinha Duarte, Abigail MorrisonFrontiers Comput. Neurosci 2014 · DOI · OpenReview

Introduction

Neocortical circuits are constantly bombarded by streams of sensory information. To process these sequences effectively, the network must maintain a delicate "ground state" known as the Asynchronous Irregular (AI) regime—a state where neurons fire at low frequencies and in an uncoordinated fashion, much like what is observed in vivo.

The challenge is that incoming stimuli act as perturbations that disrupt the local balance of excitation and inhibition (E/I balance). Without a way to adapt, a network can easily tip into Synchronous Regular (SR) activity. In this state, neurons fire in lockstep, which effectively "collapses" the network's representational space, making it nearly impossible to distinguish between different inputs. This research investigates how specific types of synaptic plasticity allow networks to self-organize and maintain dynamic stability even when faced with disruptive sequential inputs.

Methods and Stimulus Protocol

The researchers employed a computational modeling approach using the NEST simulator. The network architecture consisted of a "reservoir" of 10,000 leaky integrate-and-fire (LIF) neurons (80% excitatory, 20% inhibitory) with sparse, random connectivity.

Figure 5: Stimulus protocol and network architecture. (A) Symbolic sequence input mapped to time steps. (B) Afferent spike trains for different stimuli (A, B, C). (C) Schematic of the recurrent network with excitatory (triangles) and inhibitory (circles) neurons.

The study compared static networks against those utilizing two types of Spike-Timing-Dependent Plasticity (STDP):

  • Excitatory STDP (eSTDP): A hybrid rule that adjusts connections between excitatory neurons.
  • Inhibitory STDP (iSTDP): A homeostatic rule (based on Vogels et al., 2011) that adjusts inhibitory-to-excitatory connections to maintain a target firing rate.

Stimuli were delivered as "thalamic-like" bursts of spikes to specific sub-populations in sequences. These abstract symbolic sequences (e.g., A-B-C-B-A) were converted into time-varying Poisson spike trains. The researchers varied the number of unique stimuli ($k$) and the number of afferent neurons to test the limits of the network's discriminative power.

Key Insights: The Role of Inhibitory Plasticity

A central finding of the study is that inhibitory plasticity (iSTDP) is the primary driver of network stability. While excitatory plasticity (eSTDP) is often the focus of learning studies, it played a marginal role in maintaining the network's "ground state." iSTDP performs the "heavy lifting" of decorrelation, keeping the network in the flexible AI regime.

The authors hypothesize that plasticity creates spontaneously generated "saddle nodes" in the network's state space. These act as temporary anchors that pull neural trajectories toward reproducible paths, making the representation of a sequence robust to noise. Conversely, "pathological" synchrony leads to a collapse in computational capacity; when neurons fire together, the "rank" of the network's response matrix drops, and the network loses the ability to represent distinct input features.

Results

  • Robustness and Classification: Plastic networks maintained the AI regime over a much broader range of input parameters compared to static networks. In intermediate stimulus regimes, plastic networks achieved near-perfect classification of sequences, whereas static networks often failed due to induced synchrony.
  • Dimensionality and Trajectories: PCA analysis showed that plastic networks utilize a higher-dimensional state space. In static networks, the first principal component often accounted for 50% of the variance, indicating high redundancy. In plastic networks, variance was spread more evenly across many dimensions. Furthermore, neural trajectories for the same stimulus converged much more reliably over time (within ~150ms) in plastic networks, indicating increased reproducibility of the neural code.

Limitations and Future Directions

The study noted a "Strong Stimuli Paradox": extremely strong stimuli can cause plastic networks to perform worse than static ones because iSTDP becomes so aggressive in counteracting excitation that it effectively silences the network. Additionally, the inter-stimulus intervals used (100ms) were longer than the standard STDP window (20ms), suggesting eSTDP might play a larger role with more rapid stimulus presentation. Future work could also explore how complex dendritic processing, absent in LIF neurons, interacts with these global stability mechanisms.

Summary updated

Abstract

p>The ability to acquire and maintain appropriate representations of time-varying, sequential stimulus events is a fundamental feature of neocortical circuits and a necessary first step toward more specialized information processing. The dynamical properties of such representations depend on the current state of the circuit, which is determined primarily by the ongoing, internally generated activity, setting the ground state from which input-specific transformations emerge. Here, we begin by demonstrating that timing-dependent synaptic plasticity mechanisms have an important role to play in the active maintenance of an ongoing dynamics characterized by asynchronous and irregular firing, closely resembling cortical activity <italic>in vivo</italic>. Incoming stimuli, acting as perturbations of the local balance of excitation and inhibition, require fast adaptive responses to prevent the development of unstable activity regimes, such as those characterized by a high degree of population-wide synchrony. We establish a link between such pathological network activity, which is circumvented by the action of plasticity, and a reduced computational capacity. Additionally, we demonstrate that the action of plasticity shapes and stabilizes the transient network states exhibited in the presence of sequentially presented stimulus events, allowing the development of adequate and discernible stimulus representations. The main feature responsible for the increased discriminability of stimulus-driven population responses in plastic networks is shown to be the decorrelating action of inhibitory plasticity and the consequent maintenance of the asynchronous irregular dynamic regime both for ongoing activity and stimulus-driven responses, whereas excitatory plasticity is shown to play only a marginal role.</p>
BibTeX
@article{duarte2014dynamic,
  author = {Renato Carlos Farinha Duarte and Abigail Morrison},
  title = {{Dynamic stability of sequential stimulus representations in adapting neuronal networks}},
  journal = {Frontiers Comput. Neurosci.},
  year = {2014},
  doi = {10.3389/fncom.2014.00124},
}
Figure