A functional spiking-neuron model of activity-silent working memory in humans based on calcium-mediated short-term synaptic plasticity

Matthijs Pals, Terrence C. Stewart, Elkan G. Akyürek, Jelmer P. Borst

This research presents a significant advancement in our understanding of how the human brain maintains information over short periods. By constructing a functional, large-scale spiking-neuron model, researchers have demonstrated that working memory (WM) does not rely solely on continuous neural firing; instead, information can be stored "silently" within the transient changes of synaptic connections.

TL;DR

Researchers developed a spiking-neuron model that maintains working memory through "activity-silent" synaptic changes rather than constant neural firing. The model successfully replicates human behavioral performance and EEG patterns across multiple complex memory tasks, proving that short-term synaptic plasticity is a plausible mechanism for human working memory.

The Challenge: Moving Beyond Persistent Activity

For decades, the dominant theory in neuroscience suggested that working memory—the ability to hold a phone number or a location in mind for a few seconds—required neurons to fire continuously, a phenomenon known as persistent activity. However, recent empirical studies have identified "silent" periods where information is clearly maintained despite neural firing dropping to baseline levels.

The primary gap in the field was the lack of a functional model. While theoretical frameworks for activity-silent memory existed, they rarely "performed" tasks or made decisions in the way a human participant would. This paper addresses that gap by creating a model that processes visual input, maintains it silently, and subsequently uses that stored information to perform comparisons and reach decisions.

Methods and Model Architecture

The authors developed their model using Nengo, a framework based on the Neural Engineering Framework (NEF). The core of the model consists of a population of Leaky Integrate-and-Fire (LIF) neurons integrated with a specific biological mechanism: Calcium-mediated Short-Term Synaptic Plasticity (STSP).

In this mechanism, when a neuron fires, calcium ions flow into the presynaptic terminal. This calcium acts as a "synaptic trace," temporarily strengthening the connection (facilitation) for approximately 1.5 seconds. To ensure the model was functional, the researchers added several key components:

  • Visual Processing: The model uses Gabor filters and Singular Value Decomposition (SVD) to compress visual images into 24-dimensional vectors.
  • Decision Mechanism: Inspired by "template matching," the memory population acts as a match-filter. When a new probe appears, the model compares the incoming signal with the existing "synaptic trace" to determine the probe's orientation (e.g., clockwise or counter-clockwise relative to the memory item).
Experimental timeline showing the sequence of memory items, cue, impulse, and probe.

Simulating Human Experiments

The model was evaluated by simulating three experimental datasets originally collected from human participants by Wolff et al. (2017). These tasks involve maintaining visual gratings in memory and comparing them to subsequent probes.

  1. Retro-cue Task: One of two items is selected for maintenance based on a cue.
  2. Sequential Task: Two items are maintained and tested sequentially.
  3. Impulse Task: Investigates the impact of "impulse" stimuli—visual pings used to reveal hidden memory states—and the timing of these events.

Key Insights

  • Passive Forgetting: A notable finding is that the model "forgets" an uncued item simply through natural calcium decay. There is no requirement for an active "clearing" mechanism; if a memory is not refreshed by a cue, the chemical trace fades on its own.
  • The "Impulse" Effect: The study validates the "pinging" method used in EEG research. Much like a sonar pulse reveals an underwater object, a task-irrelevant visual "impulse" can reactivate facilitated synapses, causing the model to fire in a pattern that reveals the silently held information.
  • Decision-Making via Hysteresis: The model reaches decisions through a dynamic shift. When a probe is presented, the representation in the memory population "drifts" from the stored item toward the probe. The direction and magnitude of this drift provide the necessary information for the model to make a choice.

Results and Validation

  • Behavioral Alignment: The model’s proportion of clockwise vs. counter-clockwise responses followed the characteristic "S-curve" observed in human behavioral data.
  • Neural Representation: The model successfully replicated the "dip and return" of decoding accuracy seen in human EEG. Information became undecodable during the silent delay but reappeared when triggered by either an impulse or a probe.
  • Robustness: Parameter exploration revealed that the model is robust across various time constants, provided the calcium decay rate ($t_F$) is at least one second, which aligns with biological observations in the prefrontal cortex.

Limitations and Future Directions

The authors note that while their model is "fully silent" during the delay, human brains often exhibit low-level "focus of attention" activity. They suggest that a hybrid model—combining activity-silent STSP with some persistent firing—might provide an even more realistic representation of human cognition.

Furthermore, the current model utilizes static coding, where the same neurons represent the same information over time. Future research will explore dynamic coding, where neural representations evolve, and investigate how the model scales to handle more than two items, further testing the limits of simulated cognitive capacity.

Summary updated

Abstract

Abstract In this paper, we present a functional spiking-neuron model of human working memory (WM). This model combines neural firing for encoding of information with activity-silent maintenance. While it used to be widely assumed that information in WM is maintained through persistent recurrent activity, recent studies have shown that information can be maintained without persistent firing; instead, information can be stored in activity-silent states. A candidate mechanism underlying this type of storage is short-term synaptic plasticity (STSP), by which the strength of connections between neurons rapidly changes to encode new information. To demonstrate that STSP can lead to functional behavior, we integrated STSP by means of calcium-mediated synaptic facilitation in a large-scale spiking-neuron model and added a decision mechanism. The model was used to simulate a recent study that measured behavior and EEG activity of participants in three delayed-response tasks. In these tasks, one or two visual gratings had to be maintained in WM, and compared to subsequent probes. The original study demonstrated that WM contents and its priority status could be decoded from neural activity elicited by a task-irrelevant stimulus displayed during the activity-silent maintenance period. In support of our model, we show that it can perform these tasks, and that both its behavior as well as its neural representations are in agreement with the human data. We conclude that information in WM can be effectively maintained in activity-silent states by means of calcium-mediated STSP. Author Summary Mentally maintaining information for short periods of time in working memory is crucial for human adaptive behavior. It was recently shown that the human brain does not only store information through neural firing – as was widely believed – but also maintains information in activity-silent states. Here, we present a detailed neural model of how this could happen in our brain through short-term synaptic plasticity: rapidly adapting the connection strengths between neurons in response to incoming information. By reactivating the adapted network, the stored information can be read out later. We show that our model can perform three working memory tasks as accurately as human participants can, while using similar mental representations. We conclude that our model is a plausible and effective neural implementation of human working memory.
BibTeX
@article{pals2020functional,
  author = {Matthijs Pals and Terrence C. Stewart and Elkan G. Akyürek and Jelmer P. Borst},
  title = {{A functional spiking-neuron model of activity-silent working memory in humans based on calcium-mediated short-term synaptic plasticity}},
  journal = {PLOS Computational Biology},
  year = {2020},
  doi = {10.1371/journal.pcbi.1007936},
}
Figure