Remembering the “when”: Hebbian memory models for the time of past events

Johanni Brea, Alireza Modirshanechi, Georgios Iatropoulos, Wulfram GerstnerbioRxiv 2022 · DOI

TL;DR

This paper explores how the brain might remember when past events occurred, a crucial but poorly understood aspect of episodic memory. The authors propose a framework of biologically plausible neural models, leveraging Hebbian plasticity and various coding schemes, to explain how animals and humans can recall the temporal context of memories over long durations. They also suggest novel experiments to distinguish between these proposed mechanisms.

What Problem Does This Paper Address?

We humans (and many animals) have a remarkable ability to recall not just what happened and where, but also when it happened, even for events long past. While we understand interval timing (seconds to minutes) reasonably well, the neural mechanisms behind remembering the "when" for longer durations – days, weeks, or even years – remain largely a mystery. This gap is particularly evident in the context of episodic memory, where the temporal context is a key component. The authors aim to bridge this gap by proposing and evaluating a range of theoretical models that could implement this "when" memory.

Methods

The paper takes a systematic, theoretical approach, exploring the "space of possible mechanisms" for temporal memory. They break down the problem into several key components:

  • Encoding: How sensory information (content, location, time) is represented in neural activity (e.g., rate codes, one-hot codes, distributed codes, population rate codes).
  • Time Representation: Distinguishing between "timestamp" (fixed reference point) and "age" (relative to current time) representations.
  • Association: How content and temporal information are linked (e.g., concatenation, product codes).
  • Storage & Retrieval: Mechanisms for storing memories (e.g., Hebbian plasticity) and retrieving them, including how storage and retrieval phases can be separated (e.g., synaptic delays, mode switching).
  • Readout: How retrieved memories are translated into behavioral outputs.

They then combine these components to propose various computational models. Key to their approach is the reliance on Hebbian plasticity for memory formation and the exploration of synaptic pruning and systems consolidation as mechanisms for temporal tracking over long timescales. They also introduce novel, non-verbal experimental paradigms designed to differentiate between their proposed model classes.

Datasets

Not discussed in the paper. The paper focuses on theoretical modeling and simulations, rather than training on existing datasets.

Key Insights and Ideas

  • "When" memory is not a single mechanism: The paper highlights that remembering the "when" can be achieved through a variety of biologically plausible mechanisms, suggesting that different species or even different memory systems within a species might employ different strategies.
  • Age vs. Timestamp: The distinction between representing time as a fixed timestamp versus a dynamic "age" is crucial and has significant implications for how memories are recalled and generalized. Age-based representations are more dynamic and potentially more aligned with how we intuitively recall events relative to the present.
  • Synaptic Plasticity is Key for Long Durations: For memories lasting days or longer, persistent neural activity is unlikely. Instead, the models rely on long-term changes in synaptic connections (Hebbian plasticity) and potentially ongoing synaptic restructuring (pruning, consolidation) to encode temporal information.
  • Experimental Design is Crucial: The authors emphasize that purely behavioral experiments might not be sufficient to distinguish between all proposed models. They advocate for experiments that can probe neural activity or manipulate temporal cues to gain deeper insights.

Key Results

The paper presents simulations demonstrating that their proposed models can successfully learn to perform tasks that require remembering the "when" of past events.

  • Food Caching Simulation: A simulation of food-caching animals (like corvids) showed that models could learn to retrieve cached items based on their age, outperforming baseline policies and approaching optimal performance. For instance, the "Age-Organization" and "Random-Pruning" models learned to distinguish between food items that degrade at different rates.
  • Generalization Experiments: Simulations showed that models with distributed representations (like "Poprate-Age-Tagging" and "Random-Pruning") exhibit better generalization to novel stimuli or slightly different temporal intervals compared to models with one-hot coded age representations ("Age-Organization").
  • Task Learnability: The models were tested on tasks requiring age-dependent actions, including XOR-like problems that are challenging for simple linear readouts. Models like "Age-Organization" and "Random-Pruning" demonstrated the ability to learn these complex rules, with "Age-Organization" often showing faster learning due to its one-hot encoding.

Limitations and Future Work

  • Idealized Models: The authors acknowledge that their models are simplified "toy" models, and real biological systems are far more complex.
  • Experimental Validation Needed: While simulations are promising, direct experimental validation is needed to pinpoint the exact neural implementations in different species. The paper proposes specific experiments to facilitate this.
  • Spatio-Temporal Codes: The current models primarily use spatial codes (activity patterns at a given time). Future work could explore spatio-temporal codes, where information is encoded in the temporal evolution of neural activity, further expanding the model space.
  • More Complex Associations: While concatenation and product codes are explored, other non-linear mixed association schemes could also be investigated.
  • Neural Recordings: The authors suggest that detailed neural and synaptic recordings will be essential to identify the precise mechanisms at play.

Summary updated

Abstract

Abstract Humans and animals can remember how long ago specific events happened. Little is known about the neural mechanisms that enable remembering the “when” of memories stored for long durations in the episodic memory system – in contrast to interval-timing on the order of seconds and minutes. Based on a systematic exploration of neural coding, association and retrieval schemes, we develop model classes that span the space of possible mechanisms for the reconstruction of the time of past events. In concrete examples we show how network architecture, Hebbian plasticity, synaptic pruning or systems consolidation allow the retrieval of the time of past events. In a simulation, we demonstrate how these mechanisms would enable food caching animals like corvids to remember what they cached, where, and how long ago. To dissociate different hypotheses, we propose three kinds of novel, non-verbal experiments, that can be run with humans and animals. Our simulations predict the experimental results for different classes of models. Our study shows that remembering the “when” can be implemented by many biologically plausible mechanisms and that carefully designed experiments are needed to pin down the actual neural implementation of the memory for the time of past events in different species. Author summary Was it yesterday, a week ago, or perhaps even longer since I last ate pizza? Questions like these are typically easy to answer, because humans have a good sense of how long ago specific events happened. Research involving animals, such as food-caching birds, has revealed that they, too, can remember the “when” of past events. So far, little is known about the neuronal mechanisms that enable remembering the “when”. In this study, we explore systematically concrete hypotheses of how neural circuits, synaptic plasticity and ongoing restructuring of neural circuits allow remembering the “when”. We propose experiments, that could be done with humans or animals, to discriminate different biologically plausible mechanisms for remembering the “when”.
BibTeX
@misc{brea2022remembering,
  author = {Johanni Brea and Alireza Modirshanechi and Georgios Iatropoulos and Wulfram Gerstner},
  title = {{Remembering the “when”: Hebbian memory models for the time of past events}},
  year = {2022},
  doi = {10.1101/2022.11.28.518209},
  howpublished = {bioRxiv},
}
Figure