Coordinated hippocampal-entorhinal replay as structural inference

Talfan Evans, Neil BurgessNeurIPS 2019 · OpenReview

Navigating a new environment presents a classic "chicken-and-egg" dilemma known in robotics as Simultaneous Localization and Mapping (SLAM). To know where you are, you need a map; to build a map, you need to know where you are.

In the brain, two types of cells handle this challenge: Grid Cells (GCs) in the entorhinal cortex provide a "metric" coordinate system (like a ruler), while Place Cells (PCs) in the hippocampus link specific sensory landmarks to those coordinates. Because path integration (tracking movement) is inherently noisy, errors accumulate over time. If the brain only learned "online" while actively moving, its internal maps would quickly become blurry and inconsistent.

This paper investigates how the brain uses "offline" periods—such as when an animal is resting or pausing—to reconcile these errors and build a stable, global representation of space. The authors propose that "neural replay," the rapid reactivation of brain cells during rest, is actually a sophisticated form of probabilistic inference used to build and correct these internal maps.

A Dual-Regime Learning Model

The authors developed a computational model consisting of two distinct regimes to handle spatial learning:

1. The Online System

While the animal is moving, the brain uses Recursive Bayesian Estimation (RBE) to update its estimated location. It continuously integrates noisy path integration with incoming sensory inputs.

The online system uses Recursive Bayesian Estimation to integrate noisy path integration (grid cells) with sensory landmark inputs (place cells).

When the animal encounters a familiar landmark but its internal "GPS" coordinates are significantly off, the system generates a Prediction Error (PE).

2. The Offline System

Triggered by high Prediction Errors, the offline system activates during rest. It uses Belief Propagation (BP)—a message-passing algorithm—to propagate corrective information through the network of place cells.

The authors propose a novel "Neural BP" mechanism to achieve this. When a place cell fires during replay, it sends a spike to its associative neighbors and simultaneously initiates a traveling wave in the metric grid cell population. If the spike and the wave arrive at a neighboring place cell simultaneously, the map is deemed consistent. If they are out of sync, the brain adjusts the synaptic weights, effectively "warping" the map to fit reality.

Key Insights and Results

By treating replay as structural inference, the model shifts the perspective from replay as merely a reward-based planning tool to a fundamental mechanism for spatial calibration. Replay is the brain's way of asking, "Based on all the landmarks I've seen, where should they actually be located on my grid?"

One-Shot Learning and Loop Closure

A major triumph of the model is its ability to solve the loop-closure problem. The offline system allows the model to correct massive mapping errors in a single "replay" event.

Offline inference corrects accumulated path integration errors, enabling one-shot loop closure on a circular track.

Whereas an online-only system would take many laps to stabilize its map of a circular track, the offline inference mechanism snaps the map into place almost immediately.

Replicating Biological Phenomena

The model's message-passing naturally produces sequences that look exactly like biological hippocampal replay. Because it uses "Max-Entropy" scheduling—where only cells whose "beliefs" have changed significantly broadcast messages—the model generates the structured, sequential firing patterns (both forward and reverse replay) observed in real rodents.

Furthermore, the model explains why grid cells are often observed to "warp" or shear near environment boundaries. These local distortions are not bugs; they are features. They occur because the brain is trying to embed a non-Euclidean "associative" experience (e.g., spending more time in certain areas or relying on sharper sensory cues at walls) into a flat "metric" space.

Limitations and Future Directions

While theoretically robust, the model assumes a pre-existing grid cell lattice (the "metric" map) and does not explain how the brain learns this hexagonal structure from scratch. Additionally, the current work focuses on static spatial structures, leaving room for future exploration into how this system handles dynamic environments where landmarks move. Finally, while the "Neural BP" mechanism is computationally elegant, further experimental work is needed to confirm if grid cells support the specific type of "traveling waves" required for this coincidence-detection learning rule.

Summary updated

Abstract

Constructing and maintaining useful representations of sensory experience is essential for reasoning about ones environment. High-level associative (topological) maps can be useful for efficient planning and are easily constructed from experience. Conversely, embedding new experiences within a metric structure allows them to be integrated with existing ones and novel associations to be implicitly inferred. Neurobiologically, the synaptic associations between hippocampal place cells and entorhinal grid cells are thought to represent associative and metric structures, respectively. Learning the place-grid cell associations can therefore be interpreted as learning a mapping between these two spaces. Here, we show how this map could be constructed by probabilistic message-passing through the hippocampal-entorhinal system, where messages are scheduled to reduce the propagation of redundant information. We propose that this offline inference corresponds to coordinated hippocampal-entorhinal replay during sharp wave ripples. Our results also suggest that the metric map will contain local distortions that reflect the inferred structure of the environment according to associative experience, explaining observed grid deformations.
BibTeX
@inproceedings{evans2019coordinated,
  author = {Talfan Evans and Neil Burgess},
  title = {{Coordinated hippocampal-entorhinal replay as structural inference}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2019},
  url = {https://openreview.net/forum?id=SxN0iGPtp1L},
}
Figure