A Grid Cell-Inspired Structured Vector Algebra for Cognitive Maps

Sven Krausse, Emre Neftci, Friedrich T. Sommer, Alpha Renner

Introduction

In neuroscience, "grid cells" in the entorhinal cortex act as the brain’s internal GPS, firing in hexagonal patterns to track location. In computer science, Vector Symbolic Architectures (VSAs) represent complex data structures using high-dimensional vectors. Historically, these two fields have remained separate: spatial models struggle with logic, and logic models lack biological spatial patterns. This paper introduces GC-VSA (Grid-Cell Vector Symbolic Architecture), a framework that bridges this gap, enabling a single algebra to handle both physical coordinates and abstract reasoning.

The GC-VSA Framework

GC-VSA is a variant of Fourier Holographic Reduced Representations (FHRR) that organizes data into 5D tensors. These tensors consist of multiple 3D "modules"—cubes of neurons—that vary in scale and orientation, mimicking the modular organization of the medial entorhinal cortex.

The GC-VSA framework organizes high-dimensional vectors into 3D modules that vary by scale and orientation, enabling complex algebraic operations like binding.

Key algebraic operations include:

  • Bundling ($\oplus$): Element-wise addition to represent sets of objects.
  • Binding ($\odot$): Circular convolution to combine features or shift positions.
  • Rotation ($\otimes$): A novel operation that permutes activity across modules to rotate spatial representations around a center point.
  • Fractional Power Encoding (FPE): Allows for the representation of continuous coordinates rather than discrete grid steps.

Biological Emergence and Efficiency

A significant finding of this research is that hexagonal firing patterns are not hard-coded; they emerge naturally from the 3D block-code structure and the way the binding operation shifts phases. This provides a missing link between abstract VSA math and biological observations, reconciling competing theories of grid cells by showing that VSA math can implement the mechanics of a Continuous Attractor Network (CAN).

Furthermore, because neurons in this 3D structure activate only at specific grid points, the model is highly sparse and energy-efficient. This makes it a prime candidate for implementation on neuromorphic hardware, which mimics brain structure to achieve low-power computation.

Experimental Performance

The authors validated GC-VSA through several synthetic experiments, demonstrating its versatility in both spatial and symbolic tasks.

Experimental results demonstrating high-precision path integration (a) and successful retrieval of objects from complex spatio-temporal scenes (b, c).
  • Path Integration: The model tracked random trajectories over 100 steps with a Mean Squared Error (MSE) of just 0.17 pixels, showing high spatial precision.
  • Scene Querying: Using a "resonator network," the model successfully retrieved object identities, locations, or time points from complex spatio-temporal scenes in under 25 iterations.
  • Analogical Reasoning: The model successfully solved logic puzzles, such as identifying analogs in family trees (e.g., "Who is the Charles of your family?"), by computing mapping vectors based purely on the structural relationships encoded in the vectors.

Conclusion and Future Directions

GC-VSA currently serves as a powerful working memory system, though it does not yet incorporate long-term synaptic learning to learn new environments from scratch. Future work aims to integrate this framework into Transformer architectures—similar to the Rotary Positional Embeddings used in models like Llama—to improve how AI handles spatial data. Additionally, the authors plan to deploy the model on spiking neuromorphic hardware to further demonstrate its efficiency in real-world cognitive mapping tasks.

Summary updated

BibTeX
@inproceedings{krausse2025grid,
  author = {Sven Krausse and Emre Neftci and Friedrich T. Sommer and Alpha Renner},
  title = {{A Grid Cell-Inspired Structured Vector Algebra for Cognitive Maps}},
  booktitle = {NICE},
  year = {2025},
  doi = {10.1109/nice65350.2025.11065704},
}
Figure