No Free Lunch from Deep Learning in Neuroscience: A Case Study through Models of the Entorhinal-Hippocampal Circuit

Rylan Schaeffer, Mikail Khona, Ila Fiete

TL;DR

Deep learning models are increasingly used to understand brain circuits, with the promise of revealing the brain's optimization principles. However, this paper demonstrates that for grid cells in the entorhinal-hippocampal circuit, grid-like representations don't naturally emerge from path integration tasks. Instead, they arise from specific, often biologically unrealistic, implementation choices, suggesting a "no free lunch" principle for deep learning in neuroscience.

What Problem Does This Paper Address?

The field of neuroscience is increasingly leveraging deep learning (DL) not just as a tool for data analysis, but as a means to model brain circuits and uncover the fundamental optimization principles driving neural computation. A key claim is that if DL models trained on specific tasks can replicate observed neural phenomena, they reveal what the brain is optimizing. This paper questions this assumption by examining DL models of grid cells, a well-studied neural population in the entorhinal cortex crucial for spatial navigation. Previous work suggested that training DL networks on path integration (estimating position from self-motion cues) naturally leads to the emergence of grid cell-like activity. This paper investigates whether this emergence is a genuine insight into brain function or a byproduct of specific modeling choices.

Methods

The authors employed a systematic approach to investigate the emergence of grid cells in deep neural networks trained on path integration. They utilized publicly available code from prior studies and conducted large-scale hyperparameter sweeps. This involved varying network architectures (RNNs, LSTMs, GRUs), activation functions, optimizers, and crucially, different supervised target encodings for position. They also performed theory-driven experimentation, informed by first-principles models of grid cells. To assess grid cell properties, they used the "grid score" metric, which quantifies the hexagonal periodicity of a neuron's firing pattern.

Datasets

Not explicitly detailed as separate datasets. The "data" used for training and evaluation consists of simulated spatial trajectories within a 2.2m x 2.2m arena, generated by sampling sequences of positions and velocities.

Key Insights and Ideas

  • Grid cells are not an automatic byproduct of path integration: Contrary to some prior claims, training networks on path integration alone does not reliably produce grid-like representations.
  • The "magic" is in the readout encoding: The emergence of grid cells is highly sensitive to the specific way the network's output is designed to represent the target position (the "supervised target encoding"). Certain encodings, particularly "Difference-of-Softmaxes" (DoS), are far more likely to yield grid cells than others, even if they are less biologically plausible.
  • "Baking in" the solution: The specific choices made in the readout encoding and other hyperparameters are not fundamental truths about brain optimization but rather implementation details that effectively "bake in" grid-like properties. This makes the findings more "post hoc" (explaining existing knowledge) than predictive.
  • Fragility of grid solutions: The grid-like representations that do emerge are often fragile, disappearing with small alterations to hyperparameters.
  • Multiple modules don't emerge: A key characteristic of biological grid cells is the presence of multiple modules with different spatial scales. The DL models studied here typically only produce a single grid module.
  • No Free Lunch for Neuroscience: The paper argues for an informal "no free lunch" principle, suggesting that DL models of the brain will likely require explicit incorporation of biological inductive biases and constraints to yield truly predictive and insightful models, rather than relying solely on task optimization.

Key Results

  • Over 5500 networks were trained, with most successfully learning to path integrate (achieving low position decoding error).
  • However, only a very small fraction of these networks displayed grid-like representations, even with lenient grid score thresholds.
  • Grid cell emergence was almost exclusively observed when using a specific "Difference-of-Softmaxes" (DoS) readout encoding, while Cartesian, Polar, or Gaussian encodings failed to produce grid cells.
  • The period of the grid cells that did emerge was determined by hyperparameters of the DoS readout, not by the path integration task itself.
  • When more biologically realistic readout functions (e.g., multiple fields, multiple scales mimicking place cells) were used, grid cells did not emerge, even though position encoding remained accurate.

Limitations and Future Work

  • Limitations: The paper highlights that the emergence of grid cells in previous DL models was heavily dependent on specific, and often unstated, implementation choices, particularly the readout encoding. This suggests that these models are not discovering fundamental principles but rather reflecting programmer choices. The fragility of these solutions and the lack of multiple grid modules also point to limitations.
  • Future Work: The authors suggest that future DL models of the brain should incorporate biological inductive biases and constraints, such as non-negative activations, equivariant population responses, and high representational capacity, to move beyond post hoc explanations and achieve more robust, de novo predictions. They propose that understanding the conditions and constraints under which specific neural tuning emerges is more scientifically valuable than simply reproducing the tuning itself.

Summary updated

Abstract

Abstract Research in Neuroscience, as in many scientific disciplines, is undergoing a renaissance based on deep learning. Unique to Neuroscience, deep learning models can be used not only as a tool but interpreted as models of the brain. The central claims of recent deep learning-based models of brain circuits are that they make novel predictions about neural phenomena or shed light on the fundamental functions being optimized. We show, through the case-study of grid cells in the entorhinal-hippocampal circuit, that one may get neither. We begin by reviewing the principles of grid cell mechanism and function obtained from first-principles modeling efforts, then rigorously examine the claims of deep learning models of grid cells. Using large-scale architectural and hyperparameter sweeps and theory-driven experimentation, we demonstrate that the results of such models may be more strongly driven by particular, non-fundamental, and post-hoc implementation choices than fundamental truths about neural circuits or the loss function(s) they might optimize. We discuss why these models cannot be expected to produce accurate models of the brain without the addition of substantial amounts of inductive bias, an informal No Free Lunch result for Neuroscience. Based on first principles work, we provide hypotheses for what additional loss functions will produce grid cells more robustly. In conclusion, circumspection and transparency, together with biological knowledge, are warranted in building and interpreting deep learning models in Neuroscience.
BibTeX
@inproceedings{schaeffer2022no,
  author = {Rylan Schaeffer and Mikail Khona and Ila Fiete},
  title = {{No Free Lunch from Deep Learning in Neuroscience: A Case Study through Models of the Entorhinal-Hippocampal Circuit}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2022},
  url = {https://openreview.net/forum?id=o6Yq_mxY1oT},
}

Loading related content...

Figure