Abstract
Understanding how the brain processes information requires more than just recording neural activity; it requires identifying the underlying computations. This paper introduces "Inferring Inference," a mathematical framework that treats neural population activity as a distributed message-passing system. By applying this framework to synthetic datasets, the authors demonstrate that it is possible to recover both the brain's internal model of the world and the specific nonlinear rules it uses to perform probabilistic inference.
Introduction
Neuroscience has entered an era of "big data," with the ability to record thousands of neurons simultaneously. However, a significant gap remains between observing neural spikes and understanding the distributed computations they perform. While theories of canonical neural circuits exist, they often focus on local interactions. In reality, neural representations are highly multiplexed—information about a single variable is spread across many neurons, and a single neuron may contribute to multiple variables.
The core challenge addressed here is: if the brain acts as a "Bayesian machine" performing inference on an internal model of the world, can we deduce that model and the specific inference algorithm (e.g., belief propagation) directly from raw neural data?
The Three-Tiered Framework
The authors propose a hierarchical approach to bridge the gap between normative theories and mechanistic implementations:
- Normative Level: The brain is assumed to maintain a Probabilistic Graphical Model (PGM) to infer latent causes from sensory inputs.
- Algorithmic Level: Inference is implemented via nonlinear message-passing on a graph. These computations are assumed to be "canonical," meaning the same mathematical rules for information updates are reused throughout the network.
- Mechanistic Level: Neural population activity is viewed as a linear or nonlinear embedding of these latent message-passing states.
Methodology: Inferring the Inference
To recover the hidden algorithms, the authors utilize a Hidden Markov Model (HMM) where the latent states represent the messages being passed within the brain. They employ a Particle Expectation-Maximization (Particle EM) algorithm:
- E-step: A particle filter (Sequential Monte Carlo) estimates the most likely trajectories of hidden messages given observed neural data.
- M-step: Gradient ascent updates the parameters of the neural encoding, the structure of the world model, and the nonlinear message-passing functions.
To address the high dimensionality and potential degeneracies in the parameter space, the authors use greedy backward optimization (pruning) to identify the most parsimonious set of rules that explain the observed data.
Key Insights and Results
The framework was validated using a "TAP Brain"—a model recurrent neural network trained to implement the Thouless-Anderson-Palmer (TAP) equations, a sophisticated form of mean-field inference.
- Algorithmic Symmetry: The reuse of the same nonlinear functions across the graph creates a statistical symmetry that makes the algorithm identifiable even in noisy data.
- Stimulus Design: Recovery is most successful within a "Goldilocks" zone of sensory input intensity. Inputs must be strong enough to reveal interactions but not so strong that the system becomes purely linear.
- Successful Recovery: The model correctly identified the number of latent variables and successfully recovered the ground-truth coupling matrix and polynomial coefficients of the message-passing function.
- Predictive Accuracy: The inferred model accurately predicted neural population responses to novel sensory stimuli, demonstrating its robustness and generalizability.
Discussion and Future Directions
While this framework provides a powerful tool for discovering distributed computations, several challenges remain. The current model assumes a static internal world model, whereas biological systems often perform temporal and causal inference. Future work will aim to scale the framework to continuous variables and higher-order interactions. The ultimate goal is to apply "Inferring Inference" to real electrophysiological data from animals, providing a direct link between functional algorithms and biological neural circuits.
Summary updated