Dynamical latent state computation in the male macaque posterior parietal cortex

Kaushik J. Lakshminarasimhan, Eric Avila, Xaq Pitkow, Dora E. AngelakiNature Communications 2023 · DOI

This study, published in Nature Communications, explores how the brain tracks variables that aren't directly visible—what researchers call "latent states." By recording from the posterior parietal cortex (PPC) of macaques navigating a virtual environment, the authors demonstrate that neural populations don't just relay sensory info; they use recurrent interactions to build a dynamic "world model" that computes these hidden variables in real-time.

TL;DR

Researchers discovered that the posterior parietal cortex (PPC) uses complex, recurrent neural interactions to track "hidden" variables—like distance to an invisible goal—during navigation. These internal computations are so precise that they can predict a subject's behavioral errors on a trial-by-trial basis, revealing how the brain maintains a "mental map" of things it can no longer see.

What Problem Does This Paper Address?

Most neuroscience research focuses on how the brain processes immediate sensory inputs (like seeing a flash) or generates motor outputs (like moving a hand). However, real-world survival often depends on tracking latent states: variables that are continuous, time-varying, and not directly observable.

Imagine driving: you know where the car in your blind spot is even though you can't see it. You are updating its "latent" position based on your memory of its speed and your own movement. Until now, we haven't clearly understood how the brain represents these "thoughts" or the specific neural mechanisms used to compute them. This paper aims to bridge that gap by looking at how the PPC—a known hub for sensorimotor integration—handles these hidden variables.

Methods

The researchers trained three male rhesus macaques to perform a navigation task in a 3D virtual reality (VR) environment.

  • The Task: Monkeys used a joystick to steer toward a target. The catch? The target blinks on briefly and then disappears. To succeed, the monkey must navigate to the hidden location using only "optic flow" (the movement of ground-plane elements) to estimate its own velocity and position.
  • Neural Recording: They used chronically implanted multi-electrode arrays (Utah arrays) to record from Area 7a of the PPC.
  • Modeling: The team employed Generalized Additive Models (GAMs) to disentangle how much each neuron was "tuned" to sensory (velocity), motor (joystick movement), or latent (distance to goal) variables.
  • RNN Comparison: They trained a Recurrent Neural Network (RNN) to perform the same task to see if an artificial system optimized for the same goal would develop similar neural dynamics.

Datasets

  • Neural Data: 1,612 units recorded across 32 sessions from three monkeys (B, S, and Q).
  • Behavioral Data: A massive dataset of 121,930 trials.
  • Manipulations: The researchers created "perturbation" datasets where they changed the joystick gain (motor), optic flow density (sensory), or "teleported" the monkey mid-trial (latent) to see how the neural representation adapted.

Key Insights and Ideas

  • The PPC as a "State Estimator": The PPC isn't just a pass-through for sensory data. It acts like a Kalman filter or state estimator, integrating sensory history to maintain a belief about the world.
  • Recurrent Coupling is Key: The study found that the activity of a single neuron was better predicted by the activity of its neighbors (recurrent coupling) than by external sensory inputs alone. This suggests the "computation" happens within the local network's interactions.
  • Sequential Dynamics: Instead of "persistent activity" (neurons firing continuously to remember something), the PPC showed sequential activity. Different neurons fired at different stages of the journey, effectively "ticking off" the distance to the goal.
  • Plasticity of the World Model: When the researchers manipulated the "rules" of the VR world (e.g., changing how fast the joystick moved the monkey), the neural representation of the latent state changed significantly, while sensory and motor representations stayed stable. This suggests the PPC specifically updates its "internal model" to maintain performance.

Key Results

  • Decoding Thoughts: The researchers could decode the monkey's distance to the hidden goal from population activity with high accuracy (Pearson’s $r \approx 0.66$).
  • Predicting Errors: Decoding was so sensitive that if the neural "estimate" of the goal was short, the monkey actually stopped short. The decoded estimates predicted undershooting/overshooting with 69% accuracy.
  • Coupling Strength: Recurrent interactions accounted for a massive portion of neural variance—the "coupled" model was significantly better at predicting spikes than an "uncoupled" model that only looked at task variables.
  • RNN Alignment: The task-optimized RNN developed sequential dynamics and mixed selectivity almost identical to the biological neurons, suggesting these patterns are the "optimal" way to solve the latent state tracking problem.

Limitations and Future Work

  • Autonomous Strategies: The authors acknowledge they didn't fully explore "autonomous" strategies—where a monkey might plan a whole movement sequence in advance rather than using continuous feedback.
  • Brain-Wide Networks: While the PPC is a hub, it doesn't work alone. Future research needs to investigate how the PPC interacts with the hippocampus (for spatial maps) and the prefrontal cortex (for high-level planning).
  • Representational Drift: The study doesn't address how these neural "maps" might change or drift over weeks or months, which is a hot topic in systems neuroscience.

Reference: Lakshminarasimhan, K.J., Avila, E., Pitkow, X. & Angelaki, D.E. Dynamical latent state computation in the male macaque posterior parietal cortex. Nat Commun 14, 1832 (2023). https://doi.org/10.1038/s41467-023-37400-4

Summary updated

Abstract

Success in many real-world tasks depends on our ability to dynamically track hidden states of the world. We hypothesized that neural populations estimate these states by processing sensory history through recurrent interactions which reflect the internal model of the world. To test this, we recorded brain activity in posterior parietal cortex (PPC) of monkeys navigating by optic flow to a hidden target location within a virtual environment, without explicit position cues. In addition to sequential neural dynamics and strong interneuronal interactions, we found that the hidden state - monkey's displacement from the goal - was encoded in single neurons, and could be dynamically decoded from population activity. The decoded estimates predicted navigation performance on individual trials. Task manipulations that perturbed the world model induced substantial changes in neural interactions, and modified the neural representation of the hidden state, while representations of sensory and motor variables remained stable. The findings were recapitulated by a task-optimized recurrent neural network model, suggesting that task demands shape the neural interactions in PPC, leading them to embody a world model that consolidates information and tracks task-relevant hidden states.
BibTeX
@inproceedings{lakshminarasimhan2023dynamical,
  author = {Kaushik J. Lakshminarasimhan and Eric Avila and Xaq Pitkow and Dora E. Angelaki},
  title = {{Dynamical latent state computation in the male macaque posterior parietal cortex}},
  booktitle = {Nature Communications},
  year = {2023},
  doi = {10.1038/s41467-023-37400-4},
}
Figure