Neurocomputational mechanisms involved in adaptation to fluctuating intentions of others

Rémi Philippe, Rémi Janet, Koosha Khalvati, Rajesh P. N. Rao, Daeyeol Lee, Jean‐Claude DreherNature Communications 2024 · DOI

This study, recently published in Nature Communications, explores the neurocomputational architecture that allows humans to navigate social partners who shift between being allies and adversaries. By combining game theory, computational modeling, and fMRI, the researchers identified a "mixture of experts" mechanism in the brain that arbitrates between cooperative and competitive strategies based on their real-time reliability.

TL;DR

The human brain adapts to fluctuating social intentions by running parallel "experts"—one for cooperation and one for competition—and using a controller in the prefrontal cortex and ventral striatum to decide which expert to trust. This arbitration mechanism explains behavioral shifts more accurately than standard learning models and reveals that the brain recruits distinct neural networks to handle the increased complexity of competitive interactions.

What Problem Does This Paper Address?

Social interaction is rarely static. A colleague might cooperate on a project today but compete for a promotion tomorrow. Most neuroscientific studies of social behavior focus on "pure" contexts—either purely cooperative or purely competitive. However, in the real world, intentions are often volatile and unsignaled.

Standard reinforcement learning (RL) models, which update values incrementally based on rewards, struggle with these abrupt shifts. The "gap" addressed here is how the brain detects and adapts to these hidden changes in a partner's intent. Does the brain use one general-purpose social learner, or does it switch between specialized internal models?

Methods

The researchers used a model-based fMRI approach:

  1. The Task: 31 participants played a card-matching game against what they believed was a human partner (actually an algorithm). The algorithm switched between cooperative blocks (where it tried to match the player) and competitive blocks (where it tried to mismatch) without any explicit signal.
  2. Computational Modeling: The authors compared 11 different models to see which best predicted participant behavior. These included simple heuristics (like "Win-Stay/Lose-Switch"), standard RL, and sophisticated "Theory of Mind" (ToM) models.
  3. The Winning Model: The Mixed-intentions influence model. This is a "mixture of experts" framework where two influence-learning experts (one cooperative, one competitive) run in parallel. A "controller" calculates the reliability of each expert and weights their contributions to the final decision.
  4. Imaging: fMRI was used to map the computational variables of the winning model (reliability difference, prediction errors) onto specific brain regions.

Datasets

The study relies on a primary dataset collected by the authors:

  • Behavioral & fMRI Data: Collected from 31 independent participants (27 male, 4 female; ages 20–40).
  • Simulated Data: The authors generated 310 synthetic datasets to validate that their winning model could "recover" the behavioral signatures observed in humans.

Key Insights and Ideas

  • Arbitration over Integration: The brain doesn't just blend social signals into a single value. Instead, it treats "cooperation" and "competition" as distinct hypotheses. The ventral striatum (VS) and ventromedial prefrontal cortex (vmPFC) act as the "arbitrator," tracking which hypothesis is currently more reliable.
  • Competition is Computationally "Louder": When the brain attributes competitive intentions to a partner, it shows increased functional coupling between the reward system (VS/vmPFC) and a "mentalizing" network (dlPFC, rTPJ, and IPS).
  • Prediction Error Specificity: While some brain regions process general surprises (prediction errors), the right TPJ and dlPFC are specifically sensitive to prediction errors during competitive trials. This suggests that outsmarting an opponent requires a more specialized, high-effort neural recruitment than cooperating with a friend.

Key Results

  • Model Performance: The Mixed-intentions influence model significantly outperformed all other models, including standard ToM and RL models (Protected Exceedance Probability = 0.98).
  • Neural Correlates of Reliability: The BOLD signal in the VS, vmPFC, and posterior cingulate cortex (PCC) correlated significantly with the "reliability difference" ($\Delta$)—the signal used to switch between the cooperative and competitive experts.
  • Behavioral Bias: Participants were generally better at cooperating than competing. They performed above chance in cooperative blocks but below chance in competitive ones, suggesting the AI was more successful at exploiting human predictability than vice versa.

Limitations and Future Work

  • Sample Demographics: The participant pool was heavily skewed toward young males (27M, 4F), which limits the ability to generalize findings across genders.
  • Artificial vs. Real Humans: While participants believed they were playing a human, the "partner" was a structured algorithm. Real-world social volatility is likely more chaotic and less "block-based" than the 10/13 trial cycles used here.
  • Clinical Applications: The authors suggest this framework could be a powerful tool for studying social cognitive deficits in conditions like autism or schizophrenia, where the "arbitration" between social experts might be impaired. Future research could apply this task to these populations to identify specific computational "lesions" in social decision-making.

Summary updated

Abstract

Humans frequently interact with agents whose intentions can fluctuate between competition and cooperation over time. It is unclear how the brain adapts to fluctuating intentions of others when the nature of the interactions (to cooperate or compete) is not explicitly and truthfully signaled. Here, we use model-based fMRI and a task in which participants thought they were playing with another player. In fact, they played with an algorithm that alternated without signaling between cooperative and competitive strategies. We show that a neurocomputational mechanism with arbitration between competitive and cooperative experts outperforms other learning models in predicting choice behavior. At the brain level, the fMRI results show that the ventral striatum and ventromedial prefrontal cortex track the difference of reliability between these experts. When attributing competitive intentions, we find increased coupling between these regions and a network that distinguishes prediction errors related to competition and cooperation. These findings provide a neurocomputational account of how the brain arbitrates dynamically between cooperative and competitive intentions when making adaptive social decisions.
BibTeX
@inproceedings{philippe2024neurocomputational,
  author = {Rémi Philippe and Rémi Janet and Koosha Khalvati and Rajesh P. N. Rao and Daeyeol Lee and Jean‐Claude Dreher},
  title = {{Neurocomputational mechanisms involved in adaptation to fluctuating intentions of others}},
  booktitle = {Nature Communications},
  year = {2024},
  doi = {10.1038/s41467-024-47491-2},
}
Figure