Abstract
Trait extraversion has long been associated with increased reward sensitivity, likely mediated by the dopaminergic system. However, reinforcement learning (RL) involves two distinct computational strategies: model-free (habitual, error-driven) and model-based (goal-directed, planning). This study investigates whether extraversion selectively predicts performance in one of these systems. Using a two-step decision task, researchers found that while extraversion can lead to overall performance declines due to task disengagement, it specifically correlates with enhanced model-free learning among highly engaged participants. These findings suggest that personality traits reflect specific tuning parameters within neural learning algorithms.
Introduction: The Extraversion-Reward Link
Extraverts are characterized by their sensitivity to rewards, a trait often linked to the brain's dopamine-driven reward prediction error (RPE) signals. Computational neuroscience distinguishes between two primary RL strategies:
- Model-free RL: A computationally efficient strategy that reinforces actions based on past rewards, effectively forming habits.
- Model-based RL: A more complex strategy that utilizes a mental map of the environment to plan actions based on expected future outcomes.
The central question of this research is whether the extraversion-reward link is a general enhancement of all learning or if it is selective to the model-free, dopamine-dependent system.
Methods: The Two-Step Decision Task
To differentiate these strategies, 97 participants performed a "two-step decision task." In the first stage, participants choose between two options that lead to one of two second-stage "rooms" with specific probabilities (70% "common" vs. 30% "rare"). In the second stage, they choose between two options to receive a monetary reward.
The reward probabilities for the four second-stage options drift independently over time (as seen in the figure above), requiring participants to continuously update their values. A model-free learner repeats a first-stage choice if it led to a reward, regardless of the transition type. In contrast, a model-based learner accounts for the task structure; a reward following a rare transition would lead them to switch their first-stage choice to reach the same rewarded room more reliably.
Key Results and Insights
The "Engagement Mask"
Initial analysis of the full sample showed that higher extraversion scores actually predicted worse performance across both learning strategies. The researchers hypothesized that extraverts might be more prone to boredom or disengagement during repetitive laboratory tasks, which could mask their underlying computational strengths.
Selective Facilitation in Engaged Participants
To test this, the authors introduced an "engagement index" based on how well a participant's choices fit any learning model. When focusing on the top 20% of the most engaged participants, the original hypothesis was confirmed: extraversion significantly predicted better model-free learning ($Z = 2.02, p = 0.043$) but showed no relationship with model-based planning.
Discussion: Personality as a Computational Parameter
These results suggest that personality traits like extraversion are not merely descriptive but may reflect the "tuning" of specific neural algorithms. Extraversion appears to act as a proxy for the sensitivity or gain of the model-free, dopamine-mediated system. However, the tendency for extraverts to disengage from repetitive tasks highlights the importance of considering motivational factors when measuring cognitive performance.
Limitations and Future Directions
While the study provides a computational link between personality and RL, it does not directly measure dopamine levels. Future research using pharmacological interventions could confirm the biological mechanism. Additionally, exploring how other traits like neuroticism or impulsivity interact with these learning systems could lead to a more comprehensive "computational phenotyping" of human personality.
Summary updated