TL;DR
This paper proposes a normative framework for understanding motivation, viewing it as a mapping from outcomes to utilities. They argue that goal-directed behavior is sensitive to specific outcome utilities, while habitual behavior is influenced by a more general "energizing" effect of motivation, akin to generalized drive. This distinction helps resolve long-standing debates about motivation's role in different behavioral control systems.
What Problem Does This Paper Address?
The paper tackles the fundamental question of how motivation influences instrumental action selection, specifically distinguishing between goal-directed and habitual behaviors. While it's understood that motivational states direct goal-directed actions towards more valuable outcomes, it's less clear how they influence habitual behaviors, which are typically considered outcome-insensitive. This lack of understanding is problematic because habitual behavior plays a significant role in both normal and abnormal actions. The authors aim to bridge this gap by proposing a normative perspective that can account for motivation's influence on both types of control.
Methods
The authors adopt a normative perspective, assuming that animals aim to maximize their achieved utilities. They define motivation as a mapping from outcomes to utilities, with "motivational states" representing different such mappings (e.g., hunger vs. thirst). They then propose two distinct ways motivation influences action selection:
- Outcome-specific "directing" effects: These are directly tied to the current utility of specific outcomes and primarily influence goal-directed behavior.
- Outcome-independent "energizing" effects: These are akin to Hull's "generalized drive" and are proposed to influence habitual behavior by increasing the vigor or speed of actions, regardless of their specific outcome.
The paper discusses how these concepts can be tested using experimental paradigms like outcome revaluation (e.g., specific satiety, conditioned taste aversion, motivational shifts) and how computational models can inform these investigations. They also draw parallels with Pavlovian-instrumental transfer (PIT) to further elucidate these distinctions.
Datasets
Not discussed in the paper.
Key Insights and Ideas
- Motivation as a Utility Map: Defining motivation as a mapping from outcomes to utilities provides a clear, computational framework for understanding its influence.
- Dual Influence on Action: Motivation doesn't just "direct" behavior; it also "energizes" it. This dual role maps neatly onto the distinction between goal-directed (directing) and habitual (energizing) control.
- Habits Aren't Entirely Insensitive: While habits are generally outcome-insensitive, they are not entirely immune to motivational shifts. The "generalized drive" concept offers a mechanism for this influence.
- Generalized Drive Reimagined: The paper offers a normative interpretation of generalized drive, suggesting it's an optimal solution for maximizing response rates when overall reward potential is high, rather than a vague, non-specific arousal.
- Resolving Confusion in Habit Research: The proposed framework helps explain conflicting findings in the literature regarding habit sensitivity to outcome devaluation by differentiating between outcome-specific and general motivational effects.
Key Results
The paper is primarily theoretical and conceptual, outlining a framework and hypotheses rather than presenting novel empirical results. However, it references existing experimental findings that support its claims:
- Goal-directed behavior is demonstrably sensitive to changes in outcome utilities (e.g., after specific satiety or taste aversion).
- Habitual behavior, especially after extensive training, shows reduced sensitivity to outcome devaluation, but can be influenced by motivational shifts.
- Preliminary results from the authors' lab suggest that motivational shifts can affect habitual responding through generalized drive and generalization decrement, with little evidence for outcome-specific effects on habits in novel motivational states.
Limitations and Future Work
The authors acknowledge that experimental evidence for the "generalized drive" hypothesis in habitual behavior is still preliminary. They suggest several avenues for future research:
- Investigating the effects of up-shifts and side-shifts to untrained motivational states on habitual behavior.
- Examining whether "generalized drive" effects can be observed in individual response latencies in goal-directed behavior.
- Exploring potential dissociations in response controllers and motivational effects in Pavlovian behavior, analogous to instrumental control.
- Determining if generalized drive effects and general Pavlovian-instrumental transfer share common neural substrates.
- Investigating whether "directing" motivational effects and specific Pavlovian-instrumental transfer are mediated by similar neural mechanisms.
The paper also highlights the need for careful experimental design, using measures like inter-response latencies, to disentangle the various motivational influences on behavior.
Summary updated