Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases

Christine M. Constantinople, Alex T. Piet, Peter Bibawi, Athena Akrami, Charles D. Kopec, Carlos D. BrodyeLife 2019 · DOI

Abstract

Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between explicitly cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected the effects of previous trials, including increased willingness to take risks following risky wins, and spatial “win-stay/lose-shift” biases. Electrophysiological recordings from lateral orbitofrontal cortex (lOFC) revealed strong encoding of reward history and receipt, and optogenetic inhibition of lOFC during choice reporting eliminated rats’ increased preference for risk on subsequent trials following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and that the lOFC’s role in adaptive behavior promotes learning of more abstract, task-specific biases (here, biases for the risky option), but not spatial ones. These data are consistent with proposals that the OFC represents the animal’s location in an abstract representation of task states, and highlight the lOFC’s role in learning.

Introduction

In an ideal decision-making scenario where trials are independent, previous outcomes should not influence subsequent choices. However, both humans and animals frequently exhibit "sequential biases," such as the "hot hand" fallacy or repeating a recently rewarded action. This study investigates whether these biases—specifically abstract task-related strategies versus simple spatial habits—are driven by a single neural circuit or are dissociable. The researchers focused on the lateral orbitofrontal cortex (lOFC), a region critical for value-based decision-making, to determine its specific role in mediating these trial-by-trial behavioral updates.

Methods

The researchers developed a sophisticated "risky choice" task for rats. In each trial, rats chose between a "safe" port (guaranteed small reward) and a "risky" port (probabilistic larger reward). Auditory clicks signaled reward volume, while light flashes signaled the probability of a risky win. To decouple spatial habits from task strategies, the physical location (left vs. right) of the safe and risky options was randomized on every trial.

Figure 1: Experimental task design and behavioral performance. (A-C) Schematic of the risky choice task and stimulus-reward mappings. (D) Learning curves showing efficiency across training sessions. (E-H) Quantification of choice behavior and sequential biases, demonstrating both risky and spatial win-stay effects.

Neural activity was monitored via tetrode recordings from 1,459 individual neurons in the lOFC. To establish causality, the team used optogenetics to silence the lOFC during specific task phases: either the "cue period" (decision-making) or the "choice report" (outcome processing).

Key Results

Behavioral analysis confirmed that rats exhibit both spatial biases (repeating a physical poke) and abstract biases (repeating a "gamble" choice after a win). Electrophysiological data revealed that approximately 31% of lOFC neurons encoded the outcome of the previous trial, and 9% specifically tracked whether the rat chose a safe or risky option.

Crucially, optogenetic inhibition of the lOFC during the choice report phase—when the animal learns the outcome—eliminated the "risky win-stay" bias on the subsequent trial. However, silencing the lOFC during the cue period had no effect. Most importantly, while lOFC inhibition abolished the abstract risky bias, it left spatial "win-stay/lose-shift" habits untouched. This demonstrates that the lOFC is specifically required for updating abstract, task-specific variables rather than serving as a general learning center.

Discussion and Limitations

These findings support the theory that the OFC represents a "cognitive map" of task space, tracking abstract states like "current riskiness" to guide behavior. The temporal specificity of the effects suggests the lOFC is involved in updating value representations rather than maintaining them in working memory.

One limitation is the focus on the lateral OFC; the medial OFC may play a complementary role that remains to be fully characterized in rodents. Additionally, because the observed biases were maladaptive in this specific task (where trials were independent), future research could explore if the lOFC's role changes when such sequential biases are actually beneficial for survival.

Summary updated

Abstract

Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected sequential effects, including increased willingness to take risks following risky wins, and spatial 'win-stay/lose-shift' biases. Recordings from lateral orbitofrontal cortex (lOFC) revealed encoding of reward history and receipt, and optogenetic inhibition of lOFC eliminated rats' increased preference for risk following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and the lOFC's role in adaptive behavior promotes learning of more abstract biases (here, biases for the risky option), but not spatial ones.
BibTeX
@inproceedings{constantinople2019lateral,
  author = {Christine M. Constantinople and Alex T. Piet and Peter Bibawi and Athena Akrami and Charles D. Kopec and Carlos D. Brody},
  title = {{Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases}},
  booktitle = {eLife},
  year = {2019},
  doi = {10.7554/elife.49744},
}
Figure