Reward certainty and preference bias selectively shape voluntary decisions

Wojciech Kossut Zajkowski, Dominik Krzemiński, Jacopo Barone, Lisa H. Evans, Jiaxiang ZhangbioRxiv 2019 · DOI

Abstract

Choosing between equally valued options presents a theoretical conundrum: classical decision theories predict prolonged response times (RT) due to indifference, yet rational agents should require no deliberation when outcomes are identical. This study characterizes the neurocognitive processes underlying such "voluntary" decisions by integrating cognitive modeling with EEG recordings during a probabilistic reward task. Participants chose between cues associated with identical reward probabilities at varying levels of certainty (100%, 80%, and 20%). Results demonstrate that higher reward certainty accelerates RT, and participants consistently develop preferences for specific cues, further speeding decisions. Hierarchical Bayesian estimation of a Linear Ballistic Accumulator (LBA) model revealed that these effects are driven by the rate of evidence accumulation rather than visual encoding or motor execution. EEG analysis identified neural representations of certainty and preference as early as 120 ms post-stimulus, with the slope between N100 and P300 components predicting trial-by-trial accumulation rates. These findings suggest that reward certainty and internal preference bias collectively prevent indecision by modulating the speed of neural evidence accumulation.

Introduction: The Paradox of Equal Choice

In classical decision theory, the "Buridan’s Ass" paradox describes a scenario where an agent, faced with two equally attractive options, remains paralyzed by indecision. While theoretical models might predict a deadlock or significantly delayed response times, humans in the real world navigate these voluntary decisions with remarkable efficiency. How the brain breaks this symmetry to prevent random behavior or total stagnation remains a central question in neuroeconomics.

This research investigates whether external factors, such as the level of reward certainty, and internal factors, such as spontaneous preference biases, serve as "tie-breakers." By decomposing the decision process into its constituent parts—visual encoding, evidence accumulation, and motor execution—the authors sought to identify the specific stage where these biases exert their influence.

Methodology: Modeling the Mental Race

To explore these dynamics, the researchers employed a multi-modal approach combining behavioral psychophysics, high-density EEG, and computational modeling.

The Task

Participants (n=23) were trained to recognize six cues associated with three reward certainty levels: 100%, 80%, and 20%. During the decision phase, they were presented with pairs of these cues. The critical trials involved "equal" choices, where both cues carried the same reward probability (e.g., 80% vs. 80%).

Cognitive Modeling

The study utilized the Linear Ballistic Accumulator (LBA) model to analyze decision-making. The LBA conceptualizes a decision as a "horse race" between independent neural accumulators. Each accumulator gathers evidence for a specific option at a certain speed (drift rate) until it reaches a threshold. This model allows researchers to distinguish between the time spent processing information (accumulation) and "non-decision time," which includes visual encoding and motor response.

EEG-Informed Modeling

In a sophisticated technical integration, the team used single-trial EEG features to inform their cognitive model. Specifically, they focused on the slope between the N100 (an early visual component) and the P300 (associated with evidence accumulation). By plugging these neural signatures into the LBA, they could test if brain activity directly predicted the speed of the mental "race" on a trial-by-trial basis.

Key Insights

1. Certainty as a Catalyst

Even when two options offered the same probability of reward, the absolute level of certainty mattered. Participants were significantly faster to choose between two 100% cues than between two 20% cues. High reward certainty acts as an exogenous boost, increasing the overall speed of the decision engine regardless of the specific option chosen.

2. The Emergence of Spontaneous Preferences

In the absence of objective differences between cues, participants developed "endogenous" preference biases. They consistently chose one specific cue in an equal pair more frequently and more rapidly than its counterpart. This internal bias effectively breaks the symmetry of the choice, providing a subjective reason to favor one option over another.

3. Selective Modulation of Evidence Accumulation

The most significant finding from the hierarchical Bayesian modeling was that neither certainty nor preference affected the "non-decision time" (visual encoding or motor execution). Instead, both factors selectively modulated the rate of evidence accumulation. We do not see the cues faster or move our hands quicker; rather, we "build the case" for our preferred or more certain option at an accelerated neural pace.

4. Early Neural Tie-Breaking

Time-resolved multivariate pattern analysis (MVPA) of EEG data revealed that the brain begins to distinguish reward certainty as early as 120 ms after stimulus onset. Preference-related signals emerged shortly after, at approximately 212 ms. This suggests that the mechanisms required to prevent indecision are engaged almost immediately upon perceiving the options.

Conclusion and Future Directions

The study demonstrates that the human brain avoids the trap of indecision by utilizing both external certainty and internal preference to accelerate the evidence accumulation process. The EEG-informed LBA model outperformed traditional behavioral models, confirming that the slope of neural activity between the N100 and P300 is a reliable proxy for the latent cognitive process of deciding.

Future research may look to expand these findings by exploring how these preferences are learned over time and whether these mechanisms hold true in more complex, "noisy" environments where visual encoding might play a more substantial role in the decision-making timeline.

Summary updated

Abstract

Abstract Choosing between equally valued options can be a conundrum, for which classical decision theories predicted a prolonged response time (RT). Paradoxically, a rational decision-maker would need no deliberative thinking in this scenario, as outcomes of alternatives are indifferent. How individuals choose between equal options remain unclear. Here, we characterized the neurocognitive processes underlying such voluntary decisions, by integrating advanced cognitive modelling and EEG recording in a probabilistic reward task, in which human participants chose between pairs of cues associated with identical reward probabilities at different levels. We showed that higher reward certainty accelerated RT. At each certainty level, participants preferred to choose one cue faster and more frequently over the other. The behavioral effects on RT persisted in simple reactions to reward cues. By using hierarchical Bayesian parameter estimation for an accumulator model, we showed that the certainty and preference effects were independently associated with the rate of evidence accumulation during decisions, but not with visual encoding or motor execution latencies. Time-resolved multivariate pattern classification of EEG evoked response identified significant representations of reward certainty and preference choices as early as 120 ms after stimulus onset, with spatial relevance patterns maximal in middle central and parietal electrodes. Furthermore, EEG-informed computational modelling showed that the rate of change between N100 and P300 event-related potentials reflected changes in the model-derived rate of evidence accumulation on a trial-by-trial basis. Our findings suggested that reward certainty and preference collectively shaped voluntary decisions between equal options, providing a mechanism to prevent indecision or random behavior.
BibTeX
@misc{zajkowski2019reward,
  author = {Wojciech Kossut Zajkowski and Dominik Krzemiński and Jacopo Barone and Lisa H. Evans and Jiaxiang Zhang},
  title = {{Reward certainty and preference bias selectively shape voluntary decisions}},
  year = {2019},
  doi = {10.1101/832311},
  howpublished = {bioRxiv},
}
Figure