Temporal dynamics of prediction error processing during reward-based decision making

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Marios G. Philiastides - , Max Planck Institute for Human Development, Max Planck Institute for Human Cognitive and Brain Sciences (Author)
  • Guido Biele - , Max Planck Institute for Human Development, Max Planck Institute for Human Cognitive and Brain Sciences, Free University of Berlin (Author)
  • Niki Vavatzanidis - , Max Planck Institute for Human Development (Author)
  • Philipp Kazzer - , Max Planck Institute for Human Development (Author)
  • Hauke R. Heekeren - , Max Planck Institute for Human Development, Max Planck Institute for Human Cognitive and Brain Sciences, Free University of Berlin (Author)

Abstract

Adaptive decision making depends on the accurate representation of rewards associated with potential choices. These representations can be acquired with reinforcement learning (RL) mechanisms, which use the prediction error (PE, the difference between expected and received rewards) as a learning signal to update reward expectations. While EEG experiments have highlighted the role of feedback-related potentials during performance monitoring, important questions about the temporal sequence of feedback processing and the specific function of feedback-related potentials during reward-based decision making remain. Here, we hypothesized that feedback processing starts with a qualitative evaluation of outcome-valence, which is subsequently complemented by a quantitative representation of PE magnitude. Results of a model-based single-trial analysis of EEG data collected during a reversal learning task showed that around 220. ms after feedback outcomes are initially evaluated categorically with respect to their valence (positive vs. negative). Around 300. ms, and parallel to the maintained valence-evaluation, the brain also represents quantitative information about PE magnitude, thus providing the complete information needed to update reward expectations and to guide adaptive decision making. Importantly, our single-trial EEG analysis based on PEs from an RL model showed that the feedback-related potentials do not merely reflect error awareness, but rather quantitative information crucial for learning reward contingencies.

Details

Original languageEnglish
Pages (from-to)221-232
Number of pages12
JournalNeuroImage
Volume53
Issue number1
Publication statusPublished - 25 May 2010
Peer-reviewedYes
Externally publishedYes

External IDs

PubMed 20510376
ORCID /0000-0002-5009-1719/work/142235800

Keywords

ASJC Scopus subject areas

Keywords

  • Decision making, EEG, Model, Prediction error, Reinforcement learning, Reward, Single-trial