AUTHOR=Kastner Lucas , Kube Jana , Villringer Arno , Neumann Jane 

TITLE=Cardiac Concomitants of Feedback and Prediction Error Processing in Reinforcement Learning

JOURNAL=Frontiers in Neuroscience

VOLUME=Volume 11 - 2017

YEAR=2017

URL=https://www.frontiersin.org/journals/neuroscience/articles/10.3389/fnins.2017.00598

DOI=10.3389/fnins.2017.00598

ISSN=1662-453X

ABSTRACT=Successful learning hinges on the evaluation of positive and negative feedback. We assessed differential learning from reward and punishment in a monetary reinforcement learning paradigm, together with cardiac concomitants of positive and negative feedback processing. On the behavioral level, learning from reward resulted in more advantageous behavior than learning from punishment,  suggesting a differential impact of reward and punishment on successful feedback-based learning. Considering participants’ gender and weight status revealed less consistent behavioral adaptation in women compared to men, and obesity-related deficits in learning to avoid negative consequences. Importantly, learning and feedback processing were closely mirrored by phasic cardiac responses on a trial-by-trial basis: Negative feedback was accompanied by faster and prolonged heart rate deceleration compared to positive feedback. Moreover, cardiac responses shifted from feedback presentation at the beginning of learning to stimulus presentation later on. Most importantly, the strength of phasic cardiac responses to the presentation of feedback correlated with the strength of prediction error signals that alert the learner to the necessity for behavioral adaptation. These results provide strong new evidence for the notion that during learning phasic cardiac responses reflect an internal value and feedback monitoring system that is sensitive to the violation of performance-based expectations.