Medial prefrontal cortex as an action-outcome predictor
TLDR
It is shown that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC, and suggests a new view of the medial prefrontal cortex, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad.Abstract:
The medial prefrontal cortex (mPFC) and especially anterior cingulate cortex is central to higher cognitive function and many clinical disorders, yet its basic function remains in dispute. Various competing theories of mPFC have treated effects of errors, conflict, error likelihood, volatility and reward, using findings from neuroimaging and neurophysiology in humans and monkeys. No single theory has been able to reconcile and account for the variety of findings. Here we show that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC. The model reinterprets many known effects and suggests a new view of mPFC, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad. Cognitive control at the neural level is then seen as a result of evaluating the probable and actual outcomes of one's actions.read more
Citations
More filters
Journal ArticleDOI
Open your eyes for prediction errors.
TL;DR: Pupils with larger congruency effects, and hence a larger difference in outcome expectancies between the two trial types, showed larger differences in pupil size after both correct and incorrect responses, corroborating the idea that pupil size increased as a measure of performance prediction errors.
Journal ArticleDOI
Error, rather than its probability, elicits specific electrocortical signatures: A combined EEG-immersive virtual reality study of action observation
TL;DR: Novel evidence is provided that an observed goal error (the action slip) triggers the activity of the performance-monitoring system even when erroneous actions occur more often than correct actions and thus are not salient because of their rarity.
Journal ArticleDOI
No pain, no gain: the affective valence of congruency conditions changes following a successful response.
Nathalie Schouppe,Senne Braem,Jan De Houwer,Massimo Silvetti,Tom Verguts,K. Richard Ridderinkhof,Wim Notebaert +6 more
TL;DR: Using an affective priming paradigm, results show that incongruent trials are indeed perceived as more aversive than congruent trials, but this effect is reversed following successful responses, revealing a novel perspective on 'cognitive' adaptations to conflict.
Journal ArticleDOI
Covert rapid action-memory simulation (CRAMS): a hypothesis of hippocampal-prefrontal interactions for adaptive behavior.
TL;DR: This framework provides an account of why hippocampus has been shown to make critical contributions to the short-term control of behavior, and it motivates several new experimental approaches and hypotheses that could be used to better understand the ubiquitous role of prefrontal-hippocampal interactions in situations that require adaptively using memory to guide choices.
Journal ArticleDOI
Monitor yourself! Deficient error-related brain activity predicts real-life self-control failures.
Klaus-Martin Krönke,Max Wolff,Holger Mohr,Anja Kräplin,Michael N. Smolka,Gerhard Bühringer,Thomas Goschke +6 more
TL;DR: In a sample of 118 participants, proneness to SCF was reliably predicted by low error-related activation of a performance-monitoring network, low posterror rIFG activation, and reduced posterror slowing.
References
More filters
Journal ArticleDOI
Machine learning
TL;DR: Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis.
Journal ArticleDOI
Technical Note : \cal Q -Learning
Chris Watkins,Peter Dayan +1 more
TL;DR: This paper presents and proves in detail a convergence theorem forQ-learning based on that outlined in Watkins (1989), showing that Q-learning converges to the optimum action-values with probability 1 so long as all actions are repeatedly sampled in all states and the action- values are represented discretely.
Journal ArticleDOI
Conflict monitoring and cognitive control.
TL;DR: Two computational modeling studies are reported, serving to articulate the conflict monitoring hypothesis and examine its implications, including a feedback loop connecting conflict monitoring to cognitive control, and a number of important behavioral phenomena.
Journal ArticleDOI
Effects of noise letters upon the identification of a target letter in a nonsearch task
TL;DR: In this paper, a 1-sec tachistoscopic exposure, Ss responded with a right or left leverpress to a single target letter from the sets H and K or S and C. The target always appeared directly above the fixation cross.
Journal ArticleDOI
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
TL;DR: This paper presented a unified account of two neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a generic error-processing system associated with the anterior cingulate cortex.