Medial prefrontal cortex as an action-outcome predictor
TLDR
It is shown that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC, and suggests a new view of the medial prefrontal cortex, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad.Abstract:
The medial prefrontal cortex (mPFC) and especially anterior cingulate cortex is central to higher cognitive function and many clinical disorders, yet its basic function remains in dispute. Various competing theories of mPFC have treated effects of errors, conflict, error likelihood, volatility and reward, using findings from neuroimaging and neurophysiology in humans and monkeys. No single theory has been able to reconcile and account for the variety of findings. Here we show that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC. The model reinterprets many known effects and suggests a new view of mPFC, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad. Cognitive control at the neural level is then seen as a result of evaluating the probable and actual outcomes of one's actions.read more
Citations
More filters
Journal ArticleDOI
Functional disruption in prefrontal-striatal network in obsessive-compulsive disorder.
Zhiqiang Sha,Amelia Versace,E. Kale Edmiston,Jay C. Fournier,Simona Graur,Tsafrir Greenberg,João Paulo Lima Santos,Henry W. Chase,Richelle Stiffler,Lisa Bonar,Robert Hudak,Anastasia Yendiki,Benjamin D. Greenberg,Steven A. Rasmussen,Hesheng Liu,Gregory J. Quirk,Suzanne N. Haber,Mary L. Phillips +17 more
TL;DR: A positive correlation between left caudate-bilateral dorsolateral prefrontal cortex connectivity and depression scores in OCD participants was found, such that greater positive connectivity was associated with more severe symptoms.
Journal ArticleDOI
Individual differences in behavioral flexibility in a probabilistic reversal learning task : an fMRI study
TL;DR: This study corroborates the involvement of ACC, VLPFC, and DLPFC at the exact moment of behavioral switches and reports increased activation of the dACC and caudate head with increasing number of perseverating errors preceding a behavioral switch.
Journal ArticleDOI
Unraveling the Mysteries of Motivation
TL;DR: This Opinion article addresses two central questions regarding the nature of motivation: what are the nature and dynamics of the internal goals that drive the authors' motivational system and how can this system be sufficiently flexible to support their ability to rapidly adapt to novel situations, tasks, etc?
Journal ArticleDOI
Chimpanzee histology and functional brain imaging show that the paracingulate sulcus is not human-specific
Céline Amiez,Jerome Sallet,Jerome Sallet,Jennifer Novek,Fadila Hadj-Bouziane,Camille Giacometti,Jesper L. R. Andersson,William D. Hopkins,Michael Petrides +8 more
TL;DR: Amiez et al. as mentioned in this paper analyzed brain imaging data from humans and chimpanzees to demonstrate that the paracingulate sulcus is a shared feature of the primate brain since at least the last common ancestor to humans and great apes ~6 mya.
Journal ArticleDOI
Effects of invalid feedback on learning and feedback-related brain activity in decision-making
TL;DR: Analysis of two electrophysiological markers of feedback processing found that invalid, irrelevant feedback not only impaired learning, it also altered the amplitude of the P300 to relevant feedback, suggesting an interfering effect of irrelevant feedback on the processing of relevant feedback.
References
More filters
Journal ArticleDOI
Machine learning
TL;DR: Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis.
Journal ArticleDOI
Technical Note : \cal Q -Learning
Chris Watkins,Peter Dayan +1 more
TL;DR: This paper presents and proves in detail a convergence theorem forQ-learning based on that outlined in Watkins (1989), showing that Q-learning converges to the optimum action-values with probability 1 so long as all actions are repeatedly sampled in all states and the action- values are represented discretely.
Journal ArticleDOI
Conflict monitoring and cognitive control.
TL;DR: Two computational modeling studies are reported, serving to articulate the conflict monitoring hypothesis and examine its implications, including a feedback loop connecting conflict monitoring to cognitive control, and a number of important behavioral phenomena.
Journal ArticleDOI
Effects of noise letters upon the identification of a target letter in a nonsearch task
TL;DR: In this paper, a 1-sec tachistoscopic exposure, Ss responded with a right or left leverpress to a single target letter from the sets H and K or S and C. The target always appeared directly above the fixation cross.
Journal ArticleDOI
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
TL;DR: This paper presented a unified account of two neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a generic error-processing system associated with the anterior cingulate cortex.