Medial prefrontal cortex as an action-outcome predictor
TLDR
It is shown that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC, and suggests a new view of the medial prefrontal cortex, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad.Abstract:
The medial prefrontal cortex (mPFC) and especially anterior cingulate cortex is central to higher cognitive function and many clinical disorders, yet its basic function remains in dispute. Various competing theories of mPFC have treated effects of errors, conflict, error likelihood, volatility and reward, using findings from neuroimaging and neurophysiology in humans and monkeys. No single theory has been able to reconcile and account for the variety of findings. Here we show that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC. The model reinterprets many known effects and suggests a new view of mPFC, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad. Cognitive control at the neural level is then seen as a result of evaluating the probable and actual outcomes of one's actions.read more
Citations
More filters
Journal ArticleDOI
The effect of concurrent reward on aversive information processing in the brain.
Andy Jeesu Kim,Brian A. Anderson +1 more
TL;DR: The findings of this fMRI study are consistent with the idea that neural networks responsible for the processing of reward and punishment signals are largely independent of one another, and that representations of overall value or utility are arrived at through the integration of separate reward and punished signals at later stages of information processing.
Journal ArticleDOI
Independent and interacting value systems for reward and information in the human brain
TL;DR: The results provide empirical evidence for PFC as an optimizer of independent information and reward signals during decision-making under realistic scenarios, with potential implications for the interpretation of PFC activity in both healthy and clinical populations.
Dissertation
Novel approaches to studying the role of the anterior cingulate cortex in cognition and Parkinson's disease
TL;DR: Electrophysiological behavior of the BG thalamocortical circuit in PD and dopamine-normal states during cognitive and motor activity is examined, suggesting that ACC-mediated executive function is dopamine-sensitive and is reflected in the region’s electrophysiology.
Journal ArticleDOI
Semantic prediction-errors are context-dependent: An ERP study.
Bradley N. Jack,Mike E. Le Pelley,Oren Griffiths,Oren Griffiths,David Luque,David Luque,Thomas J. Whitford +6 more
TL;DR: This work shows that different types of prediction-errors - the discrepancies between top-down expectations and bottom-up sensory input - are integrated across processing levels and sensory modalities of the cortical hierarchy.
Journal ArticleDOI
The neural network basis of altered decision-making in patients with amyotrophic lateral sclerosis
Kazunori Imai,Michihito Masuda,Hirohisa Watanabe,Aya Ogura,Reiko Ohdake,Yasuhiro Tanaka,Toshiyasu Kato,Kazuya Kawabata,Yuichi Riku,Kazuhiro Hara,Ryoichi Nakamura,Naoki Atsuta,Epifanio Bagarinao,Kentaro Katahira,Hideki Ohira,Masahisa Katsuno,Gen Sobue +16 more
TL;DR: This work examined decision‐making features and changes in the neural hub network in patients with ALS using a probabilistic reversal learning task and resting‐state network analysis, respectively.
References
More filters
Journal ArticleDOI
Machine learning
TL;DR: Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis.
Journal ArticleDOI
Technical Note : \cal Q -Learning
Chris Watkins,Peter Dayan +1 more
TL;DR: This paper presents and proves in detail a convergence theorem forQ-learning based on that outlined in Watkins (1989), showing that Q-learning converges to the optimum action-values with probability 1 so long as all actions are repeatedly sampled in all states and the action- values are represented discretely.
Journal ArticleDOI
Conflict monitoring and cognitive control.
TL;DR: Two computational modeling studies are reported, serving to articulate the conflict monitoring hypothesis and examine its implications, including a feedback loop connecting conflict monitoring to cognitive control, and a number of important behavioral phenomena.
Journal ArticleDOI
Effects of noise letters upon the identification of a target letter in a nonsearch task
TL;DR: In this paper, a 1-sec tachistoscopic exposure, Ss responded with a right or left leverpress to a single target letter from the sets H and K or S and C. The target always appeared directly above the fixation cross.
Journal ArticleDOI
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
TL;DR: This paper presented a unified account of two neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a generic error-processing system associated with the anterior cingulate cortex.