Medial prefrontal cortex as an action-outcome predictor
TLDR
It is shown that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC, and suggests a new view of the medial prefrontal cortex, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad.Abstract:
The medial prefrontal cortex (mPFC) and especially anterior cingulate cortex is central to higher cognitive function and many clinical disorders, yet its basic function remains in dispute. Various competing theories of mPFC have treated effects of errors, conflict, error likelihood, volatility and reward, using findings from neuroimaging and neurophysiology in humans and monkeys. No single theory has been able to reconcile and account for the variety of findings. Here we show that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC. The model reinterprets many known effects and suggests a new view of mPFC, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad. Cognitive control at the neural level is then seen as a result of evaluating the probable and actual outcomes of one's actions.read more
Citations
More filters
Journal ArticleDOI
Adaptive behaviour and feedback processing integrate experience and instruction in reinforcement learning
Anne-Marike Schiffer,Anne-Marike Schiffer,Anne-Marike Schiffer,Kayla Siletti,Florian Waszak,Nick Yeung +5 more
TL;DR: This study is the first to show that neural markers of feedback anticipation and of feedback processing reflect informativeness of unexpected feedback, and suggests reinforcement learning integrates experience with high‐level beliefs.
Journal ArticleDOI
Expectancy effects in feedback processing are explained primarily by time-frequency delta not theta.
TL;DR: Results revealed that the FN was sensitive to valence but not expectancy, and that valence effects were driven by loss-sensitive theta and gain-sensitive delta, which added to a growing body of research showing that time-frequency measures reflect separable processes underlying time-domain components.
Journal ArticleDOI
Random Forest Classification of Alcohol Use Disorder Using fMRI Functional Connectivity, Neuropsychological Functioning, and Impulsivity Measures
Chella Kamarajan,Babak A. Ardekani,Babak A. Ardekani,Ashwini K. Pandey,Sivan Kinreich,Gayathri Pandey,David B. Chorlian,Jacquelyn L. Meyers,Jian Zhang,Elaine Bermudez,Arthur T. Stimus,Bernice Porjesz +11 more
TL;DR: The results confirm the previous findings that alterations in specific brain networks coupled with poor neuropsychological functioning and heightened impulsivity may characterize individuals with AUD, who can be efficiently identified using classification algorithms such as Random Forest.
Journal ArticleDOI
Prefrontal Cortical Projection Neurons Targeting Dorsomedial Striatum Control Behavioral Inhibition
Huub Terra,Bastiaan Bruinsma,Sybren F. de Kloet,Marcel van der Roest,Tommy Pattij,Huibert D. Mansvelder +5 more
TL;DR: It is shown that selective chemogenetic silencing of corticostriatal PFC neurons in rats increases premature responses and may suggest that distinct domains of cognitive control over behavior are encoded by specific projection neuron populations.
Journal ArticleDOI
Convergent neural connectivity in motor impulsivity and high-fat food binge-like eating in male Sprague-Dawley rats
Noelle C. Anastasio,Sonja J. Stutz,Amanda E. Price,Brionna D. Davis-Reyes,Dennis J. Sholler,Susan M. Ferguson,Susan M. Ferguson,John F. Neumaier,F. Gerard Moeller,Jonathan D. Hommel,Kathryn A. Cunningham +10 more
TL;DR: Chemogenetic activation of the vmPFC to NAcSh pathway significantly suppressed motor impulsivity and binge-like intake for high-fat food and served as a ‘brake’ over both behaviors.
References
More filters
Journal ArticleDOI
Machine learning
TL;DR: Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis.
Journal ArticleDOI
Technical Note : \cal Q -Learning
Chris Watkins,Peter Dayan +1 more
TL;DR: This paper presents and proves in detail a convergence theorem forQ-learning based on that outlined in Watkins (1989), showing that Q-learning converges to the optimum action-values with probability 1 so long as all actions are repeatedly sampled in all states and the action- values are represented discretely.
Journal ArticleDOI
Conflict monitoring and cognitive control.
TL;DR: Two computational modeling studies are reported, serving to articulate the conflict monitoring hypothesis and examine its implications, including a feedback loop connecting conflict monitoring to cognitive control, and a number of important behavioral phenomena.
Journal ArticleDOI
Effects of noise letters upon the identification of a target letter in a nonsearch task
TL;DR: In this paper, a 1-sec tachistoscopic exposure, Ss responded with a right or left leverpress to a single target letter from the sets H and K or S and C. The target always appeared directly above the fixation cross.
Journal ArticleDOI
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
TL;DR: This paper presented a unified account of two neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a generic error-processing system associated with the anterior cingulate cortex.