Medial prefrontal cortex as an action-outcome predictor
TLDR
It is shown that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC, and suggests a new view of the medial prefrontal cortex, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad.Abstract:
The medial prefrontal cortex (mPFC) and especially anterior cingulate cortex is central to higher cognitive function and many clinical disorders, yet its basic function remains in dispute. Various competing theories of mPFC have treated effects of errors, conflict, error likelihood, volatility and reward, using findings from neuroimaging and neurophysiology in humans and monkeys. No single theory has been able to reconcile and account for the variety of findings. Here we show that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC. The model reinterprets many known effects and suggests a new view of mPFC, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad. Cognitive control at the neural level is then seen as a result of evaluating the probable and actual outcomes of one's actions.read more
Citations
More filters
Journal ArticleDOI
Neurophysiological evidence for evaluative feedback processing depending on goal relevance.
Mario Carlo Severo,Katharina Paul,Wioleta Walentowska,Wioleta Walentowska,Agnes Moors,Gilles Pourtois +5 more
TL;DR: Although these ERP components exhibit non-overlapping spatiotemporal properties and performance monitoring effects, they can both be modulated by a common, valence-unspecific process related to goal relevance.
Journal ArticleDOI
Neural Activities Underlying the Feedback Express Salience Prediction Errors for Appetitive and Aversive Stimuli
TL;DR: Investigating the feedback with monetary reward and electrical pain shock in one task via functional magnetic resonance imaging revealed significant prediction-error-related activities in the bilateral fusiform gyrus, right middle frontal gyrus and left cingulate gyrus for both money and pain, implying that some regions underlying the feedback may signal a salience prediction error rather than a reward prediction error.
Journal ArticleDOI
Valence-specific conflict moderation in the dorso-medial PFC and the caudate head in emotional speech
TL;DR: The results suggest that control structures of the human brain (dmPFC and subcompartments of the basal ganglia) impact emotional speech differentially when conflict arises.
Posted ContentDOI
Temporal Chunking as a Mechanism for Unsupervised Learning of Task-Sets
Flora Bouchacourt,Flora Bouchacourt,Stefano Palminteri,Stefano Palminteri,Etienne Koechlin,Etienne Koechlin,Srdjan Ostojic,Srdjan Ostojic +7 more
TL;DR: It is shown that task-set learning can be achieved provided the timescale of chunking is slower than the timesscale of stimulus-response learning, and specific predictions linking chunking and task- set retrieval that were borne out by behavioral performance and reaction times are identified.
Journal ArticleDOI
Why overlearned sequences are special: distinct neural networks for ordinal sequences
TL;DR: Using functional neuroimaging, it is shown that words in ordinal categories are processed in a fronto-temporo-parietal network biased toward the right hemisphere, which differs from words in non-ordinal categories, which show an expected bias toward the left hemisphere.
References
More filters
Journal ArticleDOI
Machine learning
TL;DR: Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis.
Journal ArticleDOI
Technical Note : \cal Q -Learning
Chris Watkins,Peter Dayan +1 more
TL;DR: This paper presents and proves in detail a convergence theorem forQ-learning based on that outlined in Watkins (1989), showing that Q-learning converges to the optimum action-values with probability 1 so long as all actions are repeatedly sampled in all states and the action- values are represented discretely.
Journal ArticleDOI
Conflict monitoring and cognitive control.
TL;DR: Two computational modeling studies are reported, serving to articulate the conflict monitoring hypothesis and examine its implications, including a feedback loop connecting conflict monitoring to cognitive control, and a number of important behavioral phenomena.
Journal ArticleDOI
Effects of noise letters upon the identification of a target letter in a nonsearch task
TL;DR: In this paper, a 1-sec tachistoscopic exposure, Ss responded with a right or left leverpress to a single target letter from the sets H and K or S and C. The target always appeared directly above the fixation cross.
Journal ArticleDOI
The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.
TL;DR: This paper presented a unified account of two neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a generic error-processing system associated with the anterior cingulate cortex.