scispace - formally typeset
Open AccessJournal ArticleDOI

Medial prefrontal cortex as an action-outcome predictor

William H. Alexander, +1 more
- 01 Oct 2011 - 
- Vol. 14, Iss: 10, pp 1338-1344
TLDR
It is shown that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC, and suggests a new view of the medial prefrontal cortex, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad.
Abstract
The medial prefrontal cortex (mPFC) and especially anterior cingulate cortex is central to higher cognitive function and many clinical disorders, yet its basic function remains in dispute. Various competing theories of mPFC have treated effects of errors, conflict, error likelihood, volatility and reward, using findings from neuroimaging and neurophysiology in humans and monkeys. No single theory has been able to reconcile and account for the variety of findings. Here we show that a simple model based on standard learning rules can simulate and unify an unprecedented range of known effects in mPFC. The model reinterprets many known effects and suggests a new view of mPFC, as a region concerned with learning and predicting the likely outcomes of actions, whether good or bad. Cognitive control at the neural level is then seen as a result of evaluating the probable and actual outcomes of one's actions.

read more

Citations
More filters
Journal ArticleDOI

Integration of conflict resolution and positive emotions: Electrophysiological evidence.

TL;DR: This study used ERPs, took the flanker task as primes, set different durations between the resolution of conflicts and the presentation of targets, and chose affective words as targets to investigate the affective effect of cognitive conflict during the resolution stage, suggesting that conflict resolution was integrated with positive emotions.
Journal ArticleDOI

Relationship of sensation seeking with the neural correlates of appetitive conditioning.

TL;DR: Investigating sensation seeking in a classical conditioning paradigm revealed a negative relationship between sensation seeking and neural responses in the insula, amygdala and nucleus accumbens during the early phase and in the dorsal anterior cingulate cortex during the late phase of conditioning, suggesting reduced reward learning and consequently diminished processing of outcome expectancy in appetitive conditioning in subjects with high sensation seeking scores.
Journal ArticleDOI

Ethanol Alters Variability, But Not Rate, of Firing in Medial Prefrontal Cortex Neurons of Awake-Behaving Rats.

TL;DR: The changes in neural activity following EtOH administration in anesthetized animals are not conserved in awake-behaving animals, suggesting that acute EtOH may be affecting decision-making via this mechanism.

Understanding the human subcortex using ultra-high field MRI and computational cognitive models

TL;DR: Novel approaches for understanding the human subcortex using Ultra-High field MRI (UHF-MRI) were explored and the tripartite model of the subthalamic nucleus (STN) was tested with an empirical study on how BOLD activity in different parts of the STN is related to different aspects of perceptual decision-making.
Posted ContentDOI

Dorsal anterior cingulate and ventromedial prefrontal cortex have inverse roles in both foraging and economic choice

TL;DR: This study found that dACC better tracked values pertaining to foraging, while vmPFC better trackedvalues pertaining to economic choice, and concludes that both regions are similarly engaged by foraging-like and economic choice.
References
More filters
Journal ArticleDOI

Machine learning

TL;DR: Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis.
Journal ArticleDOI

Technical Note : \cal Q -Learning

TL;DR: This paper presents and proves in detail a convergence theorem forQ-learning based on that outlined in Watkins (1989), showing that Q-learning converges to the optimum action-values with probability 1 so long as all actions are repeatedly sampled in all states and the action- values are represented discretely.
Journal ArticleDOI

Conflict monitoring and cognitive control.

TL;DR: Two computational modeling studies are reported, serving to articulate the conflict monitoring hypothesis and examine its implications, including a feedback loop connecting conflict monitoring to cognitive control, and a number of important behavioral phenomena.
Journal ArticleDOI

Effects of noise letters upon the identification of a target letter in a nonsearch task

TL;DR: In this paper, a 1-sec tachistoscopic exposure, Ss responded with a right or left leverpress to a single target letter from the sets H and K or S and C. The target always appeared directly above the fixation cross.
Journal ArticleDOI

The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.

TL;DR: This paper presented a unified account of two neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a generic error-processing system associated with the anterior cingulate cortex.
Related Papers (5)