The reward circuit: linking primate anatomy and human imaging.
TL;DR: It is shown that human functional and structural imaging results map increasingly close to primate anatomy, and advances in neuroimaging techniques allow better spatial and temporal resolution.
About: This article is published in Neuropsychopharmacology.The article was published on 2010-01-01 and is currently open access. It has received 3026 citations till now. The article focuses on the topics: Ventral striatum & Ventral pallidum.
Citations
More filters
TL;DR: It is demonstrated that negative affect, pain and cognitive control activate an overlapping region of the dorsal cingulate — the anterior midcingulate cortex (aMCC), which constitutes a hub where information about reinforcers can be linked to motor centres responsible for expressing affect and executing goal-directed behaviour.
Abstract: It has been argued that emotion, pain and cognitive control are functionally segregated in distinct subdivisions of the cingulate cortex. However, recent observations encourage a fundamentally different view. Imaging studies demonstrate that negative affect, pain and cognitive control activate an overlapping region of the dorsal cingulate — the anterior midcingulate cortex (aMCC). Anatomical studies reveal that the aMCC constitutes a hub where information about reinforcers can be linked to motor centres responsible for expressing affect and executing goal-directed behaviour. Computational modelling and other kinds of evidence suggest that this intimacy reflects control processes that are common to all three domains. These observations compel a reconsideration of the dorsal cingulate's contribution to negative affect and pain.
1,714 citations
TL;DR: This work presents a normative model of EVC that integrates three critical factors: the expected payoff from a controlled process, the amount of control that must be invested to achieve that payoff, and the cost in terms of cognitive effort.
1,625 citations
Cites background from "The reward circuit: linking primate..."
...This assumes that it has access to information about the value of the options in contention that is represented in other structures, such as ventral regions of mPFC (Floresco et al., 2008; Haber and Knutson, 2010; Prévost et al., 2010; Rangel and Hare, 2010; Rushworth et al., 2011)....
[...]
...Furthermore, the dACC projects to both ventral and dorsomedial regions of the striatum (Choi et al., 2012; Haber and Knutson, 2010)....
[...]
...It is not surprising, therefore, that structures commonly associated with valuation and regulation have been found to coactivate and/or share structural and functional connectivity with dACC (Figure 1; Beckmann et al., 2009; Haber and Knutson, 2010; Morecraft et al., 2012; Power and Petersen, 2013; Seeley et al., 2007; Touroutoglou et al., 2012; Vincent et al., 2008; Yeo et al., 2011)....
[...]
...…and regulation have been found to coactivate and/or share structural and functional connectivity with dACC (Figure 1; Beckmann et al., 2009; Haber and Knutson, 2010; Morecraft et al., 2012; Power and Petersen, 2013; Seeley et al., 2007; Touroutoglou et al., 2012; Vincent et al., 2008; Yeo…...
[...]
...…about the value of the options in contention that is represented in other structures, such as ventral regions of mPFC (Floresco et al., 2008; Haber and Knutson, 2010; Prévost et al., 2010; Rangel and Hare, 2010; Rushworth et al., 2011). dACC and the Cost of Cognitive Control The expected…...
[...]
TL;DR: Developmental neuroimaging studies do not support a simple model of frontal cortical immaturity, and growing evidence points to the importance of changes in social and affective processing, which begin around the onset of puberty, as crucial to understanding these adolescent vulnerabilities.
Abstract: Research has demonstrated that extensive structural and functional brain development continues throughout adolescence. A popular notion emerging from this work states that a relative immaturity in frontal cortical neural systems could explain adolescents' high rates of risk-taking, substance use and other dangerous behaviours. However, developmental neuroimaging studies do not support a simple model of frontal cortical immaturity. Rather, growing evidence points to the importance of changes in social and affective processing, which begin around the onset of puberty, as crucial to understanding these adolescent vulnerabilities. These changes in social-affective processing also may confer some adaptive advantages, such as greater flexibility in adjusting one's intrinsic motivations and goal priorities amidst changing social contexts in adolescence.
1,567 citations
TL;DR: A biological embedding model is presented that maintains that childhood stress gets "programmed" into macrophages through epigenetic markings, posttranslational modifications, and tissue remodeling, and proposes that over the life course, these proinflammatory tendencies are exacerbated by behavioral proclivities and hormonal dysregulation, themselves the products of exposure to early stress.
Abstract: Among people exposed to major psychological stressors in early life, there are elevated rates of morbidity and mortality from chronic diseases of aging. The most compelling data come from studies of children raised in poverty or maltreated by their parents, who show heightened vulnerability to vascular disease, autoimmune disorders, and premature mortality. These findings raise challenging theoretical questions. How does childhood stress get under the skin, at the molecular level, to affect risk for later diseases? And how does it incubate there, giving rise to diseases several decades later? Here we present a biological embedding model, which attempts to address these questions by synthesizing knowledge across several behavioral and biomedical literatures. This model maintains that childhood stress gets “programmed” into macrophages through epigenetic markings, posttranslational modifications, and tissue remodeling. As a consequence these cells are endowed with proinflammatory tendencies, manifest in exaggerated cytokine responses to challenge and decreased sensitivity to inhibitory hormonal signals. The model goes on to propose that over the life course, these proinflammatory tendencies are exacerbated by behavioral proclivities and hormonal dysregulation, themselves the products of exposure to early stress. Behaviorally, the model posits that childhood stress gives rise to excessive threat vigilance, mistrust of others, poor social relationships, impaired self-regulation, and unhealthy lifestyle choices. Hormonally, early stress confers altered patterns of endocrine and autonomic discharge. This milieu amplifies the proinflammatory environment already instantiated by macrophages. Acting in concert with other exposures and genetic liabilities, the resulting inflammation drives forward pathogenic mechanisms that ultimately foster chronic disease.
1,402 citations
Cites background from "The reward circuit: linking primate..."
...They include encoding motivationally relevant stimuli, judging their reward value, weighing alternative courses of action, plotting a strategy for stimulus pursuit, and, finally, directing motor regions to implement the plan (Haber & Knutson, 2010; Kable & Glimcher, 2009)....
[...]
TL;DR: It is found that intense pleasure in response to music can lead to dopamine release in the striatal system, and this results help to explain why music is of such high value across all human societies.
Abstract: Music, an abstract stimulus, can arouse feelings of euphoria and craving, similar to tangible rewards that involve the striatal dopaminergic system. Using the neurochemical specificity of [(11)C]raclopride positron emission tomography scanning, combined with psychophysiological measures of autonomic nervous system activity, we found endogenous dopamine release in the striatum at peak emotional arousal during music listening. To examine the time course of dopamine release, we used functional magnetic resonance imaging with the same stimuli and listeners, and found a functional dissociation: the caudate was more involved during the anticipation and the nucleus accumbens was more involved during the experience of peak emotional responses to music. These results indicate that intense pleasure in response to music can lead to dopamine release in the striatal system. Notably, the anticipation of an abstract reward can result in dopamine release in an anatomical pathway distinct from that associated with the peak pleasure itself. Our results help to explain why music is of such high value across all human societies.
1,273 citations
References
More filters
TL;DR: Findings in this work indicate that dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events can be understood through quantitative theories of adaptive optimizing control.
Abstract: The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.
8,163 citations
"The reward circuit: linking primate..." refers background in this paper
...Given that reward anticipation can increase, and nonreward outcomes can decrease, VS activation, theorists have proposed that VS activity tracks a reward prediction error (or the difference between expected and obtained rewards) (McClure et al, 2007; Montague et al, 1996; Schultz et al, 1997)....
[...]
TL;DR: The field of neuroscience has, after a long period of looking the other way, again embraced emotion as an important research area, and much of the progress has come from studies of fear, and especially fear conditioning as mentioned in this paper.
Abstract: The field of neuroscience has, after a long period of looking the other way, again embraced emotion as an important research area. Much of the progress has come from studies of fear, and especially fear conditioning. This work has pin- pointed the amygdala as an important component of the system involved in the acqui- sition, storage, and expression of fear memory and has elucidated in detail how stimuli enter, travel through, and exit the amygdala. Some progress has also been made in understanding the cellular and molecular mechanisms that underlie fear conditioning, and recent studies have also shown that the findings from experimental animals apply to the human brain. It is important to remember why this work on emotion succeeded where past efforts failed. It focused on a psychologically well-defined aspect of emo- tion, avoided vague and poorly defined concepts such as "affect," "hedonic tone," or "emotional feelings," and used a simple and straightforward experimental approach. With so much research being done in this area today, it is important that the mistakes of the past not be made again. It is also time to expand from this foundation into broader aspects of mind and behavior
7,347 citations
TL;DR: Using a novel task which simulates real-life decision-making in the way it factors uncertainty of premises and outcomes, as well as reward and punishment, it is found that prefrontal patients are oblivious to the future consequences of their actions, and seem to be guided by immediate prospects only.
5,532 citations
"The reward circuit: linking primate..." refers result in this paper
...Consistent with these studies and human lesion findings (Bechara et al, 1994), several neuroimaging studies suggest that sensory and abstract rewards can recruit the OFC....
[...]
TL;DR: Event-related functional magnetic resonance imaging and a task-switching version of the Stroop task were used to examine whether these components of cognitive control have distinct neural bases in the human brain and a double dissociation was found.
Abstract: Theories of the regulation of cognition suggest a system with two necessary components: one to implement control and another to monitor performance and signal when adjustments in control are needed. Event-related functional magnetic resonance imaging and a task-switching version of the Stroop task were used to examine whether these components of cognitive control have distinct neural bases in the human brain. A double dissociation was found. During task preparation, the left dorsolateral prefrontal cortex (Brodmann's area 9) was more active for color naming than for word reading, consistent with a role in the implementation of control. In contrast, the anterior cingulate cortex (Brodmann's areas 24 and 32) was more active when responding to incongruent stimuli, consistent with a role in performance monitoring.
3,545 citations