The neural mechanisms of inter-temporal decision-making: understanding variability
TL;DR: The neural mechanisms underlying delay discounting are discussed and how interindividual variability (trait effects) in the neural instantiation of subprocesses ofdelay discounting contributes to differences in behaviour are described.
About: This article is published in Trends in Cognitive Sciences.The article was published on 2011-05-01. It has received 555 citations till now. The article focuses on the topics: Temporal discounting.
Citations
More filters
TL;DR: This review will review the current models of behavioral inhibition along with their expression via underlying brain regions, including those involved in the activation of the brain's emergency 'brake' operation, those engaged in more controlled and sustained inhibitory processes and other ancillary executive functions.
1,428 citations
TL;DR: It is argued that a biological approach to psychiatry based on 'neurocognitive endophenotypes', whereby changes in behavioural or cognitive processes are associated with discrete deficits in defined neural systems, has important implications for the future classification of psychiatric disorders, genetics and therapeutics.
802 citations
TL;DR: It is argued that delay discounting is a trans-disease process, undergirded by an imbalance between two competing neurobehavioral decision systems.
496 citations
TL;DR: These findings implicate exaggerated ventral striatal representation of appetitive cues in adolescents relative to an intermediary cognitive control response as one possible mechanism underlying heightened risk-taking during adolescence.
Abstract: Adolescent risk-taking is a public health issue that increases the odds of poor lifetime outcomes. One factor thought to influence adolescents' propensity for risk-taking is an enhanced sensitivity to appetitive cues, relative to an immature capacity to exert sufficient cognitive control. We tested this hypothesis by characterizing interactions among ventral striatal, dorsal striatal, and prefrontal cortical regions with varying appetitive load using fMRI scanning. Child, teen, and adult participants performed a go/no-go task with appetitive (happy faces) and neutral cues (calm faces). Impulse control to neutral cues showed linear improvement with age, whereas teens showed a nonlinear reduction in impulse control to appetitive cues. This performance decrement in teens was paralleled by enhanced activity in the ventral striatum. Prefrontal cortical recruitment correlated with overall accuracy and showed a linear response with age for no-go versus go trials. Connectivity analyses identified a ventral frontostriatal circuit including the inferior frontal gyrus and dorsal striatum during no-go versus go trials. Examining recruitment developmentally showed that teens had greater between-subject ventral-dorsal striatal coactivation relative to children and adults for happy no-go versus go trials. These findings implicate exaggerated ventral striatal representation of appetitive cues in adolescents relative to an intermediary cognitive control response. Connectivity and coactivity data suggest these systems communicate at the level of the dorsal striatum differentially across development. Biased responding in this system is one possible mechanism underlying heightened risk-taking during adolescence.
468 citations
TL;DR: It is found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior, suggesting that executive function may be protective against the deleterious effects of acute stress.
Abstract: Accounts of decision-making have long posited the operation of separate, competing valuation systems in the control of choice behavior. Recent theoretical and experimental advances suggest that this classic distinction between habitual and goal-directed (or more generally, automatic and controlled) choice may arise from two computational strategies for reinforcement learning, called model-free and model-based learning. Popular neurocomputational accounts of reward processing emphasize the involvement of the dopaminergic system in model-free learning and prefrontal, central executive–dependent control systems in model-based choice. Here we hypothesized that the hypothalamic-pituitary-adrenal (HPA) axis stress response—believed to have detrimental effects on prefrontal cortex function—should selectively attenuate model-based contributions to behavior. To test this, we paired an acute stressor with a sequential decision-making task that affords distinguishing the relative contributions of the two learning strategies. We assessed baseline working-memory (WM) capacity and used salivary cortisol levels to measure HPA axis stress response. We found that stress response attenuates the contribution of model-based, but not model-free, contributions to behavior. Moreover, stress-induced behavioral changes were modulated by individual WM capacity, such that low-WM-capacity individuals were more susceptible to detrimental stress effects than high-WM-capacity individuals. These results enrich existing accounts of the interplay between acute stress, working memory, and prefrontal function and suggest that executive function may be protective against the deleterious effects of acute stress.
406 citations
Cites background from "The neural mechanisms of inter-temp..."
...Moreover, although dual-process accounts in psychology emphasize the role of WM capacity in determining reliance on and behavioral expression of the two systems (37, 38), the dependence of the two hypothesized modes of choice on central executive resources is not well understood (39)....
[...]
References
More filters
TL;DR: The psychological principles that govern the perception of decision problems and the evaluation of probabilities and outcomes produce predictable shifts of preference when the same problem is framed in different ways.
Abstract: The psychological principles that govern the perception of decision problems and the evaluation of probabilities and outcomes produce predictable shifts of preference when the same problem is framed in different ways. Reversals of preference are demonstrated in choices regarding monetary outcomes, both hypothetical and real, and in questions pertaining to the loss of human lives. The effects of frames on preferences are compared to the effects of perspectives on perceptual appearance. The dependence of preferences on the formulation of decision problems is a significant concern for the theory of rational choice.
15,513 citations
TL;DR: It is proposed that cognitive control stems from the active maintenance of patterns of activity in the prefrontal cortex that represent goals and the means to achieve them, which provide bias signals to other brain structures whose net effect is to guide the flow of activity along neural pathways that establish the proper mappings between inputs, internal states, and outputs needed to perform a given task.
Abstract: ▪ Abstract The prefrontal cortex has long been suspected to play an important role in cognitive control, in the ability to orchestrate thought and action in accordance with internal goals. Its neural basis, however, has remained a mystery. Here, we propose that cognitive control stems from the active maintenance of patterns of activity in the prefrontal cortex that represent goals and the means to achieve them. They provide bias signals to other brain structures whose net effect is to guide the flow of activity along neural pathways that establish the proper mappings between inputs, internal states, and outputs needed to perform a given task. We review neurophysiological, neurobiological, neuroimaging, and computational studies that support this theory and discuss its implications as well as further issues to be addressed
10,943 citations
TL;DR: Findings in this work indicate that dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events can be understood through quantitative theories of adaptive optimizing control.
Abstract: The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.
8,163 citations
TL;DR: Using a novel task which simulates real-life decision-making in the way it factors uncertainty of premises and outcomes, as well as reward and punishment, it is found that prefrontal patients are oblivious to the future consequences of their actions, and seem to be guided by immediate prospects only.
5,532 citations
TL;DR: It is shown that human functional and structural imaging results map increasingly close to primate anatomy, and advances in neuroimaging techniques allow better spatial and temporal resolution.
3,026 citations