scispace - formally typeset
Search or ask a question
Book ChapterDOI

Electrophysiological Correlates of Reward Processing in Dopamine Neurons

01 Jan 2017-pp 21-31
TL;DR: In this paper, the dopamine reward-prediction error signal is used for economic choices that maximize utility, and the dopamine signal fits well into formal competitive decision models, whereby it codes the output variable (chosen value) suitable for updating or immediately influencing main input variables (object value and action value).
Abstract: Studies have identified three novel properties of the dopamine reward-prediction error signal First, the dopamine response reports initially and unselectively many salient, potentially rewarding events and subsequently processes more specifically the reward-prediction error This two-component structure restricts the earlier claimed salience coding to the initial component and explains aversive activations by physical impact rather than punishment Second, the dopamine prediction error signal reflects subjective reward value and, more stringently, formal economic utility A dopamine utility prediction error signal would be particularly useful for economic choices that maximize utility Third, the dopamine signal fits well into formal competitive decision models, whereby it codes the output variable (chosen value) suitable for updating or immediately influencing main input variables (object value and action value) With these properties, the dopamine utility prediction error signal bridges the gap between animal learning theory (prediction error) and economic decision theory (utility)
Citations
More filters
Book ChapterDOI
01 Jan 2017
TL;DR: The evidence for and against several hypotheses for the neural implementation of punishment learning are reviewed, focusing on human studies that compare the effects of neural perturbation, following drug administration and/or pathological conditions, on reward and punishment learning.
Abstract: Approaching rewards and avoiding punishments are core principles that govern the adaptation of behavior to the environment The machine learning literature has proposed formal algorithms to account for how agents adapt their decisions to optimize outcomes In principle, these reinforcement learning models could be equally applied to positive and negative outcomes, ie, rewards and punishments Yet many neuroscience studies have suggested that reward and punishment learning might be underpinned by distinct brain systems Reward learning has been shown to recruit midbrain dopaminergic nuclei and ventral prefrontostriatal circuits The picture is less clear regarding the existence and anatomy of an opponent system: several hypotheses have been formulated for the neural implementation of punishment learning In this chapter, we review the evidence for and against each hypothesis, focusing on human studies that compare the effects of neural perturbation, following drug administration and/or pathological conditions, on reward and punishment learning

49 citations

Journal ArticleDOI
TL;DR: This work is a call to action for more service researchers to adopt promising and increasingly accessible neuro-tools that allow the service field to benefit from neuroscience theories and insights, and offers service researchers a starting point to understand the potential benefits of adopting the neuroscientific method.
Abstract: The purpose of this paper is to discuss recent developments in neuroscientific methods and demonstrate its potential for the service field. This work is a call to action for more service researchers to adopt promising and increasingly accessible neuro-tools that allow the service field to benefit from neuroscience theories and insights.,The paper synthesizes key literature from a variety of domains (e.g. neuroscience, consumer neuroscience and organizational neuroscience) to provide an in-depth background to start applying neuro-tools. Specifically, this paper outlines the most important neuro-tools today and discusses their theoretical and empirical value.,To date, the use of neuro-tools in the service field is limited. This is surprising given the great potential they hold to advance service research. To stimulate the use of neuro-tools in the service area, the authors provide a roadmap to enable neuroscientific service studies and conclude with a discussion on promising areas (e.g. service experience and servicescape) ripe for neuroscientific input.,The paper offers service researchers a starting point to understand the potential benefits of adopting the neuroscientific method and shows their complementarity with traditional service research methods like surveys, experiments and qualitative research. In addition, this paper may also help reviewers and editors to better assess the quality of neuro-studies in service.

32 citations

Journal ArticleDOI
TL;DR: Results suggest that the subjective value of goods are encoded using sets of brain activation patterns which are tuned to respond uniquely to either low, medium, or high values.

14 citations


Cites background from "Electrophysiological Correlates of ..."

  • ...Being a function of momentary needs, value itself is unique to the individual and is typically revealed via behavioural measures (Schultz, 2017), such as auction tasks....

    [...]

Book ChapterDOI
V. Voon1
01 Jan 2017
TL;DR: Insight is provided into the role of dopamine on decision-making processes in addictions and potential therapeutic targets by highlighting reliance on a ventral striatal critic model of stimulus value with impaired learning from negative prediction error.
Abstract: Impulse control disorders associated with dopaminergic medications are common. Factors including elevated smoking and alcohol use, novelty seeking, impulsivity, depression, and anxiety suggest commonalities with other addictions. The parkinsonian lesion enhances the gain associated with levodopa, reinforcing properties of dopaminergic medications, and enhances delay discounting. Lower striatal dopamine transporter levels preceding medication exposure and decreased midbrain D2 autoreceptor sensitivity may underlie enhanced ventral striatal dopamine release and activity in response to salient reward cues, anticipated and unexpected rewards, and gambling tasks. Evidence supports enhanced learning from reward feedback, with a study highlighting reliance on a ventral striatal critic model of stimulus value with impaired learning from negative prediction error. Impairments in decisional impulsivity (delay discounting, reflection impulsivity, and risk taking) implicate the ventral striatum, orbitofrontal cortex, anterior insula, and dorsal cingulate. These findings provide insight into the role of dopamine on decision-making processes in addictions and potential therapeutic targets.

11 citations

References
More filters
Book
01 Jan 1944
TL;DR: Theory of games and economic behavior as mentioned in this paper is the classic work upon which modern-day game theory is based, and it has been widely used to analyze a host of real-world phenomena from arms races to optimal policy choices of presidential candidates, from vaccination policy to major league baseball salary negotiations.
Abstract: This is the classic work upon which modern-day game theory is based. What began more than sixty years ago as a modest proposal that a mathematician and an economist write a short paper together blossomed, in 1944, when Princeton University Press published "Theory of Games and Economic Behavior." In it, John von Neumann and Oskar Morgenstern conceived a groundbreaking mathematical theory of economic and social organization, based on a theory of games of strategy. Not only would this revolutionize economics, but the entirely new field of scientific inquiry it yielded--game theory--has since been widely used to analyze a host of real-world phenomena from arms races to optimal policy choices of presidential candidates, from vaccination policy to major league baseball salary negotiations. And it is today established throughout both the social sciences and a wide range of other sciences.

19,337 citations

Journal ArticleDOI
14 Mar 1997-Science
TL;DR: Findings in this work indicate that dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events can be understood through quantitative theories of adaptive optimizing control.
Abstract: The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.

8,163 citations

Journal ArticleDOI
TL;DR: Dopamine systems may have two functions, the phasic transmission of reward information and the tonic enabling of postsynaptic neurons.
Abstract: Schultz, Wolfram. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80: 1–27, 1998. The effects of lesions, receptor blocking, electrical self-stimulation, and drugs of abuse suggest t...

3,962 citations

Journal ArticleDOI
TL;DR: The authors tried to answer the question: When is a random variable Y "more variable" than another random variable X "less variable" by asking when a variable X is more variable than another variable Y.

3,655 citations