scispace - formally typeset
Journal ArticleDOI

Responses of monkey dopamine neurons during learning of behavioral reactions.

Reads0
Chats0
TLDR
D dopamine neurons responded simultaneously to the sight of primary food reward and to the conditioned stimulus associated with reward, thus demonstrating specificity for the behavioral significance of stimuli.
Abstract
1. Previous studies have shown that dopamine (DA) neurons respond to stimuli of behavioral significance, such as primary reward and conditioned stimuli predicting reward and eliciting behavioral reactions. The present study investigated how these responses develop and vary when the behavioral significance of stimuli changes during different stages of learning. Impulses from DA neurons were recorded with movable microelectrodes from areas A8, A9, and A10 in two awake monkeys during the successive acquisition of two behavioral tasks. Impulses of DA neurons were distinguished from other neurons by their long duration (1.8-5.0 ms) and low spontaneous frequency (0.5-7.0 imp/s). 2. In the first task, animals learned to reach in a small box in front of them when it opened visibly and audibly. Before conditioning, DA neurons were activated the first few times that the empty box opened and animals reacted with saccadic eye movements. Neuronal and behavioral responses disappeared on repeated stimulus presentation. Thus neuronal responses were related to the novelty of an unexpected stimulus eliciting orienting behavior. 3. Subsequently, the box contained a small morsel of apple in one out of six trials. Animals reacted with ocular saccades to nearly every box opening and reached out when the morsel was present. One-third of 49 neurons were phasically activated by every door opening. The response was stronger when food was present. Thus DA neurons responded simultaneously to the sight of primary food reward and to the conditioned stimulus associated with reward. 4. When the box contained a morsel of apple on every trial, animals regularly reacted with target-directed eye and arm movements, and the majority of 76 DA neurons responded to door opening. The same neurons lacked responses to a light not associated with task performance that was illuminated at the position of the food box in alternate sessions, thus demonstrating specificity for the behavioral significance of stimuli. 5. The second task employed the operant conditioning of a reaction time situation in which animals reached from a resting key toward a lever when a small light was illuminated. DA neurons lacked responses to the unconditioned light. During task acquisition lasting 2-3 days, one-half of 25 DA neurons were phasically activated when a drop of liquid reward was delivered for reinforcing the reaching movement. In contrast, neurons were not activated when reward was delivered at regular intervals (2.5-3.5 s) but a task was not performed.(ABSTRACT TRUNCATED AT 400 WORDS)

read more

Content maybe subject to copyright    Report

Citations
More filters
Book

Reinforcement Learning: An Introduction

TL;DR: This book provides a clear and simple account of the key ideas and algorithms of reinforcement learning, which ranges from the history of the field's intellectual foundations to the most recent developments and applications.
Journal ArticleDOI

The neural basis of drug craving: An incentive-sensitization theory of addiction

TL;DR: S sensitization of incentive salience can produce addictive behavior even if the expectation of drug pleasure or the aversive properties of withdrawal are diminished and even in the face of strong disincentives, including the loss of reputation, job, home and family.
Journal ArticleDOI

Predictive Reward Signal of Dopamine Neurons

TL;DR: Dopamine systems may have two functions, the phasic transmission of reward information and the tonic enabling of postsynaptic neurons.
Journal ArticleDOI

What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?

TL;DR: It is suggested that dopamine may be more important to incentive salience attributions to the neural representations of reward-related stimuli and is a distinct component of motivation and reward.
Journal ArticleDOI

The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity.

TL;DR: This paper presented a unified account of two neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a generic error-processing system associated with the anterior cingulate cortex.
References
More filters
Book

Nonparametric statistics for the behavioral sciences

Sidney Siegel
TL;DR: This is the revision of the classic text in the field, adding two new chapters and thoroughly updating all others as discussed by the authors, and the original structure is retained, and the book continues to serve as a combined text/reference.
Journal ArticleDOI

A psychomotor stimulant theory of addiction

TL;DR: A new attempt at a general theory of addiction is offered, based on the common denominator of the psychomotor stimulants---amphetamine, cocaine, and related drugs---rather than on thecommon denominators of the socalled depressant drugs~opiates, barbiturates, alcohol, and others.
Journal ArticleDOI

Brain dopamine and reward.

TL;DR: While the evidence is strong that dopamine plays some fundamental and special role in the rewarding effects of brain stimulation, psychomotor stimulants, opiates, and food, the exact nature of that role is not clear and dopamine is not the only reward transmitter, and dopaminergic neurons are not the final common path for all rewards.
Journal Article

Dopaminergic neurons: effect of antipsychotic drugs and amphetamine on single cell activity

TL;DR: Neostriatal 3,4-dihydroxyphenylacetic acid was inceased by chlorpromazine, decreaed by amphetamine and unchanged by promethazine, thus paralleling the effects of these drugs on dopaminergic unit activity, compatible with the neuronal feedback hypothesis.
Journal ArticleDOI

Neuroleptics and operant behavior: The anhedonia hypothesis

TL;DR: For example, the authors found that the most subtle and interesting effect of neuroleptics is a selective attenuation of motivational arousal which is critical for goal-directed behavior, normally induced by reinforcers and associated environmental stimuli, and normally accompanied by the subjective experience of pleasure.
Related Papers (5)