The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.

/pdf/a-neural-substrate-of-prediction-and-reward-2tj1zqgoih.pdf

A Neural Substrate of Prediction and Reward

Schultz, Wolfram. Predictive reward signal of dopamine neurons. J. Neurophysiol. 80: 1–27, 1998. The effects of lesions, receptor blocking, electrical self-stimulation, and drugs of abuse suggest t...

/pdf/predictive-reward-signal-of-dopamine-neurons-3f94myirza.pdf

Predictive Reward Signal of Dopamine Neurons

The Dopamine Hypothesis of Schizophrenia: A Review*

Catecholamine theories of reward: a critical review.

The role of ascending noradrenergic (NA) and dopaminergic (DA) systems in intravenous self-administration of cocaine in rats was investigated by examining the effects of 6-hydroxydopamine-induced lesions of these systems on responding for the drug on a FR-1 schedule of reinforcement. Lesions of the dorsal and ventral NA bundles that reduced hippocampal-cortical NA by 96% and hypothalamic NA by 72% failed to have any effects on responding for cocaine. Lesions of the nucleus accumbens that reduced the DA content of this nucleus by 90% resulted in a significant and long-lasting (15 days) reduction in self-administration of cocaine. Apomorphine self-administration was not affected in the same animals. Identical lesions of the n accumbens had only transient (2-3 days) effects on food-reinforced operant responding, suggesting that the prolonged disruption of cocaine self-administration was not the result of motor deficits. The results are discussed with reference to the possibility that DA terminals in the n accumbens may mediate some of the positive reinforcing properties of cocaine.

Sheila M. Brooke

Papers

Temporal changes in amine synthesizing enzymes of rat extrapyramidal structures after hemitransections or 6-hydroxydopamine administration.

Effects of amphetamine isomers and neuroleptics on self-stimulation from the nucleus accumbens and dorsal nor-adrenergenic bundle

Differential rates of increase in pontine tyrosine hydroxylase and dopamine-β-hydroxylase activities after reserpine