I have developed "tennis elbow" from lugging this book around the past four weeks, but it is worth the pain, the effort, and the aspirin. It is also worth the (relatively speaking) bargain price. Including appendixes, this book contains 894 pages of text. The entire panorama of the neural sciences is surveyed and examined, and it is comprehensive in its scope, from genomes to social behaviors. The editors explicitly state that the book is designed as "an introductory text for students of biology, behavior, and medicine," but it is hard to imagine any audience, interested in any fragment of neuroscience at any level of sophistication, that would not enjoy this book. The editors have done a masterful job of weaving together the biologic, the behavioral, and the clinical sciences into a single tapestry in which everyone from the molecular biologist to the practicing psychiatrist can find and appreciate his or

Principles of Neural Science

https://lsa.umich.edu/psych/research&labs/berridge/publications/Berridge&RobinsonBrResRev1998.pdf

What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?

https://sites.oxy.edu/clint/physio/article/therewardcircuitlinkingprimateanatomyandhumanimaging.pdf

The reward circuit: linking primate anatomy and human imaging.

http://www.columbia.edu/itc/gsas/g9600/2003/JavitchReadings/Schultz(Sulzer).pdf

Getting Formal with Dopamine and Reward

The well-known Easterlin paradox points out that average happiness has remained constant over time despite sharp rises in GNP per head. At the same time, a micro literature has typically found positive correlations between individual income and individual measures of subjective well-being. This paper suggests that these two findings are consistent with the presence of relative income terms in the utility function. Income may be evaluated relative to others (social comparison) or to oneself in the past (habituation). We review the evidence on relative income from the subjective well-being literature. We also discuss the relation (or not) between happiness and utility, and discuss some nonhappiness research (behavioral, experimental, neurological) related to income comparisons. We last consider how relative income in the utility function can affect economic models of behavior in the domains of consumption, investment, economic growth, savings, taxation, labor supply, wages, and migration.

Relative Income, Happiness and Utility: An Explanation for the Easterlin Paradox and Other Puzzles

In behavioral science, it is well known that humans and nonhuman animals are highly sensitive to differences in reward magnitude when choosing an outcome from a set of alternatives. We know that a realm of behavioral reactions is altered when animals begin to expect different levels of reward outcome. Our present aim was to investigate how the expectation for different magnitudes of reward influences behavior-related neurophysiology in the anterior striatum. In a spatial delayed response task, different instruction pictures are presented to the monkey. Each image represents a different magnitude of juice. By reaching to the spatial location where an instruction picture was presented, animals could receive the particular liquid amount designated by the stimulus. Reliable preferences in reward choice trials and differences in anticipatory licks, performance errors, and reaction times indicated that animals differentially expected the various reward amounts predicted by the instruction cues. A total of 374 of 2,000 neurons in the anterior parts of the caudate nucleus, putamen, and ventral striatum showed five forms of task-related activation during the preparation or execution of movement and activations preceding or following the liquid drop delivery. Approximately one-half of these striatal neurons showed differing response levels dependent on the magnitude of liquid to be received. Results of a linear regression analysis showed that reward magnitude and single cell discharge rate were related in a subset of neurons by a monotonic positive or negative relationship. Overall, these data support the idea that the striatum utilizes expectancies that contain precise information concerning the predicted, forthcoming level of reward in directing general behavioral reactions.

Effects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum

This study investigated how different expected rewards influence behavior-related neuronal activity in the anterior striatum. In a spatial delayed-response task, monkeys reached for a left or right target and obtained a small quantity of one of two juices (apple, grenadine, orange, lemon, black currant, or raspberry). In each trial, an initial instruction picture indicated the behavioral target and predicted the reward. Nonmovement trials served as controls for movement relationships. Consistent preferences in special reward choice trials and differences in anticipatory licks, performance errors, and reaction times indicated that animals differentially expected the rewards predicted by the instructions. About 600 of >2,500 neurons in anterior parts of caudate nucleus, putamen, and ventral striatum showed five forms of task-related activations, comprising responses to instructions, spatial or nonspatial activations during the preparation or execution of the movement, and activations preceding or following the rewards. About one-third of the neurons showed different levels of task-related activity depending on which liquid reward was predicted at trial end. Activations were either higher or lower for rewards that were preferred by the animals as compared with nonpreferred rewards. These data suggest that the expectation of an upcoming liquid reward may influence a fraction of task-related neurons in the anterior striatum. Apparently the information about the expected reward is incorporated into the neuronal activity related to the behavioral reaction leading to the reward. The results of this study are in general agreement with an account of goal-directed behavior according to which the outcome should be represented already at the time at which the behavior toward the outcome is performed.

https://www.physiology.org/doi/pdf/10.1152/jn.2001.85.6.2477

Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum

The neostriatum and its connections control the sequential organization of action ("action syntax") as well as simpler aspects of movement. This study focused on sequential organization of rodent grooming. Grooming syntax provides an opportunity to study how neural systems coordinate natural patterns of serial order. The most stereotyped of these grooming patterns, a "syntactic chain," has a particularly stereotyped order that recurs thousands of times more often than could occur by chance. The purpose of the present study was to identify the crucial site within the striatopallidal system where lesions disrupt the syntax or serial order of syntactic grooming chains without disrupting constituent movements. Small excitotoxin lesions were made using quinolinic acid at bilateral sites within the dorsolateral, dorsomedial, ventrolateral, or ventromedial neostriatum, or in the ventral pallidum or globus pallidus of rats. An objective technique for mapping functional lesions was used to quantify cell death and to map precisely those lesions that disrupted grooming syntax. Our results identified a single site within the anterior dorsolateral neostriatum, slightly more than a cubic millimeter in size (1.3 x 1.0 x 1.0 mm), as crucial to grooming syntax. Damage to this site did not disrupt the ability to emit grooming actions. By contrast, damage to sites in the ventral pallidum and globus pallidus impaired grooming actions but left the sequential organization of grooming syntax intact. Neural circuits within this crucial "action syntax site" seem to implement sequential patterns of behavior as a specific function.

/pdf/implementation-of-action-sequences-by-a-neostriatal-site-a-8cgwz7x6fb.pdf

Implementation of Action Sequences by a Neostriatal Site: A Lesion Mapping Study of Grooming Syntax

https://deepblue.lib.umich.edu/bitstream/handle/2027.42/30517/0000147.pdf;sequence=1

Where does damage lead to enhanced food aversion : the ventral pallidum/substantia innominata or lateral hypothalamus ?

The present experiments were designed to further examine the hypothesis that receptor subtype determines the direction of dopamine's (DA) ability to modulate neostriatal neuronal responses. We have reported that DA potentiates responses mediated by activation of N-methyl-d-aspartate (NMDA) receptors, but attenuates responses mediated by activation of non-NMDA receptors in neocortex [Cepeda et al. (1992b) Synapse, 11:330-341] and neostriatum [Cepeda et al. (1993) Proc. Natl. Acad. Sci. U.S.A., 90:9576-9580]. In these studies, responses to excitatory amino acids (EAAs) were evoked by microphoretic application of agonists. The present studies examined whether this differential modulation also applies to components of synaptic responses evoked by electrical stimulation of neostriatal afferents and mediated by activation of specific subtypes of EAA receptors. Using brain slices, the actions of DA and its receptor specific agonists on components of neostriatal synaptic responses that were mediated either by NMDA or non-NMDA receptors were assessed. Responses mediated by NMDA receptors were potentiated by DA while those mediated by non-NMDA receptors were attenuated. These findings provide further support for the hypothesis that the direction of modulatory action of DA is determined by the specific subtype of EAA receptor activated. In addition, the enhancement of NMDA receptor-mediated responses was mimicked by application of SKF 38393, a D1 receptor agonist. Quinpirole, a D2 receptor agonist, consistently attenuated responses mediated by activation of non-NMDA receptors. Thus, the complex modulatory actions of DA are dependent upon combinations of co-activation of specific subtypes of EAA and DA receptors. These findings are of clinical relevance since the actions of DA and EAAs have been implicated in neurological and affective disorders.

Howard C. Cromwell

Papers

Effects of Expectations for Different Reward Magnitudes on Neuronal Activity in Primate Striatum

Influence of Expectation of Different Rewards on Behavior-Related Neuronal Activity in the Striatum

Implementation of Action Sequences by a Neostriatal Site: A Lesion Mapping Study of Grooming Syntax

Where does damage lead to enhanced food aversion : the ventral pallidum/substantia innominata or lateral hypothalamus ?

Neuromodulatory actions of dopamine on synaptically-evoked neostriatal responses in slices