The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.

/pdf/a-neural-substrate-of-prediction-and-reward-2tj1zqgoih.pdf

A Neural Substrate of Prediction and Reward

I have developed "tennis elbow" from lugging this book around the past four weeks, but it is worth the pain, the effort, and the aspirin. It is also worth the (relatively speaking) bargain price. Including appendixes, this book contains 894 pages of text. The entire panorama of the neural sciences is surveyed and examined, and it is comprehensive in its scope, from genomes to social behaviors. The editors explicitly state that the book is designed as "an introductory text for students of biology, behavior, and medicine," but it is hard to imagine any audience, interested in any fragment of neuroscience at any level of sophistication, that would not enjoy this book. The editors have done a masterful job of weaving together the biologic, the behavioral, and the clinical sciences into a single tapestry in which everyone from the molecular biologist to the practicing psychiatrist can find and appreciate his or

Principles of Neural Science

The neural basis of drug craving: An incentive-sensitization theory of addiction

Secret History: Return of the Black Death Channel 4, 7-8pm In 1348 the Black Death swept through London, killing people within days of the appearance of their first symptoms. Exactly how many died, and why, has long been a mystery. This Secret History documentary follows experts as they pick through the evidence and reveal why the plague killed on such a scale. And they ask, what might be coming next?

Medscape

A model of the neuropsychology of anxiety is proposed. The model is based in the first instance upon an analysis of the behavioural effects of the antianxiety drugs (benzodiazepines, barbiturates, and alcohol) in animals. From such psychopharmacologi-cal experiments the concept of a “behavioural inhibition system” (BIS) has been developed. This system responds to novel stimuli or to those associated with punishment or nonreward by inhibiting ongoing behaviour and increasing arousal and attention to the environment. It is activity in the BIS that constitutes anxiety and that is reduced by antianxiety drugs. The effects of the antianxiety drugs in the brain also suggest hypotheses concerning the neural substrate of anxiety. Although the benzodiazepines and barbiturates facilitate the effects of γ-aminobutyrate, this is insufficient to explain their highly specific behavioural effects. Because of similarities between the behavioural effects of certain lesions and those of the antianxiety drugs, it is proposed that these drugs reduce anxiety by impairing the functioning of a widespread neural system including the septo-hippocampal system (SHS), the Papez circuit, the prefrontal cortex, and ascending monoaminergic and cholinergic pathways which innervate these forebrain structures. Analysis of the functions of this system (based on anatomical, physiological, and behavioural data) suggests that it acts as a comparator: it compares predicted to actual sensory events and activates the outputs of the BIS when there is a mismatch or when the predicted event is aversive. Suggestions are made as to the functions of particular pathways within this overall brain system. The resulting theory is applied to the symptoms and treatment of anxiety in man, its relations to depression, and the personality of individuals who are susceptible to anxiety or depression.

https://www.cambridge.org/core/services/aop-cambridge-core/content/view/S0140525X00013066

Précis of The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septo-Hippocampal System..

The Role of Dopamine in Locomotor Activity and Learning

Dopamine D1-like Receptors and Reward-related Incentive Learning

Animals with a history of receiving daily injections of +-amphetamine in a specific environment showed a placebo effect (enhanced activity) when injected with saline and placed there; control animals with similar but dissociated drug histories and experience with the test chamber failed to show the effect. The dopamine receptor blocker pimozide antagonized the establishment of conditioning. However, the same dose of pimozide, when given to previously conditioned animals on the placebo test day, failed to antagonize the expression of conditioned activity. Thus, during conditioning dopaminergic neurons mediated a change that subsequently influenced behavior even when dopaminergic systems were blocked. Although schizophrenia may be related to hyperfunctioning of dopamine, neuroleptic drugs, which block dopamine receptors on their first administration, do not have therapeutic effects for a number of days. The results of the pimozide experiments may resolve this paradox.

https://science.sciencemag.org/content/sci/220/4603/1304.full.pdf

Pimozide blocks establishment but not expression of amphetamine-produced environment-specific conditioning.

The administration of Δ9-tetrahydrocannabinol (THC), the principle psychoactive ingredient in marijuana, or the endogenous cannabinoid anandamide, has been shown to impair recent memory. The purpose of the present investigation was to determine if the cannabinoid CB1 receptor antagonist SR141716A could attenuate THC- or anandamide-induced memory impairment, and to assess the effects on memory of SR141716A alone. Memory was assessed in rats well-trained in a two-component instrumental discrimination task, consisting of a conditional discrimination, and a non-match-to-position to assess recent or working memory. SR141716A (0.0–2.0 mg/kg) had no effect on either the conditional discrimination or the non-match-to-position. However, SR141716A (0.0–2.0 mg/kg) attenuated the memory impairment produced by THC (2.0 or 4.0 mg/kg) as indexed by an enhancement of performance in the non-match-to-position. When administered to rats pretreated with anandamide (2.0 mg/kg), SR141716A (0.0–2.5 mg/kg) impaired performance in the conditional discrimination at the highest dose. This was interpreted as a deficit in some capacity unrelated to memory (e.g., motor impairment). However, lower doses of SR141716A (0.1 and 0.5 mg/kg) attenuated the anandamide-induced impairment of performance in the non-match-to-position without affecting the conditional discrimination. This is the first report that the memory impairment produced by anandamide can be attenuated by a cannabinoid antagonist; results suggest that anandamide-induced memory disruption is mediated by CB1 receptors.

/pdf/the-cannabinoid-cb1-receptor-antagonist-sr141716a-attenuates-24xgmv7zp4.pdf

The cannabinoid CB1 receptor antagonist SR141716A attenuates the memory impairment produced by delta9-tetrahydrocannabinol or anandamide.

Opioid agonists such as morphine have been found to exert excitatory and inhibitory receptor-mediated effects at low and high doses, respectively. Ultra-low doses of opioid antagonists (naloxone and naltrexone), which selectively inhibit the excitatory effects, have been reported to augment systemic morphine analgesia and inhibit the development of tolerance/physical dependence. This study investigated the site of action of the paradoxical effects of naltrexone and the generality of this effect. The potential of ultra-low doses of naltrexone to influence morphine-induced analgesia was investigated in tests of nociception. Administration of intrathecal (0.05 and 0.1 ng) or systemic (10 ng/kg i.p.) naltrexone augmented the antinociception produced by an acute submaximal dose of intrathecal (5 g) or systemic (7.5 mg/kg i.p.) morphine in the tail-flick test. Chronic intrathecal (0.005 and 0.05 ng) or systemic (10 ng/kg) naltrexone combined with morphine (15 g i.t.; 15 mg/kg i.p.) over a 7-day period inhibited the decline in morphine antinociception and prevented the loss of morphine potency. In animals rendered tolerant to intrathecal (15 g) or systemic (15 mg/kg) morphine, administration of naltrexone (0.05 ng i.t.; 10 and 50 ng/kg i.p.) significantly restored the antinociceptive effect and potency of morphine. Thus, in ultra-low doses, naltrexone paradoxically enhances morphine analgesia and inhibits or reverses tolerance through a spinal action. The potential of naltrexone to influence morphine-induced reward was also investigated using a place preference paradigm. Systemic administration of ultra-low doses of naltrexone (16.7, 20.0, and 25.0 ng/kg) with morphine (1.0 mg/kg) extended the duration of the morphine-induced conditioned place preference. These effects of naltrexone on morphine-induced reward may have implications for chronic treatment with agonist-antagonist combinations.

https://www.queensu.ca/psychology/sites/webpublish.queensu.ca.psycwww/files/files/Faculty/Richard%20Beninger/Beninger_prp_27.pdf

Richard J. Beninger

Papers

The Role of Dopamine in Locomotor Activity and Learning

Dopamine D1-like Receptors and Reward-related Incentive Learning

Pimozide blocks establishment but not expression of amphetamine-produced environment-specific conditioning.

The cannabinoid CB1 receptor antagonist SR141716A attenuates the memory impairment produced by delta9-tetrahydrocannabinol or anandamide.

Paradoxical effects of the opioid antagonist naltrexone on morphine analgesia, tolerance, and reward in rats.