The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.

/pdf/a-neural-substrate-of-prediction-and-reward-2tj1zqgoih.pdf

A Neural Substrate of Prediction and Reward

Bright and dark sides of nitric oxide in ischemic brain injury

Over the last several years, compelling evidence has accumulated indicating that central hyperactive states resulting from neuronal plastic changes within the spinal cord play a critical role in hyperalgesia associated with nerve injury and inflammation. Such neuronal plastic changes may involve activation of central nervous system excitatory amino acid (EAA) receptors, subsequent intracellular cascades including protein kinase C translocation and activation as well as nitric oxide production, leading to the functional modulation of receptor-ion channel complexes. Similar EAA receptor-mediated cellular and intracellular mechanisms have now been implicated in the development of tolerance to the analgesic effects of morphine, and a site of action involved in both hyperalgesia and morphine tolerance is likely to be in the superficial laminae of the spinal cord dorsal horn. These observations suggest that hyperalgesia and morphine tolerance, two seemingly unrelated phenomena, may be interrelated by common neural substrates that interact at the level of EAA receptor activation and related intracellular events. This view is supported by recent observations showing that thermal hyperalgesia develops when animals are made tolerant to morphine antinociception and that both hyperalgesia and reduction of the antinociceptive effects of morphine occur as a consequence of peripheral nerve injury. The demonstration of interrelationships between neural mechanisms underlying hyperalgesia and morphine tolerance may lead to a better understanding of the neurobiology of these two phenomena in particular and pain in general. This knowledge may also provide a scientific basis for improved pain management with opiate analgesics.

Mechanisms of hyperalgesia and morphine tolerance: a current view of their possible interactions.

Modern molecular biology has revealed vast numbers of large and complex proteins and genes that regulate body function. By contrast, discoveries over the past ten years indicate that crucial features of neuronal communication, blood vessel modulation and immune response are mediated by a remarkably simple chemical, nitric oxide (NO). Endogenous NO is generated from arginine by a family of three distinct calmodulin- dependent NO synthase (NOS) enzymes. NOS from endothelial cells (eNOS) and neurons (nNOS) are both constitutively expressed enzymes, whose activities are stimulated by increases in intracellular calcium. Immune functions for NO are mediated by a calcium-independent inducible NOS (iNOS). Expression of iNOS protein requires transcriptional activation, which is mediated by specific combinations of cytokines. All three NOS use NADPH as an electron donor and employ five enzyme cofactors to catalyze a five-electron oxidation of arginine to NO with stoichiometric formation of citrulline. The highest levels of NO throughout the body are found in neurons, where NO functions as a unique messenger molecule. In the autonomic nervous system NO functions NO functions as a major non-adrenergic non-cholinergic (NANC) neurotransmitter. This NANC pathway plays a particularly important role in producing relaxation of smooth muscle in the cerebral circulation and the gastrointestinal, urogenital and respiratory tracts. Dysregulation of NOS activity in autonomic nerves plays a major role in diverse pathophysiological conditions including migraine headache, hypertrophic pyloric stenosis and male impotence. In the brain, NO functions as a neuromodulator and appears to mediate aspects of learning and memory. Although endogenous NO was originally appreciated as a mediator of smooth muscle relaxation, NO also plays a major role in skeletal muscle. Physiologically muscle-derived NO regulates skeletal muscle contractility and exercise-induced glucose uptake. nNOS occurs at the plasma membrane of skeletal muscle which facilitates diffusion of NO to the vasculature to regulate muscle perfusion. nNOS protein occurs in the dystrophin complex in skeletal muscle and NO may therefore participate in the pathophysiology of muscular dystrophy. NO signalling in excitable tissues requires rapid and controlled delivery of NO to specific cellular targets. This tight control of NO signalling is largely regulated at the level of NO biosynthesis. Acute control of nNOS activity is mediated by allosteric enzyme regulation, by posttranslational modification and by subcellular targeting of the enzyme. nNOS protein levels are also dynamically regulated by changes in gene transcription, and this affords long-lasting changes in tissue NO levels. While NO normally functions as a physiological neuronal mediator, excess production of NO mediates brain injury. Overactivation of glutamate receptors associated with cerebral ischemia and other excitotoxic processes results in massive release of NO. As a free radical, NO is inherently reactive and mediates cellular toxicity by damaging critical metabolic enzymes and by reacting with superoxide to form an even more potent oxidant, peroxynitrite. Through these mechanisms, NO appears to play a major role in the pathophysiology of stroke, Parkinson's disease, Huntington's disease and amyotrophic lateral sclerosis.

Endogenous nitric oxide synthesis: Biological functions and pathophysiology

How do minds emerge from developing brains? According to "neural constructivism," the representational features of cortex are built from the dynamic interaction between neural growth mechanisms and environmentally derived neural activity. Contrary to popular selectionist models that emphasize regressive mechanisms, the neurobiological evidence suggests that this growth is a progressive increase in the representational properties of cortex. The interaction between the environment and neural growth results in a flexible type of learning: "constructive learning" minimizes the need for prespecification in accordance with recent neurobiological evidence that the developing cerebral cortex is largely free of domain-specific structure. Instead, the representational properties of cortex are built by the nature of the problem domain confronting it. This uniquely powerful and general learning strategy undermines the central assumption of classical learnability theory, that the learning properties of a system can be deduced from a fixed computational architecture. Neural constructivism suggests that the evolutionary emergence of neocortex in mammals is a progression toward more flexible representational structures, in contrast to the popular view of cortical evolution as an increase in innate, specialized circuits. Human cortical postnatal development is also more extensive and protracted than generally supposed, suggesting that cortex has evolved so as to maximize the capacity of environmental structure to shape its structure and function through constructive learning.

/pdf/the-neural-basis-of-cognitive-development-a-constructivist-meee8ey9rg.pdf

The neural basis of cognitive development: a constructivist manifesto.

L-Glutamate and norepinephrine are examples of a major excitatory neurotransmitter and a neuromodulator in the cerebral cortex, respectively. Little is known of how chemical signaling between the anatomically distinct chemical pathways occurs. Specific activation of the N-methyl-D-aspartate (NMDA) class of glutamate receptor in synaptosomal preparations from guinea pig cerebral cortex caused release of both of these chemicals, and this release was blocked by agents that inhibit nitric oxide (NO) production or remove NO from the extracellular space. Furthermore, neurotransmitter release correlated with cortical NO production after NMDA receptor stimulation. These results suggest that NO production and its extracellular movement may be links in the pathway from NMDA receptor activation to changes in chemical signaling in surrounding synaptic terminals in the cerebral cortex.

https://science.sciencemag.org/content/sci/263/5149/973.full.pdf

R. B. Marchase

Papers

Role of No production in NMDA receptor-mediated neurotransmitter release in cerebral cortex

Role of nitric oxide in NMDA receptor mediated neurotransmitter release in hippocampus