Showing papers on "Classical conditioning published in 2020"

A VTA to Basal Amygdala Dopamine Projection Contributes to Signal Salient Somatosensory Events during Fear Learning.

Abstract: The amygdala is a brain area critical for the formation of fear memories. However, the nature of the teaching signal(s) that drive plasticity in the amygdala are still under debate. Here, we use optogenetic methods to investigate the contribution of ventral tegmental area (VTA) dopamine neurons to auditory-cued fear learning in male mice. Using anterograde and retrograde labeling, we found that a sparse and relatively evenly distributed population of VTA neurons projects to the basal amygdala (BA). In vivo optrode recordings in behaving mice showed that many VTA neurons, among them putative dopamine neurons, are excited by footshocks, and acquire a response to auditory stimuli during fear learning. Combined cfos imaging and retrograde labeling in dopamine transporter (DAT) Cre mice revealed that a large majority of BA projectors (>95%) are dopamine neurons, and that BA projectors become activated by the tone-footshock pairing of fear learning protocols. Finally, silencing VTA dopamine neurons, or their axon terminals in the BA during the footshock, reduced the strength of fear memory as tested 1 d later, whereas silencing the VTA-central amygdala (CeA) projection had no effect. Thus, VTA dopamine neurons projecting to the BA contribute to fear memory formation, by coding for the saliency of the footshock event and by signaling such events to the basal amygdala.SIGNIFICANCE STATEMENT Powerful mechanisms of fear learning have evolved in animals and humans to enable survival. During fear conditioning, a sensory cue, such as a tone (the conditioned stimulus), comes to predict an innately aversive stimulus, such as a mild footshock (the unconditioned stimulus). A brain representation of the unconditioned stimulus must act as a teaching signal to instruct plasticity of the conditioned stimulus representation in fear-related brain areas. Here we show that dopamine neurons in the VTA that project to the basal amygdala contribute to such a teaching signal for plasticity, thereby facilitating the formation of fear memories. Knowledge about the role of dopamine in aversively motivated plasticity might allow further insights into maladaptive plasticities that underlie anxiety and post-traumatic stress disorders in humans.

Fear conditioning and the basolateral amygdala

Abstract: Fear is a response to impending threat that prepares a subject to make appropriate defensive responses, whether to freeze, fight, or flee to safety. The neural circuits that underpin how subjects learn about cues that signal threat, and make defensive responses, have been studied using Pavlovian fear conditioning in laboratory rodents as well as humans. These studies have established the amygdala as a key player in the circuits that process fear and led to a model where fear learning results from long-term potentiation of inputs that convey information about the conditioned stimulus to the amygdala. In this review, we describe the circuits in the basolateral amygdala that mediate fear learning and its expression as the conditioned response. We argue that while the evidence linking synaptic plasticity in the basolateral amygdala to fear learning is strong, there is still no mechanism that fully explains the changes that underpin fear conditioning.

Associative and plastic thalamic signaling to the lateral amygdala controls fear behavior.

Abstract: Decades of research support the idea that associations between a conditioned stimulus (CS) and an unconditioned stimulus (US) are encoded in the lateral amygdala (LA) during fear learning. However, direct proof for the sources of CS and US information is lacking. Definitive evidence of the LA as the primary site for cue association is also missing. Here, we show that calretinin (Calr)-expressing neurons of the lateral thalamus (Calr+LT neurons) convey the association of fast CS (tone) and US (foot shock) signals upstream from the LA in mice. Calr+LT input shapes a short-latency sensory-evoked activation pattern of the amygdala via both feedforward excitation and inhibition. Optogenetic silencing of Calr+LT input to the LA prevents auditory fear conditioning. Notably, fear conditioning drives plasticity in Calr+LT neurons, which is required for appropriate cue and contextual fear memory retrieval. Collectively, our results demonstrate that Calr+LT neurons provide integrated CS-US representations to the LA that support the formation of aversive memories.

Pavlovian Conditioning of Immunological and Neuroendocrine Functions

Abstract: The phenomenon of behaviorally conditioned immunological and neuroendocrine functions has been investigated for the past 100 yr. The observation that associative learning processes can modify perip...

Proposing a Framework for the Restorative Effects of Nature through Conditioning: Conditioned Restoration Theory.

Abstract: Natural environments have been shown to trigger psychological and physiological restoration in humans. A new framework regarding natural environments restorative properties is proposed. Conditioned restoration theory builds on a classical conditioning paradigm, postulating the occurrence of four stages: (i) unconditioned restoration, unconditioned positive affective responses reliably occur in a given environment (such as in a natural setting); (ii) restorative conditioning, the positive affective responses become conditioned to the environment; (iii) conditioned restoration, subsequent exposure to the environment, in the absence of the unconditioned stimulus, retrieves the same positive affective responses; and (iv) stimulus generalization, subsequent exposure to associated environmental cues retrieves the same positive affective responses. The process, hypothetically not unique to natural environments, involve the well-documented phenomenon of conditioning, retrieval, and association and relies on evaluative conditioning, classical conditioning, core affect, and conscious expectancy. Empirical findings showing that restoration can occur in non-natural environments and through various sensory stimuli, as well as findings demonstrating that previous negative experience with nature can subsequently lower restorative effects, are also presented in support of the theory. In integration with other existing theories, the theory should prove to be a valuable framework for future research.

Acute Stress Enhances Associative Learning via Dopamine Signaling in the Ventral Lateral Striatum.

Abstract: Acute stress transiently increases vigilance, enhancing the detection of salient stimuli in one's environment. This increased perceptual sensitivity is thought to promote the association of rewarding outcomes with relevant cues. The mesolimbic dopamine system is critical for learning cue-reward associations. Dopamine levels in the ventral striatum are elevated following exposure to stress. Together, this suggests that the mesolimbic dopamine system could mediate the influence of acute stress on cue-reward learning. To address this possibility, we examined how a single stressful experience influenced learning in an appetitive pavlovian conditioning task. Male rats underwent an episode of restraint prior to the first conditioning session. This acute stress treatment augmented conditioned responding in subsequent sessions. Voltammetry recordings of mesolimbic dopamine levels demonstrated that acute stress selectively increased reward-evoked dopamine release in the ventral lateral striatum (VLS), but not in the ventral medial striatum. Antagonizing dopamine receptors in the VLS blocked the stress-induced enhancement of conditioned responding. Collectively, these findings illustrate that stress engages dopamine signaling in the VLS to facilitate appetitive learning.SIGNIFICANCE STATEMENT Acute stress influences learning about aversive and rewarding outcomes. Dopamine neurons are sensitive to stress and critical for reward learning. However, it is unclear whether stress regulates reward learning via dopamine signaling. Using fast-scan cyclic voltammetry as rats underwent pavlovian conditioning, we demonstrate that a single stressful experience increases reward-evoked dopamine release in the ventral lateral striatum. This enhanced dopamine signal accompanies a long-lasting increase in conditioned behavioral responding. These findings highlight that the ventral lateral striatum is a node for mediating the effect of stress on reward processing.

The Reuniens and Rhomboid Nuclei Are Required for Acquisition of Pavlovian Trace Fear Conditioning in Rats.

Abstract: The reuniens (Re) and rhomboid (Rh) nuclei (ReRh) of the midline thalamus interconnects the hippocampus (HPC) and the medial prefrontal cortex (mPFC). Several studies have suggested that the ReRh participates in various cognitive tasks. However, little is known about the contribution of the ReRh in Pavlovian trace fear conditioning, a procedure with a temporal gap between the conditioned stimulus (CS) and the unconditioned stimulus (US), and therefore making it harder for the animals to acquire. Because the HPC and mPFC are involved in trace, but not delay, fear conditioning and given the role of the ReRh in mediating this neurocircuitry, we hypothesized that ReRh inactivation leads to a learning deficit only in trace conditioning. In a series of experiments, we first examined the c-Fos expression in male Long-Evans rats and established that the ReRh was recruited in the encoding, but not the retrieval phase, of fear memory. Next, we performed behavioral pharmacology experiments and found that ReRh inactivation impaired only the acquisition, but not the consolidation or retrieval, of trace fear. However, although the ReRh was recruited during the encoding of delay fear demonstrated by c-Fos results, ReRh inactivation in any phases did not interfere with delay conditioning. Finally, we found that trace fear acquired under ReRh inactivation reprised when the ReRh was brought off-line during retrieval. Together, our data revealed the essential role of the ReRh in a learning task with temporally discontinuous stimuli.

Optogenetic activation of the basolateral amygdala promotes both appetitive conditioning and the instrumental pursuit of reward cues.

Abstract: Reward-associated stimuli can both evoke conditioned responses and acquire reinforcing properties in their own right, becoming avidly pursued. Such conditioned stimuli (CS) can guide reward-seeking behavior in adaptive (e.g., locating food) and maladaptive (e.g., binge eating) ways. The basolateral amygdala (BLA) regulates conditioned responses evoked by appetitive CS, but less is known about how the BLA contributes to the instrumental pursuit of CS. Here we studied the influence of BLA neuron activity on both behavioral effects. Water-restricted male rats learned to associate a light-tone cue (CS) with water delivery into a port. During these Pavlovian conditioning sessions, we paired CS presentations with photo-stimulation of channelrhodopsin-2 (ChR2)-expressing BLA neurons. BLA photo-stimulation potentiated CS-evoked port entries during conditioning, indicating enhanced conditioned approach and appetitive conditioning. Next, new rats received Pavlovian conditioning without photo-stimulation. These rats then received instrumental conditioning sessions where they could press an inactive lever or an active lever that produced CS presentation, without water delivery. Rats pressed more on the active versus inactive lever, and pairing CS presentation with BLA-ChR2 photo-stimulation intensified responding for the CS. This suggests that BLA-ChR2 photo-stimulation enhanced CS incentive value. In a separate experiment, rats did not reliably self-administer BLA-ChR2 stimulations, suggesting that BLA neurons do not carry a primary reward signal. Last, intra-BLA infusions of d-amphetamine also intensified lever-pressing for the CS. The findings suggest that BLA-mediated activity facilitates CS control over behavior by enhancing both appetitive Pavlovian conditioning and instrumental pursuit of CS.SIGNIFICANCE STATEMENT Cues paired with rewards can guide animals to valuable resources such as food. Cues can also promote dysfunctional reward-seeking behavior, as in overeating. Reward-paired cues influence reward seeking through two major mechanisms. First, reward-paired cues evoke conditioned anticipatory behaviors to prepare for impending rewards. Second, reward-paired cues are powerful motivators and they can evoke pursuit in their own right. Here we show that increasing neural activity in the basolateral amygdala enhances both conditioned anticipatory behaviors and pursuit of reward-paired cues. The basolateral amygdala therefore facilitates cue-induced control over behavior by both increasing anticipation of impending rewards and making reward cues more attractive.

Control of non-homeostatic feeding in sated mice using associative learning of contextual food cues.

Abstract: Feeding is a complex motivated behavior controlled by a distributed neural network that processes sensory information to generate adaptive behavioral responses. Accordingly, studies using appetitive Pavlovian conditioning confirm that environmental cues that are associated with food availability can induce feeding even in satiated subjects. However, in mice, appetitive conditioning generally requires intensive training and thus can impede molecular studies that often require large numbers of animals. To address this, we developed and validated a simple and rapid context-induced feeding (Ctx-IF) task in which cues associated with food availability can later lead to increased food consumption in sated mice. We show that the associated increase in food consumption is driven by both positive and negative reinforcement and that spaced training is more effective than massed training. Ctx-IF can be completed in ~1 week and provides an opportunity to study the molecular mechanisms and circuitry underlying non-homeostatic eating. We have used this paradigm to map brain regions that are activated during Ctx-IF with cFos immunohistochemistry and found that the insular cortex, and other regions, are activated following exposure to cues denoting the availability of food. Finally, we show that inhibition of the insular cortex using GABA agonists impairs performance of the task. Our findings provide a novel assay in mice for defining the functional neuroanatomy of appetitive conditioning and identify specific brain regions that are activated during the development of learned behaviors that impact food consumption.

The Influence of Predictability and Controllability on Stress Responses to the Aversive Component of a Virtual Fence.

Abstract: To ensure animal welfare is not compromised, virtual fencing must be predictable and controllable, and this is achieved through associative learning. To assess the influence of predictability and controllability on physiological and behavioral responses to the aversive component of a virtual fence, two methods of training animals were compared. In the first method, positive punishment training involved sheep learning that after an audio stimulus, an electrical stimulus would follow only when they did not respond by stopping or turning at the virtual fence (predictable controllability). In the second method, classical conditioning was used to associate an audio stimulus with an electrical stimulus on all occasions (predictable uncontrollability). Eighty Merino ewes received one of the following treatments: control (no training and no stimuli in testing); positive punishment training with an audio stimulus in testing (PP); classical conditioning training with only an audio stimulus in testing (CC1); and classical conditioning training with an audio stimulus followed by electrical stimulus in testing (CC2). The stimuli were applied manually with an electronic collar. Training occurred on 4 consecutive days with one session per sheep per day. Sheep were then assessed for stress responses to the cues by measuring plasma cortisol, body temperature and behaviors. Predictable controllability (PP) sheep showed no differences in behavioral and physiological responses compared with the control treatment (P < 0.05). Predictable uncontrollability of receiving the aversive stimulus (CC2) induced a higher cortisol and body temperature response compared to the control but was not different to CC1 and PP treatments. CC2 treatment sheep showed a higher number of turning behaviors (P < 0.001), and more time spent running (P < 0.001) than the control and PP treatment groups, indicating that predictability without controllability was stressful. The behavior results also indicate that predicting the event without receiving it (CC1) was less stressful than predicting the event then receiving it (CC2), suggesting that there is a cost to confirmation of uncontrollability. These results demonstrate that a situation of predictability and controllability such as experienced when an animal successfully learns to avoid the aversive component of a virtual fence, induces a comparatively minimal stress response and does not compromise animal welfare.

Sleep deprivation increases threat beliefs in human fear conditioning

Abstract: Sleep disturbances and anxiety disorders exhibit high comorbidity levels, but it remains unclear whether sleep problems are causes or consequences of increased anxiety. To experimentally probe the aetiological role of sleep disturbances in anxiety, we investigated in healthy participants how total sleep deprivation influences fear expression in a conditioning paradigm. In a fear conditioning procedure, one face stimulus (conditioned stimulus [CS+]) was paired with electric shock, whereas another face stimulus was not (unpaired stimulus [CS-]). Fear expression was tested the next morning using the two face stimuli from the training phase and a generalization stimulus (i.e. a morph between the CS+ and CS- stimuli). Between fear conditioning and test, participants were either kept awake in the laboratory for 12 hr (n = 20) or had a night of sleep at home (n = 20). Irrespective of stimulus type, subjective threat expectancies, but not skin conductance responses, were enhanced after sleep deprivation, relative to regular sleep. These results suggest that sleep disturbances may play a role in anxiety disorders by increasing perceived threat.

Evaluative conditioning of artificial grammars: Evidence that subjectively-unconscious structures bias affective evaluations of novel stimuli.

Abstract: Evaluative conditioning (EC) refers to the acquisition of emotional valence by an initially neutral stimulus (conditioned stimulus [CS]) after being paired with an emotional stimulus (unconditioned stimulus [US]). An important issue regards whether, when participants are unaware of the CS-US contingency, the affective valence can generalize to new stimuli that share similarities with the CS. Previous studies have shown that generalization of EC effects appears only when participants are aware of the contingencies, but we suggest that this is because (a) the contingencies typically used in these studies are salient and easy to detect consciously, and (b) the performance-based measures of awareness (so-called "objective measures"), typically used in these studies, tend to overestimate the amount of available conscious knowledge. We report a preregistered study in which participants (N = 217) were exposed to letter strings generated from two complex artificial grammars that are difficult to decipher consciously. Stimuli from one grammar were paired with positive USs, whereas those from the other grammar were paired with negative USs. Subsequently, participants evaluated new, previously unseen, stimuli from the positively conditioned grammar more positively than new stimuli from the negatively conditioned grammar. Importantly, this effect appeared even when trial-by-trial subjective measures indicated lack of relevant conscious knowledge. We provide evidence for the generalization of EC effects even without subjective awareness of the structures that enable those generalizations. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Learning mechanisms in nocebo hyperalgesia: the role of conditioning and extinction processes.

Abstract: Nocebo hyperalgesia is a clinically relevant phenomenon and may be formed as a result of associative learning, implemented by classical conditioning. This study explored for the first time distinct nocebo conditioning methods and their consequences for nocebo attenuation methods. Healthy participants (N = 140) were recruited and randomized to the following nocebo hyperalgesia induction groups: conditioning with continuous reinforcement (CRF), conditioning with partial reinforcement (PRF), and a sham-conditioning control group. In the attenuation phase, counterconditioning was compared with extinction. During induction, participants experienced increased thermal pain in 100% of nocebo trials in the CRF groups, while in only 70% of nocebo trials in the PRF groups. During evocation, pain stimulation was equivalent across all trials. During attenuation, pain stimulation was decreased on nocebo trials relative to control trials for the counterconditioning groups, while pain remained equivalent across all trials for the extinction groups. Results showed that both PRF and CRF significantly induced nocebo hyperalgesia, but CRF was a more potent nocebo induction method, as compared to PRF. Counterconditioning was more effective than extinction in attenuating nocebo hyperalgesia. Neither CRF nor PRF resulted in resistance to extinction. However, compared with CRF, conditioning with PRF resulted in more resistance to counterconditioning. These findings demonstrate that the more ambiguous learning method of PRF can induce nocebo hyperalgesia and may potentially explain the treatment resistance and chronification seen in clinical practice. Further research is required to establish whether attenuation with counterconditioning is generalizable to clinical settings.

A mixed filter algorithm for sympathetic arousal tracking from skin conductance and heart rate measurements in Pavlovian fear conditioning

Abstract: Pathological fear and anxiety disorders can have debilitating impacts on individual patients and society. The neural circuitry underlying fear learning and extinction has been known to play a crucial role in the development and maintenance of anxiety disorders. Pavlovian conditioning, where a subject learns an association between a biologically-relevant stimulus and a neutral cue, has been instrumental in guiding the development of therapies for treating anxiety disorders. To date, a number of physiological signal responses such as skin conductance, heart rate, electroencephalography and cerebral blood flow have been analyzed in Pavlovian fear conditioning experiments. However, physiological markers are often examined separately to gain insight into the neural processes underlying fear acquisition. We propose a method to track a single brain-related sympathetic arousal state from physiological signal features during fear conditioning. We develop a state-space formulation that probabilistically relates features from skin conductance and heart rate to the unobserved sympathetic arousal state. We use an expectation-maximization framework for state estimation and model parameter recovery. State estimation is performed via Bayesian filtering. We evaluate our model on simulated and experimental data acquired in a trace fear conditioning experiment. Results on simulated data show the ability of our proposed method to estimate an unobserved arousal state and recover model parameters. Results on experimental data are consistent with skin conductance measurements and provide good fits to heartbeats modeled as a binary point process. The ability to track arousal from skin conductance and heart rate within a state-space model is an important precursor to the development of wearable monitors that could aid in patient care. Anxiety and trauma-related disorders are often accompanied by a heightened sympathetic tone and the methods described herein could find clinical applications in remote monitoring for therapeutic purposes.

A systems-neuroscience model of phasic dopamine.

Abstract: We describe a neurobiologically informed computational model of phasic dopamine signaling to account for a wide range of findings, including many considered inconsistent with the simple reward prediction error (RPE) formalism. The central feature of this PVLV framework is a distinction between a primary value (PV) system for anticipating primary rewards (Unconditioned Stimuli [USs]), and a learned value (LV) system for learning about stimuli associated with such rewards (CSs). The LV system represents the amygdala, which drives phasic bursting in midbrain dopamine areas, while the PV system represents the ventral striatum, which drives shunting inhibition of dopamine for expected USs (via direct inhibitory projections) and phasic pausing for expected USs (via the lateral habenula). Our model accounts for data supporting the separability of these systems, including individual differences in CS-based (sign-tracking) versus US-based learning (goal-tracking). Both systems use competing opponent-processing pathways representing evidence for and against specific USs, which can explain data dissociating the processes involved in acquisition versus extinction conditioning. Further, opponent processing proved critical in accounting for the full range of conditioned inhibition phenomena, and the closely related paradigm of second-order conditioning. Finally, we show how additional separable pathways representing aversive USs, largely mirroring those for appetitive USs, also have important differences from the positive valence case, allowing the model to account for several important phenomena in aversive conditioning. Overall, accounting for all of these phenomena strongly constrains the model, thus providing a well-validated framework for understanding phasic dopamine signaling. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

To Experience or to Be Informed? Classical Conditioning Induces Nocebo Hyperalgesia even when Placebo Analgesia Is Verbally Suggested-Results of a Preliminary Study.

Abstract: Objective To investigate whether direct experience (i.e., classical conditioning) or verbal suggestion is more important in inducing nocebo hyperalgesia, five groups (total sample size, N = 99) were studied: conditioning, congruent conditioning, incongruent conditioning, verbal suggestion, and control. Methods Participants in groups with conditioning experienced more intensive pain stimuli after presentation of a white circle. In the congruent conditioning group, suggestion that the circle would precede more intensive pain stimuli was additionally provided, whereas in the incongruent conditioning group, the opposite suggestion was used. Control and verbal suggestion groups received pain stimuli of one intensity; however, the latter received suggestion that a circle would precede pain stimuli of higher intensity. Results The nocebo effect was observed in all conditioning groups, regardless of the verbal suggestions used. Moreover, the experience of hyperalgesia was able to nullify the effect of the verbal suggestion of analgesia. Incongruence between verbal suggestion and pain experience produced expectancies that affected nocebo hyperalgesia. Conclusions The results of this preliminary study suggest that direct experience seems to be more important than verbal suggestion in inducing nocebo hyperalgesia.

Beyond Freezing: Temporal Expectancy of an Aversive Event Engages the Amygdalo-Prefronto-Dorsostriatal Network.

Abstract: During Pavlovian aversive conditioning, a neutral conditioned stimulus (CS) becomes predictive of the time of arrival of an aversive unconditioned stimulus (US). Using a paradigm where animals had to discriminate between a CS+ (associated with a footshock) and a CS- (never associated with a footshock), we show that, early in training, dynamics of neuronal oscillations in an amygdalo-prefronto-striatal network are modified during the CS+ in a manner related to the CS-US time interval (30 or 10 s). This is the case despite a generalized high level of freezing to both CS+ and CS-. The local field potential oscillatory power was decreased between 12 and 30 Hz in the dorsomedial striatum (DMS) and increased between 55 and 95 Hz in the prelimbic cortex (PL), while the coherence between DMS, PL, and the basolateral amygdala was increased in the 3-6 Hz frequency range up to the expected time of US arrival only for the CS+ and not for the CS-. Changing the CS-US interval from 30 to 10 s shifted these changes in activity toward the newly learned duration. The results suggest a functional role of the amygdalo-prefronto-dorsostriatal network in encoding temporal information of Pavlovian associations independently of the behavioral output.

The effect of co-occurrence and relational information on speeded evaluation.

Abstract: After co-occurrence of a neutral conditioned stimulus (CS) with an affective unconditioned stimulus (US), the evaluation of the CS acquires the US valence. This effect disappears when information a...

Cued Fear Conditioning in Carioca High- and Low-Conditioned Freezing Rats.

Abstract: Anxiety disorders (AD) comprise a broad range of psychiatric conditions, including general anxiety (GAD) and specific phobias. For the last decades, the use of animal models of anxiety has offered important insights into the understanding of the association between these psychopathologies. Here, we investigate whether Carioca high- and low-conditioned freezing rats (CHF and CLF, respectively), a GAD animal model of anxiety, show similar high- and low-freezing behavioral phenotypes for cued auditory fear conditioning. Adult CHF (n = 16), CLF (n = 16) and normal age-matched Wistar rats (control, CTL, n = 16) were tested in a classical auditory-cued fear conditioning paradigm over 3 days (Tone + Shock and Tone only groups, n = 8 per treatment). Freezing responses were measured and used as evidence of fear conditioning. Overall, both CHF and CLF rats, as well as CTL animals displayed fear conditioning to the auditory CS. However, CLF animals showed a rapid extinction to the auditory conditioned stimulus compared to CHF and CTL rats. We discuss these findings in the context of the behavioral and neuronal differences observed in rodent lines of high and low anxiety traits.

Assaying Fear Memory Discrimination and Generalization: Methods and Concepts.

Abstract: Generalization describes the transfer of conditioned responding to stimuli that perceptually differ from the original conditioned stimulus. One arena in which discriminant and generalized responding is of particular relevance is when stimuli signal the potential for harm. Aversive (fear) conditioning is a leading behavioral model for studying associative learning and memory processes related to threatening stimuli. This article describes a step-by-step protocol for studying discrimination and generalization using cued fear conditioning in rodents. Alternate conditioning paradigms, including context generalization, differential generalization, discrimination training, and safety learning, are also described. The protocol contains instructions for constructing a cued fear memory generalization gradient and methods for isolating discrete cued-from-context cued conditioned responses (i.e., "the baseline issue"). The preclinical study of generalization is highly pertinent in the context of fear learning and memory because a lack of fear discrimination (overgeneralization) likely contributes to the etiology of anxiety-related disorders and post-traumatic stress disorder. © 2020 by John Wiley & Sons, Inc. Basic Protocol 1: Tone cued fear generalization gradient Basic Protocol 2: Quantification of freezing Support Protocol: Alternate conditioning paradigms.

A-learning: A new formulation of associative learning theory

Abstract: We present a new mathematical formulation of associative learning focused on non-human animals, which we call A-learning. Building on current animal learning theory and machine learning, A-learning is composed of two learning equations, one for stimulus-response values and one for stimulus values (conditioned reinforcement). A third equation implements decision-making by mapping stimulus-response values to response probabilities. We show that A-learning can reproduce the main features of: instrumental acquisition, including the effects of signaled and unsignaled non-contingent reinforcement; Pavlovian acquisition, including higher-order conditioning, omission training, autoshaping, and differences in form between conditioned and unconditioned responses; acquisition of avoidance responses; acquisition and extinction of instrumental chains and Pavlovian higher-order conditioning; Pavlovian-to-instrumental transfer; Pavlovian and instrumental outcome revaluation effects, including insight into why these effects vary greatly with training procedures and with the proximity of a response to the reinforcer. We discuss the differences between current theory and A-learning, such as its lack of stimulus-stimulus and response-stimulus associations, and compare A-learning with other temporal-difference models from machine learning, such as Q-learning, SARSA, and the actor-critic model. We conclude that A-learning may offer a more convenient view of associative learning than current mathematical models, and point out areas that need further development.

Nocebo hyperalgesia can be induced by classical conditioning without involvement of expectancy.

Abstract: Influential theoretical accounts take the position that classical conditioning can induce placebo effects through conscious expectancies. In the current study two different conditioning procedures (hidden and open) were used to separate expectancy from conditioning in order to reveal the role of expectancy in the formation of nocebo hyperalgesia. Eighty-seven healthy females were randomly assigned to three groups (hidden conditioning, open conditioning, and control). Participants were selected according to the Fear of Pain Questionnaire scores and assigned to two subgroups: high and low level of fear of pain (trait). They received electrocutaneous pain stimuli preceded by either an orange or blue color. During the conditioning phase, one color was paired with pain stimuli of moderate intensity (control stimuli) and the other color was paired with pain stimuli of high intensity (nocebo stimuli) in both hidden and open conditioning groups. Only participants in the open conditioning group were informed about this association, however just before the testing phase the expectancy of hyperalgesia induced in this way was withdrawn. In the control group, both colors were followed by control pain stimuli. During the testing phase all participants received a series of stimuli of the same intensity, regardless of the preceding color. Participants rated pain intensity, expectancy of pain intensity and fear (state). We found that nocebo hyperalgesia was induced by hidden rather than open conditioning. The hidden conditioning procedure did not produce conscious expectancies related to pain. Nocebo hyperalgesia was induced in participants with low and high fear of pain and there was no difference in the magnitude of the nocebo effect between both groups. Nocebo hyperalgesia was not predicted by the fear of upcoming painful stimuli.