Journal ArticleDOI
A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.
John M. Pearce,Geoffrey Hall +1 more
Reads0
Chats0
TLDR
A new model is proposed that deals with the explanation of cases in which learning does not occur in spite of the fact that the conditioned stimulus is a signal for the reinforcer by specifying that certain procedures cause a conditioned stimulus to lose effectiveness.Abstract:
Several formal models of excitatory classical conditioning are reviewed. It is suggested that a central problem for all of them is the explanation of cases in which learning does not occur in spite of the fact that the conditioned stimulus is a signal for the reinforcer. We propose a new model that deals with this problem by specifying that certain procedures cause a conditioned stimulus (CS) to lose effectiveness; in particular, we argue that a CS will lose associability when its consequences are accurately predicted. In contrast to other current models, the effectiveness of the reinforcer remains constant throughout conditioning. The second part of the article presents a reformulation of the nature of the learning produced by inhibitory-conditioning procedures and a discussion of the way in which such learning can be accommodated within the model outlined for excitatory learning.read more
Citations
More filters
Journal ArticleDOI
Predictive Reward Signal of Dopamine Neurons
TL;DR: Dopamine systems may have two functions, the phasic transmission of reward information and the tonic enabling of postsynaptic neurons.
Journal ArticleDOI
Whatever next? Predictive brains, situated agents, and the future of cognitive science
TL;DR: This target article critically examines this "hierarchical prediction machine" approach, concluding that it offers the best clue yet to the shape of a unified science of mind and action.
Journal ArticleDOI
Getting Formal with Dopamine and Reward
TL;DR: Recent neurophysiological studies reveal that neurons in certain brain structures carry specific signals about past and future rewards, and the optimal use of rewards in voluntary behavior would benefit from interactions between the signals.
Journal ArticleDOI
Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex
TL;DR: The basolateral amygdala (BLA) appears to be required for a Pavlovian conditioned stimulus to gain access to the current value of the specific unconditioned stimulus (US) that it predicts, while the central nucleus of the amygdala acts as a controller of brainstem arousal and response systems, and subserves some forms of stimulus-response Pavlovia conditioning.
Journal ArticleDOI
Discrete coding of reward probability and uncertainty by dopamine neurons.
TL;DR: Using distinct stimuli to indicate the probability of reward, it was found that the phasic activation of dopamine neurons varied monotonically across the full range of probabilities, supporting past claims that this response codes the discrepancy between predicted and actual reward.
References
More filters
Journal ArticleDOI
Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory.
TL;DR: Tested the 2-process theory of detection, search, and attention presented by the current authors (1977) in a series of experiments and demonstrated the qualitative difference between 2 modes of information processing: automatic detection and controlled search.
Book
Perception and communication
TL;DR: In this paper, the authors describe a transition between behaviourist learning theory and the modern information processing or cognitive approach to perception and communication skills, and provide a principal starting point for theoretical and experimental work on selective attention.
Journal ArticleDOI
Controlled and automatic human information processing: I. Detection, search, and attention
Journal Article
Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention.
TL;DR: A series of studies using both reaction time and accuracy measures is presented, which traces these concepts in the form of automatic detection and controlled, search through the areas of detection, search, and attention and resolves a number of apparent conflicts in the literature.