The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.

/pdf/a-neural-substrate-of-prediction-and-reward-2tj1zqgoih.pdf

A Neural Substrate of Prediction and Reward

Well-being : the foundations of hedonic psychology

This article considers the role of the hippocampus in memory function. A central thesis is that work with rats, monkeys, and humans--which has sometimes seemed to proceed independently in 3 separate literatures--is now largely in agreement about the function of the hippocampus and related structures. A biological perspective is presented, which proposes multiple memory systems with different functions and distinct anatomical organizations. The hippocampus (together with anatomically related structures) is essential for a specific kind of memory, here termed declarative memory (similar terms include explicit and relational). Declarative memory is contrasted with a heterogeneous collection of nondeclarative (implicit) memory abilities that do not require the hippocampus (skills and habits, simple conditioning, and the phenomenon of priming). The hippocampus is needed temporarily to bind together distributed sites in neocortex that together represent a whole memory.

Memory and the hippocampus: A synthesis from findings with rats, monkeys, and humans.

the total number of papers may exceed 10,000. Nevertheless, cost consideration forced us to consider mostly published papers and technical reports in English. 4 Formula 4 in Seifert (1991) is in error—a multiplier of n, of cell size, is missing in the numerator. 5 Unfortunately, the technique of meta-analysis cannot be applied, at present time, to such effects because the distribution of dis based on a sampling of people, whereas the statistics of techniques such as ARIMA are based on the distribution of a sampling of observations in the time domain regardless of the size of the people sample involved (i.e., there is no way to compare a sample of 100 points in time with a sample of 100 people). That is, a sample of 100 points in time has the same degrees of freedom if it were based on an observation of 1 person or of 1,000 people. 258 KLUGER AND DENISI From the papers we reviewed, only 131 (5%) met the criteria for inclusion. We were concerned that, given the small percentage of usable papers, our conclusions might not fairly represent the larger body of relevant literature. Therefore, we analyzed all the major reasons to reject a paper from the meta-analysis, even though the decision to exclude a paper came at the first identification of a missing inclusion criterion. This analysis showed the presence of review articles, interventions of natural feedback removal, and papers that merely discuss feedback, which in turn suggests that the included studies represent 1015% of the empirical FI literature. However, this analysis also showed that approximately 37% of the papers we considered manipulated feedback without a control group and that 16% reported confounded treatments, that is, roughly two thirds of the empirical FI literature cannot shed light on the question of FI effects on performance—a fact that requires attention from future FI researchers. Of the usable 131 papers (see references with asterisks), 607 effect sizes were extracted. These effects were based on 12,652 participants and 23,663 observations (reflecting multiple observations per participant). The average sample size per effect was 39 participants. The distribution of the effect sizes is presented in Figure 1. The weighted mean (weighted by sample size) of this distribution is 0.41, suggesting that, on average, FI has a moderate positive effect on performance. However, over 38% of the effects were negative (see Figure 1). The weighted variance of this distribution is 0.97, whereas the estimate of the sampling error variance is only 0.09. A potential problem in meta-analyses is a violation of the assumption of independence. Such a violation occurs either when multiple observations are taken from the same study (Rosenthal, 1984) or when several papers are authored by the same person (Wolf, 1986). In the present investigation, there were 91 effects derived from the laboratory experiments reported by Mikulincer (e.g., 1988a, 1988b). This raises the possibility that the average effect size is biased, because his studies manipulated extreme negative FIs and used similar tasks. In fact, the weighted average d in Mikulincer's studies was —0.39; whereas in the remainder of the

The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory.

In this article we propose mechanisms that govern the processing of emotional information, particularly those involved in fear reduction. Emotions are viewed as represented by information structures in memory, and anxiety is thought to occur when an information structure that serves as program to escape or avoid danger is activated. Emotional processing is denned as the modification of memory structures that underlie emotions. It is argued that some form of exposure to feared situations is common to many psychotherapies for anxiety, and that confrontation with feared objects or situations is an effective treatment. Physiological activation and habituation within and across exposure sessions are cited as indicators of emotional processing, and variables that influence activation and habituation of fear responses are examined. These variables and the indicators are analyzed to yield an account of what information must be integrated for emotional processing of a fear structure. The elements of such a structure are viewed as cognitive representations of the stimulus characteristic of the fear situation, the individual's responses in it, and aspects of its meaning for the individual. Treatment failures are interpreted with respect to the interference of cognitive defenses, autonomic arousal, mood state, and erroneous ideation with reformation of targeted fear structures. Applications of the concepts advanced here to therapeutic practice and to the broader study of psychopathology are discussed.

/pdf/emotional-processing-of-fear-exposure-to-corrective-2ehs11haf7.pdf

Emotional processing of fear : exposure to corrective information

A recent report of ours’ proposed an information-processing account of temporal generalization. The account posited a clock process, which was the basic time measurement device, and working and reference memory for storing the output of the clock either temporarily or relatively permanently. Records of time intervals in working and reference memory were then compared using a binary decision process, which dictated responding or not responding. The analysis concentrated on a relativistic Weber’s law property of the data from temporal generalization, and the constraints this property imposed on sources of variance in the information-processing stages. Our purpose here is to summarize that work and generalize the model in two ways: First we consider several sources of variance operating simultaneously. The original analysis demonstrated that if only one source of variance is present, it must be a scalar source, that is, it must result in a variable memory for which variance increases with the square of the mean.’ In the generalized account proposed here, we will develop the conclusion that scalar sources dominate in some time ranges, while other sources may dominate in others. These ideas are then applied to two additional timing tasks with different characteristics.

Scalar timing in memory.

The similarity of animal counting and timing processes was demonstrated in four experiments that used a psychophysical choice procedure. In Experiment 1, rats initially learned a discrimination between a two-cycle auditory signal of 2-sec duration and an eight-cycle auditory signal of 8-sec duration. For the number discrimination test, the number of cycles was varied, and the signal duration was held constant at an intermediate value. For the duration discrimination test, the signal duration was varied, and the number of cycles was held constant at an intermediate value. Rats were equally sensitive to a 4:1 ratio of counts (with duration controlled) and a 4:1 ratio of times (with number controlled). The point of subjective equality for the psychophysical functions that related response classification to signal value was near the geometric mean of the extreme values for both number and duration discriminations. Experiment 2 demonstrated that 1.5 mg/kg of methamphetamine administered intraperitoneally shifted the psychophysical functions for both number and duration leftward by approximately 10%. Experiment 3 demonstrated that the magnitude of cross-modal transfer from auditory signals to cutaneous signals was similar for number and duration. In Experiment 4 the mapping of number onto duration demonstrated that a count was approximately equal to 200 msec. The psychophysical functions for number and duration were fit with a scalar expectancy model with the same parameter values for each attribute. The conclusion was that the same internal mechanism is used for counting and timing. This mechanism can be used in several modes: the "event" mode for counting or the "run" and the "stop" modes for timing.

A mode control model of counting and timing processes

Punishment and aversive behavior

Evidence has been cited for the following properties of the parts of the psychological process used for timing intervals: The pacemaker has a mean rate that can be varied by drugs, diet, and stress. The switch has a latency to operate and it can be operated in various modes, such as run, stop, and reset. The accumulator times up, in absolute, arithmetic units. Working memory can be reset on command or, after lesions have been created in the fimbria fornix, when there is a gap in a signal. The transformation from the accumulator to reference memory is done with a multiplicative constant that is affected by drugs, lesions, and individual differences. The comparator uses a ratio between the value in the accumulator (or working memory) and reference memory. Finally, there must be multiple switch-accumulator modules to handle simultaneous temporal processing; and the psychological timing process may be used on some occasions and not on others.

Properties of the Internal Clock

Eight rats were trained to make one response if a signal was shorter than a criterion duration and a different response if the signal was longer than the criterion. When exposed to intermediate durations, the rats bisected the interval at the geometric mean and the difference limen divided by the geometric mean was a constant. The rats learned new temporal discriminations more easily when the response maintained its relative, rather than its absolute, meaning. These data were interpreted in terms of a model of an internal clock that included a clock, a criterion, and a response rule.

Russell M. Church

Papers

Scalar timing in memory.

A mode control model of counting and timing processes

Punishment and aversive behavior

Properties of the Internal Clock

Bisection of temporal intervals