Showing papers in "Journal of the Experimental Analysis of Behavior in 1970"

On the law of effect

Abstract: Experiments on single, multiple, and concurrent schedules of reinforcement find various correlations between the rate of responding and the rate or magnitude of reinforcement. For concurrent schedules (i.e., simultaneous choice procedures), there is matching between the relative frequencies of responding and reinforcement; for multiple schedules (i.e., successive discrimination procedures), there are contrast effects between responding in each component and reinforcement in the others; and for single schedules, there are a host of increasing monotonic relations between the rate of responding and the rate of reinforcement. All these results, plus several others, can be accounted for by a coherent system of equations, the most general of which states that the absolute rate of any response is proportional to its associated relative reinforcement.

On chomsky's review of skinner's verbal behavior

Abstract: Skinner's book, Verbal Behavior, was published in 1957. Chomsky's review of it appeared in 1959. By the criterion of seminal influence in generating controversy and stimulating publication, both must be counted major successes, although the reputation and influence of the review are more widely acknowledged. It has been reprinted at least three times (The Bobbs-Merrill Reprint Series in the Social Sciences, No. A-34; Fodor and Katz, 1964; Jakobovits and Miron, 1967), and Chomsky has recently written (in Jakobovits and Miron, 1967, p. 142) that he would take back little of it if he were rewriting it now. Skinner's Verbal Behavior is an analysis of speech in terms of its "controlling relations" which include the speaker's current motivational state, his current stimulus circumstances, his past reinforcements, and his genetic constitution. Skinner has accepted the constraints of natural science in his basic analytical apparatus in that all of its terms are empirically definable. He intends to account only for the objective dimensions of verbal behavior and to invoke only objective, nonmentalistic and nonhypothetical entities to account for it. The notion of control, anathema to the politically oversensitive, means only "causation" in its purely functional sense, and need not alarm. It is not arguable nor criticizable that behavior is an orderly, controlled datum, sensitive to the circumstances of the behaver;

A functional analysis of language.

Abstract: Language has been given a largely structural definition by linguistics, but in order to have a psyclhological theory of language, the structural emphasis must be replaced by a functional one. What must an organism do in order to give evidence that it has language? More specifically, when is a response a word? A sequence of responses a sentence? What makes one response sequence an assertion or predication, another an imperative, still another a question? In this paper I try to give these questions the most general answers possible, general in the sense of relieving them of their exclusively human form. The functions an organism carries out when engaged in language need to be separated from the form these functions take in man. Not only human phonology but quite possibly human syntax may be unique to man; both may encompass mechanisms not found in any other species (Chomsky, 1965; Lenneberg, 1968). But if this is so, it does not commit the mechanisms of logic and semantics to the same status. The latter may be more widely distributed and it may be them, not the human form of syntax and phonology, upon which the basic functions of language depend.

Inhibition and the stimulus control of operant behavior.

Abstract: A variety of methods, definitions, and theoretical notions that have been used in the study of inhibitory stimulus control were reviewed and evaluated. Preliminary data from several new operant methods were also described. It was proposed that future workers distinguish clearly between two forms of inhibitory control: (a) the learned power of a specific stimulus to reduce behavior, and (b) a dimensional effect, in which responding increases as values progressively more distant from the value of that specific stimulus along some dimension are presented (generalization gradient). Conclusions from several important recent studies were shown to be strongly dependent on the individual experimenter's criterion for deciding when a stimulus is inhibitory. The concept of inhibition seems a very valuable one for the field of operant behavior, and it deserves more attention than it has received in the past.

Negative reinforcement without shock reduction

Abstract: Stable lever-press responding in rats was reliably produced and maintained by a procedure in which responses could delay shocks without affecting overall shock frequency. Responding was not maintained when the delay-of-shock involved an increase in overall shock frequency.

Conditioned nalorphine-induced abstinence changes: persistence in post morphine-dependent monkeys1

Abstract: Every tenth lever-press of three morphine-dependent rhesus monkeys was reinforced with food. A red light, initially a neutral stimulus, was presented every third or fourth session for 5 min before and 5 min after an intravenous injection of nalorphine, a morphine antagonist that produces an immediate abstinence syndrome in morphine-dependent monkeys. After several pairings, conditioned suppression of lever pressing, heart-rate decrease, vomiting, and excessive salivation were observed during the red-light period before nalorphine injection. No conditioned electrocardiogram, respiration or temperature changes occurred. After 10 red light-nalorphine pairings, morphine administration was completely discontinued and monkeys were then tested monthly for persistence of the conditioned responses. The red light paired with saline injection continued to suppress lever pressing and to produce heart-rate decreases after 60 to 120 days of complete abstinence from morphine. Subsequently, daily presentations of the red light-saline injection complex rapidly extinguished these conditioned responses. Nevertheless, they could be rapidly reinstated by additional nalorphine injections.

A comparison of variable-ratio and variable-interval schedules of reinforcement.

Abstract: Four pigeons responded under a two-component multiple schedule of reinforcement. Responses were reinforced in one component under a variable-ratio schedule and in the other component under a variable-interval schedule. It was found that when rates of reinforcement were equal in the two components, the rate of response in the variable-ratio component was nearly twice that in the variable-interval component. Furthermore, for three of the four subjects, the function relating response rate to relative rate of reinforcement in the variable-ratio component had a slope 2.5 to 3 times the slope of the corresponding function for the variable-interval component.

Choice for periodic schedules of reinforcement1

Abstract: Pigeons' responses in the presence of two concurrently available (initial-link) stimuli produced one of two different (terminal-link) stimuli according to identical but independent variable-interval schedules. Responding in the mutually exclusive terminal links was reinforced with food according to fixed-ratio schedules for six pigeons and according to fixed-interval schedules for two pigeons. None of the pigeons matched the proportion of (choice) responses in the initial links to the proportion of the rates of reinforcement obtained during the terminal links. Instead, as the values of each of the terminal-link schedules were increased by a constant amount, the choice proportions for the stimulus associated with the smaller of the two values increased, even though the relative rates of reinforcement during the terminal links decreased. These results are incompatible with those from previous studies with aperiodic (variable-interval or variable-ratio) schedules. The present results do suggest, however, that in transforming aperiodic schedules into their periodic equivalents, it may be necessary to consider the size of the smallest interreinforcement interval comprising the terminal-link schedules.

Superstitious key pecking after three peck-produced reinforcements.

Abstract: The first three pecks on a response key by experimentally naive pigeons produced grain reinforcements. Thereafter, for approximately 50 experimental sessions and under a variety of schedule conditions, grain was presented independently of the subjects' behaviors. The pigeons continued to peck the response key "superstitiously" throughout the 50 sessions. The results suggest that superstitions are commonplace-not relatively infrequent or abnormal events-in the behavior of pigeons.

Choice, rate of reinforcement, and the changeover delay

Abstract: Pigeons distribute their responses on concurrently available variable-interval schedules in the same proportion as reinforcements are distributed on the two schedules only when a changeover delay is used. The present study shows that this equality between proportions of responses and proportions of reinforcements (“matching”) is obtained when the value of the changeover delay is varied. When responses are partitioned into the set of rapid response bursts occurring during the delay interval and the set of responses occurring subsequently, the proportion of neither set of responses matches the proportion of reinforcements. Instead, each set deviates from matching but in opposite directions. Matching on the gross level results from the interaction of two patterns evident in the local response rates: (I) the lengthening of the changeover delay response burst is accompanied by a commensurate decrease in the number of changeovers; (2) the changeover delay response burst is longer than the scheduled delay duration. When delay responses are eliminated by introducing a blackout during the delay interval, response matching is eliminated; the pigeon, however, continues to match the proportion of time spent responding on a key to the proportion of reinforcements obtained on that key.

Conditioned suppression and conditioned enhancement with the same positive UCS: an effect of CS duration.

Abstract: Previous experiments have shown that positively reinforced operant responding is suppressed during a conditioned stimulus terminated with an electric shock (conditioned suppression). In the present experiment, the conditioned stimulus was terminated with a positive unconditioned stimulus, and it was found that the duration of the conditioned stimulus was a key factor in determining whether response suppression or response enhancement was observed during the stimulus. The lever-pressing responses of rats were maintained by a variable-interval schedule of food reinforcement. While the rats were pressing the lever, a light was occasionally turned on, its offset coincident with a brief period of access to a sucrose solution. In consecutive blocks of sessions, the light duration was 40 sec, 12 sec, or 120 sec. Results showed that the rate of lever pressing was substantially suppressed during the 12-sec stimulus, slightly suppressed during the 40-sec stimulus, and enhanced during the 120-sec stimulus.

An extinction-induced increase in an aggressive response with humans

Abstract: Nine subjects, 14 to 18 yr old, pulled a knob on a schedule of monetary reinforcement. Concurrently, they escaped or avoided periodic presentations of a tone by pressing a button that required 1.5 lb (6.67 N) of force or by punching a padded cushion that required 20 lb (88.96 N) of force. The punching response was designated as an aggressive response because the force of this response together with its topography was comparable to responses of humans that deface objects and produce escape or counter aggression from other humans. It was found that button pressing was the preferred concurrent avoidance response and there were few punches. However, when the monetary reinforcer was discontinued (extinction) punching increased for seven of the nine subjects, but there was no consistent change in the rate of button pressing. When the punching response was replaced by another non-preferred but non-aggressive response, neither this response nor button pressing increased during extinction. Hence, the increase in punching during extinction cannot be attributed solely to the fact that it was a concurrent response or a non-preferred response.

Effect of reinforcement duration on fixed-interval responding.

Abstract: Five different reinforcement durations occurred randomly within each session on fixed interval 60-sec. Postreinforcement pause was directly related (and “running” rate inversely related) to the duration of reinforcement initiating each fixed interval.

Instructional control of human operant responding during extinction following fixed-ratio conditioning.

Abstract: When given pre-conditioning instructions correctly indicating the maximum number of reinforcements obtainable, subjects made few responses during extinction following FR 10 conditioning. More extinction responses occurred when the maximum-reinforcement instructions suggested that reinforcements were obtainable during extinction. The highest rates of responding during extinction were produced by subjects who had no maximum-reinforcement instructions.

Preference for fixed-interval schedules of reinforcement.

Abstract: Pigeons were trained on a two-link concurrent chain schedule in which responding on either of two keys in the initial link occasionally produced a terminal link, signaled by a change in the color of that key and a darkening of the other. Further responding on the lighted key was reinforced with food according to a fixed-interval schedule. For one of the keys, this fixed interval was always 20 sec, while for the other it was held at values of 5, 14, 30, or 60 sec for several weeks. In the initial link, all pigeons responded relatively more often on the key with the shorter fixed interval than was predicted by the matching hypothesis. Responding in the initial link showed a large negative recency effect: pigeons responded less frequently on the key that provided their last reinforcement than predicted from the overall response rates.

Pigeon concept formation: successive and simultaneous acquisition.

Abstract: Pigeons were trained to discriminate the presence of one or more human forms in displays projected on a panel above the response key. This task was mastered, although imperfectly, with successive and with simultaneous presentations of positive and negative instances. The course of acquisition of the discrimination was similar for the two training procedures. Animals were able to transfer the discrimination from the successive to the simultaneous situation. Various tests were carried out to control for artifactual cues on which the discrimination might have been based. The discrimination was maintained when new displays were presented, when reinforcement was omitted, and when displays were inverted 180°. Animals were also able to discriminate between pairs of displays that were identical, except that one member of the pair contained a human form. The research extends the techniques used by Herrnstein and Loveland (1964), and confirms their finding that pigeons can master the concept of “person-present” in a visual display.

Generalization and response mediation of a conditional discrimination.

Abstract: Fifteen pigeons were given conditional discrimination training in which a colored sample stimulus determined which of two line comparison stimuli (vertical and horizontal) was correct. As part of the conditional discrimination procedure, birds were required to make an "observing response" to the sample stimulus presented on a wide key. The location on this key of the required observing response for the two sample stimuli differed by 0, 3, or 6 in. (0, 7.6, or 15.2 cm) for three groups of birds. Accuracy of conditional discrimination performance was directly related to the amount of separation. In subsequent generalization tests with novel sample stimuli, both observing-response location and comparison responding changed within the same region of the wavelength continuum from that appropriate for one of the training samples to that appropriate for the other. A maintained generalization test (continued reinforcement for training stimuli) revealed this relation more strongly. A test in which observing-response location was the only sample stimulus of a conditional discrimination revealed stimulus control by this observing response, supporting a response mediation interpretation of the data.

Schedule-induced aggression as a function of fixed-ratio value.

Abstract: Pigeons responding for food on fixed-ratio reinforcement schedules attacked live target birds when the ratio value was increased, but not when the value was decreased. The frequency of attacks peaked several days after ratio value change, and then gradually decreased to an original level.

Polydipsia induced in the rat by a second-order schedule.

Abstract: Drinking was studied in rats pressing a bar on a second-order schedule in which every third completion of a 1-min fixed interval was followed by food presentation. A brief flash of light signaled the completion of each fixed-interval component. The rats drank not only after the food presentations but also after presentations of the light flash alone. A high rate of steady drinking followed intervals terminated by a food presentation. Drinking that followed intervals terminated by a light flash alone was of comparable rate, but characteristically interrupted by bar pressing. When 250-mg food pellets were used instead of 45-mg pellets, both drinking and bar-pressing rates increased substantially.

The response-reinforcement dependency in fixed-interval schedules of reinforcement.

Abstract: Pigeons were exposed to four different schedules of food reinforcement that arranged a fixed minimum time interval between reinforcements (60 sec or 300 sec). The first was a standard fixed-interval schedule. The second was a schedule in which food was presented automatically at the end of the fixed time interval as long as a response had occurred earlier. The third and fourth schedules were identical to the first two except that the first response after reinforcement changed the color on the key. When the schedule required a peck after the interval elapsed, the response pattern consisted of a pause after reinforcement followed by responding at a high rate until reinforcement. When a response was not required after the termination of the interval, the pattern consisted of a pause after reinforcement, followed by responses and then by a subsequent pause until reinforcement. Having the first response after reinforcement change the color on the key had little effect on performance. Post-reinforcement pause duration varied with the minimum interreinforcement interval but was unaffected by whether or not a response was required after the interval elapsed.

Wavelength generalization and preference in monochromatically reared ducklings.

Abstract: Two experiments determined the effects of early color experience on gradients of wavelength generalization. In each experiment, one group of ducklings was raised in monochromatic (589 nanometers) sodium-vapor light and a second group, in white light. In Exp. I, ducklings pecked a key transilluminated by 589 nanometers. In a subsequent test, the group raised in white light produced steeper gradients. However, several monochromatically reared ducklings produced gradients as steep as those for the white-reared ducklings. In Exp. II, ducklings pecked a white line. In a subsequent test, using a fully illuminated key, subjects in both groups responded more often to “green” (510, 530, 550, or 570 nanometers) than to “non-green” wavelengths (490, 589, 610, or 650 nanometers). Ducklings raised in monochromatic light preferred shorter “green” wavelengths than ducklings raised in white light. This difference between the “green” preferences for the two groups accounted for most of the differences between the gradients of wavelength generalization obtained from the two groups in Exp. I after training at 589 nanometers.

Aggression during the fixed-ratio and extinction components of a multiple schedule of reinforcement.

Abstract: Pigeons were trained to key peck for food on multiple reinforcement schedules including components of continuous and fixed-ratio reinforcement and extinction. At the end of the chamber opposite the response key was a restrained target pigeon. The target restraining equipment was designed to record automatically blows struck against the target. When the experimental pigeons were paired with restrained target pigeons they attacked the target. Attack occurred during extinction after both continuous and fixed-ratio reinforcement. Attack also occurred occasionally during fixed-ratio 25 and fixed-ratio 40 and frequently during fixed-ratio 60 and fixed-ratio 120. No attack occurred during fixed-ratio 15 and continuous reinforcement. After a history of stable responding without a target bird present, the introduction of a target bird resulted in severely strained key-peck responding characterized by long periods of neither key pecking nor aggressing.

A response-initiated fixed-interval schedule of reinforcement.

Abstract: On a tandem fixed-ratio one fixed-interval schedule, the first response after reinforcement initiates a fixed interval of time and the first response after the interval has elapsed is reinforced. Pigeons trained with that schedule of food reinforcement paused after reinforcement for a period of time that approximated the fixed-interval duration for values of that duration ranging from 3.75 to 60 sec. Cumulative records revealed response patterns best described as break-and-run.

Operant acceleration during a pre-reward stimulus

Abstract: Stimuli of 20, 40, and 80 sec duration terminated with five non-response-contingent food pellets were superimposed upon lever pressing reinforced with single pellets on a DRL 30-sec schedule. Two rhesus monkeys served as subjects. No change in response frequency was observed during the 20- and 40-sec stimuli. During the 80-sec pre-food stimulus, overall response frequency increased to approximately 150% and 220% of pre-stimulus levels, and the temporal distributions of interresponse times shifted toward the shorter intervals. When the 80-sec stimulus was no longer terminated with food, the response frequency decreased and the temporal distributions of interresponse times gradually approached pre-stimulus levels. An increased frequency of short interresponse times and an increase in response rate was again observed when the pellet termination procedure was reinstituted with the 80-sec stimulus. No change in response frequency or interresponse times was observed in the absence of the conditioning stimulus, and performance efficiency, as reflected in the ratio of responses to reinforcements during non-stimulus periods, remained stable throughout the experiment.

Rate-dependent effects of drugs: modification by discriminative stimuli of the effects of amobarbital on schedule-controlled behavior.

Abstract: Food-deprived pigeons responded under a 10-min fixed-interval schedule of food presentation. During even-numbered minutes of the schedule, the discriminative stimuli were the same as those present when food was delivered. During odd-numbered minutes there was either a change in keylight color or a change in overhead illumination, either for the entire duration of the odd-numbered minutes, or for 3-sec after each response. Responding during even-numbered minutes showed the usual pattern of positive acceleration; responding during odd-numbered minutes was similarly graded, but rates were much lower. The response-rate-increasing effects of amobarbital were inversely related to control rates of responding for both even- and odd-numbered minutes. However, when the stimulus change during odd-numbered minutes was either keylight color or a change from a darkened to a brightly illuminated chamber, increases in responding were considerably less than predicted on the basis of the effects on responding during even-numbered minutes. When the stimulus change was from a darkened to a dimly illuminated chamber, control rates of responding changed little, but increases in responding during odd-numbered minutes after amobarbital were considerably greater, and of the approximate order expected on the basis of control rate.

Discrimination of auditory intensities by rats.

Abstract: Rats were trained to press one of two keys when a standard intensity value of a 4.0-kHz sine tone (70 or 100 db re 2 x 10(-4) microbar) was presented from a centrally located loudspeaker. Pressing the other key was reinforced when comparison intensity values (as much as 30 db less than the standard value) were presented. The animals initiated tone presentations by breaking a light beam at the rear of the chamber. Correct choices produced brain-stimulation reinforcement, and errors produced a timeout. A procedure designed by Jenkins was used to partial out choice data under potential control of sequential cues in the stimulus series. When the standard-comparison intensity difference was varied, the rats showed similar psychometric functions despite wide differences in response bias (relative position preference). A signal detection analysis showed that response biases for individual animals remained fairly consistent during psychophysical testing. The trend of decreasing choice accuracy at small intensity differences was described by the cumulative normal probability function. The similarity of psychometric functions obtained with 70- and 100-db standards supported Weber's law. There was some evidence that response latencies were controlled by intensity differences even when choice behavior was undifferentiated.

Punishment of elicited aggression.

Abstract: Aversive shocks are known to produce aggression when the shocks are not dependent on behavior and to suppress behavior when the shocks are arranged as a dependent punisher. These two processes were studied by presenting non-dependent shock to monkeys at regular intervals, thereby producing biting attacks on a pneumatic tube. Immediate shock punishment was stimultaneously delivered for each biting attack. The attacks were found to decrease as a function of increasing punishment intensity. These results show that aggression is eliminated by direct punishment of the aggression even when the stimulus that is used as a punisher otherwise causes the aggression.

Summation of responding maintained by fixed-interval schedules.

Abstract: A light and tone were separately correlated with responding maintained by fixed-interval schedules, in which the level of responding varied continuously throughout the duration of the interval. Responding during the presence of the single stimuli and their compound was compared during the successive segments of the interval. The following results were obtained: (1) more responses were emitted during compounding than were emitted during either stimulus alone in all segments of the interval; (2) increases in the number of responses across the interval during compounding paralleled increases during single-stimulus presentations. The sum of the responses emitted during the single stimuli was similar to the number of responses emitted during compounding, suggesting that the response tendencies correlated with the single stimuli combined in a summative or additive fashion.

Signalled and unsignalled free-operant avoidance in the pigeon.

Abstract: Pigeons were trained to depress a lever to avoid electric shock under free-operant avoidance schedules without a warning signal, or with a warning signal that could be terminated only by a response. Most birds in the signalled avoidance procedure terminated more than 50% of the warning signals before shock. In the unsignalled avoidance procedure, several birds formed a temporal discrimination and received relatively few shocks; other birds responded only in post-shock bursts, and received many more shocks.