In the metaphor of behavioral momentum, the rate of a free operant in the presence of a discriminative stimulus is analogous to the velocity of a moving body, and resistance to change measures an aspect of behavior that is analogous to its inertial mass. An extension of the metaphor suggests that preference measures an analog to the gravitational mass of that body. The independent functions relating resistance to change and preference to the conditions of reinforcement may be construed as convergent measures of a single construct, analogous to physical mass, that represents the effects of a history of exposure to the signaled conditions of reinforcement and that unifies the traditionally separate notions of the strength of learning and the value of incentives. Research guided by the momentum metaphor encompasses the effects of reinforcement on response rate, resistance to change, and preference and has implications for clinical interventions, drug addiction, and self-control. In addition, its principles can be seen as a modern, quantitative version of Thorndike's (1911) Law of Effect, providing a new perspective on some of the challenges to his postulation of strengthening by reinforcement.

Behavioral momentum and the law of effect.

Behavioral momentum is the product of response rate and resistance to change. The data on relative resistance to change are summarized for pigeons responding on single-key two-component multiple schedules, in the initial links of two-key multiple chained schedules, and in equivalent components of two-key serial schedules. For single-key procedures, the ratio of resistance to change in two schedule components is shown to depend on the ratio of reinforcer rates obtained in the presence of the component stimuli. For two-key procedures, the ratio of resistance to change in equivalent components is shown to depend on the ratio of reinforcer rates correlated with key locations. A model based on stimulus-reinforcer contingencies that combines the reinforcer rates in schedule components summed over key locations and reinforcer rates correlated with key locations summed over components, each expressed relative to the session average reinforcer rate, gives a good account of the data. An extension of the relative law of effect for multiple schedules fails to provide a complete account of resistance to change, but both approaches are needed for a comprehensive understanding of behavioral momentum.

An integrative model for the study of behavioral momentum.

Differential reinforcement as treatment for behavior disorders: procedural and functional variations.

Descriptive and experimental analyses of stereotypy by a woman with severe mental retardation showed that the behavior was maintained by escape from demands. A sequence of high-probability requests issued immediately prior to a task-related request established a momentum of compliance that increased compliance with task-related demands. Increases in compliance were accompanied by collateral reductions in stereotypic behavior. A mechanism of response covariation, called functional incompatibility, and an animal analogue study for testing the validity of this mechanism are proposed.

/pdf/behavioral-momentum-in-the-treatment-of-escape-motivated-52wg3pnew3.pdf

Behavioral momentum in the treatment of escape-motivated stereotypy.

Basic research with pigeons on behavioral momentum suggests that differential reinforcement of alternative behavior (DRA) can increase the resistance of target behavior to change. This finding suggests that clinical applications of DRA may inadvertently increase the persistence of target behavior even as it decreases its frequency. We conducted three coordinated experiments to test whether DRA has persistence-strengthening effects on clinically significant target behavior and then tested the effectiveness of a possible solution to this problem in both a nonhuman and clinical study. Experiment 1 compared resistance to extinction following baseline rates of reinforcement versus higher DRA rates of reinforcement in a clinical study. Resistance to extinction was substantially greater following DRA. Experiment 2 tested a rat model of a possible solution to this problem. Training an alternative response in a context without reinforcement of the target response circumvented the persistence-strengthening effects of DRA. Experiment 3 translated the rat model into a novel clinical application of DRA. Training an alternative response with DRA in a separate context resulted in lower resistance to extinction than employing DRA in the context correlated with reinforcement of target behavior. The value of coordinated bidirectional translational research is discussed.

/pdf/differential-reinforcement-of-alternative-behavior-increases-1hpka9fit0.pdf

Differential Reinforcement of Alternative Behavior Increases Resistance to Extinction: Clinical Demonstration, Animal Modeling, and Clinical Test of One Solution

Adults with mental retardation in a group home received popcorn or coffee reinforcers for sorting plastic dinnerware. In Part 1 of the experiment, reinforcers were dispensed according to a variable-interval 60-s schedule for sorting dinnerware of one color and according to a variable-interval 240-s schedule for sorting dinnerware of a different color in successive components of a multiple schedule. Sorting rates were similar in baseline, but when a video program was shown concurrently, sorting of dinnerware was more resistant to distraction when correlated with a higher rate of reinforcement. In Part 2 of the experiment, popcorn or coffee reinforcers were contingent upon sorting both colors of dinnerware according to variable-interval 60-s schedules, but additional reinforcers were given independently of sorting according to a variable-time 30-s schedule during one dinnerware-color component. Baseline sorting rate was lower but resistance to distraction by the video program was greater in the component with additional variable-time reinforcers. These results demonstrate that resistance to distraction depends on the rate of reinforcers obtained in the presence of component stimuli but is independent of baseline response rates and response-reinforcer contingencies. Moreover, these results are similar to those obtained in laboratory studies with pigeons, demonstrating that the determination of resistance to change by stimulus-reinforcer relations is not confined to controlled laboratory settings or unique to the pigeon.

Elizabeth Pinter Lalli

Papers

The momentum of human behavior in a natural setting.