Probability Relations within Response Sequences under Ratio Reinforcement.
01 Apr 1958-Journal of the Experimental Analysis of Behavior (Society for the Experimental Analysis of Behavior)-Vol. 1, Iss: 2, pp 109-121
About: This article is published in Journal of the Experimental Analysis of Behavior.The article was published on 1958-04-01 and is currently open access. It has received 264 citations till now. The article focuses on the topics: Reinforcement.
Citations
More filters
TL;DR: In this article, the authors present a theory by which to understand how pigeons learn response patterns in simple choice situations, assuming that, in a choice situation, patterns of responses compete for the final common path; the competition is governed by two variables, the overall reinforcement probability obtained by emitting the patterns, and the differences in reinforcement probabilities among the patterns.
Abstract: This study presents a theory by which to understand how pigeons learn response patterns in simple choice situations. The theory assumes that, in a choice situation, patterns of responses compete for the final common path; that the competition is governed by two variables, the overall reinforcement probability obtained by emitting the patterns,T, and the differences in reinforcement probabilities among the patterns,D; and that the ratioD/T determines the final strength of specific response patterns. To test these predictions, three experiments were run in which pigeons were more likely to receive food when they pecked the momentarily least-preferred of three response keys. On the basis of previous research, it was predicted that the birds would be indifferent among the keys (molar aspect) and would also acquire a response pattern that consisted of pecking each key once during three consecutive trials (molecular aspect). The present theory went further and predicted that the strength of that pattern would increase with the ratioD/T. In the first two experiments,D was manipulated whileT remained constant, and in the third,T was manipulated whileD remained constant. The results agreed with the theory, for the strength of the response pattern increased withD and decreased withT, whereas overall choice proportions were always close to the matching equilibrium.
6 citations
Cites background from "Probability Relations within Respon..."
...To illustrate, as the number of cues that must be remembered increases, variability in the performance of the pattern typically increases (see, e.g., Gallistel, 1990; Mechner, 1958; Shimp, 1982a)....
[...]
TL;DR: This supplement is a companion piece to NeuroAccounting: Consilience Between the Biologically-Evolved Brain and Culturally-Ev evolved Accounting Principles and provides brief summaries of five studies from neuroscience along with key aspects of the findings that are cited in the paper.
Abstract: This supplement is a companion piece to NeuroAccounting: Consilience Between the Biologically-Evolved Brain and Culturally-Evolved Accounting Principles. We provide brief summaries of five studies from neuroscience along with key aspects of the findings that are cited in the NeuroAccounting paper.
6 citations
TL;DR: Results of a control condition with relaxed temporal constraints for mutual reinforcement showed decreases in rates and proportion of coordinated responses, suggesting that the coordinated responses were controlled by the mutual reinforcement contingencies.
Abstract: Coordinated responses of 5 dyads of rats were investigated under fixed-ratio (FR) schedules of mutual water reinforcement. Coordinated responding was defined as 2 consecutive lever-presses, 1 from each of 2 rats, occurring <.5 s apart. In the FR schedules, each coordinated episode was defined as 1 response in the FR sequence. The size of FR schedules was parametrically manipulated assuming the values of FR 1, 6, 12, 18, 24, 30, 50, and 9, in this order. Each FR remained in effect until responding reached stability. Under all conditions, pairs of rats received access to water simultaneously (mutual reinforcement). Rates and proportions of coordinated responding showed a bitonic inverted U-shaped function of ratio size. Postreinforcement pauses increased systematically as the interreinforcement interval increased. Local rates and proportions increased as a function of response location within ratios. Results of a control condition with relaxed temporal constraints for mutual reinforcement showed decreases in rates and proportion of coordinated responses, suggesting that the coordinated responses were controlled by the mutual reinforcement contingencies. The present experiment showed that coordinated responding is quantitatively affected by 3 properties of FR schedules: response requirement, reinforcement rates, and proximity to reinforcement.
6 citations
TL;DR: The quality of the empirical results has increased substantially since the first experiments in the field, and the available research methods are likely to lead to further progress in the developments of quantitative theories of animal cognition.
5 citations
5 citations
References
More filters
340 citations
203 citations
TL;DR: I am indebted to Professor Lighthill for some further illuminating remarks regarding this point and his comments on Heisenberg's Theory of Isotropic Turbulence are highly illuminating.
Abstract: 1 G. K. Batchelor, The Theory of Homogeneous Turbulence (Cambridge: At the University Press, 1954). 2 G. K. Batchelor and A. A. Townsend, \"Decay of Turbulence in the Final Period of Decay,\" Proc. Roy. Soc. London, A, 194, 527-543, 1948. 3 W. Heisenberg, \"Zur statistischen Theorie der Turbulenz,\" Z. Physik, 124, 628-657, 1948. 4W. H. Reid, \"Two Remarks on Heisenberg's Theory of Isotropic Turbulence,\" Quart. Appl. Math. 14, 201-205, 1956. 6 Cf. M. J. Lighthill, Nature, 173, 746, 1954. I am indebted to Professor Lighthill for some further illuminating remarks regarding this point.
133 citations
129 citations