Measuring the reliability of observational data: a reactive process.
TLDR
Reliability of observational data was measured simultaneously by two assessors under two experimental conditions, indicating that observers modified their observational criteria to approximate those of the identified assessor.Abstract:
Reliability of observational data was measured simultaneously by two assessors under two experimental conditions. During overt assessment, observers were told that reliability would be measured by one of the two assessors, thus permitting computation of reliability with an identified and an unidentified assessor. During covert assessment, observers were not informed of the reliability measured. Throughout the study, each of the assessors employed a unique version of a standard observational code. In the overt assessment condition, reliability of observers with the identified assessor was consistently higher than reliability with the unidentified assessor, indicating that observers modified their observational criteria to approximate those of the identified assessor. In the covert assessment condition, reliability with the two assessors was substantially lower than during overt assessment. Further, observers consistently recorded lower frequencies of disruptive behavior than the two assessors during covert assessment.read more
Citations
More filters
Book
Handbook of psychological assessment
TL;DR: In this article, the authors present an overview of the role of clinical assessment and treatment planning in clinical practice, as well as a systematic approach to treatment planning and evaluation of psychological tests.
Journal ArticleDOI
The integrity of independent variables in behavior analysis.
TL;DR: The feasibility and utility of ensuring the integrity of the independent variable is described and a survey of articles in the Journal of Applied Behavior Analysis demonstrated that the majority of articles published do not use any assessment of the actual occurrence of theindependent variable and a sizable minority do not provide operational definitions of theIndependent variable.
Journal ArticleDOI
Interobserver agreement, reliability, and generalizability of data collected in observational studies.
TL;DR: In this paper, the authors discussed three coefficients that purport to reflect the quality of data collected in these observational studies: the interobserver agreement percentage, the reliability coefficient, and the generalizability coefficient.
Journal ArticleDOI
The reliability of peer review for manuscript and grant submissions: A cross-disciplinary investigation
TL;DR: The reliability of peer review of scientific documents and the evaluative criteria scientists use to judge the work of their peers are critically reexamined with special attention to the consistently low levels of reliability that have been reported.
Journal ArticleDOI
ARTIFACT, BIAS, AND COMPLEXITY OF ASSESSMENT: THE ABCs OF RELIABILITY
TL;DR: Evidence pertaining to various sources of artifact and bias, as well as characteristics of assessment that influence interpretation of interobserver agreement are reviewed, including reactivity of reliability assessment, observer drift, complexity of response codes and behavioral observations, observer expectancies and feedback, and others.
References
More filters
Journal ArticleDOI
Good behavior game: effects of individual contingencies for group consequences on disruptive behavior in a classroom.
TL;DR: Out-of-seat and talking-out behaviors were studied in a regular fourth-grade class that included several "problem children" and a contingency was arranged for the inappropriate behavior of each child while the consequence was shared by all members of this team as a group.
Journal ArticleDOI
Effects of teacher attention on study behavior.
TL;DR: Reinstatement of teacher attention as reinforcement for study once again markedly increased study behavior and indicated that the higher study rates were maintained after the formal program terminated.
Journal ArticleDOI
Current behavior modification in the classroom: be still, be quiet, be docile
TL;DR: It is argued therefore, that behavior modification has supported rather than changed the questionable status quo and the role of behavior modification in the development of open classrooms is discussed.
Journal ArticleDOI
Behavior modification of an adjustment class: a token reinforcement program.
TL;DR: The token reinforcement program was equally successful for all children observed, and anecdotal evidence suggests that the children's appropriate behavior generalized to other school situations.
Journal ArticleDOI
Behavior modification in the classroom: a rejoinder to winett and winkler†
TL;DR: This author questions the desirability of the "informal" or "free" classroom approach for children with marked social and academic problems and suggests a free classroom in which learning is accompanied by "singing, laughing, and whistling".