Sequential analysis and observational methods for the behavioral sciences
01 Oct 2011-
TL;DR: In this paper, the authors present a survey of observational methods for point-by-point agreement in coding schemes and enumeration of individual codes, as well as summary statistics for individual codes.
Abstract: 1. Introduction to observational methods 2. Coding schemes and observational measurement 3. Recording observational data 4. Representing observational data 5. Observer agreement and Cohen's kappa 6. Kappas for point-by-point agreement 7. The intraclass correlation coefficient (ICC) for summary measures 8. Summary statistics for individual codes 9. Cell and summary statistics for contingency tables 10. Preparing for sequential and other analyses 11. Time-window and log-linear sequential analysis 12. Recurrence analysis and permutation tests.
Citations
More filters
TL;DR: Wide variation in the quality of nonverbal and verbal interactions at 24 months accounted for 27% of the variance in expressive language 1 year later, and indicators of quality were considerably more potent predictors of later language ability than was the quantity of mothers’ words during the interaction or sensitive parenting.
Abstract: The disparity in the amount and quality of language that low-income children hear relative to their more-affluent peers is often referred to as the 30-million-word gap. Here, we expand the literature about this disparity by reporting the relative contributions of the quality of early parent-child communication and the quantity of language input in 60 low-income families. Including both successful and struggling language learners from the National Institute of Child Health and Human Development Study of Early Child Care and Youth Development, we noted wide variation in the quality of nonverbal and verbal interactions (symbol-infused joint engagement, routines and rituals, fluent and connected communication) at 24 months, which accounted for 27% of the variance in expressive language 1 year later. These indicators of quality were considerably more potent predictors of later language ability than was the quantity of mothers’ words during the interaction or sensitive parenting. Bridging the word gap requires ...
526 citations
Cites background from "Sequential analysis and observation..."
...…0 (i.e., effectively considering them agreements), weighting 2-point disagreements 1, and 3-point disagreements 2, we found that weighted κs (Bakeman & Quera, 2011) were .86, .78, and 1.00 for symbol-infused joint engagement, routines and rituals, and fluency and connectedness,…...
[...]
TL;DR: In this article, the authors describe the R package crqa to perform cross-recurrence quantification analysis of two time series of either a categorical or continuous nature, and compare computational efficiency, and results' consistency, of crqa R package, with the benchmark MATLAB toolbox crptoolbox.
Abstract: This paper describes the R package crqa to perform cross-recurrence quantification analysis of two time series of either a categorical or continuous nature. Streams of behavioral information, from eye movements to linguistic elements, unfold over time. When two people interact, such as in conversation, they often adapt to each other, leading these behavioral levels to exhibit recurrent states. In dialogue, for example, interlocutors adapt to each other by exchanging interactive cues: smiles, nods, gestures, choice of words, and so on. In order for us to capture closely the goings-on of dynamic interaction, and uncover the extent of coupling between two individuals, we need to quantify how much recurrence is taking place at these levels. Methods available in crqa would allow researchers in cognitive science to pose such questions as how much are two people recurrent at some level of analysis, what is the characteristic lag time for one person to maximally match another, or whether one person is leading another. First, we set the theoretical ground to understand the difference between ‘correlation’ and ‘co-visitation’ when comparing two time series, using an aggregative or cross-recurrence approach. Then, we describe more formally the principles of cross-recurrence, and show with the current package how to carry out analyses applying them. We end the paper by comparing computational efficiency, and results’ consistency, of crqa R package, with the benchmark MATLAB toolbox crptoolbox (Marwan, 2013). We show perfect comparability between the two libraries on both levels.
175 citations
TL;DR: Findings underscore the importance of studying team interactions for understanding the role of humor in organizations and considering team-level boundary conditions over time.
Abstract: Research on humor in organizations has rarely considered the social context in which humor occurs. One such social setting that most of us experience on a daily basis concerns the team context. Building on recent theorizing about the humor-performance link in teams, this study seeks to increase our understanding of the function and effects of humor in team interaction settings. We examined behavioral patterns of humor and laughter in real teams by videotaping and coding humor and laughter during 54 regular organizational team meetings. Performance ratings were obtained immediately following the team meetings as well as at a later time point from the teams' supervisors. At the behavioral unit level within the team interaction process, lag sequential analysis identified humor and laughter patterns occurring above chance (e.g., a joke followed by laughter, followed by another joke). Moreover, humor patterns triggered positive socioemotional communication, procedural structure, and new solutions. At the team level, humor patterns (but not humor or laughter alone) positively related to team performance, both immediately and 2 years later. Team-level job insecurity climate was identified as a boundary condition: In low job insecurity climate conditions, humor patterns were positively related to performance, whereas in high job insecurity climate conditions, humor patterns did not relate to team performance. The role of job insecurity as a boundary condition persisted at both time points. These findings underscore the importance of studying team interactions for understanding the role of humor in organizations and considering team-level boundary conditions over time. (PsycINFO Database Record (c) 2014 APA, all rights reserved).
145 citations
Cites methods from "Sequential analysis and observation..."
...Lag sequential analysis analyzes behavioral interdependencies and temporal patterns in sequentially recorded events of groups or individuals (e.g., Bakeman & Quera, 2011; see also Lehmann-Willenbrock et al., 2011, 2013, for applications of this method)....
[...]
01 Feb 2014
TL;DR: This chapter examines the disagreement about the genetics of behavior by reformulating its methodological foundation of twin and family studies by applying the reformulation of older methods to gain realistic understanding of the newer ones that capitalize on the availability of measured DNA.
Abstract: Research methods in both behavioral genetics and personality are currently at a crossroads. This chapter examines the disagreement about the genetics of behavior by reformulating its methodological foundation of twin and family studies. It applies the reformulation of older methods to gain realistic understanding of the newer ones that capitalize on the availability of measured DNA. The chapter highlights a particularly problematic aspect of scientific inference in the human behavioral sciences: the inference of causality from nonexperimental data. Religiosity was measured using four items (rated on four-point or five-point ordinal scale) assessing importance of religion, frequency of prayer, attendance at religious services, and attendance at youth groups. Random effects model was estimated in monozygotic (MZ) twin pairs using PROC MIXED in SAS. Linkage analysis has been the earliest molecular method to be adopted in the study of behavior because it requires minimal knowledge of actual genetic sequence.
144 citations
TL;DR: The Responsiveness to Child Feeding Cues Scale (RCFCS), an observational measure of caregiver responsiveness to child feeding cues relevant to obesity, is developed and assessed.
137 citations
Cites methods from "Sequential analysis and observation..."
...The RCFCS uses discrete behaviors of the mother (e.g., offering food) and child (e.g., pushing food away) to allow both microanalytic and global analyses of dyadic transactions across the course of a feeding (Bakeman & Quera, 2011; Lindahl, 2001)....
[...]
...Inter-rater agreement was assessed for all constructs using 5-point rating scales using the absolute measure intra-class correlation coefficient (ICC) for multiple raters (Bakeman & Quera, 2011; Shrout & Fleiss, 1979)....
[...]
...Further, the tool facilitates sequential coding (Bakeman & Quera, 2011), which should enable identification of salient behavioral patterns within and across different points in development....
[...]
References
More filters
Book•
01 Dec 1969TL;DR: The concepts of power analysis are discussed in this paper, where Chi-square Tests for Goodness of Fit and Contingency Tables, t-Test for Means, and Sign Test are used.
Abstract: Contents: Prefaces. The Concepts of Power Analysis. The t-Test for Means. The Significance of a Product Moment rs (subscript s). Differences Between Correlation Coefficients. The Test That a Proportion is .50 and the Sign Test. Differences Between Proportions. Chi-Square Tests for Goodness of Fit and Contingency Tables. The Analysis of Variance and Covariance. Multiple Regression and Correlation Analysis. Set Correlation and Multivariate Methods. Some Issues in Power Analysis. Computational Procedures.
115,069 citations
TL;DR: A general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies is presented and tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interob server agreement are developed as generalized kappa-type statistics.
Abstract: This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially involves the construction of functions of the observed proportions which are directed at the extent to which the observers agree among themselves and the construction of test statistics for hypotheses involving these functions. Tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interobserver agreement are developed as generalized kappa-type statistics. These procedures are illustrated with a clinical diagnosis example from the epidemiological literature.
64,109 citations
TL;DR: In this article, the authors present a procedure for having two or more judges independently categorize a sample of units and determine the degree, significance, and significance of the units. But they do not discuss the extent to which these judgments are reproducible, i.e., reliable.
Abstract: CONSIDER Table 1. It represents in its formal characteristics a situation which arises in the clinical-social-personality areas of psychology, where it frequently occurs that the only useful level of measurement obtainable is nominal scaling (Stevens, 1951, pp. 2526), i.e. placement in a set of k unordered categories. Because the categorizing of the units is a consequence of some complex judgment process performed by a &dquo;two-legged meter&dquo; (Stevens, 1958), it becomes important to determine the extent to which these judgments are reproducible, i.e., reliable. The procedure which suggests itself is that of having two (or more) judges independently categorize a sample of units and determine the degree, significance, and
34,965 citations
TL;DR: In this article, the authors present guidelines for choosing among six different forms of the intraclass correlation for reliability studies in which n target are rated by k judges, and the confidence intervals for each of the forms are reviewed.
Abstract: Reliability coefficients often take the form of intraclass correlation coefficients. In this article, guidelines are given for choosing among six different forms of the intraclass correlation for reliability studies in which n target are rated by k judges. Relevant to the choice of the coefficient are the appropriate statistical model for the reliability and the application to be made of the reliability results. Confidence intervals for each of the forms are reviewed.
21,185 citations
Book•
01 Jan 1981TL;DR: In this paper, the basic theory of Maximum Likelihood Estimation (MLE) is used to detect a difference between two different proportions of a given proportion in a single proportion.
Abstract: Preface.Preface to the Second Edition.Preface to the First Edition.1. An Introduction to Applied Probability.2. Statistical Inference for a Single Proportion.3. Assessing Significance in a Fourfold Table.4. Determining Sample Sizes Needed to Detect a Difference Between Two Proportions.5. How to Randomize.6. Comparative Studies: Cross-Sectional, Naturalistic, or Multinomial Sampling.7. Comparative Studies: Prospective and Retrospective Sampling.8. Randomized Controlled Trials.9. The Comparison of Proportions from Several Independent Samples.10. Combining Evidence from Fourfold Tables.11. Logistic Regression.12. Poisson Regression.13. Analysis of Data from Matched Samples.14. Regression Models for Matched Samples.15. Analysis of Correlated Binary Data.16. Missing Data.17. Misclassification Errors: Effects, Control, and Adjustment.18. The Measurement of Interrater Agreement.19. The Standardization of Rates.Appendix A. Numerical Tables.Appendix B. The Basic Theory of Maximum Likelihood Estimation.Appendix C. Answers to Selected Problems.Author Index.Subject Index.
16,435 citations