scispace - formally typeset
Search or ask a question
Journal ArticleDOI

Principles Underlying the Use of Multiple Informants' Reports

TL;DR: In this review, the authors advance a framework (Operations Triad Model) outlining general principles for using and interpreting informants' reports and provide supportive evidence for this framework and discuss its implications for hypothesis testing, study design, and quantitative review.
Abstract: Researchers use multiple informants' reports to assess and examine behavior. However, informants' reports commonly disagree. Informants' reports often disagree in their perceived levels of a behavior (“low” versus “elevated” mood), and examining multiple reports in a single study often results in inconsistent findings. Although researchers often espouse taking a multi-informant assessment approach, they frequently address informant discrepancies using techniques that treat discrepancies as measurement error. Yet, recent work indicates that researchers in a variety of fields often may be unable to justify treating informant discrepancies as measurement error. In this review, the authors advance a framework (Operations Triad Model) outlining general principles for using and interpreting informants' reports. Using the framework, researchers can test whether or not they can extract meaningful information about behavior from discrepancies among multiple informants' reports. The authors provide supportive evide...

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI
TL;DR: Analysis of the structure of multi-informant reports of adolescent externalizing and internalizing problems in a sample of adolescents with a history of child welfare involvement found robust, replicable patterns, which may facilitate use and interpretation of evidence-based assessments among this population.
Abstract: Researchers often question the validity of multi-informant assessments among adolescents with child welfare involvement. Yet, within other clinical populations, prior research finds that multi-informant reports have a discernable structure characterized by discrete patterns of agreement and disagreement. This structure “tracks” contextual displays of behavior and clinical severity. We examined the structure of multi-informant reports (i.e., adolescent, caregiver, teacher) of adolescent externalizing and internalizing problems in a sample of adolescents with a history of child welfare involvement. Across problem domains and informants, reporting patterns mirrored those observed in other clinical populations, and displayed characteristics robustly present in meta-analytic work on cross-informant correspondence. Specifically, informants agreed more on reports of externalizing problems than internalizing problems and caregiver-teacher dyads agreed more than adolescent-caregiver dyads. Overall, we found robust, replicable patterns of multi-informant reports among child welfare involved adolescents. These reporting patterns may facilitate use and interpretation of multi-informant evidence-based assessments among this population.

15 citations

Journal ArticleDOI
TL;DR: Among adolescents receiving inpatient psychiatric treatment, disorganized attachment and lower RF were associated with weaker internalizing symptom convergence and greater externalizing symptoms convergence, which if replicated, could inform assessment strategies and treatment planning in this setting.
Abstract: Although convergence in parent–youth reports of adolescent psychopathology is critical for treatment planning, research documents a pervasive lack of agreement in ratings of adolescents’ symptoms. Attachment insecurity (particularly disorganized attachment) and impoverished reflective functioning (RF) are 2 theoretically implicated predictors of low convergence that have not been examined in the literature. In a cross-sectional investigation of adolescents receiving inpatient psychiatric treatment, we examined whether disorganized attachment and low (adolescent and parent) RF were associated with patterns of convergence in adolescent internalizing and externalizing symptoms. Compared with organized adolescents, disorganized adolescents had lower parent–youth convergence in reports of their internalizing symptoms and higher convergence in reports of their externalizing symptoms; low adolescent self-focused RF was associated with low convergence in parent–adolescent reports of internalizing symptoms, wherea...

15 citations

Journal ArticleDOI
TL;DR: This “Introduction to the Special Section” illustrates how three tasks integral to clinical decision making can be reframed as specific examples of more basic cognitive processes.
Abstract: Understanding how clinicians and laypeople make critical decisions related to the assessment, diagnosis, and treatment of mental health is an important step toward improving mental healthcare. This Special Section features new research that, collectively, leverages interdisciplinary approaches from basic psychological science to enhance our understanding of clinical decision making. In this “Introduction to the Special Section,” we illustrate how three tasks integral to clinical decision making (assessment, diagnosis, and treatment selection) can be reframed as specific examples of more basic cognitive processes. We conclude by highlighting challenges to conducting interdisciplinary research on clinical decision making, by providing an overview of the contributions in this Special Section, and by presenting a list of essential readings on clinical decision making.

15 citations

Journal ArticleDOI
TL;DR: It is suggested that in the context of CU, the associations between parenting and CP differ based on parenting characteristics, CP dimensions, and informant, and that families may benefit from treatment targeting specific parenting practices based on CP symptom profiles.
Abstract: The current study investigated whether and how callous–unemotional traits (CU) moderated the association between specific parenting practices and child conduct problems (CP) with a special consideration of informant patterns. Associations between CU, ODD and CD symptom severity, and the parenting practices of deficient monitoring, positive involvement, and negative/ineffective discipline were examined across parent and teacher reports on 851 elementary-school students. Relative to children with low CU, in children with high CU: (1) positive parenting was associated with lower CD, but increased ODD; (2) negative/ineffective discipline was associated with increased ODD; (3) deficient monitoring was associated with increased CD. Results were not robust across informants. These findings suggest that in the context of CU, the associations between parenting and CP differ based on parenting characteristics, CP dimensions, and informant, and that families may benefit from treatment targeting specific parenting practices based on CP symptom profiles.

15 citations

Journal ArticleDOI
TL;DR: Investigating the incremental validity of teacher- and parent-rated symptoms and impairment in a non-referred sample of early elementary school children in terms of predicting impairment as rated by a different teacher 1 year later indicates that it may not be necessary to use parent symptom ratings when teacher symptom ratings are available.
Abstract: Although universal screening for mental health difficulties is increasingly recognized as a way to identify children who are at risk and provide early intervention, little research exists to inform decisions about screening, such as the choice of informants and the type of information collected. The present study examined the incremental validity of teacher- and parent-rated (primarily mothers) symptoms and impairment in a non-referred sample of early elementary school children (n = 320, 49 % boys, ages 6 to 9) in terms of predicting impairment as rated by a different teacher 1 year later. Teacher-rated symptoms and impairment and parent-rated impairment were each unique predictors of later impairment; however, parent-rated symptoms did not contribute to the prediction of later impairment above and beyond these other indicators. The results indicate that, when screening for mental health difficulties in the school system, impairment ratings collected across settings add useful information, but it may not be necessary to use parent symptom ratings when teacher symptom ratings are available.

15 citations

References
More filters
Reference EntryDOI
11 Jun 2013

113,134 citations

Book
01 Jan 1983
TL;DR: In this Section: 1. Multivariate Statistics: Why? and 2. A Guide to Statistical Techniques: Using the Book Research Questions and Associated Techniques.
Abstract: In this Section: 1. Brief Table of Contents 2. Full Table of Contents 1. BRIEF TABLE OF CONTENTS Chapter 1 Introduction Chapter 2 A Guide to Statistical Techniques: Using the Book Chapter 3 Review of Univariate and Bivariate Statistics Chapter 4 Cleaning Up Your Act: Screening Data Prior to Analysis Chapter 5 Multiple Regression Chapter 6 Analysis of Covariance Chapter 7 Multivariate Analysis of Variance and Covariance Chapter 8 Profile Analysis: The Multivariate Approach to Repeated Measures Chapter 9 Discriminant Analysis Chapter 10 Logistic Regression Chapter 11 Survival/Failure Analysis Chapter 12 Canonical Correlation Chapter 13 Principal Components and Factor Analysis Chapter 14 Structural Equation Modeling Chapter 15 Multilevel Linear Modeling Chapter 16 Multiway Frequency Analysis 2. FULL TABLE OF CONTENTS Chapter 1: Introduction Multivariate Statistics: Why? Some Useful Definitions Linear Combinations of Variables Number and Nature of Variables to Include Statistical Power Data Appropriate for Multivariate Statistics Organization of the Book Chapter 2: A Guide to Statistical Techniques: Using the Book Research Questions and Associated Techniques Some Further Comparisons A Decision Tree Technique Chapters Preliminary Check of the Data Chapter 3: Review of Univariate and Bivariate Statistics Hypothesis Testing Analysis of Variance Parameter Estimation Effect Size Bivariate Statistics: Correlation and Regression. Chi-Square Analysis Chapter 4: Cleaning Up Your Act: Screening Data Prior to Analysis Important Issues in Data Screening Complete Examples of Data Screening Chapter 5: Multiple Regression General Purpose and Description Kinds of Research Questions Limitations to Regression Analyses Fundamental Equations for Multiple Regression Major Types of Multiple Regression Some Important Issues. Complete Examples of Regression Analysis Comparison of Programs Chapter 6: Analysis of Covariance General Purpose and Description Kinds of Research Questions Limitations to Analysis of Covariance Fundamental Equations for Analysis of Covariance Some Important Issues Complete Example of Analysis of Covariance Comparison of Programs Chapter 7: Multivariate Analysis of Variance and Covariance General Purpose and Description Kinds of Research Questions Limitations to Multivariate Analysis of Variance and Covariance Fundamental Equations for Multivariate Analysis of Variance and Covariance Some Important Issues Complete Examples of Multivariate Analysis of Variance and Covariance Comparison of Programs Chapter 8: Profile Analysis: The Multivariate Approach to Repeated Measures General Purpose and Description Kinds of Research Questions Limitations to Profile Analysis Fundamental Equations for Profile Analysis Some Important Issues Complete Examples of Profile Analysis Comparison of Programs Chapter 9: Discriminant Analysis General Purpose and Description Kinds of Research Questions Limitations to Discriminant Analysis Fundamental Equations for Discriminant Analysis Types of Discriminant Analysis Some Important Issues Comparison of Programs Chapter 10: Logistic Regression General Purpose and Description Kinds of Research Questions Limitations to Logistic Regression Analysis Fundamental Equations for Logistic Regression Types of Logistic Regression Some Important Issues Complete Examples of Logistic Regression Comparison of Programs Chapter 11: Survival/Failure Analysis General Purpose and Description Kinds of Research Questions Limitations to Survival Analysis Fundamental Equations for Survival Analysis Types of Survival Analysis Some Important Issues Complete Example of Survival Analysis Comparison of Programs Chapter 12: Canonical Correlation General Purpose and Description Kinds of Research Questions Limitations Fundamental Equations for Canonical Correlation Some Important Issues Complete Example of Canonical Correlation Comparison of Programs Chapter 13: Principal Components and Factor Analysis General Purpose and Description Kinds of Research Questions Limitations Fundamental Equations for Factor Analysis Major Types of Factor Analysis Some Important Issues Complete Example of FA Comparison of Programs Chapter 14: Structural Equation Modeling General Purpose and Description Kinds of Research Questions Limitations to Structural Equation Modeling Fundamental Equations for Structural Equations Modeling Some Important Issues Complete Examples of Structural Equation Modeling Analysis. Comparison of Programs Chapter 15: Multilevel Linear Modeling General Purpose and Description Kinds of Research Questions Limitations to Multilevel Linear Modeling Fundamental Equations Types of MLM Some Important Issues Complete Example of MLM Comparison of Programs Chapter 16: Multiway Frequency Analysis General Purpose and Description Kinds of Research Questions Limitations to Multiway Frequency Analysis Fundamental Equations for Multiway Frequency Analysis Some Important Issues Complete Example of Multiway Frequency Analysis Comparison of Programs

53,113 citations

Journal ArticleDOI
TL;DR: This transmutability of the validation matrix argues for the comparisons within the heteromethod block as the most generally relevant validation data, and illustrates the potential interchangeability of trait and method components.
Abstract: Content Memory (Learning Ability) As Comprehension 82 Vocabulary Cs .30 ( ) .23 .31 ( ) .31 .31 .35 ( ) .29 .48 .35 .38 ( ) .30 .40 .47 .58 .48 ( ) As judged against these latter values, comprehension (.48) and vocabulary (.47), but not memory (.31), show some specific validity. This transmutability of the validation matrix argues for the comparisons within the heteromethod block as the most generally relevant validation data, and illustrates the potential interchangeability of trait and method components. Some of the correlations in Chi's (1937) prodigious study of halo effect in ratings are appropriate to a multitrait-multimethod matrix in which each rater might be regarded as representing a different method. While the published report does not make these available in detail because it employs averaged values, it is apparent from a comparison of his Tables IV and VIII that the ratings generally failed to meet the requirement that ratings of the same trait by different raters should correlate higher than ratings of different traits by the same rater. Validity is shown to the extent that of the correlations in the heteromethod block, those in the validity diagonal are higher than the average heteromethod-heterotrait values. A conspicuously unsuccessful multitrait-multimethod matrix is provided by Campbell (1953, 1956) for rating of the leadership behavior of officers by themselves and by their subordinates. Only one of 11 variables (Recognition Behavior) met the requirement of providing a validity diagonal value higher than any of the heterotrait-heteromethod values, that validity being .29. For none of the variables were the validities higher than heterotrait-monomethod values. A study of attitudes toward authority and nonauthority figures by Burwen and Campbell (1957) contains a complex multitrait-multimethod matrix, one symmetrical excerpt from which is shown in Table 6. Method variance was strong for most of the procedures in this study. Where validity was found, it was primarily at the level of validity diagonal values higher than heterotrait-heteromethod values. As illustrated in Table 6, attitude toward father showed this kind of validity, as did attitude toward peers to a lesser degree. Attitude toward boss showed no validity. There was no evidence of a generalized attitude toward authority which would include father and boss, although such values as the VALIDATION BY THE MULTITRAIT-MULTIMETHOD MATRIX

15,795 citations

Book
B. F. Skinner1
01 Jan 1953
TL;DR: The psychology classic "Walden Two" as mentioned in this paper is a detailed study of scientific theories of human nature and the possible ways in which human behavior can be predicted and controlled from one of the most influential behaviorists of the twentieth century.
Abstract: The psychology classic-a detailed study of scientific theories of human nature and the possible ways in which human behavior can be predicted and controlled-from one of the most influential behaviorists of the twentieth century and the author of Walden Two. "This is an important book, exceptionally well written, and logically consistent with the basic premise of the unitary nature of science. Many students of society and culture would take violent issue with most of the things that Skinner has to say, but even those who disagree most will find this a stimulating book." -Samuel M. Strong, The American Journal of Sociology "This is a remarkable book-remarkable in that it presents a strong, consistent, and all but exhaustive case for a natural science of human behavior...It ought to be...valuable for those whose preferences lie with, as well as those whose preferences stand against, a behavioristic approach to human activity." -Harry Prosch, Ethics

8,325 citations


"Principles Underlying the Use of Mu..." refers background in this paper

  • ...…which a patient lives may vary as a function of the contingencies (e.g., corporal punishment and praise) that reinforce expressions of her behavior (e.g., Skinner 1953), and as mentioned previously, multiple informants may vary in where they observe a patient’s behavior (e.g., De Los Reyes 2011)....

    [...]

Journal ArticleDOI
TL;DR: Etude de la coherence entre differentes sources (269 echantillons utilisees dans 119 etudes) concernant les evaluations des problemes affectifs et comportementaux d'enfants et d'adolescents âges de 1 1/2 a 19 ans.
Abstract: Etude de la coherence entre differentes sources (269 echantillons utilisees dans 119 etudes) concernant les evaluations des problemes affectifs et comportementaux d'enfants et d'adolescents âges de 1 1/2 a 19 ans

5,254 citations


"Principles Underlying the Use of Mu..." refers background in this paper

  • ...Third, as mentioned previously, low multi-informant correspondence is the norm rather than the exception in assessments of child, adolescent, and adult psychopathology (Achenbach et al. 1987, 2005)....

    [...]

  • ...Along these lines, perhaps the investigative team would draw from theory suggesting that parents and teachers provide discrepant reports because they observe children in different contexts or settings (parents at home versus teachers at school; Achenbach et al. 1987, Kraemer et al. 2003)....

    [...]

  • ...Achenbach et al. (1987) lucidly reflected this interpretation, in a meta-analysis of correspondence between informants’ reports of child mental health that was published nearly a century after Edgeworth’s (1888) article....

    [...]

  • ...However, although multiple informants’ reports typically correspond no higher than low-to-moderate in magnitude (e.g., r’s ranging from 0.20 to 0.40; see Achenbach et al. 1987, 2005), they nonetheless often correspond with each other at statistically significant magnitudes....

    [...]

  • ...(e.g., Achenbach et al. 1987, 2005)....

    [...]

Trending Questions (1)
What are the different ways to use multiple informants in family studies?

The paper proposes a framework called the Operations Triad Model (OTM) to guide researchers in using and interpreting multiple informants' reports in family studies.