scispace - formally typeset
Search or ask a question
Journal ArticleDOI

Convergent and incremental predictive validity of clinician, self-report, and structured interview diagnoses for personality disorders over 5 years.

TL;DR: The results from a large clinical sample echo previous research documenting limited agreement between clinicians' naturalistic PD diagnoses and those from self-report and semistructured interview methods, and provide the first evidence about the relative predictive validity of these different methods.
Abstract: The complexity of diagnosing personality disorders (PDs) has been a longstanding issue in psychiatry (Westen, 1997; Zimmerman, 1994). Several methods exist for diagnosing PDs, including semi-structured diagnostic interviews, self-report questionnaires, clinician-rated Q-sort instruments, as well as unstructured diagnoses made by treating clinicians (McDermut & Zimmerman, 2005). Although research has relied primarily on semi-structured diagnostic interviews and self-report questionnaires, therapists typically base PD diagnoses on their unstructured interviews and clinical contacts with patients (Perry, 1992; Westen, 1997; Zimmerman, 2011). Despite debate regarding the relative merits of different diagnostic methods (Westen & Muderrisoglu, 2003; Zimmerman & Mattia, 1999), no study has yet compared the predictive validity of clinicians’ naturalistic PD diagnoses to those from self-report questionnaires or semi-structured interviews (Zimmerman, 2011). Existing research has repeatedly indicated that clinician-generated PD diagnoses do not agree well with those from self-report measures (Davidson, Obonsawin, Seils, & Patience, 2003; Hyler, Rieder, Williams, & Spitzer, 1989; Morey, Blashfield, Webb, & Jewell, 1988; Rossi, Van den Brande, Tobac, Sloore, & Hauben, 2003) or semi-structured interviews (Dreessen & Arntz, 1999; Fridell & Hesse, 2006; Samuel & Widiger, 2010). This poor agreement is not unique to PDs, and has been noted for various psychiatric diagnoses (Rettew, Lynch, Achenbach, Dumenci, & Ivanova, 2009). More importantly, fundamental questions regarding the incremental predictive validity of diagnoses assigned by clinicians relative to different methods have not been answered. Research has compared the validity of self and informant reports of PD (Klein, 2003; Oltmanns & Turkheimer, 2009), but there is a critical need for analogous work comparing clinical diagnoses to other methods. Such work is crucial for determining whether and how different sources of information might be usefully combined. Currently, the optimal approach for how researchers and clinicians should most validly identify PDs remains unclear. Although research on clinical judgment offers reasons for skepticism about the validity of clinician ratings in general (Grove, Zald, Lebow, Snitz, & Nelson, 2000; Meehl, 1954), there are compelling reasons to believe that their PD diagnoses might be useful and valid. Therapists’ diagnostic impressions rely on extensive training and take into consideration information about the client's life gleaned across extended periods of clinical interactions. Pilkonis, Heape, Ruddy, and Serrao (1991) noted “clinical judgment, of course, has its own limitations, but it would seem unwise to develop assessment tools that are unrelated to thoughtful clinical experience” (p. 46). In addition, Westen (1997) suggested that clinicians take a holistic approach to diagnosis, situating them well to describe complex personality pathology. Others contend that clinicians’ PD ratings are superior to self-report because patients’ ability to accurately assess their own personality might be limited by mood states, lack of insight, or presentation biases (Ganellen, 2007; Huprich, Bornstein, & Schmitt, 2011). Finally, Morey, Blashfield, Webb, and Jewell (1988) suggested that semi-structured diagnostic interviews also might have limitations because “a relatively brief interview situation does not seem particularly well suited to the task of assessing long-term personological characteristics.” (p. 47). Despite these concerns, there are reasons to believe that patient-reported information from semi-structured interviews and/or self-report questionnaires can usefully contribute to PD diagnoses (Zimmerman & Mattia, 1999). Thus, although clinicians might not routinely ask direct questions about PD symptoms or employ semi-structured interviews and self-report questionnaires, they incorporate such information to inform their diagnoses if it is available. Importantly, because semi-structured interviews explicitly assess the longitudinal presence of PD symptoms, they might have greater ability to disentangle episodic state artifacts from more durable trait-based PD syndromes (Loranger et al., 1991; Morey et al., 2010). As treating therapists almost always play the primary role in diagnosing PDs in clinical settings, understanding the relative validity of their impressions carries particular importance. Comparing clinicians’ diagnoses with those from self-report questionnaires or semi-structured diagnostic interviews would be useful for prospectively predicting clinically-relevant outcomes that extend beyond specific diagnostic features, such as psychosocial functioning. We conducted such a comparison using data from the Collaborative Longitudinal Personality Disorders Study (CLPS) (Gunderson et al., 2000). The CLPS is well-suited for this investigation as the baseline assessment included diagnoses from treating clinicians collected using a modified version of the Personality Assessment Form (PAF) (Shea, Glass, Pilkonis, Watkins, & Docherty, 1987; Shea et al., 1990). This allowed them to record the degree to which patients evinced the prototypical characteristics of each of four study PDs (viz., schizotypal, borderline, avoidant, obsessive-compulsive). The PAF provides a relevant, externally valid method for conducting such an analysis as it closely approximates the way clinicians make PD diagnoses in clinical practice. The PAF's format is also timely, as it utilizes a prototype-matching approach that mirrors the original proposal for diagnosing PDs in DSM-5. In fact, the PAF and research that had employed it were cited as primary support for the Work Group's proposal (Skodol, Bender, et al., 2011; Skodol, Clark, et al., 2011). This proposal subsequently was criticized by a number of PD scholars (Pilkonis, Hallquist, Morse, & Stepp, 2011; Widiger, 2011; Zimmerman, 2011) and abandoned. Nonetheless, other prominent researchers and clinicians have strongly argued that the prototype-matching approach should become the standard method of PD diagnosis (Shedler et al., 2010). The benefit and goal of employing the PAF for collecting clinicians’ impressions is to maximize external validity (i.e., most closely match the type of PD diagnoses typically made in clinical practice), not to provide equivalence with other methods (Westen & Weinberger, 2004). Westen and colleagues have demonstrated that when clinicians administer a systematic clinical interview (i.e., the Clinical Diagnostic Interview, CDI; Westen, 2004) and record their impressions using the Shedler-Westen Assessment Procedure (SWAP; Westen & Shedler, 1999), their PD diagnoses become more reliable across independent raters (Westen & Muderrisoglu, 2006; Westen, Shedler, Bradley, & DeFife, 2012). Although informative, such a diagnostic strategy (i.e., a two-hour administration of the Clinical Diagnostic Interview followed by the sorting of 200 SWAP items) is not standard practice in naturalistic settings. Perhaps recognizing this, Westen and his colleagues have also been the primary proponents of the prototype-matching approach (Shedler & Westen, 2004; Westen, DeFife, Bradley, & Hilsenroth, 2010; Westen, Shedler, & Bradley, 2006) that helped inform the original DSM-5 proposal (Skodol, Bender, et al., 2011; Skodol, Clark, et al., 2011). The PAF's prototype-matching format makes it a reasonable choice for collecting treating clinicians’ PD diagnoses in this study. We compared the incremental validity of clinicians’ diagnoses of these four PDs assigned via the PAF to those generated by a semi-structured interview and self-report questionnaire for predicting psychosocial functioning assessed prospectively over five years. Given the published support for the validity of the prototype-matching approach (Westen et al., 2012), we hypothesized that clinicians’ PAF ratings would account for variance in functioning beyond that captured by self-report questionnaires or semi-structured interviews. Nonetheless, we also recognized that all previous findings concerning the relative validity of alternative diagnostic methods have suggested that the methods are mutually informative (Hopwood et al., 2008; Klein, 2003). Thus, we also hypothesized that the self-report and semi-structured interview methods would have unique strengths and demonstrate incremental predictive validity beyond the clinician-assigned diagnoses. Finally, to account for inadequate familiarity with patients that might disadvantage the clinicians’ PAF ratings, we conducted additional analyses using only the subset of cases whom clinicians had treated for at least one year prior to providing the diagnoses. This choice of a one year interval of treatment ensured adequate familiarity with a patient's personality pathology.

Summary (2 min read)

Method

  • Study participants were drawn from the 668 participants recruited from the multiple CLPS clinical sites.
  • Participants who provided written, informed consent underwent diagnostic interviews and completed self-report questionnaires as part of a standardized battery.
  • These PD diagnostic assignments were based on the Diagnostic Interview for DSM–IV Personality Disorders (DIPD-IV; Zanarini, Frankenburg, Sickel, & Yong, 1996), reliably administered by trained research personnel.
  • Participants used for the current analyses were 320 individuals from the CLPS with available PAF ratings completed by a treating clinician at baseline.
  • Baseline SNAP-2 PD scores were significantly greater for the studied group for all four PDs.

Personality Disorder Measures

  • The DIPD-IV is a semistructured diagnostic interview for assessing the Diagnostic and Statistical Manual of Mental Disorders, fourth edition (DSM–IV; American Psychiatric Association, 1994) PDs.
  • The current report considered only the DIPD-IV scores for the four PDs studied in CLPS.
  • The SNAP-2 includes scales assessing the DSM–IV PDs, ranging in length from 19 to 34 items.

Psychosocial Functioning Measures Serving as Independent External Criteria

  • Multiple measures of psychosocial functioning served as external outcome criteria.
  • Both aspects are crucial for the current purposes, as independent, external criteria provide the only opportunity to discriminate validity among different methods of PD diagnosis.
  • To assess psychosocial functioning, CLPS research team interviewers administered the LIFE (Keller et al., 1987), a structured interview assessing functioning in interpersonal relationships and occupational and recreational domains.
  • Participants also completed the SAS-SR (Weissman & Bothwell, 1976), a self-report instrument yielding estimates of interpersonal, occupational, and recreational functioning.
  • The LIFE and SAS-SR were administered at baseline and repeated at predetermined intervals, including the 5-year follow-up.

Data Analytic Procedures

  • The authors first examined the convergent validity of clinicians’ PAF diagnoses with those from a semistructured diagnostic interview (DIPD-IV) and self-report questionnaire (SNAP-2).
  • PAF dimensional ratings were compared with those from the DIPD-IV and SNAP-2 (all at baseline) for their ability to predict functional outcomes at the 60-month follow-up (via the LIFE and SAS-SR) using hierarchical regression analyses.
  • This was then repeated with the order of entry reversed.
  • To account for possible contamination due to shared method variance, the authors conducted these analyses separately using the selfreport criterion and again with the interview-based criterion variable.
  • Al- though their use of functional outcomes rather than diagnostic information as criteria attenuates this possibility, the authors nonetheless examined it by performing a parallel set of analyses restricted to a subsample of 110 participants for whom the PAF disagreed with the DIPD-IV at baseline and thus was not required for study inclusion.

Categorical and Dimensional Agreement

  • Table 1 provides the agreement between PAF ratings and those from the DIPD-IV and SNAP-2. Categorical agreement between treating clinicians’ diagnoses and the semistructured diagnostic interview ranged from of .21 to .42 , whereas dimensional agreement (Pearson correlations) ranged from .30 to .44 .
  • Agreement between clinicians’ ratings and self-report questionnaire was lower than between clinicians’ ratings and semistructured diagnostic interviews, with kappas ranging from .00 (OCPD) to .20 and Pearson correlations ranging from .18 to .28 .
  • For context, the authors note that agreement between DIPD-IV and SNAP-2 in the current sample ranged from .25 (OCPD) to .51 for categorical diagnoses and from .57 to .72 for dimensional ratings.

Incremental Predictive Validity

  • Tables 2–6 summarize the hierarchical regression analyses.
  • In contrast, clinicians’ ratings did not significantly increment the DIPD-IV interview results for either criterion.
  • Diagnostic Interview for DSM–IV Personality Disorders; SNAP-2 !.
  • Table 4 summarizes regression analyses comparing SNAP-2 ratings with the PAF in predicting functioning assessed by the SAS-SR and LIFE.

Diagnostic Ratings?

  • To determine whether clinicians’ familiarity with their patients influenced findings, the authors repeated these analyses using a subsample of clinicians who treated patients for more than 1 year.
  • Ninety clinicians had this level of familiarity, and 60-month follow-up data were available for 73 using the LIFE and 62 using the.

Discussion

  • In the current study, the authors explicitly compared the value of PD diagnoses provided by clinicians via the PAF with those from a semistructured interview and self-report questionnaire for prospectively predicting psychosocial functioning in a large clinical sample.
  • Outcome variables are means of interpersonal, recreation, and work functioning assessed by the SAS-SR and LIFE, respectively.
  • Nonetheless, their findings suggest that clinicians’ naturalistic PD diagnoses, even when recorded in a standardized format such as the PAF, do not agree well with other methods.
  • PD ratings provides important evidence supporting the utility of self-report instruments for assessing personality pathology.

Limitations

  • In the current study, the authors examined a large, carefully diagnosed clinical sample with well-validated criterion measures to provide the first data on the relative validity of clinicians’.
  • This sampling strategy excluded other potential participants relevant to the current analyses, such as individuals diagnosed with a PD by the PAF but not according to the DIPD-IV.
  • Nonetheless, it would have been ideal to collect clinician ratings of functioning that could have been used as another criterion.
  • The current study helps to demonstrate that PD diagnoses, provided by any source or method, do predict subsequent impairment.
  • The degree to which participants’ functioning improved through treatment would diminish the predictive utility of a baseline diagnosis.

Conclusions

  • Most importantly, their novel findings provide evidence that the latter two methods have greater utility than clinicians’.
  • PD diagnoses for predicting psychosocial functioning over 5-year prospective follow-up.
  • These findings underscore the advantages of incorporating established semistructured interviews and self-report questionnaires into routine clinical diagnostic practices.

Did you find this useful? Give us your feedback

Content maybe subject to copyright    Report

Wesleyan University
From the SelectedWorks of Charles A. Sanislow, Ph.D.
",/")"-
+*1"-$"*/*!* -")"*/(-"!& /&1"(&!&/3+#
(&*& &*"(#",+-/*!/-0 /0-"!*/"-1&"2
&$*+.".#+-"-.+*(&/3&.+-!"-.1"-"-.
+0$(.)0"(
%-(".*&.(+2 Wesleyan University
%-&./+,%"-+,2++! Michigan State University
- &"%"
*!-"2'+!+( University of Arizona"/(
1&(("/ %4,.2+-'.",-"..+) %-("..*&.(+2

Convergent and Incremental Predictive Validity of Clinician, Self-Report,
and Structured Interview Diagnoses for Personality Disorders Over 5 Years
Douglas B. Samuel
Yale School of Medicine
Charles A. Sanislow
Wesleyan University
Christopher J. Hopwood
Michigan State University
M. Tracie Shea
Veterans Affairs Medical Center, Providence, Rhode Island, and
Alpert Medical School of Brown University
Andrew E. Skodol
The Sunbelt Collaborative, Tucson, Arizona, and University of
Arizona College of Medicine
Leslie C. Morey
Texas A&M University
Emily B. Ansell
Yale School of Medicine
John C. Markowitz
New York State Psychiatric Institute, New York, New York,
and Columbia University College of Physicians and Surgeons
Mary C. Zanarini
Harvard Medical School
Carlos M. Grilo
Yale School of Medicine
Objective: Research has demonstrated poor agreement between clinician-assigned personality disorder (PD)
diagnoses and those generated by self-report questionnaires and semistructured diagnostic interviews. No
research has compared prospectively the predictive validity of these methods. We investigated the conver-
gence of these 3 diagnostic methods and tested their relative and incremental validity in predicting indepen-
dent, multimethod assessments of psychosocial functioning performed prospectively over 5 years. Method:
Participants were 320 patients in the Collaborative Longitudinal Personality Disorders Study diagnosed with
PDs by therapist, self-report, and semistructured interview at baseline. We examined the relative incremental
validity of therapists’ naturalistic ratings relative to these other diagnostic methods for predicting psychosocial
functioning at 5-year follow-up. Results: Hierarchical linear regression analyses revealed that both the
self-report questionnaire and semistructured interview PD diagnoses had significant incremental predictive
validity over the PD diagnoses assigned by a treating clinician. Although, in some cases, the clinicians’ ratings
for individual PDs did have validity for predicting subsequent functioning, they did not generally provide
incremental prediction beyond the other methods. These findings remained robust in a series of analyses
restricted to a subsample of therapist ratings based on clinical contact of 1 year or greater. Conclusions: These
results from a large clinical sample echo previous research documenting limited agreement between clinicians’
naturalistic PD diagnoses and those from self-report and semistructured interview methods. They extend prior work
by providing the first evidence about the relative predictive validity of these different methods. Our findings
challenge the validity of naturalistic PD diagnoses and suggest the use of structured diagnostic instruments.
Keywords: personality disorder, semistructured interview, self-report, diagnostic agreement, clinician
This article was published Online First May 6, 2013.
Douglas B. Samuel, Department of Psychiatry, Yale School of Medi-
cine; Charles A. Sanislow, Department of Psychology, Wesleyan Univer-
sity; Christopher J. Hopwood, Department of Psychology, Michigan State
University; M. Tracie Shea, Veterans Affairs Medical Center, Providence,
Rhode Island, and Department of Psychiatry, Alpert Medical School of
Brown University; Andrew E. Skodol, The Sunbelt Collaborative, Tucson,
Arizona, and Department of Psychiatry, University of Arizona College of
Medicine; Leslie C. Morey, Department of Psychology, Texas A&M
University; Emily B. Ansell, Department of Psychiatry, Yale School of
Medicine; John C. Markowitz, New York State Psychiatric Institute, New
York, New York, and Department of Psychiatry, Columbia University
College of Physicians and Surgeons; Mary C. Zanarini, Department of
Psychiatry, Harvard Medical School; Carlos M. Grilo, Department of
Psychiatry, Yale School of Medicine.
Writing of this article was supported by the Office of Academic Affiliations,
Advanced Fellowship Program in Mental Illness Research and Treatment,
Department of Veterans Affairs. Research was supported by National Institute
of Mental Health Grants MH 50837, 50838, 50839, 50840, 50850, and
MH073708, awared to Charles A. Sanislow. This publication has been re-
viewed and approved by the Publications Committee of the Collaborative
Longitudinal Personality Disorders Study.
Correspondence concerning this article should be addressed to Doug-
las B. Samuel, who is now at Department of Psychological Sciences,
Purdue University, West Lafayette, IN 47907. E-mail: dbsamuel@
purdue.edu
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
Journal of Consulting and Clinical Psychology © 2013 American Psychological Association
2013, Vol. 81, No. 4, 650 659 0022-006X/13/$12.00 DOI: 10.1037/a0032813
650

The complexity of diagnosing personality disorders (PDs) has
been a long-standing issue in psychiatry (Westen, 1997; Zimmer-
man, 1994). Several methods exist for diagnosing PDs, including
semistructured diagnostic interviews, self-report questionnaires,
clinician-rated Q-sort instruments, as well as unstructured diagno-
ses made by treating clinicians (McDermut & Zimmerman, 2005).
Although research has relied primarily on semistructured diagnos-
tic interviews and self-report questionnaires, therapists typically
base PD diagnoses on their unstructured interviews and clinical
contacts with patients (Perry, 1992; Westen, 1997; Zimmerman,
2011). Despite debate regarding the relative merits of different
diagnostic methods (Westen & Muderrisoglu, 2003; Zimmerman
& Mattia, 1999), no study has yet compared the predictive validity
of clinicians’ naturalistic PD diagnoses with those from self-report
questionnaires or semistructured interviews (Zimmerman, 2011).
Existing research has repeatedly indicated that clinician-
generated PD diagnoses do not agree well with those from self-
report measures (Davidson, Obonsawin, Seils, & Patience, 2003;
Hyler, Rieder, Williams, & Spitzer, 1989; Morey, Blashfield,
Webb, & Jewell, 1988; Rossi, Van den Brande, Tobac, Sloore, &
Hauben, 2003) or semistructured interviews (Dreessen & Arntz,
1999; Fridell & Hesse, 2006; Samuel & Widiger, 2010). This poor
agreement is not unique to PDs, and has been noted for various
psychiatric diagnoses (Rettew, Lynch, Achenbach, Dumenci, &
Ivanova, 2009). More importantly, fundamental questions regard-
ing the incremental predictive validity of diagnoses assigned by
clinicians relative to different methods have not been answered.
Research has compared the validity of self- and informant reports
of PD (Klein, 2003; Oltmanns & Turkheimer, 2009), but there is
a critical need for analogous work comparing clinical diagnoses
with other methods. Such work is crucial for determining whether
and how different sources of information might be usefully com-
bined. Currently, the optimal approach for how researchers and
clinicians should most validly identify PDs remains unclear.
Although research on clinical judgment offers reasons for skep-
ticism about the validity of clinician ratings in general (Grove,
Zald, Lebow, Snitz, & Nelson, 2000; Meehl, 1954), there are
compelling reasons to believe that their PD diagnoses might be
useful and valid. Therapists’ diagnostic impressions rely on exten-
sive training and take into consideration information about the
client’s life gleaned across extended periods of clinical interac-
tions. Pilkonis, Heape, Ruddy, and Serrao (1991) noted “clinical
judgment, of course, has its own limitations, but it would seem
unwise to develop assessment tools that are unrelated to thoughtful
clinical experience” (p. 46). In addition, Westen (1997) suggested
that clinicians take a holistic approach to diagnosis, situating them
well to describe complex personality pathology. Others contend
that clinicians’ PD ratings are superior to self-report because
patients’ ability to accurately assess their own personality might be
limited by mood states, lack of insight, or presentation biases
(Ganellen, 2007; Huprich, Bornstein, & Schmitt, 2011). Finally,
Morey et al. (1988) suggested that semistructured diagnostic in-
terviews also might have limitations because “a relatively brief
interview situation does not seem particularly well suited to the
task of assessing long-term personological characteristics” (p. 47).
Despite these concerns, there are reasons to believe that patient-
reported information from semistructured interviews and/or self-
report questionnaires can usefully contribute to PD diagnoses
(Zimmerman & Mattia, 1999). Thus, although clinicians might not
routinely ask direct questions about PD symptoms or use semi-
structured interviews and self-report questionnaires, they incorpo-
rate such information to inform their diagnoses if it is available.
Importantly, because semistructured interviews explicitly assess
the longitudinal presence of PD symptoms, they might have
greater ability to disentangle episodic state artifacts from more
durable trait-based PD syndromes (Loranger et al., 1991; Morey et
al., 2010).
As treating therapists almost always play the primary role in
diagnosing PDs in clinical settings, understanding the relative
validity of their impressions carries particular importance. Com-
paring clinicians’ diagnoses with those from self-report question-
naires or semistructured diagnostic interviews would be useful for
prospectively predicting clinically relevant outcomes that extend
beyond specific diagnostic features, such as psychosocial function-
ing. We conducted such a comparison using data from the Col-
laborative Longitudinal Personality Disorders Study (CLPS;
Gunderson et al., 2000). The CLPS is well suited for this investi-
gation as the baseline assessment included diagnoses from treating
clinicians collected using a modified version of the Personality
Assessment Form (PAF; Shea, Glass, Pilkonis, Watkins, & Do-
cherty, 1987; Shea et al., 1990). This allowed them to record the
degree to which patients evinced the prototypical characteristics of
each of four study PDs (viz., schizotypal, borderline, avoidant,
obsessive-compulsive).
The PAF provides a relevant, externally valid method for con-
ducting such an analysis as it closely approximates the way clini-
cians make PD diagnoses in clinical practice. The PAF’s format is
also timely, as it uses a prototype-matching approach that mirrors
the original proposal for diagnosing PDs in the Diagnostic and
Statistical Manual of Mental Disorders, fifth edition (DSM–5). In
fact, the PAF and research that had used it were cited as primary
support for the Work Group’s proposal (Skodol, Bender, et al.,
2011; Skodol, Clark, et al., 2011). This proposal subsequently was
criticized by a number of PD scholars (Pilkonis, Hallquist, Morse,
& Stepp, 2011; Widiger, 2011; Zimmerman, 2011) and aban-
doned. Nonetheless, other prominent researchers and clinicians
have strongly argued that the prototype-matching approach should
become the standard method of PD diagnosis (Shedler et al.,
2010).
The benefit and goal of using the PAF for collecting clinicians’
impressions is to maximize external validity (i.e., most closely
match the type of PD diagnoses typically made in clinical prac-
tice), not to provide equivalence with other methods (Westen &
Weinberger, 2004). Westen and colleagues have demonstrated that
when clinicians administer a systematic clinical interview (i.e., the
Clinical Diagnostic Interview, CDI; Westen, 2004) and record
their impressions using the Shedler-Westen Assessment Procedure
(SWAP; Westen & Shedler, 1999), their PD diagnoses become
more reliable across independent raters (Westen & Muderrisoglu,
2006; Westen, Shedler, Bradley, & DeFife, 2012). Although in-
formative, such a diagnostic strategy (i.e., a 2-hr administration of
the CDI followed by the sorting of 200 SWAP items) is not
standard practice in naturalistic settings. Perhaps recognizing this,
Westen and his colleagues have also been the primary proponents
of the prototype-matching approach (Shedler & Westen, 2004;
Westen, DeFife, Bradley, & Hilsenroth, 2010; Westen, Shedler, &
Bradley, 2006) that helped inform the original DSM–5 proposal
(Skodol, Bender, et al., 2011; Skodol, Clark, et al., 2011). The
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
651
VALIDITY OF CLINICIANS’ PERSONALITY DISORDER DIAGNOSES

PAF’s prototype-matching format makes it a reasonable choice for
collecting treating clinicians’ PD diagnoses in this study.
We compared the incremental validity of clinicians’ diagnoses
of these four PDs assigned via the PAF with those generated by a
semistructured interview and self-report questionnaire for predict-
ing psychosocial functioning assessed prospectively over 5 years.
Given the published support for the validity of the prototype-
matching approach (Westen et al., 2012), we hypothesized that
clinicians’ PAF ratings would account for variance in functioning
beyond that captured by self-report questionnaires or semistruc-
tured interviews. Nonetheless, we also recognized that all previous
findings concerning the relative validity of alternative diagnostic
methods have suggested that the methods are mutually informative
(Hopwood et al., 2008; Klein, 2003). Thus, we also hypothesized
that the self-report and semistructured interview methods would
have unique strengths and demonstrate incremental predictive va-
lidity beyond the clinician-assigned diagnoses. Finally, to account
for inadequate familiarity with patients that might disadvantage the
clinicians’ PAF ratings, we conducted additional analyses using
only the subset of cases, whom clinicians had treated for at least 1
year prior to providing the diagnoses. This choice of a 1-year
interval of treatment ensured adequate familiarity with a patient’s
personality pathology.
Method
Study participants were drawn from the 668 participants re-
cruited from the multiple CLPS clinical sites. Appropriate Institu-
tional Review Boards approved the study. Participants who pro-
vided written, informed consent underwent diagnostic interviews
and completed self-report questionnaires as part of a standardized
battery. Detailed recruitment and diagnostic procedures have been
published elsewhere (Gunderson et al., 2000). Briefly, participants
were assigned to one of four PD groups (borderline, avoidant,
schizotypal, and obsessive-compulsive [OC]), or to major depres-
sive disorder (MDD) without any PD. These PD diagnostic as-
signments were based on the Diagnostic Interview for DSM–IV
Personality Disorders (DIPD-IV; Zanarini, Frankenburg, Sickel, &
Yong, 1996), reliably administered by trained research personnel.
For inclusion, these diagnoses required confirmation by a self-
report questionnaire (e.g., Schedule for Nonadaptive and Adaptive
Personality–2; SNAP-2; Clark, Simms, Wu, & Casillas, in press)
and/or the treating clinician’s PAF ratings. Furthermore, because
inclusion demanded either a self-report or clinician-assigned diag-
nosis, in a subset of participants the semistructured interview-
assigned diagnosis disagreed with the clinicians’ ratings and was
instead confirmed by the self-report questionnaire.
Participants used for the current analyses were 320 individuals
from the CLPS with available PAF ratings completed by a treating
clinician at baseline. Independent sample t tests and chi-square
tests demonstrated no significant differences between participants
with PAF scores and the larger CLPS sample in gender, age, or
ethnicity. Independent samples t tests revealed that this subsample
differed in diagnosis and functioning, perhaps reflecting that par-
ticipants with PAF ratings were in ongoing psychiatric or psycho-
logical treatment. Participants with PAF ratings met more criteria
for borderline PD according to the DIPD-IV at baseline (M ! 4.4,
SD ! 2.7) than did those without available PAF ratings (M ! 2.6,
SD ! 2.5), t(729) ! 9.3, p " .01. Differences for the other three
studied PDs on the DIPD-IV were nonsignificant. Baseline
SNAP-2 PD scores were significantly greater for the studied group
for all four PDs. Participants with available PAF ratings did not
differ from those without in terms of psychosocial functioning
measured by the Social Adjustment Scale, Self-Report (SAS-SR),
t(700) ! 1.1, p ! .28, but did differ significantly according to the
Longitudinal Interval Follow-Up Evaluation (LIFE), t(727) ! 5.3,
p " .01.
Average age of the participants at baseline was 32.9 years
(SD ! 7.9, range ! 18 45); 199 (62%) were women; the ethnic
breakdown was 237 (74%) Caucasian, 35 (11%) African Ameri-
can, 39 (12%) Hispanic, six (2%) Asian American, and three (1%)
“other.” Of the participants, 73 (23%) were assigned to the
avoidant, 128 (40%) to the borderline, 54 (17%) to the obsessive-
compulsive, 37 (12%) to the schizotypal, and 28 (9%) to the MDD
without PD groups. Clinicians reported clinical contact with the
patients ranging from 0 to 884 weeks, with a mean of 53.7 (SD !
89.7) at the time of providing the PAF ratings. Their confidence in
their diagnostic ratings evinced a mean of 2.26 (on a 1– 5 metric,
where 1 ! high and 5 ! low; SD ! 1.12).
Personality Disorder Measures
DIPD-IV (Zanarini et al., 1996). The DIPD-IV is a semi-
structured diagnostic interview for assessing the Diagnostic and
Statistical Manual of Mental Disorders, fourth edition (DSM–IV;
American Psychiatric Association, 1994) PDs. Each criterion is
assessed with one or more questions rated on a 3-point scale (0 !
not present;1! present but of uncertain clinical significance;2!
present and clinically significant). The DIPD-IV requires that
criteria be pervasive, present for at least 2 years, and characteristic
of the person for most of his or her adult life. In the CLPS sample,
interrater reliability (based on 84 pairs of raters) kappa coefficients
ranged from .58 to 1.00 (Zanarini et al., 2000). The current report
considered only the DIPD-IV scores for the four PDs studied in
CLPS.
SNAP-2 (Clark et al., in press). Comprising 390 true/false
statements, the SNAP-2 provides a self-report assessment of 12
pathological personality traits derived from an iterative factor
analytic process. The SNAP-2 includes scales assessing the
DSM–IV PDs, ranging in length from 19 (avoidant) to 34 (antiso-
cial) items. Although most DSM–IV PD scale items are also scored
for one of the trait scales, a number of items were added to
explicitly tap additional content. The PD scales can be scored
dimensionally or by individual diagnostic criteria to yield categor-
ical diagnoses. In the full CLPS sample, the SNAP-2 PD scale
internal consistencies ranged from .69 (OCPD) to .88 (avoidant),
with an overall median of .83. The SNAP-2 PD scores correlate
consistently with those from other self-report PD inventories (Wi-
diger & Boyd, 2009) and structured PD diagnostic interviews
(Samuel et al., 2011). The current report only included the SNAP-2
scores for the four CLPS PDs.
PAF (Shea et al., 1987, 1990). The PAF was adapted for the
DSM–IV PDs from a measure developed for the National Institute
of Mental Health Treatment of Depression Collaborative Research
Program (Elkin, Parloff, Hadley, & Autry, 1985). Its purpose was
to provide a standardized method to quantify clinicians’ routine
clinical diagnoses. Thus, it was designed to maximize external
validity and mirror the type of PD ratings and diagnoses made in
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
652
SAMUEL ET AL.

clinical practice. The PAF used in CLPS contained three to four
sentence prototypical descriptions for each of the four PDs studied
(schizotypal, borderline, avoidant, and obsessive-compulsive) as
well as several “cues” to aid clinicians in rating a patient’s match
to the prototypes. The instrument is available by request to the first
author. Clinicians rated all four of the studied PDs on a 1–6 scale,
where 1 indicated not at all and 6 indicated that the patient
matched the prototype to an extreme degree. Consistent with
previous research (Shea et al., 1990), a score ! 4 indicated a
categorical diagnosis. Clinicians could also indicate no informa-
tion or insufficient data for a particular PD, although they used this
only rarely (24 times across the four PDs in the sample of 320).
Those values were recoded as missing for the current analyses. The
mean PAF ratings were 1.95 (SD ! 1.20) for schizotypal PD, 2.94
(SD ! 1.55) for borderline PD, 2.49 (SD ! 1.34) for avoidant PD,
and 2.08 (SD ! 1.33) for OCPD.
Psychosocial Functioning Measures Serving as
Independent External Criteria
Multiple measures of psychosocial functioning served as exter-
nal outcome criteria. These were independent of specific PD
symptoms and used two independent assessment methods. Both
aspects are crucial for the current purposes, as independent, exter-
nal criteria provide the only opportunity to discriminate validity
among different methods of PD diagnosis. To assess psychosocial
functioning, CLPS research team interviewers administered the
LIFE (Keller et al., 1987), a structured interview assessing func-
tioning in interpersonal relationships and occupational and recre-
ational domains. Most areas of functioning are rated on 5-point
severity scales (1 ! no impairment, high level of functioning or
very good functioning and 5 ! severe impairment or very poor
functioning). Participants also completed the SAS-SR (Weissman
& Bothwell, 1976), a self-report instrument yielding estimates of
interpersonal, occupational, and recreational functioning. The
LIFE and SAS-SR were administered at baseline and repeated at
predetermined intervals, including the 5-year follow-up. The same
interviewers administered both interviews (i.e., the LIFE and
DIPD-IV) at a given assessment interval; however, it was unlikely
that the interviewer who administered the DIPD-IV at baseline
also administered the LIFE at 5-year follow-up.
Data Analytic Procedures
We first examined the convergent validity of clinicians’ PAF
diagnoses with those from a semistructured diagnostic interview
(DIPD-IV) and self-report questionnaire (SNAP-2). PAF dimen-
sional ratings were compared with those from the DIPD-IV and
SNAP-2 (all at baseline) for their ability to predict functional
outcomes at the 60-month follow-up (via the LIFE and SAS-SR)
using hierarchical regression analyses. For example, the clinicians’
baseline PAF ratings for the four PDs were entered simultaneously
in one step, followed by the baseline PDs ratings from the
SNAP-2. This was then repeated with the order of entry reversed.
To account for possible contamination due to shared method
variance, we conducted these analyses separately using the self-
report criterion and again with the interview-based criterion vari-
able.
PAF diagnoses had been used to confirm the DIPD-IV diagnosis
for a subset of participants, creating a potential confound. Al-
though our use of functional outcomes rather than diagnostic
information as criteria attenuates this possibility, we nonetheless
examined it by performing a parallel set of analyses restricted to a
subsample of 110 participants for whom the PAF disagreed with
the DIPD-IV at baseline and thus was not required for study
inclusion. In this subsample, PAF ratings would potentially have
greater ability to increment the DIPD-IV scores.
Results
Categorical and Dimensional Agreement
Table 1 provides the agreement between PAF ratings and those
from the DIPD-IV and SNAP-2. Categorical agreement (kappas)
between treating clinicians’ diagnoses and the semistructured di-
agnostic interview ranged from of .21 (avoidant) to .42 (schizo-
typal), whereas dimensional agreement (Pearson correlations)
ranged from .30 (avoidant) to .44 (borderline). Agreement between
clinicians’ ratings and self-report questionnaire was lower than
between clinicians’ ratings and semistructured diagnostic inter-
views, with kappas ranging from .00 (OCPD) to .20 (borderline)
and Pearson correlations ranging from .18 (schizotypal) to .28
(borderline). For context, we note that agreement between
DIPD-IV and SNAP-2 in the current sample ranged from .25
(OCPD) to .51 (avoidant) for categorical diagnoses and from .57
(schizotypal) to .72 (avoidant) for dimensional ratings.
Incremental Predictive Validity
Tables 26 summarize the hierarchical regression analyses. Ta-
ble 2 shows that the DIPD-IV provided significant increment
beyond the PAF for predicting functioning assessed by both the
SAS-SR and LIFE. In contrast, clinicians’ ratings did not signifi-
cantly increment the DIPD-IV interview results for either criterion.
The nonsignificant #R
2
when the PAF block was added does not
indicate that all PAF diagnoses lacked validity, as the individual
schizotypal rating from the PAF was a significant predictor ($!
.15; p " .05). Table 3 summarizes the parallel series of analyses on
Table 1
Dimensional and Categorical Agreement of Clinician PD
Diagnostic Ratings With Interview Generated and Self-Report
PD Scores
PAF ratings
DIPD-IV criteria
counts SNAP-2 PD scores
% r % r
Schizotypal .42 .40 .01 .18
Borderline .38 .44 .20 .28
Avoidant .21 .30 .14 .23
OCPD .24 .30 .00 .20
Note. n ! 320. Kappa between diagnoses provided by PAF (!4) and
from DIPD-IV and SNAP-2 (meeting diagnostic criteria threshold). Di-
mensional agreements represent Pearson correlations of PAF ratings (1–6)
with scores from DIPD-IV and SNAP-2. PD ! personality disorder;
PAF ! Personality Assessment Form; DIPD-IV ! Diagnostic Interview
for DSM–IV Personality Disorders; SNAP-2 ! Schedule for Nonadaptive
and Adaptive Personality–2; OCPD ! obsessive-compulsive personality
disorder.
This document is copyrighted by the American Psychological Association or one of its allied publishers.
This article is intended solely for the personal use of the individual user and is not to be disseminated broadly.
653
VALIDITY OF CLINICIANS’ PERSONALITY DISORDER DIAGNOSES

Citations
More filters
Journal ArticleDOI
TL;DR: Highland Hierarchical Taxonomy of Psychopathology represents a viable alternative to classifying mental illness that can be integrated into practice today, although research is needed to further establish its utility.
Abstract: Author(s): Ruggero, Camilo J; Kotov, Roman; Hopwood, Christopher J; First, Michael; Clark, Lee Anna; Skodol, Andrew E; Mullins-Sweatt, Stephanie N; Patrick, Christopher J; Bach, Bo; Cicero, David C; Docherty, Anna; Simms, Leonard J; Bagby, R Michael; Krueger, Robert F; Callahan, Jennifer L; Chmielewski, Michael; Conway, Christopher C; De Clercq, Barbara; Dornbach-Bender, Allison; Eaton, Nicholas R; Forbes, Miriam K; Forbush, Kelsie T; Haltigan, John D; Miller, Joshua D; Morey, Leslie C; Patalay, Praveetha; Regier, Darrel A; Reininghaus, Ulrich; Shackman, Alexander J; Waszczuk, Monika A; Watson, David; Wright, Aidan GC; Zimmermann, Johannes | Abstract: ObjectiveDiagnosis is a cornerstone of clinical practice for mental health care providers, yet traditional diagnostic systems have well-known shortcomings, including inadequate reliability, high comorbidity, and marked within-diagnosis heterogeneity. The Hierarchical Taxonomy of Psychopathology (HiTOP) is a data-driven, hierarchically based alternative to traditional classifications that conceptualizes psychopathology as a set of dimensions organized into increasingly broad, transdiagnostic spectra. Prior work has shown that using a dimensional approach improves reliability and validity, but translating a model like HiTOP into a workable system that is useful for health care providers remains a major challenge.MethodThe present work outlines the HiTOP model and describes the core principles to guide its integration into clinical practice.ResultsPotential advantages and limitations of the HiTOP model for clinical utility are reviewed, including with respect to case conceptualization and treatment planning. A HiTOP approach to practice is illustrated and contrasted with an approach based on traditional nosology. Common barriers to using HiTOP in real-world health care settings and solutions to these barriers are discussed.ConclusionsHiTOP represents a viable alternative to classifying mental illness that can be integrated into practice today, although research is needed to further establish its utility. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

126 citations


Cites background from "Convergent and incremental predicti..."

  • ...These can mitigate the issue of feasibility by reducing provider burden without necessarily com promising validity (Samuel et al., 2013; Samuel, Suzuki, & Grif fin, 2016)....

    [...]

  • ...These can mitigate the issue of feasibility by reducing provider burden without necessarily compromising validity (Samuel et al., 2013; Samuel, Suzuki, & Griffin, 2016)....

    [...]

Journal ArticleDOI
TL;DR: Results indicate that the PID-5 shares a common structure with the FFM and clarify the placement of some interstitial facets, including those that have not loaded consistently in previous studies.
Abstract: The Personality Inventory for DSM-5 (PID-5) was developed as a measure of the maladaptive personality trait model included within Section III of the DSM-5. Although preliminary findings have suggested the PID-5 has a five-factor structure that overlaps considerably with the Five-Factor Model (FFM) at the higher order level, there has been much less attention on the specific locations of the 25 lower-order traits. Joint exploratory factor analysis of the PID-5 traits and the 30 facets of the NEO-PI-R were used to determine the lower-order structure of the PID-5. Results indicated the PID-5's domain-level structure closely resembled the FFM. We also explored the placement of several lower-order facets that have not loaded consistently in previous studies. Overall, these results indicate that the PID-5 shares a common structure with the FFM and clarify the placement of some interstitial facets. More research investigating the lower-order facets is needed to determine how they fit into the hierarchical structure and explicate their relationships to existing measures of pathological traits.

82 citations


Cites methods from "Convergent and incremental predicti..."

  • ...Although self-reports of PDs do appear to have considerable validity (Samuel et al., 2013), it would be useful to utilize other methods of assessing these traits....

    [...]

Journal ArticleDOI
TL;DR: Results suggest relatively little overlap between PD diagnoses assigned in research versus naturalistic settings.
Abstract: This review synthesizes a wide literature on the agreement of treating clinicians’ PD diagnoses with each other and their convergence with common research methods. Median interrater reliability between clinicians was moderate when calculated dimensionally (r = .46) or categorically (κ = .40). The agreement between clinicians’ diagnoses and those from research methods (e.g., self-report questionnaire) was more modest. Median dimensional agreement across 27 studies ranged from .05 to .36, with an overall median of .23. This overall value was moderated by several factors. First, clinicians’ diagnoses agreed more with semi-structured interviews than self-report questionnaires. Second, convergence increased slightly when clinicians utilized more systematic diagnostic methods. Results suggest relatively little overlap between PD diagnoses assigned in research versus naturalistic settings.

35 citations

Journal ArticleDOI
TL;DR: Results showed that student clinicians can learn Criterion A of the AMPD to a high level of interrater reliability and agreement with expert ratings, and the model, including the LPF, is very learnable.
Abstract: The Diagnostic and Statistical Manual of Mental Disorders (5th ed. [DSM–5]; American Psychiatric Association, 2013) Section III Alternative Model for Personality Disorders (AMPD) represents a novel...

34 citations


Cites background from "Convergent and incremental predicti..."

  • ...For example, self-perceptions differ from informant observations for PDs (Carlson, Vazire, & Oltmanns, 2013); the level of agreement between and predictive validity of self-report, structured interview, and clinician ratings often vary for PDs (Samuel et al., 2013); and clinicians and PD patients diverge in their assessments of variables related to PD (Gritti, Samuel, & Lang, 2016)....

    [...]

  • ...…& Oltmanns, 2013); the level of agreement between and predictive validity of self-report, structured interview, and clinician ratings often vary for PDs (Samuel et al., 2013); and clinicians and PD patients diverge in their assessments of variables related to PD (Gritti, Samuel, & Lang, 2016)....

    [...]

  • ...Such shortcomings include, but are not limited to, high comorbidity rates, excessive heterogeneity within PDs, and a lack of empirical support for categorical taxonomic structure (see Krueger, Hopwood, Wright, & Markon, 2014)....

    [...]

Journal ArticleDOI
TL;DR: Data indicate that clinical traits relevant to emotional disorders fit well within the traditional personality framework and offer some unique contributions to the prediction of psychopathology, but it is important to distinguish their effects from negative temperament/neuroticism.
Abstract: Certain clinical traits (e.g., ruminative response style, self-criticism, perfectionism, anxiety sensitivity, fear of negative evaluation, and thought suppression) increase the risk for and chronicity of emotional disorders. Similar to traditional personality traits, they are considered dispositional and typically show high temporal stability. Because the personality and clinical-traits literatures evolved largely independently, connections between them are not fully understood. We sought to map the interface between a widely studied set of clinical and personality traits. Two samples (N = 385 undergraduates; N = 188 psychiatric outpatients) completed measures of personality traits, clinical traits, and an interview-based assessment of emotional-disorder symptoms. First, the joint factor structure of these traits was examined in each sample. Second, structural equation modeling was used to clarify the effects of clinical traits in the prediction of clinical symptoms beyond negative temperament. Third, the incremental validity of clinical traits beyond a more comprehensive set of higher-order and lower-order personality traits was examined using hierarchical regression. Clinical and personality traits were highly correlated and jointly defined a 3-factor structure-Negative Temperament, Positive Temperament, and Disinhibition-in both samples, with all clinical traits loading on the Negative Temperament factor. Clinical traits showed modest but significant incremental validity in explaining symptoms after accounting for personality traits. These data indicate that clinical traits relevant to emotional disorders fit well within the traditional personality framework and offer some unique contributions to the prediction of psychopathology, but it is important to distinguish their effects from negative temperament/neuroticism. (PsycINFO Database Record

26 citations


Cites result from "Convergent and incremental predicti..."

  • ...Nonetheless, multisource and multiobservation studies on personality taxonomy have been consistent with findings of self-report studies (e.g., Kandler, Bleidorn, Riemann, Angleitner, & Spinath, 2011; Samuel et al., 2013), so these results likely are highly generalizable....

    [...]

References
More filters
Journal ArticleDOI
TL;DR: An issue concerning the criteria for tic disorders is highlighted, and how this might affect classification of dyskinesias in psychotic spectrum disorders.
Abstract: Given the recent attention to movement abnormalities in psychosis spectrum disorders (e.g., prodromal/high-risk syndromes, schizophrenia) (Mittal et al., 2008; Pappa and Dazzan, 2009), and an ongoing discussion pertaining to revisions of the Diagnostic and Statistical Manuel of Mental Disorders (DSM) for the upcoming 5th edition, we would like to take this opportunity to highlight an issue concerning the criteria for tic disorders, and how this might affect classification of dyskinesias in psychotic spectrum disorders. Rapid, non-rhythmic, abnormal movements can appear in psychosis spectrum disorders, as well as in a host of commonly co-occurring conditions, including Tourette’s Syndrome and Transient Tic Disorder (Kerbeshian et al., 2009). Confusion can arise when it becomes necessary to determine whether an observed movement (e.g., a sudden head jerk) represents a spontaneous dyskinesia (i.e., spontaneous transient chorea, athetosis, dystonia, ballismus involving muscle groups of the arms, legs, trunk, face, and/or neck) or a tic (i.e., stereotypic or patterned movements defined by the relationship to voluntary movement, acute and chronic time course, and sensory urges). Indeed, dyskinetic movements such as dystonia (i.e., sustained muscle contractions, usually producing twisting and repetitive movements or abnormal postures or positions) closely resemble tics in a patterned appearance, and may only be visually discernable by attending to timing differences (Gilbert, 2006). When turning to the current DSM-IV TR for clarification, the description reads: “Tic Disorders must be distinguished from other types of abnormal movements that may accompany general medical conditions (e.g., Huntington’s disease, stroke, Lesch-Nyhan syndrome, Wilson’s disease, Sydenham’s chorea, multiple sclerosis, postviral encephalitis, head injury) and from abnormal movements that are due to the direct effects of a substance (e.g., a neuroleptic medication)”. However, as it is written, it is unclear if psychosis falls under one such exclusionary medical disorder. The “direct effects of a substance” criteria, referencing neuroleptic medications, further contributes to the uncertainty around this issue. As a result, ruling-out or differentiating tics in psychosis spectrum disorders is at best, a murky endeavor. Historically, the advent of antipsychotic medication in the 1950s has contributed to the confusion about movement signs in psychiatric populations. Because neuroleptic medications produce characteristic movement disorder in some patients (i.e. extrapyramidal side effects), drug-induced movement disturbances have been the focus of research attention in psychotic disorders. However, accumulating data have documented that spontaneous dyskinesias, including choreoathetodic movements, can occur in medication naive adults with schizophrenia spectrum disorders (Pappa and Dazzan, 2009), as well as healthy first-degree relatives of chronically ill schizophrenia patients (McCreadie et al., 2003). Taken together, this suggests that movement abnormalities may reflect pathogenic processes underlying some psychotic disorders (Mittal et al., 2008; Pappa and Dazzan, 2009). More specifically, because spontaneous hyperkinetic movements are believed to reflect abnormal striatal dopamine activity (DeLong and Wichmann, 2007), and dysfunction in this same circuit is also proposed to contribute to psychosis, it is possible that spontaneous dyskinesias serve as an outward manifestation of circuit dysfunction underlying some schizophrenia-spectrum symptoms (Walker, 1994). Further, because these movements precede the clinical onset of psychotic symptoms, sometimes occurring in early childhood (Walker, 1994), and may steadily increase during adolescence among populations at high-risk for schizophrenia (Mittal et al., 2008), observable dyskinesias could reflect a susceptibility that later interacts with environmental and neurodevelopmental factors, in the genesis of psychosis. In adolescents who meet criteria for a prodromal syndrome (i.e., the period preceding formal onset of psychotic disorders characterized by subtle attenuated positive symptoms coupled with a decline in functioning), there is sometimes a history of childhood conditions which are also characterized by suppressible tics or tic like movements (Niendam et al., 2009). On the other hand, differentiating between tics and dyskinesias has also complicated research on childhood disorders such as Tourette syndrome (Kompoliti and Goetz, 1998; Gilbert, 2006). We propose consideration of more explicit and operationalized criteria for differentiating tics and dyskinesias, based on empirically derived understanding of neural mechanisms. Further, revisions of the DSM should allow for the possibility that movement abnormalities might reflect neuropathologic processes underlying the etiology of psychosis for a subgroup of patients. Psychotic disorders might also be included among the medical disorders that are considered a rule-out for tics. Related to this, the reliability of movement assessment needs to be improved, and this may require more training for mental health professionals in movement symptoms. Although standardized assessment of movement and neurological abnormalities is common in research settings, it has been proposed that an examination of neuromotor signs should figure in the assessment of any patient, and be as much a part of the patient assessment as the mental state examination (Picchioni and Dazzan, 2009). To this end it is important for researchers and clinicians to be aware of differentiating characteristics for these two classes of abnormal movement. For example, tics tend to be more complex than myoclonic twitches, and less flowing than choreoathetodic movements (Kompoliti and Goetz, 1998). Patients with tics often describe a sensory premonition or urge to perform a tic, and the ability to postpone tics at the cost of rising inner tension (Gilbert, 2006). For example, one study showed that patients with tic disorders could accurately distinguish tics from other movement abnormalities based on the subjective experience of some voluntary control of tics (Lang, 1991). Another differentiating factor derives from the relationship of the movement in question to other voluntary movements. Tics in one body area rarely occur during purposeful and voluntary movements in that same body area whereas dyskinesia are often exacerbated by voluntary movement (Gilbert, 2006). Finally, it is noteworthy that tics wax and wane in frequency and intensity and migrate in location over time, often becoming more complex and peaking between the ages of 9 and 14 years (Gilbert, 2006). In the case of dyskinesias among youth at-risk for psychosis, there is evidence that the movements tend to increase in severity and frequency as the individual approaches the mean age of conversion to schizophrenia spectrum disorders (Mittal et al., 2008). As revisions to the DSM are currently underway in preparation for the new edition (DSM V), we encourage greater attention to the important, though often subtle, distinctions among subtypes of movement abnormalities and their association with psychiatric syndromes.

67,017 citations

Journal ArticleDOI
TL;DR: In this paper, the authors provide guidelines, guidelines, and simple rules of thumb to assist the clinician faced with the challenge of choosing an appropriate test instrument for a given psychological assessment.
Abstract: In the context of the development of prototypic assessment instruments in the areas of cognition, personality, and adaptive functioning, the issues of standardization, norming procedures, and the important psychometrics of test reliability and validity are evaluated critically. Criteria, guidelines, and simple rules of thumb are provided to assist the clinician faced with the challenge of choosing an appropriate test instrument for a given psychological assessment. Clinicians are often faced with the critical challenge of choosing the most appropriate available test instrument for a given psychological assessment of a child, adolescent, or adult of a particular age, gender, and class of disability. It is the purpose of this report to provide some criteria, guidelines, or simple rules of thumb to aid in this complex scientific decision. As such, it draws upon my experience with issues of test development, standardization, norming procedures, and important psychometrics, namely, test reliability and validity. As I and my colleagues noted in an earlier publication, the major areas of psychological functioning, in the normal development of infants, children, adolescents, adults, and elderly people, include cognitive, academic, personality, and adaptive behaviors (Sparrow, Fletcher, & Cicchetti, 1985). As such, the major examples or applications discussed in this article derive primarily, although not exclusively, from these several areas of human functioning.

7,254 citations

Journal ArticleDOI
TL;DR: The derivation and testing of a simple and inexpensive method, the Social Adjustment Scale Self-Report, is described, which covers the patient's role performance, interpersonal relationships, friction, feelings and satisfaction in work, and social and leisure activities with the extended family.
Abstract: Current emphasis on early case finding, outpatient care, and on longitudinal studies of asymptomatic patients has focused attention on the community adjustment of psychiatric patients. Thus, simple and inexpensive methods such as self-report scales, which allow the routine assessment of patient adjustment, are potentially useful. The derivation and testing of such a method, the Social Adjustment Scale Self-Report, is described. This scale covers the patient's role performance, interpersonal relationships, friction, feelings and satisfaction in work, and social and leisure activities with the extended family, as a spouse, parent, and member of a family unit. Self-report results based on 76 depressed outpatients were comparable to those obtained from relatives as well as by a rater who interviewed the patient directly.

1,715 citations


"Convergent and incremental predicti..." refers methods in this paper

  • ...Participants also completed the SAS-SR (Weissman & Bothwell, 1976), a self-report instrument yielding estimates of interpersonal, occupational, and recreational functioning....

    [...]

Journal ArticleDOI
TL;DR: The Longitudinal Interval Follow-up Evaluation (LIFE) is an integrated system for assessing the longitudinal course of psychiatric disorders that consists of a semistructured interview, an Instruction booklet, a coding sheet, and a set of training materials.
Abstract: • The Longitudinal Interval Follow-up Evaluation (LIFE) is an integrated system for assessing the longitudinal course of psychiatric disorders. It consists of a semistructured interview, an instruction booklet, a coding sheet, and a set of training materials. An interviewer uses the LIFE to collect detailed psychosocial, psychopathologic, and treatment information for a six-month follow-up interval. The weekly psychopathology measures ("psychiatric status ratings") are ordinal symptom-based scales with categories defined to match the levels of symptoms used in the Research Diagnostic Criteria. The ratings provide a separate, concurrent record of the course of each disorder initially diagnosed in patients or developing during the follow-up. AnyDSM-IIIor Research Diagnostic Criteria disorder can be rated with the LIFE, and any length or number of follow-up intervals can be accommodated. The psychosocial and treatment information is recorded so that these data can be linked temporally to the psychiatric status ratings.

1,521 citations


"Convergent and incremental predicti..." refers methods in this paper

  • ...To assess psychosocial functioning, CLPS research team interviewers administered the LIFE (Keller et al., 1987), a structured interview assessing functioning in interpersonal relationships and occupational and recreational domains....

    [...]

Frequently Asked Questions (2)
Q1. What contributions have the authors mentioned in the paper "Convergent and incremental predictive validity of clinician, self-report, and structured interview diagnoses for personality disorders over 5 years" ?

In this paper, the authors showed that PD diagnoses made by treating clinicians agree poorly with semistructured interviews and self-report questionnaires, and that the latter two methods have greater utility than clinicians ' PD diagnoses for predicting psychosocial functioning. 

Future research that examines the incremental predictive validity of clinicians ’ diagnoses derived from more structured assessments, such as therapists completing the SWAP ( Westen & Shedler, 1999 ), the Personality Disorder Schedule ( Nestadt et al., 2012 ), or even an informant version of an existing PD questionnaire, would help to address this possibility. Future research exploring the validity of other psychiatric diagnoses provided by clinicians in routine practice warrants attention. Rather, their results suggest that clinicians use standardized assessment instruments to inform PD diagnoses.