Showing papers in "Psychological Assessment in 2017"
TL;DR: The results indicate that the CAPS-5 is a psychometrically sound measure of DSM–5 PTSD diagnosis and symptom severity and that it provides continuity in evidence-based assessment of PTSD in the transition from DSM–IV to DSM-5 criteria.
Abstract: The Clinician-Administered PTSD Scale (CAPS) is an extensively validated and widely used structured diagnostic interview for posttraumatic stress disorder (PTSD). The CAPS was recently revised to correspond with PTSD criteria in the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5; American Psychiatric Association, 2013). This article describes the development of the CAPS for DSM-5 (CAPS-5) and presents the results of an initial psychometric evaluation of CAPS-5 scores in 2 samples of military veterans (Ns = 165 and 207). CAPS-5 diagnosis demonstrated strong interrater reliability (к = .78 to 1.00, depending on the scoring rule) and test-retest reliability (к = .83), as well as strong correspondence with a diagnosis based on the CAPS for DSM-IV (CAPS-IV; к = .84 when optimally calibrated). CAPS-5 total severity score demonstrated high internal consistency (α = .88) and interrater reliability (ICC = .91) and good test-retest reliability (ICC = .78). It also demonstrated good convergent validity with total severity score on the CAPS-IV (r = .83) and PTSD Checklist for DSM-5 (r = .66) and good discriminant validity with measures of anxiety, depression, somatization, functional impairment, psychopathy, and alcohol abuse (rs = .02 to .54). Overall, these results indicate that the CAPS-5 is a psychometrically sound measure of DSM-5 PTSD diagnosis and symptom severity. Importantly, the CAPS-5 strongly corresponds with the CAPS-IV, which suggests that backward compatibility with the CAPS-IV was maintained and that the CAPS-5 provides continuity in evidence-based assessment of PTSD in the transition from DSM-IV to DSM-5 criteria. (PsycINFO Database Record
866 citations
TL;DR: Preliminary reliability and validity data is provided for a measure that directly corresponds to core personality pathology as operationalized in the AMPD, and items representing the 4 subcomponents of personality dysfunction were found to manifest high degrees of internal consistency.
Abstract: The DSM-5 presents an Alternative Model for Personality Disorder (AMPD) recommending the assessment of impairments in core personality functions as well as clinically relevant personality traits. Although a self-report assessment instrument has been provided corresponding to the trait model proposed in the AMPD, no comparable instrument provides a direct assessment of the specific indicators of core personality functions described in that model. The goal of this paper is to provide preliminary reliability and validity data for a measure that directly corresponds to core personality pathology as operationalized in the AMPD. Self-report questions were generated to capture each diagnostic indicator provided in the Level of Personality Functioning Scale, a clinician rating guide provided in the AMPD that describes characteristic impairments in identity, self-direction, empathy, and intimacy at 5 different levels of personality functioning. These questions were administered to a community sample of 306 participants, with the resulting scale examined for internal consistency, unidimensionality, and concurrent validity with 4 other self-report measures of global personality dysfunction. Items representing the 4 subcomponents of personality dysfunction were found to manifest high degrees of internal consistency, and were highly related to each other, supporting the AMPD contention that these core dysfunctions reflect a single dimension of personality dysfunction. Correlations with concurrent validity measures were large, with associations at the global level of dysfunction often exceeding .80. The developed instrument is reprinted in the supplementary materials, with the goal of encouraging additional refinement and development by other investigators as part of the call for additional research on the AMPD. (PsycINFO Database Record
158 citations
San Diego State University1, California State University, Dominguez Hills2, University of Miami3, University of Illinois at Chicago4, University of California, San Diego5, Northwestern University6, Albert Einstein College of Medicine7, University of North Carolina at Chapel Hill8, Roosevelt University9
TL;DR: The CES-D 10 was examined for internal consistency, test–retest reliability, convergent validity, and measurement invariance, and multiple group analyses showed the 1-factor structure to be invariant across English and Spanish speaking responders and partially invariants across Hispanic/Latino background groups.
Abstract: The Center for Epidemiologic Studies Depression Scale (CES-D) is a widely used self-report measure of depression symptomatology. This study evaluated the reliability, validity, and measurement invariance of the CES-D 10 in a diverse cohort of Hispanics/Latinos from the Hispanic Community Health Study/Study of Latinos (HCHS/SOL). The sample consisted of 16,415 Hispanic/Latino adults recruited from 4 field centers (Miami, FL; San Diego, CA; Bronx, NY; Chicago, IL). Participants completed interview administered measures in English or Spanish. The CES-D 10 was examined for internal consistency, test-retest reliability, convergent validity, and measurement invariance. The total score for the CES-D 10 displayed acceptable internal consistencies (Cronbach's alpha's = .80-.86) and test-retest reliability (r values = .41-.70) across the total sample, language group and ethnic background group. The total CES-D 10 scores correlated in a theoretically consistent manner with the Spielberger State-Trait Anxiety Inventory, r = .72, p < .001, the Patient Health Questionnaire-9 depression measure, r = .80, p < .001, the Short Form-12's Mental Component Summary, r = -.65, p < .001, and Physical Component Summary score, r = -.25, p < .001. A confirmatory factor analysis showed that a 1-factor model fit the CES-D 10 data well (CFI = .986, RMSEA = .047) after correlating 1 pair of item residual variances. Multiple group analyses showed the 1-factor structure to be invariant across English and Spanish speaking responders and partially invariant across Hispanic/Latino background groups. The total score of the CES-D 10 can be recommended for use with Hispanics/Latinos in English and Spanish. (PsycINFO Database Record
135 citations
TL;DR: The purpose of the current study was to develop and provide initial validation for the Personality Inventory for ICD-11 (PiCD), a self-report measure of this proposed 5-domain maladaptive trait model.
Abstract: Proposed for the 11th edition of the World Health Organization's International Classification of Diseases (ICD-11) is a dimensional trait model for the classification of personality disorder (Tyrer, Reed, & Crawford, 2015). The ICD-11 proposal consists of 5 broad domains: negative affective, detachment, dissocial, disinhibition, and anankastic (Mulder, Horwood, Tyrer, Carter, & Joyce, 2016). Several field trials have examined this proposal, yet none has included a direct measure of the trait model. The purpose of the current study was to develop and provide initial validation for the Personality Inventory for ICD-11 (PiCD), a self-report measure of this proposed 5-domain maladaptive trait model. Item selection and scale construction proceeded through 3 initial data collections assessing potential item performance. Two subsequent studies were conducted for scale validation. In Study 1, the PiCD was evaluated in a sample of 259 MTurk participants (who were or had been receiving mental health treatment) with respect to 2 measures of general personality structure: The Eysenck Personality Questionnaire-Revised and the 5-Dimensional Personality Test. In Study 2, the PiCD was evaluated in an additional sample of 285 participants with respect to 2 measures of maladaptive personality traits: The Personality Inventory for DSM-5 and the Computerized Adaptive Test for Personality Disorders. Study 3 provides an item-level exploratory structural equation model with the combined samples from Studies 1 and 2. The results are discussed with respect to the validity of the measure and the potential benefits for future research in having a direct, self-report measure of the ICD-11 trait proposal. (PsycINFO Database Record
131 citations
TL;DR: The present study tested the measurement invariance of the 21-item version of the DASS-21 in Poland, Russia, the United Kingdom, and the United States of America; the Russian sample had the highest levels of anxiety symptoms and the Polish sample demonstrated the highest stress levels.
Abstract: The rising burden of mental and behavioral disorders has become a global challenge (Murray et al., 2012). Measurement invariant clinical instruments are necessary for the assessment of relevant symptoms across countries. The present study tested the measurement invariance of the 21-item version of the Depression, Anxiety, and Stress Scales (DASS; Lovibond & Lovibond, 1995b) in Poland, Russia, the United Kingdom (U.K.), and the United States of America (U.S.). Telephone interviews were conducted with population-based samples (nPL = 1003, nRU = 3020, nU.K. = 1002, nU.S. = 1002). The DASS-21 shows threshold measurement invariance. Comparisons of latent means did not indicate differences between U.K. and U.S. SAMPLES However, Polish and Russian samples reported more depressive symptoms compared with U.K. and U.S. samples; the Russian sample had the highest levels of anxiety symptoms and the Polish sample demonstrated the highest stress levels. The DASS-21 can be recommended to meaningfully compare the relationships between variables across groups and to compare latent means in Polish-, Russian-, and English-speaking populations. (PsycINFO Database Record
98 citations
TL;DR: Assessment of the cross-cultural measurement invariance of questionnaires for 6 positive constructs indicated differences between national groups and confirmed at least partial strong measurement invariances for all scales except the LOT-R and Subjective Happiness Scale.
Abstract: Research into positive aspects of the psyche is growing as psychologists learn more about the protective role of positive processes in the development and course of mental disorders, and about their substantial role in promoting mental health. With increasing globalization, there is strong interest in studies examining positive constructs across cultures. To obtain valid cross-cultural comparisons, measurement invariance for the scales assessing positive constructs has to be established. The current study aims to assess the cross-cultural measurement invariance of questionnaires for 6 positive constructs: Social Support (Fydrich, Sommer, Tydecks, & Brahler, 2009), Happiness (Subjective Happiness Scale; Lyubomirsky & Lepper, 1999), Life Satisfaction (Diener, Emmons, Larsen, & Griffin, 1985), Positive Mental Health Scale (Lukat, Margraf, Lutz, van der Veld, & Becker, 2016), Optimism (revised Life Orientation Test [LOT-R]; Scheier, Carver, & Bridges, 1994) and Resilience (Schumacher, Leppert, Gunzelmann, Strauss, & Brahler, 2004). Participants included German (n = 4,453), Russian (n = 3,806), and Chinese (n = 12,524) university students. Confirmatory factor analyses and measurement invariance testing demonstrated at least partial strong measurement invariance for all scales except the LOT-R and Subjective Happiness Scale. The latent mean comparisons of the constructs indicated differences between national groups. Potential methodological and cultural explanations for the intergroup differences are discussed. (PsycINFO Database Record
98 citations
TL;DR: Processing speed based EVIs have the potential to provide a cost-effective and expedient method for evaluating the validity of cognitive data, however, they should not be used in isolation to determine the credibility of a given response set.
Abstract: Research suggests that select processing speed measures can also serve as embedded validity indicators (EVIs). The present study examined the diagnostic utility of Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) subtests as EVIs in a mixed clinical sample of 205 patients medically referred for neuropsychological assessment (53.3% female, mean age = 45.1). Classification accuracy was calculated against 3 composite measures of performance validity as criterion variables. A PSI ≤79 produced a good combination of sensitivity (.23-.56) and specificity (.92-.98). A Coding scaled score ≤5 resulted in good specificity (.94-1.00), but low and variable sensitivity (.04-.28). A Symbol Search scaled score ≤6 achieved a good balance between sensitivity (.38-.64) and specificity (.88-.93). A Coding-Symbol Search scaled score difference ≥5 produced adequate specificity (.89-.91) but consistently low sensitivity (.08-.12). A 2-tailed cutoff on the Coding/Symbol Search raw score ratio (≤1.41 or ≥3.57) produced acceptable specificity (.87-.93), but low sensitivity (.15-.24). Failing ≥2 of these EVIs produced variable specificity (.81-.93) and sensitivity (.31-.59). Failing ≥3 of these EVIs stabilized specificity (.89-.94) at a small cost to sensitivity (.23-.53). Results suggest that processing speed based EVIs have the potential to provide a cost-effective and expedient method for evaluating the validity of cognitive data. Given their generally low and variable sensitivity, however, they should not be used in isolation to determine the credibility of a given response set. They also produced unacceptably high rates of false positive errors in patients with moderate-to-severe head injury. Combining evidence from multiple EVIs has the potential to improve overall classification accuracy. (PsycINFO Database Record
94 citations
TL;DR: The MINI-KID disorder classifications yielded estimates of test–retest reliability and validity comparable to other standardized diagnostic interviews in both general population and clinic samples, making it a good candidate for use in epidemiological research and clinical practice.
Abstract: The goals of the study were to examine test-retest reliability, informant agreement and convergent and discriminant validity of nine DSM-IV-TR psychiatric disorders classified by parent and youth versions of the Mini International Neuropsychiatric Interview for Children and Adolescents (MINI-KID). Using samples drawn from the general population and child mental health outpatient clinics, 283 youth aged 9 to 18 years and their parents separately completed the MINI-KID with trained lay interviewers on two occasions 7 to 14 days apart. Test-retest reliability estimates based on kappa (κ) went from 0.33 to 0.79 across disorders, samples and informants. Parent-youth agreement on disorders was low (average κ = 0.20). Confirmatory factor analysis provided evidence supporting convergent and discriminant validity. The MINI-KID disorder classifications yielded estimates of test-retest reliability and validity comparable to other standardized diagnostic interviews in both general population and clinic samples. These findings, in addition to the brevity and low administration cost, make the MINI-KID a good candidate for use in epidemiological research and clinical practice. (PsycINFO Database Record
91 citations
TL;DR: Recommendations to researchers and practitioners are that only the speed score (and error-corrected speed score) is eligible for highly reliable assessment, and that test length may be reduced up to 50%, if necessary for time-economic reasons, to serve purposes of population screening and field assessment.
Abstract: We provide a psychometric analysis of commonly used performance indices of the d2 sustained-attention test, and give methodical guidelines and recommendations, based on this research. We examined experimental effects of repeated testing on performance speed and accuracy (omission and commission errors), and further evaluated aspects of test reliability by means of cumulative reliability function (CRF) analysis. These aspects were also examined for a number of alternative (yet commonly used) scoring techniques and valuation methods. Results indicate that performance is sensitive to change, both differentially within (time-on-task) and between (test-retest) sessions. These effects did not severely affect test reliability, since perfect score reliability was observed for measures of speed (and was even preserved with half the test length) while variability and error scores were more problematic with respect to reliability. Notably, limitations particularly hold for commission but less so for omission errors. Our recommendations to researchers and practitioners are that (a) only the speed score (and error-corrected speed score) is eligible for highly reliable assessment, that (b) error scores might be used as a secondary measure (e.g., to check for aberrant behavior), that (c) variability scores might not be used at all. Given the exceptional reliability of performance speed, and (d) test length may be reduced up to 50%, if necessary for time-economic reasons, to serve purposes of population screening and field assessment. (PsycINFO Database Record
84 citations
TL;DR: The factor structure of the Wechsler Intelligence Scale for Children-Fifth Edition standardization sample was examined using confirmatory factor analyses (CFA) with maximum likelihood estimation for all reported models from the WISC-V Technical and Interpretation Manual.
Abstract: The factor structure of the Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V; Wechsler, 2014a) standardization sample (N = 2,200) was examined using confirmatory factor analyses (CFA) with maximum likelihood estimation for all reported models from the WISC-V Technical and Interpretation Manual (Wechsler, 2014b). Additionally, alternative bifactor models were examined and variance estimates and model-based reliability estimates (ω coefficients) were provided. Results from analyses of the 16 primary and secondary WISC-V subtests found that all higher-order CFA models with 5 group factors (VC, VS, FR, WM, and PS) produced model specification errors where the Fluid Reasoning factor produced negative variance and were thus judged inadequate. Of the 16 models tested, the bifactor model containing 4 group factors (VC, PR, WM, and PS) produced the best fit. Results from analyses of the 10 primary WISC-V subtests also found the bifactor model with 4 group factors (VC, PR, WM, and PS) produced the best fit. Variance estimates from both 16 and 10 subtest based bifactor models found dominance of general intelligence (g) in accounting for subtest variance (except for PS subtests) and large ω-hierarchical coefficients supporting general intelligence interpretation. The small portions of variance uniquely captured by the 4 group factors and low ω-hierarchical subscale coefficients likely render the group factors of questionable interpretive value independent of g (except perhaps for PS). Present CFA results confirm the EFA results reported by Canivez, Watkins, and Dombrowski (2015); Dombrowski, Canivez, Watkins, and Beaujean (2015); and Canivez, Dombrowski, and Watkins (2015). (PsycINFO Database Record
82 citations
TL;DR: It is found that the new, common STATIC risk categories not only increase concordance of risk classification (from 51% to 72%)—they also allow evaluators to make the same inferences for offenders in the same category regardless of which instrument was used to assign category membership.
Abstract: This article describes principles for developing risk category labels for criterion referenced prediction measures, and demonstrates their utility by creating new risk categories for the Static-99R and Static-2002R sexual offender risk assessment tools. Currently, risk assessments in corrections and forensic mental health are typically summarized in 1 of 3 words: low, moderate, or high. Although these risk labels have strong influence on decision makers, they are interpreted differently across settings, even among trained professionals. The current article provides a framework for standardizing risk communication by matching (a) the information contained in risk tools to (b) a broadly applicable classification of "riskiness" that is independent of any particular offender risk scale. We found that the new, common STATIC risk categories not only increase concordance of risk classification (from 51% to 72%)-they also allow evaluators to make the same inferences for offenders in the same category regardless of which instrument was used to assign category membership. More generally, we argue that the risk categories should be linked to the decisions at hand, and that risk communication can be improved by grounding these risk categories in evidence-based definitions. (PsycINFO Database Record
TL;DR: The total computed score of the PSS can be recommended for use with Hispanics/Latinos in the United States that complete the measure in English or Spanish and the reverse-worded factor can enhance prediction.
Abstract: Despite widespread use, psychometric investigation of the original English and translated Spanish versions of the 10-item Perceived Stress Scale (PSS; Cohen, Kamarck, & Mermelstein, 1983) has been limited among the U.S. Hispanic/Latino population. The present study examined the factor structure, factorial invariance, and reliability and validity of PSS scores from English and Spanish versions using data from 5,176 Hispanics/Latinos who participated in the Hispanic Community Health Study/Study of Latinos Sociocultural Ancillary Study. The total sample and language multigroup confirmatory factor analyses supported a bifactor model with all 10 PSS items loading on a general perceived stress factor, and the 4 reverse-worded items also loading on a reverse-worded factor. Internal consistency ranged from .68 to .78, and it was indicated that reliable variance exists beyond the general perceived stress factor. The model displayed configural, metric, scalar, and residual invariance across language groups. Convergent validity analyses indicated that both the general perceived stress factor and the reverse-worded factor were related to scores of depression, anxiety, and anger in the expected directions. The reverse-worded factor added to the validity of the PSS beyond the general perceived stress factor. The total computed score of the PSS can be recommended for use with Hispanics/Latinos in the United States that complete the measure in English or Spanish and the reverse-worded factor can enhance prediction. (PsycINFO Database Record
TL;DR: Results indicated that resilience measured at the beginning of military service is a significant predictor of attrition from service and obtaining a mental health diagnosis within 6 months of entry.
Abstract: Results are presented for the largest study (N = 53,692) ever conducted on the 25-item Connor-Davidson Resilience Scale (CD-RISC), a popular measure of resilience. We examined the internal consistency of the CD-RISC items and associated mean resilience levels within a sample of enlisted basic trainees in the United States Air Force. In addition, the predictive validity of the CD-RISC Total Score was examined for real-life military outcomes, including attrition from service and mental health diagnosis. The CD-RISC items demonstrated strong internal consistency. Item-level examinations of scores revealed that most trainees reported relatively high resilience. Results indicated that resilience measured at the beginning of military service is a significant predictor of (a) attrition from service and (b) obtaining a mental health diagnosis within 6 months of entry. Implications and future directions are discussed. (PsycINFO Database Record
TL;DR: The findings support the use of the ACI in future studies examining SCT in adulthood and make a major contribution in moving the field toward a unified set of SCT items that can be used across studies.
Abstract: [Correction Notice: An Erratum for this article was reported in Vol 30(3) of Psychological Assessment (see record 2017-30273-001). In the article, the Table 1 item content was incorrectly ordered. The table, as well as text referencing Table 1 in the Results and Discussion, have been corrected in all versions of this article.] As interest in sluggish cognitive tempo (SCT) increases, a primary limitation for the field is the lack of a unified set of symptoms for assessing SCT. No existing SCT measure includes all items identified in a recent meta-analysis as optimal for distinguishing between SCT and attention-deficit/hyperactivity disorder (ADHD) inattention. This study evaluates a new self-report measure for assessing SCT in adulthood, the Adult Concentration Inventory (ACI), which was developed in response to the meta-analytic findings for assessing SCT. Using a large, multiuniversity sample (N = 3,172), we evaluated the convergent and discriminant validity and reliability of the ACI. We also evaluated the ACI measure of SCT in relation to self-reported demographic characteristics, daily life executive functioning, socioemotional adjustment (i.e., anxiety/depression, loneliness, emotion dysregulation, self-esteem), and functional impairment. Exploratory confirmatory factor analyses resulted in 10 ACI items demonstrating strong convergent and discriminant validity from both anxiety/depressive and ADHD inattentive symptom dimensions. SCT was moderately to-strongly correlated with daily life EF deficits, poorer socioemotional adjustment, and greater global functional impairment. Moreover, SCT remained uniquely associated in structural regression analyses with most of these external criterion domains above and beyond ADHD. Finally, when internalizing symptoms were also covaried, SCT, but not ADHD inattention, remained significantly associated with poorer socioemotional adjustment. These findings support the use of the ACI in future studies examining SCT in adulthood and make a major contribution in moving the field toward a unified set of SCT items that can be used across studies. (PsycINFO Database Record
TL;DR: Three studies were undertaken to develop the Positive–Negative Relationship Quality scale (PN-RQ), conceptualizing relationship quality as a bidimensional construct in which the positive qualities of a relationship are treated as distinct from its negative qualities.
Abstract: Three studies were undertaken to develop the Positive-Negative Relationship Quality scale (PN-RQ), conceptualizing relationship quality as a bidimensional construct in which the positive qualities of a relationship are treated as distinct from its negative qualities. Analyses in emerging adults (Study 1: N = 1,814), in online respondents (Study 2: N = 787) with a 2-week follow-up, and in a single group pre-intervention-post-intervention study (Study 3: N = 54) of the Promoting Awareness, Improving Relationships (PAIR) program provided support for (a) positive and negative qualities as distinct dimensions via confirmatory factor analysis (CFA), (b) the PN-RQ representing an item response theory-optimized measure of these 2 dimensions, (c) substantive differences between indifferent (low positive and negative qualities) and ambivalent (high positive and negative qualities) relationships potentially obscured by unidimensional scales, (d) high levels of responsiveness of the PN-RQ scales to change over time, (e) the unique predictive validity offered over time by the PN-RQ scores beyond that offered by scores of current unidimensional measures of relationship quality, and (f) the unique longitudinal information gained by using the PN-RQ as a bidimensional outcome measure in an intervention study. Taken together, the studies offer promising support for the PN-RQ scales suggesting that they have the potential to advance both basic and applied research. (PsycINFO Database Record
TL;DR: The strength of the association between parent-reported and observed parenting is small but significant, and the magnitude of the effect size depended on questionnaire length and the type of parenting investigated.
Abstract: The purpose of the present meta-analysis was to investigate the strength of the association between parent-reported and observed parenting, and to investigate which specific characteristics of participants, questionnaires, or observational procedures moderate this association. A systematic search of relevant peer-reviewed articles published between January 2000 and December 2014 yielded 36 articles (N = 8,510) and 89 effect sizes. Results from a 3-level random-effects meta-analysis demonstrated a weak, yet significant, overall association of r = .17 between parent-reported and observed parenting. The magnitude of the effect size depended on questionnaire length (larger effect for more items) and the type of parenting investigated (largest effects for negative parent behaviors, next largest effects for positive parent behaviors, and smallest effect for controlling parent behaviors). In conclusion, this study shows that the strength of the association between parent-reported and observed parenting is small but significant.
TL;DR: A novel telehealth diagnostic approach that utilizes clinically guided in-home video recordings to the gold standard in-person diagnostic assessment for autism spectrum disorder has potential to improve the efficiency of the diagnostic process for ASD.
Abstract: Research indicates that a substantial amount of time elapses between parents' first concerns about their child's development and a formal diagnosis of autism spectrum disorder (ASD). Telehealth presents an opportunity to expedite the diagnostic process. This project compared a novel telehealth diagnostic approach that utilizes clinically guided in-home video recordings to the gold standard in-person diagnostic assessment. Participants included 40 families seeking an ASD evaluation for their child and 11 families of typically developing children. Children were between the ages of 18 months and 6 years 11 months; mean adaptive behavior composite = 75.47 (SD = 15.94). All parent participants spoke English fluently. Families completed the Naturalistic Observation Diagnostic Assessment (NODA) for ASD, which was compared to an in-person assessment (IPA). Agreement between the 2 methods, as well as sensitivity, specificity, and interrater reliability, were calculated for the full sample and the subsample of families seeking an ASD evaluation. Diagnostic agreement between NODA and the IPA was 88.2% (κ = 0.75) in the full sample and 85% (κ = 0.58) in the subsample. Sensitivity was 84.9% in both, whereas specificity was 94.4% in the full sample and 85.7% in the subsample. Kappa coefficients for interrater reliability indicated 85% to 90% accuracy between raters. NODA utilizes telehealth technology for families to share information with professionals and provides a method to inform clinical judgment for a diagnosis of ASD. Due to the high level of agreement with the IPA in this sample, NODA has potential to improve the efficiency of the diagnostic process for ASD. (PsycINFO Database Record
TL;DR: The BSI-18 shows good overall concordance with a psychiatric interview, but recommended cut-off scores fail to identify a majority of YACS with psychiatric diagnosis, and Clinicians should not rely on the B SI-18 alone as a screening measure for YACs.
Abstract: The Brief Symptom Inventory-18 (BSI-18) is widely used to assess psychological symptoms in cancer survivors, but the validity of conventional BSI-18 cut-off scores in this population has been questioned. This study assessed the accuracy of the BSI-18 for identifying significant anxiety and depression in young adult cancer survivors (YACS), by comparing it with a "gold standard" diagnostic interview measure. Two hundred fifty YACS, age 18-40 completed the BSI-18 and the Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders (DSM-IV; SCID) interview assessing anxiety and depressive disorders. BSI-18 results were compared with SCID criteria using receiver operating characteristics (ROC) analyses. Forty four participants (17.7%) met criteria for ≥1 SCID diagnoses, and an additional 20 (8.0%) met criteria for clinically significant SCID symptoms without a diagnosis. General concordance between the BSI-18 GSI scale and SCID diagnosis was good (AUC = 0.848), but the 2 most widely used BSI-18 case rules failed to identify a majority of survivors with SCID diagnoses, and no alternative BSI-18 cut-off scores met study criteria for clinical screening. Analyses aimed at identifying survivors with significant SCID symptoms or a SCID diagnosis had similar results, as did analyses examining depression and anxiety separately. The BSI-18 shows good overall concordance with a psychiatric interview, but recommended cut-off scores fail to identify a majority of YACS with psychiatric diagnosis. Clinicians should not rely on the BSI-18 alone as a screening measure for YACS. Alternative BSI-18 scoring algorithms optimized for detecting psychiatric symptoms in YACS may be an important step to address this limitation. (PsycINFO Database Record
TL;DR: Findings indicate that dynamic risk assessment instruments can be a useful tool for improving sex offender treatment and have the potential to contribute to the selection of appropriate, more individually tailored treatment approaches and can assist in the evaluation of treatment effects.
Abstract: This meta-analysis is the first to our knowledge to evaluate the predictive properties of dynamic sex offender risk assessment instruments, which are designed to assess factors associated with recidivism that are amenable to change. Based on 52 studies (N = 13,446), we found that dynamic risk assessment instruments have small-to-moderate predictive properties, with Cohen's d ranging between 0.71 for sexual recidivism (41 studies, 22 unique samples, N = 5,699) and 0.43 for violent (including sexual) recidivism (27 studies, 14 unique samples, N = 10,368). Incremental predictive validity of dynamic over static risk assessment instruments was significant but modest; Cox hazard ratios varied between 1.08 for sexual recidivism (19 studies, 13 unique samples, N = 3,747) and 1.05 for any recidivism (11 studies, 8 unique samples, N = 2,511). Cox hazard ratios for the predictive validity of change scores on dynamic risk assessment instruments, controlling for static and initial dynamic scores, varied between 0.91 for sexual recidivism (6 studies, 6 unique samples, n = 1,980) and 0.95 for any recidivism (3 studies, 3 unique samples, n = 1,172). These findings indicate that dynamic risk assessment instruments can, in terms of Andrews and Bonta's (2010) risk and need principles, be a useful tool for improving sex offender treatment. They have the potential to contribute to the selection of appropriate, more individually tailored treatment approaches (focusing on individually relevant criminogenic need factors) and can assist in the evaluation of treatment effects. Considering this, further development of dynamic risk assessment instruments is warranted. (PsycINFO Database Record
TL;DR: It is suggested that although self-reported attentional control may be a useful construct, researchers using the ACS should exercise caution in interpreting it as a proxy for actual cognitive ability or performance.
Abstract: Individual differences in attentional control involve the ability to voluntarily direct, shift, and sustain attention. In studies of the role of attentional control in emotional adjustment, social relationships, and vulnerability to the effects of stress, self-report questionnaires are commonly used to measure this construct. Yet, convincing evidence of the association between self-report scales and actual cognitive performance has not been demonstrated. Across 2 independent samples, we examined associations between self-reported attentional control (Attentional Control Scale; ACS), self-reported emotional adjustment, Five-Factor Model personality traits (NEO Personality Inventory-Revised) and performance measures of attentional control. Study 1 examined behavioral performance on the Attention Network Test (ANT; Fan, McCandliss, Sommer, Raz, & Posner, 2002) and the Modified Switching Task (MST; Suchy & Kosson, 2006) in a large sample (n = 315) of healthy young adults. Study 2 (n = 78) examined behavioral performance on standardized neuropsychological tests of attention, including Conner's Continuous Performance Test-II and subtests from the Wechsler Adult Intelligence Scales, Third Edition (WAIS-III; Psychological Corporation, 1997) and Delis-Kaplan Executive Function System (D-KEFS; Delis, Kaplan, & Kramer, 2001). Results indicated that the ACS was largely unrelated to behavioral performance measures of attentional control but was significantly associated with emotional adjustment, neuroticism, and conscientiousness. These findings suggest that although self-reported attentional control may be a useful construct, researchers using the ACS should exercise caution in interpreting it as a proxy for actual cognitive ability or performance. (PsycINFO Database Record
TL;DR: Overall, the IPASE displayed strong psychometric qualities and is a brief alternative to resource-intensive phenomenological interviews in clinical, at-risk, and general population samples.
Abstract: Anomalous self-experiences (ASEs) are among the first symptoms to appear in the prodrome, predict the development of psychosis over and above clinical symptoms, and are common in people with schizophrenia. Although there are well-validated phenomenological interviews for assessing ASEs, there are no self-report measures. The current research describes 4 studies designed to develop and validate a new scale to assess ASEs: the Inventory of Psychotic-Like Anomalous Self-Experiences (IPASE). In Study 1, an overinclusive item pool was generated based on phenomenological descriptions of ASEs, and items were kept or discarded based on factor loadings in an exploratory factor analysis. Five factors were extracted including disturbances in Cognition, Consciousness, Self-Awareness and Presence, Somatization, and Transitivism/Demarcation. The 5-factor structure was confirmed in Study 2, and the scale showed measurement invariance between sexes. IPASE scores were correlated with self-report and task measures of self-processing including self-concept clarity, self-consciousness, and self-esteem as well as measures of psychotic-like experiences. In Study 3, people with positive schizotypy had higher IPASE scores than a negative schizotypy and comparison group. In Study 4, people with schizophrenia had higher IPASE scores than healthy controls. Overall, the IPASE displayed strong psychometric qualities and is a brief alternative to resource-intensive phenomenological interviews in clinical, at-risk, and general population samples. (PsycINFO Database Record
TL;DR: A total of k = 82 hypothesis tests revealed acceptable interrater reliabilities for most CBCA criteria, as measured with various indices (except Cohen’s kappa), however, results were largely heterogeneous, necessitating moderator analyses.
Abstract: This meta-analysis synthesizes research on interrater reliability of Criteria-Based Content Analysis (CBCA). CBCA is an important component of Statement Validity Assessment (SVA), a forensic procedure used in many countries to evaluate whether statements (e.g., of sexual abuse) are based on experienced or fabricated events. CBCA contains 19 verbal content criteria, which are frequently adapted for research on detecting deception. A total of k = 82 hypothesis tests revealed acceptable interrater reliabilities for most CBCA criteria, as measured with various indices (except Cohen's kappa). However, results were largely heterogeneous, necessitating moderator analyses. Blocking analyses and meta-regression analyses on Pearson's r resulted in significant moderators for research paradigm, intensity of rater training, type of rating scale used, and the frequency of occurrence (base rates) for some CBCA criteria. The use of CBCA summary scores is discouraged. Implications for research vs. field settings, for future research and for forensic practice in the United States and Europe are discussed. (PsycINFO Database Record
TL;DR: The present study examined the structure of the WJ IV Cognitive using exploratory factor analysis procedures applied to standardization sample correlation matrices and found a robust manifestation of general intelligence (g) that exceeded the variance attributed to the lower-order factors.
Abstract: Exploratory and confirmatory factor analytic studies were not reported in the Technical Manual for the Woodcock-Johnson, 4th ed. Cognitive (WJ IV Cognitive; Schrank, McGrew, & Mather, 2014b) Instead, the internal structure of the WJ IV Cognitive was extrapolated from analyses based on the full WJ IV test battery (Schrank, McGrew, & Mather, 2014b). Even if the veracity of extrapolating from the WJ IV full battery were accepted, there were shortcomings in the choices of analyses used and only limited information regarding those analyses was presented in the WJ IV Technical Manual (McGrew, Laforte, & Shrank, 2014). The present study examined the structure of the WJ IV Cognitive using exploratory factor analysis procedures (principal axis factoring with oblique [promax] rotation followed by application of the Schmid-Leiman, 1957, procedure) applied to standardization sample correlation matrices for 2 school age groups (ages 9-13; 14-19). Four factors emerged for both the 9-13 and 14-19 age groups in contrast to the publisher's proposed 7 factors. Results of these analyses indicated a robust manifestation of general intelligence (g) that exceeded the variance attributed to the lower-order factors. Model-based reliability estimates supported interpretation of the higher-order factor (i.e., g). Additional analyses were conducted by forcing extraction of the 7 theoretically posited factors; however, the resulting solution was only partially aligned (i.e., Gs, Gwm) with the theoretical structure promoted in the Technical Manual and suggested the preeminence of the higher-order factor. Results challenge the hypothesized structure of the WJ IV Cognitive and raise concerns about its alignment with Cattell-Horn-Carroll theory. (PsycINFO Database Record
TL;DR: Findings call into question the validity of aspects of the BRIEF-P, which indicated that the majority of the factors had limited convergent validity with academic ability or with a measure of behavior self-regulation.
Abstract: Executive function (EF) is a domain general cognitive construct associated with a number of important developmental outcomes. The Behavior Rating Inventory of Executive Function-Preschool version (BRIEF-P) is intended to assess 5 distinct components of EF in preschool age children. In this study, a series of factor analyses was conducted with teacher-reported EF of 2,367 preschool students to assess the structure of the BRIEF-P, and the predictive relations between the resulting factors and children's academic abilities and behavioral self-regulation were assessed to test the construct and convergent validity of the BRIEF-P scores. Results yielded mixed findings concerning the structure of the BRIEF-P and validity of its resultant scores. Results of the factor analyses indicated that the items of the BRIEF-P did not map onto factors in the way that would be expected based on its item-to-subscale mapping. The best solutions were a 4-factor and a bifactor model. The 4-factor solution revealed substantial correlations between factors, and although the bifactor solution identified a General Self-Regulation factor that explained variance in responses across items, this general factor did not account for all of the overlap among specific factors. Analyses of the relations for the factors from the correlated-factors and the bifactor models indicated that the majority of the factors had limited convergent validity with academic ability or with a measure of behavior self-regulation. Overall, these findings call into question the validity of aspects of BRIEF-P. (PsycINFO Database Record
TL;DR: The development of a multifactor measure of mindfulness represents a first step toward testing developmental models of mindfulness in young people, and will aid construction of evidence based interventions that are not simply downward derivations of adult mindfulness programs.
Abstract: Mindfulness-based interventions show consistent benefits in adults for a range of pathologies, but exploration of these approaches in youth is an emergent field, with limited measures of mindfulness for this population. This study aimed to investigate whether multifactor scales of mindfulness can be used in adolescents. A series of studies are presented assessing the performance of a recently developed adult measure, the Comprehensive Inventory of Mindfulness Experiences (CHIME) in 4 early adolescent samples. Study 1 was an investigation of how well the full adult measure (37 items) was understood by youth (N = 292). Study 2 piloted a revision of items in child friendly language with a small group (N = 48). The refined questionnaire for adolescents (CHIME-A) was then tested in Study 3 in a larger sample (N = 461) and subjected to exploratory factor analysis and a range of external validity measures. Study 4 was a confirmatory factor analysis in a new sample (N = 498) with additional external validity measures. Study 5 tested temporal stability (N = 120). Results supported an 8-factor 25-item measure of mindfulness in adolescents, with excellent model fit indices and sound internal consistency for the 8 subscales. Although the CFA supported an overarching factor, internal reliability of a combined total score was poor. The development of a multifactor measure represents a first step toward testing developmental models of mindfulness in young people. This in turn will aid construction of evidence based interventions that are not simply downward derivations of adult mindfulness programs. (PsycINFO Database Record
TL;DR: An item response theory model was used to simultaneously compare the psychometric properties of 3 commonly used self-report depression scales translated into Japanese and the PHQ–9 performed better as a whole, as it provided more information than the other scales on the broadest range of depression severity.
Abstract: We used an item response theory (IRT) model to simultaneously compare the psychometric properties of 3 commonly used self-report depression scales translated into Japanese-the Zung Self-Rating Depression Scale (SDS), the Center for Epidemiologic Studies Depression Scale (CES-D), and the Patient Health Questionnaire Depression Scale (PHQ-9)-in a Japanese university student sample. Although the 3 scales were likely to measure the same underlying construct-that is, depression-the choices of the negatively worded items in the SDS and CES-D did not function well. The CES-D provided more information than the other scales at the range of depression severity approximately from the mean through 2 standard deviations above the mean, while the PHQ-9 provided more information for the other degrees of depression. The PHQ-9 performed better as a whole, as it provided more information than the other scales on the broadest range of depression severity, and it did not contain items with inefficient choices. The CES-D may also be a good choice when sampling students with elevated levels of depressive symptoms. Finally, we linked the 3 instruments on a common scale using parameters derived from IRT analysis, and we provided a crosswalk table to enable the conversion of each scale score. (PsycINFO Database Record
TL;DR: The Edinburgh Postnatal Depression Scale appears to measure 3 related factors of depression, anhedonia, and anxiety and has a stable structure in pregnancy and the first postnatal year.
Abstract: To demonstrate validity, questionnaires should measure the same construct in different groups and across time. The Edinburgh Postnatal Depression Scale (EPDS) was designed as a unidimensional scale, but factor analyses of the EPDS have been equivocal, and demonstrate other structures: this may be because of sample characteristics and timing of administration. We aimed to examine the factor structure of the EPDS in pregnancy and postpartum at 4 time-points in a large population-based sample. We carried out exploratory and confirmatory factor analysis on the Avon Longitudinal Study of Parents and Children sample (n = 11,195-12,166) randomly split in 2. We used data from 18 and 32 weeks pregnancy gestation; and 8 weeks and 8 months postpartum. A 3-factor solution was optimal at all time-points, showing the clearest factor structure and best model fit: Depression (4 items) accounted for 43.5-47.2% of the variance; anhedonia (2 items) 10.5-11.1%; and anxiety (3 items) 8.3-9.4% of the variance. Internal reliability of subscales was good at all time points (Cronbach's αs: .73-.78). The EPDS appears to measure 3 related factors of depression, anhedonia, and anxiety and has a stable structure in pregnancy and the first postnatal year. (PsycINFO Database Record
TL;DR: This systematic review evaluated feigning classification accuracy and effect sizes across instruments and languages by summarizing 45 published peer-reviewed articles and unpublished doctoral dissertations conducted in Europe, Asia, and North America using linguistically, ethnically, and culturally diverse samples.
Abstract: The cross-cultural validity of feigning instruments and cut-scores is a critical concern for forensic mental health clinicians. This systematic review evaluated feigning classification accuracy and effect sizes across instruments and languages by summarizing 45 published peer-reviewed articles and unpublished doctoral dissertations conducted in Europe, Asia, and North America using linguistically, ethnically, and culturally diverse samples. The most common psychiatric symptom measures used with linguistically, ethnically, and culturally diverse samples included the Structured Inventory of Malingered Symptomatology, the Miller Forensic Assessment of Symptoms Test, and the Minnesota Multiphasic Personality Inventory (MMPI). The most frequently studied cognitive effort measures included the Word Recognition Test, the Test of Memory Malingering, and the Rey 15-item Memory test. The classification accuracy of these measures is compared and the implications of this research literature are discussed. (PsycINFO Database Record
TL;DR: The predictive validity of both the Structured Assessment of Violence Risk in Youth (SAVRY) and the Youth Level of Service/Case Management Inventory (YLS/CMI) for reoffending when completed by JPOs was examined.
Abstract: Risk assessment instruments are widely used by juvenile probation officers (JPOs) to make case management decisions; however, few studies have investigated whether these instruments maintain their predictive validity when completed by JPOs in the field. Moreover, the validity of these instruments for use with minority groups has been called into question. This field study examined the predictive validity of both the Structured Assessment of Violence Risk in Youth (SAVRY; n = 383) and the Youth Level of Service/Case Management Inventory (YLS/CMI; n = 359) for reoffending when completed by JPOs. The study also compared Black and White youth to examine the presence of test bias. The SAVRY and YLS/CMI significantly predicted reoffending at the test level, with most of the variance in reoffending accounted for by dynamic risk scales not static scales. The instruments did not differentially predict reoffending as a function of race but Black youth scored higher than White youth on the YLS/CMI scale related to official juvenile history. The implications for use of risk assessments in the field are discussed. (PsycINFO Database Record
TL;DR: Results from the current study suggest that individuals with 6 acts of NSSI in past year, compared with those with 5 acts or less, may represent a more severe group of self-injurers.
Abstract: Research suggesting nonsuicidal self-injury (NSSI) may belong in a distinct diagnostic category has led to the inclusion of NSSI disorder in the DSM-5 section for future study There has been limited research, however, examining the validity of Criterion A (the frequency criterion) The current study aimed to examine the validity of the frequency criterion of NSSI disorder through the use of an exploratory data mining method, structural equation modeling trees, as a way to determine a NSSI frequency that optimally discriminates pathological NSSI from normative behavior among undergraduate students (n = 3,559), 428 who engaged in NSSI in the previous year The model included psychopathology symptomology found to be comorbid with NSSI and cognitive-affective deficits commonly associated with NSSI Results demonstrated a first split between individuals with 0 and 1 act of NSSI in the past year, as was expected Among individuals with 1 or more previous acts, the optimal split was between those with 5 and 6 NSSI acts in the past year Results from the current study suggest that individuals with 6 acts of NSSI in past year, compared with those with 5 acts or less, may represent a more severe group of self-injurers These individuals reported higher levels of related psychopathology symptomology and cognitive-affective deficits, in addition to decreased quality of life Findings have potential implications for the proposed frequency criteria of NSSI disorder and how pathological NSSI is characterized (PsycINFO Database Record