Showing papers in "Assessment in 2000"
TL;DR: Life events in general showed very little influence on the levels of personality traits, although some effects were seen for changes in job and marital status that warrant further research.
Abstract: Although developmental theories and popular accounts suggest that midlife is a time of turmoil and change, longitudinal studies of personality traits have generally found stability of rank order and little or no change in mean levels. Using data from 2,274 men and women in their 40s retested after 6 to 9 years, the present study examined two hypotheses: (a) that retest correlations should be no higher than about .60 and (b) that there should be small decreases in Neuroticism, Extraversion, and Openness, and small increases in Agreeableness and Conscientiousness. The study also explored the effects of recalled life events on subsequent personality scores. Results did not support the first hypothesis; uncorrected retest correlations uniformly exceeded .60. This was true for all personality traits, including facets of Agreeableness and Conscientiousness not previously included in longitudinal studies. The hypothesized decreases in Neuroticism, Extraversion, and Openness were found, but Conscientiousness showed a small decrease instead of the predicted increase. Life events in general showed very little influence on the levels of personality traits, although some effects were seen for changes in job and marital status that warrant further research.
366 citations
TL;DR: Support was found for the hierarchical factor structure with a second-order factor of general intelligence and four firstorder factors of Verbal Comprehension, Perceptual Organization, Working Memory, and Processing Speed.
Abstract: According to Vernon's structure-of-intellect paradigm, abilities can be conceptualized as a hierarchy, with a factor of general intelligence at the top of the hierarchy, and successively more specific abilities toward the bottom. This paradigm has proven useful for interpreting a number of Wechsler intelligence scales. However, most of the research with this paradigm has used exploratory factor analysis, and the validity of the paradigm for the newest Wechsler Adult Intelligence Scale (WAIS-III) has yet to be evaluated. The present study examined the WAIS-III using second-order confirmatory factor analysis, which is a more appropriate analytic tool when specific hypotheses are tested. Using the standardization sample for the WAIS-III (N = 2,450), support was found for the hierarchical factor structure with a second-order factor of general intelligence and four first-order factors of Verbal Comprehension, Perceptual Organization, Working Memory, and Processing Speed.
174 citations
TL;DR: It was concluded that the NEO PI-R in its present form is useful for assessing adolescents' traits at the primary level, but additional research is necessary to infer the most appropriate facet level structure.
Abstract: The suitability of the Revised NEO Personality Inventory (NEO PI-R) to assess adolescents' personality traits was investigated in an unselected heterogeneous sample of 469 adolescents aged 12 to 17 years. They were further administered the Hierarchical Personality Inventory for Children (HiPIC) to allow an examination of convergent and discriminant validity. The adult NEO PI-R factor structure proved to be highly replicable in the sample of adolescents, with all facet scales primarily loading on the expected factors, independent of the age group. Domain and facet internal consistency coefficients were comparable to those obtained in adult samples, with less than 12% of the items showing corrected item-facet correlations below absolute value .20. Although, in general, adolescents reported few difficulties with the comprehensibility of the items, they tend to report more problems with the Openness to Ideas (05) and Openness to Values (06) items. Correlations between NEO PI-R and HiPIC scales underscored the convergent and discriminant validity of the NEO facets and HiPIC scales. It was concluded that the NEO PI-R in its present form is useful for assessing adolescents' traits at the primary level, but additional research is necessary to infer the most appropriate facet level structure.
163 citations
TL;DR: The use of objective psychological instruments, including the Revised NEO Personality Inventory (NEO PI-R), to assess the personalities of all 41 U.S. presidents to date is described.
Abstract: This article describes the use of objective psychological instruments, including the Revised NEO Personality Inventory (NEO PI-R), to assess the personalities of all 41 U.S. presidents to date. We briefly report our findings pertaining to the average profile of chief executives on the NEO PI-R and summarize data on two of our most illustrious presidents, Washington and Lincoln. We review a typology of presidents based on our data. Finally, we summarize the results of our investigation of the Big Five personality dimensions and facets that are related to presidential success (i.e., historical greatness). The project and findings are discussed in terms of the use of the NEO PI-R in psychohistorical research and assessment.
138 citations
TL;DR: Survey results reveal a substantial similarity in test usage between the 1991 survey and the current investigation, and the Wechsler Intelligence Scales, Rorschach, Thematic Apperception Test, and Minnesota Multiphasic Personality Inventory remain among the widely used tests with adolescents.
Abstract: In 1991, Archer, Maruish, Imhof, and Piotrowski presented survey findings based on the responses of a national sample of psychologists who performed psychological assessment with adolescent clients. The current survey was designed to update their results by examining the test use practices reported by 346 psychologists who work with adolescents in a variety of clinical and academic settings. These respondents represented an adjusted survey return rate of 36% and predominantly consisted of doctoral prepared psychologists (95%) in private practice settings (51%). The survey respondents had a mean of 13.6 years of post-degree clinical experience, and spent an average of 45% of their clinical time working with adolescents. Survey results reveal a substantial similarity in test usage between the 1991 survey and the current investigation. For example, the Wechsler Intelligence Scales, Rorschach, Thematic Apperception Test (TAT), and Minnesota Multiphasic Personality Inventory (MMPI) remain among the widely used tests with adolescents. However, several changes were also noted including a reduction in the use of the Bender-Gestalt and increases in the use of parent and teacher rating instruments. The current findings are used to estimate the relative popularity of an extensive list of test instruments, compare current findings to 1991 survey results, and to examine several issues related to general effects of managed care procedures and policies on test usage with adolescents.
125 citations
TL;DR: The results indicate that while much of the variance on the LNS task is explained by performance on the traditional measures of digit span, additional unique contributions to prediction of LNS performance are provided by measures of processing speed and visual spatial working memory.
Abstract: A total of 102 undergraduate students performed the Letter Number Sequencing (LNS) task in addition to a series of other measures of reading, working memory, motor execution, visuo-spatial memory, and executive functions. Performance on the LNS was uniquely contributed to by reading level, digit span forward and backward, arithmetic, visual spatial learning, and by performance on the Symbol Search subtest of the WAIS-III. The results indicate that while much of the variance on the LNS task is explained by performance on the traditional measures of digit span, additional unique contributions to prediction of LNS performance are provided by measures of processing speed and visual spatial working memory.
119 citations
TL;DR: In this paper, the Symptom Checklist-90 (SCL-90) was used to identify the items most indicative of overall distress, and a review of eight factor-analytic studies identified SCL- 90 items most representative of overall depression.
Abstract: Clinicians, provider organizations, and researchers need simple and valid measures to monitor mental health treatment outcomes. This article describes development of 6and 10-item indexes of psychological distress based on the Symptom Checklist-90 (SCL-90). A review of eight factor-analytic studies identified SCL-90 items most indicative of overall distress. Convergent validity of two new indexes and the previously developed SCL-10 were compared in an archival sample of posttraumatic stress disorder patients (n = 323). One index, the SCL-6, was further validated with archival data on substance abuse patients (n = 3,014 and n = 316) and hospital staff (n = 542). The three brief indexes had similar convergent validity, correlating .87 to .97 with the SCL-90 and Brief Symptom Inventory, .49 to .76 with other symptom scales, and .46 to .73 with changes in other symptom measures over time. These results indicate the concise, easily administered indexes are valid indicators of psychological distress.
109 citations
TL;DR: The future of computerized personality assessment is discussed and the role IRT methods might play in such assessments is described and it is found that for many scales, administering the "best" four items per facet scale would have produced similar results.
Abstract: This study asks, how well does an item response theory (IRT) based computerized adaptive NEO PI-R work? To explore this question, real-data simulations (N = 1,059) were used to evaluate a maximum information item selection computerized adaptive test (CAT) algorithm. Findings indicated satisfactory recovery of full-scale facet scores with the administration of around four items per facet scale. Thus, the NEO PI-R could be reduced in half with little loss in precision by CAT administration. However, results also indicated that the CAT algorithm was not necessary. We found that for many scales, administering the "best" four items per facet scale would have produced similar results. In the conclusion, we discuss the future of computerized personality assessment and describe the role IRT methods might play in such assessments.
99 citations
TL;DR: C cautious use and interpretation of one particular item (Trait Item 14 = "I try to avoid facing a crisis or difficulty"), and cautious application of the STAI to Filipino adolescents (particularly Filipino males).
Abstract: Anxiety disorders are said to be universal across all cultures and recent reviews have found relatively high prevalence rates across different countries. However, the experience and interpretation of anxiety are strongly influenced by cultural factors. Demonstrating crosscultural equivalence of measures of anxiety is essential to assure that comparisons between cultures will result in meaningful interpretations. Despite the State-Trait Anxiety Inventory being the most researched of anxiety measures from a cross-cultural basis, there is a lack of empirical studies on the psychometric properties of the STAI with adolescent Asian/Pacific Islanders. The present study examined the STAI using a large sample of ethnically diverse high school students in Hawaii. In general, a four-factor model (State-Anxiety Absent, State-Anxiety Present, Trait-Anxiety Absent, and Trait-Anxiety Present) provided the best fit based on a series of confirmatory factor analyses. Indicators of internal consistency supported the reliab...
72 citations
TL;DR: The results more consistently indicated that the index effectively discriminates between psychotic and nonpsychotic patients and the predictive validity of both a positive and negative SCZI was found to be high.
Abstract: This review focuses on the diagnostic efficiency of the new versions of the Rorschach Comprehensive System Depression Index (DEPI) and the Schizophrenia Index (SCZI). Clinical diagnosis according to the Diagnostic and Statistical Manual of Mental Disorders was chosen as the external validation criteria. The sensitivity, specificity, and overall classification rates for the indices were presented from the studies or computed from the data when possible. The positive and negative predictive validity was estimated at three different base rates. As regards the DEPI the results showed a large variation in diagnostic performance as the index seemed to have relatively more success in identifying nonpsychotic and unipolar depression than psychotic and bipolar depression. The DEPI did not successfully identify depression among adolescent patients. As regards the SCZI the results more consistently indicated that the index effectively discriminates between psychotic and nonpsychotic patients and the predictive validity of both a positive and negative SCZI was found to be high.
57 citations
TL;DR: A repeated-measures simulation design was employed to examine the specific effects of malingering on a recently developed measure of psychopathy, the Psychopathic Personality Inventory (PPI), and the broader association between psychopathic traits and dissimulation, finding that PPI scores were significantly correlated with a willingness to engage in Dissimulation across various hypothetical forensic/correctional scenarios.
Abstract: This study employed a repeated-measures simulation design to examine (a) the specific effects of malingering on a recently developed measure of psychopathy, the Psychopathic Personality Inventory (PPI), and (b) the broader association between psychopathic traits and dissimulation. One hundred and forty-three participants completed the PPI twice (both under standard instructions and with instructions to feign psychosis), and also completed post-test questionnaires assessing their attitudes toward engaging in malingering across several hypothetical settings. When attempting to feign psychosis, participants produced elevated scores on a validity scale designed to identify deviant responding, and use of a cross-validated cutoff score with this scale produced high sensitivity and specificity rates across the honest and malingering conditions. Furthermore, PPI scores (in the honest condition) were significantly correlated with a willingness to engage in dissimulation across various hypothetical forensic/correctional scenarios. Results are discussed in terms of the "fakability" of the PPI, as well as the relationship between psychopathic personality features and malingering more generally.
TL;DR: While the personality disorders as a whole appear to be differentiable from normal personality functioning on the five factors, the patterns are quite similar across the disorders, a finding that may provide some insight into the general nature of personality pathology but may also suggest problems with discriminant validity.
Abstract: The five-factor model of personality, which has been widely studied in personality psychology, has been hypothesized to have specific relevance for DSM-defined personality disorders. To evaluate hypothesized relationships of the five-factor model of personality to personality disorders, 144 patients with personality disorders (diagnosed via a structured interview) completed an inventory to assess the five-factor model. Results indicated that the majority of the personality disorders can be differentiated in theoretically predictable ways using the five-factor model of personality. However, while the personality disorders as a whole appear to be differentiable from normal personality functioning on the five factors, the patterns are quite similar across the disorders, a finding that may provide some insight into the general nature of personality pathology but may also suggest problems with discriminant validity. Third, it does not appear that considering disorders as special combinations of features (as might be expected in some categorical models) is more informative than considering them as the sum of certain features (as might be expected in a dimensional model).
TL;DR: Although all inventories were susceptible to faking, validity indices of the HPSI and the BIDR could correctly classify over two-thirds of test respondents as either responding honestly or as faking.
Abstract: Issues of reliability, item latent structure, and faking on the Holden Psychological Screening Inventory (HPSI), the Brief Symptom Inventory (BSI), and the Balanced Inventory of Desirable Responding (BIDR) were examined with a sample of 300 university undergraduates. Reliability analyses indicated that scales from all inventories had acceptable internal consistency. Confirmatory item principal component analyses supported the structures and scoring keys of the HPSI and the BIDR, but not the BSI. Although all inventories were susceptible to faking, validity indices of the HPSI and the BIDR could correctly classify over two-thirds of test respondents as either responding honestly or as faking.
TL;DR: It is suggested that even experts are unable to feign major depression successfully on the MMPI-2, and that the FB scale might be the most effective indicator for detecting feigned depression.
Abstract: Major depression is one of the most frequently presented disorders for claims of psychiatric disability. Evidence also suggests that many individuals making claims of disability exaggerate or even fabricate mental illness. These facts suggest that the detection of feigned depression is an important task in psychiatric disability claim assessments. In this study, the capacity of a number of MMPI-2 validity scales and indicators to detect feigned depression was examined. Twenty-three mental health professionals with specific expertise and significant experience in assessing and treating major depression were asked to complete the MMPI-2 as if they were suffering from major depression. The MMPI-2 protocols of this sample were compared to those of a sample of patients diagnosed with major depression. Results indicated that the validity scales F, back F (FB), and the Dissimulation scale (Ds) were highly successful at distinguishing MMPI-2 protocols of feigned depression from bona fide depression. Replicating r...
TL;DR: An interaction between race and item difficulty suggests that the MOCI items do not have equivalent psychometric properties in Blacks and Whites.
Abstract: Black university students scored significantly higher than White students on the Maudsley Obsessional Compulsive Inventory (MOCI). They tended to endorse more Cleaning and Checking subscale items in the pathological direction. Subsequent analyses examined whether this finding is a reflection of valid group differences in the prevalence of OCD or a psychometric artifact. Structured interviews were conducted to determine the correspondence of MOCI scores with OCD diagnoses. The race difference in endorsement frequency on the MOCI did not extend to OCD diagnoses. The MOCI scores showed modest predictive validity in Whites, but they did not predict interview-based diagnoses in Blacks. Multivariate item response theory was then employed to examine race differences in the Cleaning and Checking subscales. Equivalent item discrimination parameters fit the data for Black and White participants for both subscales. A more restrictive model in which relative item difficulties were also constrained to be equal for Black and White participants did not fit. This interaction between race and item difficulty suggests that the items do not have equivalent psychometric properties in Blacks and Whites.
TL;DR: This study serves to break new ground as the first systematic investigation of PCL:SV subcriteria by addressing their psychometric properties and exploring their construct and criterion-related validation.
Abstract: The development and refinement of psychopathy represent a critical issue in clinical and forensic practice. During the last decade, important advances in the operationalization of psychopathy were achieved, primarily through the development of the Psychopathy Checklist (PCL) and its subsequent versions (PCL-R and PCL:SV). PCL ratings are based primarily on item descriptions or subcriteria. The current study serves to break new ground as the first systematic investigation of PCL:SV subcriteria by addressing their psychometric properties and exploring their construct and criterion-related validation. Previously unanalyzed data from three samples were integrated: female offenders, male forensic patients, and male adolescent offenders. Results largely support the use of subcriteria as homogeneous components of criteria and provide strong initial evidence of their construct validity. Results are less conclusive regarding criterion-related validity. For female offenders, they suggested the potential value of sp...
TL;DR: The reliability of all the scores, besides the error scores, seemed to be satisfactory after the first few assessments, and the stability of the scores was maintained through all the assessments.
Abstract: The purpose of this research was to analyze the effects of repeating an executive function test. Three versions of the Tower of Hanoi (TOH) test were repeated three times each, with test-retest intervals of 2 months. Two groups of children participated in the research (7.7 and 11.6 years, n = 22 and n = 28). Repeating the assessment improved the performance and decreased the total performance time in both of the groups. The older participants improved their performance faster than the younger ones. The reliability of all the scores, besides the error scores, seemed to be satisfactory after the first few assessments. The stability of the scores was maintained through all the assessments. The planning time did not explain the variations of the achieved score. The reasons for the initially low reliabilities are discussed, and modifications for the test administration and scoring are suggested.
TL;DR: Coefficients of personality profile agreement computed to evaluate global personality change for the three perceived change groups were essentially equivalent and directional analyses of domain-specific changes in personality showed that perceived changes were weak predictors of residual gain scores.
Abstract: The finding of personality stability in adulthood may be counterintuitive to people who perceive a great deal of change in their own personality. The purpose of this study is to determine whether s...
TL;DR: Tests of higher SPC showed greater error rates, but high CTA greatly reduced the occurrence of error across levels of SPC, and practical suggestions for improving scoring accuracy are offered.
Abstract: Given the paucity of previous research, we examined the occurrence of scoring error on widely used objective personality tests and examined its possible relation to two factors: scoring procedure complexity (SPC) and commitment to accuracy (CTA). We doublechecked the scoring of three tests (MMPI, Beck Depression Inventory, Spielberger State/Trait Anxiety Inventory) across three settings. Each of the tests were misscored at a surprisingly high rate in at least one setting, and some such errors altered major interpretive implications. Tests of higher SPC showed greater error rates, but high CTA greatly reduced the occurrence of error across levels of SPC. Unexpected sources of error were also uncovered, such as commercial computer scoring errors and disagreement in scoring standards among test publishers. Practical suggestions for improving scoring accuracy are offered.
TL;DR: Comparing the equivalence of the index scores generated from the full and prorated WAIS-III revealed correlations corrected for redundancy of .90, .86, .87, and .75 for the Verbal Comprehension (VCI), Perceptual Organization (POI), Working Memory (WMI), and Processing Speed (PSI) indexes.
Abstract: A 7-subtest short form of the Wechsler Adult Intelligence Scale-III (WAIS-III) previously demonstrated good comparability in estimating Full Scale and Verbal IQ summary scores, with adequate comparability in estimating Performance IQ. In a mixed clinical sample of 295 patients, the current study assessed the equivalence of the index scores generated from the full and prorated WAIS-III. The results revealed correlations corrected for redundancy of .90, .86, .87, and .75 for the Verbal Comprehension (VCI), Perceptual Organization (POI), Working Memory (WMI), and Processing Speed (PSI) indexes, respectively. Although the 7-subtest short form of the WAIS-III was not designed to estimate index scores, adequate estimates are viable for VCI, POI, and WMI when the goal is to obtain group, rather than individual, data points.
TL;DR: This study demonstrates the relevance of IRT to personality data through analyses of Scale 2 (the Depression Scale) on the revised Minnesota Multiphasic Personality Inventory (MMPI-2).
Abstract: Item response theory (IRT) analyses have, over the past 3 decades, added much to our understanding of the relationships among and characteristics of test items, as revealed in examinees' response p...
TL;DR: A psychometrically sound method of prorating scores from a shortened version of the MMPI-2 is presented to approximate the full-scale raw scores on the basic scales.
Abstract: A psychometrically sound method of prorating scores from a shortened version of the MMPI-2 is presented to approximate the full-scale raw scores on the basic scales. After a brief review of the history of short versions of the original MMPI and their strengths and weaknesses, justifications for developing and publishing this new version are offered. In spite of the risk of abuse by harassed and over-worked clinicians, there are cogent reasons to make this set of procedures available to practitioners and research investigators. These procedures were devised on the data from the 2,600 men and women in the original MMPI-2 restandardization sample and cross-validated on a sample of 632 test records from a psychiatric inpatient service. The dependability of estimated single raw scores as well as of the patterning of the prorated profile patterns is explored.
TL;DR: Qualitative and quantitative Block Design performance was examined in Vietnam combat veterans with PTSD diagnoses and without PTSD and indicated that PTSD-diagnosed veterans committed more single block rotations than the comparison sample, and their errors occurred more frequently in right hemispace.
Abstract: Qualitative and quantitative Block Design performance was examined in Vietnam combat veterans with PTSD diagnoses (n = 23) and Vietnam combat veterans without PTSD or other mental disorders diagnoses (n = 19) Results indicated that PTSD-diagnosed veterans committed more single block rotations than the comparison sample, and that their errors occurred more frequently in right hemispace than errors made by the comparison sample The two groups did not differ in the number of configural errors made, errors committed in left hemispace, or in quantitative performance measures Findings are suggestive of relative left hemisphere hypoactivation and are congruent with prior research documenting cerebral asymmetries in emotional disorders
TL;DR: Application of diagnostic efficiency statistics for the ability of differing ICMI cutoff scores to identify college students producing a schizophrenia spectrum MMPI code type revealed that scores greater than or equal to 29 on the ICMI had good positive predictive power.
Abstract: We administered the MMPI and the Inventory of Childhood Memories and Imagining (ICMI) to 1,200 college students. Application of diagnostic efficiency statistics for the ability of differing ICMI cutoff scores to identify college students producing a schizophrenia spectrum MMPI code type revealed that scores greater than or equal to 29 on the ICMI had good positive predictive power. Scores less than 29 on the ICMI had very good negative predictive power. ICMI scores were also used to form a group of fantasizers (n = 30) and a control group (n = 30). Fantasizers were much more likely to produce MMPI codes associated with a vulnerability to schizophrenia (70%) than were controls (3.33%). Although most controls(70%) produced non-elevated MMPI scores, 66.67% of the fantasizers produced three or more elevated clinical scales on the MMPI. The modal MMPI profile for the fantasizers was an 8-9 code, indicating that fantasizers appear at heightened risk for eccentric thinking and a Cluster A or B personality organization.
TL;DR: Correlations between self-report and spousal ratings were reduced in patients engaging in positive self-presentational bias compared to those who were not so categorized on three of the five NEO PI-R scales, but these results were manifest only in a sub-sample of psychotic patients.
Abstract: The effects of response style bias on profile scores from the family of NEO scales and the resultant influence of response style on the predictive capacity of these scales continues to be debated. In this study, a large sample of Chinese psychiatric patients were categorized into four response style groups based on their scores from recently developed "validity" scales for the revised NEO Personality Inventory (NEO PI-R). Mean differences and correlations between self-report and spousal ratings of these patients were examined for the NEO PI-R domain and facet scales. Excessive positive self-presentation bias resulted in mean differences between the self-report and spousal ratings for N and E. Correlations between self-report and spousal ratings were reduced in patients engaging in positive self-presentational bias compared to those who were not so categorized on three of the five NEO PI-R scales. However, these results were manifest only in a sub-sample of psychotic patients. Negative self-presentational bias did not affect mean differences or diminish the correlations between the self-report and spousal ratings.
TL;DR: In this paper, the reliability of the WAIS-III for 100 male patients with substance abuse disorders was determined, and the means for age and education were 46.06 years (SD = 8.81 years) and 12.70 years(SD = 1.51 years).
Abstract: Reliability of the WAIS-III for 100 male patients with substance abuse disorders was determined. Means for age and education were 46.06 years (SD = 8.81 years) and 12.70 years (SD = 1.51 years). Th...
TL;DR: The present study investigated the validity of the General Ability Measure for Adults (GAMA1) by comparing it to the WAIS-R using a sample of 80 college students reporting learning difficulties, suggesting that the GAMA was more clearly associated with perceptual skills than verbal abilities.
Abstract: The present study investigated the validity of the General Ability Measure for Adults (GAMA1) by comparing it to the WAIS-R using a sample of 80 college students reporting learning difficulties. Re...
TL;DR: The relative planning time seems to measure the quality of planning better than does the raw planning time, and it is a recommended score for TOH analysis.
Abstract: Detailed time and error analyses of the Tower of Hanoi (TOH) test was performed using four repeated assessments of eight children (ages 9-12 years), who had perceptual and problem solving deficits. The time before each move was measured. In addition to the traditionally counted time scores, new, relative time scores were computed in order to separate the planning time from the general reaction speed. New error scores were defined and sum scores of serious errors (perserative moves, illegal moves, and wrong results) and mild errors (self-corrected moves, almost performed moves, and interrupted trials) were computed. The relative planning time correlated positively with the achieved score, and negatively with the serious errors. The serious errors correlated negatively with the achieved score. The relative planning time seems to measure the quality of planning better than does the raw planning time, and it is a recommended score for TOH analysis. The value of new error scores requires additional research.
Journal Article•