Discriminant validity assessment has become a generally accepted prerequisite for analyzing relationships between latent variables. For variance-based structural equation modeling, such as partial least squares, the Fornell-Larcker criterion and the examination of cross-loadings are the dominant approaches for evaluating discriminant validity. By means of a simulation study, we show that these approaches do not reliably detect the lack of discriminant validity in common research situations. We therefore propose an alternative approach, based on the multitrait-multimethod matrix, to assess discriminant validity: the heterotrait-monotrait ratio of correlations. We demonstrate its superior performance by means of a Monte Carlo simulation study, in which we compare the new approach to the Fornell-Larcker criterion and the assessment of (partial) cross-loadings. Finally, we provide guidelines on how to handle discriminant validity issues in variance-based structural equation modeling.

/pdf/a-new-criterion-for-assessing-discriminant-validity-in-4xs4c94ene.pdf

A new criterion for assessing discriminant validity in variance-based structural equation modeling

Amazon's Mechanical Turk (MTurk) is a relatively new website that contains the major elements required to conduct research: an integrated participant compensation system; a large participant pool; and a streamlined process of study design, participant recruitment, and data collection. In this article, we describe and evaluate the potential contributions of MTurk to psychology and other social sciences. Findings indicate that (a) MTurk participants are slightly more demographically diverse than are standard Internet samples and are significantly more diverse than typical American college samples; (b) participation is affected by compensation rate and task length, but participants can still be recruited rapidly and inexpensively; (c) realistic compensation rates do not affect data quality; and (d) the data obtained are at least as reliable as those obtained via traditional methods. Overall, MTurk can be used to obtain high-quality data inexpensively and rapidly.

http://www.gruberpeplab.com/teaching/psych231_fall2013/documents/231_Buhrmester2011.pdf

Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data?

Five studies tested two general hypotheses: Individuals differ in their use of emotion regulation strategies such as reappraisal and suppression, and these individual differences have implications for affect, well-being, and social relationships. Study 1 presents new measures of the habitual use of reappraisal and suppression. Study 2 examines convergent and discriminant validity. Study 3 shows that reappraisers experience and express greater positive emotion and lesser negative emotion, whereas suppressors experience and express lesser positive emotion, yet experience greater negative emotion. Study 4 indicates that using reappraisal is associated with better interpersonal functioning, whereas using suppression is associated with worse interpersonal functioning. Study 5 shows that using reappraisal is related positively to well-being, whereas using suppression is related negatively.

Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being.

This study investigated the relation of the “Big Five” personality dimensions (Extraversion, Emotional Stability, Agreeableness, Conscientiousness, and Openness to Experience) to three job performance criteria (job proficiency, training proficiency, and personnel data) for five occupational groups (professionals, police, managers, sales, and skilled/semi-skilled). Results indicated that one dimension of personality, Conscientiousness, showed consistent relations with all job performance criteria for all occupational groups. For the remaining personality dimensions, the estimated true score correlations varied by occupational group and criterion type. Extraversion was a valid predictor for two occupations involving social interaction, managers and sales (across criterion types). Also, both Openness to Experience and Extraversion were valid predictors of the training proficiency criterion (across occupations). Other personality dimensions were also found to be valid predictors for some occupations and some criterion types, but the magnitude of the estimated true score correlations was small (ρ < .10). Overall, the results illustrate the benefits of using the 5-factor model of personality to accumulate and communicate empirical findings. The findings have numerous implications for research and practice in personnel psychology, especially in the subfields of personnel selection, training and development, and performance appraisal.

The big five personality dimensions and job performance: a meta-analysis

2 Taxonomy is always a contentious issue because the world does not come to us in neat little packages (S. Personality has been conceptualized from a variety of theoretical perspectives, and at various levels of Each of these levels has made unique contributions to our understanding of individual differences in behavior and experience. However, the number of personality traits, and scales designed to measure them, escalated without an end in sight (Goldberg, 1971). Researchers, as well as practitioners in the field of personality assessment, were faced with a bewildering array of personality scales from which to choose, with little guidance and no overall rationale at hand. What made matters worse was that scales with the same name often measure concepts that are not the same, and scales with different names often measure concepts that are quite similar. Although diversity and scientific pluralism are useful, the systematic accumulation of findings and the communication among researchers became difficult amidst the Babel of concepts and scales. Many personality researchers had hoped that they might devise the structure that would transform the Babel into a community speaking a common language. However, such an integration was not to be achieved by any one researcher or by any one theoretical perspective. As Allport once put it, " each assessor has his own pet units and uses a pet battery of diagnostic devices " (1958, p. 258). What personality psychology needed was a descriptive model, or taxonomy, of its subject matter. One of the central goals of scientific taxonomies is the definition of overarching domains within which large numbers of specific instances can be understood in a simplified way. Thus, in personality psychology, a taxonomy would permit researchers to study specified domains of personality characteristics, rather than examining separately the thousands of particular attributes that make human beings individual and unique. Moreover, a generally accepted taxonomy would greatly facilitate the accumulation and communication of empirical findings by offering a standard vocabulary, or nomenclature. After decades of research, the field is approaching consensus on a general taxonomy of personality traits, the " Big Five " personality dimensions. These dimensions do not represent a particular theoretical perspective but were derived from analyses of the natural-language terms people use to describe themselves 3 and others. Rather than replacing all previous systems, the Big Five taxonomy serves an integrative function because it can represent the various and diverse systems of personality …

The Big Five Trait taxonomy: History, measurement, and theoretical perspectives.

The rapid growth of the Internet provides a wealth of new research opportunities for psychologists. Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods. Six preconceptions about Internet samples and data quality are evaluated by comparing a new large Internet sample (N = 361,703) with a set of 510 published traditional samples. Internet samples are shown to be relatively diverse with respect to gender, socioeconomic status, geographic region, and age. Moreover, Internet findings generalize across presentation formats, are not adversely affected by nonserious or repeat responders, and are consistent with findings from traditional methods. It is concluded that Internet methods can contribute to many areas of psychology.

/pdf/should-we-trust-web-based-studies-a-comparative-analysis-of-23m9wnmwag.pdf

Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.

Individuals regulate their emotions in a wide variety of ways. Are some forms of emotion regulation healthier than others? We focus on two commonly used emotion regulation strategies: reappraisal (changing the way one thinks about a potentially emotion-eliciting event) and suppression (changing the way one responds behaviorally to an emotion-eliciting event). In the first section, we review experimental findings showing that reappraisal has a healthier profile of short-term affective, cognitive, and social consequences than suppression. In the second section, we review individual-difference findings, which show that using reappraisal to regulate emotions is associated with healthier patterns of affect, social functioning, and well-being than is using suppression. In the third section, we consider issues in the development of reappraisal and suppression and provide new evidence for a normative shift toward an increasingly healthy emotion regulation profile during adulthood (i.e., increases in the use of reappraisal and decreases in the use of suppression).

Healthy and Unhealthy Emotion Regulation: Personality Processes, Individual Differences, and Life Span Development

The "Big Five" factor taxonomy: Dimensions of personality in the natural language and in questionnaires.

Handbook of personality: Theory and research, 2nd ed.

One of the functions of automatic stimulus evaluation is to direct attention toward events that may have undesirable consequences for the perceiver's well-being. To test whether attentional resources are automatically directed away from an attended task to undesirable stimuli, Ss named the colors in which desirable and undesirable traits (e.g., honest, sadistic) appeared. Across 3 experiments, color-naming latencies were consistently longer for undesirable traits but did not differ within the desirable and undesirable categories. In Experiment 2, Ss also showed more incidental learning for undesirable traits, as predicted by the automatic vigilance (but not a perceptual defense) hypothesis. In Experiment 3, a diagnosticity (or base-rate) explanation of the vigilance effect was ruled out. The implications for deliberate processing in person perception and stereotyping are discussed. There is a fundamental asymmetry in people's evaluations of gains and losses, of joy and pain, and of positive and negative events. A considerable body of research, in fields as diverse as decision making, impression formation, and emotional communication, has shown that people exhibit loss aversion (Kahneman & Tversky, 1984): They assign relatively more value, importance, and weight to events that have negative, rather than positive, implications for them. In decision making, potential costs are more influential than potential gains (e.g., Kahneman & Tversky, 1979). In impression formation, negative information is weighted more heavily than positive information (e.g., Anderson, 1974; Fiske, 1980; Hamilton & Zanna, 1972). In nonverbal communication, perceivers are more responsive to negatively toned messages than to positive ones (Frodi, Lamb, Leavitt, & Donovan, 1978). Quite generally, then, "losses loom larger than gains" (Kahneman & Tversky, 1984, p. 348). There are good evolutionary reasons for this widespread and pronounced asymmetry in people's evaluative reactions. Events that may negatively affect the individual are typically of greater time urgency than are events that lead to desirable consequences. Averting danger to one's well-being, such as preventing loss of life or limb, often requires an immediate response. In

/pdf/automatic-vigilance-the-attention-grabbing-power-of-negative-p69fosjwmh.pdf

Oliver P. John

Papers

Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.

Healthy and Unhealthy Emotion Regulation: Personality Processes, Individual Differences, and Life Span Development

The "Big Five" factor taxonomy: Dimensions of personality in the natural language and in questionnaires.

Handbook of personality: Theory and research, 2nd ed.

Automatic Vigilance: The Attention-Grabbing Power of Negative Social Information