A primary goal of scale development is to create a valid measure of an underlying construct. We discuss theoretical principles, practical issues, and pragmatic decisions to help developers maximize the construct validity of scales and subscales. First, it is essential to begin with a clear conceptualization of the target construct. Moreover, the content of the initial item pool should be overinclusive and item wording needs careful attention. Next, the item pool should be tested, along with variables that assess closely related constructs, on a heterogeneous sample representing the entire range of the target population. Finally, in selecting scale items, the goal is unidimensionality rather than internal consistency ; this means that virtually all interitem correlations should be moderate in magnitude. Factor analysis can play a crucial role in ensuring the unidimensionality and discriminant validity of scales.

/pdf/constructing-validity-basic-issues-in-objective-scale-336bh0ucpv.pdf

Constructing validity: Basic issues in objective scale development

The authors examine the facet structure of mindfulness using five recently developed mindfulness questionnaires. Two large samples of undergraduate students completed mindfulness questionnaires and measures of other constructs. Psychometric properties of the mindfulness questionnaires were examined, including internal consistency and convergent and discriminant relationships with other variables. Factor analyses of the combined pool of items from the mindfulness questionnaires suggested that collectively they contain five clear, interpretable facets of mindfulness. Hierarchical confirmatory factor analyses suggested that at least four of the identified factors are components of an overall mindfulness construct and that the factor structure of mindfulness may vary with meditation experience. Mindfulness facets were shown to be differentially correlated in expected ways with several other constructs and to have incremental validity in the prediction of psychological symptoms. Findings suggest that conceptualizing mindfulness as a multifaceted construct is helpful in understanding its components and its relationships with other variables.

https://self-compassion.org/wp-content/uploads/publications/Baer-paper.pdf

Using Self-Report Assessment Methods to Explore Facets of Mindfulness

We examine the controversial practice of using parcels of items as manifest variables in structural equation modeling (SEM) procedures. After detailing arguments pro and con, we conclude that the unconsidered use of parcels is never warranted, while, at the same time, the considered use of parcels cannot be dismissed out of hand. In large part, the decision to parcel or not depends on one's philosophical stance regarding scientific inquiry (e.g., empiricist vs. pragmatist) and the substantive goal of a study (e.g., to understand the structure of a set of items or to examine the nature of a set of constructs). Prior to creating parcels, however, we recommend strongly that investigators acquire a thorough understanding of the nature and dimensionality of the items to be parceled. With this knowledge in hand, various techniques for creating parcels can be utilized to minimize potential pitfalls and to optimize the measurement structure of constructs in SEM procedures. A number of parceling techniques are des...

To Parcel or Not to Parcel: Exploring the Question, Weighing the Merits

https://scholarworks.gsu.edu/cgi/viewcontent.cgi?article=1085&context=psych_facpub

Acceptance and Commitment Therapy: Model, processes and outcomes

Emotion-regulation strategies across psychopathology: A meta-analytic review.

Previous research on assessment of mindfulness by self-report suggests that it may include five component skills: observing, describing, acting with awareness, nonjudging of inner experience, and nonreactivity to inner experience. These elements of mindfulness can be measured with the Five Facet Mindfulness Questionnaire (FFMQ). The authors investigated several aspects of the construct validity of the FFMQ in experienced meditators and nonmeditating comparison groups. Consistent with predictions, most mindfulness facets were significantly related to meditation experience and to psychological symptoms and well-being. As expected, relationships between the observing facet and psychological adjustment varied with meditation experience. Regression and mediation analyses showed that several of the facets contributed independently to the prediction of well-being and significantly mediated the relationship between meditation experience and well-being. Findings support the construct validity of the FFMQ in a combination of samples not previously investigated.

Construct Validity of the Five Facet Mindfulness Questionnaire in Meditating and Nonmeditating Samples.

A self-report inventory for the assessment of mindfulness skills was developed, and its psychometric characteristics and relationships with other constructs were examined. Participants included thr...

/pdf/assessment-of-mindfulness-by-self-report-the-kentucky-21de38krce.pdf

Assessment of mindfulness by self-report: the Kentucky inventory of mindfulness skills.

In 3 studies, the authors developed and began to validate a measure of the propensity to act rashly in response to positive affective states (positive urgency). In Study 1, they developed a content-valid 14-item scale, showed that the measure was unidimensional, and showed that positive urgency was distinct from impulsivity-like constructs identified in 2 models of impulsive behavior. In Study 2, they showed that positive urgency explained variance in risky behavior not explained by measures of other impulsivity-like constructs, differentially explained positive mood-based risky behavior, differentiated individuals at risk for problem gambling from those not at risk, and interacted with drinking motives and expectancies as predicted to explain problem drinking behavior. In Study 3, they confirmed the hypothesis that positive urgency differentiated alcoholics from both eating-disordered and control individuals.

Integration of impulsivity and positive mood to predict risky behavior: Development and validation of a measure of positive urgency.

Under heightened emotional states, individuals are more inclined to engage in ill-considered or rash actions than at other times. The authors present evidence for the existence of 2 related traits called positive and negative urgency. The traits refer to individual differences in the disposition to engage in rash action when experiencing extreme positive and negative affect, respectively. The authors provide evidence that these traits are distinct from other dispositions toward rash action and that they play distinct roles in predicting problem levels of involvement in behaviors such as alcohol consumption, binge eating, drug use, and risky sexual behavior. The authors identify facilitative conditions for the emergence of the urgency traits from neuroscience. Certain gene polymorphisms are associated with low levels of serotonin and high levels of dopamine; that pattern of neurotransmitter activity in a brain system linking the orbitofrontal cortex and the amygdala appears to facilitate the development of positive and negative urgency. The authors discuss the implications of this theory.

/pdf/emotion-based-dispositions-to-rash-action-positive-and-1rd1hlznov.pdf

Gregory T. Smith

Papers

Using Self-Report Assessment Methods to Explore Facets of Mindfulness

Construct Validity of the Five Facet Mindfulness Questionnaire in Meditating and Nonmeditating Samples.

Assessment of mindfulness by self-report: the Kentucky inventory of mindfulness skills.

Integration of impulsivity and positive mood to predict risky behavior: Development and validation of a measure of positive urgency.

Emotion-based dispositions to rash action: positive and negative urgency.