https://research.vu.nl/ws/files/2901670/267479.pdf

Quality criteria were proposed for measurement properties of health status questionnaires

The power of feedback.

Several concepts are introduced and defined: measurement invariance, structural bias, weak measurement invariance, strong factorial invariance, and strict factorial invariance. It is shown that factorial invariance has implications for (weak) measurement invariance. Definitions of fairness in employment/admissions testing and salary equity are provided and it is argued that strict factorial invariance is required for fairness/equity to exist. Implications for item and test bias are developed and it is argued that item or test bias probably depends on the existence of latent variables that are irrelevant to the primary goal of test constructers.

Measurement Invariance, Factor Analysis and Factorial Invariance.

In diary studies, people provide frequent reports on the events and experiences of their daily lives. These reports capture the particulars of experience in a way that is not possible using traditional designs. We review the types of research questions that diary methods are best equipped to answer, the main designs that can be used, current technology for obtaining diary reports, and appropriate data analysis strategies. Major recent developments include the use of electronic forms of data collection and multilevel models in data analysis. We identify several areas of research opportunities: 1. in technology, combining electronic diary reports with collateral measures such as ambulatory heart rate; 2. in measurement, switching from measures based on between-person differences to those based on within-person changes; and 3. in research questions, using diaries to (a) explain why people differ in variability rather than mean level, (b) study change processes during major events and transitions, and (c) study interpersonal processes using dyadic and group diary methods.

/pdf/diary-methods-capturing-life-as-it-is-lived-2tmv49odub.pdf

Diary Methods: Capturing Life as it is Lived

25. Multiple Imputation for Nonresponse in Surveys. By D. B. Rubin. ISBN 0 471 08705 X. Wiley, Chichester, 1987. 258 pp. £30.25.

Multiple Imputation for Nonresponse in Surveys

This article advances a simple conception of test validity: A test is valid for measuring an attribute if (a) the attribute exists and (b) variations in the attribute causally produce variation in the measurement outcomes. This conception is shown to diverge from current validity theory in several respects. In particular, the emphasis in the proposed conception is on ontology, reference, and causality, whereas current validity theory focuses on epistemology, meaning, and correlation. It is argued that the proposed conception is not only simpler but also theoretically superior to the position taken in the existing literature. Further, it has clear theoretical and practical implications for validation research. Most important, validation research must not be directed at the relation between the measured attribute and other attributes but at the processes that convey the effect of the measured attribute on the test scores.

The concept of validity

This article examines the theoretical status of latent variables as used in modern test theory models. First, it is argued that a consistent interpretation of such models requires a realist ontology for latent variables. Second, the relation between latent variables and their indicators is discussed. It is maintained that this relation can be interpreted as a causal one but that in measurement models for interindividual differences the relation does not apply to the level of the individual person. To substantiate intraindividual causal conclusions, one must explicitly represent individual level processes in the measurement model. Several research strategies that may be useful in this respect are discussed, and a typology of constructs is proposed on the basis of this analysis. The need to link individual processes to latent variable models for interindividual differences is emphasized.

The theoretical status of latent variables

Item bias and item response theory

/pdf/advising-on-research-methods-a-consultant-s-companion-sybelwnlrh.pdf

Advising on research methods: A consultant's companion

Two strategies for assessing item bias are discussed: Methods based on Itemx Group interaction and methods that compare the probabilities of a correct response for different groups conditional on ability level In latent trait models, correct response probabilties are compared conditional on latent ability; inScheuneman’s (1979) method these probabilities are compared conditional on the observed test score Scheuneman’s method is modified to fit the general theory of loglinear and logit models for contingency tables A distinction is made between uniform and nonuniform item bias, and a method to assess item bias and distinguish between uniform and nonuniform bias is described Data reported by Scheuneman are used to demonstrate the method in detail; the differences obtained with Scheuneman’s method are discussed In addition, the method is applied to two tests administered byvan der Flier (1980) in Kenya and Tanzania, and the results are compared to those obtained with Scheuneman’s approach

Gideon J. Mellenbergh

Papers

The concept of validity

The theoretical status of latent variables

Item bias and item response theory

Advising on research methods: A consultant's companion

Contingency Table Models for Assessing Item Bias