Pedagosko i psiholosko testiranje i procjenjivanje spadaju među najvažnije doprinose znanosti o ponasanju nasem drustvu i pružaju temeljna i znacajna poboljsanja u odnosu na ranije postupke. Iako se ne može ustvrditi da su svi testovi dovoljno usavrseni niti da su sva testiranja razborita i korisna, postoji velika kolicina informacija koje ukazuju na ucinkovitost kvalitetnih instrumenata u onim situacijama u kojima je njihovo koristenje potkrijepljeno validacijskim podacima. Pravilna upotreba testova može dovesti do boljih odluka o pojedincima i programima nego sto bi to bio slucaj bez njihovog koristenja, a također i ukazati na put za siri i pravedniji pristup obrazovanju i zaposljavanju. Međutim, losa upotreba testova može dovesti do zamjetne stete nanesene ispitanicima i drugim sudionicima u procesu donosenja odluka na temelju testovnih podataka. Cilj Standarda je promoviranje kvalitetne i eticne upotrebe testova te uspostavljanje osnovice za ocjenu kvalitete postupaka testiranja. Svrha objavljivanja Standarda je uspostavljanje kriterija za evaluaciju testova, provedbe testiranja i posljedica upotrebe testova. Iako bi evaluacija prikladnosti testa ili njegove primjene trebala ovisiti prvenstveno o strucnim misljenjima, Standardi pružaju okvir koji osigurava obuhvacanje svih relevantnih pitanja. Bilo bi poželjno da svi autori, sponzori, nakladnici i korisnici profesionalnih testova usvoje Standarde te da poticu druge da ih također prihvate.

Standards for educational and psychological testing

The traditional conception of validity divides it into three separate and substitutable types—namely, content, criterion, and construct validities. This view is fragmented and incomplete, especially because it fails to take into account both evidence of the value implications of score meaning as a basis for action and the social consequences of score use. The new unified concept of validity interrelates these issues as fundamental aspects of a more comprehensive theory of construct validity that addresses both score meaning and social values in test interpretation and test use. That is, unified validity integrates considerations of content, criteria, and consequences into a construct framework for the empirical testing of rational hypotheses about score meaning and theoretically relevant relationships, including those of an applied and a scientific nature. Six distinguishable aspects of construct validity are highlighted as a means of addressing central issues implicit in the notion of validity as a unified concept. These are content, substantive, structural, generalizability, external, and consequential aspects of construct validity. In effect, these six aspects function as general validity criteria or standards for all educational and psychological measurement, including performance assessments, which are discussed in some detail because of their increasing emphasis in educational and employment settings.

/pdf/validity-of-psychological-assessment-validation-of-2zgxanmue5.pdf

Validity of Psychological Assessment: Validation of Inferences from Persons' Responses and Performances as Scientific Inquiry into Score Meaning.

Self-report measures of adult attachment are typically scored in ways (e.g., averaging or summing items) that can lead to erroneous inferences about important theoretical issues, such as the degree of continuity in attachment security and the differential stability of insecure attachment patterns. To determine whether existing attachment scales suffer from scaling problems, the authors conducted an item response theory (IRT) analysis of 4 commonly used self-report inventories: Experiences in Close Relationships scales (K. A. Brennan, C. L. Clark, & P. R. Shaver, 1998), Adult Attachment Scales (N. L. Collins & S. J. Read, 1990), Relationship Styles Questionnaire (D. W. Griffin & K. Bartholomew, 1994) and J. Simpson's (1990) attachment scales. Data from 1,085 individuals were analyzed using F. Samejima's (1969) graded response model. The authors' findings indicate that commonly used attachment scales can be improved in a number of important ways. Accordingly, the authors show how IRT techniques can be used to develop new attachment scales with desirable psychometric properties.

An item response theory analysis of self-report measures of adult attachment.

Background Although insomnia is a prevalent complaint with significant morbidity, it often remains unrecognized and untreated. Brief and valid instruments are needed both for screening and outcome assessment. This study examined psychometric indices of the Insomnia Severity Index (ISI) to detect cases of insomnia in a population-based sample and to evaluate treatment response in a clinical sample. Methods Participants were 959 individuals selected from the community for an epidemiological study of insomnia (Community sample) and 183 individuals evaluated for insomnia treatment and 62 controls without insomnia (Clinical sample). They completed the ISI and several measures of sleep quality, fatigue, psychological symptoms, and quality of life; those in the Clinical sample also completed sleep diaries, polysomnography, and interviews to validate their insomnia/good sleep status and assess treatment response. In addition to standard psychometric indices of reliability and validity, item response theory analyses were computed to examine ISI item response patterns. Receiver operating curves were used to derive optimal cutoff scores for case identification and to quantify the minimally important changes in relation to global improvement ratings obtained by an independent assessor. Results ISI internal consistency was excellent for both samples (Cronbach α of 0.90 and 0.91). Item response analyses revealed adequate discriminatory capacity for 5 of the 7 items. Convergent validity was supported by significant correlations between total ISI score and measures of fatigue, quality of life, anxiety, and depression. A cutoff score of 10 was optimal (86.1% sensitivity and 87.7% specificity) for detecting insomnia cases in the community sample. In the clinical sample, a change score of -8.4 points (95% CI: -7.1, -9.4) was associated with moderate improvement as rated by an independent assessor after treatment. Conclusion These findings provide further evidence that the ISI is a reliable and valid instrument to detect cases of insomnia in the population and is sensitive to treatment response in clinical patients.

/pdf/the-insomnia-severity-index-psychometric-indicators-to-18yvovderi.pdf

The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response.

(1998). Human cognitive abilities: A survey of factor analytic studies. Gifted and Talented International: Vol. 13, No. 2, pp. 97-98.

Human cognitive abilities: A survey of factor analytic studies

Contents: Preface. Part I: Introduction. Introduction. Part II: Item Response Theory Principles: Some Contrasts and Comparisons. The New Rules of Measurement. Item Response Theory as Model-Based Measurement. Part III: The Fundamentals of Item Response Theory. Binary IRT Models. Polytomous IRT Models. The Trait Level Measurement Scale: Meaning, Interpretations, and Measurement-Scale Properties. Measuring Persons: Scoring Examinees With IRT Models. Calibrating Items: Estimation. Assessing the Fit of IRT Models. Part IV: Applications of IRT Models. IRT Applications: DIF, CAT, and Scale Analysis. IRT Applications in Cognitive and Developmental Assessment. Applications of IRT in Personality and Attitude Assessment. Computer Programs for Conducting IRT Parameter Estimation.

Item response theory for psychologists

Background and Purpose—To be useful for clinical research, an outcome measure must be feasible to administer and have sound psychometric attributes, including reliability, validity, and sensitivity to change. This study characterizes the psychometric properties of the Stroke Impact Scale (SIS) Version 2.0. Methods—Version 2.0 of the SIS is a self-report measure that includes 64 items and assesses 8 domains (strength, hand function, ADL/IADL, mobility, communication, emotion, memory and thinking, and participation). Subjects with mild and moderate strokes completed the SIS at 1 month (n=91), at 3 months (n=80), and at 6 months after stroke (n=69). Twenty-five subjects had a replicate administration of the SIS 1 week after the 3-month or 6-month test. We evaluated internal consistency and test-retest reliability. The validity of the SIS domains was examined by comparing the SIS to existing stroke measures and by comparing differences in SIS scores across Rankin scale levels. The mixed model procedure was us...

The Stroke Impact Scale Version 2.0 Evaluation of Reliability, Validity, and Sensitivity to Change

In an ever-changing world, psychological testing remains the flagship of applied psychology. Although both the context of application and the legal guidelines for using tests have changed, psychological tests themselves have been relatively stable. Many historically valued tests, in somewhat revised forms, remain in active current use. Further, although several new tests have developed in response to contemporary needs in applied psychology, the principles underlying test development have remained constant. Or have they? Classical test theory has served test development well over several decades. Guiliksen's (1950) classic book, reprinted even in the 1990s, is often cited as the defining volume. However, classical test theory is much older. Many procedures were pioneered by Spearman ( 1907, 1913 ). Most psychologists should, and in fact do, know its principles. In some graduate programs, classical test theory is presented in a separate course that is required for applied psychologists and elective for other areas. In other graduate programs, classical test theory is part of the basic curriculum in testing methods for courses for clinical, counseling, industrial-organizational, and school psychologists. However, since Lord and Novick's (1968) classic book introduced model-based measurement, a quiet revolution has occurred in test theory. Model-based measurement, known as item response theory (IRT) or latent trait theory, has rapidly become mainstream as a theoretical basis for psychological measurement. Increasingly, tests are developed from modelbased measurement not only because the theory is more plausible but also because the potential to solve practical testing problems is greater. A large family of diverse IRT models are now available to apply to an assortment of measurement tasks. IRT applications to available tests will be increasing. Although the early IRT models emphasized dichotomous item formats (e.g., the Rasch model), extensions to other item formats, such as rating scales (Andrich, 1982) and partial credit scoring (Masters, 1982 ) are

/pdf/the-new-rules-of-measurement-507719adx3.pdf

Susan E. Embretson

Papers

Item response theory for psychologists

The Stroke Impact Scale Version 2.0 Evaluation of Reliability, Validity, and Sensitivity to Change

The new rules of measurement.

Construct validity: construct representation versus nomothetic span

A cognitive design system approach to generating valid tests : Application to abstract reasoning