scispace - formally typeset
Search or ask a question
Topic

Test theory

About: Test theory is a research topic. Over the lifetime, 566 publications have been published within this topic receiving 30120 citations.


Papers
More filters
Book
01 Jan 1968
TL;DR: In this paper, the authors present a survey of test theory models and their application in the field of mental test analysis. But the focus of the survey is on test-score theories and models, and not the practical applications and limitations of each model studied.
Abstract: This is a reprint of the orginal book released in 1968. Our primary goal in this book is to sharpen the skill, sophistication, and in- tuition of the reader in the interpretation of mental test data, and in the construction and use of mental tests both as instruments of psychological theory and as tools in the practical problems of selection, evaluation, and guidance. We seek to do this by exposing the reader to some psychologically meaningful statistical theories of mental test scores. Although this book is organized in terms of test-score theories and models, the practical applications and limitations of each model studied receive substantial emphasis, and these discussions are presented in as nontechnical a manner as we have found possible. Since this book catalogues a host of test theory models and formulas, it may serve as a reference handbook. Also, for a limited group of specialists, this book aims to provide a more rigorous foundation for further theoretical research than has heretofore been available.One aim of this book is to present statements of the assumptions, together with derivations of the implications, of a selected group of statistical models that the authors believe to be useful as guides in the practices of test construction and utilization. With few exceptions we have given a complete proof for each major result presented in the book. In many cases these proofs are simpler, more complete, and more illuminating than those originally offered. When we have omitted proofs or parts of proofs, we have generally provided a reference containing the omitted argument. We have left some proofs as exercises for the reader, but only when the general method of proof has already been demonstrated. At times we have proved only special cases of more generally stated theorems, when the general proof affords no additional insight into the problem and yet is substantially more complex mathematically.

6,814 citations

Book
01 Jul 1999
TL;DR: In this article, the authors introduce the concept of a scale and test homogeneity, reliability, and generalizability for total test scores, and propose a scaling theory for test scores.
Abstract: Contents: General Introduction. Items and Item Scores. Item and Test Statistics. The Concept of a Scale. Reliability Theory for Total Test Scores. Test Homogeneity, Reliability, and Generalizability. Reliability--Applications. Prediction and Multiple Regression. The Common Factor Model. Validity. Classical Item Analysis. Item Response Models. Properties of Item Response Models. Multidimensional Item Response Models. Comparing Populations. Alternate Forms and the Problem of Equating. An Introduction to Structural Equation Modeling. Some Scaling Theory. Retrospective. Appendix: Some Rules for Expected Values.

2,928 citations

Book ChapterDOI
01 Jan 1991
TL;DR: The item response theory (IRT) as mentioned in this paper is a new theoretical basis for educational and psychological testing and measurement, which has been variously referred to as latent trait theory, item characteristic curve theory, and, more recently, item Response Theory (IRT).
Abstract: During the past 30 years or so, a new theoretical basis for educational and psychological testing and measurement has emerged. It has been variously referred to as latent trait theory, item characteristic curve theory, and, more recently, item response theory (IRT). Although this new test theory holds considerable promise as a successor to classical test theory, it has been underutilized by test practitioners. One important reason for this underutilization is that many test developers have not had sufficient time to devote to the study of the technical and mathematical intricacies involved in this new test theory and its mathematical models. This chapter is intended as an overview of IRT for individuals with some background in the basic methods of classical test theory. Readers are referred to Hambleton (1989) and Hambleton and Swaminathan (1985) for other overviews of IRT.

1,092 citations

Book
01 Jan 2005
TL;DR: In this paper, the authors identify the Construct Links between Constructs Construct Cleanliness Single versus Multiple Constructs and Single versus multiple Constructs Summary and Next Step Problems and Exercises Designing and Writing Items Empirical, Theoretical, and Rational Approaches to Item Empirically, theoretical and rational approaches to item literature Search Subject Matter Experts How Many Items?
Abstract: Preface The Assessment of Individuals: The Critical Role and Fundamentals of Measurement Measurement in the Physical Sciences Measurement in the Social Sciences Historical Highlights of Measurement Statistics Background The First Step: Identifying the Construct Links Between Constructs Construct Cleanliness Single versus Multiple Constructs Summary and Next Step Problems and Exercises Designing and Writing Items Empirical, Theoretical and Rational Approaches to Item Empirical, Theoretical and Rational Approaches to Item Literature Search Subject Matter Experts How Many Items? Attitudinal Items: Early Work in Item Generation Assessing Behaviors Pilot Testing Summary and Next Step Problems and Exercises Designing and Scoring Responses Open-Ended Responses Closed-Ended Questions Example 1: Proportional Differences for a Single Variable Example 2: Proportional Differences for Two Variables Dichotomous Responses Multiple Choice Tests Continuous Responses Ipsative versus Normative Scales Difference and Change Scores Summary and Next Step Problems and Exercises Collecting Data: Sampling and Screening Probability Sampling Non-Probability Sampling Sample Sizes Missing Data Preparing to Analyze Your Data Summary and Next Step Problems and Exercises Classical Test Theory: Assumptions, Equations, Limitations and Item Analyses Classical Test Theory Theory of True and Error Scores: Description and Assumptions Ramifications and Limitations of Classical Test Theory Assumptions Item Analysis within CTT: Approaches, Statistical Analyses, and Interpretation Descriptive Statistics Summary Problems and Exercises Modern Test Theory: Assumptions, Equations, Limitations and Item Analyses Modern Test Theory Models One-Parameter Logistic Model Two-Parameter Logistic Model Three-Parameter Logistic Model Multiple-response IRT Models Parameter Estimation Scoring Respondents Model Fit Assumptions Ramifications of the Assumptions of Modern Test Theory Practical Advantages of Modern Test Theory Limitations of Modern Test Theory Computer Programs Practical Considerations Summary Next Steps Problems and Exercises Reliability of Test Scores and Test Items Test-retest Reliability Alternative Forms Reliability Measures of Internal Consistency Setting Confidence Intervals Reliability of a Composite Difference Scores - A Reliability Concern Practical Questions Summary and Next Steps Problems and Exercises Reliability of Raters Inter-Rater Reliability Indices Reliability Generalization Modern Test Theory Approaches to Reliability Summary and Next Steps Problems and Exercises Assessing Validity Using Content and Criterion Methods Asking the Test Takers Asking the Subject Matter Experts Assessments Using Correlation and Regression: Criterion-Related Studies Classification Approaches to Test Score Validation Group Differences and Test Bias Extending the Inferences of Criterion-Related Validity Studies Summary Problems and Exercises Assessing Validity Via Item Internal Structure Principal Components Analysis Common Factor Analysis Common Factor Analysis using Analysis of Covariance Structures Some Other Issues in Factor Analysis Practical Issues Concluding Comments on Internal Structure and Validity Threats to the Validity of Scores Multitrait-Multimethod Assessment Closing Comments on Test Score Validity Summary Problems and Exercises Ethics and Professional Issues in Testing Professional Standards and Guidelines Ethical Procedures and Protocols Test Administration Integrity Testing Computerized Testing Coaching, Testwiseness, and Re-takes Testing Legislation Test Item Bias and Adverse Impact Translation Issues Electronic Presentation and Capture Summary Problems and Exercises Brief Reviews of Some Selected Tests and Concluding Comments Information about Existing Tests Some Intelligence Tests Academic Achievement Tests Structured Personality Tests Career Interest/Guidance Instruments Chapter Summary A Quick Book Review Concluding Comments Problems and Exercises Appendices References Index

926 citations


Network Information
Related Topics (5)
Empirical research
51.3K papers, 1.9M citations
73% related
Curriculum
177.5K papers, 2.3M citations
73% related
Regression analysis
31K papers, 1.7M citations
72% related
Higher education
244.3K papers, 3.5M citations
72% related
Educational technology
72.4K papers, 1.7M citations
72% related
Performance
Metrics
No. of papers in the topic in previous years
YearPapers
20235
20229
202115
20208
201914
201813