Journal ArticleDOI
Response Time Effort: A New Measure of Examinee Motivation in Computer-Based Tests
Steven L. Wise,Xiaojing Kong +1 more
Reads0
Chats0
TLDR
In this article, the authors introduce a new measure, termed response time effort (RTE), which is based on the hypothesis that unmotivated examinees will answer too quickly (i.e., before they have time to read and fully consider the item).Abstract:
When low-stakes assessments are administered, the degree to which examinees give their best effort is often unclear, complicating the validity and interpretation of the resulting test scores. This study introduces a new method, based on item response time, for measuring examinee test-taking effort on computer-based test items. This measure, termed response time effort (RTE), is based on the hypothesis that when administered an item, unmotivated examinees will answer too quickly (i.e., before they have time to read and fully consider the item). Psychometric characteristics of RTE scores were empirically investigated and supportive evidence for score reliability and validity was found. Potential applications of RTE scores and their implications are discussed.read more
Citations
More filters
Journal ArticleDOI
Ethics and Fairness in Assessing Learning Outcomes in Higher Education
Olga Zlatkin-Troitschanskaia,Jasmin Schlax,Judith Jitomirski,Roland Happ,Carla Kühling-Thees,Sebastian Brückner,Hans Anand Pant +6 more
TL;DR: In this paper, a domain-specific higher education entry test was used to identify which students had particular difficulty completing the test, taking into account gender and language-related influence factors in the assessment of their test performance.
Report SeriesDOI
Youth in Transition: How Do Some of The Cohorts Participating in PISA Fare in PIAAC?
TL;DR: The authors examined the evolution of socio-economic and gender disparities in literacy and numeracy proficiency between the ages of 15 and 27 in the sample of countries that took part in both studies.
Journal ArticleDOI
Student engagement with mobile-based assessment systems: A survival analysis
Investigating the Dimensionality of Examinee Motivation across Instruction Conditions in Low-Stakes Testing Contexts.
TL;DR: Mathers et al. as mentioned in this paper investigated the impact of test session instructions on the psychometric properties of the test-taking motivation measure and found that the effect of instruction manipulations on the test taking motivation measure has yet to be investigated.
Journal ArticleDOI
Identifying low test-taking effort during low-stakes tests with the new Test-taking Effort Short Scale (TESS) – development and psychometrics
Katrin Schüttpelz-Brauns,Martina Kadmon,Claudia Kiessling,Yassin Karay,Margarita Gestmann,Juliane E. Kämmer,Juliane E. Kämmer +6 more
TL;DR: The newly developed Test-taking Effort Short Scale (TESS), which comprises three items measuring attainment value/intrinsic value, utility value, and perceived benefits, respectively, is presented, which is shorter than most established self-assessment scales.
References
More filters
Book
Motivation in Education: Theory, Research, and Applications
Paul R. Pintrich,Dale H. Schunk +1 more
TL;DR: Motivation: Introduction and Historical Foundations, and theories of Motivation, and Teacher Influences.
Journal ArticleDOI
Low Examinee Effort in Low-Stakes Assessment: Problems and Potential Solutions.
TL;DR: In this article, a theoretical model of test-taking motivation is presented, with a synthesis of previous research indicating that low student motivation is associated with a substantial decrease in test performance.
Journal ArticleDOI
Methodology Review : Evaluating Person Fit
Rob R. Meijer,Klaas Sijtsma +1 more
TL;DR: Person-fit methods based on classical test theory and item response theory (IRT), and methods investigating particular types of response behavior on tests, are examined in this paper, where the usefulness of person-fit statistics for improving measurement depends on the application.