Malaysian Speaking Proficiency Assessment Effectiveness for Undergraduates Suffering from Minimal Descriptors.
TLDR
In this paper, an English-speaking proficiency test and analytic rubrics designed to measure speaking proficiency of Malaysian undergraduates were developed. But the test scores, having good internal consistency (a=.89) and inter-rater reliability (ICC=.84), yielded speaking proficiency descriptors.Abstract:
This study was primarily aimed at developing an English-speaking proficiency test and analytic rubrics designed to measure speaking proficiency of Malaysian undergraduates. On the basis of Littlewood’s Methodological Framework and Long’s Interaction Hypothesis, the researchers derived three speaking tasks from four sources: (a) syllabus of the English language courses at the relevant university, (b) Kathleen Bardovi-Harlig’s operationalizing conversation speech acts, (c) IELTS part B speaking test, and (d) task B speaking section of Malaysian University English Test (MUET). A total of 96 undergraduates with four levels of the language proficiency (i.e., low performers, intermediate performers, upperintermediate performers, and high performers) from a public university in Malaysia voluntarily participated in the study. While two TESOL experts were invited to validate the content of the tasks and the rubrics, two raters rated students’ test scores. Construct validity was established through a known-group validity (construct validity) for a known-group comparison of the task performance at the three difficulty levels namely, elementary, intermediate and advanced. The test scores, having good internal consistency (a= .89) and inter-rater reliability (ICC= .84), yielded speaking proficiency descriptors. This result showed that the test is reliable and valid to diagnose speaking proficiency of Malaysian undergraduates in pursuit of improvement.read more
Citations
More filters
Journal ArticleDOI
Educational Research: Competencies for Analysis and Application:
TL;DR: In this paper, the authors apply the principles of measurement and research design to the evaluation process through several ex- ex-procedure variables, such as independent, dependent, and moderator variables.
Language Testing In Practice Designing And Developing Useful Language Tests
TL;DR: Thank you very much for downloading language testing in practice designing and developing useful language tests, but end up in malicious downloads.
Educational testing and measurement: classroom application and practice
Ali Taghinezhad,Mehdi Dastpak +1 more
TL;DR: In this paper, the authors present a book written by Tom Kubiszyn and Gary Borich for readers, teachers, and researchers interested in the field of educational testing, assessment, and measurement.
Journal ArticleDOI
Development of Problem-Solving-Based Knowledge Assessment Instrument in Electrochemistry
TL;DR: The research findings indicate that this assessment instrument can be used as a reference for teachers to conduct evaluations at the end of learning and the validity refers to the extent that the instrument measures what it was designed to measure.
References
More filters
Journal ArticleDOI
Construct validity in psychological tests.
Lee J. Cronbach,Paul E. Meehl +1 more
TL;DR: The present interpretation of construct validity is not "official" and deals with some areas where the Committee would probably not be unanimous, but the present writers are solely responsible for this attempt to explain the concept and elaborate its implications.
Journal ArticleDOI
Educational Research: Competencies for Analysis and Application:
TL;DR: In this paper, the authors apply the principles of measurement and research design to the evaluation process through several ex- ex-procedure variables, such as independent, dependent, and moderator variables.
Journal ArticleDOI
Theoretical bases of communicative approaches to second language teaching and testing
Michael Canale,Merrill Swain +1 more
Posted Content
Construct Measurement and Validation Procedures in MIS and Behavioral Research: Integrating New and Existing Techniques
TL;DR: New and existing techniques are integrated into a comprehensive set of recommendations that can be used to give researchers in MIS and the behavioral sciences a framework for developing valid measures.
Related Papers (5)
A comparison of reliability and precision of subscore reporting methods for a state English language proficiency assessment
Tanya Longabach,Vicki Peyton +1 more