Powergrading: a Clustering Approach to Amplify Human Effort for Short Answer Grading
Sumit Basu,Charles E. Jacobs,Lucy Vanderwende +2 more
- Vol. 1, pp 391-402
TLDR
This paper used a similarity metric between student responses, and then used this metric to group responses into clusters and subclusters, which allowed teachers to grade multiple responses with a single action, provide rich feedback to groups of similar answers, and discover modalities of misunderstanding among students.Abstract:
We introduce a new approach to the machine-assisted grading of short answer questions. We follow past work in automated grading by first training a similarity metric between student responses, but then go on to use this metric to group responses into clusters and subclusters. The resulting groupings allow teachers to grade multiple responses with a single action, provide rich feedback to groups of similar answers, and discover modalities of misunderstanding among students; we refer to this amplification of grader effort as “powergrading.” We develop the means to further reduce teacher effort by automatically performing actions when an answer key is available. We show results in terms of grading progress with a small “budget” of human actions, both from our method and an LDA-based approach, on a test corpus of 10 questions answered by 698 respondents.read more
Citations
More filters
Journal ArticleDOI
Machine Learning Algorithm for Grading Open-Ended Physics Questions in Turkish.
TL;DR: A short answer grading system in Turkish is reported on, based on a machine learning approach using a constructed dataset about a Physics course in Turkish, which is the first study in the field of open-ended exam scoring in Turkish.
Proceedings ArticleDOI
CEPT: Collaborative Editing Tool for Non-Native Authors
TL;DR: CEPT, which allows individual co-authors to generate their own revisions as well as incorporating edits from others to achieve mutual inspiration, is described, which could significantly improve both the language quality and collaboration experience of NNS writers.
Proceedings Article
Automatic Grading of Short Answers for MOOC via Semi-supervised Document Clustering.
TL;DR: An automatic grading approach for short answers, based on the non-negative semi-supervised document clustering method, that is able to group the large amount of short answers into multiple sets, and output the score for each answer automatically, so the effort of teachers can be greatly reduced.
Proceedings ArticleDOI
Using NLP to Support Scalable Assessment of Short Free Text Responses
TL;DR: The Amati system is presented, which aims to help human markers improve the speed and accuracy of their marking and allows markers to develop mark schemes which closely match the judgements of a human expert, with the benefits of consistency, scalability and traceability afforded by an automated marking system.
Proceedings ArticleDOI
RIMES: Embedding Interactive Multimedia Exercises in Lecture Videos
TL;DR: RIMES, a system for easily authoring, recording, and reviewing interactive multimedia exercises embedded in lecture videos, is introduced and found useful for capturing students' thought processes, identifying misconceptions, and engaging students with content.
References
More filters
Journal ArticleDOI
Latent dirichlet allocation
TL;DR: This work proposes a generative model for text and other collections of discrete data that generalizes or improves on several previous models including naive Bayes/unigram, mixture of unigrams, and Hofmann's aspect model.
Proceedings Article
Latent Dirichlet Allocation
TL;DR: This paper proposed a generative model for text and other collections of discrete data that generalizes or improves on several previous models including naive Bayes/unigram, mixture of unigrams, and Hof-mann's aspect model, also known as probabilistic latent semantic indexing (pLSI).
Book
Finding Groups in Data: An Introduction to Cluster Analysis
TL;DR: An electrical signal transmission system, applicable to the transmission of signals from trackside hot box detector equipment for railroad locomotives and rolling stock, wherein a basic pulse train is transmitted whereof the pulses are of a selected first amplitude and represent a train axle count.
Journal ArticleDOI
An algorithm for suffix stripping
TL;DR: An algorithm for suffix stripping is described, which has been implemented as a short, fast program in BCPL, and performs slightly better than a much more elaborate system with which it has been compared.
Journal ArticleDOI
Finding Groups in Data: An Introduction to Chster Analysis
TL;DR: This book make understandable the cluster analysis is based notion of starsmodern treatment, which efficiently finds accurate clusters in data and discusses various types of study the user set explicitly but also proposes another.