Open AccessPosted Content
Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power
Reads0
Chats0
TLDR
This paper proposed Instructional manipulation check (IMC), a new tool for detecting participants who are not following instructions and demonstrated how the inclusion of an IMC can increase statistical power and reliability of a dataset.Abstract:
Participants are not always as diligent in reading and following instructions as experimenters would like them to be. When participants fail to follow instructions, this increases noise and decreases the validity of their data. This paper presents and validates a new tool for detecting participants who are not following instructions – the Instructional manipulation check (IMC). We demonstrate how the inclusion of an IMC can increase statistical power and reliability of a dataset.read more
Citations
More filters
Running experiments on Amazon Mechanical Turk
TL;DR: The authors presented new demographic data about the Mechanical Turk subject population, reviewed the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and compared the magnitude of effects obtained using Mechanical Turk and traditional subject pools.
Journal Article
Data Collection in a Flat World: Strengths and Weaknesses of Mechanical Turk Samples
TL;DR: MTurk offers a highly valuable opportunity for data collection, and it is recommended that researchers using MTurk include screening questions that gauge attention and language comprehension, avoid questions with factual answers, and consider how individual differences in financial and social domains may influence results.
Journal ArticleDOI
Beyond the Turk: Alternative platforms for crowdsourcing behavioral research
TL;DR: This article found that participants on both platforms were more naive and less dishonest compared to MTurk participants, and ProA and CrowdFlower participants produced data quality that was higher than CF's and comparable to M-Turk's.
Journal ArticleDOI
Separate but equal? A comparison of participants and data gathered via Amazon's MTurk, social media, and face-to-face behavioral testing
TL;DR: It is concluded that for some behavioral tests, online recruitment and testing can be a valid-and sometimes even superior-partner to in-person data collection.
Journal ArticleDOI
Evaluating Amazon's Mechanical Turk as a Tool for Experimental Behavioral Research
TL;DR: This paper replicates a diverse body of tasks from experimental psychology including the Stroop, Switching, Flanker, Simon, Posner Cuing, attentional blink, subliminal priming, and category learning tasks using participants recruited using AMT.
References
More filters
Journal ArticleDOI
Toward a positive theory of consumer choice
TL;DR: The economic theory of the consumer is a combination of positive and normative theories as discussed by the authors, which describes how consumers should choose, but it is also described how they do choose, and in certain well-defined situations many consumers act in a manner that is inconsistent with economic theory.
Journal ArticleDOI
Mental Accounting and Consumer Choice
TL;DR: It’s time to get used to the idea that there is no such thing as a “right answer” to everything.
Journal ArticleDOI
Are Emily and Greg More Employable Than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination
TL;DR: The authors study race in the labor market by sending fictitious resumes to help-wanted ads in Boston and Chicago newspapers and find that white names receive 50 percent more callbacks for interviews than African-Americans.
Journal ArticleDOI
The efficient assessment of need for cognition
TL;DR: A short form for assessing individual differences in need for cognition is described and its application in medicine is described.