scispace - formally typeset
Open AccessPosted Content

Running experiments on Amazon Mechanical Turk

Reads0
Chats0
TLDR
The authors presented new demographic data about the Mechanical Turk subject population, reviewed the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and compared the magnitude of effects obtained using Mechanical Turk and traditional subject pools.
Abstract
Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comparing the magnitude of effects obtained using Mechanical Turk and traditional subject pools. We further discuss some additional benefits such as the possibility of longitudinal, cross cultural and prescreening designs, and offer some advice on how to best manage a common subject pool.

read more

Content maybe subject to copyright    Report

Citations
More filters
Posted ContentDOI

Don't get it or don't spread it: comparing self-interested versus prosocial motivations for COVID-19 prevention behaviors.

TL;DR: This article investigated which framing is more effective-and motivation is stronger-for fostering prevention behavior intentions for COVID-19 prevention behaviors and found that people who behaved prosocially in incentivized economic games years before the pandemic had greater prevention intentions.
Journal ArticleDOI

Data quality of platforms and panels for online behavioral research

TL;DR: In this paper, the authors examine key aspects of data quality for online behavioral research between selected platforms (Amazon Mechanical Turk, CloudResearch, and Prolific) and panels (Qualtrics and Dynata).
Journal ArticleDOI

“I know I can, but I don't fit”: Perceived fit, self-efficacy, and entrepreneurial intention

TL;DR: In this paper, the authors introduce perceived person-entrepreneurship fit to entrepreneurship and show that it moderates the relationship between entrepreneurial self-efficacy and entrepreneurial intention, and conclude that when a strong perception of fit with entrepreneurship is achieved, entrepreneurial intention is strongly predicted by entrepreneurial selfefficacy.
Journal ArticleDOI

Love at first swipe? Explaining Tinder self-presentation and motives

TL;DR: In this article, the authors assess how Tinder users present themselves, exploring at the same time the impact of their personality characteristics, their demographics, and their motives of use on their self-esteem.
Journal ArticleDOI

Scoundrels or Stars? Theory and Evidence on the Quality of Workers in Online Labor Markets

TL;DR: In this paper, the authors investigate the validity of using online workers as a proxy for non-experts when accounting research designs use more demanding tasks than these workers typically complete, and they find that online workers are at least as willing as students to make costly choices, even at significantly lower wages.
References
More filters
Journal ArticleDOI

The Framing of Decisions and the Psychology of Choice

TL;DR: The psychological principles that govern the perception of decision problems and the evaluation of probabilities and outcomes produce predictable shifts of preference when the same problem is framed in different ways.
Journal ArticleDOI

Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data?

TL;DR: Findings indicate that MTurk can be used to obtain high-quality data inexpensively and rapidly and the data obtained are at least as reliable as those obtained via traditional methods.
Journal ArticleDOI

On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications.

TL;DR: In this paper, the authors focus on some of the qualities peculiar to psychological experiments and point out that the demand characteristics perceived in any particular experiment will vary with the sophistication, intelligence, and previous experience of each experimental subject.
Journal ArticleDOI

Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.

TL;DR: The conjunction rule as mentioned in this paper states that the probability of a conjunction cannot exceed the probabilities of its constituents, P (A) and P (B), because the extension (or the possibility set) of the conjunction is included in the extension of their constituents.
Journal ArticleDOI

Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.

TL;DR: Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods and it is concluded that Internet methods can contribute to many areas of psychology.
Related Papers (5)