scispace - formally typeset
Open AccessPosted Content

Running experiments on Amazon Mechanical Turk

Reads0
Chats0
TLDR
The authors presented new demographic data about the Mechanical Turk subject population, reviewed the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and compared the magnitude of effects obtained using Mechanical Turk and traditional subject pools.
Abstract
Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comparing the magnitude of effects obtained using Mechanical Turk and traditional subject pools. We further discuss some additional benefits such as the possibility of longitudinal, cross cultural and prescreening designs, and offer some advice on how to best manage a common subject pool.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Self-enhancement and the life script in future thinking across the lifespan.

TL;DR: Findings suggest that simulated future events play a valuable role in self-enhancement across the lifespan and the life script can be viewed as a useful search mechanism when one is missing the episodic details that are more available in memories.
Journal ArticleDOI

PTSD symptoms and perception of cognitive problems: The roles of posttraumatic cognitions and trauma coping self-efficacy.

TL;DR: Clinically, in patients for which there is a perception of cognitive impairment that is not borne out in neuropsychological testing, cognitive–behavioral therapy focused on altering negative self-perceptions and appraisals may be beneficial.
Journal ArticleDOI

How do politicians use Facebook? An applied Social Observatory

TL;DR: In this article, the authors present a low latency method for the observation and measurement of social indicators within an online community by focusing on the public Facebook profiles of 187 federal German politicians.
Journal ArticleDOI

Bacteria as Bullies: Effects of Linguistic Agency Assignment in Health Message

TL;DR: It is concluded that health communicators can increase target audiences' perceptions of susceptibility and severity by assigning agency to the threat in question when devising health messages.
Proceedings ArticleDOI

Gender-Inclusive Design: Sense of Belonging and Bias in Web Interfaces

TL;DR: It is confirmed that young women exposed to the masculine page are negatively affected, reporting significantly less ambient belonging, interest in the course and in studying computer science broadly, and the need for inclusive user interface design for the web is highlighted.
References
More filters
Journal ArticleDOI

The Framing of Decisions and the Psychology of Choice

TL;DR: The psychological principles that govern the perception of decision problems and the evaluation of probabilities and outcomes produce predictable shifts of preference when the same problem is framed in different ways.
Journal ArticleDOI

Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data?

TL;DR: Findings indicate that MTurk can be used to obtain high-quality data inexpensively and rapidly and the data obtained are at least as reliable as those obtained via traditional methods.
Journal ArticleDOI

On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications.

TL;DR: In this paper, the authors focus on some of the qualities peculiar to psychological experiments and point out that the demand characteristics perceived in any particular experiment will vary with the sophistication, intelligence, and previous experience of each experimental subject.
Journal ArticleDOI

Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.

TL;DR: The conjunction rule as mentioned in this paper states that the probability of a conjunction cannot exceed the probabilities of its constituents, P (A) and P (B), because the extension (or the possibility set) of the conjunction is included in the extension of their constituents.
Journal ArticleDOI

Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.

TL;DR: Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods and it is concluded that Internet methods can contribute to many areas of psychology.
Related Papers (5)