scispace - formally typeset
Open AccessPosted Content

Running experiments on Amazon Mechanical Turk

Reads0
Chats0
TLDR
The authors presented new demographic data about the Mechanical Turk subject population, reviewed the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and compared the magnitude of effects obtained using Mechanical Turk and traditional subject pools.
Abstract
Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comparing the magnitude of effects obtained using Mechanical Turk and traditional subject pools. We further discuss some additional benefits such as the possibility of longitudinal, cross cultural and prescreening designs, and offer some advice on how to best manage a common subject pool.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Why women don’t run: Experimental evidence on gender differences in political competition aversion

TL;DR: This article found that priming individuals to consider the competitive nature of politics has a strong negative effect on women's interest in political office, but not on men's interest, hence significantly increasing the gender gap in leadership ambition.
Proceedings ArticleDOI

Combating Rumor Spread on Social Media: The Effectiveness of Refutation and Warning

TL;DR: Results have shown that exposing people to information that refutes rumors or warns that the statement has appeared on rumor websites could reduce the spread of rumors, and suggest that social media technologies can be designed such that users can self correct and inactivate potentially inaccurate information in their environment.
Journal ArticleDOI

Risk in the face of retribution: Psychopathic individuals persist in financial misbehavior among the Dark Triad

TL;DR: For example, this article found that individuals high in psychopathy persisted in gambling, leading to greater financial loss of the next participant, even in the face of punishment and financial loss.
Journal ArticleDOI

Psychopathy, DSM-5, and a caution.

TL;DR: In this paper, the authors test empirically the convergent and discriminant validity of the Psychopathic Personality Inventory-Revised (PPI-R), Triarchic Psychopathy Measure (TriPM), the Elemental Psychopathy Assessment (EPA), and the Personality Inventory for DSM-5 (PID-5) with respect to their relationship to one another, with traditional measures of psychopathy and antisocial personality disorder, and with a measure of the 5-factor model.
Journal ArticleDOI

Conducting field experiments using eLancing's natural environment☆

TL;DR: In this paper, the use of eLancing as a natural environment to conduct field experiments in entrepreneurship research is proposed, which allows researchers to improve generalizability, address the omitted variables problem, improve the operationalization of constructs, improve confidence regarding the nature of causal relationships, and address other challenges such as participant bias and selective survival.
References
More filters
Journal ArticleDOI

The Framing of Decisions and the Psychology of Choice

TL;DR: The psychological principles that govern the perception of decision problems and the evaluation of probabilities and outcomes produce predictable shifts of preference when the same problem is framed in different ways.
Journal ArticleDOI

Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data?

TL;DR: Findings indicate that MTurk can be used to obtain high-quality data inexpensively and rapidly and the data obtained are at least as reliable as those obtained via traditional methods.
Journal ArticleDOI

On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications.

TL;DR: In this paper, the authors focus on some of the qualities peculiar to psychological experiments and point out that the demand characteristics perceived in any particular experiment will vary with the sophistication, intelligence, and previous experience of each experimental subject.
Journal ArticleDOI

Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.

TL;DR: The conjunction rule as mentioned in this paper states that the probability of a conjunction cannot exceed the probabilities of its constituents, P (A) and P (B), because the extension (or the possibility set) of the conjunction is included in the extension of their constituents.
Journal ArticleDOI

Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.

TL;DR: Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods and it is concluded that Internet methods can contribute to many areas of psychology.
Related Papers (5)