scispace - formally typeset
Open AccessPosted Content

Running experiments on Amazon Mechanical Turk

Reads0
Chats0
TLDR
The authors presented new demographic data about the Mechanical Turk subject population, reviewed the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and compared the magnitude of effects obtained using Mechanical Turk and traditional subject pools.
Abstract
Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comparing the magnitude of effects obtained using Mechanical Turk and traditional subject pools. We further discuss some additional benefits such as the possibility of longitudinal, cross cultural and prescreening designs, and offer some advice on how to best manage a common subject pool.

read more

Content maybe subject to copyright    Report

Citations
More filters
Journal ArticleDOI

Benevolent characteristics promote cooperative behaviour among humans.

TL;DR: In this paper, a series of experiments were conducted to study whether benevolence, defined as a unilateral act of paying a cost to increase the welfare of someone else beyond one's own, is related to cooperation in a subsequent one-shot anonymous Prisoner's dilemma.
Journal ArticleDOI

The indirect effect of social support on post-trauma psychopathology via self-compassion

TL;DR: In this article, the authors investigated the relationship between social support and post-trauma psychopathology and self-compassion, and found that social support may reduce symptoms of PTSD, GAD, and depression through increased selfcompassion in those who experienced a trauma.
Journal ArticleDOI

Firms Talk, Suppliers Walk: Analyzing the Locus of Greenwashing in the Blame Game and Introducing ‘Vicarious Greenwashing’

TL;DR: In this paper, a new typology of greenwashing is proposed based on the locus of discrepancy, i.e. the point along the supply-chain where the discrepancy between'responsible words' and 'irresponsible walks' occurs.
Journal ArticleDOI

Suicide-Specific Rumination Relates to lifetime suicide attempts above and beyond a variety of other suicide risk factors.

TL;DR: The finding that suicide-specific rumination outperformed all other suicide risk factors in predicting the presence of a lifetime suicide attempt suggests the potential potency of this relatively understudied risk factor in understanding transitions to suicidal behavior.
Journal ArticleDOI

Sharing Policies in Multiuser Privacy Scenarios: Incorporating Context, Preferences, and Arguments in Decision Making

TL;DR: An inference model is developed and evaluated that predicts the optimal sharing policy given the three types of features in multiuser scenarios where arguments are employed, and the predictions of the model are analyzed to uncover potential scenario types that lead to incorrect predictions and to enhance the understanding of when multiusers scenarios are more or less prone to dispute.
References
More filters
Journal ArticleDOI

The Framing of Decisions and the Psychology of Choice

TL;DR: The psychological principles that govern the perception of decision problems and the evaluation of probabilities and outcomes produce predictable shifts of preference when the same problem is framed in different ways.
Journal ArticleDOI

Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data?

TL;DR: Findings indicate that MTurk can be used to obtain high-quality data inexpensively and rapidly and the data obtained are at least as reliable as those obtained via traditional methods.
Journal ArticleDOI

On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications.

TL;DR: In this paper, the authors focus on some of the qualities peculiar to psychological experiments and point out that the demand characteristics perceived in any particular experiment will vary with the sophistication, intelligence, and previous experience of each experimental subject.
Journal ArticleDOI

Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.

TL;DR: The conjunction rule as mentioned in this paper states that the probability of a conjunction cannot exceed the probabilities of its constituents, P (A) and P (B), because the extension (or the possibility set) of the conjunction is included in the extension of their constituents.
Journal ArticleDOI

Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.

TL;DR: Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods and it is concluded that Internet methods can contribute to many areas of psychology.
Related Papers (5)