Open AccessPosted Content
Running experiments on Amazon Mechanical Turk
Reads0
Chats0
TLDR
The authors presented new demographic data about the Mechanical Turk subject population, reviewed the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and compared the magnitude of effects obtained using Mechanical Turk and traditional subject pools.Abstract:
Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comparing the magnitude of effects obtained using Mechanical Turk and traditional subject pools. We further discuss some additional benefits such as the possibility of longitudinal, cross cultural and prescreening designs, and offer some advice on how to best manage a common subject pool.read more
Citations
More filters
Book
Some Whys and Hows of Experiments in Human-Computer Interaction
TL;DR: The present monograph identifies heuristics of doing good experiments, including how to build on existing work in devising hypotheses and selecting measures; how to craft challenging comparisons, rather than biased win–lose setups; and how to provide evidence for conclusions.
Journal ArticleDOI
Corporate psychopathy and the full-range leadership model.
TL;DR: The B-Scan 360 and all of its four factors were positively correlated with passive leadership (Laissez-Faire leadership) and negatively correlated with positive leadership (both Transactional and Transformational leadership).
Journal ArticleDOI
Who gets the blame for service failures? Attribution of responsibility toward robot versus human service providers and service firms
Xuying Leo,Young Eun Huh +1 more
TL;DR: Examination of how and to what extent people attribute responsibility toward service robots in such cases of service failures compared to when humans provide the same service failures shows that people attributed less responsibility toward a robot than a human for the service failure because people perceive robots to have less control over the task.
Journal ArticleDOI
Visual illusions and plate design: the effects of plate rim widths and rim coloring on perceived food portion size
Arianna D. McClain,W van den Bos,Donna M. Matheson,Manisha Desai,Samuel M. McClure,Thomas N. Robinson +5 more
TL;DR: Testing whether a plate’s rim width and coloring influence perceptual bias to affect perceived food portion size may help design plates to influence perceptions of food portion sizes.
Journal ArticleDOI
Rethinking spontaneous giving: Extreme time pressure and ego-depletion favor self-regarding reactions
TL;DR: This article showed that spontaneous reactions in one-shot anonymous interactions tend to be egoistic, and further shed further light on the cognitive underpinnings of cooperation, as they suggest that cooperation in one shot interactions is not automatic, but appears only at later stages of reasoning.
References
More filters
Journal ArticleDOI
The Framing of Decisions and the Psychology of Choice
Amos Tversky,Daniel Kahneman +1 more
TL;DR: The psychological principles that govern the perception of decision problems and the evaluation of probabilities and outcomes produce predictable shifts of preference when the same problem is framed in different ways.
Journal ArticleDOI
Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data?
TL;DR: Findings indicate that MTurk can be used to obtain high-quality data inexpensively and rapidly and the data obtained are at least as reliable as those obtained via traditional methods.
Journal ArticleDOI
On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications.
TL;DR: In this paper, the authors focus on some of the qualities peculiar to psychological experiments and point out that the demand characteristics perceived in any particular experiment will vary with the sophistication, intelligence, and previous experience of each experimental subject.
Journal ArticleDOI
Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Amos Tversky,Daniel Kahneman +1 more
TL;DR: The conjunction rule as mentioned in this paper states that the probability of a conjunction cannot exceed the probabilities of its constituents, P (A) and P (B), because the extension (or the possibility set) of the conjunction is included in the extension of their constituents.
Journal ArticleDOI
Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.
TL;DR: Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods and it is concluded that Internet methods can contribute to many areas of psychology.