Open AccessPosted Content
Running experiments on Amazon Mechanical Turk
Reads0
Chats0
TLDR
The authors presented new demographic data about the Mechanical Turk subject population, reviewed the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and compared the magnitude of effects obtained using Mechanical Turk and traditional subject pools.Abstract:
Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic data about the Mechanical Turk subject population, reviewing the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and comparing the magnitude of effects obtained using Mechanical Turk and traditional subject pools. We further discuss some additional benefits such as the possibility of longitudinal, cross cultural and prescreening designs, and offer some advice on how to best manage a common subject pool.read more
Citations
More filters
Journal ArticleDOI
When change causes stress: Effects of self-construal and change consequences
Barbara Wisse,Ed Sleebos +1 more
TL;DR: This is one of the first studies to show that different kinds of change may be leading to uncertainty or stress, depending on employees’ level of self-construal, as well as to investigate why some people experience stress during change, while others do so to a lesser extent.
Journal ArticleDOI
Supervisory consequences of abusive supervision: An investigation of sense of power, managerial self-efficacy, and task-oriented leadership behavior
TL;DR: This paper found that abusive supervisory behavior is positively related to supervisors' state sense of power, which in turn positively relates to their managerial self-efficacy and task-oriented leadership behavior.
Journal ArticleDOI
Conducting spoken word recognition research online: Validation and a new timing method
Joseph Slote,Julia Strand +1 more
TL;DR: Although online users were faster and less accurate than participants in the lab, the results revealed strong correlations between the online and laboratory measures for both word identification accuracy and lexical decision speed, suggesting that AMT can be a viable alternative to the traditional laboratory setting as a source of participation for some spoken word recognition research.
Journal ArticleDOI
The Face–Time Continuum Lifespan Changes in Facial Width-to-Height Ratio Impact Aging-Associated Perceptions
TL;DR: Evidence is provided that fWHR decreases across age and influences stereotypical perceptions that change with age, such that individuals with taller, thinner faces are perceived to be less aggressive, less physically powerful, and friendlier.
Proceedings Article
Increasing Sharing Tendency Without Reducing Satisfaction: Finding the Best Privacy-Settings User Interface for Social Networks
Bart P. Knijnenburg,Alfred Kobsa +1 more
TL;DR: It is shown that the granularity of categories, the possibility to make exceptions, the default setting, and the order in which categories are being presented have strong effects on users’ evaluation of the system as well as their sharing behavior.
References
More filters
Journal ArticleDOI
The Framing of Decisions and the Psychology of Choice
Amos Tversky,Daniel Kahneman +1 more
TL;DR: The psychological principles that govern the perception of decision problems and the evaluation of probabilities and outcomes produce predictable shifts of preference when the same problem is framed in different ways.
Journal ArticleDOI
Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data?
TL;DR: Findings indicate that MTurk can be used to obtain high-quality data inexpensively and rapidly and the data obtained are at least as reliable as those obtained via traditional methods.
Journal ArticleDOI
On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications.
TL;DR: In this paper, the authors focus on some of the qualities peculiar to psychological experiments and point out that the demand characteristics perceived in any particular experiment will vary with the sophistication, intelligence, and previous experience of each experimental subject.
Journal ArticleDOI
Extensional versus intuitive reasoning: The conjunction fallacy in probability judgment.
Amos Tversky,Daniel Kahneman +1 more
TL;DR: The conjunction rule as mentioned in this paper states that the probability of a conjunction cannot exceed the probabilities of its constituents, P (A) and P (B), because the extension (or the possibility set) of the conjunction is included in the extension of their constituents.
Journal ArticleDOI
Should we trust web-based studies? A comparative analysis of six preconceptions about internet questionnaires.
TL;DR: Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods and it is concluded that Internet methods can contribute to many areas of psychology.