TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences
Reads0
Chats0
TLDR
How TurkPrime saves time and resources, improves data quality, and allows researchers to design and implement studies that were previously very difficult or impossible to carry out on MTurk is described.Abstract:
In recent years, Mechanical Turk (MTurk) has revolutionized social science by providing a way to collect behavioral data with unprecedented speed and efficiency. However, MTurk was not intended to be a research tool, and many common research tasks are difficult and time-consuming to implement as a result. TurkPrime was designed as a research platform that integrates with MTurk and supports tasks that are common to the social and behavioral sciences. Like MTurk, TurkPrime is an Internet-based platform that runs on any browser and does not require any downloads or installation. Tasks that can be implemented with TurkPrime include: excluding participants on the basis of previous participation, longitudinal studies, making changes to a study while it is running, automating the approval process, increasing the speed of data collection, sending bulk e-mails and bonuses, enhancing communication with participants, monitoring dropout and engagement rates, providing enhanced sampling options, and many others. This article describes how TurkPrime saves time and resources, improves data quality, and allows researchers to design and implement studies that were previously very difficult or impossible to carry out on MTurk. TurkPrime is designed as a research tool whose aim is to improve the quality of the crowdsourcing data collection process. Various features have been and continue to be implemented on the basis of feedback from the research community. TurkPrime is a free research platform.read more
Citations
More filters
Journal ArticleDOI
Prolific.ac—A subject pool for online experiments
TL;DR: This article presents www.prolific.ac and lays out its suitability for recruiting subjects for social and economic science experiments, and traces the platform’s historical development, present its features, and contrast them with requirements for different types of social andEconomic experiments.
Journal ArticleDOI
Determinants of COVID-19 vaccine acceptance in the US.
TL;DR: There were noticeable demographic and geographical disparities in vaccine acceptance, and Black Americans reported lower influenza vaccine uptake and lower COVID-19 vaccine acceptance than all other racial groups reported in this study.
Journal ArticleDOI
Crowdsourcing consumer research
TL;DR: This tutorial assesses the evidence on the reliability of crowdsourced populations and the conditions under which crowdsourcing is a valid strategy for data collection, and proposes specific guidelines for researchers to conduct high-quality research via crowdsourcing.
Journal ArticleDOI
Food Insecurity and COVID-19: Disparities in Early Effects for US Adults.
Julia A. Wolfson,Cindy W. Leung +1 more
TL;DR: The early effects of the COVID-19 pandemic among low-income adults in the US as social distancing measures began to be implemented were understood, with a clear gradient effect based on severity of food security.
Journal ArticleDOI
How Many Participants Do We Have to Include in Properly Powered Experiments? A Tutorial of Power Analysis with Reference Tables.
TL;DR: In this article, the authors describe reference numbers needed for the designs most often used by psychologists, including single-variable between-groups and repeated-measures designs with two and three levels, two-factor designs involving two repeated measures and one repeated measure, and split-plot design.
References
More filters
Journal ArticleDOI
Amazon's Mechanical Turk A New Source of Inexpensive, Yet High-Quality, Data?
TL;DR: Findings indicate that MTurk can be used to obtain high-quality data inexpensively and rapidly and the data obtained are at least as reliable as those obtained via traditional methods.
Book
The WEIRDest People in the World
TL;DR: A review of the comparative database from across the behavioral sciences suggests both that there is substantial variability in experimental results across populations and that WEIRD subjects are particularly unusual compared with the rest of the species – frequent outliers.
Journal ArticleDOI
WEIRD languages have misled us, too [Comment on Henrich et al.]
Asifa Majid,Stephen C. Levinson +1 more
Running experiments on Amazon Mechanical Turk
TL;DR: The authors presented new demographic data about the Mechanical Turk subject population, reviewed the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects, and compared the magnitude of effects obtained using Mechanical Turk and traditional subject pools.