Open AccessPosted Content
The Future of Crowd Work
Aniket Kittur,Jeffrey V. Nickerson,Michael S. Bernstein,Elizabeth M. Gerber,Aaron Shaw,Aaron Shaw,John Zimmerman,Matthew Lease,John Horton +8 more
TLDR
In this paper, the authors outline a framework that will enable crowd work that is complex, collaborative, and sustainable, and lay out research challenges in twelve major areas: workflow, task assignment, hierarchy, real-time response, synchronous collaboration, quality control, crowds guiding AIs, AIs guiding crowds, platforms, job design, reputation, and motivation.Abstract:
Paid crowd work offers remarkable opportunities for improving productivity, social mobility, and the global economy by engaging a geographically distributed workforce to complete complex tasks on demand and at scale. But it is also possible that crowd work will fail to achieve its potential, focusing on assembly-line piecework. Can we foresee a future crowd workplace in which we would want our children to participate? This paper frames the major challenges that stand in the way of this goal. Drawing on theory from organizational behavior and distributed computing, as well as direct feedback from workers, we outline a framework that will enable crowd work that is complex, collaborative, and sustainable. The framework lays out research challenges in twelve major areas: workflow, task assignment, hierarchy, real-time response, synchronous collaboration, quality control, crowds guiding AIs, AIs guiding crowds, platforms, job design, reputation, and motivation.read more
Citations
More filters
Journal ArticleDOI
The rise of the 'just-in-time workforce': On-demand work, crowdwork and labour protection in the 'gig-economy'
TL;DR: In this paper, the authors discuss the implications of this commodification and advocate the full recognition of activities in the gig-economy as "work" and advocate for the formal recognition of work activities as activities.
Journal ArticleDOI
Algorithms at Work: The New Contested Terrain of Control
TL;DR: This work uses Edwards’ (1979) perspective of “conteste... to explore how algorithms may reshape organizational control in the rapidly changing environment.
Journal ArticleDOI
Peer and self assessment in massive online classes
Chinmay Kulkarni,Koh Pang Wei,Huy Viet Le,Daniel Chia,Kathryn Papadopoulos,Justin Cheng,Daphne Koller,Scott R. Klemmer +7 more
TL;DR: This article reports the experiences with two iterations of the first large online class to use peer and self-assessment, and finds that rubrics that use a parallel sentence structure, unambiguous wording, and well-specified dimensions have lower variance.
Proceedings ArticleDOI
Being a turker
TL;DR: An ethnomethodological analysis of publicly available content on Turker Nation, a general forum for Amazon Mechanical Turk (AMT) users, provides novel depth and detail on how theTurker Nation members operate as economic actors, working out which Requesters and jobs are worthwhile to them.
Proceedings ArticleDOI
We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers
Niloufar Salehi,Lilly Irani,Michael S. Bernstein,Ali Alkhatib,Eva Ogbe,Kristy Milland,Clickhappier +6 more
TL;DR: Dynamo, a platform to support the Mechanical Turk community in forming publics around issues and then mobilizing, finds that collective action publics tread a precariously narrow path between the twin perils of stalling and friction, balancing with each step between losing momentum and flaring into acrimony.
References
More filters
Journal ArticleDOI
MapReduce: simplified data processing on large clusters
Jeffrey Dean,Sanjay Ghemawat +1 more
TL;DR: This paper presents the implementation of MapReduce, a programming model and an associated implementation for processing and generating large data sets that runs on a large cluster of commodity machines and is highly scalable.
Journal Article
The Anatomy of a Large-Scale Hypertextual Web Search Engine.
Sergey Brin,Lawrence Page +1 more
TL;DR: Google as discussed by the authors is a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext and is designed to crawl and index the Web efficiently and produce much more satisfying search results than existing systems.
Journal ArticleDOI
Dilemmas in a general theory of planning
TL;DR: The search for scientific bases for confronting problems of social policy is bound to fail, becuase of the nature of these problems as discussed by the authors, whereas science has developed to deal with tame problems.
Journal ArticleDOI
Motivation through the Design of Work: Test of a Theory.
TL;DR: In this paper, a model is proposed that specifies the conditions under which individuals will become internally motivated to perform effectively on their jobs, focusing on the interaction among three classes of variables: (a) the psychological states of employees that must be present for internally motivated work behavior to develop; (b) the characteristics of jobs that can create these psychological states; and (c) the attributes of individuals that determine how positively a person will respond to a complex and challenging job.