Journal ArticleDOI
The New Reality of Reproducibility: The Role of Data Work in Scientific Research
Melanie Feinberg,Will Sutherland,Sarah Beth Nelson,Mohammad Hossein Jarrahi,Arcot Rajasekar +4 more
- Vol. 4, pp 1-22
TLDR
It is suggested that the introduction of data-related activities promotes a new understanding of reproducibility as a mechanism for local knowledge transfer and collaboration, particularly as regards efficient software reuse.Abstract:
Although reproducibility--the idea that a valid scientific experiment can be repeated with similar results--is integral to our understanding of good scientific practice, it has remained a difficult concept to define precisely. Across scientific disciplines, the increasing prevalence of large datasets, and the computational techniques necessary to manage and analyze those datasets, has prompted new ways of thinking about reproducibility. We present findings from a qualitative study of a NSF--funded two-week workshop developed to introduce an interdisciplinary group of domain scientists to data-management techniques for data-intensive computing, with a focus on reproducible science. Our findings suggest that the introduction of data-related activities promotes a new understanding of reproducibility as a mechanism for local knowledge transfer and collaboration, particularly as regards efficient software reuse.read more
Citations
More filters
Posted Content
Scientific Data Management in the Coming Decade
Jim Gray,David T. Liu,Maria Nieto-Santisteban,Alexander S. Szalay,David J. DeWitt,Gerd Heber +5 more
TL;DR: Analyzing this data to find the subtle effects missed by previous studies requires algorithms that can simultaneously deal with huge datasets and that can find very subtle effects --- finding both needles in the haystack and finding very small haystacks that were undetected in previous measurements.
Big data, little data, no data : scholarship in the networkedworld
TL;DR: Borgman as discussed by the authors argues that data have no value or meaning in isolation; they exist within a knowledge infrastructure, an ecology of people, practices, technologies, institutions, material objects, and relationships.
Posted Content
What Drives Academic Data Sharing
TL;DR: In this article, the authors developed a conceptual framework that explains the process of data sharing from the primary researcher's point of view, which can be divided into six descriptive categories: data donor, research organization, research community, norms, data infrastructure, and data recipients.
Journal ArticleDOI
Big Data, Little Data, No Data: Scholarship in the Networked World
TL;DR: Their goal is always to offer you an assortment of cost-free ebooks too as aid resolve your troubles and the authors have got a considerable collection of totally free of expense Book for people from every single stroll of life.
Posted Content
Replication in Social Science
Jeremy Freese,David Peterson +1 more
TL;DR: A sociologically sophisticated understanding of replication must take into account both the ways that replication rules and conventions evolved within an epistemic culture and how those cultures are shaped by specific research challenges.
References
More filters
Book
Constructing grounded theory
TL;DR: An Invitation to Grounded Theory Gathering Rich Data Crafting and Conducting Intensive Interviews Interviewing in Grounded theory Studies The logic of grounded theory Coding Practices and Initial Coding Focused Coding and beyond Memo-Writing Theoretical Sampling, Saturation and Sorting Reconstructing theory in grounded theories as mentioned in this paper.
Journal ArticleDOI
Estimating the reproducibility of psychological science
Alexander A. Aarts,Joanna E. Anderson,Christopher J. Anderson,Peter Raymond Attridge,Peter Raymond Attridge,Angela S. Attwood,Jordan Axt,Molly Babel,Štěpán Bahník,Erica Baranski,Michael Barnett-Cowan,Elizabeth Bartmess,Jennifer S. Beer,Raoul Bell,Heather Bentley,Leah Beyan,Grace Binion,Grace Binion,Denny Borsboom,Annick Bosch,Frank A. Bosco,Sara Bowman,Mark J. Brandt,Erin L Braswell,Hilmar Brohmer,Benjamin T. Brown,Kristina G. Brown,Jovita Brüning,Jovita Brüning,Ann Calhoun-Sauls,Shannon P. Callahan,Elizabeth Chagnon,Jesse Chandler,Jesse Chandler,Christopher R. Chartier,Felix Cheung,Felix Cheung,Cody D. Christopherson,Linda Cillessen,Russ Clay,Hayley M. D. Cleary,Mark D. Cloud,Michael Conn,Johanna Cohoon,Simon Columbus,Andreas Cordes,Giulio Costantini,Leslie Cramblet Alvarez,Ed Cremata,Jan Crusius,Jamie DeCoster,Michelle A. DeGaetano,Nicolás Delia Penna,Bobby Den Bezemer,Marie K. Deserno,Olivia Devitt,Laura Dewitte,David G. Dobolyi,Geneva T. Dodson,M. Brent Donnellan,Ryan Donohue,Rebecca A. Dore,Angela Rachael Dorrough,Angela Rachael Dorrough,Anna Dreber,Michelle Dugas,Elizabeth W. Dunn,Kayleigh E Easey,Sylvia Eboigbe,Casey Eggleston,Jo Embley,Sacha Epskamp,Timothy M. Errington,Vivien Estel,Frank J. Farach,Jenelle Feather,Anna Fedor,Belén Fernández-Castilla,Susann Fiedler,James G. Field,Stanka A. Fitneva,Taru Flagan,Amanda L. Forest,Eskil Forsell,Joshua D. Foster,Michael C. Frank,Rebecca S. Frazier,Heather M. Fuchs,Philip A. Gable,Jeff Galak,Elisa Maria Galliani,Anup Gampa,Sara García,Douglas Gazarian,Elizabeth Gilbert,Roger Giner-Sorolla,Andreas Glöckner,Andreas Glöckner,Lars Goellner,Jin X. Goh,Rebecca M. Goldberg,Patrick T. Goodbourn,Shauna Gordon-McKeon,Bryan Gorges,Jessie Gorges,Justin Goss,Jesse Graham,James A. Grange,Jeremy R. Gray,Chris H.J. Hartgerink,Joshua K. Hartshorne,Fred Hasselman,Timothy Hayes,Emma Heikensten,Felix Henninger,Felix Henninger,John Hodsoll,Taylor Holubar,Gea Hoogendoorn,Denise J. Humphries,Cathy On-Ying Hung,Nathali Immelman,Vanessa C. Irsik,Georg Jahn,Frank Jäkel,Marc Jekel,Magnus Johannesson,Larissa Gabrielle Johnson,David J. Johnson,Kate M. Johnson,William J. Johnston,Kai J. Jonas,Jennifer A. Joy-Gaba,Heather Barry Kappes,Kim Kelso,Mallory C. Kidwell,Seung K. Kim,Matthew W. Kirkhart,Bennett Kleinberg,Bennett Kleinberg,Goran Knežević,Franziska Maria Kolorz,Jolanda J. Kossakowski,Robert Krause,Job Krijnen,Tim Kuhlmann,Yoram K. Kunkels,Megan M. Kyc,Calvin K. Lai,Aamir Laique,Daniel Lakens,Kristin A. Lane,Bethany Lassetter,Ljiljana B. Lazarević,Etienne P. Le Bel,Key Jung Lee,Minha Lee,Kristi M. Lemm,Carmel A. Levitan,Melissa Lewis,Lin Lin,Stephanie C. Lin,Matthias Lippold,Darren Loureiro,Ilse Luteijn,Sean P. Mackinnon,Heather N. Mainard,Denise C. Marigold,Daniel P. Martin,Tylar Martinez,E. J. Masicampo,Joshua J. Matacotta,Maya B. Mathur,Michael May,Michael May,Nicole Mechin,Pranjal H. Mehta,Johannes M. Meixner,Johannes M. Meixner,Alissa Melinger,Jeremy K. Miller,Mallorie Miller,Katherine Moore,Katherine Moore,Marcus Möschl,Matt Motyl,Stephanie M. Müller,Marcus R. Munafò,Koen Ilja Neijenhuijs,Taylor Nervi,Gandalf Nicolas,Gustav Nilsonne,Gustav Nilsonne,Brian A. Nosek,Brian A. Nosek,Michèle B. Nuijten,Catherine Olsson,Catherine Olsson,Colleen Osborne,Lutz Ostkamp,Misha Pavel,Ian S. Penton-Voak,Olivia Perna,Cyril Pernet,Marco Perugini,R. Nathan Pipitone,Michael C. Pitts,Franziska Plessow,Franziska Plessow,Jason M. Prenoveau,Rima-Maria Rahal,Rima-Maria Rahal,Kate A. Ratliff,David Reinhard,Frank Renkewitz,Ashley A. Ricker,Anastasia E. Rigney,Andrew M Rivers,Mark A. Roebke,Abraham M. Rutchick,Robert S. Ryan,Onur Sahin,Anondah R. Saide,Gillian M. Sandstrom,David Santos,David Santos,Rebecca Saxe,René Schlegelmilch,René Schlegelmilch,Kathleen Schmidt,Sabine Scholz,Larissa Seibel,Dylan Selterman,Samuel Shaki,William B. Simpson,H. Colleen Sinclair,Jeanine L. M. Skorinko,Agnieszka Slowik,Joel S. Snyder,Courtney K. Soderberg,Carina Sonnleitner,Nick Spencer,Jeffrey R. Spies,Sara Steegen,Stefan Stieger,Nina Strohminger,Gavin Brent Sullivan,Thomas Talhelm,Megan Tapia,Anniek M. te Dorsthorst,Manuela Thomae,Manuela Thomae,Sarah L. Thomas,Pia Tio,Frits Traets,Steve N.H. Tsang,Francis Tuerlinckx,Paul J. Turchan,Milan Valášek,Anna E. Van't Veer,Robbie C. M. van Aert,Marcel A.L.M. van Assen,Riet van Bork,Mathijs Van De Ven,Don van den Bergh,Marije van der Hulst,Roel van Dooren,Johnny van Doorn,Daan R. van Renswoude,Hedderik van Rijn,Wolf Vanpaemel,Alejandro Vásquez Echeverría,Melissa Vazquez,Natalia Vélez,Marieke Vermue,Mark Verschoor,Michelangelo Vianello,Martin Voracek,Gina Vuu,Eric-Jan Wagenmakers,Joanneke Weerdmeester,Ashlee Welsh,Erin C. Westgate,Joeri Wissink,Michael J. Wood,Andy T. Woods,Andy T. Woods,Emily M. Wright,Sining Wu,Marcel Zeelenberg,Kellylynn Zuni +290 more
TL;DR: A large-scale assessment suggests that experimental reproducibility in psychology leaves a lot to be desired, and correlational tests suggest that replication success was better predicted by the strength of original evidence than by characteristics of the original and replication teams.
Book
The Fourth Paradigm: Data-Intensive Scientific Discovery
TL;DR: This presentation will set out the eScience agenda by explaining the current scientific data deluge and the case for a “Fourth Paradigm” for scientific exploration.
Journal ArticleDOI
Promoting an open research culture
Brian A. Nosek,George Alter,George C. Banks,Denny Borsboom,Sara Bowman,Steven J. Breckler,Stuart Buck,Christopher D. Chambers,G. Chin,Garret Christensen,M. Contestabile,Allan Dafoe,E. Eich,Jeremy Freese,Rachel Glennerster,D. Goroff,Donald P. Green,Bradford W. Hesse,Macartan Humphreys,John Ishiyama,Dean Karlan,A. Kraut,Arthur Lupia,Patricia L. Mabry,Temina Madon,Neil Malhotra,Evan Mayo-Wilson,Marcia McNutt,Edward Miguel,E. Levy Paluck,Uri Simonsohn,Courtney K. Soderberg,Barbara A. Spellman,J. Turitto,G. VandenBos,Simine Vazire,Eric-Jan Wagenmakers,Rick K. Wilson,Tal Yarkoni +38 more
TL;DR: A growing body of evidence suggests that transparency, openness, and reproducibility are vital features of science as discussed by the authors, and most scientists embrace these features as disciplinary norms and values when asked, therefore, one might expect that these valued features would be routine in daily practice.
Book
Ethnography through thick and thin
TL;DR: In this article, an evolving proposal for multi-sited research is presented, and traces in parallel Ethnographic projects are traced in Parallel Ethnography Projects and Power on the Extreme Periphery: The Perspective of Tongan Elites in the Modern World System.
Related Papers (5)
“Reproducible” Research in Mathematical Sciences Requires Changes in our Peer Review Culture and Modernization of our Current Publication Approach
Validity of machine learning in biology and medicine increased through collaborations across fields of expertise
Maria Littmann,Katharina Selig,Liel Cohen-Lavi,Yotam Frank,Peter Hönigschmid,Evans Kataka,Anja Mösch,Kun Qian,Kun Qian,Avihai Ron,Sebastian Schmid,Adam Sorbie,Liran Szlak,Ayana Dagan-Wiener,Nir Ben-Tal,Masha Y. Niv,Daniel Razansky,Björn Schuller,Donna P. Ankerst,Tomer Hertz,Tomer Hertz,Burkhard Rost +21 more