Open AccessJournal Article
MLlib: machine learning in apache spark
Xiangrui Meng,Joseph K. Bradley,Burak Yavuz,Evan R. Sparks,Shivaram Venkataraman,Davies Liu,Jeremy Freeman,DB Tsai,Manish Amde,Sean Owen,Doris Xin,Reynold Xin,Michael J. Franklin,Reza Bosagh Zadeh,Matei Zaharia,Ameet Talwalkar +15 more
Reads0
Chats0
TLDR
MLlib as mentioned in this paper is an open-source distributed machine learning library for Apache Spark that provides efficient functionality for a wide range of learning settings and includes several underlying statistical, optimization, and linear algebra primitives.Abstract:
Apache Spark is a popular open-source platform for large-scale data processing that is well-suited for iterative machine learning tasks. In this paper we present MLlib, Spark's open-source distributed machine learning library. MLLIB provides efficient functionality for a wide range of learning settings and includes several underlying statistical, optimization, and linear algebra primitives. Shipped with Spark, MLLIB supports several languages and provides a high-level API that leverages Spark's rich ecosystem to simplify the development of end-to-end machine learning pipelines. MLLIB has experienced a rapid growth due to its vibrant open-source community of over 140 contributors, and includes extensive documentation to support further growth and to let users quickly get up to speed.read more
Citations
More filters
Journal ArticleDOI
IoT data analytics architecture for smart healthcare using RFID and WSN
TL;DR: New real‐time data analytics architecture for an IoT‐based smart healthcare system, which consists of a wireless sensor network and a radio‐frequency identification technology in a vertical domain and can handle large volumes of data, is introduced.
Posted Content
Vamsa: Tracking Provenance in Data Science Scripts.
Mohammad Hossein Namaki,Avrilia Floratou,Fotis Psallidas,Subru Krishnan,Ashvin Agrawal,Yinghui Wu +5 more
TL;DR: Vamsa, a modular system that extracts provenance from Python scripts without requiring any changes to the user's code is presented, using up to 450K real-world data science scripts from Kaggle and publicly available Python notebooks.
Journal ArticleDOI
Top Data Mining Tools for the Healthcare Industry
TL;DR: A survey of popular open-source data mining tools in which data mining tool selection criteria based on healthcare application requirements is proposed and the best ones using the proposed selection criteria are identified.
Book ChapterDOI
Actionable Pattern Discovery for Tweet Emotions
TL;DR: This work focuses on extracting Action Rules with respect to the Emotion class from user tweets, which discovers actionable recommendations, which suggests ways to alter the user’s emotion to a better or more positive state.
Book ChapterDOI
ADABench - Towards an Industry Standard Benchmark for Advanced Analytics
Tilmann Rabl,Christoph Brücke,Philipp Härtling,Stella Stars,Rodrigo Escobar Palacios,Hamesh Patel,Satyam Srivastava,Christoph Boden,Jens Meiners,Sebastian Schelter +9 more
TL;DR: The digital revolution, rapidly decreasing storage cost, and remarkable results achieved by state of the art machine learning methods are driving widespread adoption of ML approaches.
References
More filters
Journal Article
Scikit-learn: Machine Learning in Python
Fabian Pedregosa,Gaël Varoquaux,Alexandre Gramfort,Vincent Michel,Bertrand Thirion,Olivier Grisel,Mathieu Blondel,Peter Prettenhofer,Ron Weiss,Vincent Dubourg,Jake Vanderplas,Alexandre Passos,David Cournapeau,Matthieu Brucher,Matthieu Perrot,Edouard Duchesnay +15 more
TL;DR: Scikit-learn is a Python module integrating a wide range of state-of-the-art machine learning algorithms for medium-scale supervised and unsupervised problems, focusing on bringing machine learning to non-specialists using a general-purpose high-level language.
Journal ArticleDOI
Latent dirichlet allocation
TL;DR: This work proposes a generative model for text and other collections of discrete data that generalizes or improves on several previous models including naive Bayes/unigram, mixture of unigrams, and Hofmann's aspect model.
Posted Content
Scikit-learn: Machine Learning in Python
Fabian Pedregosa,Gaël Varoquaux,Alexandre Gramfort,Vincent Michel,Bertrand Thirion,Olivier Grisel,Mathieu Blondel,Andreas Müller,Joel Nothman,Gilles Louppe,Peter Prettenhofer,Ron Weiss,Vincent Dubourg,Jake Vanderplas,Alexandre Passos,David Cournapeau,Matthieu Brucher,Matthieu Perrot,Edouard Duchesnay +18 more
TL;DR: Scikit-learn as mentioned in this paper is a Python module integrating a wide range of state-of-the-art machine learning algorithms for medium-scale supervised and unsupervised problems.
Proceedings Article
Latent Dirichlet Allocation
TL;DR: This paper proposed a generative model for text and other collections of discrete data that generalizes or improves on several previous models including naive Bayes/unigram, mixture of unigrams, and Hof-mann's aspect model, also known as probabilistic latent semantic indexing (pLSI).
Journal ArticleDOI
MapReduce: simplified data processing on large clusters
Jeffrey Dean,Sanjay Ghemawat +1 more
TL;DR: This paper presents the implementation of MapReduce, a programming model and an associated implementation for processing and generating large data sets that runs on a large cluster of commodity machines and is highly scalable.