Journal ArticleDOI
Cassandra: a decentralized structured storage system
Avinash Lakshman,Prashant Malik +1 more
TLDR
Cassandra is a distributed storage system for managing very large amounts of structured data spread out across many commodity servers, while providing highly available service with no single point of failure.Abstract:
Cassandra is a distributed storage system for managing very large amounts of structured data spread out across many commodity servers, while providing highly available service with no single point of failure. Cassandra aims to run on top of an infrastructure of hundreds of nodes (possibly spread across different data centers). At this scale, small and large components fail continuously. The way Cassandra manages the persistent state in the face of these failures drives the reliability and scalability of the software systems relying on this service. While in many ways Cassandra resembles a database and shares many design and implementation strategies therewith, Cassandra does not support a full relational data model; instead, it provides clients with a simple data model that supports dynamic control over data layout and format. Cassandra system was designed to run on cheap commodity hardware and handle high write throughput while not sacrificing read efficiency.read more
Citations
More filters
Journal ArticleDOI
Solving big data challenges for enterprise application performance management
Tilmann Rabl,Sergio Gómez-Villamor,Mohammad Sadoghi,Victor Muntés-Mulero,Hans-Arno Jacobsen,Serge Mankovskii +5 more
TL;DR: In this article, the authors present their experience and a comprehensive performance evaluation of six modern (Open-source) data stores in the context of application performance monitoring as part of CA Technologies initiative.
Proceedings Article
Serverless computation with openLambda
Scott Hendrickson,Stephen Sturdevant,Tyler Harter,Venkateshwaran Venkataramani,Andrea C. Arpaci-Dusseau,Remzi H. Arpaci-Dusseau +5 more
TL;DR: OpenLambda as mentioned in this paper is an open-source platform for building next-generation web services and applications in the burgeoning model of serverless computation, and describes the key aspects and challenges that must be addressed in the design and implementation of such systems.
Patent
Method and system for implementing a maintenance service for managing I/O and storage for a virtualization environment
TL;DR: In this article, a curator entity is provided on a distributed basis to manage and perform these functions, and a master curator manages this workload that is performed by multiple slave curators.
Journal ArticleDOI
Samza: stateful scalable stream processing at LinkedIn
Shadi A. Noghabi,Kartik Paramasivam,Yi Pan,Navina Ramesh,Jon Bringhurst,Indranil Gupta,Roy H. Campbell +6 more
TL;DR: The experiments show that Samza handles state efficiently, improving latency and throughput by more than 100X compared to using a remote storage; provides recovery time independent of state size; scales performance linearly with number of containers; and supports reprocessing of the data stream quickly and with minimal interference on real-time traffic.
Proceedings ArticleDOI
Bolt-on causal consistency
TL;DR: This work considers the problem of separating consistency-related safety properties from availability and durability in distributed data stores via the application of a "bolt-on" shim layer that upgrades the safety of an underlying general-purpose data store.
References
More filters
Journal ArticleDOI
MapReduce: simplified data processing on large clusters
Jeffrey Dean,Sanjay Ghemawat +1 more
TL;DR: This paper presents the implementation of MapReduce, a programming model and an associated implementation for processing and generating large data sets that runs on a large cluster of commodity machines and is highly scalable.
Journal ArticleDOI
MapReduce: simplified data processing on large clusters
Jeffrey Dean,Sanjay Ghemawat +1 more
TL;DR: This presentation explains how the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks.
Proceedings ArticleDOI
Chord: A scalable peer-to-peer lookup service for internet applications
TL;DR: Results from theoretical analysis, simulations, and experiments show that Chord is scalable, with communication cost and the state maintained by each node scaling logarithmically with the number of Chord nodes.
Journal ArticleDOI
The Google file system
TL;DR: This paper presents file system interface extensions designed to support distributed applications, discusses many aspects of the design, and reports measurements from both micro-benchmarks and real world use.
Proceedings Article
Bigtable: A Distributed Storage System for Structured Data (Awarded Best Paper!).
Fay W. Chang,Jeffrey Dean,Sanjay Ghemawat,Wilson C. Hsieh,Deborah A. Wallach,Michael Burrows,Tushar Deepak Chandra,Andrew Fikes,Robert Gruber +8 more
TL;DR: Bigtable as mentioned in this paper is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers, including web indexing, Google Earth and Google Finance.