Proceedings ArticleDOI
Dynamo: amazon's highly available key-value store
Giuseppe deCandia,Deniz Hastorun,Madan Mohan Rao Jampani,Gunavardhan Kakulapati,Avinash Lakshman,Alex Pilchin,Swaminathan Sivasubramanian,Peter Sven Vosshall,Werner Vogels +8 more
- Vol. 41, Iss: 6, pp 205-220
TLDR
D Dynamo is presented, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience and makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.Abstract:
Reliability at massive scale is one of the biggest challenges we face at Amazon.com, one of the largest e-commerce operations in the world; even the slightest outage has significant financial consequences and impacts customer trust. The Amazon.com platform, which provides services for many web sites worldwide, is implemented on top of an infrastructure of tens of thousands of servers and network components located in many datacenters around the world. At this scale, small and large components fail continuously and the way persistent state is managed in the face of these failures drives the reliability and scalability of the software systems.This paper presents the design and implementation of Dynamo, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience. To achieve this level of availability, Dynamo sacrifices consistency under certain failure scenarios. It makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.read more
Citations
More filters
Journal ArticleDOI
ASTERIX: towards a scalable, semistructured data platform for evolving-world models
Alexander Behm,Vinayak Borkar,Michael J. Carey,Raman Grover,Chen Li,Nicola Onose,Rares Vernica,Alin Deutsch,Yannis Papakonstantinou,Vassilis J. Tsotras +9 more
TL;DR: This paper provides an overview of the ASTERIX project, starting with its main goal—the storage and analysis of data pertaining to evolving-world models, and describes the requirements and associated challenges, and how the project is addressing them.
Proceedings Article
Zeno: eventually consistent Byzantine-fault tolerance
TL;DR: A novel BFT state machine replication protocol called Zeno that trades consistency for higher availability and replaces strong consistency with a weaker guarantee (eventual consistency): clients can temporarily miss each other's updates but when the network is stable the states from the individual partitions are merged by having the replicas agree on a total order for all requests.
Journal ArticleDOI
The little engine(s) that could: scaling online social networks
Josep M. Pujol,Vijay Erramilli,Georgos Siganos,Xiaoyuan Yang,Nikolaos Laoutaris,Parminder Chhabra,Pablo Rodriguez +6 more
TL;DR: It is shown that SPAR incurs minimum overhead, can help a well-known Twitter clone reach Twitter's scale without changing a line of its application logic, and achieves higher throughput than Cassandra, a popular key-value store database.
Journal ArticleDOI
The byzantine empire in the intercloud
TL;DR: This paper starts from commonly acknowledged issues that impede the adoption of Byzantine fault tolerance within a single cloud, and argues that many of these issues fade when Byzantine faultolerance in the Intercloud is considered.
Journal ArticleDOI
Big data for development: applications and techniques
Anwaar Ali,Junaid Qadir,Raihan Ur Rasool,Raihan Ur Rasool,Arjuna Sathiaseelan,Andrej Zwitter,Jon Crowcroft +6 more
TL;DR: In this paper, the authors provide a review of existing BD4D work to study the impact of big data on the development of society and highlight important challenges and open issues, including efficient data acquisition and sharing, establishing of context and veracity of a dataset, and ensuring appropriate privacy.
References
More filters
Proceedings ArticleDOI
Chord: A scalable peer-to-peer lookup service for internet applications
TL;DR: Results from theoretical analysis, simulations, and experiments show that Chord is scalable, with communication cost and the state maintained by each node scaling logarithmically with the number of Chord nodes.
Book ChapterDOI
Time, clocks, and the ordering of events in a distributed system
TL;DR: In this paper, the concept of one event happening before another in a distributed system is examined, and a distributed algorithm is given for synchronizing a system of logical clocks which can be used to totally order the events.
Book ChapterDOI
Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
Antony Rowstron,Peter Druschel +1 more
TL;DR: Pastry as mentioned in this paper is a scalable, distributed object location and routing substrate for wide-area peer-to-peer ap- plications, which performs application-level routing and object location in a po- tentially very large overlay network of nodes connected via the Internet.
Journal ArticleDOI
Time, clocks, and the ordering of events in a distributed system
TL;DR: In this article, the concept of one event happening before another in a distributed system is examined, and a distributed algorithm is given for synchronizing a system of logical clocks which can be used to totally order the events.
Journal ArticleDOI
The Google file system
TL;DR: This paper presents file system interface extensions designed to support distributed applications, discusses many aspects of the design, and reports measurements from both micro-benchmarks and real world use.