scispace - formally typeset
Proceedings ArticleDOI

Dynamo: amazon's highly available key-value store

TLDR
D Dynamo is presented, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience and makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.
Abstract
Reliability at massive scale is one of the biggest challenges we face at Amazon.com, one of the largest e-commerce operations in the world; even the slightest outage has significant financial consequences and impacts customer trust. The Amazon.com platform, which provides services for many web sites worldwide, is implemented on top of an infrastructure of tens of thousands of servers and network components located in many datacenters around the world. At this scale, small and large components fail continuously and the way persistent state is managed in the face of these failures drives the reliability and scalability of the software systems.This paper presents the design and implementation of Dynamo, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience. To achieve this level of availability, Dynamo sacrifices consistency under certain failure scenarios. It makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.

read more

Content maybe subject to copyright    Report

Citations
More filters
Book ChapterDOI

SCORe: a scalable one-copy serializable partial replication protocol

TL;DR: The experimental results demonstrate that SCORe provides stronger consistency guarantees (namely One-Copy Serializability) than existing multiversion partial replication protocols at no additional overhead.
Proceedings Article

The tail at store: a revelation from millions of hours of disk and SSD deployments

TL;DR: This work studies storage performance in over 450,000 disks and 4,000 SSDs over 87 days to find that the primary cause of slowdowns are the internal characteristics and idiosyncrasies of modern disk and SSD drives.
Proceedings ArticleDOI

Atlas: Baidu's key-value storage system for cloud data

TL;DR: A customized compact server design based on the ARM processors is adopted and three-copy replication for data protection with erasure coding is replaced to enable low-power and high-density storage supporting Baidu's cloud storage service.
Proceedings ArticleDOI

Performance Evaluation of NoSQL Databases: A Case Study

TL;DR: This paper presents a method and the results of a study that selected among three NoSQL databases for a large, distributed healthcare organization, and found that achieving strong consistency reduced throughput by 10-25% compared to eventual consistency.
Journal ArticleDOI

Crisis analytics: big data-driven crisis response

TL;DR: The history and the future of big crisis data analytics are introduced, along with a discussion on its promise, enabling technologies, challenges, and pitfalls.
References
More filters
Proceedings ArticleDOI

Chord: A scalable peer-to-peer lookup service for internet applications

TL;DR: Results from theoretical analysis, simulations, and experiments show that Chord is scalable, with communication cost and the state maintained by each node scaling logarithmically with the number of Chord nodes.
Book ChapterDOI

Time, clocks, and the ordering of events in a distributed system

TL;DR: In this paper, the concept of one event happening before another in a distributed system is examined, and a distributed algorithm is given for synchronizing a system of logical clocks which can be used to totally order the events.
Book ChapterDOI

Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems

TL;DR: Pastry as mentioned in this paper is a scalable, distributed object location and routing substrate for wide-area peer-to-peer ap- plications, which performs application-level routing and object location in a po- tentially very large overlay network of nodes connected via the Internet.
Journal ArticleDOI

Time, clocks, and the ordering of events in a distributed system

TL;DR: In this article, the concept of one event happening before another in a distributed system is examined, and a distributed algorithm is given for synchronizing a system of logical clocks which can be used to totally order the events.
Journal ArticleDOI

The Google file system

TL;DR: This paper presents file system interface extensions designed to support distributed applications, discusses many aspects of the design, and reports measurements from both micro-benchmarks and real world use.
Related Papers (5)
Trending Questions (1)
Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service

Amazon DynamoDB is a scalable and fully managed NoSQL database service provided by Amazon.