Proceedings ArticleDOI
Squall: Fine-Grained Live Reconfiguration for Partitioned Main Memory Databases
Aaron J. Elmore,Vaibhav Arora,Rebecca Taft,Andrew Pavlo,Divyakant Agrawal,Amr El Abbadi +5 more
- pp 299-313
Reads0
Chats0
TLDR
The Squall technique for supporting live reconfiguration in partitioned, main memory DBMSs supports fine-grained repartitioning of databases in the presence of distributed transactions, high throughput client workloads, and replicated data.Abstract:
For data-intensive applications with many concurrent users, modern distributed main memory database management systems (DBMS) provide the necessary scale-out support beyond what is possible with single-node systems. These DBMSs are optimized for the short-lived transactions that are common in on-line transaction processing (OLTP) workloads. One way that they achieve this is to partition the database into disjoint subsets and use a single-threaded transaction manager per partition that executes transactions one-at-a-time in serial order. This minimizes the overhead of concurrency control mechanisms, but requires careful partitioning to limit distributed transactions that span multiple partitions. Previous methods used off-line analysis to determine how to partition data, but the dynamic nature of these applications means that they are prone to hotspots. In these situations, the DBMS needs to reconfigure how data is partitioned in real-time to maintain performance objectives. Bringing the system off-line to reorganize the database is unacceptable for on-line applications. To overcome this problem, we introduce the Squall technique for supporting live reconfiguration in partitioned, main memory DBMSs. Squall supports fine-grained repartitioning of databases in the presence of distributed transactions, high throughput client workloads, and replicated data. An evaluation of our approach on a distributed DBMS shows that Squall can reconfigure a database with no downtime and minimal overhead on transaction latency.read more
Citations
More filters
Journal ArticleDOI
The end of slow networks: it's time for a redesign
TL;DR: In this article, the authors argue that traditional distributed DBMS architectures cannot take full advantage of high-performance networks and suggest a new architecture to address this problem, and discuss initial results from a prototype implementation of their proposed architecture for OLTP and OLAP, showing remarkable performance improvements over existing designs.
Journal ArticleDOI
What's Really New with NewSQL?
Andrew Pavlo,Matthew Aslett +1 more
TL;DR: The history of databases is discussed to understand how NewSQL systems came about and a detailed explanation of what the term NewSQL means and the different categories of systems that fall under this definition is provided.
Posted Content
The End of Slow Networks: It's Time for a Redesign
TL;DR: It is argued that traditional distributed DBMS architectures cannot take full advantage of high-performance networks and a new architecture to address this problem is suggested, and initial results from a prototype implementation of the proposed architecture for OLTP and OLAP are discussed.
Journal ArticleDOI
Clay: fine-grained adaptive partitioning for general database schemas
Marco Serafini,Rebecca Taft,Aaron J. Elmore,Andrew Pavlo,Ashraf Aboulnaga,Michael Stonebraker +5 more
TL;DR: A new on-line partitioning approach, called Clay, that supports both tree-based schemas and more complex "general" schemas with arbitrary foreign key relationships is presented and it is shown that it can generate partitioning schemes that enable the system to achieve up to 15× better throughput and 99% lower latency than existing approaches.
Proceedings ArticleDOI
Towards a Non-2PC Transaction Management in Distributed Database Systems
TL;DR: Results of an extensive experimental evaluation show that the LEAP-based engines are superior over H-Store by a wide margin, especially for workloads that exhibit locality-based data accesses.
References
More filters
Journal ArticleDOI
A view of cloud computing
Michael Armbrust,Armando Fox,Rean Griffith,Anthony D. Joseph,Randy H. Katz,Andy Konwinski,Gunho Lee,David A. Patterson,Ariel Rabkin,Ion Stoica,Matei Zaharia +10 more
TL;DR: The clouds are clearing the clouds away from the true potential and obstacles posed by this computing capability.
Proceedings ArticleDOI
Benchmarking cloud serving systems with YCSB
TL;DR: This work presents the "Yahoo! Cloud Serving Benchmark" (YCSB) framework, with the goal of facilitating performance comparisons of the new generation of cloud data serving systems, and defines a core set of benchmarks and reports results for four widely used systems.
Proceedings ArticleDOI
Live migration of virtual machines
Christopher Clark,Keir Fraser,Steven Hand,Jacob Gorm Hansen,Eric Jul,Christian Limpach,Ian Pratt,Andrew Warfield +7 more
TL;DR: The design options for migrating OSes running services with liveness constraints are considered, the concept of writable working set is introduced, and the design, implementation and evaluation of high-performance OS migration built on top of the Xen VMM are presented.
Journal ArticleDOI
Parallel database systems: the future of high performance database systems
David J. DeWitt,Jim Gray +1 more
Journal ArticleDOI
Scalable SQL and NoSQL data stores
TL;DR: This paper examines a number of SQL and socalled "NoSQL" data stores designed to scale simple OLTP-style application loads over many servers, and contrasts the new systems on their data model, consistency mechanisms, storage mechanisms, durability guarantees, availability, query support, and other dimensions.