Journal ArticleDOI
VL2: a scalable and flexible data center network
Albert Greenberg,James R. Hamilton,Navendu Jain,Srikanth Kandula,Changhoon Kim,Parantap Lahiri,David A. Maltz,Parveen Patel,Sudipta Sengupta +8 more
TLDR
VL2 is a practical network architecture that scales to support huge data centers with uniform high capacity between servers, performance isolation between services, and Ethernet layer-2 semantics and can be deployed today, and a working prototype is built.Abstract:
To be agile and cost effective, data centers must allow dynamic resource allocation across large server pools. In particular, the data center network should provide a simple flat abstraction: it should be able to take any set of servers anywhere in the data center and give them the illusion that they are plugged into a physically separate, noninterfering Ethernet switch with as many ports as the service needs. To meet this goal, we present VL2, a practical network architecture that scales to support huge data centers with uniform high capacity between servers, performance isolation between services, and Ethernet layer-2 semantics. VL2 uses (1) flat addressing to allow service instances to be placed anywhere in the network, (2) Valiant Load Balancing to spread traffic uniformly across network paths, and (3) end system--based address resolution to scale to large server pools without introducing complexity to the network control plane. VL2's design is driven by detailed measurements of traffic and fault data from a large operational cloud service provider. VL2's implementation leverages proven network technologies, already available at low cost in high-speed hardware implementations, to build a scalable and reliable network architecture. As a result, VL2 networks can be deployed today, and we have built a working prototype. We evaluate the merits of the VL2 design using measurement, analysis, and experiments. Our VL2 prototype shuffles 2.7 TB of data among 75 servers in 395 s---sustaining a rate that is 94% of the maximum possible.read more
Citations
More filters
Proceedings ArticleDOI
A theoretical framework for mitigating delay in 3D wireless data center networks
Kai Zhou,Xiaohua Tian,Yu Cheng +2 more
TL;DR: A theoretical framework for 3D DCNs where the entire network is first transformed from 3D to 2D by remodeling the 3D interference effects, and modeled as a minimum job completion time (MJCT) problem, where the optimal traffic engineering, channel allocation and scheduling schemes in the original DCN can be obtained.
Journal ArticleDOI
An Introduction to the Compute Express Link (CXL) Interconnect
TL;DR: The Compute Express Link (CXL) as discussed by the authors is an open industry-standard interconnect between processors and devices such as accelerators, memory buffers, smart network interfaces, persistent memory, and solid-state drives.
SlimeMold: Hardware Load Balancer at Scale in Datacenter
Ziyuan Liu,Zhixiong Niu,Ran Shu,Guohong Lai,Jacob Nelson,Dan R. K. Ports,Lihua Yuan,Peng Cheng,Yongqiang Xiong +8 more
TL;DR: SlimeMold as mentioned in this paper enables HLBs to work collaboratively at scale as an integrated load balancing system in data centers, which achieves line rate for state read and > 1M OPS for flow write operations.
Journal ArticleDOI
Implementation and Experimental Evaluation of Flow Diffusion Algorithms for Folded Clos Networks
Satoru Ohta,Daichi Miyamoto +1 more
TL;DR: In this paper , the authors demonstrate the implementation of the rebalancing algorithm on switches built on PCs using software tools supported by the Linux OS, and show that it is relatively easy to implement the algorithm and compared with that of its simplified version, called the balancing algorithm, as well as a conventional method.
Proceedings ArticleDOI
Deadline-aware envy-free admission control in shared datacenter networks
TL;DR: This paper presents an admission control mechanism to work with a deadline-aware transport protocol, and proposes a greedy algorithm for the problem in the mechanism, which can easily adopt a batch processing method to mitigate the incurred overhead.
References
More filters
Journal ArticleDOI
MapReduce: simplified data processing on large clusters
Jeffrey Dean,Sanjay Ghemawat +1 more
TL;DR: This paper presents the implementation of MapReduce, a programming model and an associated implementation for processing and generating large data sets that runs on a large cluster of commodity machines and is highly scalable.
Journal ArticleDOI
A scalable, commodity data center network architecture
TL;DR: This paper shows how to leverage largely commodity Ethernet switches to support the full aggregate bandwidth of clusters consisting of tens of thousands of elements and argues that appropriately architected and interconnected commodity switches may deliver more performance at less cost than available from today's higher-end solutions.
Book
Principles and Practices of Interconnection Networks
William J. Dally,Brian Towles +1 more
TL;DR: This book offers a detailed and comprehensive presentation of the basic principles of interconnection network design, clearly illustrating them with numerous examples, chapter exercises, and case studies, allowing a designer to see all the steps of the process from abstract design to concrete implementation.
Journal ArticleDOI
The part-time parliament
TL;DR: The Paxon parliament's protocol provides a new way of implementing the state machine approach to the design of distributed systems.
Proceedings Article
The Art of Computer Systems Performance Analysis.
TL;DR: The authors' goal is always to offer you an assortment of cost-free ebooks too as aid resolve your troubles.