Journal ArticleDOI
VL2: a scalable and flexible data center network
Albert Greenberg,James R. Hamilton,Navendu Jain,Srikanth Kandula,Changhoon Kim,Parantap Lahiri,David A. Maltz,Parveen Patel,Sudipta Sengupta +8 more
TLDR
VL2 is a practical network architecture that scales to support huge data centers with uniform high capacity between servers, performance isolation between services, and Ethernet layer-2 semantics and can be deployed today, and a working prototype is built.Abstract:
To be agile and cost effective, data centers must allow dynamic resource allocation across large server pools. In particular, the data center network should provide a simple flat abstraction: it should be able to take any set of servers anywhere in the data center and give them the illusion that they are plugged into a physically separate, noninterfering Ethernet switch with as many ports as the service needs. To meet this goal, we present VL2, a practical network architecture that scales to support huge data centers with uniform high capacity between servers, performance isolation between services, and Ethernet layer-2 semantics. VL2 uses (1) flat addressing to allow service instances to be placed anywhere in the network, (2) Valiant Load Balancing to spread traffic uniformly across network paths, and (3) end system--based address resolution to scale to large server pools without introducing complexity to the network control plane. VL2's design is driven by detailed measurements of traffic and fault data from a large operational cloud service provider. VL2's implementation leverages proven network technologies, already available at low cost in high-speed hardware implementations, to build a scalable and reliable network architecture. As a result, VL2 networks can be deployed today, and we have built a working prototype. We evaluate the merits of the VL2 design using measurement, analysis, and experiments. Our VL2 prototype shuffles 2.7 TB of data among 75 servers in 395 s---sustaining a rate that is 94% of the maximum possible.read more
Citations
More filters
Proceedings ArticleDOI
Network traffic characteristics of data centers in the wild
TL;DR: An empirical study of the network traffic in 10 data centers belonging to three different categories, including university, enterprise campus, and cloud data centers, which includes not only data centers employed by large online service providers offering Internet-facing applications but also data centers used to host data-intensive (MapReduce style) applications.
Proceedings ArticleDOI
Windows Azure Storage: a highly available cloud storage service with strong consistency
Brad Calder,Ju Wang,Aaron W. Ogus,Niranjan Nilakantan,Arild E. Skjolsvold,Sam McKelvie,Yikang Xu,Shashwat Srivastav,Jiesheng Wu,Huseyin Simitci,Jaidev Haridas,Chakravarthy Uddaraju,Hemal Khatri,Andrew James Edwards,Vaman Bedekar,Mainali Shane Kumar,Rafay Abbasi,Arpit Agarwal,Mian Fahim ul Haq,Muhammad Ikram ul Haq,Deepali Bhardwaj,Sowmya Dayanand,Anitha Adusumilli,Marvin McNett,Sriram Sankaran,Kavitha Manivannan,Leonidas Rigas +26 more
TL;DR: The WAS architecture, global namespace, and data model is described, as well as its resource provisioning, load balancing, and replication systems.
Proceedings ArticleDOI
Joint VM placement and routing for data center traffic engineering
TL;DR: This work proposes an efficient online algorithm that employs the real data center traffic traces under a spectrum of elephant and mice flows and demonstrates a consistent and significant improvement over the benchmark achieved by common heuristics.
Proceedings Article
OSA: an optical switching architecture for data center networks with unprecedented flexibility
Kai Chen,Ankit Singlay,Atul Singhz,Kishore Ramachandranz,Lei Xuz,Yueping Zhangz,Xitao Wen,Yan Chen +7 more
TL;DR: In this paper, the authors describe the design, implementation and evaluation of OSA, a novel optical switching architecture for DCNs, which dynamically changes its topology and link capacities, thereby achieving unprecedented flexibility to adapt to dynamic traffic patterns.
Journal ArticleDOI
A Survey on Network Methodologies for Real-Time Analytics of Massive IoT Data and Open Research Issues
TL;DR: The state-of-the-art of the analytics network methodologies, which are suitable for real-time IoT analytics are reviewed, and a number of prospective research problems and future research directions are presented focusing on thenetwork methodologies for the real- time IoT analytics.
References
More filters
Transparent Interconnection of Lots of Links (TRILL): Problem and Applicability Statement
Joseph Touch,Radia Perlman +1 more
TL;DR: This document assumes that solutions would not address issues of scalability beyond that of existing bridged (802.1) links, but that a solution would be backward compatible with 802.1, including hubs, bridges, and their existing plug-and-play capabilities.
Proceedings ArticleDOI
Symbiotic routing in future data centers
TL;DR: This paper designs an extended routing service allowing easy implementation of application-specific routing protocols on CamCube, and demonstrates the benefits and network-level impact of running multiple routing protocols.
Journal ArticleDOI
Load balanced Birkhoff-von Neumann switches, part I
TL;DR: A switch architecture with two-stage switching fabrics and one- stage switching fabrics that scales up with the speed of fiber optics is proposed.
Proceedings ArticleDOI
SPAIN: COTS data-center Ethernet for multipathing over arbitrary topologies
TL;DR: SPAIN ("Smart Path Assignment In Networks") provides multipath forwarding using inexpensive, commodity off-the-shelf (COTS) Ethernet switches, over arbitrary topologies, and is demonstrated to improve bisection bandwidth over both simulated and experimental data-center networks.
Book
Designing a predictable backbone network using valiant load-balancing
Nick McKeown,Rui Zhang-Shen +1 more
TL;DR: Valiant Load-Balancing is proposed to be used to design backbone networks that can support all traffic matrices efficiently, even under a number of failures, and applied to designing circuit-switched networks with performance guarantees.