Replica selection strategies in data grid

The requirements for network predictability are becoming increasingly critical to the DOE science community where resources are widely distributed and collaborations are world-wide. To accommodate these emerging requirements, the energy sciences network has established a science data network to provide user driven guaranteed bandwidth allocations. In this paper we outline the design, implementation, and secure coordinated use of such a network, as well as some lessons learned.

/pdf/a-user-driven-dynamic-circuit-network-implementation-4y2pmwq8ac.pdf

A User Driven Dynamic Circuit Network Implementation

https://escholarship.org/content/qt4rf342jn/qt4rf342jn.pdf?t=pd5660

AmoebaNet: An SDN-enabled network service for big data science

Many scientific applications, including bulk data transfer, can achieve significantly higher performance from vir- tually loss-free dedicated resources provisioned on shared links, than from opportunistic network use. Research and Education (RaE) backbones, including the Energy Sciences Network and Internet2, provide general-purpose services to allocate dedi- cated bandwidth. However, in order to fully take advantage of this technology, applications need to move from coarse-grained "reservation" strategies, to more sophisticated control based on software defined networking (SDN) with technologies such as OpenFlow. We propose here, as one practical step in this direction, using multiple paths for the same application transfer session. This can add bandwidth from "best effort" and dedicated networks, and can also facilitate performance with applications using multiple 10G NICs over 100G capable paths.

/pdf/exploiting-network-parallelism-for-improving-data-transfer-3hh6gmmb4q.pdf

Exploiting Network Parallelism for Improving Data Transfer Performance

Managing modern heterogeneous network technologies in a simple, uniform manner has become an increasingly difficult challenge. To help address this issue, we propose a session layer protocol called the eXtensible Session Protocol (XSP) designed to integrate existing network systems, providing the ability to easily introduce additional protocol functionality as needed, including applicationdriven network allocation and integration with network “middleboxes.” The XSP implementation is currently targeted at network middleware architectures where it allows for the transparent integration and configuration of new and existing network components and services

The eXtensible Session Protocol: A Protocol for Future Internet Architectures

Lambda Station is an ongoing project of Fermi National Accelerator Laboratory and the California Institute of Technology. The goal of this project is to design, develop and deploy network services for path selection, admission control and flow based forwarding of traffic among data- intensive Grid applications such as are used in High Energy Physics and other communities. Lambda Station deals with the last-mile problem in local area networks, connecting production clusters through a rich array of wide area networks. Selective forwarding of traffic is controlled dynamically at the demand of applications. This paper introduces the motivation of this project, design principles and current status. Integration of Lambda Station client API with the essential Grid middleware such as the dCache/SRM Storage Resource Manager is also described. Finally, the results of applying Lambda Station services to development and production clusters at Fermilab and Caltech over, advanced networks such as DOE's UltraScience Net and NSF's UltraLight is covered.

/pdf/lambda-station-on-demand-flow-based-routing-for-data-35eeaym2k4.pdf

M. Grigoriev

Papers

Lambda Station: On-Demand Flow Based Routing for Data Intensive Grid Applications Over Multitopology Networks