Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Proceedings ArticleDOI
LADS: optimizing data transfers using layout-aware data scheduling
TL;DR: This paper identifies the issues that lead to congestion on the path of an end-to-end data transfer in the terabit network environment, and presents a new bulk data movement framework called LADS for terabit networks.
Proceedings ArticleDOI
Feasibility analysis of big log data real time search based on Hbase and ElasticSearch
TL;DR: This article will explain Hbase based on modern distributed systems and cloud real-time search search engine ElasticSearch feasibility of large data logs.
Proceedings ArticleDOI
Design of an exact data deduplication cluster
TL;DR: It is shown that, despite different claims in previous papers, it is possible to combine exact deduplication, small chunk sizes, and scalability within one environment using only a commodity GBit Ethernet interconnect.
Journal ArticleDOI
Storage-aware Algorithms for Scheduling of Workflow Ensembles in Clouds
TL;DR: This paper proposes and implements a simulation model for handling file transfers between tasks, featuring the ability to dynamically calculate bandwidth and supporting a configurable number of replicas, thus allowing us to simulate various levels of congestion.
Proceedings ArticleDOI
UniDrive: Synergize Multiple Consumer Cloud Storage Services
TL;DR: UniDrive is presented, a CCS app that synergizes multiple CCSs (multi-cloud) by using only few simple public RESTful Web APIs and achieves significantly superior and consistent sync performance of UniDrive over any single CCS.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.