Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Journal ArticleDOI
On the role of application and resource characterizations in heterogeneous distributed computing systems
TL;DR: This paper quantitatively analyze the performance of three different real scientific applications consisting of many tasks on top of HDC systems based on a partnership of distributed computing clusters, grids, and clouds to understand the application and resource characteristics, and shows practical issues that normal scientific users can face during the course of leveraging these systems.
Journal ArticleDOI
RSEDP: an effective hybrid data placement algorithm for large-scale storage systems
Nong Xiao,Tao Chen,Fang Liu +2 more
TL;DR: RSEDP is developed, which combines reliable replication data placement with scalable and efficient data placement (SEDP) to achieve the requirements mentioned above, and has a good scalability and time efficiency with small memory overhead.
Proceedings Article
FlexGroup Volumes: A Distributed {WAFL} File System
Ram Kesavan,Jason Hennessey,Richard P. Jernigan,Peter Macko,Keith A. Smith,Daniel Tennant,V R Bharadwaj +6 more
TL;DR: This paper presents the FlexGroup design, which includes a new remote access layer that supports distributed transactions and the novel heuristics used to balance load and capacity across a storage cluster.
Proceedings ArticleDOI
XCPU2 distributed seamless desktop extension
TL;DR: The XCPU2 clustering model, its operation and how the per-job filesystem configuration can be used to solve some of the common problems when running a cluster are described.
Dissertation
Optimizing Distributed Systems using Machine Learning
TL;DR: This thesis proposes optimizing distributed systems using machine learning (ML), and designs, implementation, augmentation, and evaluation of three distributed systems that illustrate the impact of these ML-based optimizations that result in improved distributed systems’ efficiency and performance.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.