Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Dissertation
An integrated end-user data service for hpc centers
Ali R. Butt,Henry M. Monti +1 more
TL;DR: The Integrated End-User Data Service is presented, wherein data transfer and placement on the scratch space are scheduled with job execution, thereby bridging the gap between system software tools and scratch storage management and better equips the scratch storage system to serve the growing datasets of workloads.
Journal ArticleDOI
Design and Implementation of an Asymmetric Block-Based Parallel File System
TL;DR: This paper presents an asymmetric block-based parallel file system, Redbud, which isolates the metadata storage in the metadata server (MDS) access domain and proposes an adaptive timeout algorithm to make the MDS failure detection adaptive to the evolving workloads, improving the system availability.
Book ChapterDOI
A New Scalable Approach for Distributed Metadata in HPC
Cristina Rodríguez-Quintana,Cristina Rodríguez-Quintana,Antonio F. Díaz,Antonio F. Díaz,Julio Ortega,Julio Ortega,Raúl H. Palacios,Raúl H. Palacios,Andrés Ortiz,Andrés Ortiz +9 more
TL;DR: A completely distributed method is defined that provides efficient metadata management and seamlessly adapts to general purpose and scientific computing filesystem workloads and shows great scalability in creating operations on a single directory accessed by multiple clients.
NFSv4 and High Performance File Systems: Positioning to Scale
Dean Hildebrand,Peter Honeyman +1 more
TL;DR: Support in NFSv4 for caching, locking, and delegation suggest the potential for superior performance both in a cluster and across a WAN.
Proceedings Article
A study of the fault-tolerant PVFS2
TL;DR: In this paper, the architecture of the Parallel Virtual File System (PVFS) is thoroughly analyzed, and the possibility of enhancing the fault-tolerance and reliability of PVFS is proposed.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.