Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Proceedings ArticleDOI
The quest for scalable support of data-intensive workloads in distributed systems
TL;DR: An abstract model for data diffusion is defined, new scheduling policies with heuristics to optimize real-world performance are introduced, and a competitive online cache eviction policy is developed, to explore the feasibility of data diffusion.
Proceedings ArticleDOI
Extending I/O through high performance data services
TL;DR: The data services implementation distinguishes control aspects — the control plane — from data movement — the data plane, so that both may be changed separably, which results in runtime flexibility not only in which services to employ, but also in where to deploy them and how they use I/O resources.
Journal ArticleDOI
Coordinating Computation and I/O in Massively Parallel Sequence Search
TL;DR: This study reveals that the lack of coordination between computation scheduling and I/O optimization could result in severe performance issues, and proposes an integrated scheduling approach that effectively improves sequence-search throughput by gracefully coordinating the dynamic load balancing of computation and high-performance noncontiguous I/o.
Proceedings ArticleDOI
Server-side I/O coordination for parallel file systems
TL;DR: Experimental results demonstrate that the proposed server-side I/O coordination scheme can reduce average completion time by 8% to 46%, and provide higher I/W bandwidth than that of default data access strategies adopted by PVFS2 for heavy I/ O workloads.
Patent
Asynchronous file operations in a scalable multi-node file system cache for a remote cluster file system
Rajagopol Ananthanarayanan,Marc Eshel,Roger L. Haskin,Dean Hildebrand,Manoj P. Naik,Frank B. Schmuck,Renu Tewari +6 more
TL;DR: In this paper, a scalable multi-node file system cache for a remote cluster file system is proposed, where local file information is asynchronously committed from the cache to the file system over the network.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.