Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Journal ArticleDOI
A cross-layer optimized storage system for workflow applications
TL;DR: It is argued that an incremental adoption path for adopting cross-layer optimizations in storage exists, the system architecture for a workflow-optimized storage system and its integration with a workflow runtime engine are presented, and this approach is evaluated using synthetic and real applications.
Dissertation
NFSP : Une solution de stockage distribué pour architectures grande échelle
TL;DR: Notre solution consiste a offrir un stockage distribue logiciel pour architectures de type grappes de nature faiblement intrusive dans the mesure ou le protocole standard omni-present du monde Unix, NFS, est utilise.
Journal ArticleDOI
Data-Aware Task Dispatching for Batch Queuing System
Xieming Li,Osamu Tatebe +1 more
TL;DR: The file access cost is calculated and combined with the CPU load average into a comprehensive value, which will be used as the standard for scheduling and evaluated in comparison with the original Torque scheduler using three benchmarks.
Proceedings ArticleDOI
Efficient Support for MPI-I/O Atomicity Based on Versioning
TL;DR: In this paper, the authors consider the challenge of building data management systems that meet an important requirement of today's data-intensive HPC applications: to provide a high I/O throughput while supporting highly concurrent data accesses.
Proceedings ArticleDOI
IOPm -- Modeling the I/O Path with a Functional Representation of Parallel File System and Hardware Architecture
Julian M. Kunkel,Thomas Ludwig +1 more
TL;DR: By abstracting functionalities from the components they are hosted on, IOPm will enable to build interfaces to monitor file system activity and assist to identify and communicate bottlenecks in the machine and file system configuration by highlighting performance relevant functionalities.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.