Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Proceedings Article
{GIFT}: A Coupon Based Throttle-and-Reward Mechanism for Fair and Efficient I/O Bandwidth Management on Parallel Storage Systems
TL;DR: GIFT is introduced, a principled dynamic approach to achieve fairness among competing applications and improve system efficiency on a large-scale parallel system.
Proceedings ArticleDOI
Direct-pNFS: scalable, transparent, and versatile access to parallel file systems
Dean Hildebrand,Peter Honeyman +1 more
TL;DR: Direct-pNFS is introduced, which builds on the NFSv4.1 protocol to meet a key challenge in accessing remote parallel file systems: high-performance and scalable data access without sacrificing transparency, security, orportability.
Posted Content
FanStore: Enabling Efficient and Scalable I/O for Distributed Deep Learning
Zhao Zhang,Lei Huang,Uri Manor,Linjing Fang,Gabriele Merlo,Craig Michoski,John Cazes,Niall Gaffney +7 more
TL;DR: FanStore is presented, a transient runtime file system that optimizes DL I/O on existing hardware/software stacks that provides a POSIX-compliant interface with native hardware throughput in an efficient and scalable manner.
Proceedings ArticleDOI
Key/Value-Enabled Flash Memory for Complex Scientific Workflows with On-Line Analysis and Visualization
Stefan Eilemann,Fabien Delalondre,Jon Bernard,Judit Planas,Felix Schuermann,John Biddiscombe,Costas Bekas,Alessandro Curioni,Bernard Metzler,Peter Kaltstein,Peter Morjan,Joachim Fenkes,Ralph Bellofatto,Lars Schneidenbach,T. J. Christopher Ward,Blake G. Fitch +15 more
TL;DR: This paper presents a way to exploit the fundamental capabilities of Storage-Class Memories (SCM), such as Flash, by using scalable key-value (KV) I/O methods instead of traditional fileI/O calls commonly used in HPC systems.
Proceedings ArticleDOI
Base Operating System Provisioning and Bringup for a Commercial Supercomputer
TL;DR: This paper describes the system developed to manage the installation, provisioning, and maintenance process for a cluster of blades, providing a base level of functionality to be used by higher level management tools.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.