Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Journal ArticleDOI
Scalable Distributed Metadata Server Based on Nonblocking Transactions
TL;DR: This paper proposes a design of a scalable distributed metadata server, PPMDS, for parallel file systems using multiple key-value servers, and proposes optimizations to further improve the metadata performance by introducing a server-side transaction processing, multiple readers, and a shared lock mode.
Proceedings ArticleDOI
An enhanced journaling method for clustered file system with shared storage
Zhonglei Fan,Xiang-Mo Zhao +1 more
TL;DR: An enhanced lock-free journaling method is presented in this paper, which can improve the performance of journaling operations involving multiple nodes, and then shortens recovery time from crashes.
Proceedings ArticleDOI
Pream: Enhancing HPC Storage System Performance with Pre-Allocated Metadata Management Mechanism
TL;DR: Pream, a light-weight metadata management framework that aim to address challenges of supporting data-intensive workloads that generates a huge number of temporary files on diskless compute nodes, and can outperform Lustre in many workloads and reduce latency of metadata operation efficiently.
Journal ArticleDOI
Experimental evaluation of a flexible I/O architecture for accelerating workflow engines in ultrascale environments
Francisco Rodrigo Duro,Javier Garcia Blas,Florin Isaila,Jesus Carretero,Justin M. Wozniak,Robert Ross +5 more
TL;DR: A novel solution is presented that leverages codesign principles for integrating Hercules—an in-memory data store—with a workflow management system and demonstrates significant performance and scalability improvements over existing state-of-the-art approaches.
Proceedings ArticleDOI
In unity there is strength: Showcasing a unified big data platform with MapReduce Over both object and file storage
TL;DR: This work presents a prototype joining Apache Hadoop MapReduce with OpenStack's open-source object store Swift and IBM's cluster file system GPFSTM, and finds that the prototype achieves 50% data capacity savings, eliminates data migration overhead, offers stronger reliability and enterprise support.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.