Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Proceedings ArticleDOI
Making resonance a common case: A high-performance implementation of collective I/O on parallel file systems
TL;DR: Resonant I/O rearranges requests from multiple MPI processes according to the presumed data layout on the disks of I/o nodes so that non-sequential access of disk data can be turned into sequential access, significantly improving I/W performance without compromising the independence of a client-based implementation.
Proceedings ArticleDOI
Scalable in situ scientific data encoding for analytical query processing
Sriram Lakshminarasimhan,David A. Boyuka,Saurabh V. Pendse,Xiaocheng Zou,John Jenkins,Venkatram Vishwanath,Michael E. Papka,Nagiza F. Samatova +7 more
TL;DR: DIRAQ is proposed, a parallel in situ, in network data encoding and reorganization technique that enables the transformation of simulation output into a query-efficient form, with negligible runtime overhead to the simulation run.
Proceedings ArticleDOI
Massively parallel genomic sequence search on the Blue Gene/P architecture
TL;DR: This paper presents its first experiences in mapping and optimizing genomic sequence search onto the massively parallel IBM Blue Gene/P (BG/P) platform, and demonstrates that such scalability enables it to complete a large-scale bioinformatics problem in only a few hours on BG/P.
Proceedings ArticleDOI
Adaptive and scalable metadata management to support a trillion files
TL;DR: This work presents a scalable and adaptive metadata management system which aims to maintain a trillion files efficiently and exploits an adaptive two-level directory partitioning based on extendible hashing to manage very large directories.
Proceedings ArticleDOI
MARIANE: MApReduce Implementation Adapted for HPC Environments
TL;DR: MARIANE (MApReduce Implementation Adapted for HPC Environments) not only allows for the use of the model in an expanding number of HPC environments, but also allows for better performance in such settings.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.