Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Journal ArticleDOI
JETS: Language and System Support for Many-Parallel-Task Workflows
TL;DR: JETS represents an advance over the few known examples of multilevel many-parallel-task scheduling systems: it more efficiently schedules and launches many short-duration parallel application invocations; it overcomes the challenges of coupling the user processes of each multiprocessing application invocation via the messaging fabric; and it concurrently manages many application executions in various stages.
Proceedings ArticleDOI
HCompress: Hierarchical Data Compression for Multi-Tiered Storage Environments
TL;DR: HCompress is a hierarchical data compression library that can improve the application’s performance by harmoniously leveraging both multi-tiered storage and data compression, and has been developed a novel compression selection algorithm that facilitates the optimal matching of compression libraries to the tiered storage.
Proceedings ArticleDOI
Self-Acting Load Balancing with Parallel Sub File Migration for Parallel File System
TL;DR: The self-acting load balancing is fundamentally based on distributed architecture, which also permits parallel file migrations to accelerate balancing progress, and the experiments show that PVFS2 with self- acting load balancing can reduce the average response time and improve performance of parallel I/O obviously compared with original PVFS1.
Proceedings ArticleDOI
Improving data availability for a cluster file system through replication
TL;DR: LionFS introduces a relaxed consistency model to enable concurrent updating all replicas for a mutation operation, greatly reducing the latency of operations and ensures replica consistency if applications use file locks to synchronize the concurrent conflict mutations.
Proceedings ArticleDOI
CHAIO: Enabling HPC Applications on Data-Intensive File Systems
TL;DR: This study proposes the CHunk-Aware I/O (CHAIO) strategy, a critical and necessary step to enable HPC in the Cloud to enable efficient N-1 data access on data-intensive distributed file systems.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.