Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Proceedings ArticleDOI
LPCC: hierarchical persistent client caching for lustre
Yingjin Qian,Xi Li,Shuichi Ihara,Andreas Dilger,Carlos Thomaz,Shilong Wang,Cheng Wen,Li Chunyan,Lingfang Zeng,Fang Wang,Dan Feng,Tim Süß,André Brinkmann +12 more
TL;DR: The evaluation results presented in this paper show LPCC's advantages for various workloads, enabling even speed-ups linear in the number of clients for several real-world scenarios.
Journal ArticleDOI
Efficient Storage of Multi-Sensor Object-Tracking Data
TL;DR: This paper proposes the first read/write-optimized solution for storing multi-sensor object-tracking data on HDFS using a distributed caching mechanism and a parallel file-merging policy and demonstrates that this mechanism is able to improve the write throughput of HDFS and outperforms existing centralized-cache-based approaches.
Shared Parallel Filesystems in Heterogeneous Linux Multi-Cluster Environments
TL;DR: This paper deploys PVFS2, GPFS, Lustre, and TerraFS for shared deployment across multiple Linux clusters running with different hardware architectures and operating systems and shows that all of the parallel filesystems outperform a legacy NFS system but with different levels of complexity.
Journal ArticleDOI
Persistent memory hash indexes
TL;DR: This paper focuses on the evaluation of six state-of-the-art hash tables including Level hashing, CCEH, Dash, PCLHT, Clevel, and SOFT, with real PM hardware and identifies design trade-offs and good paradigms in prior arts, and suggests desirable optimizations and directions for the future development of PM-based hash tables.
Journal ArticleDOI
Adaptive Replica Synchronization for Distributed File Systems
TL;DR: An adaptive replica synchronization mechanism among storage servers (SSs) without the interference from the metadata server (MDS) in a distributed file system that can side step the cumbersome centralized synchronization process to accomplish the same synchronization job.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.