Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Journal ArticleDOI
Getting your big data priorities straight: a demonstration of priority-based QoS using social-network-driven stock recommendation
TL;DR: The underlying solution provides a unique capability to identify and differentiate application workloads throughout a complex big data platform, and its current implementation is based on Apache Hadoop and the IBM GPFS distributed storage system.
Proceedings ArticleDOI
Scaling NFSv4 with parallel file systems
Dean Hildebrand,Peter Honeyman +1 more
TL;DR: Extensions to the NFSv4 protocol to support parallel access are introduced and a prototype of the GridNFS design is implemented and experiments demonstrating its scalable architecture are presented.
Proceedings ArticleDOI
An Out-of-Core Eigensolver on SSD-equipped Clusters
Zheng Zhou,Erik Saule,Hasan Metin Aktulga,Chao Yang,Esmond G. Ng,Pieter Maris,James P. Vary,Ümit V. Çatalyürek +7 more
TL;DR: The effectiveness of the out-of-core eigensolver implemented using DOoC+LAF is demonstrated by reporting performance results on large-scale eigenvalue problems arising in nuclear structure calculations.
Proceedings ArticleDOI
MIQS: metadata indexing and querying service for self-describing file formats
TL;DR: This research proposes a novel Metadata Indexing and Querying Service (MIQS), which removes the external DBMS and utilizes in-memory index to achieve efficient metadata searching and provides portable and schema-free metadata indexing and querying functionalities for self-describing file formats.
Proceedings ArticleDOI
Mapping functions and data redistribution for parallel files
Florin Isaila,Walter F. Tichy +1 more
TL;DR: This paper presents general algorithms for mapping between two arbitrary distributions of a parallel file, optimized for multidimensional array partitions.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.