Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Journal ArticleDOI
Accelerating HDF5 I/O for Exascale Using DAOS
Jerome Soumagne,Jordan Henderson,Mohamad Chaarawi,Neil Fortner,Scot Breitenfeld,Songyu Lu,D. Robinson,Elena Pourmal,Johann Lombardi +8 more
TL;DR: The research efforts that have been taking place to prepare the HDF5 library for Exascale using DAOS are presented, enabling and defining a new storage file format that focuses on the benefits that it delivers to the applications in terms of features and performance.
Dissertation
Efficient support for data-intensive scientific workflows on geo-distributed clouds
TL;DR: This thesis presents several design strategies to eficiently support the execution of workflow engines across multisite clouds, by reducing the cost of metadata operations and explains how selective handling of metadata, classified by frequency of access, improves workflows performance in a multisite environment.
Journal ArticleDOI
IR+: Removing parallel I/O interference of MPI programs via data replication over heterogeneous storage devices
TL;DR: A scheme, named IR+, to eliminate I/O interference for a single MPI program on disks by taking advantage of optimized access patterns and heterogeneous storage devices (e.g., solid-state disks).
Book ChapterDOI
Optimizing Cloud Storage Management Services
Gabriel Alatorre,Sandeep Gopisetty,Divyesh Jadav,Bryan Langston,Nagapramod Mandagere,Ramani R. Routray,Heiko Ludwig +6 more
TL;DR: This chapter focuses on cloud service management from a storage perspective, providing a set of proven methods and services to optimize storage resource usage and the management architecture that enables them.
Proceedings ArticleDOI
An Efficient, Nonintrusive, Log-Based I/O Mechanism for Scientific Simulations on Clusters
TL;DR: Log-based I/O (LBIO) is proposed, an approach that can substantially increase theI/O performance of simulations on clusters by utilizing free space on the cluster's local disks to stage data on its way to remote storage.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.