Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Proceedings ArticleDOI
Panache: a parallel file system cache for global file access
TL;DR: The overall design and implementation of Panache is presented and its key features are evaluated with multiple workloads across local and wide area networks.
ReportDOI
Programming Abstractions for Data Locality
Adrian Tate,Amir Kamil,Anshu Dubey,Armin Groblinger,Brad Chamberlain,Brice Goglin,Harold C. Edwards,Chris J. Newburn,David Padua,Didem Unat,Emmanuel Jeannot,Frank Hannig,Gysi Tobias,Hatem Ltaief,James C. Sexton,Jesús Labarta,John Shalf,Karl Fuerlinger,Kathryn M. O'Brien,Leonidas Linardakis,Maciej Besta,Marie-Christine Sawley,Mark Abraham,Mauro Bianco,Miquel Pericas,Naoya Maruyama,Paul H. J. Kelly,Peter Messmer,Robert Ross,Romain Ciedat,Satoshi Matsuoka,Thomas C. Schulthess,Torsten Hoefler,Vitus J. Leung +33 more
TL;DR: The goal of the workshop and this report is to identify common themes and standardize concepts for locality-preserving abstractions for exascale programming models that can expose crucial information about data locality to the compiler and runtime system to enable performance-portable code.
Journal ArticleDOI
Dash: Scalable Hashing on Persistent Memory
TL;DR: In this article, the authors present Dash, a holistic approach to build dynamic and scalable hash tables on real PM hardware with all the aforementioned properties, including good scalability, high load factor and instant recovery.
Proceedings ArticleDOI
DeltaFS: exascale file systems scale better without dedicated servers
TL;DR: Experiments shows that the serverless file system design, DeltaFS, performs metadata operations orders of magnitude faster than traditional file system architectures.
Book
Many-Task Computing: Bridging the Gap between High Throughput Computing and High Performance Computing
TL;DR: Fundamental issues in defining the MTC paradigm are explored, as well as theoretical and practical issues in supporting compute and data intensive applications on large scale systems are explored.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.