Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Proceedings ArticleDOI
Group file operations for scalable tools and middleware
Michael J. Brim,Barton P. Miller +1 more
TL;DR: TBON-FS is a new distributed file system that provides scalable group file operations by leveraging tree-based overlay networks (TBONs) for scalable communication and data aggregation.
Proceedings ArticleDOI
Data management and analysis at the Large Scale Data Facility
Ariel Garcia,S. Bourov,Ahmad Hammad,Thomas Jejkal,Jens C. Otte,Sebastian Pfeiffer,T. Schenker,Christian Schmidt,J. van Wezel,Bernhard Neumair,Achim Streit +10 more
TL;DR: Both community specific meta data schemes, a meta data repository, an application programming interface and a graphical tool for accessing the resources were developed to further support the processing workflows of the partner scientific communities.
Proceedings ArticleDOI
Live Forensics for HPC Systems: A Case Study on Distributed Storage Systems
Saurabh Jha,Shengkun Cui,Subho S. Banerjee,Tianyin Xu,Jeremy Enos,Mike Showerman,Zbigniew Kalbarczyk,Ravishankar K. Iyer +7 more
TL;DR: Kaleidoscope as discussed by the authors is a near real-time failure detection and diagnosis framework, consisting of of hierarchical domain-guided machine learning models that identify the failing components, the corresponding failure mode, and point to the most likely cause indicative of the failure in near realtime (within one minute of failure occurrence).
Journal ArticleDOI
Timely Result-Data Offloading for Improved HPC Center Scratch Provisioning and Serviceability
TL;DR: This paper designs a framework for the timely, decentralized offload of application result data that uses an overlay of user-specified intermediate and landmark sites to orchestrate a decentralized fault-tolerant delivery.
Patent
Switch-aware parallel file system
Dean Hildebrand,Renu Tewari +1 more
TL;DR: In this paper, a computing cluster is partitioned into a plurality of computing cluster building blocks comprising a parallel file system, and a file system metadata module tracks a storage location of data allocated by the storage module within the computing cluster.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.