Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Book ChapterDOI
Big data at scale for digital humanities: An architecture for the HathiTrust research center
Stacy Kowalczyk,Yiming Sun,Zong Peng,Beth Plale,Aaron R. Todd,Loretta Auvil,Craig Willis,Jiaan Zeng,Milinda Pathirage,Samitha Liyanage,Guangchen Ruan,J. Stephen Downie +11 more
TL;DR: The HathiTrust Research Center (HTRC) is a cyberinfrastructure to support humanities research on big humanities data providing a secure, scalable, extendable, and generalizable interface for both human and computational users.
Improving the dependability of distributed systems through air software upgrades
Priya Narasimhan,Tudor Dumitras +1 more
TL;DR: This dissertation identifies the leading causes of upgrade failure—breaking hidden dependencies—and of planned downtime—complex data conversions—in distributed enterprise systems and describes techniques for assessing the impact of software upgrades, in order to reason about the implications of relaxing the AIR guarantees.
Dissertation
Active Data - Enabling Smart Data Life Cycle Management for Large Distributed Scientific Data Sets
TL;DR: This thesis introduces Active Data, a meta-model, an implementation and a programming model that allow to represent formally and graphically the life cycle of data distributed in an assemblage of heterogeneous systems and infrastructures, naturally exposing replication, distribution and different data identifiers.
Extending NFSv4 for Petascale Data Management
TL;DR: CITI’s GridNFS and pNFS combine and integrate standard Internet protocols, promising near-universal compatibility with standards-compliant desktop and enterprise network services.
Proceedings ArticleDOI
Topology-Aware Data Aggregation for High Performance Collective MPI-IO on a Multi-core Cluster System
TL;DR: A topology-aware data aggregation scheme which takes care of MPI rank layout across compute nodes is introduced which has achieved up to 67% improvements in I/O performance compared with the original ROMIO in HPIO benchmark runs using 768 processes on 64 compute nodes of the TSUBAME2.5 supercomputer at the Tokyo Institute of Technology.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.