Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Journal ArticleDOI
Cost-Aware Region-Level Data Placement in Multi-Tiered Parallel I/O Systems
TL;DR: This paper proposes a cost-aware region-level (CARL) data placement scheme in multi-tiered parallel I/O systems, and implements CARL under MPI-IO library and OrangeFS parallel file system environment.
Proceedings ArticleDOI
A Big Data Architecture for Automotive Applications: PSA Group Deployment Experience
TL;DR: This paper describes in depth the big data architecture deployed within the PSA Group and the underlaying technologies/products used in each component and the experience of thePSA Group on leveraging big data in automotive context.
Proceedings ArticleDOI
dislib: Large Scale High Performance Machine Learning in Python
TL;DR: This paper presents and evaluates dislib, a distributed machine learning library on top of PyCOMPSs programming model that addresses the issues of other existing libraries and shows that dislib can be up to 9 times faster, and can process data sets up to 16 times larger than other popular distributed machineLearning libraries, such as MLlib.
Journal ArticleDOI
Applying Amdahl's other law to the data center
TL;DR: The applicability of Amdahl's Other Law to the data center is studied to better understand the relationship between processor systems and the networks interconnecting them and is also relevant as multicore systems will become more prevalent to sustain growth of processing performance.
High availability using virtualization
TL;DR: ............................................................................................. IV INDEX ........................................................................................................ V
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.