Open AccessProceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
- pp 231-244
Reads0
Chats0
TLDR
GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.Citations
More filters
Applications of virtualization in systems design
TL;DR: This dissertation provides an understanding of both the strengths and the weaknesses that are connected by applying virtualization methods to system design and can be applicable to future applications development.
Journal ArticleDOI
Performance consequence of user space file systems due to extensive CPU sharing in virtual environment
Gopi Bhatt,Madhuri Bhavsar +1 more
TL;DR: It is shown here, that a careful selection of parameters like block sizes and type of read/write operations can improve performance of these file systems significantly by 40% to 45% even in heavily loaded environment, which will inspire users and developers to enhance the performance of FUSE based file systems.
Dissertation
Big data system infrastructure at extreme scales
TL;DR: This dissertation proposed a new system architecture and implemented a prototype that was evaluated on tens of thousands nodes on par with the scale of today’s largest supercomputers, showing near linear scalability and orders of magnitude higher data movement rate.
Journal ArticleDOI
Survey of Big Data Storage Technology
Wang Weichen,Gao Jing,Cao Rui +2 more
TL;DR: This paper summarizes file segmentation, appropriate scenarios and merits and faults of distributed file system, and mainly analyzes and summarizes the theories and appropriate scenarios of four data storage models of NoSql database.
Proceedings ArticleDOI
The Design and Implementation of Multi-Cloud Based Distributed Storage Platform with Random Linear Coding
TL;DR: The experimental results show that the proposed Normal Drive can significantly improve the transmission performance and enhance the reliability of file storage when comparing with single-cloud based distributed storage system.
References
More filters
Book ChapterDOI
Notes on Data Base Operating Systems
TL;DR: This paper is a compendium of data base management operating systems folklore and focuses on particular issues unique to the transaction management component especially locking and recovery.
Proceedings ArticleDOI
Petal: distributed virtual disks
TL;DR: The design, implementation, and performance of Petal is described, a system that attempts to approximate this ideal in practice through a novel combination of features.
Journal ArticleDOI
Extendible hashing—a fast access method for dynamic files
TL;DR: This work studies, by analysis and simulation, the performance of extendible hashing and indicates that it provides an attractive alternative to other access methods, such as balanced trees.
Proceedings ArticleDOI
Frangipani: a scalable distributed file system
TL;DR: Initial measurements indicate that Frangipani has excellent single-server performance and scales well as servers are added, and can be exported to untrusted machines using ordinary network file access protocols.
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.