Open AccessProceedings Article
Scalability in the XFS file system
Reads0
Chats0
TLDR
The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.Abstract:
In this paper we describe the architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system It is a general purpose file system for use on both workstations and servers The focus of the paper is on the mechanisms used by XFS to scale capacity and performance in supporting very large file systems The large file system support includes mechanisms for managing large files, large numbers of files, large directories, and very high performance I/O
In discussing the mechanisms used for scalability we include both descriptions of the XFS on-disk data structures and analyses of why they were chosen We discuss in detail our use of B+ trees in place of many of the more traditional linear file system structures
XFS has been shipping to customers since December of 1994 in a version of IRIX 53, and we are continuing to improve its performance and add features in upcoming releases We include performance results from running on the latest version of XFS to demonstrate the viability of our designread more
Citations
More filters
Proceedings Article
GPFS: A Shared-Disk File System for Large Computing Clusters
Frank B. Schmuck,Roger L. Haskin +1 more
TL;DR: GPFS is IBM's parallel, shared-disk file system for cluster computers, available on the RS/6000 SP parallel supercomputer and on Linux clusters, and discusses how distributed locking and recovery techniques were extended to scale to large clusters.
Journal ArticleDOI
Farsite: federated, available, and reliable storage for an incompletely trusted environment
Atul Adya,William J. Bolosky,Miguel Castro,Cermak Gerald F,Ronnie Chaiken,John R. Douceur,Jon Howell,Jacob R. Lorch,Marvin M. Theimer,Roger Wattenhofer +9 more
TL;DR: The design of Farsite is reported on and the lessons learned by implementing much of that design are reported, including how to locally caching file data, lazily propagating file updates, and varying the duration and granularity of content leases.
Journal ArticleDOI
A study of practical deduplication
TL;DR: In this paper, the authors collected file system content data from 857 desktop computers at Microsoft over a span of four weeks and analyzed the data to determine the relative efficacy of data deduplication, particularly considering whole file versus block-level elimination of redundancy.
Journal ArticleDOI
Making information flow explicit in HiStar
TL;DR: HiStar is a new operating system designed to minimize the amount of code that must be trusted, which allows users to specify precise data security policies without unduly limiting the structure of applications.
Proceedings ArticleDOI
Making information flow explicit in HiStar
TL;DR: HiStar as discussed by the authors is a new operating system designed to minimize the amount of code that must be trusted, which allows users to specify precise data security policies without unduly limiting the structure of applications.
References
More filters
Journal ArticleDOI
The design and implementation of a log-structured file system
Mendel Rosenblum,John Ousterhout +1 more
TL;DR: In this paper, a log-structured file system called Sprite LFS is proposed, which uses a segment cleaner to compress the live information from heavily fragmented segments in order to speed up file writing and crash recovery.
Journal ArticleDOI
Ubiquitous B-Tree
TL;DR: The major variations of the B-tree are discussed, especially the B+-tree, contrasting the merits and costs of each implementation and illustrating a general purpose access method that uses a B- tree.
Book
The Design and Implementation of a Log-structured file system
Mendel Rosenblum,John Ousterhout +1 more
TL;DR: A prototype log-structured file system called Sprite LFS is implemented; it outperforms current Unix file systems by an order of magnitude for small-file writes while matching or exceeding Unix performance for reads and large writes.
Journal ArticleDOI
A fast file system for UNIX
TL;DR: A reimplementation of the UNIX TM file system is described, which provides substantially higher throughput rates by using more flexible allocation policies that allow better locality of reference and can be adapted to a wide range of peripheral and processor characteristics.
Proceedings Article
File system design for an NFS file server appliance
TL;DR: WAFL (Write Anywhere File Layout) is described, which is a file system designed specifically to work in an NFS appliance, and how WAFL uses Snapshots to eliminate the need for file system consistency checking after an unclean shutdown.