Proceedings ArticleDOI
Non-volatile memory for fast, reliable file systems
Mary Baker,Satoshi Asami,Etienne Deprit,John Ouseterhout,Margo Seltzer +4 more
- Vol. 27, Iss: 9, pp 10-22
Reads0
Chats0
TLDR
The trace-driven simulation and analysis of two uses of NVRAM to improve I/O performance in distributed file systems are presented: non-volatile file caches on client workstations to reduce write traffic to file servers, and write buffers for write-optimized file systems to reduce server disk accesses.Abstract:
Given the decreasing cost of non-volatile RAM (NVRAM), by the late 1990’s it will be feasible for most workstations to include a megabyte or more of NVRAM, enabling the design of higher-performance, more reliable systems. We present the trace-driven simulation and analysis of two uses of NVRAM to improve I/O performance in distributed file systems: non-volatile file caches on client workstations to reduce write traffic to file servers, and write buffers for write-optimized file systems to reduce server disk accesses. Our results show that a megabyte of NVRAM on diskless clients reduces the amount of file data written to the server by 40 to 50%. Increasing the amount of NVRAM shows rapidly diminishing returns, and the particular NVRAM block replacement policy makes little difference to write traffic. Closely integrating the NVRAM with the volatile cache provides the best total traffic reduction. At today’s prices, volatile memory provides a better performance improvement per dollar than NVRAM for client caching, but as volatile cache sizes increase and NVRAM becomes cheaper, NVRAM will become cost effective. On the server side, providing a one-half megabyte write-buffer per file system reduces disk accesses by about 20% on most of the measured logstructured file systems (LFS), and by 90% on one heavilyused file system that includes transaction-processing workloads.read more
Citations
More filters
Journal ArticleDOI
Write off-loading: Practical power management for enterprise storage
TL;DR: In this paper, the authors analyzed block-level traces from 36 volumes in an enterprise data center for one week and concluded that significant idle periods exist, and that they can be further increased by modifying the read/write patterns using write offloading.
Journal ArticleDOI
eNVy: a non-volatile, main memory storage system
Michael Wu,Willy Zwaenepoel +1 more
TL;DR: NVy as mentioned in this paper is a large non-volatile main memory storage system built primarily with Flash memory, which presents its storage space as a linear, memory mapped array rather than as an emulated disk in order to provide an efficient and easy to use software interface.
Book
Serverless Network File Systems
Thomas Anderson,Mike Dahlin,Jeanna M. Neefe,David A. Patterson,Drew Roselli,Randolph Y. Wang +5 more
TL;DR: A new paradigm for network file system design, serverless network file systems that utilizes workstations cooperating as peers to provide all file system services to provide better performance and scalability than traditional file systems.
Journal ArticleDOI
The HP AutoRAID hierarchical storage system
TL;DR: The technology described, know as HP AutoRAID, automatically and transparently manages migration of data blocks between these two levels as access patterns change, resulting in a fully redundant storage system that is extremely easy to use, is suitable for a wide variety of workloads, and performs much better than disk arrays with comparable numbers of spindles and much larger amounts of front-end RAM cache.
Proceedings ArticleDOI
Characterizing flash memory: anomalies, observations, and applications
Laura M. Grupp,Adrian M. Caulfield,Joel Coburn,Steven Swanson,Eitan Yaakobi,Paul H. Siegel,Jack K. Wolf +6 more
TL;DR: This work empirically characterized flash memory technology from five manufacturers by directly measuring the performance, power, and reliability, and demonstrates that performance varies significantly between vendors, devices, and from publicly available datasheets.
References
More filters
Journal ArticleDOI
The design and implementation of a log-structured file system
Mendel Rosenblum,John Ousterhout +1 more
TL;DR: In this paper, a log-structured file system called Sprite LFS is proposed, which uses a segment cleaner to compress the live information from heavily fragmented segments in order to speed up file writing and crash recovery.
Book
The Design and Implementation of a Log-structured file system
Mendel Rosenblum,John Ousterhout +1 more
TL;DR: A prototype log-structured file system called Sprite LFS is implemented; it outperforms current Unix file systems by an order of magnitude for small-file writes while matching or exceeding Unix performance for reads and large writes.
Journal ArticleDOI
A fast file system for UNIX
TL;DR: A reimplementation of the UNIX TM file system is described, which provides substantially higher throughput rates by using more flexible allocation policies that allow better locality of reference and can be adapted to a wide range of peripheral and processor characteristics.
Book
Design and implementation of the Sun network filesystem
TL;DR: The Sun Network Fllesystem provides transparent, remote access to mesystems and uses an External Data Representation (XDR) specification to descnoe protocols in a machine and system independent way.
Journal ArticleDOI
The Sprite network operating system
TL;DR: The discussion covers: the application interface: the basic kernel structure; management of the file name space and file data, virtual memory; and process migration.