ViewBox: integrating local file systems with cloud storage services
Yupu Zhang,Chris Dragga,Andrea C. Arpaci-Dusseau,Remzi H. Arpaci-Dusseau +3 more
- pp 119-132
TLDR
ViewBox is presented, an integrated synchronization service and local file system that provides freedom from data corruption and inconsistency that detects and recovers from both Corruption and inconsistency, while incurring minimal overhead.Abstract:
Cloud-based file synchronization services have become enormously popular in recent years, both for their ability to synchronize files across multiple clients and for the automatic cloud backups they provide. However, despite the excellent reliability that the cloud back-end provides, the loose coupling of these services and the local file system makes synchronized data more vulnerable than users might believe. Local corruption may be propagated to the cloud, polluting all copies on other devices, and a crash or untimely shutdown may lead to inconsistency between a local file and its cloud copy. Even without these failures, these services cannot provide causal consistency.To address these problems, we present ViewBox, an integrated synchronization service and local file system that provides freedom from data corruption and inconsistency. ViewBox detects these problems using ext4-cksum, a modified version of ext4, and recovers from them using a user-level daemon, cloud helper, to fetch correct data from the cloud. To provide a stable basis for recovery, ViewBox employs the view manager on top of ext4-cksum. The view manager creates and exposes views, consistent in-memory snapshots of the file system, which the synchronization client then uploads. Our experiments show that ViewBox detects and recovers from both corruption and inconsistency, while incurring minimal overhead.read more
Citations
More filters
Journal ArticleDOI
Blockchain-based fair payment smart contract for public cloud storage auditing
TL;DR: To reduce the number of interactions in the execution of contract, the notion of non-interactive public provable data possession is presented and a blockchain-based smart contract for public cloud storage auditing based on this primitive is designed.
Proceedings Article
SCFS: a shared cloud-backed file system
Alysson Bessani,Ricardo Mendes,Tiago Ribeiro de Oliveira,Nuno Neves,Miguel Correia,Marcelo Pasin,Paulo Veríssimo +6 more
TL;DR: SCFS provides a pluggable backplane that allows it to work with various storage clouds or a cloud-of-clouds (for added dependability) and exploits some design opportunities inherent in the current cloud services through a set of novel ideas for cloud-backed file systems.
Proceedings ArticleDOI
Towards Network-level Efficiency for Cloud Storage Services
Zhenhua Li,Cheng Jin,Tianyin Xu,Christo Wilson,Yao Liu,Linsong Cheng,Yunhao Liu,Yafei Dai,Zhi-Li Zhang +8 more
TL;DR: A novel metric named TUE is defined to quantify the Traffic Usage Efficiency} of data synchronization of cloud storage services and demonstrates that a considerable portion of the data sync traffic is in a sense wasteful, and can be effectively avoided or significantly reduced via carefully designed data sync mechanisms.
Proceedings ArticleDOI
QuickSync: Improving Synchronization Efficiency for Mobile Cloud Storage Services
TL;DR: This paper proposes QuickSync, a system with three novel techniques to improve the sync efficiency for mobile cloud storage services, and proposes to build the system on two commercial sync services.
Proceedings ArticleDOI
Smart cities and the Internet of Things
TL;DR: The smart city concept is explored and a strategy development model for the implementation of IoT systems in a smart city context is proposed.
References
More filters
Proceedings Article
File system design for an NFS file server appliance
TL;DR: WAFL (Write Anywhere File Layout) is described, which is a file system designed specifically to work in an NFS appliance, and how WAFL uses Snapshots to eliminate the need for file system consistency checking after an unclean shutdown.
Proceedings ArticleDOI
An empirical study of operating systems errors
TL;DR: A study of operating system errors found by automatic, static, compiler analysis applied to the Linux and OpenBSD kernels found that device drivers have error rates up to three to seven times higher than the rest of the kernel.
Proceedings ArticleDOI
Bugs as deviant behavior: a general approach to inferring errors in systems code
TL;DR: Six checkers are developed that extract beliefs by tailoring rule "templates" to a system --- for example, finding all functions that fit the rule template "a must be paired with b."
Proceedings Article
Scalability in the XFS file system
TL;DR: The architecture and design of a new file system, XFS, for Silicon Graphics' IRIX operating system is described, and the use of B+ trees in place of many of the more traditional linear file system structures are discussed.
Proceedings ArticleDOI
Inside dropbox: understanding personal cloud storage services
TL;DR: This paper is the first to study Dropbox, which is shown to be the most widely-used cloud storage system, already accounting for a volume equivalent to around one third of the YouTube traffic at campus networks on some days.
Related Papers (5)
Windows Azure Storage: a highly available cloud storage service with strong consistency
Brad Calder,Ju Wang,Aaron W. Ogus,Niranjan Nilakantan,Arild E. Skjolsvold,Sam McKelvie,Yikang Xu,Shashwat Srivastav,Jiesheng Wu,Huseyin Simitci,Jaidev Haridas,Chakravarthy Uddaraju,Hemal Khatri,Andrew James Edwards,Vaman Bedekar,Mainali Shane Kumar,Rafay Abbasi,Arpit Agarwal,Mian Fahim ul Haq,Muhammad Ikram ul Haq,Deepali Bhardwaj,Sowmya Dayanand,Anitha Adusumilli,Marvin McNett,Sriram Sankaran,Kavitha Manivannan,Leonidas Rigas +26 more