scispace - formally typeset
Journal ArticleDOI

A Geographically Aware Poll-Based Distributed File Consistency Maintenance Method for P2P Systems

Haiying Shen, +1 more
- 01 Nov 2013 - 
- Vol. 24, Iss: 11, pp 2148-2159
Reads0
Chats0
TLDR
A poll-based distributed file consistency maintenance method called geographically aware wave (GeWave), which dramatically reduces the overhead and yields significant improvements on effectiveness, scalability, and churn resilience of previous consistency maintenance methods.
Abstract
File consistency maintenance in P2P systems is a technique for maintaining consistency between files and their replicas. Most previous consistency maintenance methods depend on either message spreading or structure-based pushing. Message spreading generates high overhead due to a large amount of messages; structure-based pushing methods reduce this overhead. However, both approaches cannot guarantee that every replica node receives an update in churn, because replica nodes passively wait for updates. As opposed to push-based methods that are not effective in high-churn and low-resource P2P systems, polling is churn resilient and generates low overhead. However, it is faced with a number of challenges: 1) ensuring a limited inconsistency; 2) realizing polling in a distributed manner; 3) considering physical proximity in polling; and 4) leveraging polling to further reduce polling overhead. To handle these challenges, this paper introduces a poll-based distributed file consistency maintenance method called geographically aware wave (GeWave). GeWave further reduces update overhead, enhances the fidelity of file consistency, and takes proximity into account. Using adaptive polling in a dynamic structure, GeWave avoids redundant file updates and ensures that every node receives an update in a limited time period even in churn. Furthermore, it propagates updates between geographically close nodes in a distributed manner. Extensive experimental results from the PlanetLab real-world testbed demonstrate the efficiency and effectiveness of GeWave in comparison with other representative consistency maintenance schemes. It dramatically reduces the overhead and yields significant improvements on effectiveness, scalability, and churn resilience of previous file consistency maintenance methods.

read more

Citations
More filters
Journal ArticleDOI

SORD: a new strategy of online replica deduplication in Cloud-P2P

TL;DR: A new strategy of online replica deduplication (SORD), achieving to reduce the impact on other nodes when deleting a redundant replica, which obtains superior performances in access latency around 5–15% on average and better load balance than other similar methods.
Proceedings ArticleDOI

Selective Data replication for Online Social Networks with Distributed Datacenters

TL;DR: This paper aims to reduce inter-datacenter communications while still achieving low service latency, and proposes Selective Data replication mechanism in Distributed Datacenters that incorporates three strategies to further enhance its performance: locality-aware multicast update tree, replica deactivation, and datacenter congestion control.
Journal ArticleDOI

Selective Data Replication for Online Social Networks with Distributed Datacenters

TL;DR: This paper proposes Selective Data replication mechanism in Distributed Datacenters (SD3), where in SD3, a datacenter jointly considers update rate and visit rate to select user data for replication, and further atomizes a user's different types of data for replicate, making sure that a replica always reduces inter-datacenter communication.
Journal ArticleDOI

RRSD: A file replication method for ensuring data reliability and reducing storage consumption in a dynamic Cloud-P2P environment

TL;DR: RRSD has superior performance regarding load balance, data reliability and storage consumption and can deliver an improvement of 10% for load balance and reduce storage consumption by 60% while meeting data reliability requirement compared with other similar methods.
Journal ArticleDOI

Swarm Intelligence Based File Replication and Consistency Maintenance in Structured P2P File Sharing Systems

TL;DR: SWARM is presented, a file replication mechanism based on swarm intelligence that can reduce querying latency, reduce the number of replicas, and reduce the consistency maintenance overhead by 49-99 percent compared to previous consistency maintenance methods.
References
More filters
Proceedings ArticleDOI

A scalable content-addressable network

TL;DR: The concept of a Content-Addressable Network (CAN) as a distributed infrastructure that provides hash table-like functionality on Internet-like scales is introduced and its scalability, robustness and low-latency properties are demonstrated through simulation.
Journal ArticleDOI

Chord: a scalable peer-to-peer lookup protocol for Internet applications

TL;DR: Results from theoretical analysis and simulations show that Chord is scalable: Communication cost and the state maintained by each node scale logarithmically with the number of Chord nodes.
Journal ArticleDOI

OceanStore: an architecture for global-scale persistent storage

TL;DR: OceanStore monitoring of usage patterns allows adaptation to regional outages and denial of service attacks; monitoring also enhances performance through pro-active movement of data.
Proceedings ArticleDOI

Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web

TL;DR: A family of caching protocols for distrib-uted networks that can be used to decrease or eliminate the occurrence of hot spots in the network, based on a special kind of hashing that is called consistent hashing.
Book ChapterDOI

Freenet: a distributed anonymous information storage and retrieval system

TL;DR: Freenet as discussed by the authors is an adaptive peer-to-peer network application that permits the publication, replication, and retrieval of data while protecting the anonymity of both authors and readers, but it does not provide any centralized location index.
Related Papers (5)