Proceedings ArticleDOI
DZMQ: A Decentralized Distributed Messaging System for Realtime Web Applications and Services
Fei Yang,Xiaojun Ye,Yong Zhang,Chunxiao Xing +3 more
- pp 165-171
Reads0
Chats0
TLDR
This paper presents a decentralized distributed architecture based on peer to peer model, in which the message system can be used to develop large scale web applications and services and provide high-performance services to users.Abstract:
Message-oriented middleware especially for message queue has been widely used in web applications and services. Performance and scalability are quite essential in these systems however they often become the bottleneck. Existing message queues are not able to scale out elastically very well. This paper presents a decentralized distributed architecture based on peer to peer model, in which we always deliver messages with zero or one hop and take advantage of zero-copy. We implemented a scaling algorithm that can be adapted to the dynamic scale of requests and make the system scale out elastically. A series of workload tests have proved that our system can have low response latency and achieve linear increasing throughput. With these desired properties, the message system can be used to develop large scale web applications and services and provide high-performance services to users.read more
Citations
More filters
Proceedings ArticleDOI
Kafka and Its Using in High-throughput and Reliable Message Distribution
TL;DR: Though Kafka is still able to be improved in some aspects, it's expected to have broad development prospects as it is suitable for both online and offline processing simultaneously.
Journal ArticleDOI
Toward a General Distributed Messaging Framework for Online Transaction Processing Applications
TL;DR: This paper presents a general distributed messaging framework for online transaction processing applications in e-business industry, and it is named as Metamorphosis (MetaQ), which has features of high availability, scalability, and high data throughput.
Journal ArticleDOI
Binary Log Design for One-Way Data Replication with ZeroMQ
TL;DR: This research will discuss how to develop a synchronization system by utilizing Binary Log from MySQL to recognize data changes, inherit changes, send changes, and hopefully can contribute new alternative method in developing real time database synchronization.
References
More filters
Proceedings ArticleDOI
Chord: A scalable peer-to-peer lookup service for internet applications
TL;DR: Results from theoretical analysis, simulations, and experiments show that Chord is scalable, with communication cost and the state maintained by each node scaling logarithmically with the number of Chord nodes.
Book ChapterDOI
The Byzantine generals problem
TL;DR: In this article, a group of generals of the Byzantine army camped with their troops around an enemy city are shown to agree upon a common battle plan using only oral messages, if and only if more than two-thirds of the generals are loyal; so a single traitor can confound two loyal generals.
Proceedings ArticleDOI
Dynamo: amazon's highly available key-value store
Giuseppe deCandia,Deniz Hastorun,Madan Mohan Rao Jampani,Gunavardhan Kakulapati,Avinash Lakshman,Alex Pilchin,Swaminathan Sivasubramanian,Peter Sven Vosshall,Werner Vogels +8 more
TL;DR: D Dynamo is presented, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience and makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.
Proceedings ArticleDOI
Practical Byzantine fault tolerance
Miguel Castro,Barbara Liskov +1 more
TL;DR: A new replication algorithm that is able to tolerate Byzantine faults that works in asynchronous environments like the Internet and incorporates several important optimizations that improve the response time of previous algorithms by more than an order of magnitude.
Journal ArticleDOI
The part-time parliament
TL;DR: The Paxon parliament's protocol provides a new way of implementing the state machine approach to the design of distributed systems.