Open AccessProceedings Article
TelegraphCQ: Continuous Dataflow Processing for an Uncertain World.
Sirish Chandrasekaran,Owen Cooper,Amol Deshpande,Michael J. Franklin,Joseph M. Hellerstein,Wei Hong,Sailesh Krishnamurthy,Samuel Madden,Vijayshankar Raman,Frederick Reiss,Mehul A. Shah +10 more
TLDR
The next generation Telegraph system, called TelegraphCQ, is focused on meeting the challenges that arise in handling large streams of continuous queries over high-volume, highly-variable data streams and leverages the PostgreSQL open source code base.Abstract:
Increasingly pervasive networks are leading towards a world where data is constantly in motion. In such a world, conventional techniques for query processing, which were developed under the assumption of a far more static and predictable computational environment, will not be sufficient. Instead, query processors based on adaptive dataflow will be necessary. The Telegraph project has developed a suite of novel technologies for continuously adaptive query processing. The next generation Telegraph system, called TelegraphCQ, is focused on meeting the challenges that arise in handling large streams of continuous queries over high-volume, highly-variable data streams. In this paper, we describe the system architecture and its underlying technology, and report on our ongoing implementation effort, which leverages the PostgreSQL open source code base. We also discuss open issues and our research agenda.read more
Citations
More filters
Pyragrid: Bringing Peer-to-Peer and Grid Architectures Together.
TL;DR: The Pyragrid architecture is presented, a novel distributed database system that borrows the principle of locating data used in a peer-to-peer system and extends it to more complex functionality and types of processing.
Journal ArticleDOI
High frequency batch-oriented computations over large sliding time windows
TL;DR: A model for batch processing based on overlapping sliding time windows that allows to increase the frequency of batches is proposed and is well suited to scenarios characterized by large data volumes, observation windows in the order of hours (or days) and frequent updates.
Journal Article
Causality Join Query Processing for Data Streams via a Spatiotemporal Sliding Window.
Oje Kwon,Ki-Joune Li +1 more
TL;DR: The result shows that the accuracy of causality join query processing in data streams with respect to the simple FIFO strategy can be improved.
Proceedings ArticleDOI
Data Types and Operations for Spatio-temporal Data Streams
TL;DR: This paper presents a data model, consisting of data types and operations on these data types, needed to support spatio-temporal data in a data stream management system, formally defined using many sorted algebra, and illustrated through an SQL-like query language.
Book ChapterDOI
iJoin: Importance-Aware Join Approximation over Data Streams
TL;DR: This work proposes a novel framework, called iJoin, which overcomes these drawbacks, maximizes result importance, and has the best performance compared to earlier work.
References
More filters
Journal ArticleDOI
TAG: a Tiny AGgregation service for Ad-Hoc sensor networks
TL;DR: This work presents the Tiny AGgregation (TAG) service for aggregation in low-power, distributed, wireless environments, and discusses a variety of optimizations for improving the performance and fault tolerance of the basic solution.
Proceedings ArticleDOI
Models and issues in data stream systems
TL;DR: The need for and research issues arising from a new model of data processing, where data does not take the form of persistent relations, but rather arrives in multiple, continuous, rapid, time-varying data streams are motivated.
Journal ArticleDOI
The click modular router
TL;DR: On conventional PC hardware, the Click IP router achieves a maximum loss-free forwarding rate of 333,000 64-byte packets per second, demonstrating that Click's modular and flexible architecture is compatible with good performance.
Proceedings ArticleDOI
The Click modular router
TL;DR: The Click IP router can forward 64-byte packets at 73,000 packets per second, just 10% slower than Linux alone, and is easy to extend by adding additional elements, which are demonstrated with augmented configurations.