Open AccessProceedings Article
On Load Shedding in Complex Event Processing
Yeye He,Siddharth Barman,Jeffrey F. Naughton +2 more
- pp 213-224
TLDR
This paper formalizes broad classes of CEP load-shedding scenarios as different optimization problems and demonstrates an array of complexity results that reveal the hardness of these problems and construct shedding algorithms with performance guarantees.Abstract:
Complex Event Processing (CEP) is a stream processing model that focuses on detecting event patterns in continuous event streams. While the CEP model has gained popularity in the research communities and commercial technologies, the problem of gracefully degrading performance under heavy load in the presence of resource constraints, or load shedding, has been largely overlooked. CEP is similar to “classical” stream data management, but addresses a substantially different class of queries. This unfortunately renders the load shedding algorithms developed for stream data processing inapplicable. In this paper we study CEP load shedding under various resource constraints. We formalize broad classes of CEP load-shedding scenarios as different optimization problems. We demonstrate an array of complexity results that reveal the hardness of these problems and construct shedding algorithms with performance guarantees. Our results shed some light on the difficulty of developing load-shedding algorithms that maximize utility.read more
Citations
More filters
Journal ArticleDOI
When things matter
Yongrui Qin,Quan Z. Sheng,Nickolas Falkner,Schahram Dustdar,Hua Wang,Athanasios V. Vasilakos +5 more
TL;DR: The main techniques and state-of-the-art research efforts in IoT from data-centric perspectives are reviewed, including data stream processing, data storage models, complex event processing, and searching in IoT.
Posted Content
When Things Matter: A Data-Centric View of the Internet of Things
Yongrui Qin,Quan Z. Sheng,Nickolas Falkner,Schahram Dustdar,Hua Wang,Athanasios V. Vasilakos +5 more
TL;DR: The main techniques and state-of-the-art research efforts in IoT from data-centric perspectives are surveyed, including data stream processing, data storage models, complex event processing, and searching in IoT.
Proceedings ArticleDOI
Load-aware shedding in stream processing systems
TL;DR: This paper provides a theoretical analysis proving that LAS is an (ε, δ)-approximation of the optimal online load shedder and shows its performance through a practical evaluation based both on simulations and on a running prototype.
Journal ArticleDOI
Microblogs data management: a survey
TL;DR: This paper reviews core components that enable large-scale querying and indexing for microblogs data, and discusses system-level issues and on-going effort on supporting microblogs through the rising wave of big data systems.
Proceedings ArticleDOI
Load Shedding for Complex Event Processing: Input-based and State-based Techniques
TL;DR: This work introduces a hybrid model that combines both input-based and statebased shedding to achieve high result quality under constrained resources and indicates that such hybrid shedding improves the recall by up to 14× for synthetic data and 11.4× for real-world data, compared to baseline approaches.
References
More filters
Book ChapterDOI
Memory-limited execution of windowed stream joins
TL;DR: It is shown formally that neither approximation can be addressed effectively for a sliding-window join of arbitrary input streams, and a broad class of applications for which an age-based model of stream arrival is more appropriate is pointed out.
Proceedings Article
SASE: Complex Event Processing over Streams
TL;DR: This work designs a complex event language for specifying application logic for such transformation, devise new query processing techniques to efficiently implement the language, and develop a comprehensive system that collects, cleans, and processes RFID data for delivery of relevant, timely information as well as storing necessary data for future querying.
Journal ArticleDOI
The complexity of approximating a nonlinear program
Mihir Bellare,Phillip Rogaway +1 more
TL;DR: This work considers the problem of finding the maximum of a multivariate polynomial inside a convex polytope and shows that even when the polynomic is quadratic there is no polynometric time approximation unless NP is contained in quasi-polynomial time.
Proceedings ArticleDOI
Sequence Pattern Query Processing over Out-of-Order Event Streams
TL;DR: This work proposes two alternate solutions: aggressive and conservative strategies respectively to process sequence pattern queries on out-of-order event streams and proposes a partial order guarantee (POG) model under which such correctness can be guaranteed.