Efficient Query Processing for Dynamically Changing Datasets.

Publikation: Beitrag in FachzeitschriftForschungsartikelBeigetragenBegutachtung

Beitragende

  • Muhammad Idris - , Université libre de Bruxelles (ULB) (Autor:in)
  • Martín Ugarte - , Pontificia Universidad Católica de Chile (Autor:in)
  • Stijn Vansummeren - , Université libre de Bruxelles (ULB) (Autor:in)
  • Hannes Voigt - , Neo4j, Inc. (Autor:in)
  • Wolfgang Lehner - , Technische Universität Dresden (Autor:in)

Abstract

The ability to efficiently analyze changing data is a key requirement of many real-time analytics applications. Traditional approaches to this problem were developed around the notion of Incremental View Maintenance (IVM), and are based either on the materialization of subresults (to avoid their recomputation) or on the recomputation of subresults (to avoid the space overhead of materialization). Both techniques are suboptimal: Instead of materializing results and subresults, one may also maintain a data structure that supports efficient maintenance under updates and from which the full query result can quickly be enumerated. In two previous articles, we have presented algorithms for dynamically evaluating queries that are easy to implement, efficient, and can be naturally extended to evaluate queries from a wide range of application domains. In this paper, we discuss our algorithm and its complexity, explaining the main components behind its efficiency. Finally, we show experiments that compare our algorithm to a state-of-the-art (Higher-order) IVM engine, as well as to a prominent complex event recognition engine. Our approach outperforms the competitor systems by up to two orders of magnitude in processing time, and one order in memory consumption.

Details

OriginalspracheEnglisch
Aufsatznummer1
Seiten (von - bis)33-40
Seitenumfang8
FachzeitschriftSIGMOD record
Jahrgang48
Ausgabenummer1
PublikationsstatusVeröffentlicht - März 2019
Peer-Review-StatusJa
Extern publiziertJa

Externe IDs

Scopus 85074859062
ORCID /0000-0001-8107-2775/work/142253462

Schlagworte

ASJC Scopus Sachgebiete