General dynamic Yannakakis: conjunctive queries with theta joins under updates

Publikation: Beitrag in FachzeitschriftForschungsartikelBeigetragenBegutachtung

Beitragende

Abstract

The ability to efficiently analyze changing data is a key requirement of many real-time analytics applications. In prior work, we have proposed general dynamic Yannakakis (GDyn), a general framework for dynamically processing acyclic conjunctive queries with θ-joins in the presence of data updates. Whereas traditional approaches face a trade-off between materialization of subresults (to avoid inefficient recomputation) and recomputation of subresults (to avoid the potentially large space overhead of materialization), GDyn is able to avoid this trade-off. It intelligently maintains a succinct data structure that supports efficient maintenance under updates and from which the full query result can quickly be enumerated. In this paper, we consolidate and extend the development of GDyn. First, we give full formal proof of GDyn ’s correctness and complexity. Second, we present a novel algorithm for computing GDyn query plans. Finally, we instantiate GDyn to the case where all θ-joins are inequalities and present extended experimental comparison against state-of-the-art engines. Our approach performs consistently better than the competitor systems with multiple orders of magnitude improvements in both time and memory consumption.

Details

OriginalspracheEnglisch
Seiten (von - bis)619-653
Seitenumfang35
FachzeitschriftThe VLDB journal
Jahrgang29
Ausgabenummer2-3
PublikationsstatusVeröffentlicht - 1 Mai 2020
Peer-Review-StatusJa

Externe IDs

Scopus 85075370130
dblp journals/vldb/IdrisUVVL20

Schlagworte

Schlagwörter

  • Acyclic joins, Complex event processing, Dynamic query processing, Incremental view maintenance, Inequalities, Theta joins