Optimistic parallelization support for event stream processing systems
Publikation: Beitrag zu Konferenzen › Paper › Beigetragen › Begutachtung
Beitragende
Abstract
Event stream applications consist of an acyclic graph of com-
ponents that are traversed by streams of events. Examples
of operations in such components are filtering, aggregation,
enrichment, and transformation of events and, commonly,
applications include a mix of common-use library functions
and user-defined functions. When the operation only de-
pends on the current input events, the component can be
trivially parallelized by replication. However, if the com-
ponent keeps state that is used for the computation of the
results, the trivial parallelization approach does not work.
Parallel versions for common components have being de-
signed, but complex or user-defined components are nor-
mally limited by single thread performance. In this work,
we use optimistic parallelization approaches to harness the
potential of multi-core processors to scale the performance
of stateful operators in event stream applications. In addi-
tion, we investigate indulgent ways to allow the user to pro-
vide application knowledge that can improve the amount of
useful speculative work. The current prototype shows con-
siderable gain in throughput even though some speculative
executions must be disregarded.
ponents that are traversed by streams of events. Examples
of operations in such components are filtering, aggregation,
enrichment, and transformation of events and, commonly,
applications include a mix of common-use library functions
and user-defined functions. When the operation only de-
pends on the current input events, the component can be
trivially parallelized by replication. However, if the com-
ponent keeps state that is used for the computation of the
results, the trivial parallelization approach does not work.
Parallel versions for common components have being de-
signed, but complex or user-defined components are nor-
mally limited by single thread performance. In this work,
we use optimistic parallelization approaches to harness the
potential of multi-core processors to scale the performance
of stateful operators in event stream applications. In addi-
tion, we investigate indulgent ways to allow the user to pro-
vide application knowledge that can improve the amount of
useful speculative work. The current prototype shows con-
siderable gain in throughput even though some speculative
executions must be disregarded.
Details
Originalsprache | Englisch |
---|---|
Seiten | 7-12 |
Seitenumfang | 6 |
Publikationsstatus | Veröffentlicht - 2008 |
Peer-Review-Status | Ja |
Konferenz
Titel | MDS '08: the 5th Middleware doctoral symposium, ACM 2008 |
---|---|
Kurztitel | MDS '08 |
Veranstaltungsnummer | |
Dauer | 1 Dezember 2008 |
Bekanntheitsgrad | Internationale Veranstaltung |
Ort | |
Stadt | New York |
Land | USA/Vereinigte Staaten |
Externe IDs
Scopus | 77954004165 |
---|
Schlagworte
Forschungsprofillinien der TU Dresden
DFG-Fachsystematik nach Fachkollegium
Schlagwörter
- Event stream processing, software transactional memory, optimistic parallelization