FUGU: Elastic Data Stream Processing with Latency Constraints.
Research output: Contribution to journal › Research article › Contributed › peer-review
Contributors
Abstract
Elasticity describes the ability of any distributed system to scale to a varying number of hosts in response to workload changes. It has become a mandatory architectural property for state of the art cloud-based data stream processing systems, as it allows treatment of unexpected load peaks and cost-efficient execution at the same time. Although such systems scale automatically, the user still needs to set configuration parameters of a scaling policy. This configuration is cumbersome and error-prone. In this paper we propose an approach that tries to remove this burden from the user. We present our data stream processing system FUGU, which optimizes the selected scaling policy automatically using an online parameter optimization approach. In addition, we demonstrate how our system considers user-defined end to end latency constraints during the scaling process.
Details
Original language | English |
---|---|
Pages (from-to) | 73-81 |
Number of pages | 9 |
Journal | IEEE Data Engineering Bulletin |
Volume | 38 |
Issue number | 4 |
Publication status | Published - 2015 |
Peer-reviewed | Yes |
Keywords
Research priority areas of TU Dresden
DFG Classification of Subject Areas according to Review Boards
Keywords
- dblp