Predicting Energy Consumption with StreamMine3G
Research output: Contribution to conferences › Paper › Contributed › peer-review
Contributors
Abstract
In this paper, we present our approach on solving the DEBS Grand Challenge using StreamMine3G, a distributed, highly scalable, elastic and fault tolerant ESP system. We will provide an overview about the system architecture of Stream-Mine3G and implementation details of an application aimed at consumption prediction and outlier detection. Using our elastic approach, we can provide an accurate prediction as we can keep a practically unbounded history able to deal with high volume, highly fluctuating workloads. Our system also provides techniques for dealing with incomplete data in the source stream, which is a common problem when processing data from a large number of sources. Finally, we provide performance measurements showing that we are able to process the dataset given as part of the 2014 DEBS Challenge (135 GB) at a throughput of up to 40 kEvents/s.
Details
Original language | English |
---|---|
Pages | 270-275 |
Number of pages | 6 |
Publication status | Published - 2014 |
Peer-reviewed | Yes |
Conference
Title | 8th ACM International Conference on Distributed Event-Based Systems (DEBS '14), ACM, 2014 |
---|---|
Abbreviated title | DEBS'14 |
Conference number | |
Duration | 26 - 29 May 2014 |
Degree of recognition | International event |
Location | |
City | New York |
Country | United States of America |
External IDs
Scopus | 84903196373 |
---|
Keywords
Research priority areas of TU Dresden
DFG Classification of Subject Areas according to Review Boards
Sustainable Development Goals
Keywords
- Algorithms, Design, Reliability, Complex Event Processing, CEP, Event Stream Processing, ESP, Scalability, Migration, State Management, Fault Tolerance