Predicting Energy Consumption with StreamMine3G
Research output: Contribution to conferences › Paper › Contributed › peer-review
Contributors
Abstract
In this paper, we present our approach on solving the DEBS Grand Challenge using StreamMine3G, a distributed, highly scalable, elastic and fault tolerant ESP system. We will provide an overview about the system architecture of Stream-Mine3G and implementation details of an application aimed at consumption prediction and outlier detection. Using our elastic approach, we can provide an accurate prediction as we can keep a practically unbounded history able to deal with high volume, highly fluctuating workloads. Our system also provides techniques for dealing with incomplete data in the source stream, which is a common problem when processing data from a large number of sources. Finally, we provide performance measurements showing that we are able to process the dataset given as part of the 2014 DEBS Challenge (135 GB) at a throughput of up to 40 kEvents/s.
Details
| Original language | English |
|---|---|
| Pages | 270-275 |
| Number of pages | 6 |
| Publication status | Published - 2014 |
| Peer-reviewed | Yes |
Conference
| Title | 8th ACM International Conference on Distributed Event-Based Systems (DEBS '14), ACM, 2014 |
|---|---|
| Abbreviated title | DEBS'14 |
| Conference number | |
| Duration | 26 - 29 May 2014 |
| Degree of recognition | International event |
| Location | |
| City | New York |
| Country | United States of America |
External IDs
| Scopus | 84903196373 |
|---|
Keywords
Research priority areas of TU Dresden
DFG Classification of Subject Areas according to Review Boards
Sustainable Development Goals
Keywords
- Algorithms, Design, Reliability, Complex Event Processing, CEP, Event Stream Processing, ESP, Scalability, Migration, State Management, Fault Tolerance