DIPBench: An independent benchmark for data-intensive integration processes
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
The integration of heterogeneous data sources is one of the main challenges within the area of data engineering. Due to the absence of an independent and universal benchmark for data-intensive integration processes, we propose a scalable benchmark, called DIPBench (Data Intensive Integration Process Benchmark), for evaluating the performance of integration systems. This benchmark could be used for subscription systems, like replication servers, distributed and federated DBMS or message-oriented middleware platforms like Enterprise Application Integration (EAI) servers and Extraction Transformation Loading (ETL) tools. In order to reach the mentioned universal view for integration processes, the benchmark is designed in a conceptual, process-driven way. The benchmark comprises 15 integration process types. We specify the source and target data schemas and provide a toolsuite for the initialization of the external systems, the execution of the benchmark and the monitoring of the integration system's performance. The core benchmark execution may be influenced by three scale factors. Finally, we discuss a metric unit used for evaluating the measured integration system's performance, and we illustrate our reference benchmark implementation for federated DBMS.
Details
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 2008 - IEEE 24th International Conference on Data Engineering Workshop, ICDE'08 |
| Pages | 214-221 |
| Number of pages | 8 |
| Publication status | Published - 2008 |
| Peer-reviewed | Yes |
Publication series
| Series | Proceedings - International Conference on Data Engineering |
|---|---|
| ISSN | 1084-4627 |
Conference
| Title | 2008 IEEE 24th International Conference on Data Engineering, ICDE'08 |
|---|---|
| Duration | 7 - 12 April 2008 |
| City | Cancun |
| Country | Mexico |
External IDs
| ORCID | /0000-0001-8107-2775/work/201623402 |
|---|