DIPBench: An independent benchmark for data-intensive integration processes

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

Abstract

The integration of heterogeneous data sources is one of the main challenges within the area of data engineering. Due to the absence of an independent and universal benchmark for data-intensive integration processes, we propose a scalable benchmark, called DIPBench (Data Intensive Integration Process Benchmark), for evaluating the performance of integration systems. This benchmark could be used for subscription systems, like replication servers, distributed and federated DBMS or message-oriented middleware platforms like Enterprise Application Integration (EAI) servers and Extraction Transformation Loading (ETL) tools. In order to reach the mentioned universal view for integration processes, the benchmark is designed in a conceptual, process-driven way. The benchmark comprises 15 integration process types. We specify the source and target data schemas and provide a toolsuite for the initialization of the external systems, the execution of the benchmark and the monitoring of the integration system's performance. The core benchmark execution may be influenced by three scale factors. Finally, we discuss a metric unit used for evaluating the measured integration system's performance, and we illustrate our reference benchmark implementation for federated DBMS.

Details

OriginalspracheEnglisch
TitelProceedings of the 2008 - IEEE 24th International Conference on Data Engineering Workshop, ICDE'08
Seiten214-221
Seitenumfang8
PublikationsstatusVeröffentlicht - 2008
Peer-Review-StatusJa

Publikationsreihe

ReiheProceedings - International Conference on Data Engineering
ISSN1084-4627

Konferenz

Titel2008 IEEE 24th International Conference on Data Engineering, ICDE'08
Dauer7 - 12 April 2008
StadtCancun
LandMexiko

Externe IDs

ORCID /0000-0001-8107-2775/work/201623402

Schlagworte

Forschungsprofillinien der TU Dresden

Fächergruppen, Lehr- und Forschungsbereiche, Fachgebiete nach Destatis