Cost-based vectorization of instance-based integration processes

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

Abstract

The inefficiency of integration processes-as an abstraction of workflow-based integration tasks-is often reasoned by low resource utilization and significant waiting times for external systems. With the aim to overcome these problems, we proposed the concept of process vectorization. There, instance-based integration processes are transparently executed with the pipes-and-filters execution model. Here, the term vectorization is used in the sense of processing a sequence (vector) of messages by one standing process. Although it has been shown that process vectorization achieves a significant throughput improvement, this concept has two major drawbacks. First, the theoretical performance of a vectorized integration process mainly depends on the performance of the most cost-intensive operator. Second, the practical performance strongly depends on the number of available threads. In this paper, we present an advanced optimization approach that addresses the mentioned problems. Therefore, we generalize the vectorization problem and explain how to vectorize process plans in a cost-based manner. Due to the exponential complexity, we provide a heuristic computation approach and formally analyze its optimality. In conclusion of our evaluation, the message throughput can be significantly increased compared to both the instance-based execution as well as the rule-based process vectorization.

Details

OriginalspracheEnglisch
TitelAdvances in Databases and Information Systems - 13th East European Conference, ADBIS 2009, Proceedings
Seiten253-269
Seitenumfang17
PublikationsstatusVeröffentlicht - 2009
Peer-Review-StatusJa

Publikationsreihe

ReiheLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band5739 LNCS
ISSN0302-9743

Konferenz

Titel13th East European Conference on Advances in Databases and Information Systems, ADBIS 2009
Dauer7 - 10 September 2009
StadtRiga
LandLettland

Externe IDs

ORCID /0000-0001-8107-2775/work/200630379

Schlagworte

Forschungsprofillinien der TU Dresden

Schlagwörter

  • Cost-based vectorization, Instance-based, Integration processes, Pipes and filters, Throughput optimization