Cost-based vectorization of instance-based integration processes
Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung
Beitragende
Abstract
The inefficiency of integration processes-as an abstraction of workflow-based integration tasks-is often reasoned by low resource utilization and significant waiting times for external systems. With the aim to overcome these problems, we proposed the concept of process vectorization. There, instance-based integration processes are transparently executed with the pipes-and-filters execution model. Here, the term vectorization is used in the sense of processing a sequence (vector) of messages by one standing process. Although it has been shown that process vectorization achieves a significant throughput improvement, this concept has two major drawbacks. First, the theoretical performance of a vectorized integration process mainly depends on the performance of the most cost-intensive operator. Second, the practical performance strongly depends on the number of available threads. In this paper, we present an advanced optimization approach that addresses the mentioned problems. Therefore, we generalize the vectorization problem and explain how to vectorize process plans in a cost-based manner. Due to the exponential complexity, we provide a heuristic computation approach and formally analyze its optimality. In conclusion of our evaluation, the message throughput can be significantly increased compared to both the instance-based execution as well as the rule-based process vectorization.
Details
| Originalsprache | Englisch |
|---|---|
| Titel | Advances in Databases and Information Systems - 13th East European Conference, ADBIS 2009, Proceedings |
| Seiten | 253-269 |
| Seitenumfang | 17 |
| Publikationsstatus | Veröffentlicht - 2009 |
| Peer-Review-Status | Ja |
Publikationsreihe
| Reihe | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
|---|---|
| Band | 5739 LNCS |
| ISSN | 0302-9743 |
Konferenz
| Titel | 13th East European Conference on Advances in Databases and Information Systems, ADBIS 2009 |
|---|---|
| Dauer | 7 - 10 September 2009 |
| Stadt | Riga |
| Land | Lettland |
Externe IDs
| ORCID | /0000-0001-8107-2775/work/200630379 |
|---|
Schlagworte
Forschungsprofillinien der TU Dresden
DFG-Fachsystematik nach Fachkollegium
ASJC Scopus Sachgebiete
Schlagwörter
- Cost-based vectorization, Instance-based, Integration processes, Pipes and filters, Throughput optimization