Cost-based vectorization of instance-based integration processes
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
The inefficiency of integration processes-as an abstraction of workflow-based integration tasks-is often reasoned by low resource utilization and significant waiting times for external systems. With the aim to overcome these problems, we proposed the concept of process vectorization. There, instance-based integration processes are transparently executed with the pipes-and-filters execution model. Here, the term vectorization is used in the sense of processing a sequence (vector) of messages by one standing process. Although it has been shown that process vectorization achieves a significant throughput improvement, this concept has two major drawbacks. First, the theoretical performance of a vectorized integration process mainly depends on the performance of the most cost-intensive operator. Second, the practical performance strongly depends on the number of available threads. In this paper, we present an advanced optimization approach that addresses the mentioned problems. Therefore, we generalize the vectorization problem and explain how to vectorize process plans in a cost-based manner. Due to the exponential complexity, we provide a heuristic computation approach and formally analyze its optimality. In conclusion of our evaluation, the message throughput can be significantly increased compared to both the instance-based execution as well as the rule-based process vectorization.
Details
| Original language | English |
|---|---|
| Title of host publication | Advances in Databases and Information Systems - 13th East European Conference, ADBIS 2009, Proceedings |
| Pages | 253-269 |
| Number of pages | 17 |
| Publication status | Published - 2009 |
| Peer-reviewed | Yes |
Publication series
| Series | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
|---|---|
| Volume | 5739 LNCS |
| ISSN | 0302-9743 |
Conference
| Title | 13th East European Conference on Advances in Databases and Information Systems, ADBIS 2009 |
|---|---|
| Duration | 7 - 10 September 2009 |
| City | Riga |
| Country | Latvia |
External IDs
| ORCID | /0000-0001-8107-2775/work/200630379 |
|---|
Keywords
Research priority areas of TU Dresden
DFG Classification of Subject Areas according to Review Boards
ASJC Scopus subject areas
Keywords
- Cost-based vectorization, Instance-based, Integration processes, Pipes and filters, Throughput optimization