Limitations of intra-operator parallelism using heterogeneous computing resources

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributedpeer-review

Contributors

  • Tomas Karnagel - , TUD Dresden University of Technology (Author)
  • Dirk Habich - , TUD Dresden University of Technology (Author)
  • Wolfgang Lehner - , TUD Dresden University of Technology (Author)

Abstract

The hardware landscape is changing from homogeneous multi-core systems towards wildly heterogeneous systems combining different computing units, like CPUs and GPUs. To utilize these heterogeneous environments, database query execution has to adapt to cope with different architectures and computing behaviors. In this paper, we investigate the simple idea of partitioning an operator’s input data and processing all data partitions in parallel, one partition per computing unit. For heterogeneous systems, data has to be partitioned according to the performance of the computing units. We define a way to calculate the partition sizes, analyze the parallel execution exemplarily for two database operators, and present limitations that could hinder significant performance improvements. The findings in this paper can help system developers to assess the possibilities and limitations of intra-operator parallelism in heterogeneous environments, leading to more informed decisions if this approach is beneficial for a given workload and hardware environment.

Details

Original languageEnglish
Title of host publicationAdvances in Databases and Information Systems - 20th East European Conference, ADBIS 2016, Proceedings
EditorsPetr Šaloun, Mirjana Ivanović, Jaroslav Pokorný, Bernhard Thalheim
PublisherSpringer, Berlin [u. a.]
Pages291-305
Number of pages15
ISBN (print)9783319440385
Publication statusPublished - 2016
Peer-reviewedYes
Externally publishedYes

Publication series

SeriesLecture Notes in Computer Science, Volume 9809
ISSN0302-9743

Conference

Title20th East European Conference on Advances in Databases and Information Systems, ADBIS 2016
Duration28 - 31 August 2016
CityPrague
CountryCzech Republic

External IDs

ORCID /0000-0001-8107-2775/work/142253539

Keywords

Keywords

  • Data partitioning, Dataflow parallelism, GPU, Heterogeneous systems, Intra-operator parallelism

Library keywords