Direct transformation techniques for compressed data: General approach and application scenarios

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

Abstract

Lightweight data compression techniques like dictionary or run-length compression play an important role in main memory database systems. Having decided for a compression scheme for a dataset, the transformation to another scheme is very inefficient today. The common approach works as follows: First, the compressed data is decompressed using the source decompression algorithm resulting in the materialization of the raw data in main memory. Second, the compression algorithm of the destination scheme is applied. This indirect way relies on existing algorithms, but is very inefficient, since the whole uncompressed data has to be materialized as an intermediate step. To overcome these drawbacks, we propose a novel approach called direct transformation, which avoids the materialization of the whole uncompressed data. Our techniques are cache optimized to reduce necessary data accesses. Moreover, we present application scenarios, where such direct transformations can be efficiently applied.

Details

OriginalspracheEnglisch
TitelAdvances in Databases and Information Systems
Redakteure/-innenLadjel Bellatreche, Tadeusz Morzy, Patrick Valduriez
Herausgeber (Verlag)Springer-Verlag
Seiten151-165
Seitenumfang15
ISBN (elektronisch)978-3-319-23135-8
ISBN (Print)978-3-319-23134-1
PublikationsstatusVeröffentlicht - 2015
Peer-Review-StatusJa

Publikationsreihe

ReiheLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band9282
ISSN0302-9743

Konferenz

Titel19th East European Conference on Advances in Databases and Information Systems, ADBIS 2015
Dauer8 - 11 September 2015
StadtPoitiers
LandFrankreich

Externe IDs

ORCID /0000-0001-8107-2775/work/199215564

Schlagworte

Forschungsprofillinien der TU Dresden

Fächergruppen, Lehr- und Forschungsbereiche, Fachgebiete nach Destatis

Schlagwörter

  • Efficient algorithms, Lightweight data compression, Main memory database systems