Steering Memory Deduplication in Multi-Tenant Database Systems

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung

Beitragende

Abstract

Improving the memory density of in-memory columnar databases is a necessary step towards more efficient sharing of hardware in multi-tenant systems. Many general-purpose tools attempt to achieve this by scanning systems for duplicate memory regions, and deduplicating these redundancies. In this paper, we show that existing tools sacrifice efficiency for general-applicability, and outline the possibilities unlocked by tapping into the architectural guarantees, and existing metadata for in-memory databases. Based on our previous work on deduplication, where we used a hardware-accelerated delta mechanism to increase memory savings, we detail a process for semantics-based steering of this mechanism. This significantly reduces the search space for duplicates, by only comparing database columns which exhibit similar features. Furthermore, we gracefully handle cases where steering causes the comparison of mismatched columns. We benchmark our solution against the widely available Linux Kernel Samepage Merging (KSM) tool, evaluating both based on their achieved memory savings and execution speed for deduplicating the Internet Movie Data Base (IMDB) and Star Schema Benchmark (SSB) datasets. Our solution manages to perform an order of magnitude faster than KSM, while detecting close to the same amount of duplicate data.

Details

OriginalspracheEnglisch
TitelGvDB 2025 Grundlagen von Datenbanken 2025
Seiten42-49
Seitenumfang8
PublikationsstatusVeröffentlicht - 2025
Peer-Review-StatusJa

Publikationsreihe

ReiheCEUR Workshop Proceedings
Band4118
ISSN1613-0073

Workshop

Titel36. GI-Workshop Grundlagen von Datenbanken
KurztitelGvDB 2025
Veranstaltungsnummer36
Dauer29 September - 1 Oktober 2025
Webseite
StadtRegensburg
LandDeutschland

Externe IDs

ORCID /0000-0001-8107-2775/work/219265703

Schlagworte

ASJC Scopus Sachgebiete

Schlagwörter

  • Data Streaming Accelerator, in-memory databases, memory-deduplication, multi-tenancy, OLAP