Steering Memory Deduplication in Multi-Tenant Database Systems
Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung
Beitragende
Abstract
Improving the memory density of in-memory columnar databases is a necessary step towards more efficient sharing of hardware in multi-tenant systems. Many general-purpose tools attempt to achieve this by scanning systems for duplicate memory regions, and deduplicating these redundancies. In this paper, we show that existing tools sacrifice efficiency for general-applicability, and outline the possibilities unlocked by tapping into the architectural guarantees, and existing metadata for in-memory databases. Based on our previous work on deduplication, where we used a hardware-accelerated delta mechanism to increase memory savings, we detail a process for semantics-based steering of this mechanism. This significantly reduces the search space for duplicates, by only comparing database columns which exhibit similar features. Furthermore, we gracefully handle cases where steering causes the comparison of mismatched columns. We benchmark our solution against the widely available Linux Kernel Samepage Merging (KSM) tool, evaluating both based on their achieved memory savings and execution speed for deduplicating the Internet Movie Data Base (IMDB) and Star Schema Benchmark (SSB) datasets. Our solution manages to perform an order of magnitude faster than KSM, while detecting close to the same amount of duplicate data.
Details
| Originalsprache | Englisch |
|---|---|
| Titel | GvDB 2025 Grundlagen von Datenbanken 2025 |
| Seiten | 42-49 |
| Seitenumfang | 8 |
| Publikationsstatus | Veröffentlicht - 2025 |
| Peer-Review-Status | Ja |
Publikationsreihe
| Reihe | CEUR Workshop Proceedings |
|---|---|
| Band | 4118 |
| ISSN | 1613-0073 |
Workshop
| Titel | 36. GI-Workshop Grundlagen von Datenbanken |
|---|---|
| Kurztitel | GvDB 2025 |
| Veranstaltungsnummer | 36 |
| Dauer | 29 September - 1 Oktober 2025 |
| Webseite | |
| Stadt | Regensburg |
| Land | Deutschland |
Externe IDs
| ORCID | /0000-0001-8107-2775/work/219265703 |
|---|
Schlagworte
ASJC Scopus Sachgebiete
- Allgemeine Computerwissenschaft - Data Streaming Accelerator, in-memory databases, memory-deduplication, multi-tenancy, OLAP
Schlagwörter
- Data Streaming Accelerator, in-memory databases, memory-deduplication, multi-tenancy, OLAP