Teaching in-memory database systems the detection of hardware Errors

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributedpeer-review

Contributors

Abstract

The key objective of database systems is to reliably manage data, whereby high query throughput and low query latency are core requirements. To satisfy these requirements, database systems constantly adapt to novel hardware features. Although it has been intensively studied and commonly accepted that hardware error rates in terms of bit flips increase dramatically with the decrease of the underlying chip structures, most database system research activities neglected this fact, leaving error (bit flip) detection as well as correction to the underlying hardware. Especially for main memory, silent data corruption (SDC) as a result of transient bit flips leading to faulty data is mainly detected and corrected at the DRAM and memory-controller layer. However, since future hardware becomes less reliable and error detection as well as correction by hardware becomes more expensive, this free ride will come to an end in the near future. To further provide a reliable data management, an emerging research direction is employing specific and tailored protection techniques at the database system level. Following that, we are currently developing and implementing an adopted system design for state-of-The-Art in-memory column stores. In our lightning talk, we will summarize our current state and outline future work.

Details

Original languageEnglish
Title of host publicationProceedings - IEEE 34th International Conference on Data Engineering, ICDE 2018
PublisherIEEE, New York [u. a.]
Pages1663
Number of pages1
ISBN (electronic)978-1-5386-5520-7
ISBN (print)978-1-5386-5521-4
Publication statusPublished - 24 Oct 2018
Peer-reviewedYes

Publication series

Series International Conference on Data Engineering (ICDE)

Conference

Title34th IEEE International Conference on Data Engineering, ICDE 2018
Duration16 - 19 April 2018
CityParis
CountryFrance

External IDs

Scopus 85057125454
ORCID /0000-0001-8107-2775/work/142253477

Keywords

Keywords

  • Database Systems, Error Detection, Query Processing, Reliability