BBQ: A Block-based Bounded Queue for Exchanging Data and Profiling

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

  • Jiawei Wang - , Seniorprofessor für Betriebssysteme, Professur für Rechnerarchitektur, Dresden Research Lab Huawei Technologies, Huawei Technologies Co., Ltd. (Autor:in)
  • Diogo Behrens - , Dresden Research Lab Huawei Technologies, Huawei Technologies Co., Ltd. (Autor:in)
  • Ming Fu - , Dresden Research Lab Huawei Technologies, Huawei Technologies Co., Ltd. (Autor:in)
  • Lilith Oberhauser - , Dresden Research Lab Huawei Technologies, Huawei Technologies Co., Ltd. (Autor:in)
  • Jonas Oberhauser - , Dresden Research Lab Huawei Technologies, Huawei Technologies Co., Ltd. (Autor:in)
  • Jitang Lei - , Dresden Research Lab Huawei Technologies, Huawei Technologies Co., Ltd. (Autor:in)
  • Geng Chen - , Huawei Technologies Co., Ltd. (Autor:in)
  • Hermann Härtig - , Seniorprofessor für Betriebssysteme (Autor:in)
  • Haibo Chen - , Huawei Technologies Co., Ltd., Shanghai Jiao Tong University (Autor:in)

Abstract

Concurrent bounded queues have been widely used for exchanging data and profiling in operating systems, databases, and multithreaded applications. The performance of state-ofthe-art queues is limited by the interference between multiple enqueues (enq-enq), multiple dequeues (deq-deq), or enqueues and dequeues (enq-deq), negatively affecting their latency and scalability. Although some existing designs employ optimizations to reduce deq-deq and enq-enq interference, they often neglect the enq-deq case. In fact, such partial optimizations may inadvertently increase interference elsewhere and result in performance degradation. We present Block-based Bounded Queue (BBQ), a novel ringbuffer design that splits the entire buffer into multiple blocks. This eliminates enq-deq interference on concurrency control variables when producers and consumers operate on different blocks. Furthermore, the block-based design is amenable to existing optimizations, e.g., using the more scalable fetch-and-add instruction. Our evaluation shows that BBQ outperforms several industrial ringbuffers. For example, in single-producer/single-consumer micro-benchmarks, BBQ yields 11.3x to 42.4x higher throughput than the ringbuffers from Linux kernel, DPDK, Boost, and Folly libraries. In realworld scenarios, BBQ achieves up to 1.5x, 50.5x, and 11.1x performance improvements in benchmarks of DPDK, Linux io_uring, and Disruptor, respectively. We verified and optimized BBQ on weak memory models with a model-checkingbased framework.

Details

OriginalspracheEnglisch
TitelProceedings of the 2022 USENIX Annual Technical Conference, ATC 2022
Herausgeber (Verlag)USENIX Association
Seiten249-262
Seitenumfang14
ISBN (elektronisch)9781939133298
PublikationsstatusVeröffentlicht - 2022
Peer-Review-StatusJa

Publikationsreihe

ReiheUSENIX Annual Technical Conference (ATC)

Konferenz

Titel2022 USENIX Annual Technical Conference, ATC 2022
Dauer11 - 13 Juli 2022
StadtCarlsbad
LandUSA/Vereinigte Staaten

Schlagworte

ASJC Scopus Sachgebiete