Elastic Scaling of a High-Throughput Content-Based Publish/Subscribe Engine

Publikation: Beitrag zu KonferenzenPaperBeigetragenBegutachtung

Beitragende

  • Raphaël Barazzutti - , Universität Neuenburg (Autor:in)
  • Thomas Heinze - , SAP Research (Autor:in)
  • André Martin - , Professur für Systems Engineering (SE) (Autor:in)
  • Emanuel Onica - , Universität Neuenburg (Autor:in)
  • Pascal Felber - , Universität Neuenburg (Autor:in)
  • Christof Fetzer - , Professur für Systems Engineering (SE) (Autor:in)
  • Zbigniew Jerzak - , SAP Research (Autor:in)
  • Marcelo Pasin - , Universität Neuenburg (Autor:in)
  • Etienne Rivière - , Universität Neuenburg (Autor:in)

Abstract

Publish/subscribe (pub/sub) infrastructures running as a service on cloud environments offer simplicity and flexibility for composing distributed applications. Provisioning them appropriately is however challenging. The amount of stored subscriptions and incoming publications varies over time, and the computational cost depends on the nature of the applications and in particular on the filtering operation they require (e.g., content-based vs. topic-based, encrypted vs. non-encrypted filtering). The ability to elastically adapt the amount of resources required to sustain given throughput and delay requirements is key to achieving cost-effectiveness for a pub/sub service running in a cloud environment. In this paper, we present the design and evaluation of an elastic content-based pub/sub system: E-STREAMHUB. Specific contributions of this paper include: (1) a mechanism for dynamic scaling, both out and in, of stateful and stateless pub/sub operators, (2) a local and global elasticity policy enforcer maintaining high system utilization and stable end-to-end latencies, and (3) an evaluation using real-world tick workload from the Frankfurt Stock Exchange and encrypted content-based filtering.

Details

OriginalspracheEnglisch
Seiten567-576
Seitenumfang10
PublikationsstatusVeröffentlicht - 2014
Peer-Review-StatusJa

Konferenz

Titel34th International Conference on Distributed Computing Systems
KurztitelICDCS 2014
Veranstaltungsnummer34
Dauer30 Juni - 3 Juli 2014
StadtMadrid
LandSpanien

Schlagworte

Forschungsprofillinien der TU Dresden

DFG-Fachsystematik nach Fachkollegium

Schlagwörter

  • Elasticity, Subscriptions, Runtime, Engines, Chryptography, Cloud Computing, Delays