Evaluation of load scheduling strategies for real-time data warehouse environments

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

Abstract

The demand for so-called living or real-time data warehouses is increasing in many application areas, including manufacturing, event monitoring and telecommunications. In fields like these, users normally expect short response times for their queries and high freshness for the requested data. However, it is truly challenging to meet both requirements at the same time because of the continuous flow of write-only updates and read-only queries as well as the latency caused by arbitrarily complex ETL processes. To optimize the update flow in terms of data freshness maximization and load minimization, we propose two algorithms - local and global scheduling - that operate on the basis of different system information. We want to discuss the benefits and drawbacks of both approaches in detail and derive recommendations regarding the optimal scheduling strategy for any given system setup and workload.

Details

Original languageEnglish
Title of host publicationEnabling Real-Time Business Intelligence - Third International Workshop, BIRTE 2009, Held at the 35th International Conference on Very Large Databases, VLDB 2009, Revised Selected Papers
PublisherSpringer-Verlag
Pages84-99
Number of pages16
ISBN (print)3642145582, 9783642145582
Publication statusPublished - 2010
Peer-reviewedYes

Publication series

SeriesLecture Notes in Business Information Processing
Volume41 LNBI
ISSN1865-1348

Conference

Title3rd International Workshop Enabling Real-Time Business Intelligence, BIRTE 2009, Held at the 35th International Conference on Very Large Databases, VLDB 2009
Duration24 August 2009
CityLyon
CountryFrance

External IDs

ORCID /0000-0001-8107-2775/work/200630394

Keywords

Research priority areas of TU Dresden

DFG Classification of Subject Areas according to Review Boards

Subject groups, research areas, subject areas according to Destatis

Keywords

  • ETL, Real-Time Data Warehouse, Scheduling