OTFX: An In-memory Event Tracing Extension to the Open Trace Format 2

Research output: Contribution to book/conference proceedings/anthology/reportChapter in book/anthology/reportContributedpeer-review

Contributors

Abstract

In event-based performance analysis the amount of collected data is one of the most urgent challenges. It can massively slow down application execution, overwhelm the underlying file system and introduce significant measurement bias due to intermediate memory buffer flushes. To address these issues we propose an in-memory event tracing approach that dynamically adapts the volume of application events to an amount that is guaranteed to fit into a single memory buffer, and therefore, avoiding file interaction entirely. These concepts include runtime filtering, enhanced encoding techniques, and novel strategies for runtime event reduction. The concepts further include the hierarchical memory buffer a multi-dimensional, hierarchical data structure allowing to realize these concepts with minimal overhead. We demonstrate the capabilities of our concepts with a prototype implementation called OTFX, based on the Open Trace Format 2, a state-of-the-art open source tracing library used by the performance analyzers Vampir, Scalasca, and Tau.

Details

Original languageEnglish
Title of host publicationAlgorithms and Architectures for Parallel Processing
PublisherSpringer, Berlin [u. a.]
Pages3-17
Number of pages15
Publication statusPublished - 2016
Peer-reviewedYes

Publication series

SeriesLecture Notes in Computer Science, Volume 10049
ISSN0302-9743

Conference

Title16th International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP)
Duration14 - 16 December 2016
CityGranada
CountrySpain

External IDs

Scopus 85007390971

Keywords

Keywords

  • Performance analysis, Tracing, Tools, OTFX, OTF2

Library keywords