Analysis of Node Failures in High Performance Computers Based on System Logs

Research output: Contribution to conferencesPosterContributedpeer-review

Abstract

The growth in size and complexity of HPC systems leads to a rapid increase of their failure rates. In the near future, it is expected that the mean time between failures of HPC systems becomes too short and that current failure recovery mechanisms will no longer be able to recover the systems from failures. Early failure detection is, thus, essential to prevent their destructive effects. Based on measurements of a production system at TU Dresden over an 8-month time period, we study the correlation of node failures in time and space. We infer possible types of correlations and show that in many cases the observed node failures are directly correlated. The significance of such a study is achieving a clearer understanding of correlations between observed node failures and enabling failure detection as early as possible. The results aimed to help system administrators minimize (or prevent) the destructive effects of failures.

Details

Original languageEnglish
Publication statusPublished - Nov 2015
Peer-reviewedYes

Conference

TitleThe International Conference for High Performance Computing, Networking, Storage, and Analysis
Abbreviated titleSC 15
Conference number15
Duration15 - 20 November 2015
Website
Degree of recognitionInternational event
LocationConvention Center
CityAustin
CountryUnited States of America

Keywords