uPAD: Unsupervised Privacy-Aware Anomaly Detection in High Performance Computing Systems
Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung
Beitragende
Abstract
Rapid growing complexity of HPC systems in response to demand for higher computing performance, results in higher probability of failures. Early detection of failures significantly reduces the damages caused by failure via impeding their propagation through system. Various anomaly detection mechanism are proposed to detect failures in their early stages. Insufficient amount of failure samples in addition to privacy concerns extremely limits the functionality of available anomaly detection approaches. Advances in machine learning techniques, significantly increased the accuracy of unsupervised anomaly detection methods, addressing the challenge of insufficient failure samples. However, available approaches are either domain specific, inaccurate, or require comprehensive knowledge about the underlying system. Furthermore, processing certain monitoring data such as system logs raises high privacy concerns. In addition, noises in monitoring data severely impact the correctness of data analysis. This work proposes an unsupervised and privacy-aware approach for detecting abnormal behaviors in general HPC systems. Preliminary results indicate high potentials of autoencoders for automatic detection of abnormal behaviors in HPC systems via analyzing anonymized system logs using fast-trainable noise-resistant models.
Details
Originalsprache | Englisch |
---|---|
Titel | Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - ICPRAM |
Redakteure/-innen | Maria De Marsico, Gabriella Sanniti di Baja, Ana L.N. Fred |
Herausgeber (Verlag) | SCITEPRESS - Science and Technology Publications |
Seiten | 852-859 |
Seitenumfang | 8 |
ISBN (Print) | 9789897583513 |
Publikationsstatus | Veröffentlicht - 2019 |
Peer-Review-Status | Ja |
Publikationsreihe
Reihe | International Conference on Pattern Recognition Applications and Methods (ICPRAM) |
---|---|
Band | 1 |
Konferenz
Titel | 8th International Conference on Pattern Recognition Applications and Methods |
---|---|
Kurztitel | ICPRAM 2019 |
Veranstaltungsnummer | 8 |
Dauer | 19 - 21 Februar 2019 |
Webseite | |
Bekanntheitsgrad | Internationale Veranstaltung |
Stadt | Prague |
Land | Tschechische Republik |
Externe IDs
Scopus | 85064662094 |
---|---|
WOS | 000659174900098 |
Scopus | 85174850627 |
Schlagworte
ASJC Scopus Sachgebiete
Schlagwörter
- Anomaly Detection, Neural Networks, Noise Mitigation, Pattern Detection, Time Series Analysis