HPC File Systems in Wide Area Networks: Understanding the Performance of Lustre over WAN

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Abstract

Using the first commercially available 100 Gbps Ethernet technology with a link of varying length, we have evaluated the performance of the Lustre file system and its networking layer under different latency scenarios. The results led us to a better understanding of the impact that the network latency has on Lustre's performance. In particular spanning Lustre's networking layer, striped small I/O, and the parallel creation of files inside a common directory. The main contribution of this work is the derivation of useful rules of thumbs to help users and system administrators predict the variation in Lustre's performance produced as a result of changes in the latency of the I/O network.

Details

OriginalspracheEnglisch
TitelEuro-Par 2012 Parallel Processing
Herausgeber (Verlag)Springer, Berlin [u. a.]
Seiten65–76
Seitenumfang11
ISBN (elektronisch)978-3-642-32820-6
ISBN (Print)9783642328190
PublikationsstatusVeröffentlicht - 2012
Peer-Review-StatusJa

Publikationsreihe

ReiheLecture Notes in Computer Science, Volume 7484
ISSN0302-9743

Externe IDs

Scopus 84867631548
ORCID /0000-0002-1686-8440/work/142240064

Schlagworte

Bibliotheksschlagworte