HPC File Systems in Wide Area Networks: Understanding the Performance of Lustre over WAN
Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung
Beitragende
Abstract
Using the first commercially available 100 Gbps Ethernet technology with a link of varying length, we have evaluated the performance of the Lustre file system and its networking layer under different latency scenarios. The results led us to a better understanding of the impact that the network latency has on Lustre's performance. In particular spanning Lustre's networking layer, striped small I/O, and the parallel creation of files inside a common directory. The main contribution of this work is the derivation of useful rules of thumbs to help users and system administrators predict the variation in Lustre's performance produced as a result of changes in the latency of the I/O network.
Details
Originalsprache | Englisch |
---|---|
Titel | Euro-Par 2012 Parallel Processing |
Herausgeber (Verlag) | Springer, Berlin [u. a.] |
Seiten | 65–76 |
Seitenumfang | 11 |
ISBN (elektronisch) | 978-3-642-32820-6 |
ISBN (Print) | 9783642328190 |
Publikationsstatus | Veröffentlicht - 2012 |
Peer-Review-Status | Ja |
Publikationsreihe
Reihe | Lecture Notes in Computer Science, Volume 7484 |
---|---|
ISSN | 0302-9743 |
Externe IDs
Scopus | 84867631548 |
---|---|
ORCID | /0000-0002-1686-8440/work/142240064 |