HPC File Systems in Wide Area Networks: Understanding the Performance of Lustre over WAN
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
Using the first commercially available 100 Gbps Ethernet technology with a link of varying length, we have evaluated the performance of the Lustre file system and its networking layer under different latency scenarios. The results led us to a better understanding of the impact that the network latency has on Lustre’s performance. In particular spanning Lustre’s networking layer, striped small I/O, and the parallel creation of files inside a common directory. The main contribution of this work is the derivation of useful rules of thumbs to help users and system administrators predict the variation in Lustre’s performance produced as a result of changes in the latency of the I/O network.
Details
Original language | English |
---|---|
Title of host publication | Euro-Par 2012 Parallel Processing |
Publisher | Springer, Berlin [u. a.] |
Pages | 65–76 |
Number of pages | 11 |
ISBN (electronic) | 978-3-642-32820-6 |
ISBN (print) | 9783642328190 |
Publication status | Published - 2012 |
Peer-reviewed | Yes |
Publication series
Series | Lecture Notes in Computer Science, Volume 7484 |
---|---|
ISSN | 0302-9743 |
External IDs
Scopus | 84867631548 |
---|---|
ORCID | /0000-0002-1686-8440/work/142240064 |