HPC File Systems in Wide Area Networks: Understanding the Performance of Lustre over WAN
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
Using the first commercially available 100 Gbps Ethernet technology with a link of varying length, we have evaluated the performance of the Lustre file system and its networking layer under different latency scenarios. The results led us to a better understanding of the impact that the network latency has on Lustre’s performance. In particular spanning Lustre’s networking layer, striped small I/O, and the parallel creation of files inside a common directory. The main contribution of this work is the derivation of useful rules of thumbs to help users and system administrators predict the variation in Lustre’s performance produced as a result of changes in the latency of the I/O network.
Details
| Original language | English |
|---|---|
| Title of host publication | Euro-Par 2012 Parallel Processing |
| Publisher | Springer, Berlin [u. a.] |
| Pages | 65–76 |
| Number of pages | 11 |
| ISBN (electronic) | 978-3-642-32820-6 |
| ISBN (print) | 9783642328190 |
| Publication status | Published - 2012 |
| Peer-reviewed | Yes |
Publication series
| Series | Lecture Notes in Computer Science, Volume 7484 |
|---|---|
| ISSN | 0302-9743 |
External IDs
| Scopus | 84867631548 |
|---|---|
| ORCID | /0000-0002-1686-8440/work/142240064 |