HPC File Systems in Wide Area Networks: Understanding the Performance of Lustre over WAN

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Abstract

Using the first commercially available 100 Gbps Ethernet technology with a link of varying length, we have evaluated the performance of the Lustre file system and its networking layer under different latency scenarios. The results led us to a better understanding of the impact that the network latency has on Lustre’s performance. In particular spanning Lustre’s networking layer, striped small I/O, and the parallel creation of files inside a common directory. The main contribution of this work is the derivation of useful rules of thumbs to help users and system administrators predict the variation in Lustre’s performance produced as a result of changes in the latency of the I/O network.

Details

Original languageEnglish
Title of host publicationEuro-Par 2012 Parallel Processing
PublisherSpringer, Berlin [u. a.]
Pages65–76
Number of pages11
ISBN (electronic)978-3-642-32820-6
ISBN (print)9783642328190
Publication statusPublished - 2012
Peer-reviewedYes

Publication series

SeriesLecture Notes in Computer Science, Volume 7484
ISSN0302-9743

External IDs

Scopus 84867631548
ORCID /0000-0002-1686-8440/work/142240064

Keywords

Library keywords