On the effectiveness of recoding-based repair in network coded distributed storage

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Márton Sipos - , Budapest University of Technology and Economics, Aalborg University (Author)
  • Patrik János Braun - , Budapest University of Technology and Economics (Author)
  • Daniel Enrique Lucani - , Aalborg University, Chocolate Cloud ApS (Author)
  • Frank H.P. Fitzek - , Deutsche Telekom Chair of Communication Networks (Author)
  • Hassan Charaf - , Budapest University of Technology and Economics (Author)

Abstract

High capacity storage systems distribute files across several storage devices (nodes) and apply an erasure code to meet availability and reliability requirements. Since devices can lose network connectivity or fail permanently, a dynamic repair mechanism must be put in place. In such cases a new recovery node gets connected to a given subset of the operating nodes and receives a part of the stored data. The objective of this paper is to investigate data survival for Random Linear Network Coding (RLNC) as a function of topology and communication overhead, defined by the number of connections and the number of transmitted packets to the recovery node, respectively. The paper includes two main contributions. First, a sufficient set of conditions for quasi-infinite longevity of the stored data is derived. Second, a comparison using experimental results shows that RLNC can be up to 50% more effective than traditional erasure codes like Reed-Solomon.

Details

Original languageEnglish
Pages (from-to)12-21
Number of pages10
JournalPeriodica polytechnica
Volume61
Issue number1
Publication statusPublished - 2017
Peer-reviewedYes

External IDs

ORCID /0000-0001-8469-9573/work/161891287