Dynamic allocation and efficient distribution of data among multiple clouds using network coding

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

  • Márton Sipos - , Budapest University of Technology and Economics, Phonedeck (Author)
  • Frank H.P. Fitzek - , Aalborg University, Phonedeck (Author)
  • Daniel E. Lucani - , Aalborg University, Chocolate Cloud ApS (Author)
  • Morten V. Pedersen - , Aalborg University (Author)

Abstract

Distributed storage has attracted large interest lately from both industry and researchers as a flexible, cost-efficient, high performance, and potentially secure solution for geographically distributed data centers, edge caching or sharing storage among users. This paper studies the benefits of random linear network coding to exploit multiple commercially available cloud storage providers simultaneously with the possibility to constantly adapt to changing cloud performance in order to optimize data retrieval times. The main contribution of this paper is a new data distribution mechanisms that cleverly stores and moves data among different clouds in order to optimize performance. Furthermore, we investigate the trade-offs among storage space, reliability and data retrieval speed for our proposed scheme. By means of real-world implementation and measurements using well-known and publicly accessible cloud service providers, we can show close to 9x less network use for the adaptation compared to more conventional dense recoding approaches, while maintaining similar download time performance and the same reliability.

Details

Original languageEnglish
Title of host publication2014 IEEE 3rd International Conference on Cloud Networking, CloudNet 2014
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages90-95
Number of pages6
ISBN (electronic)9781479927302
Publication statusPublished - 26 Nov 2014
Peer-reviewedYes
Externally publishedYes

Conference

Title2014 3rd IEEE International Conference on Cloud Networking, CloudNet 2014
Duration8 - 10 October 2014
CityLuxembourg
CountryLuxembourg

External IDs

ORCID /0000-0001-8469-9573/work/161891341

Keywords

Keywords

  • Data distribution, Distributed storage, Random Linear Network Coding, Sparse codes