Analysing and Learning Low-Latency Network Coding Schemes

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributedpeer-review

Abstract

Forward Error Correction (FEC) has become an integral part of communication technology to address expected losses during transfer of data. Among various layer three block codes, Random Linear Network Coding (RLNC) has emerged as an adaptable, powerful approach. However, its most straightforward implementation, Full Vector Coding (FVC), introduces too much delay for widespread adoption. Handcrafted schemes were introduced to optimise coding delay, while keeping resilience reasonably high. These works have resulted in tailRLNC and PACE. For the first time we analyse their respective behaviours in a fair and comparable manner, as non-recovered packets were statistically ignored previously. We then introduce an environment that uses a consistent, unbiased simulator and interface it with a Deep Reinforcement Learning (DRL) agent. This is the first time RLNC is joined with DRL. Our deep Q-network (DQN) based agent effectively uses an optimisation loop and utilises a customisable, expressive and extendable parametric loss function to learn a protocol. We demonstrate our agent recovers hand-tailored schemes and achieves state of the art.

Details

Original languageEnglish
Title of host publication2023 19th International Conference on Wireless and Mobile Computing, Networking and Communications, WiMob 2023
PublisherIEEE Computer Society
Pages175-180
Number of pages6
ISBN (electronic)979-8-3503-3667-2
Publication statusPublished - 2023
Peer-reviewedYes

Publication series

SeriesInternational Conference on Wireless and Mobile Computing, Networking and Communications
Volume2023-June
ISSN2161-9646

Conference

Title19th IEEE International Conference on Wireless and Mobile Computing, Networking and Communications, WiMob 2023
Duration21 - 23 June 2023
CityMontreal
CountryCanada

Keywords

Keywords

  • Network Coding, Reinforcement Learning