Coded Matrix Multiplication on a Group-Based Model
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
Coded distributed computing has been considered as a promising technique which makes large-scale systems robust to the "straggler" workers. Yet, practical system models for distributed computing have not been available that reflect the clustered or grouped structure of real-world computing servers. Also, the large variations in the computing power and bandwidth capabilities across different servers have not been properly modeled. We suggest a group-based model to reflect practical conditions and develop an appropriate coding scheme for this model. The suggested code, called group code, employs parallel encoding for each group. We show that the suggested coding scheme can asymptotically achieve optimal computing time in the regime of infinite n, the number of workers. While theoretical analysis is conducted in the asymptotic regime, numerical results also show that the suggested scheme achieves near-optimal computing time for any finite but reasonably large n. Moreover, we demonstrate that decoding complexity of the suggested scheme is significantly reduced by the virtue of parallel decoding.
Details
| Original language | English |
|---|---|
| Title of host publication | 2019 IEEE International Symposium on Information Theory (ISIT) |
| Publisher | Institute of Electrical and Electronics Engineers (IEEE) |
| Pages | 722-726 |
| Number of pages | 5 |
| ISBN (print) | 978-1-5386-9292-9 |
| Publication status | Published - 12 Jul 2019 |
| Peer-reviewed | Yes |
| Externally published | Yes |
Symposium
| Title | 2019 IEEE International Symposium on Information Theory |
|---|---|
| Abbreviated title | ISIT 2019 |
| Duration | 7 - 12 July 2019 |
| Degree of recognition | International event |
| Location | Maison de la Mutualité |
| City | Paris |
| Country | France |
External IDs
| Scopus | 85073151316 |
|---|
Keywords
Keywords
- Computational modeling, Decoding, Task analysis, Encoding, Complexity theory, Distributed computing, Resource management