A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes - Télécom Paris Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2019

A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes

Résumé

The optimal storage-computation tradeoff is characterized for a MapReduce-like distributed computing system with straggling nodes, where only a part of the nodes can be utilized to compute the desired output functions. The result holds for arbitrary output functions and thus generalizes previous results that restricted to linear functions. Specifically, in this work, we propose a new information-theoretical converse and a new matching coded computing scheme, that we call coded computing for straggling systems (CCS).
Fichier principal
Vignette du fichier
CCS_ISIT.pdf (360.04 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02288594 , version 1 (15-09-2019)

Identifiants

  • HAL Id : hal-02288594 , version 1

Citer

Qifa Yan, Michèle Wigger, Sheng Yang, Xiaohu Tang. A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes. 2019. ⟨hal-02288594⟩
70 Consultations
123 Téléchargements

Partager

Gmail Facebook X LinkedIn More