Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training

Alham Fikri Aji, Kenneth Heafield, Nikolay BogoychevEMNLP 2019 · DOI

BibTeX
@inproceedings{aji2019combining,
  author = {Alham Fikri Aji and Kenneth Heafield and Nikolay Bogoychev},
  title = {{Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2019},
  doi = {10.18653/v1/d19-1373},
}
Figure