Magnitude Matters: Fixing signSGD Through Magnitude-Aware Sparsification and Error Feedback in the Presence of Data Heterogeneity

Richeng Jin, Xiaofan He, Caijun Zhong, Zhaoyang Zhang, Tony Q. S. Quek, Huaiyu DaiIEEE TSP 2024 · DOI

BibTeX
@article{jin2024magnitude,
  author = {Richeng Jin and Xiaofan He and Caijun Zhong and Zhaoyang Zhang and Tony Q. S. Quek and Huaiyu Dai},
  title = {{Magnitude Matters: Fixing signSGD Through Magnitude-Aware Sparsification and Error Feedback in the Presence of Data Heterogeneity}},
  journal = {IEEE Trans. Signal Process.},
  year = {2024},
  doi = {10.1109/tsp.2024.3454986},
}

Loading related content...

Figure