PipeMesh: Achieving Memory-Efficient Computation-Communication Overlap for Training Large Language Models

Fanxin Li, Shixiong Zhao, Yuhao Qing, Jianyu Jiang, Xusheng Chen, Heming CuiIEEE TPDS 2025 · DOI

BibTeX
@article{li2025pipemesh,
  author = {Fanxin Li and Shixiong Zhao and Yuhao Qing and Jianyu Jiang and Xusheng Chen and Heming Cui},
  title = {{PipeMesh: Achieving Memory-Efficient Computation-Communication Overlap for Training Large Language Models}},
  journal = {IEEE Trans. Parallel Distributed Syst.},
  year = {2025},
  doi = {10.1109/tpds.2025.3583983},
}

Loading related content...

Figure