DECA: Decentralizing Block-Wise Adam for Efficient LLM Full-Parameter Fine-Tuning on Non-IID Data

Yunsheng Yuan, Shaowei Li, Kai Wang, Zhongyuan Sun, Zheng Zhang, Kai Han, Jun Luo, Feng LiarXiv 2026 · DOI

BibTeX
@misc{yuan2026deca,
  author = {Yunsheng Yuan and Shaowei Li and Kai Wang and Zhongyuan Sun and Zheng Zhang and Kai Han and Jun Luo and Feng Li},
  title = {{DECA: Decentralizing Block-Wise Adam for Efficient LLM Full-Parameter Fine-Tuning on Non-IID Data}},
  year = {2026},
  eprint = {2606.03209},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2606.03209},
}

Loading related content...

Figure