A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs

Zijie Liu, Jie Peng, Jinhao Duan, Zirui Liu, Kaixiong Zhou, Mingfu Liang, Luke Simon, Xi Liu, Zhaozhuo Xu, Tianlong ChenarXiv 2026 · DOI

BibTeX
@misc{liu2026replicate,
  author = {Zijie Liu and Jie Peng and Jinhao Duan and Zirui Liu and Kaixiong Zhou and Mingfu Liang and Luke Simon and Xi Liu and Zhaozhuo Xu and Tianlong Chen},
  title = {{A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs}},
  year = {2026},
  eprint = {2602.19938},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2602.19938},
}

Loading related content...

Figure