Continual LLM Upcycling: A Predictor-Gated Bank-Wise Sparsity Training Recipe for Dense-to-Sparse LLMs

Ruixuan Huang, Jinyuan Shi, Hantao Huang, Yifan Huang, Ziyi Guan, Hao Zeng, Ian En-Hsu Yen, Minghui YuarXiv 2026 · DOI

BibTeX
@misc{huang2026continual,
  author = {Ruixuan Huang and Jinyuan Shi and Hantao Huang and Yifan Huang and Ziyi Guan and Hao Zeng and Ian En-Hsu Yen and Minghui Yu},
  title = {{Continual LLM Upcycling: A Predictor-Gated Bank-Wise Sparsity Training Recipe for Dense-to-Sparse LLMs}},
  year = {2026},
  doi = {10.48550/arxiv.2606.10722},
}

Loading related content...

Figure