A Data-Efficient Path to Multilingual LLMs: Language Expansion via Post-training PARAMΔ Integration into Upcycled MoE

Hao Zhou, Tianhao Li, Zhijun Wang, Shuaijie She, Linjuan Wu, Hao-Ran Wei, Baosong Yang, Jiajun Chen, Shujian HuangarXiv 2026 · DOI

BibTeX
@misc{zhou2026data,
  author = {Hao Zhou and Tianhao Li and Zhijun Wang and Shuaijie She and Linjuan Wu and Hao-Ran Wei and Baosong Yang and Jiajun Chen and Shujian Huang},
  title = {{A Data-Efficient Path to Multilingual LLMs: Language Expansion via Post-training PARAMΔ Integration into Upcycled MoE}},
  year = {2026},
  doi = {10.48550/arxiv.2605.18083},
}

Loading related content...

Figure