Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging

Mengxian Lyu, Cheng Peng, Ziyi Chen, Mengyuan Zhang, Jieting Li Lu, Yonghui WuarXiv 2026 · DOI

BibTeX
@misc{lyu2026countering,
  author = {Mengxian Lyu and Cheng Peng and Ziyi Chen and Mengyuan Zhang and Jieting Li Lu and Yonghui Wu},
  title = {{Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging}},
  year = {2026},
  eprint = {2604.01538},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2604.01538},
}

Loading related content...

Figure