Limits of Convergence-Rate Control for Open-Weight Safety

Domenic Rosati, Xijie Zeng, Hong Huang, Sebastian Dionicio, Subhabrata Majumdar, Frank Rudzicz, Hassan Sajjad

Abstract

Open-weight foundation models can be fine-tuned for harmful purposes after release, yet no existing training resistance methods provide theoretical guarantees. Treating these interventions as convergence-rate control problems allows us to connect optimization speed to the spectral structure of model weights. We leverage this insight to develop a novel understanding of convergence rate control through spectral reparameterization and derive an algorithm, SpecDef, that can both provably and empirically slow first- and second-order optimization in non-adversarial settings. In adversarial settings, we establish a fundamental limit on a broad class of convergence rate control methods including our own: an attacker with sufficient knowledge can restore fast convergence at a linear increase in model size. In order to overcome this limitation, future works will need to investigate methods that are not equivalent to controlling convergence rate.
BibTeX
@misc{rosati2026limits,
  author = {Domenic Rosati and Xijie Zeng and Hong Huang and Sebastian Dionicio and Subhabrata Majumdar and Frank Rudzicz and Hassan Sajjad},
  title = {{Limits of Convergence-Rate Control for Open-Weight Safety}},
  year = {2026},
  eprint = {2602.18868},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2602.18868},
}
Figure