MARS: Unleashing the Power of Speculative Decoding via Margin-Aware Verification

Jingwei Song, Xinyu Wang, Hanbin Wang, Xiaoxuan Lei, Bill Shi, Shixin Han, Eric Yang, Xiao-Wen Chang, Lynn Ai

BibTeX
@inproceedings{song2026mars,
  author = {Jingwei Song and Xinyu Wang and Hanbin Wang and Xiaoxuan Lei and Bill Shi and Shixin Han and Eric Yang and Xiao-Wen Chang and Lynn Ai},
  title = {{MARS: Unleashing the Power of Speculative Decoding via Margin-Aware Verification}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.421},
}

Loading related content...

Figure