Talon: Breaking the Synchronization Barrier in Speculative Decoding with Hybrid Model-based and Retrieve-based Drafting

Xiangxiang Gao, Weisheng Xie, Lixin, Xuwei Fang, Chen Hang, Changqun Li, Yuhan Lin, Xiaolong XuAAAI 2026 · DOI

BibTeX
@inproceedings{gao2026talon,
  author = {Xiangxiang Gao and Weisheng Xie and Lixin and Xuwei Fang and Chen Hang and Changqun Li and Yuhan Lin and Xiaolong Xu},
  title = {{Talon: Breaking the Synchronization Barrier in Speculative Decoding with Hybrid Model-based and Retrieve-based Drafting}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2026},
  doi = {10.1609/aaai.v40i25.39266},
}

Loading related content...

Figure