Scaling LLM Speculative Decoding: Non-Autoregressive Forecasting in Large-Batch Scenarios

Luohe Shi, Zuchao Li, Lefei Zhang, Baoyuan Qi, Guoming Liu, Hai ZhaoAAAI 2026 · DOI

BibTeX
@inproceedings{shi2026scaling,
  author = {Luohe Shi and Zuchao Li and Lefei Zhang and Baoyuan Qi and Guoming Liu and Hai Zhao},
  title = {{Scaling LLM Speculative Decoding: Non-Autoregressive Forecasting in Large-Batch Scenarios}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2026},
  doi = {10.1609/aaai.v40i39.40576},
}

Loading related content...

Figure