Scout Before You Attend: Sketch-and-Walk Sparse Attention for Efficient LLM Inference

Hoang Anh Duy Le, Sahil Joshi, Zeyu Yang, Zhaozhuo Xu, Anshumali Shrivastava

BibTeX
@inproceedings{le2026scout,
  author = {Hoang Anh Duy Le and Sahil Joshi and Zeyu Yang and Zhaozhuo Xu and Anshumali Shrivastava},
  title = {{Scout Before You Attend: Sketch-and-Walk Sparse Attention for Efficient LLM Inference}},
  booktitle = {International Conference on Machine Learning},
  year = {2026},
  url = {https://openreview.net/forum?id=uCLVPafHqd},
}

Loading related content...

Figure