Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving

Yasmin Moslem, Magdalena Kacmajor, Vasudevan Nedumpozhimana, Ammar N. Abbas, Solmaz Panahi, David Lynch, Zhuangzhuang Nie, Alexandros Agapitos, Aleksandar Milenovic, Hongmeng Song, Yucheng Shi, Yue Pan, Patricia Buffini, John D. KelleherarXiv 2026 · DOI

BibTeX
@misc{moslem2026cluster,
  author = {Yasmin Moslem and Magdalena Kacmajor and Vasudevan Nedumpozhimana and Ammar N. Abbas and Solmaz Panahi and David Lynch and Zhuangzhuang Nie and Alexandros Agapitos and Aleksandar Milenovic and Hongmeng Song and Yucheng Shi and Yue Pan and Patricia Buffini and John D. Kelleher},
  title = {{Cluster, Route, Escalate: Cascaded Framework for Cost-Aware LLM Serving}},
  year = {2026},
  eprint = {2606.27457},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2606.27457},
}

Loading related content...

Figure