Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs

Yixuan Mei, Zikun Li, Zixuan Chen, Shiqi Pan, Mengdi Wu, Xupeng Miao, Zhihao Jia, K. V. RashmiarXiv 2026 · DOI

BibTeX
@misc{mei2026coral,
  author = {Yixuan Mei and Zikun Li and Zixuan Chen and Shiqi Pan and Mengdi Wu and Xupeng Miao and Zhihao Jia and K. V. Rashmi},
  title = {{Coral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs}},
  year = {2026},
  doi = {10.48550/arxiv.2605.04357},
}

Loading related content...

Figure