Lilou: Resource-Aware Model-Driven Latency Prediction for Gpu-Accelerated Model Serving

Qianlin Liang, Haoliang Wang, Prashant ShenoySSRN 2025 · DOI

BibTeX
@misc{liang2025lilou,
  author = {Qianlin Liang and Haoliang Wang and Prashant Shenoy},
  title = {{Lilou: Resource-Aware Model-Driven Latency Prediction for Gpu-Accelerated Model Serving}},
  year = {2025},
  doi = {10.2139/ssrn.5256341},
  howpublished = {SSRN},
}

Loading related content...

Figure