Post-Hoc Request Adaptive Scheduling Scheme for Online Inference Pipelines

Hesheng Sun, Zhuzhong Qian, Andong Zhu, Mingyu Li, Sheng Zhang, Sanglu Lu, Lingkun Meng, Dongxu Wang, Xiangyu LiSSRN 2025 · DOI

BibTeX
@misc{sun2025post,
  author = {Hesheng Sun and Zhuzhong Qian and Andong Zhu and Mingyu Li and Sheng Zhang and Sanglu Lu and Lingkun Meng and Dongxu Wang and Xiangyu Li},
  title = {{Post-Hoc Request Adaptive Scheduling Scheme for Online Inference Pipelines}},
  year = {2025},
  doi = {10.2139/ssrn.5260642},
  howpublished = {SSRN},
}

Loading related content...

Figure