UELLM: A Unified and Efficient Approach for Large Language Model Inference Serving

Yiyuan He, Minxian Xu, Jinlin Wu, Wenlong Zheng, Kejiang Ye, Chengzhong XuLecture Notes in Computer Science 2024 · DOI · OpenAlex

BibTeX
@inproceedings{he2024uellm,
  author = {Yiyuan He and Minxian Xu and Jinlin Wu and Wenlong Zheng and Kejiang Ye and Chengzhong Xu and Cheng-zhong Xu},
  title = {{UELLM: A Unified and Efficient Approach for Large Language Model Inference Serving}},
  booktitle = {Lecture Notes in Computer Science},
  year = {2024},
  doi = {10.1007/978-981-96-0805-8\_16},
}

Loading related content...

Figure