Akashic: A Low-Overhead LLM Inference Service with MemAttention

Yang Liu, Zhaokai Luo, Huayi Jin, Ruozhou He, Chenchen Hong, Zhiyong Wang, Yifei Liu, Yunfei Gu, Chentao Wu, Junhao HuarXiv 2026 · DOI

BibTeX
@misc{liu2026akashic,
  author = {Yang Liu and Zhaokai Luo and Huayi Jin and Ruozhou He and Chenchen Hong and Zhiyong Wang and Yifei Liu and Yunfei Gu and Chentao Wu and Junhao Hu},
  title = {{Akashic: A Low-Overhead LLM Inference Service with MemAttention}},
  year = {2026},
  doi = {10.48550/arxiv.2607.05708},
}

Loading related content...

Figure