CD-LLM: A Heterogeneous Multi-FPGA System for Batched Decoding of 70B+ LLMs Using a Compute-Dedicated Architecture

Wenheng Ma, Xinhao Yang, Shulin Zeng, Tengxuan Liu, Libo Shen, Hongyi Wang, Shiyao Li, Ke Hong, Zhenhua Zhu, Xuefei Ning, Tsung-Yi Ho, Guohao Dai, Yu WangACM Trans. Reconfigurable Technol. Syst 2026 · DOI

BibTeX
@article{ma2026cd,
  author = {Wenheng Ma and Xinhao Yang and Shulin Zeng and Tengxuan Liu and Libo Shen and Hongyi Wang and Shiyao Li and Ke Hong and Zhenhua Zhu and Xuefei Ning and Tsung-Yi Ho and Guohao Dai and Yu Wang},
  title = {{CD-LLM: A Heterogeneous Multi-FPGA System for Batched Decoding of 70B+ LLMs Using a Compute-Dedicated Architecture}},
  journal = {ACM Trans. Reconfigurable Technol. Syst.},
  year = {2026},
  doi = {10.1145/3771288},
}

Loading related content...

Figure