Towards Floating Point-Based Attention-Free LLM: Hybrid PIM with Non-Uniform Data Format and Reduced Multiplications

Lidong Guo, Zhenhua Zhu, Tengxuan Liu, Xuefei Ning, Shiyao Li, Guohao Dai, Huazhong Yang, Wangyang Fu, Yu Wang

BibTeX
@inproceedings{guo2024towards,
  author = {Lidong Guo and Zhenhua Zhu and Tengxuan Liu and Xuefei Ning and Shiyao Li and Guohao Dai and Huazhong Yang and Wangyang Fu and Yu Wang},
  title = {{Towards Floating Point-Based Attention-Free LLM: Hybrid PIM with Non-Uniform Data Format and Reduced Multiplications}},
  booktitle = {ICCAD},
  year = {2024},
  doi = {10.1145/3676536.3676776},
}

Loading related content...

Figure