Hardware-oriented algorithms for softmax and layer normalization of large language models

Wenjie Li, Dongxu Lyu, Gang Wang, Aokun Hu, Ningyi Xu, Guanghui HeScience China Information Sciences 2024 · DOI

BibTeX
@article{li2024hardware,
  author = {Wenjie Li and Dongxu Lyu and Gang Wang and Aokun Hu and Ningyi Xu and Guanghui He},
  title = {{Hardware-oriented algorithms for softmax and layer normalization of large language models}},
  journal = {Science China Information Sciences},
  year = {2024},
  doi = {10.1007/s11432-024-4137-4},
}

Loading related content...

Figure