NIOT: A Novel Inference Optimization of Transformers on Modern CPUs

Zining Zhang, Yao Chen, Bingsheng He, Zhenjie Zhang

BibTeX
@article{zhang2023niot,
  author = {Zining Zhang and Yao Chen and Bingsheng He and Zhenjie Zhang},
  title = {{NIOT: A Novel Inference Optimization of Transformers on Modern CPUs}},
  journal = {IEEE Trans. Parallel Distributed Syst.},
  year = {2023},
  url = {https://openreview.net/forum?id=Xd_4wjccYPF},
}

Loading related content...

Figure