Spectral attention for transformers: frequency-domain filtering of attention maps

Zhigao Huang, Pinghui Wu, Musheng Chen, Quanfa Li, Miao PanJ. King Saud Univ. Comput. Inf. Sci 2026 · DOI

BibTeX
@article{huang2026spectral,
  author = {Zhigao Huang and Pinghui Wu and Musheng Chen and Quanfa Li and Miao Pan},
  title = {{Spectral attention for transformers: frequency-domain filtering of attention maps}},
  journal = {J. King Saud Univ. Comput. Inf. Sci.},
  year = {2026},
  doi = {10.1007/s44443-026-00599-5},
}

Loading related content...

Figure