Attention Sinks Induce Gradient Sinks

Yihong Chen, Quanming YaoarXiv 2026 · DOI

BibTeX
@misc{chen2026attention,
  author = {Yihong Chen and Quanming Yao},
  title = {{Attention Sinks Induce Gradient Sinks}},
  year = {2026},
  eprint = {2603.17771},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2603.17771},
}

Loading related content...

Figure