A Residual-Aware Theory of Position Bias in Transformers

Hanna Herasimchyk, Robin Labryga, Tomislav Prusina, Sören LauearXiv 2026 · DOI

BibTeX
@misc{herasimchyk2026residual,
  author = {Hanna Herasimchyk and Robin Labryga and Tomislav Prusina and Sören Laue},
  title = {{A Residual-Aware Theory of Position Bias in Transformers}},
  year = {2026},
  eprint = {2602.16837},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2602.16837},
}

Loading related content...

Figure