Blind to the Human Touch: Overlap Bias in LLM-Based Summary Evaluation

Jiangnan Fang, Cheng-Tse Liu, Hanieh Deilamsalehy, Nesreen K. Ahmed, Puneet Mathur, Nedim Lipka, Franck Dernoncourt, Ryan A. Rossi

BibTeX
@misc{fang2026blind,
  author = {Jiangnan Fang and Cheng-Tse Liu and Hanieh Deilamsalehy and Nesreen K. Ahmed and Puneet Mathur and Nedim Lipka and Franck Dernoncourt and Ryan A. Rossi},
  title = {{Blind to the Human Touch: Overlap Bias in LLM-Based Summary Evaluation}},
  year = {2026},
  eprint = {2602.07673},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2602.07673},
}
Figure