Capture the Flags: Family-Based Evaluation of Agentic LLMs via Semantics-Preserving Transformations

Shahin Honarvar, Amber Gorzynski, James Lee-Jones, Harry Coppock, Marek Rei, Joseph Ryan, Alastair F. DonaldsonarXiv 2026 · DOI

BibTeX
@misc{honarvar2026capture,
  author = {Shahin Honarvar and Amber Gorzynski and James Lee-Jones and Harry Coppock and Marek Rei and Joseph Ryan and Alastair F. Donaldson},
  title = {{Capture the Flags: Family-Based Evaluation of Agentic LLMs via Semantics-Preserving Transformations}},
  year = {2026},
  eprint = {2602.05523},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2602.05523},
}

Loading related content...

Figure