Can LLM-as-a-Judge Reliably Verify Rubrics in Agentic Scenarios?

Yangda Peng, Yunjia Qi, Hao Peng, Haotian Xia, Guanzhong He, Xintong Shi, Richeng Xuan, Songyuanyi Lu, Yixian Liu, Zhichao Hu, Yuhong Liu, Lei Hou, Bin Xu, Juanzi LiarXiv 2026 · DOI

BibTeX
@misc{peng2026can,
  author = {Yangda Peng and Yunjia Qi and Hao Peng and Haotian Xia and Guanzhong He and Xintong Shi and Richeng Xuan and Songyuanyi Lu and Yixian Liu and Zhichao Hu and Yuhong Liu and Lei Hou and Bin Xu and Juanzi Li},
  title = {{Can LLM-as-a-Judge Reliably Verify Rubrics in Agentic Scenarios?}},
  year = {2026},
  doi = {10.48550/arxiv.2606.29920},
}

Loading related content...

Figure