LogEval: A comprehensive benchmark suite for LLMs in log analysis

Tianyu Cui, Shiyu Ma, Ziang Chen, Tong Xiao, Chenyu Zhao, Shimin Tao, Yilun Liu, Shenglin Zhang, Duoming Lin, Changchang Liu, Yuzhe Cai, Weibin Meng, Yongqian Sun, Dan PeiEmpir. Softw. Eng 2025 · DOI

BibTeX
@article{cui2025logeval,
  author = {Tianyu Cui and Shiyu Ma and Ziang Chen and Tong Xiao and Chenyu Zhao and Shimin Tao and Yilun Liu and Shenglin Zhang and Duoming Lin and Changchang Liu and Yuzhe Cai and Weibin Meng and Yongqian Sun and Dan Pei},
  title = {{LogEval: A comprehensive benchmark suite for LLMs in log analysis}},
  journal = {Empir. Softw. Eng.},
  year = {2025},
  doi = {10.1007/s10664-025-10701-6},
}

Loading related content...

Figure