A Comprehensive Deepfake Detector Assessment Platform

Liu liu, Zhixuan Chu, Zhongjie Ba, Chengyi Yan, Ziyue Zhan, Feng Lin, Zhan Qin, Kui RenOpenReview 2025 · Submission to ICLR 2025 · Rejected · OpenReview

Abstract

The rapid development of deepfake techniques has raised serious concerns about the authenticity and integrity of digital media. To combat the potential misuse of deepfakes, it is crucial to develop reliable and robust deepfake detection algorithms. In this paper, we propose a comprehensive **D**eepfake **D**etector **A**ssessment **P**latform (**DAP**), covering six critical dimensions: benchmark performance, forgery algorithm generalization, image distortion robustness, adversarial attack resilience, forgery localization accuracy, and attribute bias. Our framework aims to provide a standardized and rigorous approach to assess the performance, generalization ability, robustness, security, localization precision, and fairness of deepfake detection algorithms. Extensive experiments are conducted on multiple public and self-built databases, considering various forgery techniques, image distortions, adversarial attacks, and attributes. The proposed framework offers insights into the strengths and limitations of state-of-the-art deepfake detection algorithms and serves as a valuable tool for researchers and practitioners to develop and evaluate novel approaches in this field. All codes, scripts, and data described in this paper are open source and available at https://github.com/tempuser4567/DAP.
BibTeX
@misc{liu2025comprehensive,
  author = {Liu liu and Zhixuan Chu and Zhongjie Ba and Chengyi Yan and Ziyue Zhan and Feng Lin and Zhan Qin and Kui Ren},
  title = {{A Comprehensive Deepfake Detector Assessment Platform}},
  year = {2025},
  url = {https://openreview.net/forum?id=C6d9S2lYFN},
  howpublished = {OpenReview},
  note = {Submitted to ICLR 2025},
}

Loading related content...

Figure