Multi-Strategy Adversarial Learning for Robust Face Forgery Detection Under Heterogeneous and Composite Attacks

Xiyao Liu, Fengkai Dong, Xin Liao, Yuhan Guo, Jianbiao He, Jian Zhang, Gerald Schaefer, Hui FangICME 2024 · OpenReview

Abstract

Face forgery detection has recently progressed to address the threat from image synthesis technology, although robust face forgery detection under heterogeneous attacks remains challenging. When forgers leverage image post-processing techniques to manipulate forged photos, recent detection methods exhibit significant performance degradation. In this work, we propose a novel multi-strategy adversarial learning (MAL) method to extract salient features in order to achieve more reliable forgery detection under attacks. In particular, our MAL framework creates a large number of positive and negative sample pairs by designing a composite attack generation module with supervised contrastive training to ensure the attack robustness. In addition, we exploit two intuitive strategies, hard sample selection and region consistency, to enhance the contrastive losses for further strengthened feature reliability. Extensive experimental results demonstrate our proposed method to outperform recent state-of-the-art face forgery detection methods in terms of overall accuracy under various single and composite attacks.
BibTeX
@inproceedings{liu2024multi,
  author = {Xiyao Liu and Fengkai Dong and Xin Liao and Yuhan Guo and Jianbiao He and Jian Zhang and Gerald Schaefer and Hui Fang},
  title = {{Multi-Strategy Adversarial Learning for Robust Face Forgery Detection Under Heterogeneous and Composite Attacks}},
  booktitle = {ICME},
  year = {2024},
  url = {https://openreview.net/forum?id=TGQ7AQO5zY},
}

Loading related content...

Figure