Focus by Prior: Deepfake Detection Based on Prior-Attention
Lists
Only you see this
Abstract
Nowadays advanced facial manipulation techniques produce deepfake videos more realistically, which makes deepfake detection more difficult. To capture subtle and intricate artifacts, recent works attempt to enhance low-level textural information by attention-based framework. However, these methods require complex simulated data or extra supervision. Highly dependent on training settings, these methods not only have high training costs but also are prone to overfitting. To address this issue, we propose a novel perspective of deepfake detection via so-called prior-attention. Specifically, we introduce prior textural information, such as edge and noise, to model the attention maps explicitly. Benefiting from these natural “attention maps”, our model significantly enhances discriminative information without additional supervision. Furthermore, we design a Feature Abstraction Block (FAB) to facilitate cross-layer features interaction and insert it into distinct layers of CNN to detect the inconsistencies at multiple spatial levels. Extensive experiments demonstrate that our method achieves performance comparable to state-of-the-art methods.
BibTeX
@inproceedings{yu2022focus,
author = {Cai Yu and Peng Chen and Jiao Dai and Xi Wang and Weibo Zhang and Jin Liu and Jizhong Han},
title = {{Focus by Prior: Deepfake Detection Based on Prior-Attention}},
booktitle = {ICME},
year = {2022},
url = {https://openreview.net/forum?id=txu0E4QNOthW},
}Loading related content...