FSSPOTTER: Spotting Face-Swapped Video by Spatial and Temporal Clues
Lists
Only you see this
Abstract
Recent advances in face generation and manipulation have enabled the creation of sophisticated face-swapped videos, also known as DeepFakes, which brings great potential threats to our society. Hence, it is crucial to develop effective approaches to distinguish them. Currently, face-swapped videos produced by existing methods are prone to exhibit some subtle spatial and temporal manipulated traces, which can be utilized as distinctive clues for face-swapped video detection. In this paper, we propose a unified framework, named FSSpotter, to explore rich spatial and temporal information in the video simultaneously. It consists of a Spatial Feature Extractor (SFE), which aims to discover spatial evidences within a single frame, and a Temporal Feature Aggregator (TFA), which is responsible for capturing temporal inconsistencies between frames. Moreover, a novel data processing strategy is adopted to highlight the inconsistencies of forged face with its surrounding regions. The evaluations on Deepfakes of FaceForensics++, DeepfakeTIMIT, UADFV and Celeb-DF datasets demonstrate that the proposed approach achieves better or comparable performance on AUC scores.
BibTeX
@inproceedings{chen2020fsspotter,
author = {Peng Chen and Jin Liu and Tao Liang and Guangzhi Zhou and Hongchao Gao and Jiao Dai and Jizhong Han},
title = {{FSSPOTTER: Spotting Face-Swapped Video by Spatial and Temporal Clues}},
booktitle = {ICME},
year = {2020},
url = {https://openreview.net/forum?id=WMrP4Eeh9sp},
}Loading related content...