Spoof Trace Disentanglement for Generic Face Anti-Spoofing

Yaojie Liu, Xiaoming Liu

Abstract

Prior studies show that the key to face anti-spoofing lies in the subtle image patterns, termed “spoof trace”, e.g., color distortion, 3D mask edge, and Moire pattern. Spoof detection rooted on those spoof traces can improve not only the model's generalization but also the interpretability. Yet, it is a challenging task due to the diversity of spoof attacks and the lack of ground truth for spoof traces. In this work, we propose a novel adversarial learning framework to explicitly estimate the spoof related patterns for face anti-spoofing. Inspired by the physical process, spoof faces are disentangled into spoof traces and the live counterparts in two steps: additive step and inpainting step. This two-step modeling can effectively narrow down the searching space for adversarial learning of spoof trace. Based on the trace modeling, the disentangled spoof traces can be utilized to reversely construct new spoof faces, which is used as data augmentation to effectively tackle long-tail spoof types. In addition, we apply frequency-based image decomposition in both the input and disentangled traces to better reflect the low-level vision cues. Our approach demonstrates superior performance on 3 testing scenarios: known attacks, unknown attacks, and open-set attacks. It provides visually-convincing spoof traces.
BibTeX
@article{liu2023spoof,
  author = {Yaojie Liu and Xiaoming Liu},
  title = {{Spoof Trace Disentanglement for Generic Face Anti-Spoofing}},
  journal = {IEEE Trans. Pattern Anal. Mach. Intell.},
  year = {2023},
  doi = {10.1109/tpami.2022.3176387},
}

Loading related content...

Figure