Facial Behavior Analysis using 4D Curvature Statistics for Presentation Attack Detection

Martin Thümmel, Sven Sickert, Joachim Denzler

Abstract

This paper introduces a novel method for Presentation Attack Detection (PAD) that shifts focus from static 3D geometry to the analysis of 4D facial behavior (3D sequences over time). By measuring temporal changes in surface curvature along radial stripes of the face, the researchers distinguish genuine human expressions from sophisticated spoofs. Utilizing an anomaly detection model trained exclusively on real faces, the system achieves high robustness against various attacks, including silicone masks and video replays, without requiring prior exposure to specific attack types during training.

Introduction

Facial recognition systems are increasingly targeted by "presentation attacks," ranging from simple printed photos to high-fidelity 3D silicone masks. While 3D sensors have improved security against flat 2D spoofs, they remain vulnerable to masks that accurately mimic human geometry. The authors argue that the critical missing link in current security is behavioral plausibility. A static or even an elastic mask does not deform with the same subtle, complex curvature changes characteristic of human skin and muscle.

Examples of presentation attacks used in the study, including elastic masks, static masks, and monitor replays.

Methodology

The proposed pipeline focuses on the temporal dynamics of surface curvature through a multi-stage process:

  1. 4D Data Acquisition: Sequences of 3D scans are captured while the user performs a "challenge-response" task (e.g., answering a question) to induce natural facial movement.
  2. Radial Stripe Extraction: To manage high-resolution data, the face is intersected with planes at regular angles, creating "radial stripes" emanating from the nose tip.
  3. Curvature Statistics: Curvature is calculated using "surface variation," a metric based on the eigenvalues of local point neighborhoods, ensuring robustness against sensor noise.
  4. Temporal Cross-Correlation: The system calculates the maximum cross-correlation ($R_t$) between consecutive frames for each stripe, capturing how the facial landscape shifts during movement.
  5. Anomaly Detection: A One-Class SVM is trained only on genuine faces to learn the manifold of normal human movement. Any deviation—such as the rigid motion of a static mask or the reduced complexity of an elastic one—is flagged as an attack.
Overview of the 4D curvature analysis pipeline, from 3D reconstruction to temporal cross-correlation.

Experimental Setup and Datasets

Due to a lack of existing 4D PAD databases with diverse attack types, the authors recorded a new dataset featuring 24 subjects (9 women, 15 men). The database includes 109 4D scans covering 11 attack categories, such as elastic 3D masks, static 3D masks, bent photographs, and monitor replay attacks. Participants were prompted with open-ended questions to ensure natural mouth and eye dynamics.

Key Results and Insights

The method demonstrated high effectiveness in identifying sophisticated spoofs:

  • AUROC: 95.90%
  • APCER (Attack Presentation Classification Error Rate): 11.46%
  • BPCER (Bona Fide Presentation Classification Error Rate): 6.19%

Curvature serves as a "behavioral fingerprint" that is invariant to 3D Euclidean transformations (rotation and translation), allowing the system to remain robust even if the user moves their head. The researchers found that the mouth and eye regions provide the strongest signals for distinguishing real humans from spoofs. Qualitatively, the system successfully detected that even when an elastic mask moves, its overall facial expression intensity and complexity are significantly lower than those of a genuine face.

Limitations and Future Work

While highly effective, the system faced challenges with "partial chin masks," where the upper face still moves naturally. Additionally, some genuine users were misclassified if they failed to move or blink sufficiently during the challenge-response phase. Future work will explore localizing specific anomalous facial regions to improve accuracy and investigate applications in medical fields, such as monitoring facial palsy treatment progress.

Summary updated

Abstract

The human face has a high potential for biometric identification due to its many individual traits. At the same time, such identification is vulnerable to biometric copies. These presentation attacks pose a great challenge in unsupervised authentication settings. As a countermeasure, we propose a method that automatically analyzes the plausibility of facial behavior based on a sequence of 3D face scans. A compact feature representation measures facial behavior using the temporal curvature change. Finally, we train our method only on genuine faces in an anomaly detection scenario. Our method can detect presentation attacks using elastic 3D masks, bent photographs with eye holes, and monitor replay-attacks. For evaluation, we recorded a challenging database containing such cases using a high-quality 3D sensor. It features 109 4D face scans including eleven different types of presentation attacks. We achieve error rates of 11% and 6% for APCER and BPCER, respectively.
BibTeX
@inproceedings{thummel2021facial,
  author = {Martin Thümmel and Sven Sickert and Joachim Denzler},
  title = {{Facial Behavior Analysis using 4D Curvature Statistics for Presentation Attack Detection}},
  booktitle = {IWBF},
  year = {2021},
  doi = {10.1109/iwbf50991.2021.9465080},
}
Figure