Abstract
Photo attacks represent the most accessible spoofing method for face recognition systems, as facial images are often publicly available. Imposters can manipulate photographs to mimic live movements, making detection a significant challenge. Video spoofing poses an even greater threat, as it incorporates physiological clues like blinking and head movement. This paper explores liveness detection techniques, focusing on spontaneous eye blinking as a non-intrusive physiological clue. We propose a robust software-based solution using Conditional Random Fields (CRF) and a novel 'eye closity' metric to distinguish live faces from static photographs using standard webcams.
Introduction: The Challenge of Face Spoofing
Face recognition systems are increasingly ubiquitous, yet they remain vulnerable to simple "low-tech" attacks. The most prevalent is the photo attack, where an imposter presents a high-quality photograph of a legitimate user. While humans intuitively recognize physiological clues like facial expressions and eye movement, translating this capability to computer vision is complex, especially in unconstrained environments.
Previous solutions have relied on depth estimation or non-rigid deformation detection. However, depth estimation is sensitive to noise and lighting, while motion detection often requires high-quality input or active user collaboration (e.g., head rotation or speaking). The goal of this research is a "software-only" solution that utilizes standard webcams without requiring extra effort from the user.
Methods: Modeling the Blink
The proposed system focuses on spontaneous eye blinking, a natural physiological process. The technical approach rests on two pillars:
1. Eye Closity
Instead of processing raw pixels, the authors introduce "eye closity," a discriminative measure that maps an eye image to a single scalar value. Using an ensemble of weak classifiers, the system determines if an eye is open (negative score) or closed (positive score). This abstraction reduces computational load while preserving essential temporal information.
2. Conditional Random Fields (CRF)
Blinking is a dynamic temporal sequence: Open → Ambiguous → Closed → Ambiguous → Open. Traditional models like Hidden Markov Models (HMMs) assume independent observations, which fails to capture the context of video frames. By employing a Conditional Random Field (CRF), the system incorporates a temporal window ($W$) of surrounding frames. This contextual awareness makes the model robust against transient noise, such as reflections on eyewear.
Datasets and Validation
To validate the approach, two datasets were developed:
- ZJU Eyeblink Database: 80 video clips of 20 individuals under various conditions, including different eyewear and camera angles.
- ZJU Photo-Imposter Database: 100 spoofing attempts involving static photos, 3D movement, rotation, and bending to simulate facial depth.
Key Insights
- Temporal Context: Accuracy improved significantly with a window size of $W=3$ (7 frames total). This aligns with the typical 250ms duration of a human blink.
- State Modeling: Moving beyond binary "open/closed" states to include an "ambiguous" state better captures the fluid motion of eyelids.
- Real-time Performance: The system achieves 20 frames per second (fps), making it suitable for live authentication on standard hardware.
Results
The CRF-based approach demonstrated superior performance over traditional methods:
- Detection Rate: Achieved a 95.7% two-eye detection rate.
- Comparative Advantage: In one-eye tests, the CRF (88.8%) significantly outperformed Cascaded AdaBoost (64.0%) and HMM (49.6%).
- Spoofing Resistance: Only 1 out of 100 photo-spoofing clips successfully fooled the $W=3$ model.
Limitations and Future Outlook
While highly effective against photo attacks, the system faces challenges with strong eyeglass reflections that obscure the eye. Furthermore, video attacks—where an imposter plays a recording of a valid user—remain a threat, as they contain genuine blinking patterns. Future work will need to address these sophisticated spoofing methods to ensure comprehensive security.
Summary updated