Introduction
Face Image Quality Assessment (FIQA) serves as a critical gatekeeper in biometric systems, determining whether an input image possesses sufficient clarity, lighting, and pose for accurate processing. However, current FIQA models suffer from a significant ethnic quality bias. Because primary training datasets like CASIA-Webface and MS-Celeb-1M are predominantly composed of Caucasian faces (often exceeding 74%), models frequently fail to generalize to other ethnicities. This imbalance leads to non-Caucasian faces receiving lower quality scores regardless of actual image clarity, creating a bottleneck for fairness in global face recognition systems.
Two primary technical hurdles complicate the mitigation of this bias. First, FIQA is typically framed as a regression task, which is notoriously difficult to transfer between domains due to shifts in feature scales. Second, the lack of objective "ground truth" labels for face quality makes it challenging to ensure a model isn't simply learning the noise or specific quirks of the source domain.
Methodology: The EQBM Framework
To address these challenges, the authors propose the Ethnic-Quality-Bias Mitigating (EQBM) framework. This approach shifts the paradigm from simple scalar regression to a distribution-based, curriculum-driven domain adaptation strategy.
From Scalars to Likert Scales
Instead of predicting a single quality score, EQBM maps quality into a Likert-scale probability distribution (e.g., probabilities for levels like "poor," "fair," and "excellent"). This soft-mapping stabilizes the learning process and bypasses the feature scaling issues inherent in traditional regression-based domain adaptation, providing a more robust foundation for cross-ethnic transfer.
Curriculum Domain Adaptation
Recognizing that not all images are equally informative, the framework employs an "easy-to-hard" training scheduler. Samples are prioritized based on two metrics:
- Inter-domain Uncertainty: Identifying samples that look similar across races in the feature space.
- Intra-domain Quality Margin: Selecting pairs where the quality difference is clear and unambiguous. By starting with "easy" pairs, the model builds a stable foundation before tackling complex cases where ethnic features might otherwise distract from quality assessment.
Ranking-based Domain Adversarial Network
To overcome the absence of ground-truth labels, the model utilizes a pairwise ranking loss. Rather than guessing an absolute score, the network learns to identify which of two images is of higher quality. This is integrated with a Gradient Reversal Layer (GRL) to ensure that the learned features are "race-blind" while remaining highly "quality-aware."
Experimental Results
The EQBM framework was validated using the Racial Faces in the Wild (RFW) benchmark, which contains 10,000 images for each of four ethnic groups: Caucasian, Indian, Asian, and African. Training was conducted on the BUPT-Transferface dataset, using Caucasian images as the source and unlabeled images of other races as the target domain.
Using the Area Over Curve (AOC) metric, the EQBM-S variant demonstrated substantial improvements over state-of-the-art (SOTA) methods like FaceQAN and SDD-FIQA:
- African Group: 13.2% improvement over the best competitor.
- Indian Group: 41.4% improvement in accuracy.
- Asian Group: 21.9% improvement.
Crucially, the model maintained high performance on general benchmarks like IJB-C (AOC of 0.632), proving that mitigating ethnic bias does not necessitate a trade-off in overall system performance.
Conclusion and Future Work
The EQBM framework successfully addresses ethnic bias in FIQA by treating quality as a distribution and employing a curriculum-based ranking strategy. While this represents a significant step toward fairer biometrics, the authors note that gender and age bias remain open challenges. Future research will explore extending this curriculum approach to a multi-attribute framework that simultaneously addresses race, gender, and age to ensure universal reliability in face recognition technology.
Summary updated