Synthetic Face Ageing: Evaluation, Analysis and Facilitation of Age-Robust Facial Recognition Algorithms

Yao Wang, Muhammad Ali Farooq, Joseph Lemley, Peter CorcoranarXiv 2024 · DOI · arXiv

Abstract

The ability to accurately recognize an individual's face with respect to human aging factor holds significant importance for various private as well as government sectors such as customs and public security bureaus, passport office, and national database systems. Developing a robust age-invariant face recognition system is of crucial importance to address the challenges posed by ageing and maintain the reliability and accuracy of facial recognition technology. This research explores the feasibility of utilizing synthetic ageing data to improve the robustness of face recognition models. We evaluate state-of-the-art synthetic ageing methods and explore the effect of age intervals on deep learning-based face recognition algorithms. Experimental results show that the recognition rate of a model trained on synthetic ageing images is 3.33% higher than the baseline when tested on images with a 40-year age gap, demonstrating the potential of synthetic data to enhance age-invariant systems.

Introduction

Facial recognition systems are remarkably accurate today, but they face a significant challenge: the human aging factor. As individuals age, bone structure shifts, skin loses elasticity, and features change, leading to a drop in reliability for long-term applications like passport control or tracking missing persons. The primary obstacle in addressing this is data scarcity; finding large-scale, longitudinal datasets tracking the same individuals over decades is difficult. This study investigates whether Generative Adversarial Networks (GANs) can bridge this gap by synthesizing the aging process to train more robust recognition models.

Methodology

The research was conducted in two phases: evaluation and facilitation.

Evaluation of Synthetic Ageing

Three state-of-the-art GAN-based models were compared:

  • SAM (Style-based Age Manipulation): Uses a pre-trained StyleGAN to manipulate age via a regression network.
  • CUSP (Custom Structure Preservation): Focuses on maintaining underlying facial structure during age editing.
  • AgeTransGAN: A multi-task framework designed for identity-preserving age transformation.

Evaluation utilized a "self-consistency" framework, where faces were aged and then "reverse-aged" to check identity consistency. Automated age estimators verified the accuracy of the target ages.

Synthetic sample generated at target age 25.

Facilitating Recognition

The researchers used the ArcFace model as a baseline. They fine-tuned it using synthetic datasets generated from the SAM model to determine if exposure to simulated aging improved performance on real-world longitudinal data from the B3FD (Biometrically Filtered Famous Figure Dataset).

Experimental Results

The study revealed a natural tension between aging a face and preserving its identity. While AgeTransGAN excelled at identity preservation, SAM was more accurate at reaching specific target ages.

Synthetic sample of the same identity aged to 45.

Key findings include:

  • Performance Decay: On the real-world B3FD dataset, baseline accuracy dropped from 98.34% (1-year gap) to 88.88% (40-year gap).
  • Synthetic Data Boost: Fine-tuning with synthetic data improved the 40-year gap recognition rate to 92.21%, a 3.33% increase over the baseline.
  • Optimal Training Age: Synthetic samples aged to 55 years provided the most robust performance boost across various age intervals.

Conclusion

Synthetic aging data, while not a perfect mirror of reality, serves as a valuable resource for improving the generalization of deep learning models. By providing age-variant features that are difficult to obtain in real-world datasets, synthetic data significantly narrows the performance gap caused by human aging. Future work will focus on subjective human evaluation and developing more sophisticated quality metrics for synthetic transformations.

Summary updated

Abstract

The ability to accurately recognize an individual's face with respect to human aging factor holds significant importance for various private as well as government sectors such as customs and public security bureaus, passport office, and national database systems. Therefore, developing a robust age-invariant face recognition system is of crucial importance to address the challenges posed by ageing and maintain the reliability and accuracy of facial recognition technology. In this research work, the focus is to explore the feasibility of utilizing synthetic ageing data to improve the robustness of face recognition models that can eventually help in recognizing people at broader age intervals. To achieve this, we first design set of experiments to evaluate state-of-the-art synthetic ageing methods. In the next stage we explore the effect of age intervals on a current deep learning-based face recognition algorithm by using synthetic ageing data as well as real ageing data to perform rigorous training and validation. Moreover, these synthetic age data have been used in facilitating face recognition algorithms. Experimental results show that the recognition rate of the model trained on synthetic ageing images is 3.33% higher than the results of the baseline model when tested on images with an age gap of 40 years, which prove the potential of synthetic age data which has been quantified to enhance the performance of age-invariant face recognition systems.
BibTeX
@misc{wang2024synthetic,
  author = {Yao Wang and Muhammad Ali Farooq and Joseph Lemley and Peter Corcoran},
  title = {{Synthetic Face Ageing: Evaluation, Analysis and Facilitation of Age-Robust Facial Recognition Algorithms}},
  year = {2024},
  eprint = {2406.06932},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2406.06932},
}
Figure