FunFace: Feature Utility and Norm Estimation for Face Recognition

Žiga Babnik, Fadi Boutros, Naser Damer, Deepak Kumar Jain, Peter Peer, Vitomir ŠtrucarXiv 2026 · arXiv

TL;DR

FunFace is a novel adaptive margin loss function for face recognition that bridges the gap between visual image quality and actual cryptographic recognizability. By blending feature norms with a sample's "biometric utility" (estimated via the Certainty Ratio), FunFace significantly boosts face recognition performance on low-quality, real-world surveillance images while remaining highly competitive on high-quality datasets.

What Problem Does This Paper Address?

Modern face recognition (FR) models rely heavily on margin-based loss functions (like ArcFace or CosFace) to maximize the separation between different identities in a feature space. Recent state-of-the-art methods use adaptive margins (e.g., AdaFace, MagFace), which dynamically adjust the margin based on the difficulty of an image, typically using the feature norm as a proxy for image quality.

However, the authors point out a critical flaw: visual image quality (e.g., blur, illumination, resolution) does not perfectly translate to biometric utility—which is how useful an image actually is to a machine learning model trying to avoid false matches. As shown in the paper, an image can have a high feature norm (good visual quality) but low biometric utility, or vice versa.

Fig. 1: Comparison of the feature norms and biometric utility of samples. Feature norms commonly used by adap- tive margin functions [22], [29], have been shown to correlate well with the visual image quality of samples. While visual quality estimates provide a good source of information for the usefulness of samples for the recognition task, recently, biometric utility has been shown to capture the usefulness of samples more accurately. Here, we show visual examples of both high and low feature norm images as estimated by AdaFace [22], and compare their biometric utility, estimated by CR-FIQA [6]. We can observe a disparity between the feature norms and biometric utility, alluding to the fact that the information present in feature norms cannot accurately represent the biometric sample utility.

Relying solely on feature norms means loss functions cannot accurately adapt to the true biometric difficulty of a sample, limiting performance in challenging, low-quality scenarios like surveillance or drone footage.

Methods

FunFace addresses this limitation by explicitly incorporating biometric utility into the adaptive margin framework of AdaFace.

Overview of the proposed FunFace loss function

The core innovation lies in the adaptive function $\kappa$, which scales the angular ($g_{angle}$) and additive ($g_{add}$) margins:

$$\kappa = \lambda \cdot \hat{\|z_i\|} + (1 - \lambda) \cdot \hat{\|CR_i\|}$$

Where:

  • $\hat{\|z_i\|}$ is the normalized feature norm (representing visual quality).
  • $\hat{\|CR_i\|}$ is the normalized Certainty Ratio (CR), which acts as the proxy for biometric utility. CR is calculated online during training as the ratio of the sample's similarity to its true class center versus its similarity to the nearest negative class center.
  • $\lambda$ is a mixing hyperparameter that balances the two quality descriptors.

Additionally, because adaptive margins thrive on diverse data, the authors introduced an extended suite of aggressive data augmentations during training—including noising, grayscaling, masking (to simulate occlusions like masks or glasses), and affine transformations.

Datasets

The authors evaluated FunFace comprehensively across various scales and difficulties:

  • Training Datasets: MS1MV2 (5.8M images), MS1MV3 (5.1M images), and WebFace4M (4.2M images).
  • Low Difficulty Benchmarks: LFW, CFP-FP, CPLFW, AgeDB, and CALFW.
  • Medium Difficulty Benchmark: IJB-C.
  • High Difficulty (Low Quality) Benchmarks: TinyFace, DroneSURF, and SurvFace.

Key Insights and Ideas

  • The Non-Linear Mismatch: Plotting feature norms against biometric utility reveals a complex, non-linear relationship. For low-quality images, they correlate linearly, but for higher-quality images, they actually exhibit an inverse correlation. This proves that feature norms alone cannot accurately depict biometric utility.
  • FIQA > IQA: Face Image Quality Assessment (FIQA) metrics like CR-FIQA possess vastly superior predictive strength for face recognition compared to standard Image Quality Assessment (IQA) metrics like BRISQUE. Discarding images based on BRISQUE scores can actually degrade model performance, whereas discarding based on CR consistently improves it.
Predictive strength of FIQA vs IQA
  • Dynamic Gradient Scaling: By adding the Certainty Ratio, FunFace alters the gradient scale during training. Early on, it prioritizes easier samples to stabilize embedding learning. As training progresses and the average CR increases, the loss automatically shifts its weight toward harder, ambiguous samples near the decision boundaries.

Key Results

FunFace achieved state-of-the-art results on low-quality, high-difficulty benchmarks while maintaining top-tier performance on standard datasets:

  • TinyFace Benchmark: When trained on MS1MV2, FunFace achieved a 69.07% Rank-1 accuracy, outperforming AdaFace (68.21%). On WebFace4M, it reached 73.31%.
  • DroneSURF (Active Scenario): FunFace demonstrated a massive leap, hitting 65.20% Rank-1 accuracy compared to AdaFace's 59.00%.
  • SurvFace (1% FAR): FunFace scored 11.91% True Acceptance Rate (TAR), significantly outperforming AdaFace (7.55%) and MagFace (9.45%).

The Catch: This performance boost comes at a computational cost. FunFace increases training runtime significantly because it must compute the closest negative neighbor for every sample in a batch. Its per-batch runtime was measured at 0.1220 seconds, compared to AdaFace's 0.0075 seconds.

Limitations and Future Work

The primary limitation of FunFace is its heavy computational overhead during training, making it slower to train than standard adaptive loss functions. Furthermore, while it dominates in low-quality domains, it performs comparably (but not noticeably better) to existing methods on high- and medium-quality datasets.

Future work includes optimizing the negative-mining step to reduce training time and exploring the interplay between extended data augmentations and biometric utility estimation more deeply.

Summary updated

Abstract

Face Recognition (FR) is used in a variety of application domains, from entertainment and banking to security and surveillance. Such applications rely on the FR model to be robust and perform well in a variety of settings. To achieve this, state-of-the-art FR models typically use expressive adaptive margin loss functions, which tie the feature norm to concepts related to sample quality, such as recognizability and perceptual image quality. Recently, through the development of Face Image Quality Assessment (FIQA) techniques, biometric utility has become the preferred measure of face-image quality and has been shown to be a better predictor of the usefulness of samples for face recognition compared to more human-centric aspects, such as resolution, blur, and lighting, tied to general image quality. While image quality expressed through feature norms exhibits a certain level of correlation with biometric utility, it does not fully encapsulate all aspects of utility. To address this point, we propose a new adaptive margin loss, FunFace (Face Recognition Through Utility and Norm Estimation), which incorporates biometric utility, estimated by the Certainty Ratio, into the adaptive margin, taking inspiration from AdaFace. We show that FunFace (when used to train a face recognition model) achieves competitive results to other state-of-the-art FR models on benchmarks containing high-quality samples, while surpassing them on low quality benchmarks.
BibTeX
@misc{babnik2026funface,
  author = {Žiga Babnik and Fadi Boutros and Naser Damer and Deepak Kumar Jain and Peter Peer and Vitomir Štruc},
  title = {{FunFace: Feature Utility and Norm Estimation for Face Recognition}},
  year = {2026},
  eprint = {2604.26598},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2604.26598},
}

Loading related content...

Figure