Identity-Obscured Neural Radiance Fields: Privacy-Preserving 3D Facial Reconstruction

Jiayi Kong, Baixin Xu, Xurui Song, Chen Qian, Jun Luo, Ying He

Introduction

State-of-the-art 3D head reconstruction techniques, such as Neural Radiance Fields (NeRF) and Signed Distance Functions (SDF), typically rely on dense sets of high-resolution, multi-view facial images. While these methods yield impressive results, they present significant privacy risks. Facial images are considered sensitive biometric data, susceptible to unauthorized tracking, surveillance, and the creation of malicious DeepFakes.

This research addresses a critical question: Can we reconstruct a detailed 3D head model without exposing sensitive facial textures to the reconstruction algorithm? The authors propose that while facial textures (e.g., skin tone, eye color) are highly sensitive, the underlying 3D geometry is less so. By decoupling geometry from texture, they introduce a method to generate high-fidelity 3D models using only "privacy-neutral" and "privacy-protected" data.

Methodology: The Two-Stage Pipeline

The proposed system utilizes a novel two-stage pipeline built upon the VolSDF framework, a volume rendering approach for Signed Distance Functions. The core innovation lies in the selective use of image data to prevent identity exposure.

Overview of the two-stage privacy-preserving reconstruction pipeline, illustrating the transition from neutral images to gradient-based refinement.

Stage 1: Foundational Geometry

In the first stage, the model is trained using "privacy-neutral" images—specifically, views of the back and sides of the head. These images lack identifiable facial features but provide sufficient information to establish the global structure and low-frequency geometric priors of the subject. For scenarios with sparse data, a generic neutral head template can be integrated as a geometric prior.

Stage 2: Geometric Refinement via Gradients

To capture fine facial details (e.g., the specific contour of the nose or lips) without RGB data, the authors introduce privacy-protected gradient images. Users process their frontal photos locally using a gradient operator (such as a Sobel filter) to extract edge magnitudes. These maps retain geometric "edges" while discarding sensitive color and texture information.

Two key technical components ensure the success of this stage:

  • Gradient Loss ($L_{grad}$): The network compares the gradients of the rendered view against the user-provided gradient maps rather than comparing pixel colors.
  • Lipschitz Regularization ($L_{lip}$): To mitigate noise inherent in gradient-only supervision, Lipschitz constraints are applied to the MLP layers, ensuring the reconstructed surface remains smooth and preventing over-fitting to artifacts.

Results and Discussion

The method was evaluated using the FaceScape and H3DS datasets, measuring geometric accuracy via Chamfer Distance (CD) and privacy protection through standard facial recognition (FR) systems.

Qualitative comparison of reconstruction stages against ground truth and full-image baselines across multiple subjects.

Geometric Fidelity

As shown in the qualitative results, Stage 2 significantly refines the coarse geometry from Stage 1, bringing it close to the quality of full-RGB baselines. Quantitatively, on the FaceScape dataset, the Chamfer Distance improved from 2.35 after Stage 1 to 0.78 after Stage 2 refinement, nearing the 0.49 achieved by standard VolSDF using full RGB images.

Privacy and Security

The privacy benefits are substantial. Facial recognition accuracy dropped from 91.67% with original images to just 6.05% when using the protected gradient inputs. Furthermore, the resulting models proved resistant to DeepFake manipulation, as the high-frequency textures required for convincing identity swaps were never captured or stored.

Conclusion and Future Work

This research demonstrates that gradient magnitudes provide sufficient signal to refine 3D meshes while effectively obscuring identity. By treating irreversibility as a feature—where multiple textures can produce the same gradient map—the system creates a viable privacy shield for 3D reconstruction.

Future work aims to address current limitations, such as the dependence on high-quality Stage 1 initialization and the handling of complex occlusions like glasses. Additionally, the authors suggest that integrating faster backends, such as 3D Gaussian Splatting, could move this privacy-preserving approach toward real-time applications.

Summary updated

BibTeX
@inproceedings{kong2025identity,
  author = {Jiayi Kong and Baixin Xu and Xurui Song and Chen Qian and Jun Luo and Ying He},
  title = {{Identity-Obscured Neural Radiance Fields: Privacy-Preserving 3D Facial Reconstruction}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2025},
  url = {https://openreview.net/forum?id=8RFyibf662},
}
Figure