PIDiffu: Pixel-aligned Diffusion Model for High-Fidelity Clothed Human Reconstruction
Lists
Only you see this
Abstract
This paper presents the Pixel-aligned Diffusion Model (PIDiffu), a new framework for reconstructing high-fidelity clothed 3D human models from a single image. While existing PIFu variants have made significant advances using more complicated 2D and 3D feature extractions, these methods still suffer from floating artifacts and body part du-plication due to their reliance on point-wise occupancy field estimations. PIDiffu employs a diffusion-based strategy for line-wise estimation along the ray direction, conditioned by pixel-aligned features with a guided attention. This approach improves the local details and structural accuracy of the reconstructed body shape and is robust to unfamiliar and complex image features. Moreover, PIDiffu can be easily integrated with existing PIFu-based methods to leverage their advantages. The paper demonstrates that PIDiffu outperforms state-of-the-art methods that do not rely on parametric 3D body models. Especially, our method is superior in handling ’in-the-wild’ images, such as those with complex patterned clothes unseen in the training data.
BibTeX
@inproceedings{lee2024pidiffu,
author = {Jungeun Lee and Sanghun Kim and Hansol Lee and Tserendorj Adiya and Hwasup Lim},
title = {{PIDiffu: Pixel-aligned Diffusion Model for High-Fidelity Clothed Human Reconstruction}},
booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
year = {2024},
doi = {10.1109/wacv57701.2024.00509},
}Loading related content...