Introduction
Reconstructing high-fidelity 3D clothed humans from a single image is a cornerstone task for applications ranging from virtual reality to e-commerce. While Pixel-Aligned Implicit Functions (PIFu) have set a strong baseline, they often struggle with structural consistency and generalization to complex real-world scenarios. PIDiffu addresses these limitations by reimagining the reconstruction process as a line-wise diffusion task.
The Challenge of Single-Image Reconstruction
Traditional methods like PIFu predict occupancy or Signed Distance Functions (SDF) on a point-by-point basis. This independent prediction often leads to "depth ambiguity," manifesting as floating limbs, elongated torsos, or duplicated geometry. Furthermore, these models frequently fail when encountering "in-the-wild" images with unusual poses or intricate clothing patterns, as the conditioning mechanisms (like FiLM) can over-modulate and lead to unstable results.
The PIDiffu Approach: Line-wise Diffusion
PIDiffu shifts the paradigm from point-wise estimation to line-wise distribution estimation along camera rays.
Ray-based Diffusion
Instead of evaluating points in isolation, PIDiffu uses a diffusion model to generate the SDF for an entire ray simultaneously. This 1D approach captures the structural context necessary to ensure geometric consistency without the prohibitive computational cost of full 3D voxel grids.
Feature-wise Linear Attention (FiLA)
To improve robustness, the authors introduce FiLA. Unlike standard modulation techniques that can drastically alter feature maps, FiLA uses an attention-based residual mechanism. This allows the model to integrate image features while staying anchored to the robust geometric priors learned during training, preventing the "explosion" of artifacts in challenging cases.
Experimental Results
The model was trained on the THuman2.0 dataset and evaluated on benchmarks like BUFF and SSHQ.
Quantitative Performance
PIDiffu consistently outperforms state-of-the-art methods. On the BUFF dataset, it achieved a Chamfer Distance (CD) of 2.861, surpassing IntegratedPIFu's 2.968.
Qualitative Superiority
Visually, PIDiffu produces significantly cleaner meshes. It excels at reconstructing accessories like bags and hats—elements that typically cause baseline models to fail. By maintaining a consistent noise set during diffusion inference, the model ensures a smooth and continuous 3D surface.
Conclusion and Future Work
PIDiffu demonstrates that modeling 1D distributions along rays is a "sweet spot" for 3D human reconstruction, balancing efficiency with structural awareness. While it significantly reduces artifacts, challenges remain regarding extreme self-occlusion and dataset-induced demographic biases. Future work will focus on integrating parametric body models and expanding training diversity to further enhance generalization.
Summary updated