Precision Enhancement of 3-D Surfaces from Compressed Multiview Depth Maps
Lists
Only you see this
Abstract
Transmitting depth maps captured from multiple viewpoints of a 3-D scene enables a wide range of receiver-side 3-D applications, including virtual view synthesis via depth-image-based rendering (DIBR). Observing that compressed depth maps from different viewpoints constitute multiple descriptions (MD) of the same signal, we propose to reconstruct 3-D surfaces of the scene by considering multiple compressed depth maps jointly. Specifically, we propose an alternating projection algorithm, inspired by the theory of projection onto convex sets (POCS), which at convergence returns a 3-D surface that satisfies three sets of conditions: spatial smoothness prior, quantization bin constraints in the block transform domain, and inter-view consistency. We present a theoretical proof that shows convergence of our algorithm under benign conditions. Compared to existing multiview depth map denoising schemes and single image de-quantization schemes, our proposed solution achieves higher objective quality for both reconstructed depth maps and synthesized virtual views.
BibTeX
@article{wan2015precision,
author = {Pengfei Wan and Gene Cheung and Philip A. Chou and Dinei A. F. Florêncio and Cha Zhang and Oscar C. Au},
title = {{Precision Enhancement of 3-D Surfaces from Compressed Multiview Depth Maps}},
journal = {IEEE Signal Processing Letters},
year = {2015},
url = {https://openreview.net/forum?id=m92WZJFLHu},
}| 3D Point Cloud Enhancement using Graph-Modelled Multiview Depth Measurements | arXiv · 2020 |
| Depth Coding Based on Compressed Sensing with Optimized Measurement and Quantization | J. Inf. Hiding Multim. Signal Process · 2014 |
| Optimized Multiple Description Lattice Vector Quantization Coding for 3D Depth Image | Ksii Trans. Internet Inf. Syst · 2015 |
| Dynamic 3D Scene Depth Reconstruction via Optical Flow Field Rectification | Plos · 2012 |
| Joint Reconstruction of Multi-view Compressed Images | arXiv · 2012 |
| Scalable Coding of Depth Images with Synthesis-Guided Edge Detection | Ksii · 2015 |