Two-Stage Depth Video Recovery with Spatiotemporal Coherence

Quewei Li, Jie Guo, Qinyu Tang, Yanwen Guo, Jinghui QianICME 2020 · OpenReview

Abstract

This paper proposes a practical two-stage method to enhance the depth channel of low-quality RGB-D videos. At the first stage of the proposed method, we select several key frames from an input RGB-D video and recover them with a new MRF-regularized low-rank matrix completion method. At the second stage, we introduce a novel Laplacian smoothing algorithm to smoothly expand the recovered key depth frames to other in-between frames. With associated weights extracted from color images and a depth confidence constraint, we are able to recover each in-between frame faithfully and guarantee long-range temporal consistency. Experiments show that our method can generate high-quality and spatiotemporally coherent RGB-D videos for a wide range of scene configurations and achieve the state-of-the-art performance. Several applications further validate the effectiveness of the proposed method.
BibTeX
@inproceedings{li2020two,
  author = {Quewei Li and Jie Guo and Qinyu Tang and Yanwen Guo and Jinghui Qian},
  title = {{Two-Stage Depth Video Recovery with Spatiotemporal Coherence}},
  booktitle = {ICME},
  year = {2020},
  url = {https://openreview.net/forum?id=nvPjTHpYwgA},
}

Loading related content...

Figure