Rate-Distortion Driven Decomposition of Multiview Imagery to Diffuse and Specular Components

Maryam Haghighat, Reji Mathew, David TaubmanIEEE TIP 2020 · DOI · OpenReview

Abstract

In this work, we propose an overcomplete representation of multiview imagery for the purpose of compression. We present a rate-distortion (R-D) driven approach to decompose multiview datasets into two additive parts which can be interpreted as diffuse and specular content. We choose distinct and different sparsifying transforms for the diffuse and specular components and employ an R-D inspired measure as our optimization cost function to drive the decomposition based solely on compressibility. We first describe a framework which performs data separation in a registered domain to avoid the complexity of warping between views. Then a more comprehensive approach is proposed to separate specular data progressively from coordinates of multiple reference views. Experimental results show a coding gain of up to 0.6 dB for synthetic datasets and up to 0.9 dB for real datasets.
BibTeX
@article{haghighat2020rate,
  author = {Maryam Haghighat and Reji Mathew and David Taubman},
  title = {{Rate-Distortion Driven Decomposition of Multiview Imagery to Diffuse and Specular Components}},
  journal = {IEEE Trans. Image Process.},
  year = {2020},
  doi = {10.1109/tip.2020.2983849},
}

Loading related content...

Figure