Learning Compressible 360$^{\circ }$∘ Video Isomers
Lists
Only you see this
Abstract
Standard video encoders developed for conventional narrow field-of-view video are widely applied to 360 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">°</sup> video as well, with reasonable results. However, while this approach commits arbitrarily to a projection of the spherical frames, we observe that some orientations of a 360 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">° </sup> video, once projected, are more compressible than others. We introduce an approach to predict the sphere rotation that will yield the maximal compression rate. Given video clips in their original encoding, a convolutional neural network learns the association between a clip's visual content and its compressibility at different rotations of a cubemap projection. Given a novel video, our learning-based approach efficiently infers the most compressible direction in one shot, without repeated rendering and compression of the source video. We validate our idea on thousands of video clips and multiple popular video codecs. The results show that this untapped dimension of 360 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">°</sup> compression has substantial potential-“good” rotations are typically 8-18 percent more compressible than bad ones, and our learning approach can predict them reliably 78 percent of the time.
BibTeX
@article{su2021learning,
author = {Yu-Chuan Su and Kristen Grauman},
title = {{Learning Compressible 360$^\{\textbackslash\{\}circ \}$∘ Video Isomers}},
journal = {IEEE Trans. Pattern Anal. Mach. Intell.},
year = {2021},
doi = {10.1109/tpami.2020.2974472},
}Loading related content...