A mid-level representation of visual structures for video compression

Georgios Georgiadis, Stefano SoattoWACV 2016 · OpenReview

Abstract

A video coding system is presented that partitions the scene into "visual structures" and a residual "background" layer. A low-level representation ("track-template") of visual structures is proposed that exploits their temporal redundancy. A dictionary of track-templates is constructed that is used to encode video frames. We make optimal use of the dictionary in terms of rate-distortion by choosing a subset of the dictionary's elements for encoding using a Markov Random Field (MRF) formulation that places the track-templates in "depth" layers. The selected "track-templates" form the mid-level representation of the "visual structure" regions of the video. Our video coding system offers improvements over H.265/H.264 and other methods in a rate-distortion comparison.
BibTeX
@inproceedings{georgiadis2016mid,
  author = {Georgios Georgiadis and Stefano Soatto},
  title = {{A mid-level representation of visual structures for video compression}},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year = {2016},
  url = {https://openreview.net/forum?id=AVdlkDcTZy},
}

Loading related content...

Figure