Motion Feedback Design for Video Frame Interpolation
Lists
Only you see this
Abstract
This paper introduces a feedback-based approach to interpolate video frames involving small and fast-moving objects. Unlike the existing feedforward-based methods that estimate optical flow and synthesize in-between frames sequentially, we introduce a motion-oriented component that adds a feedback block to the existing multi-scale autoencoder pipeline, which feedbacks information of small objects shared between architectures of two different scales. We show that feeding this additional information enables more robust detection of optical flow caused by small objects in fast motion. Using experiments on various datasets, we show that the feedback mechanism allows our method to achieve state-of-the-art results, both qualitatively and quantitatively.
BibTeX
@inproceedings{hu2020motion,
author = {Mengshun Hu and Liang Liao and Jing Xiao and Lin Gu and Shin'ichi Satoh},
title = {{Motion Feedback Design for Video Frame Interpolation}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2020},
url = {https://openreview.net/forum?id=2vrgY0zxmy4},
}Loading related content...