Sparse Flow: Sparse Matching for Small to Large Displacement Optical Flow
Lists
Only you see this
Abstract
Despite recent advances, the extraction of optical flow with large displacements is still challenging for state-of the-art methods. The approaches that are the most successful at handling large displacements blend sparse correspondences from a matching algorithm with an optimization that refines the optical flow. We follow the scheme of Deep-Flow [33]. We first extract sparse pixel correspondences by means of a matching procedure and then apply a variational approach to obtain a refined optical flow. In our approach, coined 'Sparse Flow', the novelty lies in the matching. This uses an efficient sparse decomposition of a pixel's surrounding patch as a linear sum of those found around candidate corresponding pixels. As matching pixel the one dominating the decomposition is chosen. The pixel pairs matching in both directions, i.e. in a forward-backward fashion, are used as guiding points in the variational approach. Sparse-Flow is competitive on standard optical flow benchmarks with large displacements, while showing excellent performance for small and medium displacements. Moreover, it is fast in comparison to methods with a similar performance.
BibTeX
@inproceedings{timofte2015sparse,
author = {Radu Timofte and Luc Van Gool},
title = {{Sparse Flow: Sparse Matching for Small to Large Displacement Optical Flow}},
booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
year = {2015},
url = {https://openreview.net/forum?id=Z6gDWUJQOfVN},
}Loading related content...