Video recoloring via spatial-temporal geometric palettes

Zheng-Jun Du, Kai-Xiang Lei, Kun Xu, Jianchao Tan, Yotam I. GingoldACM Trans. Graphics 2021 · OpenReview

Abstract

Color correction and color grading are important steps in film production. Recent palette-based approaches to image recoloring have shown that a small set of representative colors provide an intuitive set of handles for color adjustment. However, a single, static palette cannot represent the time-varying colors in a video. We introduce a spatial-temporal geometry-based approach to video recoloring. Specifically, its core is a 4D skew polytope with a few vertices that approximately encloses the video pixels in color and time, which implicitly defines time-varying palettes through slicing of the 4D skew polytope at specific time values. Our geometric palette is compact, descriptive, and provides a correspondence between colors throughout the video, including topological changes when colors merge or split. Experiments show that our method produces natural, artifact-free recoloring.
BibTeX
@article{du2021video,
  author = {Zheng-Jun Du and Kai-Xiang Lei and Kun Xu and Jianchao Tan and Yotam I. Gingold},
  title = {{Video recoloring via spatial-temporal geometric palettes}},
  journal = {ACM Trans. Graphics},
  year = {2021},
  url = {https://openreview.net/forum?id=8GrDQDTRd9},
}

Loading related content...

Figure