OISSR: Optical Image Stabilization Based Super Resolution on Smartphone Cameras

Hao Pan, Feitong Tan, Wenhao Li, Yi-Chao Chen, Guangtao XueACM Multimedia 2022 · OpenReview

Abstract

Multi-frame super-resolution methods can generate high resolution images by combining multiple captures of the same scene; however, the performance of merged results are susceptible to degradation due to a lack of precision in image registration. In this study, we sought to develop a robust multi-frame super resolution method (called OISSR) for use on smartphone cameras with a optical image stabilizer (OIS). Acoustic injection is used to alter the readings from the built-in MEMS gyroscope to control the lens motion in the OIS module (note that the image sensor is fixed). We employ a priori knowledge of the induced lens motion to facilitate optical flow estimation with sub-pixel accuracy, and the output high-precision pixel alignment vectors are utilized to merge the multiple frames to reconstruct the final super resolution image. Extensive experiments on a OISSR prototype implemented on a Xiaomi 10Ultra demonstrate the high performance and effectiveness of the proposed system in obtaining the quadruple enhanced resolution imaging.
BibTeX
@inproceedings{pan2022oissr,
  author = {Hao Pan and Feitong Tan and Wenhao Li and Yi-Chao Chen and Guangtao Xue},
  title = {{OISSR: Optical Image Stabilization Based Super Resolution on Smartphone Cameras}},
  booktitle = {ACM Multimedia},
  year = {2022},
  url = {https://openreview.net/forum?id=W-saZuG1G6j},
}

Loading related content...

Figure