HSCNN+: Advanced CNN-Based Hyperspectral Recovery From RGB Images

Zhan Shi, Chang Chen, Zhiwei Xiong, Dong Liu, Feng Wu

Abstract

Hyperspectral recovery from a single RGB image has seen a great improvement with the development of deep convolutional neural networks (CNNs). In this paper, we propose two advanced CNNs for the hyperspectral reconstruction task, collectively called HSCNN+. We first develop a deep residual network named HSCNN-R, which comprises a number of residual blocks. The superior performance of this model comes from the modern architecture and optimization by removing the hand-crafted upsampling in HSCNN. Based on the promising results of HSCNN-R, we propose another distinct architecture that replaces the residual block by the dense block with a novel fusion scheme, leading to a new network named HSCNN-D. This model substantially deepens the network structure for a more accurate solution. Experimental results demonstrate that our proposed models significantly advance the state-of-the-art. In the NTIRE 2018 Spectral Reconstruction Challenge, our entries rank the 1st (HSCNN-D) and 2nd (HSCNN-R) places on both the "Clean" and "Real World" tracks.
BibTeX
@inproceedings{shi2018hscnn,
  author = {Zhan Shi and Chang Chen and Zhiwei Xiong and Dong Liu and Feng Wu},
  title = {{HSCNN+: Advanced CNN-Based Hyperspectral Recovery From RGB Images}},
  booktitle = {Workshops @ CVPR},
  year = {2018},
  url = {https://openreview.net/forum?id=B1VRjkfdZr},
}

Loading related content...

Figure