Cascaded Context Dependency: An Extremely Lightweight Module For Deep Convolutional Neural Networks

Xu Ma, Zhinan Qiao, Jingda Guo, Sihai Tang, Qi Chen, Qing Yang, Song FuICIP 2020 · OpenReview

Abstract

In this paper, we present a cascaded context dependency module, which is a highly lightweight module that can improve the performance of deep convolutional neural networks for various visual tasks. Inspired by the feature pyramid work in object detection and the context dependency work in image recognition, we consider to cascade the contexts of multiscale feature maps to aggregate the locality and globality in a local region. We further extract the dependency between original input and cascaded contexts for feature recalibration. Without employing learnable layers, our method introduces almost no additional parameters and computations. Furthermore, Our module can be seamlessly plugged into many existing CNN architectures to improve the performance. Experiments on ImageNet and MS COCO benchmarks indicate that our method can achieve results on par with or better than related work. Qualitatively, we achieve an absolute 1.42% (77.3137% vs. 75.8974%) top-1 classification accuracy improvement based on ResNet50 on ImageNet 2012 validation set with negligible computational overhead. Besides, our method yields significant gains on the MS COCO benchmark for the object detection task. All codes and models are made publicly available 1 . 1 We submit all the codes, pre-trained models, and training log files to https://github.com/13952522076/ParameterFree.
BibTeX
@inproceedings{ma2020cascaded,
  author = {Xu Ma and Zhinan Qiao and Jingda Guo and Sihai Tang and Qi Chen and Qing Yang and Song Fu},
  title = {{Cascaded Context Dependency: An Extremely Lightweight Module For Deep Convolutional Neural Networks}},
  booktitle = {ICIP},
  year = {2020},
  url = {https://openreview.net/forum?id=g71SPVkXfJ},
}

Loading related content...

Figure