Multi-Level Contrastive Learning for Dense Prediction Task
Lists
Only you see this
Abstract
In this work, we present Multi-Level Contrastive Learning for Dense Prediction Task (MCL), an efficient self-supervised method to learn region-level feature representation for dense prediction tasks. This approach is motivated by the three key factors in detection: localization, scale consistency and recognition. Considering the above factors, we design a novel pretext task, which explicitly encodes absolute position and scale information simultaneously by assembling multi-scale images in a montage manner to mimic multi-object scenario. Unlike the existing image-level self-supervised methods, our method constructs a multi-level contrastive loss by considering each sub-region of the montage image as a singleton to learn a regional semantic representation for translation and scale consistency, while reducing the pre-training epochs to the same as supervised pre-training. Extensive experiments show that MCL consistently outperforms the recent state-of-the-art methods on various datasets with significant margins. In particular, MCL obtains 42.5 AP^bb and 38.3 AP^mk on COCO with the 1x schedule and surpasses MoCo by 4.0 AP^bb and 3.1 AP^mk, when using Mask R-CNN with an R50-FPN backbone pre-trained with 100 epochs. In addition, we further explore the alignment between pretext task and downstream tasks. We extend our pretext task to supervised pre-training, which achieves a similar performance with self-supervised learning, demonstrating the importance of the alignment between pretext task and downstream tasks.
BibTeX
@misc{guo2023multi,
author = {Qiushan Guo and Yizhou Yu and Jiannan Wu and Yi Jiang and Dongdong Yu and Zehuan Yuan and Ping Luo},
title = {{Multi-Level Contrastive Learning for Dense Prediction Task}},
year = {2023},
eprint = {2304.02010},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2304.02010},
}Loading related content...