Weakly Supervised Disease Localization in Chest X-rays via Looking into Image Relations

Baolian Qi, Gangming Zhao, Xin Wei, Chaowei Fang, Zhiqiang Chen, Jinpeng LiBIBM 2021 · OpenReview

Abstract

Locating diseases in chest X-ray images with few careful annotations saves large human effort in annotation. Recent works tackled this problem with innovative weakly-supervised algorithms, however, the performance of these methods on X-ray analysis is not as good as in the general computer vision tasks. Different from natural images, the global structure of different chest X-rays are relatively consistent and the disease regions are relatively inconspicuous, and radiologists often need to compare multiple images to make diagnostic decisions. Inspired by this, we propose a hypothesis that the explicit modelling of the image-to-image relationship is beneficial to the learning machines, especially when the supervision is insufficient. To model the relationship, we exploit a cross-image graph method to excavate the structural relationship between X-ray images. The proposed method represents the inter-image relationship as in-batch graphs, where each X-ray image is regarded as a node and the distance between X-ray images is defined as an edge. The graphs are used as regularizers to help preserve the structural similarity between image pairs in the embedding space. By means of this, our approach achieves the state-of-the-art result on NIH chest X-ray dataset for disease localization with limited supervision, which has a very practical use in the weakly-supervised localization tasks. The code <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> is accessible online.
BibTeX
@inproceedings{qi2021weakly,
  author = {Baolian Qi and Gangming Zhao and Xin Wei and Chaowei Fang and Zhiqiang Chen and Jinpeng Li},
  title = {{Weakly Supervised Disease Localization in Chest X-rays via Looking into Image Relations}},
  booktitle = {BIBM},
  year = {2021},
  url = {https://openreview.net/forum?id=PU6UWmYBjzg},
}

Loading related content...

Figure