Semi-Supervised Multimodality Learning With Graph Convolutional Neural Networks For Disease Diagnosis

Yongxiang Huang, Albert C. S. ChungICIP 2020 · OpenReview

Abstract

There is a trend that digitalized clinical data increases dramatically every year. Part of data is multi-modal with imaging and non-imaging data such as phenotypic and genetic information. Though the success of CNNs has empowered a wide range of applications in learning from the imaging data, incorporating both the imaging and non-imaging data complementarily to improve the diagnostic quality is still challenging. To tackle this challenge, we propose a novel graph-convolutional model which is based on the proposed concept of edge adapter for learning an adaptive population graph from a multi-modal database. The edge adapter can be jointly optimized with the proposed graph convolutional neural network for semi-supervised node classification. Experimental results on two challenging multimodal medical databases demonstrate the potential of our method in learning from multi-modal data for disease diagnosis.
BibTeX
@inproceedings{huang2020semi,
  author = {Yongxiang Huang and Albert C. S. Chung},
  title = {{Semi-Supervised Multimodality Learning With Graph Convolutional Neural Networks For Disease Diagnosis}},
  booktitle = {ICIP},
  year = {2020},
  url = {https://openreview.net/forum?id=qIVW9A4ByG},
}

Loading related content...

Figure