Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification
Lists
Only you see this
Abstract
Robustness of medical image classification models is limited by its exposure to the candidate disease classes. Generalized zero shot learning (GZSL) aims at correctly predicting seen and unseen classes and most current GZSL approaches have focused on the single label case. It is common for chest x-rays to be labelled with multiple disease classes. We propose a novel multi-label GZSL approach using: 1) class specific feature disentanglement and 2) semantic relationship between disease labels distilled from BERT models pre-trained on biomedical literature. We learn a dictionary from distilled text embeddings, and leverage them to synthesize feature vectors that are representative of multi-label samples. Compared to existing methods, our approach does not require class attribute vectors, which are an essential part of GZSL methods for natural images but are not available for medical images. Our approach outperforms state of the art GZSL methods for chest xray images.
BibTeX
@inproceedings{mahapatra2023class,
author = {Dwarikanath Mahapatra and Antonio José Jimeno-Yepes and Shiba Kuanar and Sudipta Roy and Behzad Bozorgtabar and Mauricio Reyes and Zongyuan Ge},
title = {{Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification}},
booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
year = {2023},
doi = {10.1007/978-3-031-43895-0\_26},
}Loading related content...