MamlFormer: Priori-experience guiding transformer network via manifold adversarial multi-modal learning for laryngeal histopathological grading

Pan Huang, Chentao Li, Peng He, Hualiang Xiao, Yifang Ping, Peng Feng, Sukun Tian, Hu Chen, Francesco Mercaldo, Antonella Santone, Hui-yuan Yeh, Jing Qin

Abstract

Highlights•We propose MamlFormer for effective multimodal fusion of LSCC high and low magnification image models.•The manifold block eliminates the redundancy of feature information caused by the background semantics. Eventually, it improves the consistency of LSCC high and low magnification image modalities in the multimodal model.•The adversarial block achieves adaptive learning of a latent metric for the modal distribution of LSCC high- and low-magnification images. Hereby, it enhances the complementarity of the LSCC high- and low-magnification image modalities.
BibTeX
@article{huang2024mamlformer,
  author = {Pan Huang and Chentao Li and Peng He and Hualiang Xiao and Yifang Ping and Peng Feng and Sukun Tian and Hu Chen and Francesco Mercaldo and Antonella Santone and Hui-yuan Yeh and Jing Qin},
  title = {{MamlFormer: Priori-experience guiding transformer network via manifold adversarial multi-modal learning for laryngeal histopathological grading}},
  journal = {Information Fusion},
  year = {2024},
  doi = {10.1016/j.inffus.2024.102333},
}

Loading related content...

Figure