Guest Editorial Introduction to the Special Section on Transformer Models in Vision

Salman H. Khan, Fahad Shahbaz Khan, Ashish Vaswani, Niki Parmar, Ming-Hsuan Yang, Mubarak Shah

Abstract

Transformer models have achieved outstanding results on a variety of language tasks, such as text classification, ma- chine translation, and question answering. This success in the field of Natural Language Processing (NLP) has sparked interest in the computer vision community to apply these models to vision and multi-modal learning tasks. However, visual data has a unique structure, requiring the need to rethink network designs and training methods. As a result, Transformer models and their variations have been suc- cessfully used for image recognition, object detection, seg- mentation, image super-resolution, video understanding, image generation, text-image synthesis, and visual question answering, among other applications.
BibTeX
@article{khan2023guest,
  author = {Salman H. Khan and Fahad Shahbaz Khan and Ashish Vaswani and Niki Parmar and Ming-Hsuan Yang and Mubarak Shah},
  title = {{Guest Editorial Introduction to the Special Section on Transformer Models in Vision}},
  journal = {IEEE Trans. Pattern Anal. Mach. Intell.},
  year = {2023},
  doi = {10.1109/tpami.2023.3306164},
}
Figure