UniBO at SemEval-2022 Task 5: A Multimodal bi-Transformer Approach to the Binary and Fine-grained Identification of Misogyny in Memes
Lists
Only you see this
Abstract
We present our submission to SemEval 2022 Task 5 on Multimedia Automatic Misogyny Identification. We address the two tasks: Task A consists of identifying whether a meme is misogynous. If so, Task B attempts to identify its kind among shaming, stereotyping, objectification, and violence. Our approach combines a BERT Transformer with CLIP for the textual and visual representations. Both textual and visual encoders are fused in an early-fusion fashion through a Multimodal Bidirectional Transformer with unimodally pretrained components. Our official submissions obtain macro-averaged F1=0.727 in Task A (4th position out of 69 participants)and weighted F1=0.710 in Task B (4th position out of 42 participants).
BibTeX
@inproceedings{muti2022unibo,
author = {Arianna Muti and Katerina Korre and Alberto Barrón-Cedeño},
title = {{UniBO at SemEval-2022 Task 5: A Multimodal bi-Transformer Approach to the Binary and Fine-grained Identification of Misogyny in Memes}},
booktitle = {SemEval @ NAACL},
year = {2022},
doi = {10.18653/v1/2022.semeval-1.91},
}| TIB-VA at SemEval-2022 Task 5: A Multimodal Architecture for the Detection and Classification of Misogynous Memes | arXiv · 2022 |
| RIT Boston at SemEval-2022 Task 5: Multimedia Misogyny Detection By Using Coherent Visual and Language Features from CLIP Model and Data-centric AI Principle | Proceedings of the 16th International Workshop on Semantic Evaluation (semeval-2022) · 2022 |
| Multimodal and Explainable Internet Meme Classification | arXiv · 2022 |
| M3Hop-CoT: Misogynous Meme Identification with Multimodal Multi-hop Chain-of-Thought | EMNLP · 2024 |
| A Multimodal Framework for the Detection of Hateful Memes | arXiv · 2020 |
| Multimodal Learning For Hateful Memes Detection | arXiv · 2020 |