Multimodal Conversation Modelling for Topic Derailment Detection

Zhenhao Li, Marek Rei, Lucia SpeciaEMNLP 2022 · OpenReview

Introduction

Online social platforms are often plagued by conversations that "derail"—drifting away from the original topic or descending into toxicity. While significant research has focused on detecting toxicity (e.g., hate speech or insults), topic derailment is a broader phenomenon. It includes spam, tangential non-sequiturs, and bot-generated content that disrupts the flow of discussion without necessarily being abusive.

An example of a multimodal conversation derailment where the final comment shifts from the medical context to a meta-discussion about terminology.

Researchers from Imperial College London argue that existing text-only moderation tools are insufficient for modern social media. On platforms like Reddit or Twitter, conversations often revolve around an image. Without visual context, an AI cannot accurately determine if a comment is relevant or a derailment. To address this, they introduced the MMConv model and the Multimodal Conversation Derailment (MCD) dataset.

The MMConv Architecture

The proposed MMConv (Multimodal Conversational model) uses a hierarchical approach to process conversational data across three stages:

  1. Initial Topic Encoding: The model establishes the "ground truth" of the post by combining text from the title (via BERT) and visual features from the image (via Faster R-CNN). These are fused using a self-attention layer.
  2. Contextual Tracking: A GRU (Gated Recurrent Unit) network processes the sequence of previous comments (utterances) to maintain a sense of how the conversation has evolved.
  3. Late Fusion: A final self-attention layer integrates the initial topic, the conversational history, and the target comment to classify whether a derailment has occurred.

This structure ensures the model "remembers" the original post's intent while remaining sensitive to the immediate conversational flow.

The Multimodal Conversation Derailment (MCD) Dataset

To train and evaluate their model, the authors created the MCD dataset, sourced from Reddit communities with high visual content (/r/itookapicture and /r/pics). The dataset comprises 12,653 conversations and 5,269 unique images.

The MCD dataset categorizes derailment into four types: unrelated content, new topics, spam, and toxicity.

Human annotators labeled comments based on four specific criteria: lack of relation to the initial topic, introduction of a completely different topic, spam, or toxicity. This multi-faceted labeling reflects the complexity of real-world online interactions.

Key Findings and Performance

The MMConv model demonstrated significant improvements over existing baselines:

  • Superior Accuracy: MMConv achieved a weighted F1-score of 0.756, outperforming text-only models like BERT and specialized conversational models like CRAFT.
  • Visual Anchoring: The inclusion of images makes the model more robust to "noisy" text (slang or typos). The image acts as a stable contextual anchor when text quality is low.
  • Forecasting Capabilities: The model could predict a high probability of derailment approximately 3.5 utterances before the actual derailment occurred, suggesting potential for proactive moderation.
  • Adversarial Robustness: When tested against word-swapping attacks (TextFooler), MMConv proved harder to deceive than simpler models, maintaining higher accuracy under pressure.

Conclusion and Future Directions

While MMConv represents a major step forward, challenges remain. Processing high-resolution images and long conversation chains is computationally expensive. Furthermore, "derailment" remains a subjective concept, and agreement between human annotators is not always absolute. Future research will focus on expanding the dataset to other platforms like Instagram and distilling the model into a more efficient version for real-time, large-scale moderation.

Summary updated

BibTeX
@inproceedings{li2022multimodal,
  author = {Zhenhao Li and Marek Rei and Lucia Specia},
  title = {{Multimodal Conversation Modelling for Topic Derailment Detection}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2022},
  url = {https://openreview.net/forum?id=4zJfDimA7Y},
}
Figure