COSMOS: Catching Out-of-Context Image Misuse Using Self-Supervised Learning

Shivangi Aneja, Chris Bregler, Matthias NießnerAAAI 2023 · DOI

TL;DR

This paper introduces COSMOS, a novel self-supervised method to automatically detect when an image is used out-of-context with its accompanying text. By grounding textual claims to specific image regions, COSMOS can identify misleading narratives even when the images themselves are not manipulated, achieving 85% detection accuracy and releasing a new benchmark dataset.

What Problem Does This Paper Address?

The internet is awash with misinformation, and while much attention has been paid to manipulated images like DeepFakes, a more insidious form of deception involves using genuine images in entirely false or misleading contexts. This "out-of-context" misuse is particularly challenging to detect because the visual content itself is authentic; the deception lies solely in the mismatch between the image and its accompanying text. Fact-checkers currently rely heavily on manual effort to identify these instances, a process that is slow and difficult to scale. This paper aims to automate this detection process, providing a tool to assist fact-checkers by flagging potentially misleading image-text pairings.

Methods

The core of COSMOS is a self-supervised learning approach that leverages the relationship between images and their associated text. Instead of relying on explicit labels of "out-of-context," the model learns to distinguish between genuine and misleading pairings by focusing on how well textual descriptions align with specific objects within an image.

The process involves:

  • Text Pre-processing: Proper nouns in captions (like names and locations) are replaced with their hypernyms (e.g., "Robert Maguire" becomes "Person") to generalize the learning process.
  • Image-Text Matching Model (Training):
    • A pre-trained Mask R-CNN is used to detect objects in an image, and these object regions are embedded using an "Object Encoder."
    • Two captions are considered: C_match (the original caption associated with the image) and C_rand (a randomly sampled caption from a different image).
  • Both captions are embedded using a Universal Sentence Encoder (USE).
  • The model learns to maximize the similarity score between C_match and the image objects, while minimizing the score for C_rand. This self-supervised training teaches the model to ground textual descriptions to visual elements.
  • Out-of-Context Detection Model (Test Time):
    • For a given image and two captions (C1, C2), the model first identifies the most relevant object in the image for each caption using the trained Image-Text Matching model.
  • It then checks for visual overlap between the top bounding boxes identified for C1 and C2. If the overlap is significant (above a threshold t_iou), it suggests the captions refer to the same visual element.
  • If visual overlap is detected, a pre-trained Sentence-BERT model is used to assess the semantic similarity between C1 and C2. If the semantic similarity is low (below a threshold t_sim), it indicates that the same object is being described with different, potentially conflicting, meanings, thus flagging it as out-of-context.

Datasets

The authors introduce a new, large-scale dataset for benchmarking out-of-context image detection.

  • Training Data: Approximately 200,000 images with 450,000 corresponding text captions were scraped from news websites and fact-checking sites.
  • Test Data: A manually annotated subset of 1,700 image-caption pairs was created, with each image paired with two captions. This dataset was specifically curated to include both out-of-context and not-out-of-context examples.

Key Insights and Ideas

  • Grounding is Crucial: The paper strongly emphasizes that language-only analysis is insufficient for detecting out-of-context images. The ability to link textual claims to specific visual elements (objects) within an image is the key differentiator.
  • Self-Supervised Learning for Alignment: The success of the self-supervised approach highlights that learning robust image-text alignments doesn't require explicit "out-of-context" labels. By contrasting matching and non-matching caption pairs, the model learns valuable grounding capabilities.
  • Object-Level Features are Superior: Evaluating different image representation strategies (full image vs. object bounding boxes) revealed that focusing on object-level features provides a richer representation and leads to better performance in visual grounding.
  • Semantic Mismatch + Visual Overlap = Out-of-Context: The core insight for detection is that when two captions refer to the same visual element (high visual overlap) but describe different events or contexts (low semantic similarity), it's a strong indicator of out-of-context misuse.

Key Results

  • Accuracy: The COSMOS model achieves an impressive 85% out-of-context detection accuracy on its test set.
  • Performance Improvement: Using the Universal Sentence Encoder (USE) for text embeddings significantly boosted performance by 9% compared to other methods.
  • Comparison: The proposed method outperforms existing state-of-the-art methods for rumor detection and fake news classification when adapted for the out-of-context task, achieving up to a 14% improvement.
  • Qualitative: Visualizations demonstrate the model's ability to identify relevant objects for captions and assign grounding scores, supporting its effectiveness.

Limitations and Future Work

  • Limitations:
    • The current model does not determine the veracity of individual captions; it only flags potential miscontextualization.
  • The current work focuses on English language captions.
  • The authors acknowledge that for sensitive topics, human intervention is still necessary for final decisions due to the potential dangers of false positives/negatives.
  • Future Work:
    • The authors plan to publish their new dataset to facilitate further research in this area.
  • They aim to continue research to address misinformation in online news and social media platforms.
  • The work is positioned as a step towards assisting fact-checkers by narrowing down their search space.

Summary updated

BibTeX
@inproceedings{aneja2023cosmos,
  author = {Shivangi Aneja and Chris Bregler and Matthias Nießner},
  title = {{COSMOS: Catching Out-of-Context Image Misuse Using Self-Supervised Learning}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2023},
  doi = {10.1609/aaai.v37i12.26648},
}
Figure