Learning Similarity between Movie Characters and Its Potential Implications on Understanding Human Experiences

Zhilin Wang, Weizhe Lin, Xiaodong Wu

TL;DR

This paper introduces a novel two-step approach to identify similar movie characters using weakly supervised learning, achieving significant improvements over existing methods. The learned character similarities are then shown to be transferable to understanding themes in real-life human experiences, as demonstrated by matching Reddit posts to movie characters.

What Problem Does This Paper Address?

Understanding what makes individuals similar is a fundamental question, but capturing the full richness of human experience is challenging. Previous NLP approaches have focused on aspects like personality or demographics, but these are often insufficient. The authors propose that movie characters, with their community-curated descriptions and themes (tropes), offer a rich, albeit indirect, proxy for understanding human experiences. The core problem is to efficiently and accurately identify similar movie characters and then explore if this learned similarity can be applied to real-world human experiences, which is difficult to collect and annotate at scale.

Methods

The paper proposes a two-step "Select and Refine" approach for identifying similar movie characters:

  1. Select: This initial step aims to efficiently narrow down the search space by identifying a smaller set of likely candidate characters. The authors explore using a Character Encoding Model (CEM), a variant of their BERT-based Character Comparison Model (CCM) that outputs embeddings for individual characters. Cosine similarity between these embeddings is used to find potential matches. A Siamese-BERT model is also tested for this step.
  2. Refine: This step takes the candidates identified in the "Select" phase and re-ranks them using a more computationally intensive but precise model. The Character Comparison Model (CCM), a BERT Next Sentence Prediction (NSP) model trained for pair-wise character comparison, is used here. This two-step process balances computational efficiency with accuracy.

Datasets

  • All The Tropes: This is the primary dataset used for training and evaluation. It consists of over 100,000 movie character descriptions, each associated with one or more community-curated themes (tropes). The dataset was filtered to include descriptions longer than 100 words and tropes with multiple characters.
  • Reddit r/OffMyChest: A collection of 50 posts from this forum, describing personal life experiences, was used to demonstrate the transferability of the learned character similarities to human experiences. These posts were then matched with movie characters.

Key Insights and Ideas

  • Movie characters as proxies for human experience: The paper posits that the rich, often narrative-driven descriptions of movie characters, especially when categorized by community-defined tropes, can serve as a valuable proxy for understanding the nuances of human experiences.
  • Weakly supervised learning for character similarity: Leveraging community-curated tropes as labels for character similarity is a novel approach that bypasses the need for expensive manual annotation.
  • The "Select and Refine" strategy: This two-step approach is crucial for achieving both efficiency and high performance, addressing the computational bottleneck of exhaustive pairwise comparisons.
  • Transferability of learned similarities: The most striking insight is that the similarity learned between movie characters can be effectively applied to identify thematic similarities between movie characters and real-life human experiences described in text.

Key Results

  • The proposed "Select and Refine" approach, particularly when using Siamese-BERT for the "Select" step, achieved 9-27% improvement over state-of-the-art paragraph-embedding based methods on various metrics (Recall@k, nDCG@k, MRR).
  • For the task of matching Reddit posts to movie characters, the Select and Refine model (with Siamese-BERT) achieved an excellent precision@1 of 98.00%, indicating strong zero-shot transfer capabilities.
  • Qualitative analysis showed that the model effectively captures thematic similarities, even when phrase-level semantic overlap is present in baseline models.

Limitations and Future Work

  • Computational Cost: While the "Select and Refine" approach significantly reduces computational cost compared to exhaustive pairwise comparisons, the "Refine" step can still be computationally demanding, especially with larger top_n values.
  • Suitability of "Select" models: The paper notes that while Siamese-BERT and CEM showed the greatest overlap in candidate selection, a full-scale evaluation of their suitability for the "Select" step was limited by computational constraints.
  • Future Directions: The authors suggest several promising avenues:
  • Social Media Analysis: Using movie characters to identify similar experiences in social media data.
  • Personalizing Dialogue Agents: Training dialogue agents with movie characters that share similar personalities.
  • Media Recommendations: Suggesting media content based on how well movie characters resonate with users' experiences.
  • Virtual Environments: Allowing users to embody movie characters they are similar to in games and virtual reality.

Summary updated

Abstract

While many different aspects of human experiences have been studied by the NLP community, none has captured its full richness. We propose a new task to capture this richness based on an unlikely setting: movie characters. We sought to capture theme-level similarities between movie characters that were community-curated into 20,000 themes. By introducing a two-step approach that balances performance and efficiency, we managed to achieve 9-27\% improvement over recent paragraph-embedding based methods. Finally, we demonstrate how the thematic information learnt from movie characters can potentially be used to understand themes in the experience of people, as indicated on Reddit posts.
BibTeX
@inproceedings{wang2021learning,
  author = {Zhilin Wang and Weizhe Lin and Xiaodong Wu},
  title = {{Learning Similarity between Movie Characters and Its Potential Implications on Understanding Human Experiences}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2021},
}
Figure