Abstract
While many different aspects of human experiences have been studied by the NLP community, none has captured its full richness. We propose a new task to capture this richness based on an unlikely setting: movie characters. We sought to capture theme-level similarities between movie characters that were community-curated into 20,000 themes. By introducing a two-step approach that balances performance and efficiency, we managed to achieve 9-27% improvement over recent paragraph-embedding based methods. Finally, we demonstrate how the thematic information learnt from movie characters can potentially be used to understand themes in the experience of people, as indicated on Reddit posts.
Introduction
Capturing the full complexity of human experience in Natural Language Processing (NLP) is a daunting task. Most existing research focuses on narrow slices of identity, such as personality traits, demographics, or specific beliefs. However, humans are more than the sum of these parts; our lives are defined by rich, interacting thematic experiences.
The challenge is that collecting large-scale, annotated data on real-life human experiences is prohibitively expensive and ethically complex. To bypass this, we propose using movie characters as a proxy. Fictional characters are often inspired by real people, and their stories are categorized by fans into "tropes"—standardized thematic units that mirror real-world interpersonal turmoil, achievements, and hardships. The "thematic space" of fiction significantly overlaps with reality, suggesting that identifying characters in the same trope can inform us about similarities between people in real life.
Methodology: The Select and Refine Approach
To identify similar characters efficiently, we introduce a two-step Select and Refine approach. This architecture is designed to balance computational efficiency with high precision, avoiding the "exhaustive pairwise comparison" problem which would otherwise require approximately 10,000 GPU hours for our dataset.
- Select (Bi-Encoder): The model first uses a fast Character Encoding Model (CEM) or a Siamese-BERT model to generate individual character embeddings. It then identifies a pool of $top\_n$ candidates using simple cosine similarity.
- Refine (Cross-Encoder): The model then employs a more powerful Character Comparison Model (CCM), based on a BERT Next Sentence Prediction (NSP) architecture, to re-rank only the $top\_n$ candidates. This cross-encoder captures complex semantic relationships and abstract features that simple vector similarity might miss.
Data and Experimental Setup
The primary dataset, All The Tropes, consists of over 100,000 character descriptions categorized into more than 20,000 themes. This provides a high-volume, weakly supervised signal for training. To test real-world applicability, we also utilized a zero-shot transfer task involving 50 posts from the Reddit (r/OffMyChest) community, where users share personal life experiences. This task evaluates whether the model can find movie characters that resonate with real human stories without additional fine-tuning.
Results and Discussion
The Select and Refine model demonstrates significant performance gains over standard embedding methods. By using the two-step approach, we reduced computational runtime from an estimated 10,000 GPU hours to just a few, making high-precision character matching practical for large datasets.
As shown in the results table below, the Siamese-BERT variant of our model outperformed baseline paragraph-embedding methods (such as Google's USE or standard BERT) by 9-27% across metrics like Recall@k and nDCG@k.
In the Reddit transfer task, the model achieved an absolute precision of 98% at k=1. This indicates that the top-ranked movie character almost always shared a clear thematic overlap with the user's real-life post, highlighting the model's ability to generalize from fictional tropes to real human experiences.
Conclusion
This work demonstrates that movie characters can serve as effective proxies for studying thematic human experiences. While computational constraints limited our search to $top\_n = 500$, the results suggest that the "Select and Refine" paradigm is a robust solution for large-scale similarity tasks. Future applications could include personalizing dialogue agents, improving mental health surveillance on social media, or enhancing media recommendation systems by bridging the gap between cinematic tropes and daily human life.
Summary updated