Introduction
Online Knowledge Libraries (OKLs) like IMDb and Douban serve as vital repositories for movie enthusiasts and researchers. However, maintaining these databases is a monumental task, often leading to significant gaps where a movie present in one library is missing from another. This paper addresses the Miso-Klic problem (Multiple aligned ISomeric Online Knowledge LIbraries Completion), focusing on "isomeric" libraries—those that describe the same entities but differ in language, cultural context, and user-generated content.
The IDEA Framework
To bridge these gaps, the authors propose IDEA (Integrated Deep alignEd Auto-encoder), a framework that leverages the synergy between disparate libraries to identify and rank missing content. The framework operates in three distinct stages:
1. Movie Embedding
Traditional text matching fails across languages (English vs. Chinese). IDEA utilizes a Deep Auto-encoder to project diverse movie attributes—including titles, storylines, cast, and even the sentiment of user reviews—into a unified numerical vector space. This allows the system to find similarities based on the latent "identity" of a film rather than just its name.
2. Missing Movie Identification
By training on "anchor links" (movies known to exist in both IMDb and Douban), the model learns to align the feature spaces of both libraries. A movie in Library A is flagged as "missing" in Library B if it lacks close neighbors in the shared latent space.
3. Missing Movie Ranking
Because resources for manual entry are limited, IDEA prioritizes missing movies by predicting their potential quality (rating) and popularity (comment count) in the target library. This ensures that high-impact "blockbusters" are added before obscure titles.
Cultural Divergence and Data Characteristics
The study highlights significant differences in how audiences interact with movies across cultures. For instance, Douban users tend to focus heavily on recent releases, whereas IMDb users show a more distributed interest across historical classics and modern films.
Furthermore, the distribution of ratings varies significantly by genre and platform, reinforcing the need for a model that understands these "isomeric" differences to predict quality accurately.
Key Results
The IDEA framework demonstrates remarkable effectiveness compared to traditional methods:
- Superior Identification: IDEA achieved an F1-score nearly triple that of baseline methods relying on simple title translation and matching (CT-EM/ET-EM).
- Ranking Precision: The model predicted movie quality and popularity with a Mean Absolute Error (MAE) of less than 0.01, proving that latent features are highly predictive across cultural boundaries.
- Robustness: Performance remained stable regardless of the size of the "knowledge gap" between the two libraries, indicating the model's reliability in real-world scenarios.
Conclusion
IDEA provides a robust, automated solution for synchronizing global movie databases by treating cross-lingual libraries as isomeric structures rather than simple translation problems. While currently focused on pairs of libraries, future work aims to extend this synergistic completion to multiple libraries simultaneously and address real-time updates as new content is released.
Summary updated