Task-Specific Representation Learning for Web-Scale Entity Disambiguation

Rijula Kar, Susmija Reddy, Sourangshu Bhattacharya, Anirban Dasgupta, Soumen Chakrabarti

Introduction

Named Entity Disambiguation (NED) is the critical task of mapping text mentions to unique entities in a Knowledge Graph (KG). For instance, determining whether "Jordan" refers to the athlete, the country, or the river. At web-scale, with millions of entities and mentions, traditional approaches struggle with the "long tail" of rare entities and the sheer dimensionality required for a universal feature space.

The Problem with Shared Representations

Standard Multi-Task Representation Learning (MTRL) typically employs a shared feature representation for all tasks while maintaining unique classifiers for each. The authors argue this is counter-intuitive for NED. Disambiguating "Apple" (tech vs. fruit) requires entirely different contextual features than disambiguating "Jaguar" (automotive vs. zoological). Forcing all mentions into a single shared feature space is inefficient and necessitates high-dimensional vectors to capture every possible nuance.

Methodology: The Architecture Flip

The authors propose Task-Specific Representation Learning (TSRL), which effectively "flips" the traditional MTRL architecture. Instead of shared features and unique classifiers, TSRL utilizes task-specific representation functions ($h_u$) for each mention string, which then feed into a common, shared classifier ($f$).

Comparison of traditional MTRL (top) and the proposed TSRL (bottom) architectures.

Task Grouping and Information Sharing

To handle millions of tasks, the authors group mentions that share candidate entities. By using a shared classifier across these groups, the model can "borrow" knowledge. For example, learning to identify a "Person" from a frequent mention like "Washington" helps the model disambiguate rarer mentions that also point to "Person" entities. This approach maintains statistical rigor while being computationally practical for web-scale data.

Key Results

The researchers evaluated TSRL against standard benchmarks including AIDA-CoNLL, MSNBC, AQUAINT, and ACE.

State-of-the-Art Performance

TSRL achieved state-of-the-art results across all datasets. On the AIDA-CoNLL benchmark, it reached 89.4% micro-average accuracy when incorporating entity definitions, outperforming established baselines from Google and Microsoft.

Boosting Performance for Rare Entities

A standout feature of TSRL is its performance on the "long tail." In "Bin-3"—representing entities with lower prior probabilities—TSRL achieved 73% accuracy, a significant jump from the 63.4% achieved by the Per-Alias Classifier (PAC) baseline.

Accuracy comparison across different entity frequency bins, highlighting TSRL's performance on rare entities.

Conclusion

By reimagining NED as a multi-task learning problem with task-specific representations, TSRL offers a more efficient and effective way to handle web-scale entity disambiguation. The architecture's ability to share classification logic across tasks significantly improves performance for rare entities while remaining computationally feasible on standard hardware. Future work may explore more sophisticated task clustering using Knowledge Graph relations to further enhance information sharing.

Summary updated

BibTeX
@inproceedings{kar2018task,
  author = {Rijula Kar and Susmija Reddy and Sourangshu Bhattacharya and Anirban Dasgupta and Soumen Chakrabarti},
  title = {{Task-Specific Representation Learning for Web-Scale Entity Disambiguation}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2018},
  doi = {10.1609/aaai.v32i1.12066},
}
Figure