XLEnt: Mining a Large Cross-lingual Entity Dataset with Lexical-Semantic-Phonetic Word Alignment

Ahmed El-Kishky, Adithya Renduchintala, James Cross, Francisco Guzmán, Philipp Koehn

Introduction

Named entities—the names of people, locations, and organizations—serve as the fundamental anchors of meaning in natural language processing (NLP). While high-resource languages like English benefit from extensive entity lexica derived from sources like Wikipedia, these resources are often sparse or non-existent for the majority of the world's languages. To bridge this gap, researchers have introduced XLEnt, a massive dataset comprising 164 million cross-lingual entity pairs across 120 languages. This resource was constructed using a novel alignment model, LSP-Align, which integrates lexical, semantic, and phonetic signals to accurately map entities even in low-resource settings.

The Challenge of Cross-lingual Alignment

The standard approach for building cross-lingual lexica is "projection": identifying an entity in a source language (e.g., English) and finding its counterpart in a translated sentence (bitext) using word alignment. However, traditional tools like FastAlign rely heavily on word frequency. If a name appears only a few times in a corpus, these tools often fail to establish a correct link. Furthermore, names frequently undergo significant changes across different scripts, rendering simple string matching ineffective.

Figure 1: Cross-lingual word alignment between English and Arabic, illustrating the complexity of mapping entities across different scripts.

The LSP-Align Framework

To overcome these limitations, the authors developed LSP-Align, a generative model that triangulates three distinct signals:

  1. Lexical Signal: The traditional statistical approach based on co-occurrence frequency across a large bitext corpus.
  2. Semantic Signal: Leveraging LASER (multilingual sentence embeddings) to identify words that occupy similar positions in a shared meaning space, regardless of the language.
  3. Phonetic Signal: Often the "secret sauce" for named entities, this signal uses an unsupervised transliteration system and edit distance to find words that sound similar, even if they use different alphabets.

By treating the true alignment as a latent variable, LSP-Align dynamically decides which signal is most reliable for a given word pair, creating a more robust mapping than any single method could achieve alone.

Results and the XLEnt Dataset

The XLEnt dataset was mined from three massive web-scale bitext collections: CCAligned, WikiMatrix, and CCMatrix. Evaluation against a "gold standard" lexicon confirms the high quality of the mined pairs. A key finding of the research is the "Power of Triangulation." While lexical alignment is effective for common words, phonetic alignment is indispensable for names in different scripts, and semantic alignment aids when words are translated by meaning.

LSP-Align particularly excels in the "long tail" of entities. Most named entities are rare, appearing only a few times in the data. As shown in the performance metrics, LSP-Align significantly outperforms standard baselines for low-frequency entities (those appearing 3 times or fewer).

Figure 6: Fuzzy-F1 performance on low-frequency entities, demonstrating the superiority of the LSP-Align model over individual lexical, semantic, or phonetic baselines.

Overall, LSP-Align achieved an average Fuzzy-F1 score of 0.86 across various resource levels. While performance remains highest for high-resource languages compared to low-resource ones, the method provides a vital baseline for languages that previously lacked digital entity resources.

Conclusion

XLEnt represents a significant step toward truly multilingual NLP. By providing a massive, high-quality entity lexicon, it enables improved performance in downstream tasks such as multilingual Named Entity Recognition (NER), entity linking, and the construction of global knowledge bases. The XLEnt dataset is freely available for research at http://data.statmt.org/xlent/.

Summary updated

Abstract

Cross-lingual named-entity lexica are an important resource to multilingual NLP tasks such as machine translation and cross-lingual wikification. While knowledge bases contain a large number of entities in high-resource languages such as English and French, corresponding entities for lower-resource languages are often missing. To address this, we propose Lexical-Semantic-Phonetic Align (LSP-Align), a technique to automatically mine cross-lingual entity lexica from mined web data. We demonstrate LSP-Align outperforms baselines at extracting cross-lingual entity pairs and mine 164 million entity pairs from 120 different languages aligned with English. We release these cross-lingual entity pairs along with the massively multilingual tagged named entity corpus as a resource to the NLP community.
BibTeX
@inproceedings{elkishky2021xlent,
  author = {Ahmed El-Kishky and Adithya Renduchintala and James Cross and Francisco Guzmán and Philipp Koehn},
  title = {{XLEnt: Mining a Large Cross-lingual Entity Dataset with Lexical-Semantic-Phonetic Word Alignment}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {2021},
  doi = {10.18653/v1/2021.emnlp-main.814},
}
Figure