An Empirical Study of Chinese Name Matching and Applications

Nanyun Peng, Mo Yu, Mark Dredze

TL;DR

While name matching is a solved problem for English, the logographic nature of Chinese—where thousands of characters can represent the same sound—makes it a unique challenge. This study demonstrates that by combining phonetic representations (Pinyin) with machine learning (SVMs), researchers can significantly outperform standard string-matching algorithms and improve downstream tasks like entity clustering by over 2 F1 points.

The Challenge of Chinese Name Matching

In natural language processing, "name matching" determines if two different strings refer to the same entity. While well-studied in English, Chinese presents a "perfect storm" of linguistic hurdles:

  1. Character Sparsity: With over 50,000 Chinese characters (hanzi), models struggle to learn patterns from raw characters alone.
  2. Phonetic Ambiguity: Many characters share the same pronunciation, leading to variations in transliteration.
  3. Regional Variations: Differences between Simplified and Traditional writing systems, and dialects like Mandarin and Cantonese, mean a name transliterated in Mainland China may differ significantly from its Hong Kong or Taiwan counterpart.
Examples of Chinese name variations including simplified vs. traditional forms and regional transliterations.

Methodology: Beyond Edit Distance

The authors evaluate three primary approaches to move beyond simple character-based edit distance:

  • Enhanced String Matching: Standard algorithms (Levenshtein, Jaro-Winkler) improved by converting text to Simplified Chinese and testing various Pinyin (phonetic) representations.
  • Probabilistic Transducers: Generative models that learn transformation probabilities between strings. To combat character sparsity, these are trained on Pinyin representations.
  • SVM Classification: A binary classification approach using a Support Vector Machine (SVM) with a diverse feature set, including N-gram alignments via the Hungarian algorithm, Jaccard similarity, phonetic Pinyin-based n-grams, and heuristics like shared surnames.

Data and Evaluation

The researchers developed two key datasets derived from Wikipedia:

  • REDIRECT: 13,730 person name pairs from Wikipedia redirect links, reflecting real-world noise like nicknames and aliases.
  • NAME GROUPS: Mappings of foreign names across regions (e.g., Mainland China vs. Hong Kong), focusing on transliteration differences.

Key Insights

  • The "Character-Pinyin" Sweet Spot: Representing names as sequences of Pinyin tokens (one per character) outperformed long phonetic strings by preserving the name's structural "rhythm" while collapsing homophones.
  • Simplification is Essential: Mapping Traditional to Simplified characters provided an immediate performance boost across all algorithms.
  • Learning Beats Hard-Coding: The SVM approach succeeded by weighing different similarity types; for instance, learning that Jaccard similarity is often more predictive than strict character ordering.
  • Transducers for Transliteration: While SVM was the best generalist, Transducers excelled at regional transliteration rules in the "Name Groups" dataset.

Experimental Results

The SVM model demonstrated superior performance across multiple benchmarks. On the REDIRECT dataset, the SVM achieved a Precision@1 of 0.888, significantly outperforming the best Levenshtein baseline.

Performance comparison of Levenshtein, Transducer, and SVM methods across different datasets.

Furthermore, integrating the SVM matcher into a downstream entity clustering system improved the clustering F1 score from 68.42 (exact match) to 70.81.

Limitations and Future Directions

Despite these gains, challenges remain. Approximately 43% of errors stem from "semantic" matches like nicknames or stage names that lack phonetic or visual similarity. Future work involves integrating external knowledge bases and alias lists. Additionally, while Pinyin helps with Mandarin, it does not fully capture Cantonese variations; future iterations may include automatic dialect detection to apply region-specific phonetic mappings.

The authors have released their tool, Mingpipe, as a Python package to support further research in Chinese NLP.

Summary updated

Abstract

Methods for name matching, an important component to support downstream tasks such as entity linking and entity clustering, have focused on alphabetic languages, primarily English. In contrast, logogram languages such as Chinese remain untested. We evaluate methods for name matching in Chinese, including both string matching and learning approaches. Our approach, based on new representations for Chinese, improves both name matching and a downstream entity clustering task.
BibTeX
@inproceedings{peng2015empirical,
  author = {Nanyun Peng and Mo Yu and Mark Dredze},
  title = {{An Empirical Study of Chinese Name Matching and Applications}},
  booktitle = {Annual Meeting of the Association for Computational Linguistics},
  year = {2015},
  doi = {10.3115/v1/p15-2062},
}
Figure