Japanese Named Entity Extraction with Redundant Morphological Analysis

Masayuki Asahara, Yuji MatsumotoNAACL 2003

TL;DR

This paper tackles the challenge of Japanese Named Entity (NE) extraction, which is hindered by the rigid word segmentation of traditional morphological analyzers. They propose a novel character-based chunking method that leverages redundant, n-best outputs from a morphological analyzer to create richer features for an SVM chunker, achieving state-of-the-art results.

What Problem Does This Paper Address?

Named Entity (NE) extraction, a crucial task for information extraction and question answering, involves identifying proper nouns and numerical expressions. For languages like Japanese, a common approach is to first perform morphological analysis (segmenting text into words and assigning part-of-speech tags) and then use a chunker to group these words into NEs. However, this pipeline faces a significant hurdle: the segmentation boundaries determined by the morphological analyzer might not align with the actual boundaries of NEs. For instance, a word like "訪朝" (visiting North Korea) might be a single unit in morphological analysis, preventing the extraction of "朝" (North Korea) as a location NE, even though it's part of the intended entity. This "word unit problem" limits the ability to accurately extract certain NEs.

Methods

The authors propose a character-based chunking method to overcome the word unit problem. Instead of relying on a single morphological analysis output, they:

  1. Redundant Morphological Analysis: Apply a statistical morphological analyzer to generate multiple (n-best) segmentation and POS tag sequences for each sentence.
  2. Rich Feature Engineering: For each character in the sentence, they create features that include:
  3. Its character type (e.g., Hiragana, Katakana, Kanji, digit, space).
  4. Multiple POS tags derived from the n-best morphological analysis results.
  5. Information about the character's position within a word (using tags like B, I, E from the SE model).
  6. SVM-based Chunker: Utilize a Support Vector Machine (SVM) chunker (specifically, yamcha) to learn from these rich character-level features and predict NE tags. This approach allows the chunker to consider a broader range of possibilities from the morphological analysis, effectively mitigating the limitations of a single segmentation.

Datasets

The paper uses the CRL NE data for evaluation. This dataset consists of 1,174 newspaper articles containing 19,262 NEs. They perform five-fold cross-validation on this dataset.

Key Insights and Ideas

  • Character-level chunking is key: Moving from word-level to character-level processing for chunking is crucial for handling segmentation ambiguities in Japanese NE extraction.
  • Redundancy is beneficial: Using n-best outputs from morphological analysis, rather than a single best guess, provides richer information that significantly improves NE extraction accuracy.
  • Contextual features matter: The length of the contextual window (number of preceding and succeeding characters) used for feature extraction has a notable impact on performance, with a 2-character window (L2R2) often yielding the best results.
  • Character types are important: Features derived from character types are indispensable for NE extraction, highlighting the importance of the raw character information.
  • POS subcategories are useful: Excluding POS subcategories (which encode semantic information for proper nouns) leads to a drop in accuracy, indicating their value.

Key Results

The proposed method achieved a cross-validation F-measure of 87.21 on the CRL NE data, which was the best result among systems reported for the IREX NE extraction task at the time of publication. This represents a significant improvement over previous methods. Specifically, the paper shows that:

  • The character-based chunking with redundant morphological analysis outperforms single-analysis methods.
  • The L2R2 contextual feature length generally provides the best accuracy.
  • The One-vs-Rest SVM method for multi-class classification performed better than the Pairwise method.

Limitations and Future Work

  • Thesaurus limitations: While they explored using a thesaurus (NTT Goi Taikei), its effectiveness was limited for certain NE types like "ARTIFACT" and "TIME." The authors note that encoding hierarchical relationships within the thesaurus is a potential area for future work.
  • Generalizability: The method was tested on Japanese. While the authors believe it's applicable to other languages with word unit problems, this was not empirically demonstrated.
  • Character type definition: For numeral expressions, excluding character types improved accuracy because numbers in Kanji were not well-defined in their character type set. This suggests a need for more comprehensive character type definitions.

Summary updated

BibTeX
@inproceedings{asahara2003japanese,
  author = {Masayuki Asahara and Yuji Matsumoto},
  title = {{Japanese Named Entity Extraction with Redundant Morphological Analysis}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2003},
}
Figure