Learning for transliteration of arabic-numeral expressions using decision tree for Korean TTS

HyeonSook Nam, Youngim Jung, Donghun Lee, Hyuk‐Chul Kwon, Ae-Sun Yoon2004 · DOI

TL;DR

This paper introduces TLAN, a novel decision-tree-based system for accurately transliterating Arabic numeral expressions (ANEs) into Korean for Text-to-Speech (TTS) systems. By analyzing contextual features, numeral patterns, and heuristic information, TLAN significantly improves upon existing TTS systems' handling of these ambiguous linguistic elements.

What Problem Does This Paper Address?

Modern Text-to-Speech (TTS) systems, while adept at handling standard alphabetic text, often struggle with non-alphabetic symbols, particularly Arabic numerals. The challenge lies in the fact that Arabic numerals, when embedded in text, can have vastly different meanings and pronunciations depending on their context. For instance, the numeral "3" can be read as "three" (quantity), "third" (order), or even as part of a proper noun like "Big Three." This ambiguity leads to errors in TTS output, diminishing the naturalness and usability of synthesized speech. Existing TTS systems typically handle these expressions with a limited set of rules, leading to frequent misinterpretations.

Methods

The core of TLAN is a decision tree learning approach. The authors propose a three-phase learning process to disambiguate ANEs:

  1. Contextual Features: These are derived from the surrounding words (eo-jeols) of the ANE. They are categorized into "Right Associated Collocation" (RAC) and "Left Associated Collocation" (LAC) and are built into dictionaries.
  2. Pattern Structure: This involves analyzing the structure of the ANE itself, including the number of digits, the number and type of accompanying text symbols (like "-", "%", ":"), and the relationships between digits (e.g., difference between two numbers).
  3. Heuristic Information: This includes features like the size of figures, the first digit's position, and the position of figures within the ANE, which provide subtle clues to the intended meaning.

The C4.5 algorithm is employed to build the decision tree, using information gain and gain ratio to select the most informative learning elements for classification. The system architecture involves a training phase where input data is preprocessed, ANEs and their learning elements are extracted and converted into features, and a decision tree is constructed. A testing phase then uses this tree to assign senses and readings to ANEs in new data.

Datasets

The authors created a custom corpus for their research. This corpus consists of news articles from 10 major Korean newspapers, spanning from January 1st, 2000, to December 31st, 2001.

  • Training Set: 90,000 "eo-jeols" (morpheme clusters).
  • Test Set: 10,000 "eo-jeols."

The paper notes that, to their knowledge, no pre-existing corpora with transliterated ANEs for this specific task were available, necessitating the manual evaluation of results.

Key Insights and Ideas

  • Context is King (and Queen, and Jack): The paper strongly emphasizes that the meaning and pronunciation of Arabic numerals are heavily context-dependent. Simply having a numeral isn't enough; its surroundings and internal structure are crucial for correct interpretation.
  • Beyond Simple Rules: The limitations of rule-based systems are highlighted. The sheer variety of ways Arabic numerals can be used (quantity, order, time, proper nouns, etc.) makes it difficult to capture all possibilities with predefined rules. Machine learning, specifically decision trees, offers a more flexible and adaptive approach.
  • Multi-faceted Feature Engineering: The success of TLAN hinges on the careful extraction and classification of diverse learning elements. Combining contextual, structural, and heuristic information provides a richer understanding of the ANE than any single feature type alone.
  • The Power of Gain Ratio: Using information gain and gain ratio in the C4.5 algorithm is key to selecting the most discriminative features, leading to a more efficient and accurate decision tree.

Key Results

The TLAN system achieved impressive accuracy rates:

  • Training Set Accuracy: 97.39%
  • Test Set Accuracy: 97.29%

These results significantly outperform current TTS systems, which are reported to have accuracies as low as 55% for ANE transliteration. The paper also notes that their learning model shows comparable or superior performance to existing rule-based systems.

Limitations and Future Work

The authors acknowledge several limitations:

  • Proper Nouns: ANEs within proper nouns (e.g., "MP3," "BK21") pose a challenge due to their inconsistent structural information and contextual features.
  • Morphology Analysis Errors: Errors in the underlying morphological analysis of Korean text can lead to incorrect extraction of learning elements.
  • Contextual Ambiguities: Some ambiguities are so subtle that even humans might struggle to resolve them without more than two contextual features, making automated extraction difficult.

For future work, the authors suggest:

  • Hybrid System: Combining the rule-based approach with their learning model to leverage the strengths of both.
  • Broader Symbol Coverage: Extending the system to transliterate other non-Korean alphabetic symbols, such as Roman alphabets, measurement symbols, and Chinese characters, for more comprehensive Korean TTS.

Summary updated

Abstract

Despite of much work on TTS technologies and several TTS systems customized for Korean, current TTS systems output many errors in transliterating non-alphabetic symbols such as Arabic numerals and text symbols. This paper proposes TLAN (Transliteration Learner for Arabic-Numeral expressions) which can efficiently disambiguate the reading and meaning of Arabic Numeral Expressions (ANEs) in texts by using a decision tree. For the purpose of analyzing and learning data, three phases of learning elements were suggested: patterns of Arabic numerals combined with text symbols, contextual features and heuristic information were classified according to the senses and sounds of ANEs. Our corpus was made up of news articles issued from January 1, 2000 to December 31, 2001 from 10 major newspapers in Korea. By learning the three phases of learning elements, the model shows 97.38% and 97.28% accuracies for the training set and the test set, respectively.
BibTeX
@misc{nam2004learning,
  author = {HyeonSook Nam and Youngim Jung and Donghun Lee and Hyuk‐Chul Kwon and Ae-Sun Yoon},
  title = {{Learning for transliteration of arabic-numeral expressions using decision tree for Korean TTS}},
  year = {2004},
  doi = {10.21437/interspeech.2004-479},
}
Figure