Combining Hand-crafted Rules and Unsupervised Learning in Constraint-based Morphological Disambiguation

Kemal Oflazer, Gökhan Tür

TL;DR

This paper introduces a novel constraint-based system for morphological disambiguation in complex, agglutinative languages like Turkish. By combining hand-crafted linguistic rules with unsupervised learning from text, the system achieves high accuracy in resolving word ambiguities, even for unknown words, demonstrating a practical approach to a challenging NLP problem.

What Problem Does This Paper Address?

Natural language processing systems often struggle with languages that have highly complex morphology, where a single word can have many possible grammatical interpretations. This is particularly true for agglutinative languages like Turkish, where suffixes are added to a root word to convey a wealth of grammatical information (tense, case, person, etc.). This can lead to a single word form having thousands of potential morphological analyses, making it difficult for downstream NLP tasks like parsing to proceed. Traditional rule-based systems are hard to maintain and scale, while purely statistical methods can struggle with the sheer combinatorial explosion of possibilities. The paper aims to bridge this gap by developing a system that can effectively disambiguate these complex word forms.

Methods

The core of the proposed system is a constraint-based morphological disambiguation approach. It integrates three key components:

  1. Corpus-Independent Hand-Crafted Rules: These are linguistically motivated rules designed to improve precision without sacrificing recall. They act as an initial filter, reducing ambiguity based on established linguistic knowledge.
  2. Unsupervised Learning of Constraint Rules: The system learns additional rules from an untagged training corpus. This learning process generates two types of rules:
  3. Choose Rules: These rules select specific morphological parses that satisfy certain constraints, effectively discarding other possibilities.
  4. Delete Rules: These rules eliminate parses that satisfy a given constraint. This learning is inspired by Brill's work but adapted for languages like Turkish where tag predictability is lower.

  5. Statistical Information from the Corpus: The system leverages contextual statistics derived from the corpus to further refine disambiguation.

A significant innovation is the novel approach to unknown word processing. When a word is not found in the lexicon, a secondary morphological processor attempts to recover inflectional and derivational information by assuming a nominal root and analyzing suffixes. This dramatically reduces the number of truly unknown words.

The system's preprocessor also handles lexical and non-lexical collocations, compound verbs, and other multi-word constructs, converting them into unified feature structures before disambiguation.

Datasets

The paper uses two Turkish texts for experimentation:

  • ARK: A short text on Near Eastern archaeology.
  • C2400/C270: A book on early 20th-century Turkish Republic history.

The system was trained on portions of the C2400 text (500, 1000, and 2000 sentences) and also on the ARK text itself. The C270 text was used for testing. Gold standard disambiguated versions of ARK and C270 were manually prepared for evaluation.

Key Insights and Ideas

  • Hybrid Approach is Key: For highly agglutinative languages, a combination of expert linguistic knowledge (hand-crafted rules) and data-driven learning (unsupervised rules) is crucial for effective disambiguation.
  • Unsupervised Learning for Specificity: Unsupervised learning is particularly valuable for discovering subtle contextual constraints that would be difficult for humans to enumerate exhaustively.
  • Unknown Word Handling is Critical: The ability to process and assign plausible morphological analyses to unknown words is essential for achieving high recall in real-world text. The proposed secondary processor significantly boosts this capability.
  • "Choose" vs. "Delete" Rules: The distinction between rules that actively select a parse ("choose") and those that eliminate improbable ones ("delete") provides a flexible framework for ambiguity reduction.
  • Contextual Statistics for Refinement: After initial rule application, using statistical patterns in unambiguous contexts helps to prune remaining unlikely parses.

Key Results

The system achieves impressive results on Turkish text:

  • Recall: 96% to 97%
  • Precision: 93% to 94%
  • Ambiguity: 1.02 to 1.03 parses per token (close to the ideal of 1.0)
  • Unknown Words: Well below 1% of tokens remain unknown.

The paper also notes that hand-crafted rules handle the majority of the "easy" disambiguation tasks, while learned rules contribute to refining the more difficult cases. Sentence-level analysis shows that a significant portion (over 60%) of sentences are correctly disambiguated with very few remaining ambiguous parses.

Limitations and Future Work

  • Genuine Ambiguities: The paper acknowledges that some ambiguities are inherent to the language (e.g., words like "o" can be a pronoun or determiner) and cannot be fully resolved by syntactic or morphological means alone. Semantic or discourse-level information would be needed.
  • Semantic/Discourse Constraints: The current system relies primarily on syntactic and morphological constraints. Future work could incorporate semantic preferences or discourse-level information to resolve remaining ambiguities.
  • Root Word Preference Statistics: The authors suggest that obtaining root word preference statistics and word form preference statistics could help resolve some of the more problematic ambiguities, particularly those involving multiple possible nominal constituents.
  • Learning from Scratch: Attempting to learn rules without any initial hand-crafted rules led to failure, highlighting the necessity of bootstrapping the learning process with expert knowledge.

Summary updated

Abstract

This paper presents a constraint-based morphological disambiguation approach that is applicable languages with complex morphology--specifically agglutinative languages with productive inflectional and derivational morphological phenomena. In certain respects, our approach has been motivated by Brill's recent work, but with the observation that his transformational approach is not directly applicable to languages like Turkish. Our system combines corpus independent hand-crafted constraint rules, constraint rules that are learned via unsupervised learning from a training corpus, and additional statistical information from the corpus to be morphologically disambiguated. The hand-crafted rules are linguistically motivated and tuned to improve precision without sacrificing recall. The unsupervised learning process produces two sets of rules: (i) choose rules which choose morphological parses of a lexical item satisfying constraint effectively discarding other parses, and (ii) delete rules, which delete parses satisfying a constraint. Our approach also uses a novel approach to unknown word processing by employing a secondary morphological processor which recovers any relevant inflectional and derivational information from a lexical item whose root is unknown. With this approach, well below 1 percent of the tokens remains as unknown in the texts we have experimented with. Our results indicate that by combining these hand-crafted,statistical and learned information sources, we can attain a recall of 96 to 97 percent with a corresponding precision of 93 to 94 percent, and ambiguity of 1.02 to 1.03 parses per token.
BibTeX
@inproceedings{oflazer1996combining,
  author = {Kemal Oflazer and Gökhan Tür},
  title = {{Combining Hand-crafted Rules and Unsupervised Learning in Constraint-based Morphological Disambiguation}},
  booktitle = {Conference on Empirical Methods in Natural Language Processing},
  year = {1996},
  url = {https://openreview.net/forum?id=Cv_N2f4FtOf},
}
Figure