A Categorial Variation Database for English

Nizar Habash, Bonnie J. Dorr

Introduction

In Natural Language Processing (NLP), identifying that different words represent the same underlying concept is a fundamental challenge. For instance, a query for "development" should ideally retrieve documents containing "develop." Traditionally, researchers have relied on two primary methods: reductionist stemming (e.g., the Porter stemmer) and expansionist generation. However, stemming often suffers from over-stemming (linking unrelated words) or under-stemming (failing to link related words like adhere and adhesion). Conversely, expansionist systems frequently generate non-existent words.

Furthermore, existing resources like WordNet, while effective at linking synonyms, often fail to connect words across different parts of speech (e.g., the verb feed and the noun food). This paper introduces CatVar, a large-scale database designed to bridge this "cross-categorial" gap by mapping words that share a root but differ in part-of-speech.

Methodology

CatVar (version 2.0) was developed using a hybrid approach that combines human-curated linguistic data with automated clustering algorithms. The process began with Seed Extraction, pulling explicit links from high-quality resources such as NOMLEX (for nominalizations) and LDOCE (for verb-noun pairs).

These seeds were then used to guide an automated Clustering process. While the Porter stemmer was used to group words from the Brown Corpus and Penn Treebank, the "seed" links ensured that these clusters remained linguistically valid. For example, a cluster might include {hunger (N), hunger (V), hungry (Adj), hungriness (N)}.

The CATVAR 2.0 web interface showing a cluster search for the word "hunger".

Key Results and Evaluation

CatVar 2.0 comprises 96,368 unique lexemes organized into 62,232 clusters. Human evaluation by native speakers demonstrated high reliability, with a precision of 91.82% and an F-score of approximately 89%.

A significant finding is the "linkability" of the database. The authors found that 30% of the links within CatVar are invisible to standard stemmers. In practical applications, CatVar has shown tangible benefits:

  • Machine Translation: Since 98% of translation "divergences" involve categorial variation, CatVar serves as a critical alignment tool.
  • Headline Generation: Using CatVar as an "event filter" to ensure headlines contain informative verbal or nominalized roots improved Bleu scores from 0.1687 to 0.1740.
Distribution of words across cluster sizes in CatVar 2.0.

Discussion and Future Work

Despite its scale, CatVar faces certain limitations. As shown in the distribution of cluster sizes, approximately half of the database currently consists of single-word clusters. Future efforts will focus on "absorbing" these into larger, related groups. Additionally, while CatVar links words by shared roots, it does not yet distinguish between specific semantic relationships (e.g., distinguishing an action like construction from an agent like constructor).

Future work also includes integrating inflectional analysis to handle plurals and tenses, as well as expanding the database to support cross-linguistic tasks and bilingual alignment.

Summary updated

Abstract

We describe our approach to the construction and evaluation of a large-scale database called "CatVar" which contains categorial variations of English lexemes. Due to the prevalence of cross-language categorial variation in multilingual applications, our categorial-variation resource may serve as an integral part of a diverse range of natural language applications. Thus, the research reported herein overlaps heavily with that of the machine-translation, lexicon-construction, and information-retrieval communities.We apply the information-retrieval metrics of precision and recall to evaluate the accuracy and coverage of our database with respect to a human-produced gold standard. This evaluation reveals that the categorial database achieves a high degree of precision and recall. Additionally, we demonstrate that the database improves on the linkability of Porter stemmer by over 30%.
BibTeX
@inproceedings{habash2003categorial,
  author = {Nizar Habash and Bonnie J. Dorr},
  title = {{A Categorial Variation Database for English}},
  booktitle = {Conference of the North American Chapter of the Association for Computational Linguistics},
  year = {2003},
}
Figure