Decision Lists for Robust Lexical Disambiguation

You are reading version 1 of this direction, frozen 2026-10-04. The latest version is version 2.

Version 1 of 214 papers16 conceptsfrozen 2026-10-04

When a computer encounters the word "bass," it must decide if it is looking at a fish or a musical instrument. In natural language, we are surrounded by such ambiguities—missing accents in Spanish, elided subjects in Japanese, or the countability of nouns in learner essays.

The traditional approach to solving this might involve weighing every possible clue in a sentence and calculating a probability. However, research across several decades suggests a more robust alternative: Decision Lists. Instead of balancing many weak, correlated features, a decision list identifies the single most reliable piece of evidence and ignores everything else.

The Logic of the Strongest Signal

A decision list is an ordered sequence of "if-then" rules. Unlike a standard decision tree that splits data into smaller and smaller pockets, or a Naive Bayes classifier that sums up every available feature, a decision list searches for the first rule that matches the current context.

As David Yarowsky demonstrated in Decision Lists for Lexical Ambiguity Resolution, this "winner-takes-all" strategy is remarkably effective for tasks like accent restoration. If the word "público" appears next to "el," it is almost certainly a noun; if it appears next to "yo," it is likely a verb. By ranking these contextual clues by their reliability, the algorithm doesn't need to worry about conflicting, weaker signals further down the list.

Ranking by Reliability

The "intelligence" of a decision list lies in how the rules are ordered. The most common metric for this is the log-likelihood ratio.

Researchers like Eneko Agirre and David Martínez have used this to test the "one sense per collocation" hypothesis. In One Sense per Collocation and Genre/Topic Variations, they show that while a word's meaning is often determined by its immediate neighbors, the strength of that clue varies. A decision list handles this by putting the most predictive collocations at the top.

This ranking mechanism has evolved over time:

Why Order Matters

Why use an ordered list instead of a set of independent rules? Raymond J. Mooney argues in Comparative Experiments on Disambiguating Word Senses that ordered lists are fundamentally better at handling exceptions.

In an unordered system, a general rule and a specific exception might conflict. In an ordered decision list, you simply place the exception at the top. If the exception matches, the system acts on it and stops. If not, it falls through to the more general rules. This hierarchy, as noted by Gerard Escudero in A Comparison between Supervised Learning Algorithms for Word Sense Disambiguation, ensures that the most discriminative features always take precedence, providing a clear and logical path for every decision.

From Language to Vision: The Explainability Benefit

The simplicity of the "if-then" structure makes decision lists highly interpretable. While modern deep learning models are often "black boxes," decision lists offer a human-readable map of why a classification was made.

This property is being rediscovered in modern computer vision. In Local-to-Global Logical Explanations for Deep Vision Models, Bhavan Vasu and Giuseppe Maria Raffa use ordered hierarchical lists to explain neural network outputs. By ensuring that each input satisfies only the first applicable logical rule, they prevent overlapping or conflicting explanations, mirroring the "noise-tolerant" search first pioneered by the CN2 Induction Algorithm by Tim Niblett.

Whether restoring a Spanish accent or explaining a vision model, the core intuition remains the same: identify the strongest evidence, rank it by reliability, and stop as soon as you find a match.

Papers in this version

History & citationVersion 2 · 2026-10-04

Current · Permanent link

  1. Version 2 (latest) · 2026-10-04 · 13 papers
  2. Version 1 · 2026-10-04 · 14 papers
Cite this direction

Latest version (a living page):

@misc{lacuna_log_likelihood_feature_ranking_bd5995fc,
  title = {log-likelihood feature ranking},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/log-likelihood-feature-ranking/rdr_bd5995fcc4a44397a71e9b1b54e7605e},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_decision_lists_for_robust_lexical_disamb_bd5995fc_v1,
  title = {Decision Lists for Robust Lexical Disambiguation},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/decision-lists-for-robust-lexical-disambiguation/rdr_bd5995fcc4a44397a71e9b1b54e7605e/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}