Imprecision in Machine Learning and AI

Cassio Polpo de Campos, Alessandro AntonucciIEEE Intell. Informatics Bull 2015 · OpenReview

Abstract

Standard artificial intelligence and machine learning models often exhibit unwarranted overconfidence by relying on "precise" single-point probabilities. This paper advocates for an imprecise probabilistic framework, which replaces single distributions with sets of possible distributions (credal sets). By embracing imprecision, researchers can develop more robust systems that better manage missing data, provide reliable classifications in ambiguous scenarios, and incorporate qualitative expert knowledge without making unfounded assumptions.

Introduction: The Gap of Ignorance

In classical probability, uncertainty is typically represented by a single numerical value—for instance, stating there is a "70% chance of rain." However, such "sharp" values often mask a deeper layer of ignorance. When data is entirely absent, representing the state of knowledge as "50%" is fundamentally different from stating it is "somewhere between 0% and 100%."

The authors identify five critical areas where this "gap of ignorance" leads to failures in standard models:

  1. Missing Data: Real-world data is rarely "missing at random." Standard imputation methods can introduce significant bias.
  2. Overconfident Classification: Models frequently force a single choice even when evidence is highly ambiguous.
  3. Model Sensitivity: Minor perturbations in parameters can lead to drastically different conclusions.
  4. Feature Selection: Statistical significance may vanish under more rigorous, cautious analysis.
  5. Expert Knowledge: Qualitative statements like "more likely than" are difficult to map accurately to precise decimals.

Methods: From Points to Sets

The core proposal is a transition from standard probability to imprecise probabilities. Instead of a single distribution, the framework utilizes a set of distributions, often referred to as a "credal set."

Figure 1: A credal set (shaded region) representing a range of possible probabilities for outcomes (win, draw, loss), compared to a precise single-point probability (white dot).

Key techniques within this framework include:

  • Credal Networks: Extensions of Bayesian networks where conditional probability tables contain intervals or sets rather than single values.
  • Robust Sensitivity Analysis: Establishing an "$ϵ$-box" around parameters to determine how much variation is possible before the model's output changes.
  • Conservative Data Completion: Considering all possible completions for missing data to ensure the final conclusion remains stable.
  • Imprecise Statistical Tests: Utilizing robust versions of tests (e.g., Mann-Whitney u-test) that can return "indeterminate" results when data is insufficient.

Experimental Evaluation

The framework was tested across several datasets to demonstrate its robustness:

  • Iris Dataset: Used to evaluate reliable classification.
  • Cohn-Kanade Dataset: A collection of facial expressions used to test the sensitivity of facial action unit detection.
  • Australian AIDS Dataset: Used for feature selection and survival analysis.
  • Asia Diagnostic Network: A medical model demonstrating the quantification of qualitative expert statements.
Figure 5: Sample images from the Cohn-Kanade dataset, illustrating the variety of facial expressions used to test model robustness and sensitivity.

Key Results and Insights

The research yields several significant findings:

  • Reliable Classification: On the Iris dataset, while a standard Naive Bayes classifier achieved 72% accuracy, the imprecise version reached 100% "set accuracy." This means the true class was always included in the predicted set. Crucially, on "hard" cases where the imprecise model returned multiple classes, the standard model's accuracy plummeted to 60%, confirming that the imprecise model correctly identifies ambiguity.
  • Identifying Flukes: In the Australian AIDS dataset, standard tests suggested significant regional differences in survival. The imprecise method identified this as unreliable, suggesting the result was a data artifact rather than a robust finding.
  • Robustness as a Metric: In facial recognition tasks using the Cohn-Kanade dataset, a clear correlation was found between the robustness parameter ($ϵ$) and prediction accuracy. As decisions became less robust (smaller $ϵ$), the error rate (Hamming distance) increased.

Conclusion

The primary trade-off of this approach is that it can lead to "less informative" results. By being more cautious, the model may provide a range of possibilities rather than a single answer. However, in high-stakes fields like medicine or autonomous systems, it is often preferable for a model to admit "I don't know" or "It is one of these three options" than to provide a single, potentially catastrophic, wrong answer. Future work will focus on improving the computational efficiency of inference in credal networks and refining the translation of qualitative knowledge into mathematical constraints.

Summary updated

BibTeX
@inproceedings{campos2015imprecision,
  author = {Cassio Polpo de Campos and Alessandro Antonucci},
  title = {{Imprecision in Machine Learning and AI}},
  booktitle = {IEEE Intell. Informatics Bull},
  year = {2015},
  url = {https://openreview.net/forum?id=lL3fgbbuUo},
}
Figure