Reasoning in Non-Probabilistic Uncertainty: Logic Programming and Neural-Symbolic Computing as Examples

Tarek R. Besold, Artur S. d'Avila Garcez, Keith Stenning, Leendert W. N. van der Torre, Michiel van Lambalgen

Abstract

This article challenges the prevailing assumption that probability theory is the sole rigorous framework for managing uncertainty in artificial intelligence. We argue that certain forms of uncertainty—specifically those involving interpretational and normative reasoning—are fundamentally non-probabilistic. To demonstrate the efficacy of logic-based alternatives, we present two paradigms: Logic Programming with Kleene semantics for modeling discourse interpretation, and a neural-symbolic implementation of Input/Output logic for managing dynamic normative contexts. Our results suggest that these structured logical frameworks provide a robust foundation for reasoning in environments where the underlying model is in flux.

Introduction: The Limits of Probabilistic Dominance

In contemporary AI research, the mantra "the world is uncertain, therefore we must use probability" has become a standard heuristic. However, this perspective often overlooks a critical distinction between different types of uncertainty. While probability is excellent for reasoning from a fixed model (e.g., calculating the likelihood of an event given a known distribution), it struggles with reasoning to a model.

We identify two specific domains where probabilistic methods face principled challenges: interpretational uncertainty (how an agent constructs a mental model of a discourse) and normative uncertainty (how an agent navigates shifting rules and obligations). In these scenarios, the "algebra of propositions" is not fixed; rather, the very structure of the problem is what the agent must determine. This paper explores how logic-based methods can address these gaps.

Logic Programming and Interpretational Uncertainty

When humans engage in discourse, we do not typically assign probabilities to every possible meaning of a sentence. Instead, we perform "reasoning to an interpretation," constructing a minimal model of the state of affairs described.

To simulate this, we utilize Logic Programming (LP) with Kleene semantics. Unlike classical binary logic, Kleene semantics employs a three-valued system: True, False, and Currently Indeterminate. This allows an agent to maintain a flexible model that only commits to truth values as information becomes available. By applying Closed World Assumptions (CWA), the system assumes a "normal" state of affairs unless evidence of an abnormality or exception is introduced. This non-monotonic approach allows the agent to revise its interpretation as a narrative unfolds, mimicking human-like cognitive processing of information.

Neural-Symbolic Integration for Normative Reasoning

The second paradigm addresses uncertainty in dynamic environments where rules (norms) may conflict or change. We employ Input/Output (I/O) Logic, which treats norms as pairs consisting of an input (a specific situation) and an output (the resulting obligation).

To make this computationally efficient and capable of learning, we utilize the N-CILP (Neural-Symbolic Connectionist Inductive Learning and Logic Programming) algorithm. This framework allows for a unique "Knowledge Head-Start":

  1. Translation: Symbolic logical rules are mapped directly into the weights and architecture of an Artificial Neural Network (ANN).
  2. Refinement: The network uses standard backpropagation to refine these rules based on new data.
  3. Priorities: Complex normative concepts, such as "Contrary-to-Duty" (CTD) obligations (what to do when a primary rule is violated), are modeled as logical priorities and translated into inhibitory weights within the network.

Empirical Evaluation: The RoboCup Case Study

To test the N-CILP framework, we utilized a proof-of-concept environment based on the RoboCup Soccer Simulator. The agent was tasked with navigating 26 complex rules (R1-R26) governing fouls, scoring, and positioning. This synthetic dataset provided a controlled environment to measure how well the system could learn priorities and exceptions compared to a standard, non-symbolic ANN.

Key Results

The integration of symbolic knowledge provided a significant performance advantage:

  • Accuracy: The N-CILP network, initialized with a partial knowledge base, achieved a 91.18% total accuracy (predicting the entire vector of obligations correctly) and 98.01% partial accuracy.
  • Learning Exceptions: The system successfully learned CTD rules—such as "do not collide with opponents, but if a collision is inevitable, minimize the impact force"—with an accuracy range of 87% to 95%.
  • Efficiency: Unlike standard ANNs that start as a "blank slate," the N-CILP network reached high performance levels significantly faster, demonstrating that background knowledge acts as a powerful regularizer during the learning process.

Discussion and Future Directions

Our findings demonstrate that logic-based methods are not merely historical artifacts but are essential for addressing specific categories of uncertainty. The ability to reason to a model is a communicative necessity; in discourse, we must first understand the intended model before we can calculate probabilities within it.

However, limitations remain. The current discourse models assume a pre-existing, mature knowledge base, and the RoboCup agent lacks a temporal memory to track events over time (e.g., remembering a previous yellow card). Future work will focus on integrating these two paradigms into a unified architecture capable of both interpreting the world and reasoning normatively within it, potentially incorporating external memory networks to handle temporal dependencies. By moving beyond the "bell curve" of probability, we can develop AI systems that more closely mirror the structural and interpretational flexibility of human cognition.

Summary updated

Abstract

This article aims to achieve two goals: to show that probability is not the only way of dealing with uncertainty (and even more, that there are kinds of uncertainty which are for principled reasons not addressable with probabilistic means); and to provide evidence that logic-based methods can well support reasoning with uncertainty. For the latter claim, two paradigmatic examples are presented: Logic Programming with Kleene semantics for modelling reasoning from information in a discourse, to an interpretation of the state of affairs of the intended model, and a neural-symbolic implementation of Input/Output logic for dealing with uncertainty in dynamic normative contexts.
BibTeX
@inproceedings{besold2017reasoning,
  author = {Tarek R. Besold and Artur S. d'Avila Garcez and Keith Stenning and Leendert W. N. van der Torre and Michiel van Lambalgen},
  title = {{Reasoning in Non-Probabilistic Uncertainty: Logic Programming and Neural-Symbolic Computing as Examples}},
  booktitle = {Minds Mach},
  year = {2017},
  url = {https://openreview.net/forum?id=9mOb_zC410O},
}
Figure