A Neural-Symbolic Cognitive Agent for Online Learning and Reasoning

Leo de Penning, Artur S. d'Avila Garcez, Luís C. Lamb, John-Jules Ch. MeyerIJCAI 2011 · DOI

Abstract

The Neural-Symbolic Cognitive Agent (NSCA) is a novel framework designed to bridge the gap between "black-box" neural learning and "transparent" symbolic reasoning. By leveraging a Recurrent Temporal Restricted Boltzmann Machine (RTRBM), the agent learns complex temporal patterns from noisy simulator data and exports this knowledge as human-readable temporal logic rules. This paper demonstrates the NSCA's effectiveness in a driving simulator environment, where it successfully mirrors human instructor assessments and extracts logical rules governing safe driving behavior.

Introduction

Artificial Intelligence has long been divided between two paradigms: symbolic logic and neural networks. Symbolic logic excels at reasoning and explainability but struggles with the noise and scale of real-world data. Conversely, neural networks are adept at handling uncertainty and complex patterns but lack transparency, often operating as "black boxes." This tension is particularly acute in online learning environments, such as training simulators, where high-level concepts like "safe driving" involve fuzzy temporal relationships that are difficult to hand-code.

The NSCA addresses this challenge by providing a framework for online learning and reasoning that is both robust to noise and interpretable by humans.

Architecture and Methodology

The core of the NSCA is the Recurrent Temporal Restricted Boltzmann Machine (RTRBM). Unlike standard RBMs, the RTRBM incorporates recurrent connections, enabling it to maintain a memory of previous states and learn temporal sequences effectively.

Architecture of the Neural-Symbolic Cognitive Agent (NSCA) showing the integration of the RTRBM with symbolic logic and belief reconstruction.

The framework's primary technical contribution is its bidirectional translation capability:

  1. Encoding: Human domain knowledge, represented in temporal logic (e.g., using operators like "sometime in the future" or "since"), is used to initialize the weights of the neural network.
  2. Extraction: After training on observational data, the updated weights are translated back into revised, human-readable logic rules.

Furthermore, the model employs Bayesian inference to handle missing data and sensor errors, allowing it to maintain "beliefs" about the environment even under incomplete information. The stochastic nature of the network's activation functions allows these beliefs to be treated as fuzzy sets, capturing vague human concepts like "approaching quickly."

Experimental Evaluation

The NSCA was validated using data from ANWB driving simulators. The dataset included 43 distinct telemetry and spatial measurements from five students across five test scenarios. Ground truth was established using assessment scores (0–100) provided by three professional driving instructors in categories such as vehicle control, economic driving, traffic flow, and safety.

Results and Discussion

The NSCA demonstrated a high degree of fidelity in mirroring human assessment patterns. As shown in the assessment data, the agent's inferred scores closely tracked the actual scores assigned by instructors in real-time.

Comparison of inferred scores from the NSCA versus actual instructor scores, demonstrating the model's ability to mirror human-like assessment.

Beyond score tracking, the model successfully extracted complex rules from its learned weights. For instance, it identified a logical relationship between high "Steering Angle Velocity" and lower safety scores—a rule derived purely from observation. This "knowledge discovery" capability allows the AI to articulate correlations that human experts might intuitively understand but haven't explicitly defined.

Conclusion and Future Work

The NSCA represents a significant step toward transparent AI in complex, temporal domains. While the current validation is limited by a small sample size, the results are promising. Future work will focus on scaling the architecture to Deep Boltzmann Machines for higher-level abstractions and testing the system in high-stakes environments like jet fighter pilot training and strategic command-and-control.

Summary updated

BibTeX
@inproceedings{penning2011neural,
  author = {Leo de Penning and Artur S. d'Avila Garcez and Luís C. Lamb and John-Jules Ch. Meyer},
  title = {{A Neural-Symbolic Cognitive Agent for Online Learning and Reasoning}},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year = {2011},
  doi = {10.5591/978-1-57735-516-8/ijcai11-278},
}
Figure