CBGT-Net: A Neuromimetic Architecture for Robust Classification of Streaming Data

Shreya Sharma, Dana Hughes, Katia P. Sycara

Abstract

CBGT-Net is a brain-inspired neural network architecture that mimics how mammals accumulate evidence before making a decision. Unlike traditional models that force an output for every input, CBGT-Net processes a stream of noisy data and only "commits" to a classification once its internal evidence crosses a predefined threshold. This mechanism leads to higher accuracy in uncertain environments and significantly faster training than standard recurrent models.

Introduction: The Need for Deliberation

Traditional deep learning models are often "trigger-happy." Whether processing a clear image or a single blurry pixel, a standard Convolutional Neural Network (CNN) typically generates a classification, often with overconfident probability scores. Even recurrent models like LSTMs are usually designed to provide an output at a fixed point in time or after a predetermined sequence length.

In real-world scenarios, data is frequently streaming, noisy, or incomplete—such as a robot catching glimpses of an object through moving foliage. There is a critical need for models that can deliberate: systems that recognize when a single observation is insufficient and can integrate multiple observations over time until enough information is gathered to make a robust decision.

Methods: The CBGT-Net Architecture

The authors introduce CBGT-Net, modeled after the cortico-basal ganglia-thalamic (CBGT) circuits in the brain, which are responsible for action selection and evidence integration.

The CBGT-Net architecture, featuring an evidence encoder, an accumulator, and a threshold-based decision module.

The architecture consists of three main components:

  1. Evidence Encoder ($E_\theta$): A neural network (e.g., LeNet or ResNet) that maps a single observation, such as an image patch, to an "evidence vector." Each element in this vector represents the support for a specific class.
  2. Evidence Accumulator: This component maintains a running sum of the evidence vectors over time. Unlike the "black box" hidden state of an LSTM, this accumulator has clear semantic meaning: it represents the total evidence gathered for each category so far.
  3. Decision Threshold Module: A gating mechanism that monitors the accumulator and triggers a final decision only when the evidence for at least one category exceeds a predefined threshold ($\tau$).

The model is trained using standard cross-entropy loss applied at the moment the threshold is crossed, incentivizing the encoder to produce additive evidence that builds toward a correct classification.

Experimental Setup

CBGT-Net was evaluated using two classic benchmarks modified for a streaming environment:

  • MNIST (Handwritten Digits): Images were decomposed into streams of small patches (5x5 to 20x20 pixels).
  • CIFAR-10 (Object Categories): Color images were presented as sequences of random patches.

In these tasks, the model must "peek" at different parts of the image sequentially, simulating a scenario where the full context is not immediately available.

Key Results and Insights

CBGT-Net demonstrates several advantages over traditional approaches:

  • Superior Accuracy and Robustness: The model consistently outperformed single-patch baselines and LSTM models, particularly in high-uncertainty scenarios involving small patches. By waiting for more information, CBGT-Net effectively increases the signal-to-noise ratio before acting.
  • Adjustable "Caution": The decision threshold ($\tau$) can be adjusted at deployment. This allows users to tune the model's behavior—making it "impulsive" (fast but risky) or "cautious" (slow but accurate)—without the need for retraining.
  • Interpretability: Because the model explicitly sums evidence, the deliberation process is transparent. One can observe the confidence for different classes climbing toward the threshold.

Training Efficiency

A standout finding was the efficiency of the learning process. By utilizing simple additive accumulation rather than complex gating mechanisms, CBGT-Net converges much earlier than LSTMs.

Comparison of training episodes required for convergence between CBGT-Net and LSTM across different patch sizes for MNIST and CIFAR-10.

As shown in the figure above, CBGT-Net required significantly fewer training episodes to converge—averaging 75.4% fewer episodes for MNIST and 89.4% fewer for CIFAR-10 compared to the LSTM baseline.

Limitations and Future Work

While promising, the authors identify several areas for future research:

  • Linear Accumulation: The current model uses simple addition. Biological systems often exhibit "leaky" integration or non-linear dynamics, which may be necessary for non-stationary tasks.
  • Fixed Thresholds: Currently, the threshold is a user-defined hyperparameter. Future iterations could incorporate learned dynamic thresholds that adjust based on task urgency or the cost of delay.
  • Dimensionality Constraints: The evidence vector must currently match the number of classes, which might limit the learning of complex intermediate representations.

CBGT-Net represents a compelling step toward "neuromimetic" AI that moves beyond simple computation to active decision-making.

Summary updated

BibTeX
@inproceedings{sharma2024cbgt,
  author = {Shreya Sharma and Dana Hughes and Katia P. Sycara},
  title = {{CBGT-Net: A Neuromimetic Architecture for Robust Classification of Streaming Data}},
  booktitle = {ICHMS},
  year = {2024},
  doi = {10.1109/ichms59971.2024.10555685},
}
Figure