Invariant Odor Recognition with ON-OFF Neural Ensembles

Srinath Nizampatnam, Lijun Zhang, Rishabh Chandak, Nalin Katta, Baranidharan RamanbioRxiv 2020 · DOI

TL;DR

This paper tackles the challenge of robustly recognizing sensory stimuli despite noisy and variable neural responses. By studying the locust olfactory system, the researchers developed a surprisingly simple "ON minus OFF" neural classifier that can achieve invariant odor recognition. This approach was then generalized into a Boolean neural network, demonstrating its potential for broader pattern recognition tasks.

What Problem Does This Paper Address?

All sensory systems face the fundamental problem of recognizing stimuli reliably, even when the neural signals are highly variable. This variability can arise from numerous factors: changes in stimulus presentation (dynamics, repetition), the presence of competing stimuli, the history of previous stimuli, and even environmental conditions like humidity. The core question is whether a single computational framework can overcome these diverse sources of noise to achieve invariant recognition. The authors investigate this in the locust olfactory system, a well-studied model for sensory processing.

Methods

The researchers employed a multi-pronged approach:

  • Electrophysiology: They recorded the activity of projection neurons (PNs) in the locust antennal lobe using multi-electrode arrays.
  • Stimulus Manipulation: They systematically varied stimulus dynamics (pulse duration, inter-pulse intervals), introduced background odorants, altered stimulus history, and changed ambient humidity to probe neural response variability.
  • Behavioral Assays: Locusts were trained in an appetitive conditioning assay to associate an odor with a reward. Their ability to recognize the odor under different humidity conditions was then tested.
  • Computational Modeling:
    • Bayesian Logistic Regression: They developed a constrained Bayesian logistic regression model with binary or ternary weights to decode PN responses.
  • "ON minus OFF" Classifier: A simplified version of the Bayesian approach was developed, summing the activity of "ON" neurons (activated by the odor) and subtracting the activity of "OFF" neurons (inhibited by the odor or activated after stimulus termination).
  • Boolean Neural Network: The "ON minus OFF" principle was generalized into a Boolean neural network, designed to be interpretable and capable of pattern recognition.

Datasets

The study primarily used data collected from locust olfactory systems. For the generalization to non-olfactory tasks, the well-known MNIST dataset of handwritten digits was used for training and evaluating the Boolean neural network.

Key Insights and Ideas

  • Neural responses are highly variable, but behavior can be invariant: Individual PN responses in the locust olfactory system were found to be highly unpredictable across repetitions, stimulus dynamics, history, and humidity. However, behavioral recognition (e.g., palp-opening response) remained robust. This discrepancy highlights the need for sophisticated decoding mechanisms.
  • A simple "ON minus OFF" rule can achieve robust recognition: The most striking finding is that a very simple classifier, which sums the activity of neurons excited by the odor ("ON" neurons) and subtracts the activity of neurons inhibited by the odor ("OFF" neurons), can effectively decode odor identity despite neural variability. This suggests that the brain might employ surprisingly straightforward principles for invariant recognition.
  • OFF neurons are crucial for reducing false positives: While ON neurons alone could detect the target odor, the inclusion of OFF neurons significantly improved discrimination and reduced false positives, enhancing the overall robustness of the classifier.
  • The "ON minus OFF" principle generalizes to other domains: The researchers successfully adapted this concept into a Boolean neural network, which performed well on the MNIST digit classification task, demonstrating the broad applicability of this computational strategy.

Key Results

  • Robust odor recognition with a simple classifier: The "ON minus OFF" classifier achieved robust odor recognition in the locust olfactory system, even with variable neural inputs.
  • Improved performance with ternary weights: A Bayesian logistic regression with ternary weights ('-1', '0', '1') significantly improved recognition performance compared to binary weights ('0', '1'), particularly in the presence of background odorants.
  • Behavioral invariance to humidity: Locusts trained in one humidity condition could recognize the odor equally well when tested in either dry or humid conditions, demonstrating behavioral invariance.
  • Boolean neural network performance on MNIST: The generalized Boolean neural network achieved an error rate of 2.68% on the MNIST dataset, only modestly higher than state-of-the-art ANNs with real-valued weights.

Limitations and Future Work

  • Interpretability of the "ON minus OFF" rule: While the rule is simple, the precise contribution of OFF neurons to enhancing separability and reducing false positives warrants further investigation.
  • Generalizability of the Boolean network: While successful on MNIST, further exploration of the Boolean neural network's performance on other complex pattern recognition tasks would be valuable.
  • Translating neural signals to behavior: The paper notes a discrepancy between the variability observed in neural data and the robustness of behavioral output, suggesting that the rules for translating neural responses into appropriate behavior require further investigation.
  • Fault tolerance: The authors acknowledge that relying on a small subset of neurons for recognition might not be fault-tolerant, suggesting that ensemble-level processing is key.

Summary updated

Abstract

ABSTRACT Invariant recognition of a stimulus is a challenging pattern-recognition problem that must be dealt with by all sensory systems. Since neural responses evoked by a stimulus could be perturbed in a multitude of ways, could a single scheme be devised to achieve this computational capability? We examined this issue in locust olfactory system. We found that odor-evoked responses in individual projection neurons in the locust antennal lobe varied unpredictably with repetition, stimulus dynamics, stimulus history, presence of background odorants, and changes in ambient conditions. Yet, a highly-constrained Bayesian logistic regression approach with ternary weights could provide robust odor recognition. We found that this approach could be further simplified: sum firing rates of ON neurons and subtract total activity in OFF neurons (‘ON minus OFF’ classifier). Notably, we found that this approach could be generalized to develop a Boolean neural network that can perform well in a non-olfactory pattern recognition task.
BibTeX
@misc{nizampatnam2020invariant,
  author = {Srinath Nizampatnam and Lijun Zhang and Rishabh Chandak and Nalin Katta and Baranidharan Raman},
  title = {{Invariant Odor Recognition with ON-OFF Neural Ensembles}},
  year = {2020},
  doi = {10.1101/2020.11.07.372870},
  howpublished = {bioRxiv},
}
Figure