TL;DR
AutoHebb is a novel neural network architecture that achieves superior zero-shot inference and continual learning by combining meta-learning with autonomous, neuromodulated Hebbian plasticity. Unlike standard models that rely on external gradients, AutoHebb generates its own learning signals, allowing it to "discover" efficient learning algorithms that generalize far beyond their training data.
What Problem Does This Paper Address?
Artificial intelligence still struggles with two hallmarks of biological intelligence: Zero-Shot Inference (ZI)—the ability to reason about novel combinations of familiar elements (e.g., "if A > B and B > C, then A > C")—and Continual Learning (CL)—the ability to learn new information over time without forgetting the old.
Current approaches often fall into two traps. Either they rely on external components (like researcher-calculated gradients or memory buffers) that don't exist in the brain, or they use architectures so complex that they are impossible to analyze mathematically. The authors of AutoHebb sought a "fully neural" model that is biologically grounded, autonomously controlled, and simple enough to be reverse-engineered into human-understandable algorithms.
Methods
The AutoHebb architecture consists of two feedforward subnetworks:
- The Main Network: A standard multi-layer perceptron (MLP) containing both fixed weights and plastic weights.
- The Control Network: An auxiliary network that monitors the main network's activity and environmental feedback to produce a scalar neuromodulator signal ($m$).
Learning happens via a 3-factor Hebbian rule: updates to plastic weights are determined by the product of pre-synaptic activity, post-synaptic activity, and the global neuromodulator signal. Crucially, the network is trained using meta-learning (an "outer loop") to find the optimal fixed weights. These fixed weights act as "inductive biases" that enable the "inner loop" (the Hebbian updates) to learn specific tasks efficiently during the network's "lifetime."
Datasets and Benchmarks
The authors evaluated AutoHebb on several cognitively demanding tasks:
- Transitive Inference (TI): A ranking task where the model learns adjacent pairs (A>B, B>C) and must infer non-adjacent relationships (A>C).
- Transitive Equivalence (TE): A grouping task where the model must infer that if A=B and B=C, then A=C.
- Continual Learning Variants: "Linking" tasks (TI-L and TE-L) where the model must connect two separate lists or groups based on a single new piece of information.
- Multi-task ZI: Learning TI followed by TE (or vice versa) without being told which task is currently active.
Key Insights and Ideas
- Autonomous Control is Key: By generating its own neuromodulatory signal, AutoHebb can self-regulate. For example, it can "shut off" learning once a task is mastered, preventing "overexposure" from corrupting its internal representations.
- Emergent "Length Generalization": Even when meta-trained on only 8 items, AutoHebb successfully generalized its ranking abilities to 20+ items. This suggests the meta-learning process discovered a truly abstract algorithm for ordering, rather than just memorizing patterns.
- Algorithmic Tractability: Because the architecture is feedforward and modular, the authors successfully reverse-engineered the network's behavior. They found it "discovered" a scalar rank representation for items, using subtraction to make decisions.
- The Essential Trinity: The paper demonstrates that meta-learning, Hebbian plasticity, and autonomous neuromodulation are jointly essential. Removing any one component caused performance to collapse on at least one of the benchmark tasks.
Key Results
AutoHebb consistently outperformed popular meta-learning models like MAML, Reptile, and ANML.
- Zero-Shot Accuracy: On the TI task, AutoHebb achieved ~98% accuracy compared to ~70-74% for MAML and Reptile. On the TE task, most baselines performed at chance (~50%), while AutoHebb reached ~94%.
- Continual Learning: AutoHebb was the only model that could successfully perform the "Linking" tasks and the Multi-task ZI benchmark without explicit task cues.
- Robustness: While other models' performance decayed when shown the same pair too many times (overexposure), AutoHebb remained stable by down-regulating its own plasticity.
Limitations and Future Work
While powerful, the current study focused on relatively low-dimensional, symbolic inputs. The authors acknowledge that scaling AutoHebb to high-dimensional sensory data (like raw images or natural language) is a major next step. They also suggest that AutoHebb modules could be integrated into larger architectures, like Transformers, to provide them with more robust online learning and "test-time" adaptation capabilities.
Summary updated