SPIRE: Task-agnostic embodied continual learning through autonomous situation inference and causal motor-primitive reuse

Yiyang Jia, Mingyang Lyu, Gongce Cao, Feifei Zhao, Yinqian Sun, Yi ZengarXiv 2026 · arXiv

TL;DR

SPIRE is a brain-inspired framework for embodied agents that autonomously detects environmental changes and reuses learned motor skills to master new tasks faster. By combining situation inference with a modular spiking neural network, it achieves a 40% reduction in learning time and significantly outperforms traditional task-free continual learning methods.

What Problem Does This Paper Address?

In the real world, robots and autonomous agents don't get "task labels" or clear boundaries telling them when a situation has changed. Most continual learning (CL) research focuses on preventing "catastrophic forgetting"—ensuring an agent doesn't lose old skills while learning new ones. However, in embodied control (like robotics), the bigger challenge is forward transfer: how can an agent use what it already knows to learn a new, related skill more quickly?

Current methods often struggle to identify which specific prior skills are relevant to a new situation without human intervention. SPIRE addresses this by creating a system that autonomously decides when to recover an old behavior and how to compose existing "motor primitives" to tackle novel challenges.

Methods

The authors introduce Situation-guided Primitive Integration for Recurrent Embodiment (SPIRE). The architecture consists of three tightly coupled modules:

  1. Situation Inference: The agent constantly predicts the outcomes of its actions. When prediction errors spike, it uses "motor probes" (small, exploratory movements) to determine if it has entered a familiar context or a brand-new one.
  2. Primitive Composition: Instead of learning every task from scratch, SPIRE identifies "mature" skills (protected source actors) that match the current situation's signature. It then learns only the residual—the difference between what the old skills provide and what the new task requires.
  3. Action Output: The final commands are generated by a Recurrent Spiking Neural Network (SNN). This brain-inspired approach allows the agent to maintain a temporal state and process information in an event-driven, energy-efficient manner.
Figure 1. SPIRE learning architecture. From left to right: situation inference, primitive composition and recurrent-spiking action output. Colored dashed arrows indicate selection of source and residual actors, while the solid xt arrow carries their current input. Paired event rows denote positive and negative population channels. Environment feedback supports context inference and local learning. The context-belief map and control environments are schematic.

Datasets

The system was evaluated across three simulated embodied control environments designed to test skill composition:

  • Coordinate Regulation: Moving a point-mass to specific axial and diagonal targets.
  • Three-joint Pose Control: Managing a robotic arm with three degrees of freedom.
  • Hidden-force Compensation: Stabilizing a body against invisible, spatially varying "winds" or forces.

The agents were put through a continuous stream of tasks ($A \rightarrow B \rightarrow X \rightarrow C \rightarrow A_{return}$), where task $C$ was a composition of the forces or targets learned in $A$ and $B$.

Figure 2. Three embodied control forms and the continuous task sequence. (a) Coordinate regulation uses axial source targets A and B, an opposing target X and the unseen diagonal composition C. (b) Joint control uses one three-link body and base. Gray poses illustrate A, B and X, and the navy pose illustrates C; rings mark ideal target endpoints, with each arm shown near its target. (c) Hidden-force compensation stabilizes the body at the origin against the spatially uniform C disturbance (+x, +y). (d) The sequence is illustrated with hidden forces while the origin target remains fixed: source skills are learned in A and B, X introduces interference, C combines the A and B disturbances to test reuse, and return-A tests retention. Target rings, force arrows and compensation arrows follow the shared legend. Paths and compensation directions are schematic. Controller memory persists throughout the sequence, and phase labels are not supplied to SPIRE.

Key Insights and Ideas

  • Causal Reuse, Not Just Correlation: The researchers didn't just observe faster learning; they proved it was caused by the old skills. By "rewinding" (disabling) specific source actors, they showed that early acquisition of task $C$ was significantly impaired, confirming that the agent was truly building on its past.
  • Residual Learning is Key: By focusing the learning process on the "target residual," the agent avoids overwriting stable, useful skills. This architectural separation is what enables the high degree of forward transfer.
  • Autonomous Context Switching: SPIRE doesn't need a "reset" button. It uses its own interaction history to infer latent contexts, allowing it to recover the original Task A behavior with near-perfect accuracy even after significant interference from other tasks.

Key Results

  • Faster Acquisition: SPIRE reduced the number of interactions needed to reach a performance criterion by ~40% compared to "fresh" controllers starting from scratch.
  • Superior Transfer: Against seven common baselines (including EWC, SI, and Replay), SPIRE achieved 2.4 times the mean prior-learning advantage of the strongest task-free alternative.
  • Robust Retention: The system met strict retention criteria in 100% of test runs, successfully recovering the initial Task A behavior after learning multiple intervening tasks.
Quantitative results showing context occupancy, control performance, and the clear advantage of SPIRE in transfer learning.

Limitations and Future Work

While SPIRE excels in these controlled environments, the authors note several areas for expansion:

  • Scaling the Repertoire: The current system was tested with a latent context capacity of six. Future work will explore how context-guided selection scales to hundreds or thousands of learned motor skills.
  • High-Dimensional Sensing: The experiments focused on low-dimensional state vectors (position, velocity). Integrating SPIRE with complex sensory inputs like raw video remains an open challenge.
  • Complex Composition: The current "signature matching" assumes a relatively straightforward dimension-wise mask for combining skills. More complex, non-linear compositions of primitives could unlock even more sophisticated behaviors.

Summary updated

Abstract

Embodied continual learning requires controllers to infer changing situations, retain prior behavior and reuse motor skills without task labels or known boundaries. The challenge is deciding when to recover earlier behavior and which skills can support new learning. We introduce Situation-guided Primitive Integration for Recurrent Embodiment (SPIRE), a recurrent-spiking system that infers latent contexts from action-outcome evidence and learns context-specific motor actors online. Mature actors become protected sources that combine with a target-context residual to drive recurrent-spiking motor populations. Across coordinate, three-joint and hidden-force control, SPIRE maintained control, autonomously inferred situations, retained prior behavior and accelerated acquisition of an unseen source composition, reducing mean interactions to criterion by approximately 40% relative to matched fresh controllers. Rewinding compatible source actors impaired early acquisition in every matched intervention, demonstrating causal reuse. Against seven recurrent continual-learning and modular-control comparators, SPIRE achieved 2.4 times the mean prior-learning advantage of the strongest eligible task-free alternative selected for each paired stream. These results demonstrate autonomous recovery and causal reuse of motor skills for new learning in continuous embodied control.
BibTeX
@misc{jia2026spire,
  author = {Yiyang Jia and Mingyang Lyu and Gongce Cao and Feifei Zhao and Yinqian Sun and Yi Zeng},
  title = {{SPIRE: Task-agnostic embodied continual learning through autonomous situation inference and causal motor-primitive reuse}},
  year = {2026},
  eprint = {2611.14840},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.14840},
}
Figure