Evidence of an Emergent "Self" in Continual Robot Learning

Adidev Jhunjhunwala, Judah Goldfeder, Hod LipsonarXiv 2026 · arXiv

TL;DR

When robots are forced to learn multiple distinct behaviors sequentially, their neural networks spontaneously organize into two distinct structures: a highly stable, invariant core that encodes the robot's own body dynamics (a minimal "self"), and plastic, rapidly changing modules for task-specific skills. This emergent subnetwork is functionally critical for cross-behavior adaptation, providing a concrete, quantifiable footprint of machine selfhood without any explicit architectural hardcoding.

What Problem Does This Paper Address?

A long-standing challenge in philosophy and AI is defining and quantifying "self-awareness." In robotics, understanding the "self" usually means learning a body schema—an internal model of kinematic limits, muscle synergies, and motor responses. However, most existing approaches explicitly segregate or hardcode this self-model from the rest of the controller.

The authors tackle a fundamental question: Can a minimal, embodied concept of "self" emerge spontaneously within a standard, monolithic deep learning policy? They hypothesize that the "self" can be isolated by looking for the most persistent, invariant portion of the cognitive process across lifelong experiences. Just as a human separates the knowledge of their own body from the specific rules of swimming or running, a robot undergoing continual learning should naturally isolate task-agnostic body representations from task-specific action rules.

Methods

The researchers trained simulated robots sequentially across multiple distinct behaviors using Soft Actor-Critic (RL), transferring only the policy weights between phases. To discover internal structures, they introduced a post-hoc analysis pipeline:

  1. Co-activation Mapping: They passed the trained networks through a shared set of reference states and computed a neuron-neuron cosine similarity matrix based on activation traces.
  2. Block Diagonalization: They thresholded this matrix ($\tau = 0.70$) to build a sparse similarity graph and applied reverse Cuthill-McKee (RCM) ordering to isolate tightly coupled neuron groups (subnetworks).
  3. Cross-Behavior Alignment: Because hidden units suffer from permutation symmetries, they used the Hungarian algorithm to match "the same" neurons across different behavior networks.
  4. Persistence Scoring: They quantified how much a neuron's activation and connectivity structure changed across behavior switches.
  5. Intervention Analysis: To prove functional importance, they compared the effects of freezing or lesioning (reinitializing) the emergent "self" subnetwork versus task-specific subnetworks during transfer to new tasks.
Figure 1: Continual learning produces a stable self-like core. Compared to a single-task baseline, multi-behavior training yields a subnetwork that remains stable across behaviors (“persistent self”), while other components vary. Representative results from the first hidden layer of each network shown.

Datasets

The authors validated their approach across three distinct robotic morphologies and control domains:

  • IsaacLab Quadruped (Ant-like): An 8-degree-of-freedom robot trained on a cyclical curriculum of walk, wiggle (in-place rotation), and bob (vertical hopping).
  • Hexapod: A wider 18-degree-of-freedom morphology trained on the same walk-wiggle-bob curriculum to ensure the findings weren't specific to a single body plan.
  • Continual World / Meta-World Manipulation Benchmark: A robotic arm trained sequentially across four distinct task families spanning tool use, pushing, pressing, sliding, closing, and alignment-sensitive extraction.

Key Insights and Ideas

  • Spontaneous Modularity: Continual multi-behavior learning naturally drives the network to split into a stable core and plastic task modules. No explicit architectural constraints, modular networks, or self-modeling components are required.
  • The "Everything Brain" Control: Robots trained on a single constant task (e.g., walk-only) do not develop a clean, trackable self-subnetwork. Instead, their internal representations remain diffuse and entangled—a monolithic structure the authors term the "everything brain."
Alluvial flow visualization showing a fragmented network structure in the constant task (left) versus a dominant, continuous "persistent self" band under continual learning (right).
  • Hierarchical Layering of Self: The emergent self-like subnetwork is most clearly expressed in the earlier hidden layers of the network. Earlier layers develop a much larger stable core, while later layers retain a smaller core alongside highly behavior-dependent structures.

Key Results

  • Significant Stability Gap: In the continual learning regime, the self-subnetwork exhibited a mean separation of 16.9 percentage points in persistence score compared to the pooled task subnetworks ($p \ll 0.001$).
  • Functional Importance via Intervention: Freezing the self-subnetwork during transfer to a new behavior led to significantly better adaptation performance than freezing an equally sized task subnetwork (median advantage of 1.6% of the evaluation window, with 92.7% bootstrap support).
  • Lesion Vulnerability: Conversely, lesioning (disrupting) the self-subnetwork caused a substantially larger drop in performance than lesioning the task subnetwork, proving that this stable core is not merely an artifact of optimization but functionally vital.
Quantitative evidence showing clear subnetwork boundaries and higher per-neuron persistence scores in continual learning compared to the constant task baseline.

Limitations and Future Work

The authors emphasize a modest definition of "selfhood": they do not claim evidence of human-like consciousness or self-reflective awareness, but rather a minimal embodied self grounded in continuity through change.

Key limitations and future directions include:

  • Behavior Breadth: The locomotion behavior set (walk, wiggle, bob) is compact. Future work should explore how the self-subnetwork scales as the behavior suite expands.
  • Methodological Enhancements: While co-activation grouping provides a transparent handle on modularity, it doesn't capture every functional nuance. The authors suggest integrating causal interventions, sparsity-based decompositions, and targeted ablations in future iterations.
  • Practical Exploitation: A highly promising next step is explicitly exploiting this emergent structure—using the stable subnetwork as a fixed backbone to drastically improve transfer efficiency or to provide robustness against physical perturbations like joint damage or morphological changes.

Summary updated

Abstract

A key challenge to understanding self-awareness has been a principled way of quantifying whether an intelligent system has a concept of a "self", and if so how to differentiate the "self" from other cognitive structures. We propose that the "self" can be isolated by seeking the invariant portion of cognitive process that changes relatively little compared to more rapidly acquired cognitive skills - because our self is the most persistent aspect of our experiences. We used this principle to analyze the cognitive structure of robots under two conditions: One robot learns a constant task, while a second undergoes continual learning under variable tasks. We find that robots subjected to continual learning develop an invariant subnetwork that is significantly more stable (p < 0.001) compared to the control, and that this subnetwork is also functionally important: preserving it aids adaptation while damaging it impairs performance. We validate this pattern across three different robots spanning locomotion and manipulation.
BibTeX
@misc{jhunjhunwala2026evidence,
  author = {Adidev Jhunjhunwala and Judah Goldfeder and Hod Lipson},
  title = {{Evidence of an Emergent "Self" in Continual Robot Learning}},
  year = {2026},
  eprint = {2603.24350},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2603.24350},
}
Figure