A computational model of infant sensorimotor exploration in the mobile paradigm

Josua Spisak, Sergiu T. Popescu, Stefan Wermter, Matej Hoffmann, J. Kevin Ο’Regan

TL;DR

This paper presents a computational model that replicates infant behavior in the "mobile paradigm," demonstrating how infants learn sensorimotor contingencies. The model highlights the crucial roles of action-outcome prediction, exploration, and biologically inspired motor control in this learning process, offering insights into early cognitive development.

What Problem Does This Paper Address?

Developing infants must learn how their actions affect their environment to understand their bodies and gain control. A key aspect of this is learning "sensorimotor contingencies" – the predictable sensory consequences of their movements. The "mobile paradigm" is a classic experimental setup used to study this: a mobile hangs above an infant's crib and is connected to one of their limbs. Infants learn to preferentially move the connected limb because its movements reliably cause the mobile to move. While this phenomenon has been observed for decades, there's a need for computational models that can explain the underlying mechanisms. Previous models have either been too simplistic or relied on computationally impractical mechanisms. This paper aims to bridge this gap by proposing a detailed computational model that replicates key infant behaviors in this paradigm, including limb preference, sensitivity to contingency, and even the debated "extinction burst."

Methods

The authors developed a computational model incorporating several key components:

  • Neural Network: A core component that takes the system's previous state (limb activities and sensory feedback) as input and outputs new limb activities and a prediction of the sensory feedback.
  • Action-Outcome Prediction: The model actively predicts the sensory consequences of its actions. When predictions are wrong, it generates "surprise," which drives learning.
  • Exploration Mechanism: This module uses the prediction error (surprise) to update an "activity interest map." It encourages the model to explore actions that lead to surprising outcomes, thus promoting learning.
  • Biologically Inspired Motor Control: Instead of simple joint control, the model uses a population code of 600 "muscle commands" that can influence multiple limbs, mimicking the complexity of human motor control. This allows for more nuanced limb movements and interactions.
  • Motor Noise: Random variability is introduced into limb movements to simulate the natural imprecision of infant motor control and to facilitate exploration.
  • Deviation from Baseline Module: This component ensures that limb activities stay within a reasonable range, reflecting an infant's tendency to maintain a baseline level of activity.

The model's learning is driven by minimizing three "losses": the difference between predicted and actual sensory feedback, the difference between current and desired limb activity, and the difference between current and baseline limb activity.

Datasets

The model was trained and evaluated using data from two existing empirical studies on infant sensorimotor contingency detection:

  • Popescu et al. [12] (Binary condition)
  • Jacquey et al. [11] (Non-binary/conjugate condition)

The authors performed 20 simulation runs for each condition to match the number of participants in these studies. No new datasets were introduced.

Key Insights and Ideas

  • Prediction is Key: The model's ability to predict sensory outcomes is crucial. Without this "prediction error" loss, the model fails to differentiate between the connected and unconnected limbs, highlighting the importance of predictive mechanisms in infant learning.
  • Exploration Drives Learning: The "novelty-based reinforcement calculator" is essential. By actively seeking surprising outcomes, the model is guided to discover which limb is connected and how to control it.
  • Motor Complexity Matters: A large number of "muscle command neurons" (simulating complex motor control) is necessary for the model to accurately replicate infant behavior, especially in the non-binary condition. This suggests that the fine-grained control and potential for varied movements are important for learning.
  • Motor Noise is a Double-Edged Sword: While essential for exploration and learning, too much or too little motor noise significantly hinders the model's ability to learn. An intermediate level is optimal.
  • Extinction Burst is Conditional: The model, like infants, doesn't always exhibit an "extinction burst" (a temporary increase in activity after contingency removal). It appears more likely in the non-binary condition, suggesting that the nature of the contingency influences this phenomenon.

Key Results

  • The model successfully replicates the classic finding of preferential movement of the connected limb in both binary and non-binary conditions, mirroring infant behavior.
  • It accurately simulates the higher limb activity observed in contingent groups compared to non-contingent control groups, demonstrating sensitivity to the contingency itself.
  • The model shows a slightly more robust differentiation of the connected limb in the binary condition compared to the non-binary (conjugate) condition, aligning with empirical observations.
  • Ablation studies revealed that action-outcome prediction, exploration, a large number of muscle command neurons, and an intermediate level of motor noise are all essential components for the model to accurately simulate infant behavior.
  • The model sometimes exhibits an extinction burst after contingency removal, particularly in the non-binary condition, which is consistent with debated findings in infant research.

Limitations and Future Work

  • Variability: The model exhibits less variability across individual simulation runs compared to the observed variability in infant data. The authors suggest that adjusting the novelty threshold might increase variability.
  • Attentional, Social, and Environmental Factors: The current model excludes these factors, which are known to influence infant behavior. Future work could incorporate these to better capture real-world infant complexity.
  • Concurrent Learning and Task Switching: The model is designed for a single task. Implementing mechanisms for concurrent learning and task switching would make it more realistic.
  • Generalizability: The model was tested on only one type of sensorimotor contingency. Future work should explore its ability to learn a wider variety of contingencies and transfer learning to new situations.
  • Habituation and Boredom: The model does not account for factors like habituation or boredom, which could influence infant exploration and activity levels.

Summary updated

Abstract

We present a computational model of the mechanisms that may determine infant behavior in the “mobile paradigm”. This paradigm has been used in developmental psychology to explore how infants learn the sensory effects of their actions. In this paradigm, a mobile (an articulated and movable object hanging above an infant’s crib) is connected to one of the infant’s limbs, prompting the infant to preferentially move that “connected” limb. This ability to detect a “sensorimotor contingency” is considered to be a oundational cognitive ability in development. To understand how infants learn sensorimotor contingencies, we built a model that attempts to replicate infant behavior. Our model incorporates a neural network, action-outcome prediction, exploration, motor noise, preferred activity level, and biologically inspired motor control. We find that simulations with our model replicate the classic findings in the literature showing preferential movement of the connected limb. An interesting observation is that the model sometimes exhibits a burst of movement after the mobile is disconnected, shedding light on a similar occasional finding in infants. In addition to these general findings, the simulations also replicate data from two recent more detailed studies using a connection with the mobile that was either gradual or all-or-none. A series of ablation studies further shows that the inclusion of mechanisms of action-outcome prediction, exploration, motor noise, and biologically inspired motor control was essential for the model to correctly replicate infant behavior. This suggests that these components are also involved in infant sensorimotor learning.<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup>
BibTeX
@article{spisak2025computational,
  author = {Josua Spisak and Sergiu T. Popescu and Stefan Wermter and Matej Hoffmann and J. Kevin Ο’Regan},
  title = {{A computational model of infant sensorimotor exploration in the mobile paradigm}},
  journal = {IEEE Transactions on Cognitive and Developmental Systems},
  year = {2025},
  doi = {10.1109/tcds.2025.3635281},
}
Figure