Unsupervised Multiple Proactive Behavior Learning of Mobile Robots for Smooth and Safe Navigation

Arthicha Srisuchinnawong, Jonas Bæch, Marek Piotr Hyzy, Tsampikos Kounalakis, Evangelos Boukas, Poramate ManoonpongIROS 2024 · DOI

Introduction

Standard autonomous navigation systems typically rely on local motion planners, such as Dynamic Window Approach (DWA) or Model Predictive Control (MPC). While effective for pathfinding, these planners face significant hurdles in real-world deployment: high computational requirements leading to low update frequencies (1–10 Hz), reliance on simplified kinematic models that mismatch physical reality, and a dependency on massive amounts of labeled data or complex reward functions.

To address these challenges, researchers have developed Multiple Proactive Behavior Learning (MPL), a "plug-and-play" neural control module. This system allows mobile robots to autonomously learn smooth and safe navigation through unsupervised correlation-based learning, bridging the gap between slow model-based planning and high-frequency sensory feedback.

Methodology: The MPL Architecture

The core innovation of this work is the MPL module, a model-free neural control architecture designed to augment existing local planners. The system operates as a high-speed "reflex" layer that anticipates the planner's intent.

The system architecture integrates the high-latency Local Motion Planner with the low-latency, high-frequency MPL module to generate final robot commands.

Unsupervised Correlation-Based Learning

Instead of traditional reinforcement learning, the MPL utilizes a biologically inspired differential Hebbian learning rule. The module consists of 14 neural sub-modules, each monitoring a 20° slice of the environment via Lidar. It learns by observing correlations between sensory inputs (detecting an obstacle) and the local planner’s subsequent commands (e.g., slowing down or turning).

By treating the planner as a "teacher," the MPL learns to associate specific Lidar patterns with the planner's avoidance maneuvers. This allows the MPL to execute proactive adjustments at 30–50 Hz, significantly faster than the 5 Hz update rate of the primary planner. This dual-rate execution enables the robot to react to dynamic obstacles long before the main planner can recompute a path.

Experimental Setup and Hardware

The system was validated using the Capra Hircus Robot, a unique four-wheeled platform featuring passive joints and a complex kinematic profile. Testing encompassed three primary scenarios:

  1. Static Narrow Corridor: A 1.0m wide path obstructed by four stationary individuals.
  2. Dynamic Free Space: A 10x10m area with 16 people walking at random speeds to simulate a crowded environment.
  3. Physical Validation: Real-world trials to ensure that the unsupervised learning successfully transferred from simulation to physical hardware.

Key Results and Insights

The integration of the MPL module yielded substantial improvements in both safety and efficiency. In narrow static environments, the robot saw a 10% improvement in motion smoothness (measured by RMS jerk) and a 30% reduction in collisions.

Experimental results demonstrate the MPL module providing proactive obstacle avoidance (orange) ahead of the standard planner's commands (grey) as an obstacle is detected.

In highly dynamic, crowded environments, the impact was even more pronounced, with a 70% reduction in collisions. Notably, the neural weights in the MPL module stabilized within just 1 to 2 minutes of operation. This rapid convergence proves that the system is viable for real-time, online learning in entirely new environments without prior training.

Conclusion and Future Work

The MPL module demonstrates that "data-frugal" unsupervised learning can effectively solve the latency and model-mismatch issues inherent in traditional robotics planning. By acting as a learned reflex, it allows heavy-duty planners to focus on long-term goals while the MPL handles high-frequency safety adjustments.

Future research aims to expand the MPL's sensory scope beyond Lidar to include vision and internal states (such as motor torque). This would allow the system to learn more complex behaviors, such as energy-efficient maneuvering and smoother acceleration profiles in varied terrain.

Summary updated

BibTeX
@inproceedings{srisuchinnawong2024unsupervised,
  author = {Arthicha Srisuchinnawong and Jonas Bæch and Marek Piotr Hyzy and Tsampikos Kounalakis and Evangelos Boukas and Poramate Manoonpong},
  title = {{Unsupervised Multiple Proactive Behavior Learning of Mobile Robots for Smooth and Safe Navigation}},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems},
  year = {2024},
  doi = {10.1109/iros58592.2024.10802071},
}
Figure