Abstract
Bipedal locomotion remains a significant challenge in robotics due to the discrepancies between idealized analytical models and real-world physical dynamics. This paper proposes a pragmatic "human-in-the-loop" approach to stabilize the Aldebaran Nao robot's walk. The method involves two phases: recording a successful open-loop walk cycle and subsequently learning a closed-loop stabilization policy through real-time human corrective feedback provided via a Nintendo Wiimote. By mapping human intuition to onboard accelerometer data, the robot achieves a walking distance of 956 cm, significantly outperforming both open-loop playback (327 cm) and expert hand-tuned controllers (689 cm).
Introduction
Maintaining stability in bipedal robots is a high-dimensional control problem. While analytical models provide a mathematical foundation for movement, they often fail in practice due to unmodeled factors such as gear friction, sensor noise, and the complex dynamics of the robot's own mass distribution. The Aldebaran Nao robot, used in this study, features a heavy torso and lacks certain degrees of freedom (like hip yaw joints), making manual controller tuning particularly arduous.
The Modeling Gap
The primary obstacle to stable walking is the "reality gap" between commanded joint angles and their actual execution. As shown in Figure 4, there is a distinct lag and deviation between the intended joint command and the actual position reached by the robot's hardware. These small errors accumulate over multiple walk cycles, eventually leading to a loss of balance and a fall.
Methodology
The researchers implemented a two-phase learning framework to bridge this gap:
Phase One: Open-Loop Playback
The process begins by executing a standard analytical walk algorithm. The system records a single, successful "walk cycle" (a sequence of joint commands) from trials where the robot remained upright. This cycle is then played back in an infinite loop. While this provides a baseline movement, it lacks the feedback necessary to recover from perturbations.
Phase Two: Corrective Learning
To introduce closed-loop stability, a human teacher provides real-time corrections.
- Interface: Using a Nintendo Wiimote and Nunchuk, the teacher observes the robot and provides tilt corrections (forward/backward and side-to-side). This wireless interface ensures the teacher does not physically interfere with the robot's dynamics.
- Data Mapping: The robot records these human-initiated corrections alongside its internal accelerometer data at 50Hz.
- Policy Generation: The system fits a normal distribution to the correction data for each sensor state. During autonomous operation, the robot applies the mean correction corresponding to its current accelerometer reading to its joint commands.
To ensure smooth movement, a running mean filter (window size of 5) is applied to the sensor data, and a geometric constraint is used to couple hip and ankle movements ($C_{ankle} = -C_{hip}$), keeping the feet flat during torso stabilization.
Experimental Results
The effectiveness of the learned policy was evaluated over 20 trials, comparing it against open-loop playback and a manually tuned closed-loop controller.
| Method | Maximum Distance Traveled (cm) |
|---|---|
| Open-loop Playback | 327 |
| Hand-tuned Closed-loop | 689 |
| Learned Closed-loop (Proposed) | 956 |
The results indicate that the learned policy not only provides superior stability compared to the baseline but also outperforms expert-level manual tuning. This suggests that human intuition can effectively capture and compensate for complex physical nuances that are difficult to model analytically.
Conclusion
This research demonstrates that human corrective demonstration is a powerful tool for robot learning in high-dimensional spaces. By leveraging a simple wireless interface and mapping human reactions to onboard sensors, the Nao robot achieved a significantly more robust walk. Future work will explore extending this framework to multi-directional walking and more complex "Advice Operators" for multi-joint coordination.
Summary updated