AHEADance: Anticipatory Humanoid Dance from Streaming Audio

Tianhu Peng, Yukun Wang, Lingfan Bao, Yiyang Jia, Chengxu ZhouarXiv 2026 · arXiv

TL;DR

AHEADance is a "robot-native" streaming dance generator that allows humanoid robots to dance to live audio by forecasting upcoming musical beats. By combining short-term music prediction with a novel "Commit Forcing" training strategy, the system achieves superior synchronization and sustained movement compared to existing offline and online models.

What Problem Does This Paper Address?

Most AI-driven dance generation models are "offline"—they require the entire music track in advance to choreograph a sequence. However, for a humanoid robot to dance to a live stream or a DJ set, it must operate under two brutal constraints:

  1. Causality: The robot only hears music up to the current moment, but due to mechanical and processing latency, it must commit to a "motion chunk" before the accompanying music has even played.
  2. Irrevocability: Unlike an animation on a screen, a physical robot cannot "revise" a previous frame. Every new move must start exactly where the last committed move ended, even if that previous move was slightly off-target.

Without addressing these, streaming robots often fall out of sync or suffer from "motion decay," where the model becomes increasingly uncertain and eventually freezes in place.

Methods

The authors introduce AHEADance, which generates motion chunk-by-chunk (0.533s per chunk) and executes it via a whole-body tracking controller (SONIC). The architecture relies on two primary innovations:

  • ListenAhead: To overcome the delay between hearing music and moving, the system uses a frozen music model (MRT-2) to forecast the next ~0.5s of audio features. These forecasts are weighted by an "adaptive reliability" metric—if the music is predictable (like a steady beat), the model relies heavily on the forecast; if the music is chaotic, it down-weights it.
  • Commit Forcing: This is a training regime designed for stable continuation. During training, the model doesn't just look at "clean" ground-truth history. Instead, it reconstructs a sequence of its own noisy, committed chunks. This teaches the generator how to recover from its own previous "mistakes" and maintain momentum.

The motion itself is represented by a Commit-Aligned Motion Codec, a hybrid system that uses discrete tokens for broad motion prototypes and continuous residuals for fine-grained detail (D+C).

Overview of the AHEADance inference and training pipelines.

Datasets

The model was trained on a massive 61.7-hour collection of dance motion retargeted to the Unitree G1 humanoid. This "OMG-Data" release includes:

  • AIOZ-GDANCE (The bulk of the data)
  • FineDance
  • AIST++
  • CoMPAS3D, ChoreoMaster, and OpenDance

Evaluation was performed on 42 "unseen" songs—audio that appeared in none of the training sets for the generator or the evaluators.

Key Insights and Ideas

  • The Future is Predictable (Enough): The authors found that music forecasts carry the timing of upcoming beats almost as well as the actual future audio. By "listening ahead," the robot can hit accents exactly on time rather than reacting late to a beat it just heard.
  • The "Frozen Robot" Problem: Standard autoregressive models often "die out" when they encounter their own generated outputs at inference time, leading to a robot that barely moves. Commit Forcing solved this, reducing "low activity" frames from a staggering 83.5% down to 10.3%—matching the activity levels of real human dancers.
  • Decoupling Trajectory and Body: By separating the root trajectory (where the robot goes) from the body pose (how it dances), the model can adapt a dance style to different spatial paths without losing the "soul" of the movement.

Key Results

AHEADance was tested against several state-of-the-art baselines (like EDGE and Bailando++) in both offline and "strict online" modes.

  • Synchronization: On unseen songs, AHEADance achieved a 28.6% offset accuracy (measured by ChoreoSync), significantly higher than the next best online baseline (11.9%).
  • Song Matching: Using a music-motion retrieval metric (MMR), AHEADance scored 0.187, vastly outperforming baselines which struggled to stay above 0.05.
  • Physical Deployment: On a physical Unitree G1, the robot successfully danced to seven different styles. Crucially, it automatically came to a graceful rest when the music stopped and resumed dancing when it started again, without ever falling.
The physical Unitree G1 robot dancing across various styles and responding to silence.

Limitations and Future Work

  • Kinetic Diversity: While the robot is stable and in sync, its "vocabulary" of moves is still less diverse than a real human dancer.
  • Reaction Latency: While the robot anticipates beats well, it still takes about 1 second to react to an unpredictable event, such as a sudden, abrupt stop in the music.
  • Off-board Computation: Currently, the heavy lifting (the diffusion generator and music model) runs on an external workstation. Porting this to run entirely on the robot's onboard hardware is a key next step.
  • Closing the Loop: The generator currently doesn't "feel" the robot's actual measured state; it assumes the tracker is following perfectly. Integrating the robot's actual physical feedback into the motion generation could improve balance and flair.

For more details, videos, and code, visit the project page.

Summary updated

Abstract

A humanoid that dances to streamed music must commit each motion chunk before it has heard the music that chunk accompanies, and must continue from motion it has already committed. We present AHEADance, a robot-native streaming dance generator executed on a humanoid robot by a whole-body tracker. ListenAhead conditions each chunk on heard music and a frozen music model's forecasts of the coming music, aligned to their target times and weighted by reliability. The forecasts carry the timing of upcoming beats almost as well as the actual future; with them, the generator is better synchronized with the music and concentrates more motion energy at its song's beat frequency. Commit Forcing trains continuation from the model's own committed chunks, updating both the latent history and the decoded boundary of the next chunk; it reduces low activity from 83.5% to 10.3%, the level of real dance. Three music evaluators, each validated on real G1 dance, test synchronization, song and style. On a physical Unitree G1, it dances while the music plays and comes to rest when it stops, without a fall. Project page: https://ihcr.github.io/AHEADance
BibTeX
@misc{peng2026aheadance,
  author = {Tianhu Peng and Yukun Wang and Lingfan Bao and Yiyang Jia and Chengxu Zhou},
  title = {{AHEADance: Anticipatory Humanoid Dance from Streaming Audio}},
  year = {2026},
  eprint = {2611.13370},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.13370},
}
Figure