ARFlow: Human Action-Reaction Flow Matching with Physical Guidance

Wentao Jiang, Jingya Wang, Haotao Lu, Kaiyang Ji, Baoxiong Jia, Siyuan Huang, Ye ShiarXiv 2025 · DOI · arXiv

Abstract

Generating realistic human reactions to actions is a fundamental challenge in computer vision and robotics. Traditional diffusion-based models often struggle with computational complexity and physical violations such as body inter-penetration. We present ARFlow, a novel framework that utilizes Flow Matching (FM) to establish direct probability paths between action and reaction distributions. By predicting the clean target pose ($x_1$) directly and incorporating a specialized physical guidance mechanism with reprojection, ARFlow achieves state-of-the-art performance in generating diverse, physically plausible reactions with significantly reduced artifacts.

Introduction

Synthesizing a realistic human reaction to an action—such as flinching from a kick or reaching for a handshake—is a complex task characterized by causality and asymmetry. The reactor must respond dynamically without prior knowledge of the actor's future movements.

Conceptual comparison of ARFlow vs. Diffusion models.

While current state-of-the-art methods rely on diffusion models, these approaches face two primary hurdles: high computational complexity due to intricate noise-to-data mapping and frequent physical violations, where character meshes unrealistically pass through one another (inter-penetration). ARFlow addresses these issues by replacing the noise-based diffusion process with a direct probability flow between action and reaction distributions.

Methodology

ARFlow is the first Flow Matching architecture specifically designed for action-reaction synthesis. It simplifies the training objective and accelerates inference by creating a linear probability path between the distributions of actions and reactions.

Action-to-Reaction Flow and $x_1$-Prediction

Unlike standard FM that predicts a velocity vector field, ARFlow is designed to directly predict the "clean" target pose ($x_1$). This architectural choice allows the model to apply geometric and physical losses directly to human body parameters during training, ensuring that the generated motions remain within a physically plausible manifold.

The ARFlow architecture, showing (a) training and (b) sampling with physical constraint guidance.

Physical Guidance with Reprojection

To mitigate body "clipping," ARFlow utilizes a Signed Distance Function (SDF) to calculate a penetration loss ($\mathcal{L}_{pene}$). The gradient of this loss is applied during sampling. To prevent traditional guidance from pulling the model off its intended path, the authors introduced a reprojection method that nudges the sampling direction back toward a physically plausible manifold. Diversity is maintained through controlled stochastic sampling, preventing the model from collapsing into a single "average" reaction.

Experiments and Results

ARFlow was evaluated on three major datasets: NTU120-AS, Chi3D-AS, and InterHuman-AS. To quantify physical realism, the authors introduced two new metrics: Intersection Volume (IV) and Intersection Frequency (IF).

  • Quality & Diversity: ARFlow outperforms existing models like ReGenNet and MDM in Fréchet Inception Distance (FID) and Multi-modality, indicating more realistic and varied motions.
  • Physical Plausibility: On the NTU120 dataset, ARFlow reduced the Intersection Volume (IV) by nearly 90% compared to ReGenNet (from 3.50 to 0.23 in offline settings).
  • Efficiency: The model achieves optimal performance with only 5 Euler sampling steps, making it highly suitable for real-time applications such as VR and character animation.

Conclusion

ARFlow demonstrates that Flow Matching is a natural and efficient fit for paired action-reaction tasks. By guiding the predicted clean pose ($x_1$) rather than noisy intermediate states, the model provides more accurate physical constraints. While highly effective at preventing penetration, future work will focus on achieving precise contact—such as the exact touch required for a handshake—by incorporating more sophisticated physical constraints like friction and joint torque.

Summary updated

Abstract

Human action-reaction synthesis, a fundamental challenge in modeling causal human interactions, plays a critical role in applications ranging from virtual reality to social robotics. While diffusion-based models have demonstrated promising performance, they exhibit two key limitations for interaction synthesis: reliance on complex noise-to-reaction generators with intricate conditional mechanisms, and frequent physical violations in generated motions. To address these issues, we propose Action-Reaction Flow Matching (ARFlow), a novel framework that establishes direct action-to-reaction mappings, eliminating the need for complex conditional mechanisms. Our approach introduces a physical guidance mechanism specifically designed for Flow Matching (FM) that effectively prevents body penetration artifacts during sampling. Moreover, we discover the bias of traditional flow matching sampling algorithm and employ a reprojection method to revise the sampling direction of FM. To further enhance the reaction diversity, we incorporate randomness into the sampling process. Extensive experiments on NTU120, Chi3D and InterHuman datasets demonstrate that ARFlow not only outperforms existing methods in terms of Fréchet Inception Distance and motion diversity but also significantly reduces body collisions, as measured by our new Intersection Volume and Intersection Frequency metrics.
BibTeX
@misc{jiang2025arflow,
  author = {Wentao Jiang and Jingya Wang and Haotao Lu and Kaiyang Ji and Baoxiong Jia and Siyuan Huang and Ye Shi},
  title = {{ARFlow: Human Action-Reaction Flow Matching with Physical Guidance}},
  year = {2025},
  eprint = {2503.16973},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2503.16973},
}
Figure