Video-Action Models for Data-Efficient Industrial Manipulation

Eugenio Chisari, Stefanos Charalambous, Oliver Sanchez, Thomas Umbach, Michael Gentner, Fabio Quattrini, Norica Bacuieti, Sabin Grube Doiz, Valentin Bertle, Sigmund Hennum Hoeg, Alain Ryser, German Rodriguez, Mario Arduini, Dang Nguyen, Florian Aumann, Felix Hegg, Manuel Meier, Philipp Wand, Julian Lotzer, Alessio Desogus, Benedek Forrai, Michael Bloesch, Stephan-Daniel Gravert, Stefan Weirich, Patrick Lanners, Elvis NavaarXiv 2026 · arXiv

TL;DR

Researchers from Mimic Robotics and BMW Group have introduced FLUX-mimic, a video-action model (VAM) designed to tackle the "long tail" of industrial manipulation tasks. By combining a large-scale pretrained video backbone with joint video-action training, the model achieves high success rates on complex automotive tasks—like routing flexible cables and kitting deformable foams—using significantly less labeled robot data than traditional baselines.

What Problem Does This Paper Address?

While generalist robot models (Vision-Language-Action models or VLAs) have shown impressive results in household environments, the factory floor is a different beast. Industrial manipulation requires extreme precision, handling of deformable objects (like rubber gaskets or wire harnesses), and operating within tight geometric constraints.

The primary hurdle is the data bottleneck. Collecting thousands of labeled robot demonstrations for every specific industrial task is prohibitively expensive. Existing generalist models, often trained on datasets like Open X-Embodiment, lack the "physical reasoning" required for industrial settings. The authors ask: Can we leverage the rich physical priors found in video data to make robot learning more sample-efficient?

Methods

The authors propose FLUX-mimic, which moves beyond standard VLAs by incorporating a generative video component.

  1. The Backbone: They initialize the model with FLUX 3, a multimodal foundation model pretrained on millions of hours of web video and audio. Crucially, they further pretrain this backbone on a custom industrial dataset.
  2. Architecture: As shown in Figure 3, the model consists of the FLUX video backbone and a compact Action Expert. The Action Expert attends to the intermediate features of the video backbone, effectively "reading" the model's internal representation of how the scene is expected to evolve.
  3. Joint Training: The model is trained using Flow Matching, a generative objective. During training, it simultaneously learns to predict the next video frames and the corresponding robot actions.
  4. Efficient Inference: Unlike some video-based models that require generating a full video rollout to decide on an action, FLUX-mimic only needs a single denoising step from the backbone to provide the features the Action Expert needs to predict a chunk of actions.
The FLUX-mimic architecture, showing how the Action Expert leverages features from the video backbone.

Datasets

The researchers collected a substantial new industrial dataset to bridge the gap between household tasks and manufacturing:

  • Scale: 31 distinct tasks, totaling 295.8 hours of data.
  • Diversity: It includes 20 tasks collected via robot teleoperation and 11 tasks recorded using wearable cameras on human operators. This human data provides visual examples of task execution without needing robot action labels.
  • Benchmarks: Evaluation focused on four automotive tasks: Control unit assembly, fixture insertion, soft part kitting, and wire harness routing.
Breakdown of the industrial data collection across benchmark and pretraining tasks.

Key Insights and Ideas

  • Video as a Physical Prior: The core "aha moment" is that a model trained to predict video inherently learns about geometry, contact, and object dynamics. By conditioning actions on these predictive features, the robot gains a better "understanding" of the physics involved in the task.
  • The Power of Joint Supervision: The authors found that keeping the video prediction objective active during policy training is vital. An ablation study showed that removing the video loss dropped success rates from 100% to 65% on a kitting task.
  • Embodiment Matters: The model was tested on two very different platforms: Franka arms with dexterous hands and Trossen arms with parallel-jaw grippers. FLUX-mimic excelled particularly on the dexterous Franka platform, where the complex hand-object interactions benefit most from strong visual-physical priors.

Key Results

FLUX-mimic demonstrated remarkable sample efficiency and performance:

  • Superiority on Dexterous Tasks: On the Franka platform, FLUX-mimic achieved an average success rate of 82.8%, dwarfing the VLA baseline ($\pi_{0.5}$) at 27.6% and a single-task flow-matching baseline at 52.6%.
  • Doing More with Less: In the soft part kitting experiment (Figure 5), FLUX-mimic reached 95% success with just 8 hours of data. To reach a similar level of performance, the baselines required the full 32-hour dataset. Even with just one hour of data, FLUX-mimic achieved a 45% success rate, while baselines struggled below 10%.
Sample efficiency results on the soft part kitting task, showing FLUX-mimic outperforming baselines at all data budgets.

Limitations and Future Work

While FLUX-mimic shows a clear path toward data-efficient industrial automation, some challenges remain:

  • Platform Alignment: While FLUX-mimic dominated on the dexterous platform, it only matched the $\pi_{0.5}$ baseline on the simpler gripper-based Trossen setup. This suggests that the baseline's pretraining (which focused on parallel grippers) provided a strong enough prior for simpler embodiments.
  • Long-Horizon Tasks: The current benchmark tasks, while complex, are relatively short. Scaling this approach to multi-stage assembly processes that last several minutes remains an open challenge.
  • Real-Time Constraints: Although the model avoids full video sampling at inference, the computational cost of large transformer backbones is always a consideration for high-frequency industrial control.

Summary updated

Abstract

Industrial manipulation requires precise alignment and controlled handling of rigid, deformable, and flexible components. Yet, the benefits of pretrained visuomotor policies remain underexplored in settings where limited access to specialized hardware, components, and fixtures constrains demonstration collection and evaluation. Understanding task-specific data requirements is important for assessing their scalability across diverse processes on the factory floor. We investigate whether video pretraining can support reliable industrial manipulation with limited action data. We propose FLUX-mimic, a video-action model, motivated by the potential of video pretraining to capture motion and interaction patterns that enable sample-efficient training. FLUX-mimic is built on a backbone pretrained on large-scale web and industrial task data, and an action expert to generate robot trajectories. We train our policy by joint video-action training. Across four automotive manufacturing benchmark tasks and two bimanual robot platforms, FLUX-mimic outperforms all considered baselines on the dexterous robot platform and matches pi_{0.5}'s average success rate on the gripper-based robot platform. On a deformable part kitting task, FLUX-mimic reaches 77.5% success with as little as two hours of task-specific action-labeled demonstrations.
BibTeX
@misc{chisari2026video,
  author = {Eugenio Chisari and Stefanos Charalambous and Oliver Sanchez and Thomas Umbach and Michael Gentner and Fabio Quattrini and Norica Bacuieti and Sabin Grube Doiz and Valentin Bertle and Sigmund Hennum Hoeg and Alain Ryser and German Rodriguez and Mario Arduini and Dang Nguyen and Florian Aumann and Felix Hegg and Manuel Meier and Philipp Wand and Julian Lotzer and Alessio Desogus and Benedek Forrai and Michael Bloesch and Stephan-Daniel Gravert and Stefan Weirich and Patrick Lanners and Elvis Nava},
  title = {{Video-Action Models for Data-Efficient Industrial Manipulation}},
  year = {2026},
  eprint = {2611.15974},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.15974},
}
Figure