CUA-Lite: An Open Platform for Computer Use Agents

Zhanhui Zhou, Weichen Zhang, Haoran Liu, Lingjie Chen, Tianneng Shi, Kevin Lin, Zhengyuan Yang, Lijuan Wang, Dawn SongarXiv 2026 · arXiv

Computer Use Agents (CUAs)—AI models that can navigate desktops, browsers, and mobile apps—are one of the most exciting frontiers in automation. However, the field currently suffers from a "fragmentation tax." Every new environment, dataset, or model comes with its own custom code, making it incredibly difficult to scale training or compare results across different platforms.

CUA-Lite is a new open platform designed to solve this by providing a unified infrastructure for developing, evaluating, and training CUAs. By standardizing the "plumbing" of agent development, the authors have created a playground where researchers can easily move between desktop, web, and mobile tasks using a single, consistent interface.

Figure 1: CUA-Lite overview. One environment interface, Lite.Gym, serves every integrated environment, regardless of its runtime. One supervised data format, Lite.Sample, stores all supervised data, converted from public datasets or recorded through rollouts. One harness per model connects it to both, so evaluation, RL, and SFT share the same code (§2.3).

TL;DR

CUA-Lite standardizes the development of computer use agents by providing a unified environment interface, a common data format, and shared model harnesses. It introduces lightweight, VM-free Docker sandboxes that are 6x more memory-efficient than traditional virtual machines while maintaining high evaluation fidelity.

What Problem Does This Paper Address?

Developing CUAs is currently a mess of incompatible resources. If you want to train an agent on a desktop benchmark (like OSWorld) and then test it on a mobile one (like AndroidWorld), you typically have to rewrite the action mapping, context management, and rollout loops from scratch.

Furthermore, the infrastructure for Supervised Fine-Tuning (SFT), Reinforcement Learning (RL), and evaluation is often siloed. This fragmentation prevents researchers from easily scaling their models across different platforms and makes it nearly impossible to share training pipelines. Finally, existing desktop environments often rely on heavy Virtual Machines (VMs) that are slow to boot and expensive to run in the cloud.

Methods

The authors introduce three core abstractions to unify the field:

  1. Lite.Gym: A unified environment interface that wraps 12 different benchmarks into a standard Gym-style reset/step loop. It standardizes GUI actions (like click, type, and swipe) and observations (screenshots and text) across all platforms.
  2. VM-Free Sandboxes (Lite.*): To replace heavy VMs, the team reverse-engineered the OSWorld environment into lightweight Docker containers. These "sandboxes" share the host kernel, drastically reducing the resource overhead.
  3. Model Harnesses: A standardized "scaffolding" for each model family (supporting 14 families including GPT-4/5, Claude, and Qwen). The harness handles the translation between the model's raw output and the standardized Lite.Gym actions, allowing the same code to be used for evaluation, SFT, and RL.

Datasets

CUA-Lite integrates a massive amount of data into its unified Lite.Sample format:

  • 12 Benchmarks: Including OSWorld, WebVoyager, AndroidWorld, and Mind2Web.
  • 1.26 Million Converted Samples: Sourced from 9 major public CUA datasets.
  • 82,000 Fresh Rollouts: Recorded from frontier models like GPT-5.5 and Qwen on verifiable training tasks.
  • 30,000+ Verifiable Tasks: Specifically designed for training, including synthesized and perturbed tasks to prevent overfitting.
Figure 4: The stored Lite.Samples. Left: the 9 converted datasets, by platform (inner ring) and by task type within each platform (outer ring). Right: GPT-5.5’s rollouts with verified reward on our training environments, by platform; Appendix E.3 adds those of Qwen3.5-27B and Qwen3.8-27B.

Key Insights and Ideas

  • Docker is Enough: One of the most practical findings is that you don't need a full VM for high-fidelity desktop agent research. The Docker-based Lite.OSWorld achieved a 0.98 Spearman correlation with the original VM-based benchmark while using only 1/6th of the memory.
  • The "Thinking" Boost: For top-tier models like GPT-5.5, enabling reasoning (Chain-of-Thought) leads to significantly higher success rates. Interestingly, these models also produce longer rollouts as they "verify" their work before finishing.
  • Unified Training Works: The authors demonstrated a "recipe" for improving open-weight models: first SFT a small model (Qwen3.5-4B) on high-quality rollouts from a "teacher" model (GPT-5.5), then further refine it using RL (specifically the GRPO algorithm) on verifiable tasks.
Figure 3: Lite.OSWorld against OSWorld. Left: cost of one instance, median over 20 cold starts with both runtimes allocated 4 GB and 4 cores; memory (resident usage within that allocation) and CPU are cgroup counters over a 300 s window with no action sent (Appendix D). Right: evaluation scores (%) of 13 models. The dashed line marks equal scores. See Table D.1 for per-model scores.

Key Results

  • Performance Gains: SFTing the Qwen3.5-4B model on GPT-5.5 rollouts improved its desktop success rate from 22.6% to 44.8% and its browser success rate from 4.4% to 60.0%.
  • RL Improvement: Applying GRPO (Reinforcement Learning) further boosted the SFTed model's performance, raising the browser success rate from 60.0% to 72.8%.
  • Reasoning Ablation: For open-weight models, the impact of reasoning is mixed; it sometimes shortens rollouts but doesn't always improve scores as dramatically as it does for frontier API models.
GRPO training consistently improves the success rate of SFTed models across desktop, browser, and mobile platforms.

Limitations and Future Work

  • Mobile Still Needs Emulators: While desktop was successfully "Dockerized," mobile environments in CUA-Lite still require heavy emulators.
  • Linux-Centric: The lightweight sandboxes currently only support Linux; Windows-based environments like WindowsAgentArena still require traditional VMs.
  • Verifier Accuracy: The authors note that they haven't fully audited all training verifiers, and some tasks rely on model-based judges which can be imperfect.
  • Generalization: The training in this paper focused on the same applications used in evaluation; future work is needed to see how well these gains transfer to entirely unseen software.

Summary updated

Abstract

Open resources for computer use agents (CUAs) -- environments, datasets, and models -- remain scattered: without a standard, these resources cannot be integrated and scaled; additionally, evaluation, RL, and SFT cannot share one infrastructure. We present CUA-Lite, an open platform for developing CUAs, built around three standardized abstractions: (1) Unified environment interface, under which we integrate 12 benchmarks across desktop, browser, and mobile, plus lightweight VM-free sandboxes that replicate OSWorld's desktop at much lower cost, providing over 30,000 verifiable tasks. (2) Unified supervised data format, into which we convert the major public CUA datasets, from GUI grounding and understanding to full rollouts, and record our fresh rollouts from frontier CUAs on these verifiable environments. (3) Model harnesses shared across evaluation, RL, and SFT, one per model and implemented for 14 model families. Each harness runs its model in these computer environments, producing the rollouts that evaluation and RL consume, or renders stored supervised data into the model's own training format for SFT. We release reference scores across the integrated benchmarks, and show that RL and SFT through the same harness improve open-weight models. We release our dataset, code, and models, and the platform is open to contributions.
BibTeX
@misc{zhou2026cua,
  author = {Zhanhui Zhou and Weichen Zhang and Haoran Liu and Lingjie Chen and Tianneng Shi and Kevin Lin and Zhengyuan Yang and Lijuan Wang and Dawn Song},
  title = {{CUA-Lite: An Open Platform for Computer Use Agents}},
  year = {2026},
  eprint = {2610.26071},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.26071},
}
Figure