DataPraxis: Scaling Analytics Tasks via Verified Workspace Evolution

Nan Jia, Wenxuan Shi, Jingqing Ruan, Zhizhao Zeng, Tianyi Zhai, Zhongda Su, Feng Hong, Zhengyu Chen, Wenhao Yan, Haojin Yang, Siqi Dai, Weipeng Zhang, Ke Zeng, Xunliang CaiarXiv 2026 · arXiv

TL;DR

DataPraxis is a novel framework for synthesizing complex data analysis tasks by "evolving" workspaces—using initial findings to uncover deeper, non-obvious questions. By training on the resulting DataPraxis-5K dataset, mid-sized models (27B-35B) can match or outperform frontier LLMs on professional analytics benchmarks.

What Problem Does This Paper Address?

While large language models (LLMs) are becoming proficient at basic coding and tool use, performing professional-grade data analysis remains a high bar. Professional analysis isn't just about answering a single prompt; it requires sustained reasoning, iterative investigation, and the ability to connect dots across different datasets.

The authors identify a "data bottleneck": generating high-quality training tasks directly from raw data often results in shallow questions. Deeper insights—the kind that drive business decisions—usually only emerge after an initial layer of analysis has been performed. Furthermore, verifying the correctness of long-horizon agent trajectories is notoriously difficult. DataPraxis tackles both the task complexity and verification challenges.

Methods

The core innovation is Verified Workspace Evolution. Instead of asking an agent to generate a task from a raw CSV, the framework follows a multi-stage process:

  1. Workspace Evolution: A "Director" agent proposes analytical directions based on a data profile. An "Executor" performs the analysis, and a "Validator" verifies the results. This process enriches the workspace with new scripts, intermediate data, and validated findings.
  2. Evolution Modes: The framework uses four distinct modes to grow the "tree" of analysis: Deepen (extend findings), Search (retrieve external info), Decompose (split tasks), and Compose (merge findings from different branches).
  3. Backward Synthesis: Once a "deep" finding is reached (e.g., at Level 3 of the evolution), the framework works backward to the original raw data. It constructs a standalone task instruction ($q$) that requires the agent to reach that final deep conclusion starting from scratch, without seeing the intermediate steps generated during evolution.
  4. Dual-Evidence Verification: To ensure the training data is high-quality, the authors combine "evolution evidence" (the path taken to build the task) with "solution evidence" (trajectories from independent models) to generate robust evaluation rubrics.
Figure 2: The DataPraxis framework. (a) The Profiler characterizes the initial data and domain. (b) Verified workspace evolution progressively discovers and validates analytical findings, which are converted into standalone tasks through backward synthesis. (c) Dual-evidence verification com- bines evidence from evolution with independent solving trajectories.

Datasets

  • DataPraxis-5K: A new training dataset featuring 5,000 verified trajectories across 15 domains (business, finance, sports, etc.).
  • DABStep: Used for evaluating multi-step data analysis reasoning.
  • JobBench: Used to assess the ability to produce professional deliverables across various occupations.
  • RideBench: A newly introduced internal benchmark simulating complex business analysis in ride-hailing scenarios.

Key Insights and Ideas

  • Analysis Informs Questions: The authors found that the "perplexity" (a measure of how hard it is to predict a question) of deep questions is much lower when the model has access to prior analysis. In other words, you can't easily ask the "right" deep questions until you've done the preliminary work. Question perplexity drops significantly when models have access to prior analytical findings.

  • The Value of Depth: As the "evolution depth" increases, tasks become objectively harder. Pass rates drop and the number of required tool calls increases, providing a much richer training signal for agents. As evolution depth increases, pass rates fall and tool-call turns rise, indicating higher task difficulty.

  • Composition is Key: By merging different analytical branches (the Compose mode), the framework can create tasks that require synthesizing information from disparate sources—a hallmark of professional-level work.

Figure 3: Question perplexity with initial workspace information alone or with ac- cumulated findings.
Figure 4: Average pass rate and tool-call turns across evolution depths.

Key Results

The models trained on this data, DataPraxis-27B and DataPraxis-35B-A3B, showed dramatic improvements over their base models:

  • Performance Leap: DataPraxis-27B improved its average benchmark score from 48.36 to 60.39.
  • Matching the Giants: On the DABStep "Hard" set, DataPraxis-27B achieved a score of 49.74, matching or surpassing frontier models like GLM-5.2 and DeepSeek-V4-Pro.
  • Behavioral Shifts: Post-training, agents became significantly better at self-verification (inspecting their own outputs) and explicit task organization (breaking complex requests into subgoals).

Limitations and Future Work

  • Seed Dependency: The framework relies on "seed" workspaces that are complex enough to support deep exploration. If the initial data is too simple, the evolution "tree" won't grow very deep.
  • Teacher Model Quality: The difficulty of synthesized tasks and the quality of training trajectories are still bounded by the capabilities of the "teacher" models used during the evolution and synthesis phases.
  • Future Directions: The authors suggest that scaling this approach to even more diverse environments and higher-fidelity simulations (like RideBench) could further push the boundaries of agentic data analysis.

Summary updated

Abstract

General-purpose agents are increasingly expected to perform professional analytics work, which requires sustained reasoning, iterative investigation, and reliable evidence. Training these capabilities requires diverse and challenging tasks. However, generating tasks directly from raw data often overlooks deeper questions that emerge through analysis and provides limited evidence for verification. To address these limitations, we introduce DataPraxis, an analytics task synthesis framework based on verified workspace evolution. The framework progressively enriches workspaces with validated findings and artifacts, then inherits and combines these workspaces to uncover deeper questions. It constructs tasks from accumulated findings and their dependencies, verifying analytical results both during evolution and after task assembly. Using this framework, we construct DataPraxis-5K, a dataset of 5,000 verified trajectories spanning diverse domains and output formats, to train DataPraxis-27B and DataPraxis-35B-A3B. DataPraxis-27B achieves 55.11 on DABStep and 51.9 on JobBench, matching or surpassing frontier models such as GLM-5.2. DataPraxis-5K is available at huggingface.co/datasets/stargazerhust/DataPraxis-5k
BibTeX
@misc{jia2026datapraxis,
  author = {Nan Jia and Wenxuan Shi and Jingqing Ruan and Zhizhao Zeng and Tianyi Zhai and Zhongda Su and Feng Hong and Zhengyu Chen and Wenhao Yan and Haojin Yang and Siqi Dai and Weipeng Zhang and Ke Zeng and Xunliang Cai},
  title = {{DataPraxis: Scaling Analytics Tasks via Verified Workspace Evolution}},
  year = {2026},
  eprint = {2610.26924},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.26924},
}
Figure