ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent System

Yutong He, Daibo Li, Guohong Li, Jiahe Geng, Zhengyang Huang, Can Ren, Zekun Zhang, Yifan Liu, Shuchen Zhu, Hengrui Zhang, Boao Kong, Ming Sun, Shu Li, Chenyi Li, Jiang Hu, Kun Yuan, Zaiwen Wen, Pingwen Zhang

While AI agents have become adept at writing code and running empirical experiments, the "ivory tower" of applied mathematics—with its requirement for rigorous proofs and deep theoretical synthesis—has remained largely out of reach. Enter ReasFlow, an end-to-end autonomous multi-agent system designed to act as a "capable graduate student" for human researchers in mathematically grounded disciplines.

TL;DR

ReasFlow is an autonomous multi-agent system that automates the entire scientific discovery pipeline for applied mathematics, from literature survey to theorem proving and manuscript preparation. By utilizing specialized "knowledge cards" and a rigorous internal verification loop, it can produce high-quality research papers that match or even exceed the theoretical depth of human-designed algorithms.

What Problem Does This Paper Address?

Most existing "AI Scientist" frameworks are designed for empirical fields where progress is measured by quantitative benchmarks (e.g., "did the accuracy go up?"). Applied mathematics is different: it is "theory-first." It requires synthesizing diverse domain knowledge (like convex analysis and probability theory) to derive rigorous convergence guarantees and complexity bounds.

The authors identify three core challenges:

  1. Verification at Scale: Natural language proofs are notoriously difficult to verify automatically.
  2. Reasoning Gaps: Current LLMs often lack the specialized background knowledge required for master-level mathematical research.
  3. Missing Heuristics: The "tricks of the trade"—procedural heuristics used by human mathematicians—are rarely documented in published papers, making them hard for AI to learn.

Methods

ReasFlow operationalizes a collaborative paradigm where a human expert acts as a Principal Investigator (PI), providing high-level goals, while the system functions as a multi-agent research team.

The ReasFlow system architecture and its multi-agent pipeline.

Key components include:

  • The MetaAgent Orchestrator: Manages specialized sub-agents for literature surveys, algorithm design, theorem proving, experimentation, and writing.
  • Knowledge Base Augmentation: The system uses "knowledge cards"—structured snippets that encode both declarative facts (definitions, theorems) and procedural heuristics (e.g., "try a quadratic Lyapunov function first").
  • Internal Verification Loop: Unlike standard LLMs that might "hallucinate" a proof, ReasFlow includes a dedicated LemmaVerifierAgent. This module audits derivations for logical coherence, computational accuracy, and the "tightness" of derived bounds before a human ever sees them.
A comparison between traditional AI workflows and the ReasFlow framework.

Datasets

To evaluate the system's ability to design and implement algorithms, the authors introduced OR-Bench (Optimization Research Benchmark), which consists of 35 open-ended optimization research tasks. For the empirical validation of the algorithms ReasFlow designed, the system utilized standard datasets including MNIST, CIFAR-100, and Wikitext-2.

Key Insights and Ideas

  • Procedural vs. Declarative Knowledge: The authors found that simply giving an AI a library of papers isn't enough. The AI needs to be "taught" the how of proving (procedural heuristics) through structured knowledge cards to avoid common pitfalls like misapplying stochastic independence lemmas.
  • Zero-Tolerance Verification: In mathematics, a single overlooked flaw invalidates an entire contribution. ReasFlow’s verifier adopts a "zero-tolerance" policy, rejecting any proof with unstructured thinking traces or ambiguous notation, forcing the agent into a revision loop.
  • The "Theory-First, Experiment-Supporting" Paradigm: ReasFlow unifies the derivation of new theoretical bounds with the code generation needed to empirically validate those bounds, ensuring the two are consistent.

Key Results

The system was deployed to autonomously generate five complete research papers in fields like federated learning and manifold optimization. Remarkably, some of these papers produced algorithms that matched or improved upon the best-known theoretical convergence rates previously established by human experts.

In a head-to-head comparison with other state-of-the-art AI research agents (including AI Scientist-v2 and DeepScientist), ReasFlow achieved significantly higher scores across nine scholarly dimensions.

A radar chart showing ReasFlow outperforming baselines across dimensions like math rigor and originality.

Specifically:

  • Math Rigor: ReasFlow scored an average of 90.7/100, while the best baseline (QED) scored 73.
  • Success Rate: On the OR-Bench, ReasFlow (using GPT-5.4) achieved a 100% first-run success rate for generating executable Python implementations of its designed algorithms.

Limitations and Future Work

While ReasFlow is a major step forward, the authors note several limitations:

  • Domain Specificity: The current knowledge base is heavily tailored to applied math and optimization. Expanding to other theory-intensive fields (like theoretical physics) would require new knowledge-extraction pipelines.
  • Informal vs. Formal Verification: The system verifies proofs in natural language. Integrating it with formal verification systems like Lean or Coq could provide even stronger guarantees of correctness.
  • LLM Constraints: The system is ultimately bounded by the underlying reasoning capabilities of the base LLM.

ReasFlow is currently integrated into the ReasLab platform, providing a collaborative workspace for researchers to explore AI-assisted theoretical discovery.

Summary updated

Abstract

Recent advances in Large Language Models have fueled autonomous AI agents capable of tackling complex scientific tasks, yet existing automated research systems remain predominantly focused on empirically driven domains with quantitative benchmarks, leaving theory-driven discovery, particularly in mathematically grounded disciplines requiring rigorous proofs and synthesis of domain knowledge, largely underexplored. Key challenges include the difficulty of verifying theoretical reasoning at scale, insufficient reasoning ability for autonomous frontier exploration, and a scarcity of procedural heuristics in the literature. We introduce ReasFlow, an end-to-end autonomous agent system for reasoning-centric scientific discovery that operationalizes a collaborative paradigm where the human expert acts as Principal Investigator while the agent executes rigorous derivations as a capable graduate student. ReasFlow incorporates (i) a robust internal verification loop that audits logical coherence and corrects fundamental errors prior to human inspection, and (ii) an automated knowledge retrieval and self-improvement mechanism that proactively surfaces both declarative facts and overlooked procedural heuristics, substantially reducing expert intervention. The system unifies literature synthesis, algorithm design, theorem proving, experimentation, and manuscript preparation in a single system. Deployed to autonomously generate five complete research papers with rigorous theoretical and empirical content from minimal prompts, ReasFlow consistently achieves the highest evaluation scores among state-of-the-art open-access baselines under a curated LLM-based review rubric. ReasFlow is publicly accessible via the ReasLab platform, providing a collaborative workspace for AI-assisted theoretical research. Github repo: https://github.com/reaslab/ReasFlow.git.
BibTeX
@inproceedings{he2026reasflow,
  author = {Yutong He and Daibo Li and Guohong Li and Jiahe Geng and Zhengyang Huang and Can Ren and Zekun Zhang and Yifan Liu and Shuchen Zhu and Hengrui Zhang and Boao Kong and Ming Sun and Shu Li and Chenyi Li and Jiang Hu and Kun Yuan and Zaiwen Wen and Pingwen Zhang},
  title = {{ReasFlow: Assisting Reasoning-Centric Scientific Discovery in Applied Mathematics via a Knowledge-Based Multi-Agent System}},
  booktitle = {AI4Math @ ICML},
  year = {2026},
  url = {https://openreview.net/forum?id=SBSalCZOSR},
}
Figure