ClinicalReTrial: Clinical Trial Redesign with Self-Evolving Agents

Sixue Xing, Kerui Wu, Xuanye Xia, Meng Jiang, Jintai Chen, Tianfan Fu

TL;DR

Clinical trials are notoriously expensive and prone to failure due to subtle flaws in their complex, natural-language protocols. ClinicalReTrial introduces a self-evolving, multi-agent AI framework that moves beyond merely predicting trial failure to actively fixing it, iteratively redesigning protocols to boost success rates at a negligible cost of just \$0.12 per trial.

What Problem Does This Paper Address?

Bringing a new drug to market is a monumental gamble, costing an estimated \$2.6 billion per drug, with a staggering 80-90% of clinical trials ending in failure. Many of these failures aren't due to the drug itself, but rather to flaws in the trial's protocol—the complex natural language document specifying eligibility criteria, dosing regimens, and target endpoints. A criterion that is too restrictive might cause a trial to fail due to poor enrollment, while a dosing oversight could trigger safety issues.

While recent AI advances have gotten quite good at predicting whether a trial will fail, they are inherently reactive. They act as a black box that says "this will fail" without offering actionable remedies. ClinicalReTrial bridges this gap by treating clinical trial optimization as an AI-solvable, in silico-verifiable redesign problem.

Methods

ClinicalReTrial orchestrates a closed-loop, reward-driven optimization framework powered by a coordinated multi-agent pipeline:

  1. Protocol Diagnosis Analyzer: Examines a failed protocol and identifies the root causes of failure across three primary modes: poor enrollment, safety/adverse effects, or lack of efficacy. It then prioritizes specific text segments for modification (e.g., recommending to delete, modify, or add a criterion).
  2. Protocol Refinement Generator: Translates diagnostic insights into concrete text variations using action-specific logic and few-shot prompting.
  3. Clinical Safety Validator: Acts as an "LLM-as-a-Judge," leveraging Retrieval-Augmented Generation (RAG) against external biomedical databases (DrugBank, PubMed, and a Disease Database) to prune unsafe or clinically implausible modifications.
  4. Protocol Candidate Evaluator: Reconstructs candidate protocols using Beam Search to manage combinatorial complexity, and passes them to a simulation environment.
Figure 2: Detailed ClinicalReTrial Agent architecture and iterative redesign workflow, comprising diagnosis, augmentation, and validation, with a simulation environment and hierarchical memory to progressively optimize failed clinical trial protocols.

The framework's secret sauce lies in its Simulation Environment and Hierarchical Memory. Instead of running actual, multi-million dollar trials, the authors trained a highly accurate LightGBM classifier on multi-modal trial features to serve as a simulation oracle. The improvement in predicted success probability acts as a dense reward signal.

To ensure continuous self-improvement, the system maintains a local memory to accumulate feedback within a single trial's optimization iterations, and a global memory to distill and transfer successful redesign patterns across entirely different trials.

Datasets

The simulation environment and agents were trained and evaluated using:

  • TrialBench: A standardized benchmark containing 20,769 annotated Phase I-IV clinical trials. For the agent optimization experiments, a stratified sample of 60 failed trials (20 enrollment, 20 safety, 20 efficacy) was used.
  • External Knowledge Bases: DrugBank (for pharmacological profiles), a specialized Disease Database (for diagnostic criteria and risk factors), and PubMed abstracts spanning 1975–2025.

Key Insights and Ideas

  • Simulation as an Optimization Oracle: By framing a high-fidelity predictive model as a simulation environment, the authors turned a static NLP task into a dynamic reinforcement learning environment, providing the dense rewards necessary for agent self-evolution.
  • Marginal Contribution for Text Edits: To determine which specific text modification actually drove an improvement, the Evaluator decomposes protocol-level success probabilities into augmentation-level rewards, effectively solving the credit assignment problem for natural language edits.
  • Occam’s Razor in Trial Design: Retrospective case studies revealed an interesting tension: while the AI agent naturally defaults to "mechanistic over-optimization" (like adding complex biomarker screening criteria to fix efficacy issues), real-world successful trial redesigns often favor pragmatic simplicity, such as merely increasing the sample size to boost statistical power.

Key Results

  • High-Fidelity Simulation: The underlying LightGBM simulation model achieved strong predictive performance with a PR-AUC > 0.75 across all failure modes, outperforming existing baselines like HINT and TrialBench by 6% to 19% in ROC-AUC.
  • Protocol Optimization: ClinicalReTrial successfully improved 83.3% of the failed trial protocols, achieving a mean success probability gain ($\Delta p$) of 5.7%.
  • Safety Failures Benefited Most: Safety-driven protocols saw the highest average improvement ($\Delta p = 7.0\%$), as the agent successfully identified and mitigated specific contraindication patterns.
Figure 3: Iterative redesign trajectories by failure mode. Curves show mean cumulative improvement in pre- dicted success probability (∆p).
  • Extreme Cost Efficiency: The entire iterative optimization process cost an average of just \$0.12 per trial, demonstrating immense feasibility for industrial-scale deployment.

Limitations and Future Work

Despite its strong performance, the authors note that ClinicalReTrial is strictly a decision-support tool and cannot replace human expert judgment; all generated protocols require professional medical and regulatory review.

Additionally, because the simulation environment is a predictive model, any inherent prediction errors could result in suboptimal redesign recommendations. The system also faces generalization constraints when dealing with rare diseases or novel therapeutic mechanisms underrepresented in historical data. Future work will focus on integrating tighter real-world constraints, specialized biomarker databases, and safety ontologies to make the generated protocol language even more clinically precise.

Summary updated

Abstract

Clinical trials constitute a critical yet exceptionally challenging and costly stage of drug development (\$2.6B per drug), where protocols are encoded as complex natural language documents, motivating the use of AI systems beyond manual analysis. Existing AI methods accurately predict trial failure, but do not provide actionable remedies. To fill this gap, this paper proposes ClinicalReTrial, a multi-agent system that formulates clinical trial optimization as an iterative redesign problem on textural protocols. Our method integrates failure diagnosis, safety-aware modifications, and candidate evaluation in a closed-loop, reward-driven optimization framework. Serving the outcome prediction model as a simulation environment, ClinicalReTrial enables low-cost evaluation and dense reward signals for continuous self-improvement. We further propose a hierarchical memory that captures iteration-level feedback within trials and distills transferable redesign patterns across trials. Empirically, ClinicalReTrial improves $83.3\%$ of trial protocols with a mean success probability gain of $5.7\%$ with negligible cost (\$0.12 per trial). Retrospective case studies demonstrate alignment between the discovered redesign strategies and real-world clinical trial modifications. The code is anonymously available at: https://github.com/xingsixue123/ClinicalFailureReasonReTrial.
BibTeX
@misc{xing2026clinicalretrial,
  author = {Sixue Xing and Kerui Wu and Xuanye Xia and Meng Jiang and Jintai Chen and Tianfan Fu},
  title = {{ClinicalReTrial: Clinical Trial Redesign with Self-Evolving Agents}},
  year = {2026},
  eprint = {2601.00290},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2601.00290},
}
Figure