G-CAST: Governed Continual Self-Training for E-Commerce Agents under Evolving Demands

Yuechun Yu, Wenzheng Kong, Xiaofeng Mao, Jin ZhangarXiv 2026 · arXiv

In the fast-moving world of e-commerce, AI agents aren't just static chatbots; they are dynamic assistants that must master new product categories, procurement rules, and specialized tools every week. But how do you keep an agent's brain in sync with its ever-expanding toolkit without breaking what already works?

Researchers at Alibaba Group have introduced G-CAST (Governed Continual Self-Training), a system designed to handle the "capability drift" that occurs when user demands and agent harnesses evolve in tandem.

TL;DR

G-CAST is a governed continual self-training framework that synchronizes model updates, data selection, and reward functions as an agent’s capabilities expand. By using reward-routed data orchestration and a "governed" transition process, it ensures e-commerce agents learn new skills while strictly preserving performance on legacy tasks.

What Problem Does This Paper Address?

Most LLM agents are trained once and deployed. However, in production e-commerce, the "capability contract"—the set of tools, skills, and protocols the agent can use—is constantly expanding. This creates three critical mismatches:

  1. Model Mismatch: The underlying model doesn't know how to invoke newly added tools.
  2. Data Mismatch: Existing training logs contain no evidence of how to use new features.
  3. Reward Mismatch: A static reward function might penalize a new, valid procedure or fail to catch errors in a new tool's output.

Simply retraining the model periodically is too slow and labor-intensive. G-CAST seeks to automate this "self-evolution" while providing the governance necessary to prevent regressions in a live production environment.

Methods

G-CAST operates via two interlinked loops: a Governed Self-Evolution Loop for model updates and a Reward Evolution Loop for updating the evaluation logic itself.

Figure 1: G-CAST, a governed continual adaptation loop for deployed e-commerce agents. The main self-evolution loop converts daily production queries into checkpoint updates through multi-rollout generation, reward reliability checking, reward-routed data orchestration, model adaptation, and governed checkpoint transition. When rollout evidence indicates a possible reward error under the current contract, the reward-evolution loop updates the executable reward through contract-grounded annotation, offline reward checks, and trial adaptation before training resumes. Candidate checkpoints are admitted only after cumulative evaluation on both newly introduced and previously retained capabilities, with rejected candidates, regressions, and reward anomalies recorded in the evaluation ledger.

1. Reward-Routed, Entropy-Prioritized Data Orchestration

Instead of treating all production data equally, G-CAST routes queries based on their rollout outcomes:

  • SFT Pool: Queries where all rollouts fail but a verified target exists are sent to Supervised Fine-Tuning.
  • RL Pool: Queries with mixed success/failure outcomes are used for Reinforcement Learning.
  • Monitoring: Queries that consistently succeed are set aside to monitor for regressions.

Within these pools, G-CAST uses token-level entropy to prioritize the most "informative" (uncertain) examples, ensuring the training budget is spent where the model is most confused.

2. Capability-Contract-Driven Reward Evolution

As the agent's harness grows (e.g., adding file export or sandbox tools), the reward function is treated as a versioned, executable object. If the system detects a "reward error" (like high scores for hallucinated content), the Reward Evolution Loop triggers an audit, proposes a rule update, and validates it against "known-good" trajectories before resuming training.

3. Governed Checkpoint Transition

A new model candidate is never automatically deployed. It must pass a cumulative evaluation ledger that tests performance across all previous time periods. If the model learns a new skill but "forgets" how to do basic retrieval, the update is rejected.

Datasets

The study uses real-world production queries from Yuancai, a B2B procurement agent on Alibaba’s 1688 platform. The researchers sampled data across four distinct periods, representing the agent's growth from 4 basic tools to 23 complex workflows.

Table showing the evolution of tools and capabilities across four periods.

Key Insights and Ideas

  • The "Crossover" Effect: The paper demonstrates that while standard autonomous training (like AutoTrainess) works well for simple tasks, it falls behind when the "capability contract" becomes complex. G-CAST’s governed reward evolution becomes the deciding factor in later stages of agent growth.
  • Decoupling Uncertainty from Correctness: By routing by reward first and then ranking by entropy, G-CAST avoids the trap of training on highly uncertain but fundamentally "unlearnable" or garbage data.
  • Reward as Governance: The authors argue that in a production setting, the reward function is not just a training signal but a specification of the "contract" between the user and the agent.

Key Results

  • Performance Retention: In the final evaluation period (Period 4), G-CAST achieved a cumulative reward of 0.8078, significantly outperforming the strong AutoTrainess baseline (0.7911).
  • Adaptation vs. Forgetting: G-CAST improved performance on new tasks by +0.183 while simultaneously increasing performance on retained (old) tasks by +0.012. In contrast, the baseline showed signs of "forgetting" on older tasks (Ref Figure 4).
  • Operational Efficiency: Deployment of G-CAST reduced human reward-audit effort from 2 person-days to just 30 minutes per round and shortened the turnaround for new feature acceptance from a week to two days.
Figure 2: Performance degradation of a fixed checkpoint as the capability contract expands across demand periods. The figure reports the base reward, which excludes auxiliary re- ward components introduced only in later contract versions, so that performance remains directly comparable across pe- riods. The dark curve shows the cumulative mean over all active evaluation slices, and the colored curves show the period-specific means.

Limitations and Future Work

The authors acknowledge that their study is based on a single longitudinal production application (Yuancai) and one primary model family (Qwen). While the patterns of demand and capability evolution are representative of e-commerce, they may not transfer directly to highly creative or non-procedural agent settings.

Future work could explore more automated ways to generate the "reward update proposals," potentially using LLMs to draft the executable reward rules based on audit failures.

Summary updated

Abstract

With the rapid advancement of Large Language Models (LLMs), an increasing number of users are turning to LLM-powered agents for conversational shopping in e-commerce. However, the user needs continue to change as new product categories, procurement scenarios, and feature requests emerge. At the same time, the product's execution harness-including its tools, skills, and operating procedures-continues to evolve to support increasingly sophisticated interactions. These changes create two practical challenges: 1) Demand drift alters the distribution, intent, and complexity of user requests, causing a model trained once to fall behind; 2) Harness evolution requires the model to use newly introduced capabilities correctly without losing behavior that users already rely on. Periodic manual retraining is too delayed and labor-intensive for this setting. To address these challenges, we present G-CAST, a governed continual self-training system that converts daily production evidence under evolving demand and capability contracts into reward-routed, entropy-prioritized training data and governed reward evolution. Governed checkpoint transition under cumulative evaluation controls each model update, enabling the agent to learn newly introduced behaviors without sacrificing previously accepted capabilities. Experiments on a real production e-commerce agent show that G-CAST achieves stronger adaptation to newly introduced demand while better preserving previously accepted behavior compared with a strong autonomous post-training baseline. Ablations further show that both reward-routed, entropy-prioritized data orchestration and governed reward evolution are important to these gains. G-CAST is now deployed in Yuancai(http://cai.1688.com/), a B2B procurement agent on Alibaba's 1688 platform.
BibTeX
@misc{yu2026g,
  author = {Yuechun Yu and Wenzheng Kong and Xiaofeng Mao and Jin Zhang},
  title = {{G-CAST: Governed Continual Self-Training for E-Commerce Agents under Evolving Demands}},
  year = {2026},
  eprint = {2611.17814},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.17814},
}
Figure