SPAR: Experience-Driven Strategy Evolution in Multi-Session B2B Sales

Hangming Zhang, Yao Zhao, Haotian Kuang, C. L. Philip Chen, Tong Zhang, Tengyue MaarXiv 2026 · DOI · arXiv

TL;DR

SPAR (Strategy Playbook via Attributed Refinement) is a self-evolving framework for B2B sales agents that uses a "double-loop" architecture to bridge the gap between single-session interactions and long-term strategic learning. By modeling sales strategies as testable hypotheses and using causal attribution to filter out environmental noise, SPAR achieved a +15.8% conversion lift in a live A/B test involving over 200,000 merchants.

What Problem Does This Paper Address?

Closing a B2B deal is rarely a one-and-done affair. It involves high transaction values and requires building relationship-based trust over multiple outreach rounds. However, most current LLM-based sales agents suffer from a "single-session limitation": they treat every call as an isolated event, failing to carry forward context or learn from past rejections.

Even when agents do attempt to learn, they face attribution ambiguity. If a merchant hangs up, was it because the sales pitch was flawed (a strategy failure) or because the merchant just had their budget slashed (an external factor)? Without a way to distinguish between the two, automated strategy updates can end up amplifying errors rather than correcting them.

Figure 1: Single-session agents repeat generic pitches across isolated calls without addressing the merchant’s core objection, leading to repeated rejections. Multi- session human salespeople follow up on specific con- cerns, build on prior context, and achieve conversion. S1, S2, . . . denote session 1, session 2, and so on.

Methods

The authors propose a double-loop architecture that separates individual merchant adaptation from global strategy refinement:

  1. The Inner Loop (Merchant Adaptation): This loop manages episodic memory for each merchant. After every session, the agent generates a structured reflection on what happened and what to try next. This ensures the agent doesn't repeat the same mistakes in follow-up calls.
  2. The Outer Loop (Strategy Evolution): This loop maintains a shared Strategy Playbook ($\mathcal{P}$). Strategies are treated as testable hypotheses with a defined lifecycle: proposal, testing, validation (promotion to "active"), and retirement (deprecation).

A critical component is Causal Attribution. The system uses an LLM to analyze dialogues and determine if an outcome was strategy-driven ($s$), externally-determined ($x$), or uncertain ($u$). Only strategy-driven outcomes are used to update the playbook's confidence scores, which are calculated using a Beta-Bernoulli model to avoid overconfidence from small sample sizes.

Figure 2: Overview of the SPAR framework. All strategies and merchant data shown are anonymized. The illustration is a simplified example for readability. Real B2B sales scenarios involve more complex merchant profiles and longer interaction sequences.

Datasets

  • B2B Sales Evaluation Dataset: A new dataset constructed from 1,642 real-world conversations between experienced human sales teams and merchants on the 1688 platform (a major B2B site). It includes detailed merchant profiles, behavioral archetypes, and session-level outcomes.
  • Merchant Simulator: To test the agents, the authors built a high-fidelity simulator using GPT-4o, which achieved 98.7% outcome agreement when replaying real human interactions.
  • Live A/B Test: The framework was deployed in a massive real-world test on the 1688 platform, involving over 200,000 merchants.

Key Insights and Ideas

  • Attribution as a Filter: The "aha moment" here is that not all data is good data. By explicitly labeling outcomes as "externally driven," SPAR prevents environmental noise (like a merchant's bad mood or budget cuts) from corrupting the strategic playbook.
  • Hypothesis Lifecycle: Instead of just storing "lessons" as unstructured text, SPAR treats strategies as evolving entities. This structured approach allows the system to systematically retire failing strategies and promote validated ones based on empirical success rates.
  • Double-Loop Synergy: The ablation studies showed that the loops are mutually reinforcing. The inner loop provides the continuity needed for rapport, while the outer loop provides the strategic depth needed to handle complex objections.

Key Results

SPAR significantly outperformed established baselines like Reflexion and ExpeL across both simulated and real-world environments:

  • Live A/B Test: SPAR achieved a +15.8% conversion lift and a +35.8% growth in high-intent merchants compared to a direct prompting baseline.
  • Human Evaluation: Domain experts rated SPAR at 4.62 out of 5 for overall sales quality. It was particularly effective at reducing repetition (an 18.5% reduction over the next-best method).
  • Objection Handling: In simulations, SPAR showed a 9.6% improvement in objection recognition and a 5.5% gain in providing concrete evidence support compared to the strongest baselines.
Table 2: Results on the B2B sales evaluation dataset. Bold with underline marks the best and underline marks the second-best in each column. Recognize, Respond, and Evidence measure objection handling, Monologue and Repetition measure dialogue quality, and Recall measures proactive memory callback in follow-up sessions. GPT Eval and Claude Eval score the same dialogues with GPT-4o and with Claude Sonnet 4.5. Sales Quality is rated by three domain experts on a 1–5 scale under blind conditions (rubric in Appendix C).

Limitations and Future Work

  • Cold-Start Problem: SPAR requires multiple interactions before the playbook meaningfully evolves. The authors suggest "warm-start" techniques, such as transferring playbooks across different domains, as a future research path.
  • LLM Stochasticity: The strategy evolution process relies on LLM reasoning, which can be unpredictable. The authors propose adding an auxiliary verification agent to validate strategy changes before they are committed to the playbook.
  • Sequential vs. Parallel: Currently, the system processes merchants sequentially. In real-world sales, agents handle many leads concurrently, and future work will explore how parallel interactions affect learning dynamics.

Summary updated

Abstract

B2B outbound sales involves high transaction values and relationship-based trust, so closing a deal typically requires multiple rounds of outreach building on prior context. Existing LLM-based sales agents operate within single sessions and cannot carry forward context or refine strategies from experience. Methods that do learn from experience store lessons as unstructured text and treat all outcomes as equally informative, with no mechanism to distinguish a flawed strategy from an external factor. We propose SPAR, a self-evolving framework that models selling strategies as testable hypotheses and refines them without parameter updates. A double-loop architecture lets an inner loop adapt to individual merchants through episodic memory while an outer loop evolves a shared strategy playbook through causal attribution and hypothesis-driven evolution. In a live A/B test on the 1688 platform with over 200,000 merchants, SPAR achieves +15.8% conversion lift and +35.8% high-intent merchant growth. Human evaluation by domain experts rates SPAR at 4.62 out of 5 on overall sales quality, the highest among all methods.
BibTeX
@misc{zhang2026spar,
  author = {Hangming Zhang and Yao Zhao and Haotian Kuang and C. L. Philip Chen and Tong Zhang and Tengyue Ma},
  title = {{SPAR: Experience-Driven Strategy Evolution in Multi-Session B2B Sales}},
  year = {2026},
  eprint = {2611.01695},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.01695},
}
Figure