MARS: Training Multilingual Search Agents for Retriever-Free Evidence Acquisition

Rui Qi, Yunlong Liang, Yufeng Chen, Jinan Xu, Fandong Meng, Kaiyu HuangarXiv 2026 · arXiv

TL;DR

MARS (Multilingual Search Agent) is a "retriever-free" framework that allows LLMs to find evidence across languages by directly executing shell commands (like grep) on raw text corpora. By grounding search terms in corpus-native aliases and using a redundancy-aware reinforcement learning reward, MARS significantly outperforms traditional vector-based retrieval methods while being more efficient and robust to language diversity.

What Problem Does This Paper Address?

Most Multilingual Retrieval-Augmented Generation (MRAG) systems rely on "retrievers"—models that turn text into mathematical vectors to find similar documents. However, these systems struggle with cross-lingual retrieval errors, high indexing costs, and "embedding shifts" where a relevant document in one language might have a lower similarity score than an irrelevant one in another.

An alternative is Direct Corpus Interaction (DCI), where an agent uses tools like grep to search raw text. While powerful, DCI faces two major hurdles:

  1. Lexical Mismatch: Exact search is brittle. If you search for "Cristiano Ronaldo" in a Chinese corpus that only uses the alias "C罗," you find nothing.
  2. Search Redundancy: Without proper guidance, reinforcement learning (RL) agents often get stuck in loops, generating repetitive or ineffective search commands that waste tokens and time.
Illustration of lexical mismatch and trajectory optimization challenges.

Methods

The authors introduce MARS, which treats multilingual search as an iterative, agentic process. The core of the system is Utility-Aware Retrieval Policy Optimization (URPO), which refines the agent's behavior using three key components:

  • Direct Corpus Interaction (DCI): Instead of a black-box retriever, the model generates executable shell commands to filter and pipe results from language-specific corpora.
  • Corpus-Native Entity Grounding: To solve the lexical mismatch problem, MARS extracts language-specific titles and aliases directly from retrieved snippets. These "lexical anchors" are then reused in subsequent search steps. If a search in a target language fails, the model can "pivot" to a high-resource language (like English) to find a valid anchor first.
  • Redundancy-Aware Search Reward: The authors use a novel reward function that penalizes Jaccard similarity between commands in a single search trajectory. This encourages the model to be concise and explore new search terms rather than repeating failed ones.
Figure 2: Illustration of MARS for multilingual DCI. The policy directly interacts with language-specific corpora in URPO, while corpus-native grounding supplies reusable lexical anchors and redundancy-aware search encourages successful, non-redundant search trajectories.

Datasets

The researchers evaluated MARS on two primary multilingual benchmarks:

  • MKQA (Multilingual Knowledge Questions and Answers): 13 languages, including "seen" languages used during training and "unseen" languages to test cross-lingual generalization.
  • MLQA (Multilingual Question Answering): 7 languages, used to evaluate the model's ability to handle extractive QA tasks.
  • HotpotQA: A monolingual multi-hop benchmark used to ensure that adding multilingual capabilities doesn't degrade standard performance.

Key Insights and Ideas

  • Anchors over Translations: You don't need a perfect translation of a query to succeed in DCI. You just need to find one document that bridges the gap between the query term and the corpus-native alias.
  • Efficiency as a Training Signal: Rewarding "conciseness" doesn't just save tokens; it forces the model to generate more informative search commands. This prevents the "training collapse" often seen when RL agents are only given a reward at the very end of a long, messy trajectory.
  • Robustness to Scale: Interestingly, while baseline DCI methods often get "confused" and perform worse as more languages are added to the search space, MARS actually improves. It successfully leverages the increased evidence pool without getting bogged down by the noise.

Key Results

MARS consistently outperformed both traditional RAG and existing DCI baselines (like Grepseek) across various model scales (Qwen3.5-4B and 9B).

  • Accuracy: On MKQA, MARS achieved a 40.6% Exact Match (EM) score, significantly higher than the 37.1% achieved by the previous best DCI method.
  • Efficiency: MARS reduced the number of search commands by 39% and the total response tokens (a proxy for latency) by 29% compared to Grepseek.
  • Generalization: The model showed strong performance on "unseen" languages, proving that the search strategy it learns is language-agnostic.
Main results comparing MARS against various RAG and DCI baselines.
Figure 3: Overall EM under increasing corpus-language coverage on MKQA. Ul denotes the corpus in the user- query language, Ul+En additionally includes English, and All includes all available language-specific corpora.

Limitations and Future Work

The authors acknowledge that MARS requires task-specific training data and incurs additional optimization costs during the RL phase. Furthermore, while corpus-native grounding helps, the system is still fundamentally sensitive to lexical variation; if a corpus contains no aliases or links for an entity, exact search will still fail.

Future work may explore hybrid retrieval—combining the precision and control of executable shell commands with the fuzzy-matching robustness of semantic vector search.

Summary updated

Abstract

Existing multilingual retrieval-augmented generation relies heavily on learned retrievers and similarity-based ranking from multilingual collections, which are vulnerable to cross-lingual retrieval errors and indexing overhead. In this paper, we explore retriever-free multilingual search, where the model directly interacts with raw corpora through executable shell commands. This paradigm shifts the bottleneck to multilingual search action generation, where exact search is sensitive to entity surface forms and outcome-only supervision provides limited guidance for multi-turn search. To address these challenges, we propose MARS, a multilingual search agent in direct corpus interaction (DCI) with reinforcement learning (RL). MARS introduces corpus-native entity grounding to recover reliable lexical anchors from corpus evidence, mitigating failure to retrieve evidence. Meanwhile, we present a redundancy-aware search reward to encourage concise and effective search trajectories, addressing training collapse in RL of multilingual scenarios. Experiments show that \ours~consistently outperforms strong retrieval-based and DCI baselines, while demonstrating robust cross-lingual generalization and substantially reducing redundant corpus interactions.
BibTeX
@misc{qi2026mars,
  author = {Rui Qi and Yunlong Liang and Yufeng Chen and Jinan Xu and Fandong Meng and Kaiyu Huang},
  title = {{MARS: Training Multilingual Search Agents for Retriever-Free Evidence Acquisition}},
  year = {2026},
  eprint = {2611.09090},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.09090},
}
Figure