Stop-RAG: Value-Based Retrieval Control for Iterative RAG
Lists
Only you see this
Abstract
Iterative retrieval-augmented generation (RAG) enables large language models to answer complex multi-hop questions, but each additional loop increases latency, costs, and the risk of introducing distracting evidence, motivating the need for an efficient stopping strategy. Existing methods either use a predetermined number of iterations or rely on confidence proxies that poorly reflect whether more retrieval will actually help. We cast iterative RAG as a finite-horizon Markov decision process and introduce Stop-RAG, a value-based controller that adaptively decides when to stop retrieving. Trained with full-width forward-view Q($λ$) targets from complete trajectories, Stop-RAG learns effective stopping policies while remaining compatible with black-box APIs and existing pipelines. On multi-hop question-answering benchmarks, Stop-RAG consistently outperforms both fixed-iteration baselines and prompting-based stopping with LLMs. These results highlight adaptive stopping as a key missing component in current agentic systems, and demonstrate that value-based control can improve the accuracy of RAG systems.
BibTeX
@inproceedings{park2025stop,
author = {Jaewan Park and Solbee Cho and Jay-Yoon Lee},
title = {{Stop-RAG: Value-Based Retrieval Control for Iterative RAG}},
booktitle = {MTI-LLM @ NeurIPS},
year = {2025},
url = {https://openreview.net/forum?id=fN4PJNYgs3},
}Loading related content...