PathLoop: Self-Evolving Multi-Agent Reasoning for Evidence-Grounded Whole-Slide Image Analysis

Jincheng Li, Zhengyi Liu, Zelin Liu, Yihui Zhan, Yifei Sun, Xiangyu Li, Minye Shao, Lingyao Kong, Tao Hou, Xinheng Lyu, Lanfeng Zhong, Ziquan Zhu, Rongzhao Zhang, Rui Yan, S. Kevin ZhouarXiv 2026 · arXiv

In the world of digital pathology, a single Whole-Slide Image (WSI) is a gigapixel monster—a digital map so large that if printed, it would cover a small room. For an AI to "diagnose" cancer from these images, it usually scans for obvious visual patterns. But human pathologists don't just look for what's obvious; they use their years of experience, consult textbooks, and sometimes use genetic data to decide exactly which tiny corner of a slide deserves a closer look.

PathLoop, a new framework presented in this paper, aims to bridge this gap by creating a "self-evolving" multi-agent system that mimics this sophisticated human workflow.

TL;DR

PathLoop is a multi-agent framework for whole-slide image analysis that uses molecular "omics" data to guide its visual search and a curated knowledge base to verify its findings. By maintaining a persistent memory of past cases, it iteratively refines its reasoning to achieve state-of-the-art performance in cancer diagnosis and prognosis.

What Problem Does This Paper Address?

Current AI models for pathology face three major hurdles:

  1. The "Salience" Trap: Most models focus on visually "loud" areas (like large clusters of dark cells) but might miss "quiet" but diagnostically critical regions that aren't visually prominent.
  2. Ignoring the "Why": Existing systems often treat molecular data (genetics/omics) as a sidecar rather than using it to inform where the AI should look on the slide.
  3. No Long-Term Memory: Most AI models treat every patient case as a brand-new problem, failing to accumulate "clinical expertise" or reuse successful reasoning strategies from previous similar cases.

Methods

PathLoop solves these problems by deploying four specialized "agents" that work in a closed loop:

  • Planning Agent: Analyzes the initial query and retrieves relevant "memories" (trajectories and tips) from past cases to formulate a multi-step diagnostic plan.
  • Execution Agent: This is the "eyes" of the system. It operates across three scales:
  • Slide Level: A global overview.
  • Patch Level: Uses an Omics Interpreter to translate genetic data into "molecular intent." For example, if the genetics suggest high cell death, the agent specifically hunts for necrotic regions.
  • Pixel Level: Zooms in (20x) on the most promising areas, using a "projector" to keep the global context in mind while looking at fine details.
  • Judgment Agent: Acts as a peer reviewer. It checks the Execution Agent’s findings against Pathology-Wiki—a structured knowledge base of 48 cancer subtypes. If the findings contradict the "textbook," it triggers a "REVISE" command, forcing the system to re-examine the slide.
  • Persist Agent: The "memory." It stores successful reasoning paths, practical tips, and tool usages. It uses a "credit assignment" system to ensure only helpful experiences are saved for future cases.

Datasets

The researchers evaluated PathLoop using four major cohorts from The Cancer Genome Atlas (TCGA):

  • BRCA (Breast Invasive Carcinoma)
  • LUAD (Lung Adenocarcinoma)
  • BLCA (Bladder Urothelial Carcinoma)
  • UCEC (Uterine Corpus Endometrial Carcinoma)

They also introduced Pathology-Wiki, a newly curated benchmark/knowledge base containing 48 subtype entries across 24 organ systems, complete with IHC (immunohistochemistry) profiles and differential diagnosis links.

Key Insights and Ideas

  • Omics as a Compass: Instead of just "fusing" data at the end, PathLoop uses molecular signals as a search query. This allows the model to find "visually inconspicuous" but biologically significant regions.
  • The "Aha!" Moment of Self-Correction: The Judgment Agent provides a safety net. In one case study, the model initially misidentified a tumor, but the Judgment Agent noticed the visual evidence didn't support the "textbook" definition of that cancer, leading to a re-examination and a correct final diagnosis.
  • Learning Without Retraining: Through the Persist Agent, PathLoop "evolves." It gets better at tasks by remembering which "skills" worked before, effectively gaining experience without needing expensive GPU-heavy parameter updates.

Key Results

PathLoop consistently outperformed state-of-the-art (SOTA) methods, including specialized pathology models and general-purpose giants like GPT-4/Gemini.

  • Superior Accuracy: On the TCGA-BRCA dataset, it achieved a 0.854 AUC for HER2 prediction (significantly higher than the previous best of 0.815).
  • Better Prognosis: In survival risk prediction (C-index), it reached 0.735, outperforming the previous SOTA (SurvPath) at 0.705.
  • Explainability: Unlike "black box" models, PathLoop produces a final report that cites specific visual evidence and matches it against the Pathology-Wiki, making its reasoning transparent to human doctors.

Limitations and Future Work

  • Computational Overhead: The iterative "looping" and multi-agent coordination are more computationally expensive and slower than a simple single-pass model.
  • Knowledge Base Scope: While Pathology-Wiki covers 48 subtypes, human pathology involves thousands. Expanding this knowledge base is a massive manual undertaking.
  • Omics Dependency: The system performs best when molecular data is available. While it can function without it, its unique "omics-guided" advantage is lost in settings where genetic sequencing isn't standard.

Future work will likely focus on automating the expansion of the Pathology-Wiki and optimizing the agents to reduce the time required for each "loop."

Summary updated

Abstract

Analyzing whole-slide images (WSIs) requires combining evidence across tissue regions and spatial scales. Multi-agent systems offer a promising approach to this task. However, existing systems make limited use of molecular evidence, often select visually prominent but less representative regions while overlooking global context, and struggle to reuse experience from previous cases. To address these challenges, we present PathLoop, a self-evolving multi-agent framework that integrates omics data for evidence-grounded WSI analysis. Specifically, PathLoop coordinates visual and omics interpreters across slide, patch, and pixel levels, using molecular signals to guide region selection and combining local tissue details with global slide features. A judgment agent then checks the consistency of the collected evidence against Pathology-Wiki, a knowledge base built from 48 entries across 24 organ systems, and triggers re-examination when the evidence is inconsistent. To reuse past experience, a four-level memory stores reasoning trajectories, practical tips, skills, and tools to guide future cases, forming a loop of evidence collection, review, and memory update. We evaluate PathLoop on four TCGA cohorts with biomarker prediction, survival prediction, and subtype classification. The results demonstrate the effectiveness of PathLoop across these tasks and support its use for evidence-grounded WSI analysis.
BibTeX
@misc{li2026pathloop,
  author = {Jincheng Li and Zhengyi Liu and Zelin Liu and Yihui Zhan and Yifei Sun and Xiangyu Li and Minye Shao and Lingyao Kong and Tao Hou and Xinheng Lyu and Lanfeng Zhong and Ziquan Zhu and Rongzhao Zhang and Rui Yan and S. Kevin Zhou},
  title = {{PathLoop: Self-Evolving Multi-Agent Reasoning for Evidence-Grounded Whole-Slide Image Analysis}},
  year = {2026},
  eprint = {2611.19527},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.19527},
}
Figure