An Agentic AI Workflow for Liver Lesion Segmentation and Structured Radiology Reporting

Fatma Ahmed Mansour, Rahatara Ferdousi, Manar Fathy ElshenawyarXiv 2026 · arXiv

TL;DR

Researchers have developed an "agentic" AI workflow that transforms raw CT scans into structured, traceable radiology reports for liver lesions. By using deterministic computational tools to calculate measurements before handing them to a Large Language Model (LLM) for report assembly, the system ensures that every number in the final report is grounded in image evidence rather than LLM "hallucinations."

What Problem Does This Paper Address?

While AI models have become quite good at segmenting (outlining) organs and tumors in medical images, there is a massive "last-mile" gap between a colorful segmentation mask and a clinically useful radiology report.

Currently, radiologists must manually measure lesions and dictate findings, which is time-consuming and prone to variability. While LLMs could theoretically automate report writing, they are notorious for "hallucinating"—generating plausible-sounding but factually incorrect numbers. In medicine, a hallucinated tumor measurement isn't just a bug; it's a patient safety risk. This paper tackles the challenge of creating an automated pipeline that is both clinically relevant and strictly traceable to the source data.

Methods

The authors propose a five-stage agentic workflow designed to prioritize transparency:

  1. AI Segmentation: The system uses nnU-Net models (via the TotalSegmentator framework) to delineate the liver, specific anatomical regions (Couinaud segments), and lesions.
  2. Deterministic Extraction: Instead of asking an LLM to "look" at the image, a Python-based computational layer calculates volumes, dimensions, and counts directly from the 3D segmentation masks.
  3. Diagnostic Context: A tool called RADAR estimates probabilities for 18 different liver-related findings to provide supplementary context.
  4. Agentic Report Generation: An LLM agent receives the structured data (in JSON format) and organizes it into a predefined reporting schema.
  5. Verification & Review: The system performs automated numerical consistency checks to ensure the LLM didn't alter any measurements. Finally, a radiologist reviews the report alongside visual overlays of the segmentation.
Fig. 1: Overview of the proposed agentic AI workflow

Datasets

The study utilized two primary data sources:

  • LiTS (Liver Tumor Segmentation Benchmark): 51 CT cases were used to evaluate how well the AI could identify and measure lesions.
  • MERLIN: A large-scale dataset of 25,494 radiology reports used for an exploratory screening task to identify the prevalence of liver abnormalities in general clinical practice.

Key Insights and Ideas

  • Separation of Concerns: The core "aha moment" is the strict separation between computation (math) and composition (language). By forcing the LLM to act as an editor of deterministic data rather than a calculator, the researchers eliminate the primary source of AI hallucinations in medical reporting.
  • Traceability as a Feature: Every measurement in the report is linked back to its computational source. This "evidence-grounded" approach is essential for human-centered AI, where a radiologist must be able to verify the AI's work quickly.
  • Couinaud Localization: The system doesn't just find a lesion; it automatically assigns it to one of the eight Couinaud segments of the liver based on mask overlap, providing the specific anatomical context surgeons need.

Key Results

The system demonstrated strong performance in both segmentation and detection:

  • Liver Segmentation: Achieved a Dice score of 0.947, indicating near-perfect overlap with human expert outlines.
  • Lesion Detection: The model reached a sensitivity of 75.6%, outperforming some previous benchmarks (65.7%), though this came with a trade-off in precision (PPV of 68.9%).
  • Exploratory Screening: When applied to the massive MERLIN dataset, the system identified liver-related abnormalities in 40% of the reports, showcasing its potential for large-scale clinical auditing.
Fig. 2: Representative CT segmentation masks illustrating the delineated liver and lesions.

Limitations and Future Work

The authors acknowledge several areas for improvement:

  • Lesion Segmentation Difficulty: While liver segmentation is highly accurate, lesion segmentation remains challenging (Dice score of 0.63), as tumors can be small and have poorly defined boundaries.
  • Small Evaluation Cohort: The performance was tested on only 51 cases; larger, more diverse datasets are needed to prove reliability across different hospital settings.
  • Clinical Usability: While the framework exists, the authors have not yet quantitatively evaluated how much time it actually saves radiologists or how it affects their diagnostic accuracy in a real-world workflow.

Future work will focus on validating measurement accuracy against reference annotations and refining the "agentic" behavior to handle longitudinal studies (comparing current scans to previous ones).

Summary updated

Abstract

Despite advances in automated liver lesion segmentation, a gap remains between image-derived predictions and clinically interpretable radiology reports. Bridging this gap requires quantitative measurements that are both reproducible and traceable. We present an evidence-grounded agentic AI framework that connects liver and lesion segmentation with deterministic quantification and structured reporting. TotalSegmentator-based nnU-Net models delineate the liver, Couinaud segments, and lesions, while computational tools extract volumes, dimensions, counts, and anatomical locations. A large language model (LLM) organizes these measurements into a predefined reporting schema, with numerical consistency checks against source measurements. On 51 LiTS cases, the segmentation stage achieved a liver Dice score of 0.947, lesion sensitivity of 75.6%, and positive predictive value of 68.9%. Exploratory screening of 25,494 MERLIN reports identified 10,208 (40.0%) with liver-related abnormalities. By connecting quantitative imaging evidence with agentic report generation, this work takes a step toward human-centered medical AI that prioritizes traceability and clinical relevance.
BibTeX
@misc{mansour2026agentic,
  author = {Fatma Ahmed Mansour and Rahatara Ferdousi and Manar Fathy Elshenawy},
  title = {{An Agentic AI Workflow for Liver Lesion Segmentation and Structured Radiology Reporting}},
  year = {2026},
  eprint = {2610.34599},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.34599},
}
Figure