Can AI Agents Interface Clinicians and Complex Models?

Giulio Colombini, Matteo Falcioni, Mario Massimo, Francesco Durazzi, Marianna Santoro, Paolo Tubertini, Mirko Degli Esposti, Armando BazzaniarXiv 2026 · arXiv

TL;DR

The authors present EpidemIA, a multi-agent AI system that allows clinicians to interact with complex epidemiological models and clinical data using natural language. By deploying an open-weights Large Language Model (LLM) locally, the system bridges the methodological gap between medical professionals and data scientists while strictly maintaining patient data privacy.

What Problem Does This Paper Address?

Modern healthcare generates mountains of data, but the sophisticated tools needed to extract insights—such as dynamical models from mathematical biology and complex systems physics—often remain locked behind a "language barrier." Clinicians and hospital administrators typically lack the specialized coding and mathematical training required to implement these models, while the physicists and data scientists who build them are often removed from daily clinical operations.

Furthermore, standard LLMs (like GPT-4) are ill-suited for this task in isolation. They struggle with precise numerical reasoning, cannot natively interact with local clinical files, and pose significant privacy risks if sensitive patient data is uploaded to third-party cloud providers.

Methods

The researchers developed EpidemIA, a training-free Multi-Agent System (MAS) built on the LangGraph framework. The system architecture (shown in Figure 2) splits responsibilities between two specialized agents:

  1. The Supervisor: Acts as the primary interface. It decomposes user queries, reformulates vague requests into technical directives, and aggregates the final results into a readable report.
  2. The Analyst: The "engine room" of the system. It uses a suite of tools to explore datasets, filter data, and—crucially—execute expert-written Python models.
Figure 2: Architecture of our system. The user queries EpidemIA, which accesses clinical data and epidemiological models as needed - through the analyst agent - in order to produce a clear, readable output.

A key design choice was the use of Qwen3.8:27B as the backbone LLM. This open-weights model was run locally on a single NVIDIA RTX A6000 GPU. This ensures that no data leaves the hospital infrastructure, satisfying strict privacy regulations like GDPR.

Datasets

The system was tested using a real-world dataset of Emergency Department (ED) visits provided by the IRCCS Sant’Orsola in Bologna, Italy. This dataset was enriched with laboratory results from flu swabs, allowing the agents to correlate hospital workload with actual pathogen prevalence. Due to privacy laws, this dataset is not public, highlighting the necessity of EpidemIA’s local-first approach.

Key Insights and Ideas

  • Modular Reliability: Unlike many AI "coders," the Analyst agent does not write the epidemiological equations from scratch. Instead, it calls pre-validated, human-expert-written modules (like SIR or SEIR models). This prevents the LLM from "hallucinating" incorrect physics or math while still allowing it to handle the "glue code" for data processing and visualization.
  • The Agentic Loop: The system uses an "agentic loop" (illustrated in Figure 1), where the LLM can iteratively call tools, check outputs, and refine its approach before presenting a final answer to the user.
  • Small Model, High Intelligence: The authors demonstrate that a 27-billion parameter model is sufficient for complex reasoning tasks in a specialized domain, rivaling much larger frontier models (see Figure 3).
Figure 1: An example of AI agent architecture: an LLM backbone is given the ability to execute external functions - its tools - in a loop, to perform complex tasks.
Figure 3: Snapshot of the Artificial Analysis Intelligence Index as of September 13th, 2026. The LLM we employed - Qwen3.8 27B - reaches a significative level of intelligence, comparable to that of frontier open source models, at a fraction of their size.

Key Results

The authors validated EpidemIA through four distinct use cases:

  • Statistical Analysis: The agent successfully extracted "Red Code" (most urgent) emergency visits for a specific month and generated descriptive statistics and histograms.
  • Automated Forecasting: When asked for a flu prediction, the Supervisor defaulted to a standard SIR model. The Analyst filtered the swab data, fitted the model parameters (finding an $R_0$ of 1.226), and projected a decline in cases through March 2026.
  • "What-if" Scenarios: In a particularly impressive test, the user asked: "What if the $R_0$ is 5% higher?" The agent recalibrated the model and produced a comparative visualization, showing that a 5% increase in transmissibility would lead to a 33% higher peak in hospitalizations.

Limitations and Future Work

The primary limitation is evaluation. Because the underlying clinical data is private, it is difficult for the broader research community to reproduce these exact tests. The authors suggest using "LLM-as-a-judge" techniques and synthetic datasets for future benchmarking.

Next steps include:

  • Integrating environmental data (e.g., weather/heatwave sensors) to predict non-infectious health hazards.
  • Implementing Text-to-SQL capabilities to allow the agents to query massive institutional databases directly rather than relying on exported CSV files.
  • Scaling the MAS to include more specialized sub-agents for different medical departments.

Summary updated

Abstract

Background: Contemporary healthcare institutions generate daily very large amounts of data, which contain highly useful information for the improvement of work organization, planning and overall efficiency. While models and techniques to extract these insights are well known and constantly developed in mathematical biology, complex systems physics and data science, the adoption of these techniques among Clinicians and Hospital Administrators remains limited, mainly due to language and methodological divides. Objective: In this article we implement an AI Multi Agent System (MAS) that allows Users to use predictive models and make statistical analyses via natural language conversations. Methods: We developed EpidemIA, a training-free MAS endowed with a modular suite of epidemiological models written by human experts, executable on a single-GPU workstation. To avoid relaying sensitive data to third parties, the system uses locally an open-weights LLM as backbone for its two subagents. Results: Using a dataset of Emergency Department visits provided to us by IRCCS Sant'Orsola (Bologna) we test the model on a few typical use cases, demonstrating the possibility of performing both simpler statistical analyses and visualizations as well as more complicated epidemiological predictions based on dynamical models, through simple queries made in natural language. Conclusions: While still being a proof-of-concept implementation, EpidemIA showcases the transformative capabilities of LLM based technologies as an enabling factor in the widespread adoption of complex dynamical models, which is at present hindered by their steep learning curve.
BibTeX
@misc{colombini2026can,
  author = {Giulio Colombini and Matteo Falcioni and Mario Massimo and Francesco Durazzi and Marianna Santoro and Paolo Tubertini and Mirko Degli Esposti and Armando Bazzani},
  title = {{Can AI Agents Interface Clinicians and Complex Models?}},
  year = {2026},
  eprint = {2610.39681},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.39681},
}
Figure