Prompt2Echo (P2Echo): Text-Prompted Multi-View Echocardiography Segmentation with One Model

Moein Heidari, Alvin Kimbowa, Mahdi Tabatabaei, Afshin Bozorgpour, Sina Ghorbani Kolahi, River Jiang, Wenjin Chen, David J. Foran, Jasmine Grewal, Dorit Merhof, Ilker HacihalilogluarXiv 2026 · arXiv

TL;DR

Prompt2Echo (P2Echo) is a unified framework that uses structured text prompts to segment multiple cardiac structures across various echocardiographic views with a single, efficient model. By introducing a novel Dynamic Image-Text Alignment (DyITA) module, it outperforms both view-specific "specialist" models and massive foundation models while running at a fraction of the computational cost (64+ FPS).

What Problem Does This Paper Address?

Echocardiography (ultrasound of the heart) is notoriously difficult for AI because the heart's appearance changes drastically depending on the "acoustic window" or view used (e.g., 4-chamber vs. short-axis). Traditionally, researchers have built "siloed" models—one for each view—because a single model trained on all views often converges to a mediocre average that fails to capture view-specific nuances.

Beyond appearance disparity, the authors highlight several "real-world" hurdles:

  • Acquisition shifts: Different scanners and settings change image texture.
  • Anatomical variability: Heart shapes and sizes vary significantly between patients.
  • Image quality: Ultrasound is plagued by speckle noise, shadowing, and signal dropout, which blur anatomical boundaries.
Fig. 1: Key challenges in multi-view echocardiography image segmentation: (a) cross-view appearance disparity, (b) acquisition-domain shift, (c) inter-subject anatomical variabil- ity, (d) view-specific anatomical visibility, and (e) boundary degradation from speckle, shadowing, and signal dropout. Colored contours denote the annotated cardiac structures.

Methods

P2Echo moves away from implicit "latent priors" used in many foundation models. Instead, it uses explicit conditioning via structured text prompts (e.g., "View: 4CH. Target: LV. Description: Bullet-shaped, forms apex.").

The architecture consists of a dual-encoder (PVTv2 for images and a frozen Qwen3-Embedding for text) and a multi-stage decoder. The core innovation is the Dynamic Image-Text Alignment (DyITA) module, which performs three key operations at every decoder stage:

  1. Dynamic Projection: Uses a differentiable routing mechanism to select specialized "projectors" for different views, allowing the network to "switch" its internal pathways based on the prompt.
  2. Dynamic Measure Kernel: A token-adaptive sharpening mechanism that emphasizes dominant feature dimensions before alignment.
  3. Cross-Modal Differential Operator: This suppresses redundant correlations between image and text, forcing the model to focus only on the evidence that matches the specific prompt.
The P2Echo framework architecture featuring the DyITA module.

Datasets

The researchers curated and harmonized eight echocardiography datasets to create a unified multi-view benchmark.

  • Internal Development: Camus, CardiacUDA, EchoCP, EchoNet-Pediatric, and SegRWMA.
  • External Evaluation (Held-out): CardiacNet, EchoNet-Dynamic, and HMC_QU.

A significant effort was made to harmonize heterogeneous labels (pixel values, binary masks, and contours) into a common space for five structures: Left Ventricle (LV), Myocardium (MYO), Left Atrium (LA), Right Ventricle (RV), and Right Atrium (RA).

Key Insights and Ideas

  • Explicit > Implicit: While many "Segment Anything" (SAM) adaptations for medical imaging rely on learned visual prompts, P2Echo shows that natural language descriptions provide a more controllable and robust signal for resolving anatomical ambiguity.
  • Routing is Key: Instead of a static fusion of text and image, the dynamic routing in DyITA allows a single set of weights to act like a collection of specialists.
  • Differential Alignment: By explicitly subtracting "redundant" cross-modal responses, the model becomes much better at ignoring noise and focusing on the requested anatomy, even in low-contrast regions.

Key Results

P2Echo demonstrates that "one model to rule them all" is possible in echocardiography:

  • Performance: It achieved a median gain of 2.33% Dice across all evaluated datasets compared to the strongest baselines. On the 2-chamber view, it improved Dice scores by 5.3 points over EchoONE.
  • Efficiency: The model is incredibly lean, requiring only 6.90 GFLOPs and achieving 64.68 FPS on an NVIDIA H100. This is 4–160× more efficient than other promptable foundation models.
  • Generalization: It maintained high accuracy on external, held-out datasets, proving it isn't just memorizing its training data but has learned robust anatomical features.
Qualitative comparison showing P2Echo's superior cavity delineation across different views.

Limitations and Future Work

Despite its success, P2Echo has a few areas for improvement:

  • Prompt Sensitivity: The model performs best with the structured "canonical" template. Using free-form clinical language or very concise prompts (e.g., "segment the LV") leads to a significant drop in accuracy.
  • View Constraints: The current study focuses on four standard views. It remains to be seen how well the model generalizes to non-standard or "off-axis" views.
  • Clinical Metrics: The evaluation focused on segmentation accuracy (Dice/HD95). Future work will need to validate if these improvements translate into more accurate clinical measurements like Ejection Fraction (EF).

The authors suggest that paraphrase-augmented training could be a promising path to make the model more robust to the varied ways clinicians describe anatomy.

Summary updated

Abstract

Automated segmentation in multi-view echocardiography is essential for comprehensive cardiac assessment, yet remains challenging due to substantial anatomical and appearance variability across standard acoustic windows. In this paper, we present P2Echo, a unified framework capable of segmenting diverse cardiac structures across multiple standard echocardiographic views using a single model controlled by structured view-aware text prompts. Unlike recent foundation model adaptations that rely on implicit latent priors, P2Echo explicitly conditions the segmentation process via a novel Dynamic Image-Text Alignment (DyITA) module. DyITA integrates a differentiable routing mechanism and token differential operators to dynamically modulate decoder features according to the requested view and target structure. This allows the network to adaptively switch its processing pathways for different views without architectural changes. Extensive experiments on a large-scale internal dataset (seen during training) and held-out evaluation on three external datasets demonstrate that P2Echo matches or exceeds both view-specific specialists and state-of-the-art universal models at a fraction of their computational cost, offering an efficient, controllable solution for multi-plane cardiac analysis. Code is available at: https://github.com/moeinheidari7829/P2Echo.
BibTeX
@misc{heidari2026prompt,
  author = {Moein Heidari and Alvin Kimbowa and Mahdi Tabatabaei and Afshin Bozorgpour and Sina Ghorbani Kolahi and River Jiang and Wenjin Chen and David J. Foran and Jasmine Grewal and Dorit Merhof and Ilker Hacihaliloglu},
  title = {{Prompt2Echo (P2Echo): Text-Prompted Multi-View Echocardiography Segmentation with One Model}},
  year = {2026},
  eprint = {2611.13425},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.13425},
}
Figure