Toward Content-based Indexing and Retrieval of Head and Neck CT with Abscess Segmentation

Thao Thi Phuong Dao, Tan-Cong Nguyen, Trong-Le Do, Truong Hoang Viet, Nguyen Chi Thanh, Huynh Nguyen Thuan, Do Vo Cong Nguyen, Minh-Khoi Pham, Mai-Khiem Tran, Viet-Tham Huynh, Trong-Thuan Nguyen, Trung-Nghia Le, Vo Thanh Toan, Tam V. Nguyen, Minh-Triet Tran, Thanh Dinh Le

TL;DR

This paper introduces AbscessHeNe, the first publicly available, comprehensively annotated contrast-enhanced CT (CECT) dataset dedicated to head and neck abscess segmentation. By benchmarking convolutional, Transformer, and state-space (Mamba) architectures, the authors demonstrate that while Mamba-based models lead the pack, the intricate anatomy and low contrast of abscess boundaries make this an exceptionally challenging task. Furthermore, the dataset is uniquely structured to pioneer future content-based image retrieval (CBIR) systems for clinical decision support.

What Problem Does This Paper Address?

Head and neck abscesses are acute, pus-filled infections that can rapidly escalate into life-threatening complications like airway obstruction or septic shock if not treated promptly. While contrast-enhanced computed tomography (CECT) is the gold standard for evaluation, precisely delineating abscess boundaries is incredibly difficult. The complex anatomy of the deep cervical spaces—packed with vital blood vessels and nerves—becomes distorted by inflammation and edema.

While AI has made massive strides in medical imaging, existing head and neck CT datasets focus almost exclusively on oncology (tumor segmentation and organs-at-risk for radiotherapy planning). This leaves a critical gap for non-oncologic, emergency conditions. The authors address this lack of data by releasing a curated dataset and establishing baseline performance metrics to spark research in automated abscess segmentation and case-based clinical retrieval.

Methods

The authors established a rigorous, multi-stage data annotation pipeline to ensure ground-truth reliability:

  1. Initial Annotation: Two independent doctors manually segmented abscess boundaries at the pixel level.
  2. Consensus Review: The annotators jointly resolved any discrepancies.
  3. Expert Adjudication: A senior expert reviewed all segmentations and reports to ensure anatomical accuracy and make final decisions on disputed cases.
Fig. 1. Comprehensive pipeline for building AbscessHeNe dataset.

Using this dataset, they benchmarked three distinct deep learning paradigms:

  • CNNs: Traditional U-Net, which excels at local spatial details.
  • Transformers: TransUNet, UNETR, and Swin-UNETR, which leverage self-attention to capture long-range dependencies.
  • State Space Models (Mamba): Swin-UMamba and VM-UNet, which offer long-range modeling capabilities similar to Transformers but with highly efficient linear complexity.

Beyond standalone segmentation, the authors designed a conceptual framework for a Content-Based Image Retrieval (CBIR) prototype. This pipeline uses a vector database (FAISS) to match image embeddings with structured clinical metadata (e.g., location, patient age, multiloculated status), allowing clinicians to search for visually and contextually similar historical cases.

Datasets

The newly introduced AbscessHeNe dataset consists of 4,926 contrast-enhanced CT slices derived from 47 clinically confirmed patient cases.

  • Data Split: 80% training (3,935 images) and 20% testing (991 images).
  • Format: Images are provided in PNG format, resized to 512 × 512 pixels, and paired with pixel-wise ground-truth masks.
  • Availability: The dataset is open-sourced on GitHub.

Key Insights and Ideas

  • The Mamba Advantage: Mamba-based architectures, particularly VM-UNet, proved to be highly effective for this task. They successfully balance the global context-awareness of Transformers with a fraction of the computational overhead (FLOPs).
  • A High Bar for Medical AI: The top-performing model only achieved a Dice Similarity Coefficient (DSC) of 0.39. This modest score underscores that head and neck abscess segmentation is far from solved. The irregular shapes, variable sizes, and low contrast at the soft-tissue interface present a severe challenge to current state-of-the-art models.
  • Moving Beyond Segmentation: By pairing pixel-level masks with rich metadata, the authors shift the paradigm from pure segmentation toward "case-based reasoning," where an AI doesn't just draw boundaries but helps doctors find similar past cases to guide surgical drainage planning.

Key Results

Quantitatively, VM-UNet outperformed all other architectures across almost every metric while remaining incredibly lightweight:

  • VM-UNet: Achieved the highest DSC of 0.39, a mean Intersection-over-Union (mIoU) of 0.27, a Normalized Surface Distance (NSD) of 0.67, and the lowest 95th percentile Hausdorff Distance (HD95) of 21.27 mm. Crucially, it required only 4.11 G FLOPs of computational power.
  • U-Net: Was the strongest non-Mamba baseline, achieving a DSC of 0.35, though it required significantly more computation (54.74 G FLOPs).
  • Transformers: Pure Transformer models like UNETR struggled significantly on this task, posting a lower DSC of 0.22.
Fig. 3. Visualization of results from the different models on our AbscessHeNe dataset for segmentation.

Qualitative evaluations (Figure 3) confirmed that while most models suffered from false positives and struggled with indistinct boundaries, VM-UNet's predictions aligned most closely with the expert ground truth.

Limitations and Future Work

The primary limitation of this study is the cohort size: the dataset is built from 47 patients (split into 40 training and 7 testing cases), evaluated on a single train/test split. This limits immediate statistical robustness and generalizability.

To address this, the authors plan to expand AbscessHeNe with more cases and richer metadata. Future algorithmic directions will explore boundary-aware loss functions, multi-window Hounsfield Unit (HU) normalization to better capture tissue density, and 3D contextual modeling to improve boundary precision.

Summary updated

Abstract

Abscesses in the head and neck represent an acute infectious process that can potentially lead to sepsis or mortality if not diagnosed and managed promptly. Accurate detection and delineation of these lesions on imaging are essential for diagnosis, treatment planning, and surgical intervention. In this study, we introduce AbscessHeNe, a curated and comprehensively annotated dataset comprising 4,926 contrast-enhanced CT slices with clinically confirmed head and neck abscesses. The dataset is designed to facilitate the development of robust semantic segmentation models that can accurately delineate abscess boundaries and evaluate deep neck space involvement, thereby supporting informed clinical decision-making. To establish performance baselines, we evaluate several state-of-the-art segmentation architectures, including CNN, Transformer, and Mamba-based models. The highest-performing model achieved a Dice Similarity Coefficient of 0.39, Intersection-over-Union of 0.27, and Normalized Surface Distance of 0.67, indicating the challenges of this task and the need for further research. Beyond segmentation, AbscessHeNe is structured for future applications in content-based multimedia indexing and case-based retrieval. Each CT scan is linked with pixel-level annotations and clinical metadata, providing a foundation for building intelligent retrieval systems and supporting knowledge-driven clinical workflows. The dataset will be made publicly available at https://github.com/drthaodao3101/AbscessHeNe.git.
BibTeX
@misc{dao2025toward,
  author = {Thao Thi Phuong Dao and Tan-Cong Nguyen and Trong-Le Do and Truong Hoang Viet and Nguyen Chi Thanh and Huynh Nguyen Thuan and Do Vo Cong Nguyen and Minh-Khoi Pham and Mai-Khiem Tran and Viet-Tham Huynh and Trong-Thuan Nguyen and Trung-Nghia Le and Vo Thanh Toan and Tam V. Nguyen and Minh-Triet Tran and Thanh Dinh Le},
  title = {{Toward Content-based Indexing and Retrieval of Head and Neck CT with Abscess Segmentation}},
  year = {2025},
  eprint = {2512.01589},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2512.01589},
}
Figure