Toward Content-Based Indexing and Retrieval of Head and Neck CT With Abscess Segmentation

Thao Thi Phuong Dao, Tan-Cong Nguyen, Trong-Le Do, Truong Hoang Viet, Nguyễn Duy Thành, Huynh Nguyen Thuan, Do Vo Cong Nguyen, Minh-Khoi Pham, Mai-Khiem Tran, Viet-Tham Huynh, Trong-Thuan Nguyen, Trung-Nghia Leo, Vo Thanh Toan, Tam V. Nguyen, Minh–Triet Tran, Thanh Dinh Le

Introduction

Head and neck abscesses are severe, localized infections that can lead to life-threatening complications like airway obstruction or sepsis if not treated promptly. Contrast-Enhanced Computed Tomography (CECT) is the gold standard for diagnosing these lesions and planning surgical drainage. However, segmenting these abscesses is notoriously difficult—even for expert clinicians—due to complex surrounding anatomy, irregular boundaries, and heterogeneous internal fluid density.

While AI has advanced medical image segmentation, most public head and neck datasets focus on oncology. This paper introduces AbscessHeNe, the first publicly available dataset dedicated to head and neck abscess segmentation, laying the groundwork for automated diagnostic and retrieval tools.

The AbscessHeNe Dataset

The AbscessHeNe dataset comprises 4,926 CECT slices from 47 patients, featuring high-quality, pixel-wise ground truth masks. To ensure anatomical accuracy, the authors developed a rigorous, multi-stage annotation pipeline involving independent clinicians and senior expert adjudication.

The multi-stage annotation pipeline for the AbscessHeNe dataset, ensuring high-quality ground truth through expert consensus.

Methodology

The authors benchmarked a spectrum of modern segmentation architectures, including CNNs (U-Net), Transformers (TransUNet, UNETR, Swin-UNETR), and State Space Models (Swin-UMamba, VM-UNet). Beyond segmentation, the study proposes a prototype Content-Based Image Retrieval (CBIR) pipeline. In this system, segmented masks act as semantic anchors. By combining image embeddings with clinical metadata (e.g., location, multiloculated status), the system allows clinicians to query the database for visually and clinically similar historical cases to aid decision-making.

Experimental Results

Benchmarking results highlight the extreme difficulty of abscess segmentation. The best-performing model, VM-UNet, achieved a Dice Similarity Coefficient (DSC) of only 0.39, indicating significant room for algorithmic innovation. Interestingly, the classic U-Net remained highly competitive, outperforming several complex Transformer-based models.

Quantitative performance comparison of various segmentation models on the AbscessHeNe dataset.

VM-UNet demonstrated superior computational efficiency, requiring only 4.11 G FLOPs compared to U-Net's 54.74 G, while achieving the highest scores across DSC, mIoU, and HD95 metrics. Qualitative analysis shows that most models struggle with the fuzzy boundaries and low contrast typical of these infectious lesions.

Discussion and Future Work

The modest baseline scores confirm that standard off-the-shelf models struggle with the indistinct boundaries and class imbalance of abscesses. However, the efficiency and accuracy of Mamba-based models (like VM-UNet) suggest that State Space Models are a viable path forward for complex medical vision tasks.

Future work will focus on expanding the dataset and exploring boundary-aware loss functions and retrieval-augmented training to improve segmentation performance and clinical utility.

Summary updated

Abstract

Abscesses in the head and neck represent an acute infectious process that can potentially lead to sepsis or mortality if not diagnosed and managed promptly. Accurate detection and delineation of these lesions on imaging are essential for diagnosis, treatment planning, and surgical intervention. In this study, we introduce AbscessHeNe, a curated and comprehensively annotated dataset comprising 4,926 contrastenhanced CT slices with clinically confirmed head and neck abscesses. The dataset is designed to facilitate the development of robust semantic segmentation models that can accurately delineate abscess boundaries and evaluate deep neck space involvement, thereby supporting informed clinical decision-making. To establish performance baselines, we evaluate several state-of-the-art segmentation architectures, including CNN, Transformer, and Mamba-based models. The highestperforming model achieved a Dice Similarity Coefficient of 0.39, Intersection-over-Union of 0.27, and Normalized Surface Distance of 0.67, indicating the challenges of this task and the need for further research. Beyond segmentation, AbscessHeNe is structured for future applications in content-based multimedia indexing and case-based retrieval. Each CT scan is linked with pixel-level annotations and clinical metadata, providing a foundation for building intelligent retrieval systems and supporting knowledge-driven clinical workflows. The dataset will be made publicly available at https://github.com/drthaodao3101/AbscessHeNe.git.
BibTeX
@misc{dao2025toward,
  author = {Thao Thi Phuong Dao and Tan-Cong Nguyen and Trong-Le Do and Truong Hoang Viet and Nguyễn Duy Thành and Huynh Nguyen Thuan and Do Vo Cong Nguyen and Minh-Khoi Pham and Mai-Khiem Tran and Viet-Tham Huynh and Trong-Thuan Nguyen and Trung-Nghia Leo and Vo Thanh Toan and Tam V. Nguyen and Minh–Triet Tran and Thanh Dinh Le},
  title = {{Toward Content-Based Indexing and Retrieval of Head and Neck CT With Abscess Segmentation}},
  year = {2025},
  eprint = {2512.01589},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2512.01589},
}
Figure