HVSMR-2.0: A 3D cardiovascular MR dataset for whole-heart segmentation in congenital heart disease

Danielle F. Pace, Hannah T. M. Contreras, Jennifer Romanowicz, Shruti Ghelani, Imon Rahaman, Yue Zhang, Patricia Gao, Mohammad Imrul Jubair, Tom Yeh, Polina Golland, Tal Geva, Sunil J. Ghelani, Andrew J. Powell, Mehdi H. MoghariScientific 2024 · DOI

TL;DR

The HVSMR-2.0 dataset provides 60 high-quality 3D cardiovascular magnetic resonance (CMR) scans with expert manual segmentations of eight key cardiac structures in patients with Congenital Heart Disease (CHD). By providing a public benchmark for highly variable and "abnormal" cardiac anatomy, the authors aim to move medical AI beyond "normal" heart models toward tools that can actually assist in complex surgical planning.

What Problem Does This Paper Address?

Most cardiac segmentation algorithms are trained on "normal" anatomy. However, patients with Congenital Heart Disease (CHD) possess hearts that deviate significantly from the textbook: chambers may be swapped, vessels may be transposed, or entire structures might be missing or duplicated.

While 3D models are invaluable for planning the complex surgeries these patients require, creating them manually is a grueling process that takes experts hours per patient. Existing public datasets are either too small, focused on CT rather than radiation-free MRI, or only provide "global" labels (like "blood pool") rather than individual labels for the four chambers and four great vessels. HVSMR-2.0 fills this gap by providing a diverse, multiclass dataset specifically for the CHD population.

Methods

The researchers curated 60 3D CMR scans from Boston Children’s Hospital, representing a spectrum of CHD severity (Mild, Moderate, and Severe).

To create the ground-truth segmentations, they employed a multi-stage pipeline:

  1. Manual Foundation: The first 20 cases were segmented entirely by hand using 3D Slicer.
  2. Semi-Automatic Bootstrapping: For the remaining 40 cases, they used an ensemble of four 3D U-Nets (trained on the first 20) to generate initial masks, which were then rigorously corrected by human experts.
  3. Intensity Normalization: They developed a custom normalization scheme that rescales intensities based on the "cardiac blood pool" and "lung" values, helping the models handle the inherent variability in MRI signal.
  4. Optional Vessel Zones: Recognizing that "where a vessel ends" is often arbitrary in a scan, the authors defined "required" and "optional" zones for the great vessels. This allows for a fairer evaluation—algorithms aren't penalized for segmenting a bit more or less of the aorta than the human rater did.

Datasets

The primary contribution is the HVSMR-2.0 dataset (60 scans). It relates to several existing benchmarks:

  • HVSMR (1.0): The predecessor, which had only 20 scans and only two labels (blood pool and myocardium).
  • MM-WHS: Contains only 16 MR images from CHD patients.
  • ImageCHD: A larger dataset, but composed of CT images rather than CMR.

Key Insights and Ideas

  • The "Severe" Performance Gap: A baseline 3D U-Net achieved a respectable ~87% Dice score on "mild" and "moderate" cases but plummeted to ~64% on "severe" cases. This highlights that current state-of-the-art AI still struggles with "topological" surprises (e.g., a single ventricle).
  • Anatomy over Location: In CHD, the "left" ventricle might be on the right side of the body. The authors emphasize that labels must be based on anatomical characteristics (morphology) rather than spatial position, a major challenge for standard convolutional neural networks.
  • Fair Comparison via "Optional Zones": By explicitly labeling which parts of the superior vena cava or aorta are "required" versus "optional," the authors provide a solution to a common frustration in medical imaging challenges: being penalized for "over-segmenting" a vessel that is clearly visible but wasn't part of the rater's arbitrary cutoff.

Key Results

  • Dataset Composition: 60 subjects ranging from infants (<1 year) to adults (52 years), with a median age of 10.
  • Structural Labels: 8 foreground classes: Left Ventricle (LV), Right Ventricle (RV), Left Atrium (LA), Right Atrium (RA), Aorta (AO), Pulmonary Artery (PA), Superior Vena Cava (SVC), and Inferior Vena Cava (IVC).
  • Baseline Benchmark: Using a 3D U-Net ensemble, the authors established that while "mild" cases are approaching "solved" status, "severe" CHD remains a significant frontier for the field.

Limitations and Future Work

The authors acknowledge that 60 cases, while a significant improvement over previous datasets, is still a small sample size for the massive diversity of CHD. Furthermore, they chose not to label the myocardium (the heart muscle wall), focusing instead on the blood pool of the chambers and vessels, which are more critical for current 3D-printed surgical models.

Future work suggested by the paper includes exploring interactive segmentation (where AI and humans work in a loop), transformer-based models, and topological priors to help neural networks understand that even a malformed heart must follow certain "logical" connectivity rules.

Summary updated

Abstract

Patients with congenital heart disease often have cardiac anatomy that deviates significantly from normal, frequently requiring multiple heart surgeries. Image segmentation from a preoperative cardiovascular magnetic resonance (CMR) scan would enable creation of patient-specific 3D surface models of the heart, which have potential to improve surgical planning, enable surgical simulation, and allow automatic computation of quantitative metrics of heart function. However, there is no publicly available CMR dataset for whole-heart segmentation in patients with congenital heart disease. Here, we release the HVSMR-2.0 dataset, comprising 60 CMR scans alongside manual segmentation masks of the 4 cardiac chambers and 4 great vessels. The images showcase a wide range of heart defects and prior surgical interventions. The dataset also includes masks of required and optional extents of the great vessels, enabling fairer comparisons across algorithms. Detailed diagnoses for each subject are also provided. By releasing HVSMR-2.0, we aim to encourage development of robust segmentation algorithms and clinically relevant tools for congenital heart disease.
BibTeX
@inproceedings{pace2024hvsmr,
  author = {Danielle F. Pace and Hannah T. M. Contreras and Jennifer Romanowicz and Shruti Ghelani and Imon Rahaman and Yue Zhang and Patricia Gao and Mohammad Imrul Jubair and Tom Yeh and Polina Golland and Tal Geva and Sunil J. Ghelani and Andrew J. Powell and Mehdi H. Moghari},
  title = {{HVSMR-2.0: A 3D cardiovascular MR dataset for whole-heart segmentation in congenital heart disease}},
  booktitle = {Scientific},
  year = {2024},
  doi = {10.1038/s41597-024-03469-9},
}
Figure