TUNA-Net: Task-Oriented UNsupervised Adversarial Network for Disease Recognition in Cross-domain Chest X-rays

Yuxing Tang, Youbao Tang, Veit Sandfort, Jing Xiao, Ronald M. Summers

TL;DR

TUNA-Net is a novel unsupervised domain adaptation (UDA) framework designed to bridge the gap between different medical imaging datasets—specifically adapting pneumonia recognition from adult to pediatric chest X-rays. By integrating task-specific semantic constraints into a Cycle-GAN architecture, it achieves a 96.3% AUC on unlabeled target data, nearly matching the performance of fully supervised models.

What Problem Does This Paper Address?

Deep learning models in radiology often suffer from "domain shift." A model trained on X-rays from one hospital or age group (e.g., adults) frequently performs poorly when applied to another (e.g., children) due to differences in anatomy, imaging protocols, and hardware.

While we can fix this with supervised learning, labeling medical data is incredibly expensive and requires hours of expert clinician time. Unsupervised Domain Adaptation (UDA) aims to solve this by "translating" knowledge from a labeled source domain to an unlabeled target domain. However, existing UDA methods (like standard Cycle-GANs) often focus on matching the general "style" of images while accidentally erasing the very disease features (like lung opacities) the model is supposed to detect.

Methods

The authors propose TUNA-Net (Task-oriented UNsupervised Adversarial Network). It builds on the Cycle-GAN architecture—which learns to translate images between two domains (A $\leftrightarrow$ P) without paired examples—but adds three critical layers of "constraints" to ensure the disease information isn't lost in translation:

  1. Low-level Detail Preservation: Uses standard cycle-consistency loss to ensure the translated image can be reconstructed back to the original.
  2. High-level Semantic Modeling: This is the "task-oriented" secret sauce. The authors introduce auxiliary classifiers ($F_A$ and $F_P$). These force the generators to ensure that if an adult X-ray has pneumonia, its synthetic pediatric version also clearly displays pneumonia features.
  3. Mid-level Feature Regularization: Inspired by perceptual loss, this ensures that the internal "feature maps" (the way a CNN "sees" the image) for real pediatric X-rays and synthetic pediatric X-rays are statistically similar.

By optimizing these simultaneously, the model learns to generate "radio-realistic" images that preserve the clinical "truth" of the original scan.

Datasets

The study utilized two major public chest X-ray datasets:

  • Source Domain (Adults): A subset of the NIH Chest X-ray 14 dataset (via the RSNA Pneumonia Detection Challenge), containing 6,993 normal and 4,659 pneumonia images.
  • Target Domain (Pediatric): Data from the Guangzhou Women and Children’s Medical Center. The authors used 5,232 images for training (with labels hidden to simulate an unsupervised environment) and a hold-out set of 624 images for final evaluation.

Key Insights and Ideas

  • Cycle-GANs can be "too good" at style transfer: Without task-specific constraints, a GAN might "fix" a pathology to make an image look more like a "typical" (healthy) image from the target domain. TUNA-Net prevents this "semantic washing."
  • End-to-End is Better: The authors found that training the target classifier ($F_P$) online and simultaneously with the image translation process was significantly more effective than "offline" training (where you first generate a bunch of synthetic images and then train a classifier on them later).
  • Preserving the "Aha!" Moment: The mid-level feature regularization ensures that the model isn't just matching pixels, but is actually learning the underlying structural representations common to both domains.

Key Results

TUNA-Net significantly outperformed standard UDA baselines on the pediatric pneumonia classification task:

  • TUNA-Net: 96.3% AUC / 93.1% Accuracy.
  • No Adaptation (Baseline): 89.3% AUC (showing the significant drop caused by domain shift).
  • Standard Cycle-GAN: 80.4% AUC (actually worse than no adaptation, likely due to the "semantic washing" mentioned above).
  • CyCADA (State-of-the-art UDA): 93.5% AUC.
  • Supervised Upper Bound: 98.1% AUC (the performance achieved if the model had full access to pediatric labels).

Notably, TUNA-Net closed the gap to the supervised upper bound within 2%, despite never seeing a single label for the pediatric data.

Limitations and Future Work

  • Binary Focus: The current work focuses on a binary classification (Normal vs. Pneumonia). Real-world clinical settings often require multi-label classification (e.g., detecting pneumothorax, cardiomegaly, and nodules simultaneously).
  • Anatomical Complexity: While the model handles the shift between adult and pediatric anatomy well, it remains to be seen how it handles more drastic shifts, such as different imaging modalities (e.g., adapting from CT slices to X-rays).
  • Future Directions: The authors suggest extending this framework to other tasks like lesion detection and segmentation, as well as testing it on different modalities like MRI and CT.

Summary updated

Abstract

In this work, we exploit the unsupervised domain adaptation problem for radiology image interpretation across domains. Specifically, we study how to adapt the disease recognition model from a labeled source domain to an unlabeled target domain, so as to reduce the effort of labeling each new dataset. To address the shortcoming of cross-domain, unpaired image-to-image translation methods which typically ignore class-specific semantics, we propose a task-driven, discriminatively trained, cycle-consistent generative adversarial network, termed TUNA-Net. It is able to preserve (1) low-level details, (2) high-level semantic information and (3) mid-level feature representation during the image-to-image translation process, to favor the target disease recognition task. The TUNA-Net framework is general and can be readily adapted to other learning tasks. We evaluate the proposed framework on two public chest X-ray datasets for pneumonia recognition. The TUNA-Net model can adapt labeled adult chest X-rays in the source domain such that they appear as if they were drawn from pediatric X-rays in the unlabeled target domain, while preserving the disease semantics. Extensive experiments show the superiority of the proposed method as compared to state-of-the-art unsupervised domain adaptation approaches. Notably, TUNA-Net achieves an AUC of 96.3% for pediatric pneumonia classification, which is very close to that of the supervised approach (98.1%), but without the need for labels on the target domain.
BibTeX
@inproceedings{tang2019tuna,
  author = {Yuxing Tang and Youbao Tang and Veit Sandfort and Jing Xiao and Ronald M. Summers},
  title = {{TUNA-Net: Task-Oriented UNsupervised Adversarial Network for Disease Recognition in Cross-domain Chest X-rays}},
  booktitle = {International Conference on Medical Image Computing and Computer-Assisted Intervention},
  year = {2019},
  url = {https://openreview.net/forum?id=F5IpWeDniC},
}

Loading related content...

Figure