Efficient Annotation for Medical Image Analysis: A One-Pass Selective Annotation Approach

Yuli Wang, Peiyu Duan, Zhangxing Bian, Anqi Feng, Yuan XuearXiv 2023 · DOI · arXiv

TL;DR

This paper introduces EPOSA, a novel one-pass approach to efficiently select a small, representative subset of medical images for annotation. By leveraging Variational Autoencoders (VAEs) for feature extraction and a two-stage clustering-based selection method (RepSel), EPOSA significantly reduces annotation costs while maintaining high model performance, outperforming random selection and other active learning strategies.

What Problem Does This Paper Address?

Supervised learning models, especially in medical image analysis, thrive on large, diverse, and representative datasets. However, manually annotating medical images is a notoriously time-consuming and expensive process due to the complexity and variability of the data. This bottleneck limits the development and deployment of advanced AI models in healthcare. Traditional active learning methods, while aiming to reduce annotation effort, often involve an iterative, interactive process that can be impractical for human experts. This paper tackles the challenge of drastically reducing annotation burden without sacrificing model performance by proposing a highly efficient, single-pass selection strategy.

Methods

The core of the EPOSA framework lies in its two main components:

  • Unsupervised Feature Extraction (VAE): The process begins by using a Variational Autoencoder (VAE) to learn a low-dimensional latent representation of the unannotated medical images. This unsupervised step is crucial as it doesn't require any initial labels, allowing the model to capture the intrinsic data structure.
  • Representative Selection (RepSel): This is a two-stage algorithm designed to pick the most valuable images for annotation.
  • Stage 1 (Intra-cluster Selection): DBSCAN clustering is applied to the VAE's latent features to group similar images into distinct clusters. Within each cluster, a Markov Chain Monte Carlo (MCMC) sampling technique is used to select an initial subset of images. Then, a greedy approach, guided by maximizing intra-cluster mutual information, selects representative samples from each cluster. This aims to reduce redundancy within similar image groups.
  • Stage 2 (Inter-cluster Selection): This stage focuses on selecting samples that represent different clusters. It uses a mutual information-based criterion to select images that are most representative of the entire dataset while minimizing redundancy between the already selected samples from different clusters. This ensures overall diversity.

The selected images are then used to train a VGG-16 network for classification.

Datasets

The primary dataset used for evaluation is the Path-MNIST subset of the Med-MNIST dataset. This dataset consists of:

  • 80,000 training images
  • 10,000 validation images
  • 7,000 test images

These images are categorized into ten classes of colon pathology (e.g., muscle, mucus, lymphocyte) and are provided as 3-channel RGB images with a resolution of 28x28 pixels.

Key Insights and Ideas

  • The Power of Unsupervised Features: Using a VAE for feature extraction before any annotation is a smart way to leverage the inherent structure of medical images without relying on potentially scarce labels.
  • Clustering as a Foundation for Selection: Grouping images into clusters first is an effective strategy to manage the diversity of a large dataset. It allows for targeted selection within similar groups and then across different groups.
  • Mutual Information for Representativeness: The paper's novel use of mutual information to quantify how well an image represents a cluster (or the entire selected set) is a key innovation. This metric goes beyond simple similarity and captures a deeper sense of representativeness.
  • One-Pass Efficiency: The "one-pass" nature of EPOSA is a significant advantage. Unlike iterative active learning, it performs all selection in a single pass, making it much more practical for real-world annotation workflows.
  • Balancing Diversity and Representativeness: The two-stage RepSel algorithm is designed to achieve a delicate balance: ensuring that selected samples are diverse enough to cover the data distribution while also being representative of their respective image categories.

Key Results

The EPOSA framework demonstrated strong performance on the Path-MNIST dataset:

  • Superior Performance: EPOSA outperformed several baseline methods, including Uncertainty, Core set, and Deep Bayesian Active Learning (DBAL), as well as random sampling.
  • High Accuracy with Reduced Data: With only 40% of the labeled training data, EPOSA achieved a classification accuracy of 50.1%. This highlights its efficiency in selecting high-value samples.
  • Ablation Study Highlights Contributions: An ablation study showed that each component of EPOSA contributes significantly to its performance. The VAE for feature extraction, DBSCAN for clustering, and the RepSel selection method all led to substantial improvements in accuracy compared to simpler approaches.

Limitations and Future Work

  • Limitations: The paper acknowledges that some baseline methods performed comparably to random sampling, potentially due to the small sampling size and inherent randomness, which reduced the discriminative power of the sampling methods.
  • Future Work: The authors suggest several promising directions:
  • Exploring the application of EPOSA to other types of medical image datasets and tasks.
  • Investigating the integration of alternative clustering and sampling methods within the EPOSA framework.
  • Further refinement of the approach to potentially achieve even higher performance with reduced annotation budgets.

Summary updated

Abstract

Annotating biomedical images for supervised learning is a complex and labor-intensive task due to data diversity and its intricate nature. In this paper, we propose an innovative method, the efficient one-pass selective annotation (EPOSA), that significantly reduces the annotation burden while maintaining robust model performance. Our approach employs a variational autoencoder (VAE) to extract salient features from unannotated images, which are subsequently clustered using the DBSCAN algorithm. This process groups similar images together, forming distinct clusters. We then use a two-stage sample selection algorithm, called representative selection (RepSel), to form a selected dataset. The first stage is a Markov Chain Monte Carlo (MCMC) sampling technique to select representative samples from each cluster for annotations. This selection process is the second stage, which is guided by the principle of maximizing intra-cluster mutual information and minimizing inter-cluster mutual information. This ensures a diverse set of features for model training and minimizes outlier inclusion. The selected samples are used to train a VGG-16 network for image classification. Experimental results on the Med-MNIST dataset demonstrate that our proposed EPOSA outperforms random selection and other state-of-the-art methods under the same annotation budget, presenting a promising direction for efficient and effective annotation in medical image analysis.
BibTeX
@misc{wang2023efficient,
  author = {Yuli Wang and Peiyu Duan and Zhangxing Bian and Anqi Feng and Yuan Xue},
  title = {{Efficient Annotation for Medical Image Analysis: A One-Pass Selective Annotation Approach}},
  year = {2023},
  eprint = {2308.13649},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2308.13649},
}
Figure