Distance guided selection of the best base classifier in an ensemble with application to cervigram image segmentation

Wei Wang, Xiaolei Huang

Introduction

Ensemble learning typically relies on the "wisdom of the crowd," where multiple classifiers are combined through averaging or voting to improve performance. However, in complex medical imaging tasks like cervigram segmentation, traditional ensemble methods often fail due to high inter-image variance. This paper proposes a paradigm shift: instead of combining all classifiers, the system identifies and selects the single "expert" classifier whose training data most closely matches the characteristics of the test image.

The Challenge of Cervigram Segmentation

Cervigrams are used for cervical cancer screening by identifying Acetowhite (AW) regions. These regions vary significantly across patients due to differences in illumination, specular reflections, and tissue diversity.

Feature distribution showing overlap between classes in different images.

As shown in the feature space distributions, the "signature" of a specific tissue type can overlap significantly with others across different images. A single global classifier trained on a diverse dataset often "averages out" these critical distinctions, leading to poor sensitivity—as low as 8% in some cases—due to massive overfitting to the mean characteristics of the dataset.

Proposed Methodology: Distance-Guided Selection

The authors introduce a Multiple Classifier System (MCS) that prioritizes selection over combination. The core innovation lies in the Distance-Guided Selection mechanism. Instead of aggregating the outputs of all $N$ classifiers, the system treats each classifier as a specialist for the specific image it was trained on.

Flowchart of the proposed distance-guided selection and ranking system.

The pipeline consists of several key stages:

  1. Ensemble Construction: $N$ independent linear-kernel SVM base classifiers are trained, each using data from exactly one training image.
  2. Distance Measurement: For a new test image, the system calculates the Bhattacharyya distance between its feature distributions and those of the training images. This metric quantifies the overlap between the feature distributions of the test image and each training image for specific tissue types.
  3. Class-Dependent Matching: Similarity is measured specifically between corresponding tissue classes (e.g., AW vs. Squamous Epithelium) rather than the overall image appearance. This ensures that the selected classifier has a decision boundary optimized for the specific behavior of those tissues in the test image.
  4. Ranking and Selection: The classifier from the training image with the most similar class-dependent decision boundaries is selected to perform the final segmentation.

Experimental Results

The study utilized a subset of the NCI/NLM Guanacaste project archive, containing 100 images of diverse appearance. The proposed method was compared against a global SVM and standard ensemble techniques using the Dice Similarity Coefficient (DSC).

Method Dice Similarity Coefficient (DSC)
Proposed Method (Estimated Best) 0.5822
STAPLE 0.3902
Majority Voting 0.3543
Bagging 0.2814
Global SVM 0.1183

The performance gap is striking. Standard ensemble methods like STAPLE and Majority Voting were hindered by the inclusion of "weak" or irrelevant base classifiers for specific test images. Furthermore, when a human user was allowed to select the best result from a ranked list of the top $k$ classifiers, performance reached a DSC of 0.6250, nearing the theoretical maximum for this dataset.

Conclusion and Future Work

By shifting from classifier combination to distance-guided selection, the authors achieved a substantial improvement in medical image segmentation. This "finding the expert" approach proves far more robust in domains with high data variance. Future work aims to improve computational efficiency—currently a bottleneck due to the need to run all base classifiers—and incorporate texture features to further enhance accuracy.

Summary updated

Abstract

We empirically evaluate a distance-guided learning method embedded in a multiple classifier system (MCS) for tissue segmentation in optical images of the uterine cervix. Instead of combining multiple base classifiers as in traditional ensemble methods, we propose a Bhattacharyya distance based metric for measuring the similarity in decision boundary shapes between a pair of statistical classifiers. By generating an ensemble of base classifiers trained independently on separate training images, we can use the distance metric to select those classifiers in the ensemble whose decision boundaries are similar to that of an unknown test image. In an extreme case, we select the base classifier with the most similar decision boundary to accomplish classification and segmentation on the test image. Our approach is novel in the way that the nearest neighbor is picked and effectively solves classification problems in which base classifiers with good overall performance are not easy to construct due to a large variation in the training examples. In our experiments, we applied our method and several popular ensemble methods to segmenting acetowhite regions in cervical images. The overall classification accuracy of the proposed method is significantly better than that of a single classifier learned using the entire training set, and is also superior to other ensemble methods including majority voting, STAPLE, Boosting and Bagging.
BibTeX
@inproceedings{wang2009distance,
  author = {Wei Wang and Xiaolei Huang},
  title = {{Distance guided selection of the best base classifier in an ensemble with application to cervigram image segmentation}},
  booktitle = {Workshops @ CVPR},
  year = {2009},
  doi = {10.1109/cvprw.2009.5204048},
}
Figure