Refine decision boundaries of a statistical ensemble by active learning

Dingsheng Luo, Ke Chen

Abstract

For pattern classification, the decision boundaries are gradually constructed in a statistical ensemble through a divide-and-conquer procedure based on resampling techniques. Hence a resampling criterion critically governs the process of forming the final decision boundaries. Motivated by active learning ideas, we propose an alternative resampling criterion based on the zero-one loss measure in this paper, where all the patterns in the training set are ranked in terms of their "difficulty" for classification no matter whether a pattern has been incorrectly classified or not. Our resampling criterion incorporated by Adaboost has been applied to benchmark handwritten digit recognition and text-independent speaker identification tasks. Comparative results demonstrate that our method refines decision boundaries and therefore yields the better generalization performance.
BibTeX
@inproceedings{luo2003refine,
  author = {Dingsheng Luo and Ke Chen},
  title = {{Refine decision boundaries of a statistical ensemble by active learning}},
  booktitle = {IJCNN},
  year = {2003},
  doi = {10.1109/ijcnn.2003.1223924},
}

Loading related content...

Figure