Comparing Pure Parallel Ensemble Creation Techniques Against Bagging

Lawrence O. Hall, Kevin W. Bowyer, Robert E. Banfield, Divya Bhadoria, W. Philip Kegelmeyer, Steven Eschrich

Abstract

We experimentally evaluate randomization-based approaches to creating an ensemble of decision-tree classifiers. Unlike methods related to boosting, all of the eight approaches considered here create each classifier in an ensemble independently of the other classifiers. Experiments were performed on 28 publicly available datasets, using C4.5 release 8 as the base classifier. While each of the other seven approaches has some strengths, we find that none of them is consistently more accurate than standard bagging when tested for statistical significance.
BibTeX
@inproceedings{hall2003comparing,
  author = {Lawrence O. Hall and Kevin W. Bowyer and Robert E. Banfield and Divya Bhadoria and W. Philip Kegelmeyer and Steven Eschrich},
  title = {{Comparing Pure Parallel Ensemble Creation Techniques Against Bagging}},
  booktitle = {ICDM},
  year = {2003},
  url = {https://openreview.net/forum?id=jtQ8HeA5Jkb},
}

Loading related content...

Figure