Using HDDT to avoid instances propagation in unbalanced and evolving data streams

Andrea Dal Pozzolo, Reid A. Johnson, Olivier Caelen, Serge Waterschoot, Nitesh V. Chawla, Gianluca BontempiIJCNN 2014 · OpenReview

Abstract

Hellinger Distance Decision Trees [10] (HDDT) has been previously used for static datasets with skewed distributions. In unbalanced data streams, state-of-the-art techniques use instance propagation and standard decision trees (e.g. C4.5 [27]) to cope with the unbalanced problem. However it is not always possible to revisit/store old instances of a stream. In this paper we show how HDDT can be successfully applied in unbalanced and evolving stream data. Using HDDT allows us to remove instance propagations between batches with several benefits: i) improved predictive accuracy ii) speed iii) single-pass through the data. We use a Hellinger weighted ensemble of HDDTs to combat concept drift and increase accuracy of single classifiers. We test our framework on several streaming datasets with unbalanced classes and concept drift.
BibTeX
@inproceedings{pozzolo2014using,
  author = {Andrea Dal Pozzolo and Reid A. Johnson and Olivier Caelen and Serge Waterschoot and Nitesh V. Chawla and Gianluca Bontempi},
  title = {{Using HDDT to avoid instances propagation in unbalanced and evolving data streams}},
  booktitle = {IJCNN},
  year = {2014},
  url = {https://openreview.net/forum?id=1vZoO7SYTg},
}

Loading related content...

Figure