Generation of Attribute Value Taxonomies from Data for Data-Driven Construction of Accurate and Compact Classifiers

Dae-Ki Kang, Adrian Silvescu, Jun Zhang, Vasant G. Honavar

Abstract

Attribute value taxonomies (AVT) have been shown to be useful in constructing compact, robust, and comprehensible classifiers. However, in many application domains, human-designed AVTs are unavailable. We introduce AVT-learner, an algorithm for automated construction of attribute value taxonomies from data. AVT-learner uses hierarchical agglomerative clustering (HAC) to cluster attribute values based on the distribution of classes that co-occur with the values. We describe experiments on UCI data sets that compare the performance of AVT-NBL (an AVT-guided naive Bayes learner) with that of the standard naive Bayes learner (NBL) applied to the original data set. Our results show that the AVTs generated by AVT-learner are competitive with human-gene rated AVTs (in cases where such AVTs are available). AVT-NBL using AVTs generated by AVT-learner achieves classification accuracies that are comparable to or higher than those obtained by NBL; and the resulting classifiers are significantly more compact than those generated by NBL.
BibTeX
@inproceedings{kang2004generation,
  author = {Dae-Ki Kang and Adrian Silvescu and Jun Zhang and Vasant G. Honavar},
  title = {{Generation of Attribute Value Taxonomies from Data for Data-Driven Construction of Accurate and Compact Classifiers}},
  booktitle = {ICDM},
  year = {2004},
  doi = {10.1109/icdm.2004.10115},
}

Loading related content...

Figure