Internal Validation of Unsupervised Clustering following an Association Accuracy Heuristic
Lists
Only you see this
Abstract
One challenge of unsupervised clustering is that its clustering results cannot be directly evaluated in terms of expected accuracy. In case of internal validation, the clustering is validated based on the compactness within a cluster as well as the separation of clusters. Especially in high dimensional settings, internal validation as well as user inspection, becomes more difficult and expensive the higher the dimension of the data. We therefore propose an association accuracy heuristic, relating the association of results obtained by different methods to their accuracy. This heuristic is based on an analogy to decision making where high homogeneity among the opinions of independent experts is a widely accepted indicator for having chosen the right decision. Analogous to expert opinions, we assess the groupings of different state-of-the art clustering methods. To measure the (dis)similarity of the clustering results, we propose method-association-measures, that are built on an adaption of $\chi^{2}-$based association measures. Our heuristic is investigated in a simulation study as well as on single-cell RNA sequencing data. Incorporating the ground truth allows a validation of the proposed association accuracy heuristic. Our results provide the opportunity to distinguish between situations where clustering results are expected to be trustworthy and settings where external intervention is indispensable to protect ourself against high risk of bad clustering results.
BibTeX
@inproceedings{fuetterer2021internal,
author = {Cornelia Fuetterer and Thomas Augustin},
title = {{Internal Validation of Unsupervised Clustering following an Association Accuracy Heuristic}},
booktitle = {BIBM},
year = {2021},
doi = {10.1109/bibm52615.2021.9669782},
}Loading related content...