Diagnosing extrapolation: tree-based density estimation
Lists
Only you see this
Abstract
There has historically been very little concern with extrapolation in Machine Learning, yet extrapolation can be critical to diagnose. Predictor functions are almost always learned on a set of highly correlated data comprising a very small segment of predictor space. Moreover, flexible predictors, by their very nature, are not controlled at points of extrapolation. This becomes a problem for diagnostic tools that require evaluation on a product distribution. It is also an issue when we are trying to optimize a response over some variable in the input space. Finally, it can be a problem in non-static systems in which the underlying predictor distribution gradually drifts with time or when typographical errors misrecord the values of some predictors.We present a diagnosis for extrapolation as a statistical test for a point originating from the data distribution as opposed to a null hypothesis uniform distribution. This allows us to employ general classification methods for estimating such a test statistic. Further, we observe that CART can be modified to accept an exact distribution as an argument, providing a better classification tool which becomes our extrapolation-detection procedure. We explore some of the advantages of this approach and present examples of its practical application.
BibTeX
@inproceedings{hooker2004diagnosing,
author = {Giles Hooker},
title = {{Diagnosing extrapolation: tree-based density estimation}},
booktitle = {ACM SIGKDD Conference on Knowledge Discovery and Data Mining},
year = {2004},
doi = {10.1145/1014052.1014121},
}Loading related content...