Modal Regression via Direct Log-Density Derivative Estimation

Hiroaki Sasaki, Yurina Ono, Masashi SugiyamaICONIP 2016 · OpenReview

Abstract

Regression is aimed at estimating the conditional expectation of output given input, which is suitable for analyzing functional relation between input and output. On the other hand, when the conditional density with multiple modes is analyzed, modal regression comes in handy. Partial mean shift (PMS) is a promising method of modal regression, which updates data points toward conditional modes by gradient ascent. In the implementation, PMS first obtains an estimate of the joint density by kernel density estimation and then computes its derivative for gradient ascent. However, this two-step approach can be unreliable because a good density estimator does not necessarily mean a good density derivative estimator. In this paper, we propose a novel method for modal regression based on direct estimation of the log-density derivative without density estimation. Experiments show the superiority of our direct method over PMS.
BibTeX
@inproceedings{sasaki2016modal,
  author = {Hiroaki Sasaki and Yurina Ono and Masashi Sugiyama},
  title = {{Modal Regression via Direct Log-Density Derivative Estimation}},
  booktitle = {ICONIP},
  year = {2016},
  url = {https://openreview.net/forum?id=rsYDVhTjUR0},
}

Loading related content...

Figure