Multivariate Regression via Stiefel Manifold Constraints

Gökhan H. Bakir, Arthur Gretton, Matthias O. Franz, Bernhard Schölkopf

Abstract

We introduce a learning technique for regression between high-dimensional spaces. Standard methods typically reduce this task to many one-dimensional problems, with each output dimension considered independently. By contrast, in our approach the feature construction and the regression estimation are performed jointly, directly minimizing a loss function that we specify, subject to a rank constraint. A major advantage of this approach is that the loss is no longer chosen according to the algorithmic requirements, but can be tailored to the characteristics of the task at hand; the features will then be optimal with respect to this objective, and dependence between the outputs can be exploited.
BibTeX
@inproceedings{bakir2004multivariate,
  author = {Gökhan H. Bakir and Arthur Gretton and Matthias O. Franz and Bernhard Schölkopf},
  title = {{Multivariate Regression via Stiefel Manifold Constraints}},
  booktitle = {DAGM-Symposium},
  year = {2004},
  doi = {10.1007/978-3-540-28649-3\_32},
}

Loading related content...

Figure