Convex Factorization Machines

Mathieu Blondel, Akinori Fujino, Naonori Ueda

Abstract

Factorization machines are a generic framework which allows to mimic many factorization models simply by feature engineering. In this way, they combine the high predictive accuracy of factorization models with the flexibility of feature engineering. Unfortunately, factorization machines involve a non-convex optimization problem and are thus subject to bad local minima. In this paper, we propose a convex formulation of factorization machines based on the nuclear norm. Our formulation imposes fewer restrictions on the learned model and is thus more general than the original formulation. To solve the corresponding optimization problem, we present an efficient globally-convergent two-block coordinate descent algorithm. Empirically, we demonstrate that our approach achieves comparable or better predictive accuracy than the original factorization machines on 4 recommendation tasks and scales to datasets with 10 million samples.
BibTeX
@inproceedings{blondel2015convex,
  author = {Mathieu Blondel and Akinori Fujino and Naonori Ueda},
  title = {{Convex Factorization Machines}},
  booktitle = {ECML/PKDD},
  year = {2015},
  doi = {10.1007/978-3-319-23525-7\_2},
}

Loading related content...

Figure