Multi-space probabilistic sequence modeling
Lists
Only you see this
Abstract
Learning algorithms that embed objects into Euclidean space have become the methods of choice for a wide range of problems, ranging from recommendation and image search to playlist prediction and language modeling. Probabilistic embedding methods provide elegant approaches to these problems, but can be expensive to train and store as a large monolithic model. In this paper, we propose a method that trains not one monolithic model, but multiple local embeddings for a class of pairwise conditional models especially suited for sequence and co-occurrence modeling. We show that computation and memory for training these multi-space models can be efficiently parallelized over many nodes of a cluster. Focusing on sequence modeling for music playlists, we show that the method substantially speeds up training while maintaining high model quality.
BibTeX
@inproceedings{chen2013multi,
author = {Shuo Chen and Jiexun Xu and Thorsten Joachims},
title = {{Multi-space probabilistic sequence modeling}},
booktitle = {ACM SIGKDD Conference on Knowledge Discovery and Data Mining},
year = {2013},
doi = {10.1145/2487575.2487632},
}| A Probabilistic Model for Learning Multi-Prototype Word Embeddings | COLING · 2014 |
| Model-Parallel Inference for Big Topic Models | arXiv · 2014 |
| Probabilistic Models over Ordered Partitions with Application in Learning to Rank | arXiv · 2010 |
| TribeFlow: Mining & Predicting User Trajectories | WWW · 2016 |
| Scaling Large Learning Problems with Hard Parallel Mixtures | Int. J. Pattern Recognit. Artif. Intell · 2003 |
| Near-Optimal Clustering in Mixture of Markov Chains | arXiv · 2025 |