Sqn2Vec: Learning Sequence Representation via Sequential Patterns with a Gap Constraint

Dang Nguyen, Wei Luo, Tu Dinh Nguyen, Svetha Venkatesh, Dinh Q. Phung

Abstract

When learning sequence representations, traditional pattern-based methods often suffer from the data sparsity and high-dimensionality problems while recent neural embedding methods often fail on sequential datasets with a small vocabulary. To address these disadvantages, we propose an unsupervised method (named Sqn2Vec) which first leverages sequential patterns (SPs) to increase the vocabulary size and then learns low-dimensional continuous vectors for sequences via a neural embedding model. Moreover, our method enforces a gap constraint among symbols in sequences to obtain meaningful and discriminative SPs. Consequently, Sqn2Vec produces significantly better sequence representations than a comprehensive list of state-of-the-art baselines, particularly on sequential datasets with a relatively small vocabulary. We demonstrate the superior performance of Sqn2Vec in several machine learning tasks including sequence classification, clustering, and visualization.
BibTeX
@inproceedings{nguyen2018sqn,
  author = {Dang Nguyen and Wei Luo and Tu Dinh Nguyen and Svetha Venkatesh and Dinh Q. Phung},
  title = {{Sqn2Vec: Learning Sequence Representation via Sequential Patterns with a Gap Constraint}},
  booktitle = {ECML/PKDD},
  year = {2018},
  doi = {10.1007/978-3-030-10928-8\_34},
}

Loading related content...

Figure