COTIC: Embracing Non-uniformity in Event Sequence Data via Multilayer Continuous Convolution
Lists
Only you see this
Abstract
Massive samples of event sequences occur in various domains, including e-commerce, healthcare, and finance. There are two main challenges regarding modeling such data: methodological and computational. The methodological peculiarity for event sequences is their non-uniformity and sparsity. These requirements make time series models unsuitable. The computational challenge arises from a large amount of available data and the significant length of each sequence. Thus, the problem requires complex and efficient models. Existing solutions include large recurrent and transformer neural network architectures. On top of existing blocks, their authors introduce specific intensity functions defined at each moment. However, due to their parametric nature, these continuous-time-aware intensities represent only a limited class of event sequences. We propose the COTIC method based on an efficient continuous convolution neural network suitable for the non-uniform occurrence of events in time. In COTIC, dilations and multi-layer architecture efficiently handle long-term dependencies between events. Furthermore, the model provides intensity dynamics in continuous time --- including self-excitement encountered in practice. Being the first to introduce multiple continuous convolution layers that can handle arbitrary complex dependencies via MLP-modeled convolutions, we obtain these properties. When benchmarked against existing models, the COTIC consistently outperforms them, especially in predicting the next event time and type: it has the average rank of 2.125 vs. 3.688 of the primal competitor. Additionally, its ability to produce effective embeddings showcases its potential for a range of downstream tasks, as produced embeddings are sufficient to solve various downstream tasks, e.g., 0.459 vs. 0.452 baseline accuracy on a 4-label age bin prediction for transactions dataset. The code of the proposed method is available at https://anonymous.4open.science/r/COTIC-F47D/README.md
BibTeX
@article{zhuzhel2025cotic,
author = {Vladislav Andreevich Zhuzhel and Vsevolod Grabar and Galina Boeva and Artem Zabolotnyi and Alexander Stepikin and Vladimir Zholobov and Maria Ivanova and Mikhail Orlov and Ivan A Kireev and Evgeny Burnaev and Rodrigo Rivera-Castro and Alexey Zaytsev},
title = {{COTIC: Embracing Non-uniformity in Event Sequence Data via Multilayer Continuous Convolution}},
journal = {IEEE Access},
year = {2025},
doi = {10.1109/access.2025.3641785},
}