Pseudo-Marginal Inference for CTMCs on Infinite Spaces via Monotonic Likelihood Approximations
Lists
Only you see this
Abstract
Bayesian inference for Continuous-Time Markov chains (CTMCs) on countably infinite spaces is notoriously difficult because evaluating the likelihood exactly is intractable. One way to address this challenge is to first build a nonnegative and unbiased estimate of the likelihood—involving the matrix exponential of finite truncations of the true rate matrix—and then to use the estimates in a pseudo-marginal inference method. In this work, we show that we can dramatically increase the efficiency of this approach by avoiding the computation of exact matrix exponentials. In particular, we develop a general methodology for constructing an unbiased, nonnegative estimate of the likelihood using doubly-monotone matrix exponential approximations. We further develop a novel approximation in this family—the skeletoid—as well as theory regarding its approximation error and how that relates to the variance of the estimates used in pseudo-marginal inference. Experimental results show that our approach yields more efficient posterior inference for a wide variety of CTMCs. Supplementary materials for this article are available online.
BibTeX
@inproceedings{bironlattes2022pseudo,
author = {Miguel Biron-Lattes and Alexandre Bouchard‐Côté and Trevor Campbell},
title = {{Pseudo-Marginal Inference for CTMCs on Infinite Spaces via Monotonic Likelihood Approximations}},
booktitle = {Figshare},
year = {2022},
doi = {10.6084/m9.figshare.20822251},
}Loading related content...