Sequential Monte Carlo methods for statistical analysis of tables

Yuguo Chen, Persi Diaconis, Susan Holmes, Jun S. Liu

Abstract

We describe a sequential importance sampling (SIS) procedure for analyzing two-way zero-one or contingency tables with fixed marginal sums. An essential feature of the new method is that it samples the columns of the table progressively according to certain special distributions. Our method produces Monte Carlo samples that are remarkably close to the uniform distribution, enabling one to approximate closely the null distributions of various test statistics about these tables. Our method compares favorably with other existing Monte Carlo-based algorithms, sometimes a few orders of magnitude more e#cient. In particular, compared with Markov chain Monte Carlo (MCMC) based approaches, our importance sampling method not only is more e#cient in terms of absolute running time and frees one from pondering over the mixing issue, but also provides an easy and accurate estimate of the total number of tables with fixed marginal sums, which is far more di#cult for an MCMC method to achieve.
BibTeX
@article{chen2005sequential,
  author = {Yuguo Chen and Persi Diaconis and Susan Holmes and Jun S. Liu},
  title = {{Sequential Monte Carlo methods for statistical analysis of tables}},
  journal = {Journal of the American Statistical Association},
  year = {2005},
  doi = {10.1198/016214504000001303},
}

Loading related content...

Figure