An Auxiliary Variational Method

Felix V. Agakov, David BarberICONIP 2004 · OpenReview

Abstract

An attractive feature of variational methods used in the context of approximate inference in undirected graphical models is a rigorous lower bound on the normalization constants. Here we explore the idea of using augmented variable spaces to improve on the standard mean-field bounds. Our approach forms a more powerful class of approximations than any structured mean field technique. Moreover, the existing variational mixture models may be seen as computationally expensive special cases of our method. A byproduct of our work is an efficient way to calculate a set of mixture coefficients for any set of tractable distributions that principally improves on a flat combination.
BibTeX
@inproceedings{agakov2004auxiliary,
  author = {Felix V. Agakov and David Barber},
  title = {{An Auxiliary Variational Method}},
  booktitle = {ICONIP},
  year = {2004},
  url = {https://openreview.net/forum?id=uDtQgpJtft},
}

Loading related content...

Figure