Variational Information Maximization for Neural Coding

Felix V. Agakov, David BarberICONIP 2004 · OpenReview

Abstract

Mutual Information (MI) is a long studied measure of coding efficiency, and many attempts to apply it to population coding have been made. However, this is a computationally intractable task, and most previous studies redefine the criterion in forms of approximations. Recently we described properties of a simple lower bound on MI [2]. Here we describe the bound optimization procedure for learning of population codes in a simple point neural model. We compare our approach with other techniques maximizing approximations of MI, focusing on a comparison with the Fisher Information criterion.
BibTeX
@inproceedings{agakov2004variational,
  author = {Felix V. Agakov and David Barber},
  title = {{Variational Information Maximization for Neural Coding}},
  booktitle = {ICONIP},
  year = {2004},
  url = {https://openreview.net/forum?id=BYK3olb59Q},
}

Loading related content...

Figure