Information-Estimation Relationships Over Binomial and Negative Binomial Models
Lists
Only you see this
Abstract
In recent years, a number of new connections between information measures and estimation have been found under various models, including, predominantly, Gaussian and Poisson models. This paper develops similar results for the binomial and negative binomial models. In particular, it is shown that the derivative of the relative entropy and the derivative of the mutual information for the binomial and negative binomial models can be expressed through the expectation of closed-form expressions that have conditional estimates as the main argument. Under mild conditions, those derivatives take the form of an expected Bregman divergence.
BibTeX
@article{taborda2014information,
author = {Camilo G. Taborda and Dongning Guo and Fernando Pérez-Cruz},
title = {{Information-Estimation Relationships Over Binomial and Negative Binomial Models}},
journal = {IEEE Trans. Information Theory},
year = {2014},
doi = {10.1109/tit.2014.2307070},
}Loading related content...