Bounds on approximate steepest descent for likelihood maximization in exponential families

Nicolò Cesa-Bianchi, Anders Krogh, Manfred K. WarmuthIEEE Trans. Information Theory 1994 · DOI · OpenReview

Abstract

An approximate steepest descent strategy is described, converging in families of regular exponential densities to maximum likelihood estimates of density functions. These density estimates are also obtained by an application of the principle of minimum relative entropy subject to empirical constraints. We prove tight bounds on the increase of the log-likelihood at each iteration of our strategy for families of exponential densities whose log-densities are spanned by a set of bounded basis functions.<>
BibTeX
@article{cesabianchi1994bounds,
  author = {Nicolò Cesa-Bianchi and Anders Krogh and Manfred K. Warmuth},
  title = {{Bounds on approximate steepest descent for likelihood maximization in exponential families}},
  journal = {IEEE Trans. Information Theory},
  year = {1994},
  doi = {10.1109/18.335953},
}

Loading related content...

Figure