Density-Driven Generalized Regression Neural Networks (DD-GRNN) for Function Approximation

John Yannis Goulermas, Panos Liatsis, Xiao-Jun Zeng, Phil CookIEEE Trans. Neural Networks 2007 · OpenReview

Abstract

para xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> This paper proposes a new nonparametric regression method, based on the combination of generalized regression neural networks (GRNNs), density-dependent multiple kernel bandwidths, and regularization. The presented model is generic and substitutes the very large number of bandwidths with a much smaller number of trainable weights that control the regression model. It depends on sets of extracted data density features which reflect the density properties and distribution irregularities of the training data sets. We provide an efficient initialization scheme and a second-order algorithm to train the model, as well as an overfitting control mechanism based on Bayesian regularization. Numerical results show that the proposed network manages to reduce significantly the computational demands of having individual bandwidths, while at the same time, provides competitive function approximation accuracy in relation to existing methods. </para>
BibTeX
@article{goulermas2007density,
  author = {John Yannis Goulermas and Panos Liatsis and Xiao-Jun Zeng and Phil Cook},
  title = {{Density-Driven Generalized Regression Neural Networks (DD-GRNN) for Function Approximation}},
  journal = {IEEE Trans. Neural Networks},
  year = {2007},
  url = {https://openreview.net/forum?id=g26B8X4U7Kx},
}

Loading related content...

Figure