Kernelized LARS-LASSO for constructing radial basis function neural networks
Lists
Only you see this
Abstract
Model structure selection is of crucial importance in radial basis function (RBF) neural networks. Existing model structure selection algorithms are essentially forward selection or backward elimination methods that may lead to sub-optimal models. This paper proposes an alternative selection procedure based on the kernelized least angle regression (LARS)–least absolute shrinkage and selection operator (LASSO) method. By formulating the RBF neural network as a linear-in-the-parameters model, we derive a l 1-constrained objective function for training the network. The proposed algorithm makes it possible to dynamically drop a previously selected regressor term that is insignificant. Furthermore, inspired by the idea of LARS, the computing of output weights in our algorithm is greatly simplified. Since our proposed algorithm can simultaneously conduct model structure selection and parameter optimization, a network with better generalization performance is built. Computational experiments with artificial and real world data confirm the efficacy of the proposed algorithm.
BibTeX
@article{zhou2013kernelized,
author = {Quan Zhou and Shiji Song and Cheng Wu and Gao Huang},
title = {{Kernelized LARS-LASSO for constructing radial basis function neural networks}},
journal = {Neural Computing and Applications},
year = {2013},
url = {https://openreview.net/forum?id=RXMbYjC2r7l},
}Loading related content...