A Deep Neural Network Architecture Using Dimensionality Reduction with Sparse Matrices
Lists
Only you see this
Abstract
We present a new deep neural network architecture, motivated by sparse random matrix theory that uses a low-complexity embedding through a sparse matrix instead of a conventional stacked autoencoder. We regard autoencoders as an information-preserving dimensionality reduction method, similar to random projections in compressed sensing. Thus, exploiting recent theory on sparse matrices for dimensionality reduction, we demonstrate experimentally that classification performance does not deteriorate if the autoencoder is replaced with a computationally-efficient sparse dimensionality reduction matrix.
BibTeX
@inproceedings{matsumoto2016deep,
author = {Wataru Matsumoto and Manabu Hagiwara and Petros T. Boufounos and Kunihiko Fukushima and Toshisada Mariyama and Xiongxin Zhao},
title = {{A Deep Neural Network Architecture Using Dimensionality Reduction with Sparse Matrices}},
booktitle = {ICONIP},
year = {2016},
doi = {10.1007/978-3-319-46681-1\_48},
}Loading related content...