Multilayer Networks

Andrew G. Engel, J. F. J. van den BrandCambridge 2001 · DOI · OpenAlex

Abstract

In the preceding chapters we have described various properties of learning in the perceptron, exploiting the fact that its simple architecture allows a rather detailed mathematical analysis. However, the perceptron suffers from a major deficiency that led to its demise in the late 1960s: being able only to implement linearly separable Boolean functions its computational capacities are rather limited. An obvious generalization is feed-forward multilayer networks with one or more intermediate layers of formal neurons neurons between input and output (cf. fig. 1.1c). On the one hand these may be viewed as being composed of individual perceptrons, so that their theoretical analysis may build on what has been accomplished for the perceptron. On the other hand the addition of internal degrees of freedom makes them computationally much more powerful. In fact multilayer neural networks are able to realize all possible Boolean functions between input and output, which makes them an attractive choice for practical applications. There is also a neurophysiological motivation for the study of multilayer networks since most neurons in biological neural nets are interneurons neither directly connected to sensory inputs nor to motor outputs.
BibTeX
@inproceedings{engel2001multilayer,
  author = {Andrew G. Engel and J. F. J. van den Brand},
  title = {{Multilayer Networks}},
  booktitle = {Cambridge},
  year = {2001},
  doi = {10.1017/cbo9781139164542.013},
}

Loading related content...

Figure