scispace - formally typeset
Book ChapterDOI

Neural Networks for Pattern Recognition

Suresh Kothari, +1 more
- 01 Jan 1993 - 
- Vol. 37, pp 119-166
Reads0
Chats0
TLDR
The chapter discusses two important directions of research to improve learning algorithms: the dynamic node generation, which is used by the cascade correlation algorithm; and designing learning algorithms where the choice of parameters is not an issue.
Abstract
Publisher Summary This chapter provides an account of different neural network architectures for pattern recognition. A neural network consists of several simple processing elements called neurons. Each neuron is connected to some other neurons and possibly to the input nodes. Neural networks provide a simple computing paradigm to perform complex recognition tasks in real time. The chapter categorizes neural networks into three types: single-layer networks, multilayer feedforward networks, and feedback networks. It discusses the gradient descent and the relaxation method as the two underlying mathematical themes for deriving learning algorithms. A lot of research activity is centered on learning algorithms because of their fundamental importance in neural networks. The chapter discusses two important directions of research to improve learning algorithms: the dynamic node generation, which is used by the cascade correlation algorithm; and designing learning algorithms where the choice of parameters is not an issue. It closes with the discussion of performance and implementation issues.

read more

Citations
More filters
Proceedings ArticleDOI

Deep Residual Learning for Image Recognition

TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
Book

Reinforcement Learning: An Introduction

TL;DR: This book provides a clear and simple account of the key ideas and algorithms of reinforcement learning, which ranges from the history of the field's intellectual foundations to the most recent developments and applications.
Journal ArticleDOI

A Tutorial on Support Vector Machines for Pattern Recognition

TL;DR: There are several arguments which support the observed high accuracy of SVMs, which are reviewed and numerous examples and proofs of most of the key theorems are given.
Journal ArticleDOI

Machine learning

TL;DR: Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis.
Journal ArticleDOI

A tutorial on support vector regression

TL;DR: This tutorial gives an overview of the basic ideas underlying Support Vector (SV) machines for function estimation, and includes a summary of currently used algorithms for training SV machines, covering both the quadratic programming part and advanced methods for dealing with large datasets.
References
More filters
Proceedings ArticleDOI

A new learning approach to enhance the storage capacity of the Hopfield model

TL;DR: A new learning technique is introduced to solve the problem of the small and restrictive storage capacity of the Hopfield model and exploits the maximum storage capacity.

Neural network processing as a tool for function optimization

W. Jeffrey, +1 more
TL;DR: In this article, the authors summarize the development of neural network-like processing for function optimization, and demonstrate how this method can be designed so as to avoid trapping in local extrema.
Book ChapterDOI

Neurocomputing formalisms for computational learning and machine intelligence

TL;DR: The chapter rederives a theoretical framework for neural learning of nonlinear mappings, wherein both the topology of the network and synaptic interconnection strengths are evolved adaptively, and exploits the concept of adjoint-operators to enable a fast global computation of a network's response to perturbations in all system parameters.
Book ChapterDOI

Collective computation, content-addressable memory, and optimization problems

TL;DR: A collective decision network is described which can function as a computational element in a digital computer or signal processor and differs from conventional digital circuit designs in emphasizing the large connectivity and analog response that biological “computational” systems employ.