Journal ArticleDOI
An Adaptive Associative Memory Principle
Reads0
Chats0
TLDR
It is shown that an analog associative memory with optimal selectivity can be formed in adaptive processes which use learning algorithms related to the gradient method.Abstract:
It is shown that an analog associative memory with optimal selectivity can be formed in adaptive processes which use learning algorithms related to the gradient method. The information is distributed throughout the memory by a matrix transform.read more
Citations
More filters
Journal ArticleDOI
Neural theory of association and concept-formation
TL;DR: Primitive neural models of association and concept-formation are presented, which will elucidate the distributed and multiply superposed manner of retaining knowledge in the brain.
Journal ArticleDOI
On associative memory.
TL;DR: The information storing capacity of certain associative and auto-associative memories is calculated and the usefulness of associative memories, as opposed to conventional listing memories, is discussed — especially in connection with brain modelling.
Book ChapterDOI
The Self-Organizing Maps: Background, Theories, Extensions and Applications
TL;DR: Among various existing neural network architectures and learning algorithms, Kohonen’s selforganizing map (SOM) is one of the most popular neural network models and can provide topologically preserved mapping from input to output spaces.
Book ChapterDOI
Learning Process in an Asymmetric Threshold Network
TL;DR: A learning procedure which requires the outside world to specify the state of every neuron during the learning session can hardly be considered as a general learning rule because in real-world conditions, only a partial information on the “ideal” network state for each task is available from the environment.
Journal ArticleDOI
On the convergence of the LMS algorithm with adaptive learning rate for linear feedforward networks
TL;DR: It is shown that, by dynamically decreasing the learning rate during each training cycle, the sequence of matrices generated by the LMS algorithm will converge to the optimal weight matrix.
References
More filters
Journal ArticleDOI
Non-holographic associative memory
TL;DR: The features of a hologram that commend it as a model of associative memory can be improved on by other devices.
Book
Correlation matrix memories
TL;DR: In this article, a new model for associative memory based on a correlation matrix is proposed, which is failure tolerant and facilitates associative search of information; these are properties that are usually assigned to holographic memories.
Journal ArticleDOI
Correlation Matrix Memories
TL;DR: A new model for associative memory, based on a correlation matrix, is suggested, in which any part of the memorized information can be used as a key and the memories are selective with respect to accumulated data.
Journal ArticleDOI
Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements
TL;DR: In this article, the stability of state transition in an autonomous logical net of threshold elements is studied by the use of characteristics of threshold element and the stability degree of their remembering and recalling under noise disturbances is investigated theoretically.