The organization of behavior: A neuropsychological theory

This ebook is the first authorized digital version of Kernighan and Ritchie's 1988 classic, The C Programming Language (2nd Ed.). One of the best-selling programming books published in the last fifty years, "K&R" has been called everything from the "bible" to "a landmark in computer science" and it has influenced generations of programmers. Available now for all leading ebook platforms, this concise and beautifully written text is a "must-have" reference for every serious programmers digital library.

As modestly described by the authors in the Preface to the First Edition, this "is not an introductory programming manual; it assumes some familiarity with basic programming concepts like variables, assignment statements, loops, and functions. Nonetheless, a novice programmer should be able to read along and pick up the language, although access to a more knowledgeable colleague will help."

The C programming language

Continual lifelong learning with neural networks: A review.

http://www.buzsakilab.com/content/PDFs/Buzsaki2010Neuron.pdf

Neural Syntax: Cell Assemblies, Synapsembles, and Readers

Pattern recognition systems usually have a relatively small number of patterns to be recognized. As a rule the number of handwritten symbols, number of phonemes or number of human faces are of the order of some dozens. But sometimes the pattern recognition task demands much more classes. For example, a continuous speech recognition system can be created on the base of syllables; a handwriting recognition system will be more efficient if the recognized units are not different letters, but triplets of letters. In these cases it is necessary to have various thousands of classes. In this paper we will consider the situation of the recognition problem that demands many thousands of classes to be recognized. For such problems we propose the use of the neural networks with ensembles. We give a short description of this type of neural network and calculate its storage capacity.

Neural network with ensembles

Neural associative networks with plastic synapses have been proposed as computational models of brain functions and also for applications such as pattern recognition and information retrieval. To guide biological models and optimize technical applications, several definitions of memory capacity have been used to measure the efficiency of associative memory. Here we explain why the currently used performance measures bias the comparison between models and cannot serve as a theoretical benchmark. We introduce fair measures for information-theoretic capacity in associative memory that also provide a theoretical benchmark.

In neural networks, two types of manipulating synapses can be discerned: synaptic plasticity, the change in strength of existing synapses, and structural plasticity, the creation and pruning of synapses. One of the new types of memory capacity we introduce permits quantifying how structural plasticity can increase the network efficiency by compressing the network structure, for example, by pruning unused synapses. Specifically, we analyze operating regimes in the Willshaw model in which structural plasticity can compress the network structure and push performance to the theoretical benchmark. The amount C of information stored in each synapse can scale with the logarithm of the network size rather than being constant, as in classical Willshaw and Hopfield nets (≤ ln 2 ≈ 0.7). Further, the review contains novel technical material: a capacity analysis of the Willshaw model that rigorously controls for the level of retrieval quality, an analysis for memories with a nonconstant number of active units (where C ≤ 1/eln 2 ≈ 0.53), and the analysis of the computational complexity of associative memories with and without network compression.

/pdf/memory-capacities-for-synaptic-and-structural-plasticity-3o9u8ae1v5.pdf

Memory capacities for synaptic and structural plasticity

Donald Hebb's concept of cell assemblies is a physiology-based idea for a distributed neural representation of behaviorally relevant objects, concepts, or constellations. In the late 70s Valentino Braitenberg started the endeavor to spell out the hypothesis that the cerebral cortex is the structure where cell assemblies are formed, maintained and used, in terms of neuroanatomy (which was his main concern) and also neurophysiology. This endeavor has been carried on over the last 30 years corroborating most of his findings and interpretations. This paper summarizes the present state of cell assembly theory, realized in a network of associative memories, and of the anatomical evidence for its location in the cerebral cortex.

Cell assemblies in the cerebral cortex

Pattern separation and synchronization in spiking associative memories and visual areas

Two core elements for the coordination of different actions in sport are tactical information and knowledge about tactical situations. The current study describes two experiments to learn about the memory structure and the cognitive processing of tactical information. Experiment 1 investigated the storage and structuring of team-specific tactics in humans’ long-term memory with regard to different expertise levels. Experiment 2 investigated tactical decision-making skills and the corresponding gaze behavior, in presenting participants the identical match situations in a reaction time task. The results showed that more experienced soccer players, in contrast to less experienced soccer players, possess a functionally organized cognitive representation of team-specific tactics in soccer. Moreover, the more experienced soccer players reacted faster in tactical decisions, because they needed less fixations of similar duration as compared to less experienced soccer players. Combined, these experiments offer evidence that a functionally organized memory structure leads to a reaction time and a perceptual advantage in tactical decision-making in soccer. The discussion emphasizes theoretical and applied implications of the current results of the study.

/pdf/cognitive-representations-and-cognitive-processing-of-team-3ozkt538dt.pdf

Andreas Knoblauch

Papers

Memory capacities for synaptic and structural plasticity

Cell assemblies in the cerebral cortex

Pattern separation and synchronization in spiking associative memories and visual areas

Cognitive representations and cognitive processing of team-specific tactics in soccer.

2009 Special Issue: Discrete combinatorial circuits emerging in neural networks: A mechanism for rules of grammar in the human brain?