Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268

An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets

From the Publisher:
The old opposition of matter versus mind stubbornly persists in the way we study mind and brain. In treating cognition as problem solving, Andy Clark suggests, we may often abstract too far from the very body and world in which our brains evolved to guide us. Whereas the mental has been treated as a realm that is distinct from the body and the world, Clark forcefully attests that a key to understanding brains is to see them as controllers of embodied activity. From this paradigm shift he advances the construction of a cognitive science of the embodied mind.

/pdf/being-there-putting-brain-body-and-world-together-again-31tt4y51ml.pdf

Being There: Putting Brain, Body, and World Together Again

The organization of behavior: A neuropsychological theory

Continual lifelong learning with neural networks: A review.

Bringing together neural, perceptual, and behavioral studies, The Merging of the Senses provides the first detailed review of how the brain assembles information from different sensory systems in order to produce a coherent view of the external world. Stein and Meredith marshall evidence from a broad array of species to show that interactions among senses are the most ancient scheme of sensory organization, an integrative system reflecting a general plan that supersedes structure and species. Most importantly, they explore what is known about the neural processes by which interactions among the senses take place at the level of the single cell.The authors draw on their own experiments to illustrate how sensory inputs converge (from visual, auditory, and somatosensory modalities, for instance) on individual neurons in different areas of the brain, how these neurons integrate their inputs, the principles by which this integration occurs, and what this may mean for perception and behavior. Neurons in the superior colliculus and cortex are emphasized as models of multiple sensory integrators.Barry E. Stein is Professor of Physiology and M. Alex Meredith is Associate Professor of Anatomy, both at the Medical College of Virginia, Virginia Commonwealth University.

The Merging of the Senses

Multisensory integration allows information from multiple senses to be combined, with benefits for nervous-system processing. Stein and Stanford discuss the principles of multisensory integration in single neurons in the CNS and consider the questions that the field must address.

Multisensory integration: current issues from the perspective of the single neuron.

The responses of superior colliculus cells to a given sensory stimulus were influenced by the presence or absence of other sensory cues. By pooling sensory inputs, many superior colliculus cells seem to amplify the effects of subtle environmental cues in certain conditions, whereas in others, responses to normally effective stimuli can be blocked. The observations illustrate the dynamic, interactive nature of the multisensory inputs which characterize the deeper laminae of the superior colliculus.

https://science.sciencemag.org/content/sci/221/4608/389.full.pdf

Interactions among converging sensory inputs in the superior colliculus.

A comprehensive search for subcortical projections to the cat superior colliculus was conducted using the retrograde horseradish peroxidase (HRP) method. Over 40 different subcortical structures project to the superior colliculus. The more notable among these are grouped under the following categories.



Visual structures: ventral lateral geniculate nucleus, parabigeminal nucleus, pretectal area (nucleus of the optic tract, posterior pretectal nucleus, nuclei of the posterior commissure).



Auditory structures: inferior colliculus (external and pericentral nuclei), dorsomedial periolivary nucleus, nuclei of the trapezoid body, ventral nucleus of the lateral lemniscus.



Somatosensory structures: sensory trigeminal complex (all divisions, but mainly the γ division of nucleus oralis), dorsal column nuclei (mostly cuneate nucleus), and the lateral cervical nucleus.



Catecholamine nuclei: locus coeruleus, raphe dorsalis, and the parabrachial nuclei.



Cerebellum: medial, interposed, and lateral nuclei, and the perihypoglossal nuclei.



Reticular areas: zona incerta, substantia nigra, midbrain tegmentum, nucleus paragigantocellularis lateralis, and the hypothalamus.



Evidence is presented that only the parabigeminal nucleus, the nucleus of the optic tract, and the posterior pretectal nucleus project to the superficial collicular layers (striatum griseum superficiale and stratum opticum), while all other afferents terminate in the deeper layers of the colliculus. Also presented is information concerning the rostrocaudal distribution of some of these afferent connections. These findings stress the multiplicity and diversity of inputs to the deeper collicular layers, and more specifically, identify multiple sources of the physiologically well-known representations of the somatic and auditory modalities in the colliculus.

Sources of subcortical projections to the superior colliculus in the cat.

1. The properties of visual-, auditory-, and somatosensory-responsive neurons, as well as of neurons responsive to multiple sensory cues (i.e., multisensory), were examined in the superior colliculus of the rhesus monkey. Although superficial layer neurons responded exclusively to visual stimuli and visual inputs predominated in deeper layers, there was also a rich nonvisual and multisensory representation in the superior colliculus. More than a quarter (27.8%) of the deep layer population responded to stimuli from more than a single sensory modality. In contrast, 37% responded only to visual cues, 17.6% to auditory cues, and 17.6% to somatosensory cues. Unimodal- and multisensory-responsive neurons were clustered by modality. Each of these modalities was represented in map-like fashion, and the different representations were in alignment with one another. 2. Most deep layer visually responsive neurons were binocular and exhibited poor selectivity for such stimulus characteristics as orientation, velocity, and direction of movement. Similarly, most auditory-responsive neurons had contralateral receptive fields and were binaural, but had little frequency selectivity and preferred complex, broad-band sounds. Somatosensory-responsive neurons were overwhelmingly contralateral, high velocity, and rapidly adapting. Only rarely did somatosensory-responsive neurons require distortion of subcutaneous tissue for activation. 3. The spatial congruence among the different receptive fields of multisensory neurons was a critical feature underlying their ability to synthesize cross-modal information. 4. Combinations of stimuli could have very different consequences in the same neuron, depending on their temporal and spatial relationships. Generally, multisensory interactions were evident when pairs of stimuli were separated from one another by < 500 ms, and the products of these interactions far exceeded the sum of their unimodal components. Whether the combination of stimuli produced response enhancement, response depression, or no interaction depended on the location of the stimuli relative to one another and to their respective receptive fields. Maximal response enhancements were observed when stimuli originated from similar locations in space (as when derived from the same event) because they fell within the excitatory receptive fields of the same multisensory neurons. If, however, the stimuli were spatially disparate such that one fell beyond the excitatory borders of its receptive field, either no interaction was produced or this stimulus depressed the effectiveness of the other. Furthermore, maximal response interactions were seen with the pairing of weakly effective unimodal stimuli. As the individual unimodal stimuli became increasingly effective, the levels of response enhancement to stimulus combinations declined, a principle referred to as inverse effectiveness. Many of the integrative principles seen here in the primate superior colliculus are strikingly similar to those observed in the cat. These observations indicate that a set of common principles of multisensory integration is adaptable in widely divergent species living in very different ecological situations. 5. Surprisingly, a few multisensory neurons had individual receptive fields that were not in register with one another. This has not been noted in multisensory neurons of other species, and these "anomalous" receptive fields could present a daunting problem: stimuli originating from the same general location in space cannot simultaneously fall within their respective receptive fields, a stimulus pairing that may result in response depression. Conversely, stimuli that originate from separate events and disparate locations (and fall within their receptive fields) may result in response enhancement. However, the spatial principle of multisensory integration did not apply in these cases. (ABSTRACT TRUNCATED)

Barry E. Stein

Papers

The Merging of the Senses

Multisensory integration: current issues from the perspective of the single neuron.

Interactions among converging sensory inputs in the superior colliculus.

Sources of subcortical projections to the superior colliculus in the cat.

Representation and integration of multiple sensory inputs in primate superior colliculus.