In many everyday situations, our senses are bombarded by many different unisensory signals at any given time. To gain the most veridical, and least variable, estimate of environmental stimuli/properties, we need to combine the individual noisy unisensory perceptual estimates that refer to the same object, while keeping those estimates belonging to different objects or events separate. How, though, does the brain “know” which stimuli to combine? Traditionally, researchers interested in the crossmodal binding problem have focused on the roles that spatial and temporal factors play in modulating multisensory integration. However, crossmodal correspondences between various unisensory features (such as between auditory pitch and visual size) may provide yet another important means of constraining the crossmodal binding problem. A large body of research now shows that people exhibit consistent crossmodal correspondences between many stimulus features in different sensory modalities. For example, people consistently match high-pitched sounds with small, bright objects that are located high up in space. The literature reviewed here supports the view that crossmodal correspondences need to be considered alongside semantic and spatiotemporal congruency, among the key constraints that help our brains solve the crossmodal binding problem.

/pdf/crossmodal-correspondences-a-tutorial-review-20vme8gbi3.pdf

Crossmodal correspondences: A tutorial review

Contents: Foreword. Preface. What Are Statistical Decisions? Non-Parametric Measures of Sensitivity. Gaussian Distributions of Signal and Noise With Equal Variances. Gaussian Distributions of Signal and Noise With Unequal Variances. Conducting a Rating Scale Experiment. Choice Theory Approximations to Signal Detection Theory. Threshold Theory. The Laws of Categorical and Comparative Judgement. Appendices: Answers to Problems. Logarithms. Integration of the Expression for the Logistic Curve. Computer Programmes for Signal Detection Analysis. Tables.

A Primer of Signal Detection Theory; Table of D' and β

Wallace, Tylor, Wundt, Johannesson, and others have proposed that human language had its basis in hand and arm gestures. The Gardners' work with the chimpanzee Washoe, Premack's study of the chimpanzee Sarah, and continuing experiments along these lines indicate that neural restructuring would not have been necessary for the protohominid acquisition of a simple propositional gesture or sign language which did not involve cross-modal transfer at a high level from the visual to the auditory channel or vice versa. Evidence from primate studies, early tool-using, the continuing functions of gesture in human communication, lateral dominance in its relation to speech and tool manipulation, and other sources is presented to support a model of glottogenesis. It is argued that a preexisting gestural language system would have provided an easier pathway to vocal language than a direct outgrowth of the "emotional" use of vocalization characteristic of nonhuman primates.

Primate Communication and the Gestural Origin of Language

Wallace, Tylor, Wundt, Johannesson, and others have proposed that human language had its basis in hand and arm gestures. The Gardners' work with the chimpanzee Washoe, Premack's study of the chimpanzee Sarah, and continuing experiments along these lines indicate that neural restructuring would not have been necessary for the protohominid acquisition of a simple propositional gesture or sign language which did not involve cross-modal transfer at a high level from the visual to the auditory channel or vice versa. Evidence from primate studies, early tool-using, the continuing functions of gesture in human communication, lateral dominance in its relation to speech and tool manipulation, and other sources is presented to support a model of glottogenesis. It is argued that a preexisting gestural language system would have provided an easier pathway to vocal language than a direct outgrowth of the "emotional" use of vocalization characteristic of non-human primates.

Primate Communication and the Gestural Origin of Language [and Comments and Reply]

The Conners' Continuous Performance Test (CPT) is a neuropsychological task that has repeatedly been shown to differentiate ADHD from normal groups. Several variables may be derived from the Conners' CPT including errors of omission and commission, mean hit reaction time(RT), mean hit RT standard error, d', and β. What each CPT parameter actually assesses has largely been based upon clinical assumptions and the face validity of each measure (e.g., omission errors measure inattention, commission errors measure impulsivity). This study attempts to examine relations between various CPT variables and phenotypic behaviors so as to better understand the various CPT variables. An epidemiological sample of 817 children was administered the Conners' CPT. Diagnostic interviews were conducted with parents to determine ADHD symptom profiles for all children. Children diagnosed with ADHD had more variable RTs, made more errors of commission and omission, and demonstrated poorer perceptual sensitivity than nondiagnosed children. Regarding specific symptoms, generalized estimating equations (GEE) and ANCOVAs were conducted to determine specific relationships between the 18 DSM-IV ADHD symptoms and 6 CPT parameters. CPT performance measures demonstrated significant relationships to ADHD symptoms but did not demonstrate symptom domain specificity according to a priori assumptions. Overall performance on the two signal detection measures, d' and β, was highly related to all ADHD symptoms across symptom domains. Further, increased variability in RTs over time was related to most ADHD symptoms. Finally, it appears that at least 1 CPT variable, mean hit RT, is minimally related to ADHD symptoms as a whole, but does demonstrate some specificity in its link with symptoms of hyperactivity.

Maurice M. Taylor

Papers

The d' measure of signal detectability in vigilance-like situations.

Phonetic symbolism in four unrelated languages.

Another look at phonetic symbolism.