This book is about the processing of information in face-to-face communication when a speaker makes both audible and visible information available to a perceiver. Both auditory and visual sources of information are evaluated and integrated to achieve speech perception. The evaluation of the information source provides information about the strength of alternative interpretations, rather than just all-or-none categorical information, as claimed by “categorical perception” theory. Information sources are evaluated independently; the integration process insures that the least ambiguous sources have the most influences on the judgment. Similar processes occur in a variety of other behaviors, ranging from personality judgments and categorization to sentence interpretation and decision making. The experimental results are consistent with a fuzzy logical model of perception, positing three operations in perceptual (primary) recognition: feature evaluation, feature integration, and pattern classification. Continuously valued features are first evaluated, then integrated and matched against prototype descriptions in memory; finally, an identification decision is made on the basis of the relative goodness-of-match of the stimulus information with the relevant prototype descriptions.

Speech Perception By Ear and Eye: A Paradigm for Psychological Inquiry

Intelligibility of normal speech I: global and fine-grained acoustic-phonetic talker characteristics

The notion of modularity, introduced by Noam Chomsky and developed with special emphasis on perceptual and linguistic processes by Jerry Fodor in his important book "The Modularity of Mind, " has provided a significant stimulus to research in cognitive science. This book presents essays in which a diverse group of philosophers, linguists, psycholinguists, and neuroscientists--including both proponents and critics of the modularity hypothesis--address general questions and specific problems related to modularity.

Modularity in knowledge representation and natural-language understanding

From both direct-realist and motor-theoretic perspectives, the objects of speech perception are construed as articulatory events. We offer the alternative view that it is the auditory properties of phonetic events to which listeners are primarily sensitive. Evidence for this alternative view comes from a variety of sources, including studies of phonetic and phonological universals, comparisons of the perception of speech and nonspeech signals, cross-language perceptual experi- ments, and studies of phonetic categorization by nonhuman animals.

On the Objects of Speech Perception

Several models of information integration are developed and analyzed within the context of a proto-typical pattern-recognition task. The central concerns are whether the models prescribe maximally efficient (optimal) integration and to what extent the models are psychologically valid. Evaluation, integration, and decision processes are specified for each model. Important features are whether evaluation is noisy, whether integration follows Bayes's theorem, and whether decision consists of a criterion rule or a relative goodness rule. Simulations of the models and predictions of the results by the same models are carried out to provide a measure of identifiability or the extent to which the models can be distinguished from one another. The models are also contrasted against empirical results from tasks with 2 and 4 response alternatives and with graded responses.

/pdf/models-of-integration-given-multiple-sources-of-information-2hl7f2m526.pdf

Models of integration given multiple sources of information.

Several experiments investigate voicing judgments in minimal pairs likerabid-rapid when the duration of the first vowel and the medial stop are varied factorially and other cues for voicing remain ambiguous. In Experiments 1 and 2, in which synthetic labial and velar-stop voicing pairs are investigated, the perceptual boundary along a continuum of silent consonant durations varies in constant proportion to increases in the duration of the preceding vocalic interval. In Experiment 3, it is shown that speaking tempo external to the test word has far smaller effects on a closure duration boundary for voicing than does the tempo within the test word. Experiment 4 shows that, even within the word, it is primarily the preceding vowel that accounts for changes in the consonant duration effects. Furthermore, in Experiments 3 and 4, the effects of timing outside the vowel-consonant interval are independent of the duration of that interval itself. These findings suggest that consonant/vowel ratio serves as a primary acoustic cue for English voicing in syllable-final position and imply that this ratio possibly is directly extracted from the speech signal.

https://link.springer.com/content/pdf/10.3758/BF03204273.pdf

Jonathan Dalby

Papers

Consonant/vowel ratio as a cue for voicing in English