The role of visual information in the processing of place and manner features in speech perception
Kerry P. Green,Patricia K. Kuhl +1 more
TLDR
The results demonstrate that place-voice interactions are not limited to situations in which place information is specified audibly, and the voicing boundary is not shifted in the absence of a change in the global percept, even when discrepant auditory-visual information is presented.Abstract:
Visual information provided by a talker's mouth movements can influence the perception of certain speech features. Thus, the "McGurk effect" shows that when the syllable (bi) is presented audibly, in synchrony with the syllable (gi), as it is presented visually, a person perceives the talker as saying (di). Moreover, studies have shown that interactions occur between place and voicing features in phonetic perception, when information is presented audibly. In our first experiment, we asked whether feature interactions occur when place information is specificed by a combination of auditory and visual information. Members of an auditory continuum ranging from (ibi) to (ipi) were paired with a video display of a talker saying (igi). The auditory tokens were heard as ranging from (ibi) to (ipi), but the auditory-visual tokens were perceived as ranging from (idi) to (iti). The results demonstrated that the voicing boundary for the auditory-visual tokens was located at a significantly longer VOT value than the voicing boundary for the auditory continuum presented without the visual information. These results demonstrate that place-voice interactions are not limited to situations in which place information is specified audibly.(ABSTRACT TRUNCATED AT 250 WORDS)read more
Citations
More filters
Journal ArticleDOI
Infants' perception of expressive behaviors: differentiation of multimodal information.
TL;DR: The literature on infants' perception of facial and vocal expressions, combined with data from studies on infant-directed speech, mother-infant interaction, and social referencing, supports the view that infants come to recognize the affective expressions of others through a perceptual differentiation process.
Journal ArticleDOI
Temporal constraints on the McGurk effect
TL;DR: The results suggest that perceivers may be sensitive to the concordance of the time-varying aspects of speech but they do not require temporal coincidence of that information.
Journal ArticleDOI
Two-month-old infants match phonetic information in lips and voice
TL;DR: This article showed that infants aged 2.5 months are able to match phonetic information in the face and voice of infants at 2 months of age and showed evidence of matching vowel information in face and speech.
Journal ArticleDOI
Auditory–visual integration of talker gender in vowel perception
TL;DR: This article found that the gender of a visually presented face affects the location of the phoneme boundary between [Ω] and [Λ] in the perceptual identification of a continuum of auditory-visual stimuli ranging from hood to hud.
Journal ArticleDOI
McGurk effect in non-English listeners: few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility.
Kaoru Sekiyama,Yoh’ichi Tohkura +1 more
TL;DR: The results indicate that the "Japanese McGurk effect" is less easily induced than the English one, and that it depends on the auditory intelligibility of the speech signal.
References
More filters
Journal ArticleDOI
Hearing lips and seeing voices
Harry McGurk,John Macdonald +1 more
TL;DR: The study reported here demonstrates a previously unrecognised influence of vision upon speech perception, on being shown a film of a young woman's talking head in which repeated utterances of the syllable [ba] had been dubbed on to lip movements for [ga].
Journal ArticleDOI
A Cross-Language Study of Voicing in Initial Stops: Acoustical Measurements
Leigh Lisker,Arthur S. Abramson +1 more
TL;DR: A cross-language study of Voicing in Initial Stops: Acoustical Measurements as discussed by the authors was conducted in the early 1960s and the results showed that the initial stops were noisy.
Journal ArticleDOI
The Bimodal Perception of Speech in Infancy
TL;DR: Both the ability to detect auditory-visual correspondences and the tendency to imitate may reflect the infant's knowledge of the relationship between audition and articulation.
Journal ArticleDOI
Phonetic categorization in auditory word perception.
TL;DR: In two experiments, subjects showed a significant lexical effect--that is, a tendency to make phonetic categorizations that make words that are greater at the phoneme boundary than at the ends of the condinua.