Integration of auditory and vibrotactile stimuli: Effects of phase and stimulus-onset asynchrony
TLDR
The perceptual integration of 250 Hz, 500 ms vibrotactile and auditory tones was studied in detection experiments as a function of relative phase and temporal asynchrony of the tone pulses and results indicated certain combinations of auditory and tactile signals result in significant integrative effects.Abstract:
The perceptual integration of 250 Hz, 500 ms vibrotactile and auditory tones was studied in detection experiments as a function of (1) relative phase and (2) temporal asynchrony of the tone pulses. Vibrotactile stimuli were delivered through a single-channel vibrator to the left middle fingertip and auditory stimuli were presented diotically through headphones in a background of 50 dB sound pressure level broadband noise. The vibrotactile and auditory stimulus levels used each yielded 63%–77%-correct unimodal detection performance in a 2-I, 2-AFC task. Results for combined vibrotactile and auditory detection indicated that (1) performance improved for synchronous presentation, (2) performance was not affected by the relative phase of the auditory and tactile sinusoidal stimuli, and (3) performance for non-overlapping stimuli improved only if the tactile stimulus preceded the auditory. The results are generally more consistent with a “Pythagorean Sum” model than with either an “Algebraic Sum” or an “Optimal Single-Channel” Model of perceptual integration. Thus, certain combinations of auditory and tactile signals result in significant integrative effects. The lack of phase effect suggests an envelope rather than fine-structure operation for integration. The effects of asynchronous presentation of the auditory and tactile stimuli are consistent with time constants deduced from single-modality masking experiments.read more
Citations
More filters
Integration of touch and sound in auditory cortex
TL;DR: In this paper, high-resolution fMRI of the macaque monkey was used to quantify the integration of auditory broadband noise and tactile stimulation of hand and foot in anaesthetized animals.
Journal ArticleDOI
Intersensory binding across space and time: A tutorial review
Lihan Chen,Jean Vroomen +1 more
TL;DR: This review examines various manifestations of spatial and temporal attraction between the senses (both direct effects and aftereffects), and discusses important constraints on the occurrence of these effects.
Journal ArticleDOI
Multisensory Representation of Frequency across Audition and Touch: High Density Electrical Mapping Reveals Early Sensory-Perceptual Coupling
TL;DR: High-density electrophysiological recordings were made in humans while they were presented with separate blocks of somatosensory, auditory, and audio-somatoensory “standards” and “deviants,” where the deviant differed in frequency.
Journal ArticleDOI
Integration of auditory and vibrotactile stimuli: effects of frequency.
TL;DR: Combined-modality detection for closely spaced frequencies was generally consistent with an algebraic sum model of perceptual integration; wider-frequency spacings were generally better fit by a Pythagorean sum model.
Journal ArticleDOI
Separate Mechanisms for Audio-Tactile Pitch and Loudness Interactions
TL;DR: It is shown that temporal frequency representations are perceptually linked regardless of the attended modality, and that audio-tactile loudness interactions depend critically on stimulus timing, while pitch interactions do not.
References
More filters
Journal ArticleDOI
Hearing lips and seeing voices
Harry McGurk,John Macdonald +1 more
TL;DR: The study reported here demonstrates a previously unrecognised influence of vision upon speech perception, on being shown a film of a young woman's talking head in which repeated utterances of the syllable [ba] had been dubbed on to lip movements for [ga].
Journal ArticleDOI
Transformed Up‐Down Methods in Psychoacoustics
TL;DR: A broad class of up‐down methods used in psychoacoustics with due emphasis on the related problems of parameter estimation and the efficient placing of observations is described, including examples where conventional techniques are inapplicable.
Journal ArticleDOI
Humans integrate visual and haptic information in a statistically optimal fashion.
TL;DR: The nervous system seems to combine visual and haptic information in a fashion that is similar to a maximum-likelihood integrator, and this model behaved very similarly to humans in a visual–haptic task.
Book
The Merging of the Senses
Barry E. Stein,M. Alex Meredith +1 more
TL;DR: The authors draw on their own experiments to illustrate how sensory inputs converge on individual neurons in different areas of the brain, how these neurons integrate their inputs, the principles by which this integration occurs, and what this may mean for perception and behavior.
Journal ArticleDOI
Neuronal Oscillations and Multisensory Interaction in Primary Auditory Cortex
Peter Lakatos,Chi-Ming Chen,Monica N. O'Connell,Aimee Mills,Charles E. Schroeder,Charles E. Schroeder +5 more
TL;DR: The timing and laminar profile of the multisensory interactions in A1 indicate that nonspecific thalamic systems may play a key role in the effect and underscore the instrumental role of neuronal oscillations in cortical operations.