Open Access
Multisensory integration in percussion performance
TLDR
In this paper, the authors investigated how auditory and haptic information concerning objects hardness is integrated for the purpose of controlling the velocity with which we strike an object and found that the haptic changes could be congruent (e.g., both increased in hardness) or incongruent.Abstract:
We investigated how auditory and haptic information concerning objects hardness is integrated for the purpose of controlling the velocity with which we strike an object. Our experimental manipulations and data analyses considered a variety of factors that should be integrated in a theory of multisensory perception: expertise of the perceiver; context (unimodal vs. multimodal); inter-modality congruence; inter-participants agreement in sensory weighting; performance. On each trial, participants struck a virtual object with a constant target velocity and received feedback on correctness. When the performance criterion was reached, feedback was eliminated, the auditory and/or haptic hardness of the struck object were changed, and the e ects on subsequent striking velocity and performance were measured. In unimodal trials only the haptic or auditory display was presented. In multisensory trials, the audio-haptic changes could be congruent (e.g., both increased in hardness) or incongruent. We recruited participants with di erent levels of expertise with the task: percussionists, nonpercussionist musicians and nonmusicians. For both modalities, striking velocity increased with decreasing hardness, and vice versa. With the vast majority of participants, changes in haptic hardness were perceptually more relevant because they in- uenced striking velocity to a greater degree than did changes in auditory hardness. The perceptual weighting of auditory information was robust to context variations (unimodal vs. multimodal), independent of expertise, uniform across participants and modulated by audio-haptic congruence. The perceptual weighting of haptic information was modulated by context and expertise, was more varied across participants and was robust to changes in audio-haptic congruence. Performance in velocity tracking was more strongly a ected by haptic than by auditory information, was not at its best in a multisensory context and was independent of information congruence.read more
References
More filters
Book
Mixed-Effects Models in S and S-PLUS
TL;DR: Linear Mixed-Effects and Nonlinear Mixed-effects (NLME) models have been studied in the literature as mentioned in this paper, where the structure of grouped data has been used for fitting LME models.
Journal ArticleDOI
Humans integrate visual and haptic information in a statistically optimal fashion.
TL;DR: The nervous system seems to combine visual and haptic information in a fashion that is similar to a maximum-likelihood integrator, and this model behaved very similarly to humans in a visual–haptic task.
Book
Linear Mixed Models for Longitudinal Data
Geert Verbeke,Geert Molenberghs +1 more
TL;DR: Using data of 955 men, Brant et al showed that the average rates of increase of systolic blood pressure (SBP) are smallest in the younger age groups, and greatest in the older agegroups, and that obese individuals tend to have a higher SBP than non-obese individuals.
Book
The Handbook of Multisensory Processing
TL;DR: This landmark reference work brings together for the first time in one volume the most recent research from different areas of the emerging field of multisensory integration with broad underlying principles that govern this interaction, regardless of the specific senses involved.
Journal ArticleDOI
Size-contrast illusions deceive the eye but not the hand
TL;DR: Evidence is presented that the calibration of grasp is quite refractory to pictorial illusions that have large effects on perceptual judgements of size, suggesting that the automatic and metrically accurate calibrations required for skilled actions are mediated by visual processes that are separate from those mediating the authors' conscious experiential perception.
Related Papers (5)
Visual-haptic cue weighting is independent of modality-specific attention
HB Helbig,Marc O. Ernst +1 more