Felipe Reinoso Carvalho

Bio: Felipe Reinoso Carvalho is an academic researcher from Vrije Universiteit Brussel. The author has contributed to research in topics: Perception & Soundscape. The author has an hindex of 10, co-authored 16 publications receiving 357 citations. Previous affiliations of Felipe Reinoso Carvalho include Katholieke Universiteit Leuven.

Does Music Influence the Multisensory Tasting Experience

Abstract: All of the senses can potentially contribute to the perception and experience of food and drink. Sensory influences come both from the food or drink itself, and from the environment in which that food or drink is tasted and consumed. In this study, participants initially had to pair each of three soundtracks with one of three chocolates (varying on the bitter-sweet dimension). In a second part of the study, the impact of the various music samples on these participants’ ratings of the taste of various chocolates was assessed. The results demonstrate that what people hear exerts a significant influence over their rating of the taste of the chocolate. Interestingly, when the results were analysed based on the participants’ individual music-chocolate matches (rather than the average response of the whole group), more robust crossmodal effects were revealed. These results therefore provide support for the claim that ambient sound influences taste judgments, and potentially provide useful insights concerning the future design of multisensory tasting experiences. Practical Applications The approach outlined here follows the increasing demand from the field of gastronomy for greater influence over the general multisensory atmosphere surrounding eating/drinking experiences. One of the novel contributions of the present research is to show how, by considering a participant's individual response, further insight for user-studies in gastrophysics may be provided. Increasing the personalization of such experiments in the years to come may help researchers to design individualized “sonic seasoning” experiences that are even more effective. In the future, then, the approach outlined here may help researchers and experience designers to obtain more profound effects of the auditory or multisensory atmosphere.

Music Influences Hedonic and Taste Ratings in Beer

Abstract: The research presented here focuses on the influence of background music on the beer-tasting experience. An experiment is reported in which different groups of customers tasted a beer under three different conditions (N = 231). The control group was presented with an unlabeled beer, the second group with a labeled beer, and the third group with a labeled beer together with a customized sonic cue (a short clip from an existing song). In general, the beer-tasting experience was rated as more enjoyable with music than when the tasting was conducted in silence. In particular, those who were familiar with the band that had composed the song, liked the beer more after having tasted it while listening to the song, than those who knew the band, but only saw the label while tasting. These results provide support for the idea that customized sound-tasting experiences can complement the process of developing novel beverage (and presumably also food) events. Here we also suggest that involving musicians and researchers alongside brewers in the process of beer development, offers an interesting model for future development. Finally, we discuss the role of attention in sound-tasting experiences, and the importance that a positive hedonic reaction towards a song can have for the ensuing tasting experience.

Using sound-taste correspondences to enhance the subjective value of tasting experiences.

Abstract: The soundscapes of those places where we eat and drink can influence our perception of taste. Here, we investigated whether contextual sound would enhance the subjective value of a tasting experience. The customers in a chocolate shop were invited to take part in an experiment in which they had to evaluate a chocolate's taste while listening to an auditory stimulus. Four different conditions were presented in a between-participants design. Envisioning a more ecological approach, a pre-recorded piece of popular music and the shop's own soundscape were used as the sonic stimuli. The results revealed that not only did the customers report having a significantly better tasting experience when the sounds were presented as part of the food's identity, but they were also willing to pay significantly more for the experience. The method outlined here paves a new approach to dealing with the design of multisensory tasting experiences, and gastronomic situations.

Universal access in the information society

Abstract: ▶ Addresses the accessibility, usability, and, ultimately, acceptability of Information Society Technologies by anyone, anywhere, at anytime, and through any media and device. ▶ Focuses on theoretical, methodological, and empirical research, of both technological and non-technological nature. ▶ Features papers that report on theories, methods, tools, empirical results, reviews, case studies, and best-practice examples.

"When Birds of a Feather Flock Together": Synesthetic Correspondences Modulate Audiovisual Integration in Non-Synesthetes

Abstract: Background Synesthesia is a condition in which the stimulation of one sense elicits an additional experience, often in a different (i.e., unstimulated) sense. Although only a small proportion of the population is synesthetic, there is growing evidence to suggest that neurocognitively-normal individuals also experience some form of synesthetic association between the stimuli presented to different sensory modalities (i.e., between auditory pitch and visual size, where lower frequency tones are associated with large objects and higher frequency tones with small objects). While previous research has highlighted crossmodal interactions between synesthetically corresponding dimensions, the possible role of synesthetic associations in multisensory integration has not been considered previously. Methodology Here we investigate the effects of synesthetic associations by presenting pairs of asynchronous or spatially discrepant visual and auditory stimuli that were either synesthetically matched or mismatched. In a series of three psychophysical experiments, participants reported the relative temporal order of presentation or the relative spatial locations of the two stimuli. Principal Findings The reliability of non-synesthetic participants' estimates of both audiovisual temporal asynchrony and spatial discrepancy were lower for pairs of synesthetically matched as compared to synesthetically mismatched audiovisual stimuli. Conclusions Recent studies of multisensory integration have shown that the reduced reliability of perceptual estimates regarding intersensory conflicts constitutes the marker of a stronger coupling between the unisensory signals. Our results therefore indicate a stronger coupling of synesthetically matched vs. mismatched stimuli and provide the first psychophysical evidence that synesthetic congruency can promote multisensory integration. Synesthetic crossmodal correspondences therefore appear to play a crucial (if unacknowledged) role in the multisensory integration of auditory and visual information.

Sounds like a healthy retail atmospheric strategy: Effects of ambient music and background noise on food sales

Abstract: Retail atmospherics is becoming an increasingly important strategic tool for stores and restaurants. Ambient music and background noise are especially important atmospheric elements given their ubi ...

Not just seeing, but also feeling art: Mid-air haptic experiences integrated in a multisensory art exhibition

Abstract: The use of the senses of vision and audition as interactive means has dominated the field of Human-Computer Interaction (HCI) for decades, even though nature has provided us with many more senses for perceiving and interacting with the world around us. That said, it has become attractive for HCI researchers and designers to harness touch, taste, and smell in interactive tasks and experience design. In this paper, we present research and design insights gained throughout an interdisciplinary collaboration on a six-week multisensory display – Tate Sensorium – exhibited at the Tate Britain art gallery in London, UK. This is a unique and first time case study on how to design art experiences whilst considering all the senses (i.e., vision, sound, touch, smell, and taste), in particular touch, which we exploited by capitalizing on a novel haptic technology, namely, mid-air haptics. We first describe the overall set up of Tate Sensorium and then move on to describing in detail the design process of the mid-air haptic feedback and its integration with sound for the Full Stop painting by John Latham (1961). This was the first time that mid-air haptic technology was used in a museum context over a prolonged period of time and integrated with sound to enhance the experience of visual art. As part of an interdisciplinary team of curators, sensory designers, sound artists, we selected a total of three variations of the mid-air haptic experience (i.e., haptic patterns), which were alternated at dedicated times throughout the six-week exhibition. We collected questionnaire-based feedback from 2500 visitors and conducted 50 interviews to gain quantitative and qualitative insights on visitors’ experiences and emotional reactions. Whilst the questionnaire results are generally very positive with only a small variation of the visitors’ arousal ratings across the three tactile experiences designed for the Full Stop painting, the interview data shed light on the differences in the visitors’ subjective experiences. Our findings suggest multisensory designers and art curators can ensure a balance between surprising experiences versus the possibility of free exploration for visitors. In addition, participants expressed that experiencing art with the combination of mid-air haptic and sound was immersive and provided an up-lifting experience of touching without touch. We are convinced that the insights gained from this large-scale and real-world field exploration of multisensory experience design exploiting a new and emerging technology provide a solid starting point for the HCI community, creative industries, and art curators to think beyond conventional art experiences. Specifically, our work demonstrates how novel mid-air technology can make art more emotionally engaging and stimulating, especially abstract art that is often open to interpretation.