scispace - formally typeset
Journal ArticleDOI

An introduction to multimodal communication

TLDR
The history of the study of complexity in animal communication, issues relating to defining and classifying multi-modal signals, and particular issues to consider with multimodal (as opposed to multicomponent unimodal) communication are discussed.
Abstract
Though it has long been known that animal communication is complex, recent years have seen growing interest in understanding the extent to which animals give multicomponent signals in multiple modalities, and how the different types of information extracted by receivers are interpreted and integrated in animal decision-making. This interest has culminated in the production of the present special issue on multimodal communication, which features both theoretical and empirical studies from leading researchers in the field. Reviews, comparative analyses, and species-specific empirical studies include manuscripts on taxa as diverse as spiders, primates, birds, lizards, frogs, and humans. The present manuscript serves as both an introduction to this special issue, as well as an introduction to multimodal communication more generally. We discuss the history of the study of complexity in animal communication, issues relating to defining and classifying multimodal signals, and particular issues to consider with multimodal (as opposed to multicomponent unimodal) communication. We go on to discuss the current state of the field, and outline the contributions contained within the issue. We finish by discussing future avenues for research, in particular emphasizing that ‘multimodal’ is more than just ‘bimodal’, and that more integrative frameworks are needed that incorporate more elements of efficacy, such as receiver sensory ecology and the environment.

read more

Citations
More filters
Journal ArticleDOI

Pollution going multimodal: the complex impact of the human-altered sensory environment on animal perception and performance.

TL;DR: It is concluded that sensory pollution can affect animals in complex ways due to interactions among sensory stimuli, neural processing and behavioural and endocrinal feedback.
Journal ArticleDOI

How Robots Influence Humans: A Survey of Nonverbal Communication in Social Human–Robot Interaction

TL;DR: This paper uniquely investigates findings that span across these different nonverbal modes and how they influence humans in four separate ways: shifting cognitive framing, eliciting emotional responses, triggering specific behavioral responses, and improving task performance.
Journal ArticleDOI

A systems approach to animal communication

TL;DR: It is demonstrated how consideration of the system-level organization of animal communication poses new practical research questions that will aid the understanding of how and why animal displays are so complex.
Journal ArticleDOI

Prosocial signaling and cooperation among Martu hunters

TL;DR: In this article, the prosocial sharing hypothesis among Martu hunters is tested and it is shown that prosocial generosity produces benefits indirectly, through the formation of trusting, cooperative partnerships, and that those who consistently pay higher costs to share, not necessarily those who are better hunters, are preferred partners for cooperative hunting.
References
More filters
Book

The Expression of the Emotions in Man and Animals

TL;DR: The Expression of the Emotions in Man and Animals Introduction to the First Edition and Discussion Index, by Phillip Prodger and Paul Ekman.
Journal ArticleDOI

Hearing lips and seeing voices

TL;DR: The study reported here demonstrates a previously unrecognised influence of vision upon speech perception, on being shown a film of a young woman's talking head in which repeated utterances of the syllable [ba] had been dubbed on to lip movements for [ga].
Journal ArticleDOI

Is neocortex essentially multisensory

TL;DR: The notion that neocortical operations are essentially multisensory is examined, which forces us to abandon the notion that the senses ever operate independently during real-world cognition.
Journal ArticleDOI

The use of multiple cues in mate choice

TL;DR: It is suggested that in contrast to this expectation, the use of multiple cues can reduce mate choice costs by decreasing the number of mates inspected more closely or the time and energy spent inspecting a set of mates.
Journal ArticleDOI

Complex signal function: developing a framework of testable hypotheses

TL;DR: This work builds a framework of functional hypotheses of complex signal evolution based on content-driven (ultimate) and efficacy-driven selection pressures (sensu Guilford and Dawkins 1991), and point out key predictions for various hypotheses and discuss different approaches to uncovering complex signal function.
Related Papers (5)