3
A Roadmap for Technological Innovation in Multimodal Communication Research⋆
(www.researchgate.net)
Sumary made with Quivr/GPT-4
user:
What is this document about? Give me a detailed summary explaining the discoveries and observations in this document. Use plain English that is easy to understand and really highlight the potential benefits of the discoveries made. I am especially interested in ways in which this document applies to the study of animal communication and animal language.
assistant:
This document is a research paper by a group of scientists with diverse backgrounds who are studying multimodal communication. Multimodal communication refers to the way information is transferred through multiple channels, such as visual, acoustic, and tactile cues. The researchers are particularly interested in visual communication and how it interacts with other channels, like sound. They are exploring how communication, whether vocal or signed, is inherently multimodal and shaped by social interaction.
The researchers are part of the Priority Programme Visual Communication (ViCom), supported by the German Research Foundation. ViCom's goal is to understand the specific characteristics of visual communication and its interaction with other channels to develop models of human and animal communication.
The researchers acknowledge that many aspects of multimodal communication remain unknown, including how multiple signals are quickly integrated in perception and coordinated in production. They believe that technological advancements are needed to explore these aspects further. They also note that the tools and methods required for this research differ from those used for written text.
The paper aims to survey the existing research tools used in multimodal communication research, evaluate current approaches, identify scientific innovations, and provide suggestions for tools and applications. The researchers believe that these tools can help advance the interdisciplinary research dialogue between cognitive and computer science.
The paper also highlights the need for specific terminology in multimodal data acquisition and digital data analysis. It points out that some tools are primarily used by computer scientists due to the high technical skills required.
In terms of animal communication, the researchers mention that olfactory signals are used in animal communication. They also reference a study on the compositionality in primate gestural communication and multicomponent signal displays. However, the document does not provide detailed findings or observations specifically related to animal communication or language.