Impact Factor 3.707 | CiteScore 5.1
More on impact ›

REVIEW article

Front. Neurosci. | doi: 10.3389/fnins.2021.652611

Multisensory Integration as per Technological Advances: A review Provisionally accepted The final, formatted version of the article will be published soon. Notify me

  • 1University College London, United Kingdom
  • 2BI Norwegian Business School, Norway

Multisensory integration research has allowed us to better understand how humans integrate sensory information to produce a unitary experience of the external world. However, this field is often challenged by the limited ability to deliver and control sensory stimuli, especially when going beyond audio-visual events and outside laboratory settings. In this review, we examine the scope and challenges of new technology in the study of multisensory integration in a world that is increasingly characterized as a fusion of physical and digital/virtual events. We discuss multisensory integration research through the lens of novel multisensory technologies, and thus, bring research in human-computer interaction, experimental psychology, and neuroscience closer together. Today, for instance, displays have become volumetric so that visual content is no longer limited to 2D screens, new haptic devices enable tactile stimulation without physical contact, olfactory interfaces provide users with smells precisely synchronized with events in virtual environments, and novel gustatory interfaces enable taste perception through levitating stimuli. These technological advances offer new ways to control and deliver sensory stimulation for multisensory integration research beyond traditional laboratory settings and open up new experimentations in naturally occurring events in everyday life experiences. Our review then summarizes these multisensory technologies and discusses initial insights to introduce a bridge between the disciplines in order to advance the study of multisensory integration.

Keywords: multisensory integration, human-computer interaction, multisensory technology, Interaction techniques, sensory stimulation

Received: 12 Jan 2021; Accepted: 29 Apr 2021.

Copyright: © 2021 Cornelio, Velasco and Obrist. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

* Correspondence: Dr. Patricia Cornelio, University College London, London, United Kingdom, p.cornelio@ucl.ac.uk