AUTHOR=Kvasova Daria , Garcia-Vernet Laia , Soto-Faraco Salvador 

TITLE=Characteristic Sounds Facilitate Object Search in Real-Life Scenes

JOURNAL=Frontiers in Psychology

VOLUME=Volume 10 - 2019

YEAR=2019

URL=https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2019.02511

DOI=10.3389/fpsyg.2019.02511

ISSN=1664-1078

ABSTRACT=Real-world multisensory events do not only provide temporally and spatially correlated information, but also semantic correspondences about object identity. Semantically consistent sounds can enhance visual detection, identification and search performance, but these effects are always demonstrated in simple and stereotyped displays that lack ecological validity. In order to address identity-based crossmodal relationships in real-world​ scenarios, we designed a visual search task using complex, dynamic scenes. Participants searched objects in video clips from real life scenes with background sounds. Auditory cues embedded in the background sounds could be target-consistent, distracter-consistent, neutral and no sound (just background noise). We found that characteristic sounds enhance the visual search of relevant objects in natural scenes but fail to increase the salience of irrelevant distracters. Our findings generalize previous results on object-based crossmodal interactions with simple stimuli and shed light upon how audio-visual semantically congruent relationships play out in real-life contexts.