Event Abstract

Audiovisual integration in speech perception

  • 1 Department of Psychophysiology, Research Institute for Psychology, Hungary
  • 2 Biophysics Department, KFKI Research Institute for Particle and Nuclear Physics, Hungary
  • 3 Department of Cognitive Psychology, Institute of Psychology, Eötvös Loránd University, Hungary
  • 4 Department of Information Systems, Eötvös Loránd University of Sciences, Hungary

Speech comprehension is significantly improved by visual information originating from the inspection of the speaker's mouth movements. Audiovisual integration necessary for the existence of this phenomenon is often studied in EEG experiments by the comparison of the event related potential (ERP) evoked by a bimodal stimulus and the sum of ERPs triggered by the auditory and the visual modalities (AV versus A+V comparison). However, due to ERP components common to all these three types of stimulus, this analysis can only be applied to the first 200 ms poststimulus latency, and subsequent components (e.g. auditory P2 component) can not be studied by this method. Moreover, spurious results might emerge also in the analyzed 200 ms range due to common early anticipatory potentials. In order to circumvent methodological problems related to the AV versus A+V method, we suggest a different approach for the investigation of audiovisual integration: temporally slightly asynchronous bimodal syllable was presented to the subjects, which leaded to the development of either a fused or an unfused percept. ERPs belonging to the two different perceptions were compared. We found that components corresponding to both auditory N1 and P2 waves were smaller in case of the fused perception and the N1 effect showed a clearly right hemisphere dominance while the effect around the P2 peak was most pronounced on central electrodes. These results are in accordance with previous studies suggesting suppression of N1 generator activities during speech-related audiovisual interaction and suggest a similar phenomenon to subsequent processing stages too.

Conference: 12th Meeting of the Hungarian Neuroscience Society, Budapest, Hungary, 22 Jan - 24 Jan, 2009.

Presentation Type: Poster Presentation

Topic: Behavioural neuroscience

Citation: Huhn Z, Szirtes G, Lorincz A and Csepe V (2009). Audiovisual integration in speech perception. Front. Syst. Neurosci. Conference Abstract: 12th Meeting of the Hungarian Neuroscience Society. doi: 10.3389/conf.neuro.01.2009.04.090

Received: 03 Mar 2009; Published Online: 03 Mar 2009.

* Correspondence: Zsofia Huhn, Department of Psychophysiology, Research Institute for Psychology, Budapest, Hungary, huhn.zsofia@gmail.com

© 2007 - 2018 Frontiers Media S.A. All Rights Reserved