Audiovisual speech integration in adolescents with Specific Language Impairment (SLI): A mismatch between modalities is not detected
-
1
Centre for Developmental Language Disorders and Cognitive Neuroscience, University College London, United Kingdom
-
2
Institute for Research in Child Development, School of Psychology, University of East London, United Kingdom
-
3
Department of Phonetics, University of Turku, Finland
The Mismatch Negativity (MMN) reflects the expectation violation when current auditory input does not match an anticipated one. The anticipation of the ensuing auditory event may be based on the immediate auditory past but also on the long-term memory traces. Our study (Kushnerenko et al, 2008, PNAS) suggested that a similar kind of a mismatch response can be elicited in infants when speech processing initiated by visual articulation was violated by an unexpected speech sound.
An integration of auditory and visual cues sometimes leads to illusory effects (the McGurk effect): when an auditory /ba/ is dubbed onto a visual /ga/, the illusory /da/ is often reported. Less studied is the reverse incongruent combination of an auditory /ga/ and a visual /ba/ which is not fused to a coherent percept. Apparently, the visual /ba/ exerts much more predictive power on the ensuing auditory event, than /ga/ and, therefore, disallows its fusion with the auditory /ga/ input. In 5-month old infants, this incongruent audiovisual combination elicits a brain response with timing and scalp distribution similar to that of the infant’s auditory mismatch response.
We aimed 1) to identify whether the violation of audiovisual speech relations results in a similar mismatch response in adolescents and 2) to explore perception of incongruent audiovisual speech input in adolescents with atypical language development (Specific Language Impairment, SLI).
We recorded the ERPs of 8 SLI subjects (13-19 years) and 8 controls in response to 4 types of audiovisual (AV) syllables: congruent /ba/ and /ga/ syllables, and 2 incongruent generated by crossing the auditory and visual components of these stimuli.
In order to control for different auditory and visual inputs two types of difference waves were analyzed. In the control group but not the SLI group both difference waves revealed a frontocentral negative peak at about 230 ms from sound onset (main effect for group (F(1,14)=8.72; p<.0105). In addition, the amplitudes of auditory N1 responses to all the stimuli were smaller in the SLI group and there was a right hemisphere predominance (Group x Hemisphere interaction F(2,28)=3.49; p<.0442). In contrast, occipitally recorded visual N1 responses to /ga/ and /ba/ articulation were similar in both groups.
These results suggest that SLI do not detect mismatch between incongruent auditory and visual speech input. We will discuss the possible roles of auditory perception and integration processes to account for the data.
Conference:
MMN 09
Fifth Conference on Mismatch Negativity (MMN) and its Clinical and Scientific Applications, Budapest, Hungary, 4 Apr - 7 Apr, 2009.
Presentation Type:
Poster Presentation
Topic:
Poster Presentations
Citation:
Kushnerenko
E,
Tuomainen
O,
Moore
DG and
Van-der-Lely
HK
(2009). Audiovisual speech integration in adolescents with Specific Language Impairment (SLI): A mismatch between modalities is not detected.
Conference Abstract:
MMN 09
Fifth Conference on Mismatch Negativity (MMN) and its Clinical and Scientific Applications.
doi: 10.3389/conf.neuro.09.2009.05.094
Copyright:
The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers.
They are made available through the Frontiers publishing platform as a service to conference organizers and presenters.
The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated.
Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed.
For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions.
Received:
25 Mar 2009;
Published Online:
25 Mar 2009.
*
Correspondence:
Elena Kushnerenko, Centre for Developmental Language Disorders and Cognitive Neuroscience, University College London, London, United Kingdom, e.kushnerenko@gmail.com