Abstract
In the neuroscience of language, phonemes are frequently described as multimodal units whose neuronal representations are distributed across perisylvian cortical regions, including auditory and sensorimotor areas. A different position views phonemes primarily as acoustic entities with posterior temporal localization, which are functionally independent from frontoparietal articulatory programs. To address this current controversy, we here discuss experimental results from functional magnetic resonance imaging (fMRI) as well as transcranial magnetic stimulation (TMS) studies. On first glance, a mixed picture emerges, with earlier research documenting neurofunctional distinctions between phonemes in both temporal and frontoparietal sensorimotor systems, but some recent work seemingly failing to replicate the latter. Detailed analysis of methodological differences between studies reveals that the way experiments are set up explains whether sensorimotor cortex maps phonological information during speech perception or not. In particular, acoustic noise during the experiment and ‘motor noise’ caused by button press tasks work against the frontoparietal manifestation of phonemes. We highlight recent studies using sparse imaging and passive speech perception tasks along with multivariate pattern analysis (MVPA) and especially representational similarity analysis (RSA), which succeeded in separating acoustic-phonological from general-acoustic processes and in mapping specific phonological information on temporal and frontoparietal regions. The question about a causal role of sensorimotor cortex on speech perception and understanding is addressed by reviewing recent TMS studies. We conclude that frontoparietal cortices, including ventral motor and somatosensory areas, reflect phonological information during speech perception and exert a causal influence on language understanding.
Introduction
Establishing links between the specifically human ability to speak and understand language and the underlying neuronal machinery of the human brain is a key to modern cognitive neuroscience. At the level of specific language sounds, or phonemes, such links were first suggested by magnetoencephalography (MEG) recordings which showed that neuromagnetic activity differed between vowel types (Diesch et al., ). This work was followed by demonstrations of distinct and phoneme-specific local activity patterns in the superior temporal cortex, close to auditory perceptual areas (Obleser et al., , ; Obleser and Eisner, ). However, phonemes are abstract multimodal units interlinking what is heard with how to produce the acoustic signals, and even visual representations of the articulatory movement play a role in processing speech sounds (McGurk and MacDonald, ; Schwartz et al., 2004). Therefore, their neuronal correlates may not be locally represented in the brain in and close to the auditory-perceptual temporal cortex alone, but, instead, may be supported by distributed neuronal circuits that interlink acoustic perceptual and articulatory motor information (Pulvermüller, ; Pulvermüller and Fadiga, 2010; Schwartz et al., 2012; Strijkers and Costa, 2016).
That phonemic perceptual mechanisms link up with articulatory information processing in the mind and brain had long been stated by biological and cognitive models of speech processing. In particular Fry’s () early model postulated sensorimotor articulatory-acoustic mechanisms and also the Motor Theory of Speech Perception (Liberman et al., ; Liberman and Whalen, ) linked phonemic production with perception, although other statements immanent to that theory—about the modularity of speech processing and the primacy of the speech motor module for perception—appear problematic today (Galantucci et al., ; Pulvermüller et al., 2006). Contrasting with the cross-modal links suggested by biological and motor theories, a classic position in the neuroscience of language had been that speech motor and speech perception networks are relatively independent from each other (Wernicke, 1874; Lichtheim, ), a position also inherited by more recent approaches. As one example, , (, p. 181). views the posterior superior temporal sulcus as the locus for phonemes and as “the real gateway to understanding”. Today, two diverging positions dominate discussions about the brain basis of phonemes (Figure 1). In one view, phonemic speech perception circuits are located in temporal and temporo-parietal cortex and are functionally separate from speech production circuits in inferior frontal and articulatory areas. We call this the “local fractionated circuit model” of speech perception and production, because, in this view, the temporal speech perception network would realize speech recognition on its own (local fractionation) and speech production circuits in fronto-parietal cortex (or “dorsal stream”) are considered to play “little role in perceptual recognition” (Hickok, , p. 239)1. Speech production and perception are thus viewed as independent processes, mapped onto separate brain substrates with no significant interaction between them, hence the term “fractionated circuit model”. In contrast, the “action-perception integration model” postulates strong reciprocal links between speech perception and production mechanisms yielding multimodal distributed neuronal circuits, which provide the neuronal basis for the production, perception and discrimination of phonemes. These distributed multimodal circuits encompass acoustic perceptual mechanisms in temporal cortex along with articulatory sensorimotor information access in fronto-parietal areas2. Thus, in contrast to Liberman’s pure motor theory, which viewed articulatory gestures, i.e., motor units, as the central unit of speech perception, modern neurobiological theories of speech perception emphasize the interplay between perceptual and motor processes, positing that language processing relies on action-perception circuits distributed across auditory and motor systems (Pulvermüller and Fadiga, 2010, 2016).
Figure 1
From an integrative action-perception perspective, the fronto-parietal sensorimotor system appears well suited for processing fine-grained differences between speech sounds, because the muscles and motor movements relevant for the articulation of speech sounds have different and well-investigated cortical loci side by side (Penfield and Rasmussen, ; Bouchard et al., ). Neighboring body parts are controlled by adjacent locations of the motor and premotor cortex (PMC) and a similar somatotopic relationship holds in the somatosensory cortex, where the sensations in adjacent parts of the body are represented side-by-side. Different articulators such as the lips, jaw and tongue are localized from top to bottom in the so-called “motor strip”, thus predicting that a phoneme strongly involving the lips—such as the [+bilabial] phoneme /p/—is cortically underpinned by relatively more dorsal neuronal assemblies than a tongue related phonological element—such as the [+alveolar] phoneme /t/. Apart from predominant articulator involvement per se (e.g., tongue vs. lips), different actions performed with the same articulator muscles may have their specific articulatory-phonological mappings in the motor system (Kakei et al., ; Graziano et al., ; Pulvermüller, ; Graziano, ), thus possibly resulting, for example, in differential cortical motor correlates of different tongue-dominant consonants (/s/ vs. /∫/) or vowels (features [+front] vs. [+back] of /i/ vs. /u/). Crucially, in the undeprived language learning individual, (a) phoneme articulation yields immediate perception, so that articulatory motor activity is immediately followed by auditory feedback activity in auditory cortex, and (b) the relevant motor and auditory areas are strongly connected by way of adjacent inferior frontal and superior temporal areas, so that (c) well-established Hebbian learning implies that auditory-motor neurons activated together during phoneme production will be bound together into one distributed neuronal ensemble (Pulvermüller and Fadiga, 2010).
In this action-perception integration perspective, speech sounds with different places of articulation have their cortical correlates in different activation topographies across superior-temporal and fronto-parietal areas, including the articulatory sensorimotor cortex. If this statement is correct, it should be possible (i) to see motor activity during speech perception, phoneme recognition and language understanding3, and (ii) phonemes with different places of articulation and articulator involvement should differentially activate subsections of the articulatory motor system. Furthermore, distributed sensorimotor cortical circuits for phonemes imply (iii) that causal effects on speech perception and understanding can originate not only in auditory cortex and adjacent secondary and “higher” multimodal areas, but also in frontoparietal areas in and close to sensorimotor ones. As the motor and the somatosensory cortex have parallel somatotopies and with every articulator movement (performed under undeprived conditions) there is specific stimulation of the corresponding somatosensory cortex as well, this position predicts not only specific motor cortex activation in speech perception, but, in addition, somatosensory cortex activation. Indeed, there is evidence for a role of somatosensory systems both in speech production (Tremblay et al., 2003; Bouchard et al., ) and perception (Möttönen et al., ; Skipper et al., 2007; Ito et al., ; Nasir and Ostry, ; Correia et al., ; Bartoli et al., 2016). The motor and somatosensory system may already be important for speech perception early in life, since pacifiers blocking specific articulator movements were shown to affect the discrimination of speech sounds even in the first year (Yeung and Werker, 2013; for review see Guellaï et al., ).
To sum up, a major controversy between the competing models (Figure 1) surrounds the involvement of the sensorimotor cortex and adjacent areas in the fronto-parietal cortex (or “dorsal stream”) in speech perception and understanding. While both agree on a role of temporal areas in speech recognition, the “fractionated” model states independence of speech perception from fronto-parietal circuits, whereas the integrative action-perception perspective predicts interaction, and hence, additional involvement of fronto-parietal including sensorimotor cortices in speech perception and understanding. In this review article, we will evaluate the empirical results that speak to this controversy in an attempt to settle the debate.
Auditory/Temporal and Sensorimotor/Fronto-Parietal Activation in Speech Perception
When speech sounds embedded in meaningless syllables are presented to the ears, functional magnetic resonance imaging (fMRI) reveals widespread activation in both temporal and frontal areas (for a meta-analysis, see Vigneau et al., 2006). Activation in the auditory cortex and surrounding areas of superior and middle temporal cortex is not surprising because most of the afferent ‘cables’ of the auditory pathway conveying sound information, from the ears terminate in superior temporal primary auditory cortex (Brodmann Area (BA) 41), from where activation spreads to adjacent and connected areas. Some of this activity, especially in the left language-dominant hemisphere, but also to a degree in the other one, is specific to speech, as is evident from comparisons of speech-sound elicited activity with that to noise patterns matched to speech (Scott et al., 2000; Uppenkamp et al., 2006). Some discrepancy still exists between data showing that speech specific activity is primarily present in anterior superior temporal cortex (Scott and Johnsrude, 2003; Rauschecker and Scott, 2009) or, alternatively, in posterior superior and middle temporal cortex (Shtyrov et al., 2000, 2005; Uppenkamp et al., 2006). Therefore, a role of both anterior and posterior temporal areas in processing speech sounds needs to be acknowledged (DeWitt and Rauschecker, ).
However, in addition to temporal areas, the frontal and sensorimotor cortex seems to equally be activated in speech processing. Early fMRI studies could already demonstrate general activation in the left inferior frontal cortex during passive speech perception (Poldrack et al., ; Benson et al., ). In a seminal study, Fadiga et al. () applied magnetic stimulation to the articulatory motor cortex and showed that motor-evoked potentials (MEPs) in the tongue muscle are specifically enhanced when subjects listen to speech containing phonemes that strongly involve the tongue—in particular the rolling /r/ of Italian—and are enhanced even more speech sounds embedded into meaningful words (but see Roy et al., 2008). As this evoked-potential enhancement is likely due to increased activity in tongue-related motor and premotor cortex, it has been interpreted as a confirmation for motor system activation in speech perception. Further converging evidence came from studies using a range of methods, including fMRI and MEG/electroencephalography (EEG) with source localization (e.g., Watkins et al., 2003; Watkins and Paus, 2004; Wilson et al., 2004), and it could be demonstrated that activation spreads rapidly from the superior temporal to inferior frontal areas (Pulvermüller et al., 2003, 2005; see Tomasello et al., 2016, for converging evidence from computational modeling). Sound-evoked activity in the motor or sensorimotor system is not specific to speech sounds as compared with other acoustic stimuli, because similar patterns of motor activation have also been seen for nonlinguistic sounds, in particular for the sounds of mouth-produced or manual actions (Hauk et al., ; Scott et al., 2006; Etzel et al., ). However, apart from showing motor involvement in speech perception, Fadiga et al.’s () work and related studies suggested specificity of activation at a more fine-grained level. In particular, the tongue-related articulatory-phonological nature of the /r/ sound may have contributed to localization specificity4. As we discuss below, this was investigated in detail in further studies.
Does Sensorimotor Cortex Contain Phonological Information Relevant for Speech Perception?
Some fMRI studies investigated whether, during speech perception, activity in frontoparietal and articulatory motor areas reflects phonological information, in particular about the phonemic features “place of articulation” (Pulvermüller et al., 2006; Raizada and Poldrack, 2007) and “voicing” (Myers et al., ). Pulvermüller et al. (2006) had subjects attentively listen to syllables starting with a lip-related bilabial /p/ or a tongue-related alveolar phoneme /t/. In the absence of any overt motor task, stimuli were passively presented during silent breaks where the MRI scanner was switched off, using a technique known as “sparse imaging” (Hall et al., ; Peelle et al., ), so as to allow speech perception without scanner noise overlay. After the linguistic perception part of the experiment, participants produced non-linguistic minimal lip and tongue movements and these movement localizer tasks were used to define lip and tongue regions of interest (ROIs), in sensorimotor cortex. When using these ROIs, and also when examining a range of subsections of the precentral cortex, the authors found that during perception of syllables starting with lip-related and tongue-related sounds, the corresponding relatively more dorsal vs. ventral sectors of sensorimotor cortex controlling those articulators were differentially activated. In other words, the motor cortex activation as a whole contained information about the place of articulation of the perceived phonemes (see Figure 2 top).
Figure 2
In recent years, the univariate fMRI studies of the brain correlates of speech perception were complemented by experiments using the novel analysis method of multivariate pattern analysis, or MVPA (Haxby et al., 2001; Norman et al., 2006; Haynes, 2015). This method offers a way of testing whether fine-grained voxel-by-voxel activation patterns within specific brain areas contain information about stimulus types, for example about phonetic and phonemic features of speech. Initially, the application of MVPA to fMRI activity in studies on phonological processing focused on temporal cortex, where successful decoding of vowel identity could be demonstrated (Formisano et al.,
An innovative study by Evans and Davis (
Some Discrepancies Between Recent Findings
In a recent study, Arsenault and Buchsbaum (
Apart from their purported replication attempt using univariate methods, Arsenault and Buchsbaum (
The Role of (Scanner) Noise and Overt Motor Tasks
In order to explain the discrepancies in results about the motor system’s role as an indicator of phoneme processing, it is necessary to pay special attention to subtle but possibly crucial differences between studies. In Table 1, we compiled a list of fMRI studies that found phonology-related information in specific cortical areas during (mostly passive) speech perception. The table lists studies that investigated the cortical loci of general phoneme-related activity during speech perception (studies 1–5) as well as activity carrying specific phonological information (studies 6–15), for example, activation differences between phonemes, phonological features and/or feature values (such as [+bilabial] or [+front]). Comparing studies against each other shows that the crucial methodological factors which predict acoustically induced phonological activation of, and information in, fronto-parietal areas are: (i) the use of “silent gap”, or “sparse” imaging (Hall et al.,
Table 1
| No. | Study | Stimuli features investigated | Phonetic | Task | Button presses | Sparse imaging | Analyses | Baseline | Activation/Decoding found in … | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Prefrontal areas | Motor areas | Somatosensory and inferior parietal areas | |||||||||
| 1 | Benson et al. ( | 15 C/VC/CVC syllables | n/a | none | never | yes | univariate | non-speech tones | left BA 9, 10 | left BA 6 | left SMG (BA 40) |
| 2 | Wilson et al. (2004) | /pa/, /gi/ | n/a | none | never | no | univariate | rest/silence | not reported | ventral (v) BA 4, 6 | right SMG (BA 40) |
| 3 | Wilson and Iacoboni (2006) | 50 consonants embedded between two /α/ vowels | n/a | none | never | no | univariate | rest/silence | not reported | v BA 4, 6 | not reported |
| 4 | Szenkovits et al. (2012) | monosyllabic pseudowords | n/a | one-back repetition detection task | 10% of trials | no | univariate | non-speech buzzes | not reported | not reportedd | not reported |
| 5 | Grabski et al. ( | 9 vowels | n/a | none | never | yes | univariate | rest/silence | BA 44, left BA 45 | right BA 6 | not reported |
| 6 | Pulvermüller et al. (2006) | /pæ/, /tæ/, /pI/, /tI/ | Place | none | never | yes | univariate, ROI-baseda | matched noise stimuli | not reported | left v BA 4, 6 (differential activation of lip vs. tongue regions) | not reported |
| 7 | Raizada and Poldrack (2007) | /ba/, /da/ | Place | detect occasional quieter stimulus | 6% of trials | yes | repetition adaptation | n/a | left middle frontal cortex (amplification of response to stimulus pairs differing in place) | not reported | left SMG (amplification of response to stimulus pairs differing in place) |
| 8 | Myers et al. ( | /da/, /ta/ | Voicing | detect occasional high-pitched stimulus | 37.5% of trials | yes | repetition adaptation | n/a | left inferior frontal sulcus (release from adaptation only for stimuli differing in voicing) | not reported | not reported |
| 9 | Lee et al. ( | 10 CV syllables on /ba/-/da/ continuum | Place | detect occasional quieter stimulus | 11% of trials | yes | MVPA (searchlight) | n/a | left BA 44 (decoding of place) | left pre-SMA (decoding of place) | not reported |
| 10 | Chevillet et al. ( | /da/–/ga/ continuum | Place | dichotic listening (detect in which ear the sound persisted longer) | always | yes | repetition adaptation | n/a | not reported | left BA 6 (release from adaptation for stimulus pairs differing in place of articulation) | not reported |
| 11 | Du et al. ( | /ba/, /ma/, /da/, /ta/ | Place | active syllable identification (4-AFC) | always | no (but scanner noise attenuation by 25 dB) | MVPA (searchlight) | n/a | Insula/Broca’s area (decoding of place)—at low/moderate noise levels onlye | left v BA 6 (decoding of place)—at low noise levels onlyf | left inferior parietal lobule (decoding of place)—at low noise levels only |
| 12 | Arsenault and Buchsbaum ( | 16 CV syllables | Place, manner, voicing | gender identification task | always | no | MVPA (ROI-based) | n/a | not reported | not reported | left subcentral gyrus (decoding of place) |
| 13 | Evans and Davis ( | /ba/, /da/, /ma/, /na/, /ab/, /ad/ | Place, manner, phoneme identity, CV structure (CV vs. VC) | one-back repetition detection task | 8% of trials | yes | MVPA-based RSA (searchlight)c | rest/silence | not reported | left precentral gyrus (decoding of syllable and phoneme identity and CV structure) | left postcentral gyrus (decoding of syllable identity) |
| 14 | Correia et al. ( | 24 CV syllables | Place, manner, voicing | none | never | yes | MVPA (searchlight) | n/a | IFG (decoding of place/manner) | right inferior precentral gyrus (decoding of place) | postcentral gyrus, SMG (decoding of place/manner) |
| 15 | Arsenault and Buchsbaum ( | 8 CV syllables: /ba/, /pa/, /va/, /fa/, /da/, /ta/, /za/, /sa/ | Place (manner/voicing not analyzed) | detect occasional blank trials | 11% of trials | no | univariate and MVPA (both ROI-based) | n/a | not reported | not reported | left postcentral gyrus (decoding of place) |
Overview of functional magnetic resonance imaging (fMRI) studies investigating involvement of inferior frontal, sensorimotor and inferior parietal systems in syllable perception.
aDifferential activation of subregions (lip vs. tongue) in left BA 4, 6 depending on place of articulation (lip vs. tongue; see Figure 2 Top). bSee also Alho et al. (
The Role of Scanner Noise
Why would avoiding scanner noise be so important for finding brain activation related to speech perception in frontal areas? Arsenault and Buchsbaum (
Figure 3

Multivariate pattern analysis (MVPA) phoneme-specificity maps as a function of signal-to-noise ratio (SNR; in dB). A more negative SNR indicates more additional noise on top of scanner noise attenuated by 25 dB (which was always present, even in the “no noise” condition). Successful MVPA decoding of phoneme identity in ventral premotor cortex (PMC) can only be seen in the “no noise” condition (D), whereas with increasing noise (A–C), decoding is unsuccessful in ventral PMC, but still successful in dorsal PMC and inferior frontal regions (see main text for detailed discussion). Adapted from Du et
Therefore, taking into consideration the caveats about Du et al.’s (
Still, some studies reported that a contribution of frontal or motor systems further increases when stimuli become moderately more difficult to understand, for example, because of noise overlay (Murakami et al.,
In summary, motor systems’ contributions to speech processing tend to show up already with no noise and might further increase with moderate noise overlay. However, with too strong noise overlay (which non-attenuated scanner noise might constitute), this contribution disappears again. This observation is problematic for models viewing perceptually-induced motor system activation as correlate of a prediction process only effective under noisy or otherwise challenging perceptual conditions (Hickok,
The Role of Overt Motor Tasks
We now turn to the second important methodological point, the role of overt motor responses (e.g., occasional or constant button presses). Arsenault and Buchsbaum’s (
In sum, a review of a range of neuroimaging experiments on speech processing shows that the factors noise overlay and overt motor tasks explain why some previous univariate and multivariate fMRI studies found evidence for phoneme-specific activation in frontal cortex, including Broca’s and precentral areas, and why others did not7. The mechanisms underlying these effects need further clarification, but a tentative mechanistic explanation can be offered in terms of acoustic phonemic signal-to-noise ratios reflected in the fronto-central cortex, which must decrease both with overlay of acoustic noise and ‘motor noise’ which may result from preparatory motor movements. These two factors, especially in combination (see studies 4, 11, 12, 15 in Table 1), seem to cause a loss of phoneme-related activation in frontal areas, which also explains the unsuccessful replication attempt of Arsenault and Buchsbaum (
Excursus: Cross-Decoding from Miming to Perception as the Critical Test?
A methodologically innovative aspect of Arsenault and Buchsbaum’s (
This latter statement is problematic, however; no explanation is given as to why this cross-decoding should constitute “the critical test”. This view seems to imply that substantial similarities should exist between the cortical activity patterns seen during speech production and perception. In contrast, the crucial prediction of action-perception integration models of speech which was vindicated by Pulvermüller et al. (2006), was that phoneme perception involves access to multimodal phoneme representations which, due to their multimodal character, include neurons with articulatory function in the speech motor system (cf. Galantucci et al.,
In summary, it appears unreasonable to expect identical neural activation for motor action and concordant perception (in this case silent articulation or “miming” of speech sounds and their perception). Rather, the aspects of neural activity shared between perception and production can only be a subset of the total activity patterns present during both. Hence, when testing a classifier in a condition which shares only some of the relevant processes with the condition it was trained on, it is no surprise that cross-decoding is difficult. Such a result fits well with general observations from other MVPA studies, which found, firstly, that in general cross-decoding performance is reduced when performed across different modalities (auditory vs. written word presentation; Akama et al.,
The Functional Relevance of (Phonological Information In) Sensorimotor Cortex for Speech Perception and Understanding
The neurophysiological experiments reviewed above show that phonological information about perceived speech, including abstract phonemic distinctive features such as place of articulation, is reflected in differential patterns of activation in motor cortex. These results are of great theoretical interest, as they help to decide between competing theories that view speech perception either as a fractionated sensory process or as an interactive mechanism involving both action and perception information and mechanisms.
However, the mere activation of sensorimotor cortex in perception could be due to intentional articulatory activity, which adds to the perception mechanism from which it is otherwise functionally divorced. Such motor activity may be sub-threshold and may thus appear while no corresponding movement or muscle activity occurs. Motor activity during, but entirely independent of perception, may be linked to motor preparation or to predicting future perceptual input. To judge this possibility, it is critical to find out whether perceptually-induced motor activation indeed carries a more general function in speech processing. Already some brain activation studies suggest a functional role of motor cortex activation in speech processing. One study found that the magnitude of speech-evoked motor activity reflects working memory capacities of experiment participants (Szenkovits et al., 2012). Other work showed that perceptually-induced motor activation reflected the type of language learning by which novel “pseudo-words” had been acquired. Fronto-central cortical responses to novel sequences of spoken syllables increased when subjects familiarized themselves with these items by repeated articulation, whereas the passive perceptual learning of the same speech items did not lead to comparable sensorimotor activation (Pulvermüller et al., 2012; Adank et al.,
The strongest statement of an integrative active perception account, however, addresses a putative causal role of motor systems in the perceptual processing. Is the motor system causal for speech perception and understanding? To decide this crucial issue, a neuropsychological research strategy is required, which investigates whether functional changes in the sensorimotor cortex impact on speech perception. Indeed, TMS studies have demonstrated that the motor system has a causal influence on the discrimination and classification of speech sounds (Meister et al.,
As mentioned before, research addressing the causality question requires a neuropsychological research strategy whereby the manipulated independent variable is the change of brain states (e.g., by TMS) and the measured dependent variable is a behavioral response, for example the accuracy and/or latency of a button press. Therefore, all neuropsychological studies require an overt motor task and any task administered in an experimental laboratory is to a degree “unnatural”, such studies are open to criticisms. Researchers holding a critical attitude towards action-perception theory, for example Hickok (
One may still ask, however, how this TMS functional change relates to language comprehension under normal conditions, as speech sound discrimination tasks do not provide conclusive evidence about any causal role in language comprehension. The standard task with which psycholinguists investigate single word comprehension uses pictures and has subjects, select a picture related to a spoken word. This word-to-picture-matching task (WPMT) was applied recently in two TMS experiments. In one experiment (Schomers et al., 2015), pictures were shown whose typical verbal labels were phonological “minimal pairs” only differing in their word-initial phoneme, which was either a [+bilabial] lip-related or [+alveolar] tongue-related speech sound (for example, pictures of a deer and a beer were shown while the spoken word “deer” was presented). TMS to lip- and tongue-controlling precentral sulcus differentially influenced reaction times in the comprehension of spoken words starting with [+bilabial] and [+alveolar] phonemes, respectively (see Figure 4 top), thus demonstrating a causal role of sensorimotor cortex on speech comprehension. As in previous studies using sub-threshold single or double TMS, a relative facilitation effect was revealed by response times. In another recent experiment, Murakami et al. (
Figure 4

Transcranial magnetic stimulation (TMS) studies showing causal effects of frontal cortex stimulation on speech comprehension (word-to-picture matching). (Top) Double TMS pulses to different articulator representations in motor cortex (lip vs. tongue) led to relative facilitation in word comprehension responses for words starting with a phoneme related to the congruent articulator, as revealed by a significant interaction of stimulation locus and word type (“lip words” vs. “tongue words”). *p < 0.05. Adapted from Schomers et al. (2015; Figure 1) by permission of Oxford Univ. Press, material published under a CC-BY-NC license. (Bottom) A simultaneous virtual lesion in both dPMC and pIFG (using “double-knockout” thetaburst TMS) led to significantly increased semantic and phonological errors in word recognition (word-to-picture matching). *p < 0.05, **p < 0.01, ***p < 0.001. Adapted from Murakami et
In conclusion, sensorimotor articulatory cortex does not only reveal phoneme-specific activation signatures during speech perception, it also takes a differential phoneme-specific causal role in speech perception and word comprehension. Importantly, as both facilitation and error-induction could be observed in speech comprehension tasks, the causal role of sensorimotor cortex in perceptual tasks receives strong support.
Conclusion
So, is the sensorimotor system relevant for speech perception and comprehension? Considering the evidence available across methods, studies and laboratories, this question receives a clear “Yes”. Still, noise overlay and motor tasks during speech perception may cancel any measurable phonologically related activation in the motor system, including multivoxel pattern information reflecting phonological specificity.
Evidence from univariate analyses of fMRI data has long shown that various parts of the speech motor system are activated during passive speech perception. Some of these studies even found specific phonological information, e.g., about place of articulation or voicing, present in these areas. Recently, several fMRI studies using MVPA replicated and extended the earlier findings. An open question that remains is what the precise role of the different regions in the sensorimotor system is, in particular the IFG, the premotor, primary motor and somatosensory cortices (see Hertrich et al., 2016, for a recent review on the role of the supplementary motor area). Mechanistic neurobiological models suggest that the roles of neurons in primary, secondary and higher multimodal areas in both frontal and temporal lobes can be understood in terms of distributed functional circuits within which distributional different patterns of activation are the basis of the perception, recognition and working-memory storage of phonemes and meaningful units (Pulvermüller and Garagnani, 2014; Grisoni et al.,
Still, there is substantial divergence between some of the reported findings regarding the precise locations where phonological information can be detected in the neurometabolic response (see Table 1). We argue here that at least a significant portion of this variance can be explained by differences in methods, in particular by the features of scanner noise and preparatory motor activity. Activity in motor cortex, especially precentral gyrus, seems to be vulnerable to both (whereas activity close to auditory areas and in somatosensory cortex is not as much influenced by preparatory motor activity). Hence, in order to observe motor system activity in perception experiments, it is of the essence to reduce acoustic noise and ‘motor noise’ as much as possible, i.e., to use sparse imaging and avoid having subjects engage in (even only occasional) button presses throughout the experiment. Finally and most importantly, any discrepancies in fMRI results are secondary in light of clear evidence from TMS that modulation of sensorimotor and frontoparietal areas causes functional changes in speech perception and comprehension, both measured neurophysiologically (Möttönen et al.,
Funding
Funding was provided by the Deutsche Forschungsgemeinschaft (DFG, Pu 97/16-1), the Berlin School of Mind and Brain, and the Freie Universität Berlin.
Statements
Author contributions
MRS and FP analyzed and reviewed the relevant literature and wrote the article.
Acknowledgments
We would like to thank Dr. Radoslaw Cichy and our referees for helpful discussion.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Abbreviations
ECoG, electrocorticography; EEG, electroencephalography; MEG, magnetoencephalography; MEP, motor-evoked potential; MMN, mismatch negativity; fMRI, functional magnetic resonance imaging; MVPA, multivariate pattern analysis; ROI, region of interest; RSA, representational similarity analysis; TMS, rTMS, (repetitive) transcranial magnetic stimulation; (d/v)PMC, (dorsal/ventral) premotor cortex; (p)IFG, (posterior) inferior frontal gyrus; STG/S, superior temporal gyrus/sulcus; SMG, supramarginal gyrus; SMA, supplementary motor area; PoA, place of articulation.
- ECoG
electrocorticography
- EEG
electroencephalography
- MEG
magnetoencephalography
- MEP
motor-evoked potential
- MMN
mismatch negativity
- fMRI
functional magnetic resonance imaging
- MVPA
multivariate pattern analysis
- ROI
region of interest
- RSA
representational similarity analysis
- TMS, rTMS
(repetitive) transcranial magnetic stimulation
- (d/v)PMC
(dorsal/ventral) premotor cortex
- (p)IFG
(posterior) inferior frontal gyrus
- STG/S
superior temporal gyrus/sulcus
- SMG
supramarginal gyrus
- SMA
supplementary motor area
- PoA
place of articulation.
Abbreviations
Footnotes
1.^But note that some other publications of the same author (Hickok et al.,
2.^Such an action-perception integration perspective is not restricted to the speech domain, but equally applies to written word processing, where it has been demonstrated that reading letters activates the hand motor areas involved in writing (Longcamp et al.,
3.^Note that obviously some suppression mechanisms are necessary to prevent overt motor movements/articulation during perception. In concrete implementations of action-perception integration models of language, the obvious differences between speech production and recognition (overt motor movements vs. open auditory ‘gates’) are implemented in terms of area-specific cortical regulation processes (Garagnani et al.,
4.^Apart from phonological features, the high arousal and general motor activity associated with the rolling /r/ of Italian may be relevant for the observed specificity.
5.^Furthermore, it is well-known that completely noise-free and ‘perfect’ listening conditions rarely occur outside the context of laboratory experiments (D’Ausilio et al.,
6.^Note that there are also similar proposals for motor-induced forward predictions in speech perception without constraints (Skipper et al., 2005, 2007), which sit well with the available data.
7.^A recent ECoG study (Cheung et al.,
8.^Our literature review does not rule out other factors as additional explanatory variables, such as ROI-based vs. searchlight analyses, or searchlight size; for example, Correia et al. (
9.^Park et al. (
References
1
AdankP.DavisM. H.HagoortP. (2012). Neural dissociation in processing noise and accent in spoken language comprehension. Neuropsychologia50, 77–84. 10.1016/j.neuropsychologia.2011.10.024
2
AdankP.HagoortP.BekkeringH. (2010). Imitation improves language comprehension. Psychol. Sci.21, 1903–1909. 10.1177/0956797610389192
3
AdankP. M.RueschemeyerS.-A.BekkeringH. (2013). The role of accent imitation in sensorimotor integration during processing of intelligible speech. Front. Hum. Neurosci.7:634. 10.3389/fnhum.2013.00634
4
AkamaH.MurphyB.NaL.ShimizuY.PoesioM. (2012). Decoding semantics across fMRI sessions with different stimulus modalities: a practical MVPA study. Front. Neuroinform.6:24. 10.3389/fninf.2012.00024
5
AlhoJ.GreenB. M.MayP. J.SamsM.TiitinenH.RauscheckerJ. P.et al. (2016). Early-latency categorical speech sound representations in the left inferior frontal gyrus. Neuroimage129, 214–223. 10.1016/j.neuroimage.2016.01.016
6
ArsenaultJ. S.BuchsbaumB. R. (2015). Distributed neural representations of phonological features during speech perception. J. Neurosci.35, 634–642. 10.1523/JNEUROSCI.2454-14.2015
7
ArsenaultJ. S.BuchsbaumB. R. (2016). No evidence of somatotopic place of articulation feature mapping in motor cortex during passive speech perception. Psychon. Bull. Rev.23, 1231–1240. 10.3758/s13423-015-0988-z
8
BabiloniF.CarducciF.CincottiF.Del GrattaC.PizzellaV.RomaniG. L.et al. (2001). Linear inverse source estimate of combined EEG and MEG data related to voluntary movements. Hum. Brain Mapp.14, 197–209. 10.1002/hbm.1052
9
BartoliE.D’AusilioA.BerryJ.BadinoL.BeverT.FadigaL. (2015). Listener-speaker perceived distance predicts the degree of motor contribution to speech perception. Cereb. Cortex25, 281–288. 10.1093/cercor/bht257
10
BartoliE.MaffongelliL.CampusC.D’AusilioA. (2016). Beta rhythm modulation by speech sounds: somatotopic mapping in somatosensory cortex. Sci. Rep.6:31182. 10.1038/srep31182
11
BensonR. R.WhalenD. H.RichardsonM.SwainsonB.ClarkV. P.LaiS.et al. (2001). Parametrically dissociating speech and nonspeech perception in the brain using fMRI. Brain Lang.78, 364–396. 10.1006/brln.2001.2484
12
BinderJ. R.LiebenthalE.PossingE. T.MedlerD. A.WardB. D. (2004). Neural correlates of sensory and decision processes in auditory object identificationNat. Neurosci.7, 295–301. 10.1038/nn1198
13
BonteM.HausfeldL.ScharkeW.ValenteG.FormisanoE. (2014). Task-dependent decoding of speaker and vowel identity from auditory cortical response patterns. J. Neurosci.34, 4548–4557. 10.1523/JNEUROSCI.4339-13.2014
14
BouchardK. E.ChangE. F. (2014). Control of spoken vowel acoustics and the influence of phonetic context in human speech sensorimotor cortex. J. Neurosci.34, 12662–12677. 10.1523/JNEUROSCI.1219-14.2014
15
BouchardK. E.MesgaraniN.JohnsonK.ChangE. F. (2013). Functional organization of human sensorimotor cortex for speech articulation. Nature495, 327–332. 10.1038/nature11911
16
CarotaF.MoseleyR.PulvermüllerF. (2012). Body-part-specific representations of semantic noun categories. J. Cogn. Neurosci.24, 1492–1509. 10.1162/jocn_a_00219
17
CatfordA. P.PisoniD. B. (1970). Auditory vs. articulatory training in exotic sounds. Mod. Lang. J.54, 477–481. 10.1111/j.1540-4781.1970.tb03581.x
18
CheungC.HamiltonL. S.JohnsonK.ChangE. F. (2016). The auditory representation of speech sounds in human motor cortex. eLife5:e12577. 10.7554/eLife.12577
19
ChevilletM. A.JiangX.RauscheckerJ. P.RiesenhuberM. (2013). Automatic phoneme category selectivity in the dorsal auditory stream. J. Neurosci.33, 5208–5215. 10.1523/JNEUROSCI.1870-12.2013
20
CichyR. M.HeinzleJ.HaynesJ.-D. (2012). Imagery and perception share cortical representations of content and location. Cereb. Cortex22, 372–380. 10.1093/cercor/bhr106
21
CorreiaJ. M.JansmaB. M.BonteM. (2015). Decoding articulatory features from fMRI responses in dorsal speech regions. J. Neurosci.35, 15015–15025. 10.1523/JNEUROSCI.0977-15.2015
22
D’AusilioA.BufalariI.SalmasP.FadigaL. (2012). The role of the motor system in discriminating normal and degraded speech sounds. Cortex48, 882–887. 10.1016/j.cortex.2011.05.017
23
D’AusilioA.PulvermüllerF.SalmasP.BufalariI.BegliominiC.FadigaL. (2009). The motor somatotopy of speech perception. Curr. Biol.19, 381–385. 10.1016/j.cub.2009.01.017
24
de BorstA. W.de GelderB. (2016). fMRI-based multivariate pattern analyses reveal imagery modality and imagery content specific representations in primary somatosensory, motor and auditory cortices. Cereb. Cortex10.1093/cercor/bhw211 [Epub ahead of print].
25
DeWittI.RauscheckerJ. P. (2012). Phoneme and word recognition in the auditory ventral stream. Proc. Natl. Acad. Sci. U S A109, E505–E514. 10.1073/pnas.1113427109
26
DieschE.EulitzC.HampsonS.RossB. (1996). The neurotopography of vowels as mirrored by evoked magnetic field measurements. Brain Lang.53, 143–168. 10.1006/brln.1996.0042
27
DuY.BuchsbaumB. R.GradyC. L.AlainC. (2014). Noise differentially impacts phoneme representations in the auditory and speech motor systems. Proc. Natl. Acad. Sci. U S A111, 7126–7131. 10.1073/pnas.1318738111
28
DuY.BuchsbaumB. R.GradyC. L.AlainC. (2016). Increased activity in frontal motor cortex compensates impaired speech perception in older adults. Nat. Commun.7:12241. 10.1038/ncomms12241
29
EtzelJ. A.GazzolaV.KeysersC. (2008). Testing simulation theory with cross-modal multivariate classification of fMRI data. PLoS One3:e3690. 10.1371/journal.pone.0003690
30
EvansS.DavisM. H. (2015). Hierarchical organization of auditory and motor representations in speech perception: evidence from searchlight similarity analysis. Cereb. Cortex25, 4772–4788. 10.1093/cercor/bhv136
31
FadigaL.CraigheroL.BuccinoG.RizzolattiG. (2002). Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur. J. Neurosci.15, 399–402. 10.1046/j.0953-816x.2001.01874.x
32
FormisanoE.De MartinoF.BonteM.GoebelR. (2008). “Who” is saying “What”? Brain-based decoding of human voice and speech. Science322, 970–973. 10.1126/science.1164318
33
FryD. B. (1966). “The development of the phonological system in the normal and deaf child,” in The Genesis of Language: A Psycholinguistic Approach, eds SmithF.MillerG. A. (Cambridge, MA: MIT Press), 187–206.
34
GalantucciB.FowlerC. A.TurveyM. T. (2006). The motor theory of speech perception reviewed. Psychon. Bull. Rev.13, 361–377. 10.3758/bf03193857
35
GaragnaniM.WennekersT.PulvermüllerF. (2008). A neuroanatomically grounded Hebbian-learning model of attention-language interactions in the human brain. Eur. J. Neurosci.27, 492–513. 10.1111/j.1460-9568.2008.06015.x
36
GrabskiK.SchwartzJ.-L.LamalleL.VilainC.ValléeN.BaciuM.et al. (2013). Shared and distinct neural correlates of vowel perception and production. J. Neurolinguistics26, 384–408. 10.1016/j.jneuroling.2012.11.003
37
GrazianoM. S. (2016). Ethological action maps: a paradigm shift for the motor cortex. Trends Cogn. Sci.20, 121–132. 10.1016/j.tics.2015.10.008
38
GrazianoM. S.TaylorC. S.MooreT. (2002). Complex movements evoked by microstimulation of precentral cortex. Neuron34, 841–851. 10.1016/s0896-6273(02)00698-0
39
GrisoniL.DreyerF. R.PulvermüllerF. (2016). Somatotopic semantic priming and prediction in the motor system. Cereb. Cortex26, 2353–2366. 10.1093/cercor/bhw026
40
GuellaïB.StreriA.YeungH. H. (2014). The development of sensorimotor influences in the audiovisual speech domain: some critical questions. Front. Psychol.5:812. 10.3389/fpsyg.2014.00812
41
HallD. A.HaggardM. P.AkeroydM. A.PalmerA. R.SummerfieldA. Q.ElliottM. R.et al. (1999). Sparse temporal sampling in auditory fMRI. Hum. Brain Mapp.7, 213–223. 10.1002/(SICI)1097-0193(1999)7:3<213::AID-HBM5>3.0.CO;2-N
42
HartwigsenG.BaumgaertnerA.PriceC. J.KoehnkeM.UlmerS.SiebnerH. R. (2010a). Phonological decisions require both the left and right supramarginal gyri. Proc. Natl. Acad. Sci. U S A107, 16494–16499. 10.1073/pnas.1008121107
43
HartwigsenG.PriceC. J.BaumgaertnerA.GeissG.KoehnkeM.UlmerS.et al. (2010b). The right posterior inferior frontal gyrus contributes to phonological word decisions in the healthy brain: evidence from dual-site TMS. Neuropsychologia48, 3155–3163. 10.1016/j.neuropsychologia.2010.06.032
44
HartwigsenG.WeigelA.SchuschanP.SiebnerH. R.WeiseD.ClassenJ.et al. (2016). Dissociating parieto-frontal networks for phonological and semantic word decisions: a condition-and-perturb TMS study. Cereb. Cortex26, 2590–2601. 10.1093/cercor/bhv092
45
HaukO.ShtyrovY.PulvermüllerF. (2006). The sound of actions as reflected by mismatch negativity: rapid activation of cortical sensory-motor networks by sounds associated with finger and tongue movements. Eur. J. Neurosci.23, 811–821. 10.1111/j.1460-9568.2006.04586.x
46
HaxbyJ. V.GobbiniM. I.FureyM. L.IshaiA.SchoutenJ. L.PietriniP. (2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science293, 2425–2430. 10.1126/science.1063736
47
HaynesJ. D. (2015). A primer on pattern-based approaches to fMRI: principles, pitfalls, and perspectives. Neuron87, 257–270. 10.1016/j.neuron.2015.05.025
48
HertrichI.DietrichS.AckermannH. (2016). The role of the supplementary motor area for speech and language processing. Neurosci. Biobehav. Rev. 68, 602–610. 10.1016/j.neubiorev.2016.06.030
49
Hervais-AdelmanA. G.CarlyonR. P.JohnsrudeI. S.DavisM. H. (2012). Brain regions recruited for the effortful comprehension of noise-vocoded words. Lang. Cogn. Process.27, 1145–1166. 10.1080/01690965.2012.662280
50
HickokG. (2014). The Myth of Mirror Neurons: The Real Neuroscience of Communication and Cognition.New York, NY: WW Norton and Company.
51
HickokG. (2015). The motor system’s contribution to perception and understanding actions: clarifying mirror neuron myths and misunderstandings. Lang. Cogn.7, 476–484. 10.1017/langcog.2015.2
52
HickokG.HoudeJ.RongF. (2011). Sensorimotor integration in speech processing: computational basis and neural organization. Neuron69, 407–422. 10.1016/j.neuron.2011.01.019
53
HuangJ.CarrT. H.CaoY. (2002). Comparing cortical activations for silent and overt speech using event-related fMRI. Hum. Brain Mapp.15, 39–53. 10.1002/hbm.1060
54
HuangY.-Z.EdwardsM. J.RounisE.BhatiaK. P.RothwellJ. C. (2005). Theta burst stimulation of the human motor cortex. Neuron45, 201–206. 10.1016/j.neuron.2004.12.033
55
ItoT.TiedeM.OstryD. J. (2009). Somatosensory function in speech perception. Proc. Natl. Acad. Sci. U S A106, 1245–1248. 10.1073/pnas.0810063106
56
KakeiS.HoffmanD. S.StrickP. L. (1999). Muscle and movement representations in the primary motor cortex. Science285, 2136–2139. 10.1126/science.285.5436.2136
57
KaplanJ. T.ManK.GreeningS. G. (2015). Multivariate cross-classification: applying machine learning techniques to characterize abstraction in neural representations. Front. Hum. Neurosci.9:151. 10.3389/fnhum.2015.00151
58
KartushinaN.Hervais-AdelmanA.FrauenfelderU. H.GolestaniN. (2015). The effect of phonetic production training with visual feedback on the perception and production of foreign speech sounds. J. Acoust. Soc. Am.138, 817–832. 10.1121/1.4926561
59
KemmererD. (2015). Are the motor features of verb meanings represented in the precentral motor cortices? Yes, but within the context of a flexible, multilevel architecture for conceptual knowledge. Psychon. Bull. Rev.22, 1068–1075. 10.3758/s13423-014-0784-1
60
KornhuberH. H.DeeckeL. (1965). Hirnpotentialänderungen bei Willkürbewegungen und passiven Bewegungen des Menschen: Bereitschaftspotential und reafferente Potentiale. Pflüg. Arch. Für Gesamte Physiol. Menschen Tiere284, 1–17. 10.1007/bf00412364
61
Krieger-RedwoodK.GaskellM. G.LindsayS.JefferiesB. (2013). The selective role of premotor cortex in speech perception: a contribution to phoneme judgements but not speech comprehension. J. Cogn. Neurosci.25, 2179–2188. 10.1162/jocn_a_00463
62
KriegeskorteN.KievitR. A. (2013). Representational geometry: integrating cognition, computation, and the brain. Trends Cogn. Sci.17, 401–412. 10.1016/j.tics.2013.06.007
63
KriegeskorteN.MurM.BandettiniP. A. (2008). Representational similarity analysis-connecting the branches of systems neuroscience. Front. Syst. Neurosci.2, 4. 10.3389/neuro.06.004.2008
64
LamettiD. R.Rochet-CapellanA.NeufeldE.ShillerD. M.OstryD. J. (2014). Plasticity in the human speech motor system drives changes in speech perception. J. Neurosci.34, 10339–10346. 10.1523/JNEUROSCI.0108-14.2014
65
LeeY. S.TurkeltaubP.GrangerR.RaizadaR. D. S. (2012). Categorical speech processing in Broca’s area: an fMRI study using multivariate pattern-based analysis. J. Neurosci.32, 3942–3948. 10.1523/JNEUROSCI.3814-11.2012
66
LibermanA. M.CooperF. S.ShankweilerD. P.Studdert-KennedyM. (1967). Perception of the speech code. Psychol. Rev.74, 431–461. 10.1037/h0020279
67
LibermanA. M.WhalenD. H. (2000). On the relation of speech to language. Trends Cogn. Sci.4, 187–196. 10.1044/jshr.0402.194
68
LichtheimL. (1885). On aphasia. Brain7, 433–484. 10.1093/brain/7.4.433
69
LongcampM.AntonJ.-L.RothM.VelayJ.-L. (2003). Visual presentation of single letters activates a premotor area involved in writing. Neuroimage19, 1492–1500. 10.1016/s1053-8119(03)00088-0
70
MarkiewiczC. J.BohlandJ. W. (2016). Mapping the cortical representation of speech sounds in a syllable repetition task. Neuroimage141, 174–190. 10.1016/j.neuroimage.2016.07.023
71
McGurkH.MacDonaldJ. (1976). Hearing lips and seeing voices. Nature264, 746–748. 10.1038/264746a0
72
MeisterI. G.WilsonS. M.DeblieckC.WuA. D.IacoboniM. (2007). The essential role of premotor cortex in speech perception. Curr. Biol.17, 1692–1696. 10.1016/j.cub.2007.08.064
73
MöttönenR.DuttonR.WatkinsK. E. (2013). Auditory-motor processing of speech sounds. Cereb. Cortex23, 1190–1197. 10.1093/cercor/bhs110
74
MöttönenR.JärveläinenJ.SamsM.HariR. (2005). Viewing speech modulates activity in the left SI mouth cortex. Neuroimage24, 731–737. 10.1016/j.neuroimage.2004.10.011
75
MöttönenR.van de VenG. M.WatkinsK. E. (2014). Attention fine-tunes auditory-motor processing of speech sounds. J. Neurosci.34, 4064–4069. 10.1523/JNEUROSCI.2214-13.2014
76
MöttönenR.WatkinsK. E. (2009). Motor representations of articulators contribute to categorical perception of speech sounds. J. Neurosci.29, 9819–9825. 10.1523/JNEUROSCI.6018-08.2009
77
MurakamiT.KellC. A.RestleJ.UgawaY.ZiemannU. (2015). Left dorsal speech stream components and their contribution to phonological processing. J. Neurosci.35, 1411–1422. 10.1523/JNEUROSCI.0246-14.2015
78
MurakamiT.RestleJ.ZiemannU. (2011). Observation-execution matching and action inhibition in human primary motor cortex during viewing of speech-related lip movements or listening to speech. Neuropsychologia49, 2045–2054. 10.1016/j.neuropsychologia.2011.03.034
79
MyersE. B.BlumsteinS. E.WalshE.EliassenJ. (2009). Inferior frontal regions underlie the perception of phonetic category invariance. Psychol. Sci.20, 895–903. 10.1111/j.1467-9280.2009.02380.x
80
NäätänenR.LehtokoskiA.LennesM.CheourM.HuotilainenM.IivonenA.et al. (1997). Language-specific phoneme representations revealed by electric and magnetic brain responses. Nature385, 432–434. 10.1038/385432a0
81
NasirS. M.OstryD. J. (2009). Auditory plasticity and speech motor learning. Proc. Natl. Acad. Sci. U S A106, 20470–20475. 10.1073/pnas.0907032106
82
NuttallH. E.Kennedy-HigginsD.HoganJ.DevlinJ. T.AdankP. (2016). The effect of speech distortion on the excitability of articulatory motor cortex. Neuroimage128, 218–226. 10.1016/j.neuroimage.2015.12.038
83
NormanK. A.PolynS. M.DetreG. J.HaxbyJ. V. (2006). Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci.10, 424–430. 10.1016/j.tics.2006.07.005
84
ObleserJ.BoeckerH.DrzezgaA.HaslingerB.HennenlotterA.RoettingerM.et al. (2006). Vowel sound extraction in anterior superior temporal cortex. Hum. Brain Mapp.27, 562–571. 10.1002/hbm.20201
85
ObleserJ.EisnerF. (2009). Pre-lexical abstraction of speech in the auditory cortex. Trends Cogn. Sci.13, 14–19. 10.1016/j.tics.2008.09.005
86
ObleserJ.LahiriA.EulitzC. (2003). Auditory-evoked magnetic field codes place of articulation in timing and topography around 100 milliseconds post syllable onset. Neuroimage20, 1839–1847. 10.1016/j.neuroimage.2003.07.019
87
OosterhofN. N.TipperS. P.DowningP. E. (2012). Visuo-motor imagery of specific manual actions: a multi-variate pattern analysis fMRI study. Neuroimage63, 262–271. 10.1016/j.neuroimage.2012.06.045
88
OsnesB.HugdahlK.SpechtK. (2011). Effective connectivity analysis demonstrates involvement of premotor cortex during speech perception. Neuroimage54, 2437–2445. 10.1016/j.neuroimage.2010.09.078
89
ParkH.KayserC.ThutG.GrossJ. (2016). Lip movements entrain the observers’ low-frequency brain oscillations to facilitate speech intelligibility. eLife5:e14521. 10.7554/eLife.14521
90
PeelleJ. E.EasonR. J.SchmitterS.SchwarzbauerC.DavisM. H. (2010). Evaluating an acoustically quiet EPI sequence for use in fMRI studies of speech and auditory processing. Neuroimage52, 1410–1419. 10.1016/j.neuroimage.2010.05.015
91
PenfieldW.RasmussenT. (1950). The Cerebral Cortex of Man.New York, NY: MacMillan.
92
PoldrackR. A.WagnerA. D.PrullM. W.DesmondJ. E.GloverG. H.GabrieliJ. D. (1999). Functional specialization for semantic and phonological processing in the left inferior prefrontal cortex. Neuroimage10, 15–35. 10.1006/nimg.1999.0441
93
PulvermüllerF. (1992). Constituents of a neurological theory of language. Concepts Neurosci.3, 157–200.
94
PulvermüllerF. (1999). Words in the brain’s language. Behav. Brain Sci.22, 253–279; discussion 280–336. 10.1017/s0140525x9900182x
95
PulvermüllerF. (2005). Brain mechanisms linking language and action. Nat. Rev. Neurosci.6, 576–582. 10.1038/nrn1706
96
PulvermüllerF. (2013). How neurons make meaning: brain mechanisms for embodied and abstract-symbolic semantics. Trends Cogn. Sci.17, 458–470. 10.1016/j.tics.2013.06.004
97
PulvermüllerF.FadigaL. (2010). Active perception: sensorimotor circuits as a cortical basis for language. Nat. Rev. Neurosci.11, 351–360. 10.1038/nrn2811
98
PulvermüllerF.FadigaL. (2016). “Brain language mechanisms built on action and perception,” in Handbook of Neurobiology of Language, eds HickokG.SmallS. L. (Amsterdam: Elsevier), 311–324.
99
PulvermüllerF.GaragnaniM. (2014). From sensorimotor learning to memory cells in prefrontal and temporal association cortex: a neurocomputational study of disembodiment. Cortex57, 1–21. 10.1016/j.cortex.2014.02.015
100
PulvermüllerF.GaragnaniM.WennekersT. (2014). Thinking in circuits: toward neurobiological explanation in cognitive neuroscience. Biol. Cybern.108, 573–593. 10.1007/s00422-014-0603-9
101
PulvermüllerF.HärleM.HummelF. (2001). Walking or talking? behavioral and neurophysiological correlates of action verb processing. Brain Lang.78, 143–168. 10.1006/brln.2000.2390
102
PulvermüllerF.HussM.KherifF.Moscoso del Prado MartinF.HaukO.ShtyrovY. (2006). Motor cortex maps articulatory features of speech sounds. Proc. Natl. Acad. Sci. U S A103, 7865–7870. 10.1073/pnas.0509989103
103
PulvermüllerF.KiffJ.ShtyrovY. (2012). Can language-action links explain language laterality?: an ERP study of perceptual and articulatory learning of novel pseudowords. Cortex48, 871–881. 10.1016/j.cortex.2011.02.006
104
PulvermüllerF.ShtyrovY.IlmoniemiR. (2003). Spatiotemporal dynamics of neural language processing: an MEG study using minimum-norm current estimates. Neuroimage20, 1020–1025. 10.1016/s1053-8119(03)00356-2
105
PulvermüllerF.ShtyrovY.IlmoniemiR. (2005). Brain signatures of meaning access in action word recognition. J. Cogn. Neurosci.17, 884–892. 10.1162/0898929054021111
106
RaizadaR. D.PoldrackR. A. (2007). Selective amplification of stimulus differences during categorical processing of speech. Neuron56, 726–740. 10.1016/j.neuron.2007.11.001
107
RauscheckerJ. P.ScottS. K. (2009). Maps and streams in the auditory cortex: nonhuman primates illuminate human speech processing. Nat. Neurosci.12, 718–724. 10.1038/nn.2331
108
RogersJ. C.MöttönenR.BoylesR.WatkinsK. E. (2014). Discrimination of speech and non-speech sounds following theta-burst stimulation of the motor cortex. Front. Psychol.5:754. 10.3389/fpsyg.2014.00754
109
RoyA. C.CraigheroL.Fabbri-DestroM.FadigaL. (2008). Phonological and lexical motor facilitation during speech listening: a transcranial magnetic stimulation study. J. Physiol. Paris102, 101–105. 10.1016/j.jphysparis.2008.03.006
110
SatoM.TremblayP.GraccoV. L. (2009). A mediating role of the premotor cortex in phoneme segmentation. Brain Lang.111, 1–7. 10.1016/j.bandl.2009.03.002
111
SchomersM. R.KirilinaE.WeigandA.BajboujM.PulvermüllerF. (2015). Causal influence of articulatory motor cortex on comprehending single spoken words: TMS evidence. Cereb. Cortex25, 3894–3902. 10.1093/cercor/bhu274
112
SchwartzJ.-L.BasiratA.MénardL.SatoM. (2012). The Perception-for-Action-Control Theory (PACT): a perceptuo-motor theory of speech perception. J. Neurolinguistics25, 336–354. 10.1016/j.jneuroling.2009.12.004
113
SchwartzJ.-L.BerthommierF.SavariauxC. (2004). Seeing to hear better: evidence for early audio-visual interactions in speech identification. Cognition93, B69–B78. 10.1016/s0010-0277(04)00054-x
114
ScottS. K.BlankC. C.RosenS.WiseR. J. (2000). Identification of a pathway for intelligible speech in the left temporal lobe. Brain123, 2400–2406. 10.1093/brain/123.12.2400
115
ScottS. K.JohnsrudeI. S. (2003). The neuroanatomical and functional organization of speech perception. Trends Neurosci.26, 100–107. 10.1016/s0166-2236(02)00037-1
116
ScottS. K.RosenS.LangH.WiseR. J. (2006). Neural correlates of intelligibility in speech investigated with noise vocoded speech–a positron emission tomography study. J. Acoust. Soc. Am.120, 1075–1083. 10.1121/1.2216725
117
ShtyrovY.ButorinaA.NikolaevaA.StroganovaT. (2014). Automatic ultrarapid activation and inhibition of cortical motor systems in spoken word comprehension. Proc. Natl. Acad. Sci. U S A111, E1918–E1923. 10.1073/pnas.1323158111
118
ShtyrovY.KujalaT.PalvaS.IlmoniemiR. J.NäätänenR. (2000). Discrimination of speech and of complex nonspeech sounds of different temporal structure in the left and right cerebral hemispheres. Neuroimage12, 657–663. 10.1006/nimg.2000.0646
119
ShtyrovY.PihkoE.PulvermüllerF. (2005). Determinants of dominance: is language laterality explained by physical or linguistic features of speech?Neuroimage27, 37–47. 10.1016/j.neuroimage.2005.02.003
120
SkipperJ. I.NusbaumH. C.SmallS. L. (2005). Listening to talking faces: motor cortical activation during speech perception. Neuroimage25, 76–89. 10.1016/j.neuroimage.2004.11.006
121
SkipperJ. I.van WassenhoveV.NusbaumH. C.SmallS. L. (2007). Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception. Cereb. Cortex17, 2387–2399. 10.1093/cercor/bhl147
122
SmalleE. H.RogersJ.MöttönenR. (2015). Dissociating contributions of the motor cortex to speech perception and response bias by using transcranial magnetic stimulation. Cereb. Cortex25, 3690–3698. 10.1093/cercor/bhu218
123
StrijkersK.CostaA. (2016). The cortical dynamics of speaking: present shortcomings and future avenues. Lang. Cogn. Neurosci.31, 484–503. 10.1080/23273798.2015.1120878
124
SzenkovitsG.PeelleJ. E.NorrisD.DavisM. H. (2012). Individual differences in premotor and motor recruitment during speech perception. Neuropsychologia50, 1380–1392. 10.1016/j.neuropsychologia.2012.02.023
125
TremblayS.ShillerD. M.OstryD. J. (2003). Somatosensory basis of speech production. Nature423, 866–869. 10.1038/nature01710
126
TomaselloR.GaragnaniM.WennekersT.PulvermüllerF. (2016). Brain connections of words, perceptions and actions: A neurobiological model of spatio-temporal semantic activation in the human cortex.Neuropsychologia10.1016/j.neuropsychologia.2016.07.004 [Epub ahead of print].
127
UppenkampS.JohnsrudeI. S.NorrisD.Marslen-WilsonW.PattersonR. D. (2006). Locating the initial stages of speech-sound processing in human temporal cortex. Neuroimage31, 1284–1296. 10.1016/j.neuroimage.2006.01.004
128
VigneauM.BeaucousinV.HervéP. Y.DuffauH.CrivelloF.HoudéO.et al. (2006). Meta-analyzing left hemisphere language areas: phonology, semantics and sentence processing. Neuroimage30, 1414–1432. 10.1016/j.neuroimage.2005.11.002
129
WatkinsK. E.StrafellaA. P.PausT. (2003). Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia41, 989–994. 10.1016/s0028-3932(02)00316-0
130
WatkinsK.PausT. (2004). Modulation of motor excitability during speech perception: the role of Broca’s area. J. Cogn. Neurosci.16, 978–987. 10.1162/0898929041502616
131
WernickeC. (1874). Der Aphasische Symptomenkomplex. Eine Psychologische Studie Auf Anatomischer Basis.Breslau, Germany: Kohn und Weigert.
132
WilsonS. M.IacoboniM. (2006). Neural responses to non-native phonemes varying in producibility: evidence for the sensorimotor nature of speech perception. Neuroimage33, 316–325. 10.1016/j.neuroimage.2006.05.032
133
WilsonS. M.SayginA. P.SerenoM. I.IacoboniM. (2004). Listening to speech activates motor areas involved in speech production. Nat. Neurosci.7, 701–702. 10.1038/nn1263
134
YeungH. H.WerkerJ. F. (2013). Lip movements affect infants’ audiovisual speech perception. Psychol. Sci.24, 603–612. 10.1177/0956797612458802
Summary
Keywords
speech perception, sensorimotor integration of speech, motor cortex, somatosensory cortex, articulatory features, multivariate pattern analysis (MVPA), transcranial magnetic stimulation (TMS), embodied cognition
Citation
Schomers MR and Pulvermüller F (2016) Is the Sensorimotor Cortex Relevant for Speech Perception and Understanding? An Integrative Review. Front. Hum. Neurosci. 10:435. doi: 10.3389/fnhum.2016.00435
Received
26 May 2016
Accepted
15 August 2016
Published
21 September 2016
Volume
10 - 2016
Edited by
Nathalie Tzourio-Mazoyer, CNRS, CEA and Bordeaux University, France
Reviewed by
Roel M. Willems, Radboud University Nijmegen, Netherlands; Monica Baciu, Université Pierre Mendès-France, France
Updates

Check for updates
Copyright
© 2016 Schomers and Pulvermüller.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Malte R. Schomers m.schomers@fu-berlin.de Friedemann Pulvermüller friedemann.pulvermuller@fu-berlin.de
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.