Skip to main content

ORIGINAL RESEARCH article

Front. Hum. Neurosci., 13 March 2015
Sec. Speech and Language
Volume 9 - 2015 | https://doi.org/10.3389/fnhum.2015.00126

Auditory and motion metaphors have different scalp distributions: an ERP study

  • Department of Psychology, Hope College, Holland, MI, USA

While many links have been established between sensory-motor words used literally (kick the ball) and sensory-motor regions of the brain, it is less clear whether metaphorically used words (kick the habit) also show such signs of “embodiment.” Additionally, not much is known about the timing or nature of the connection between language and sensory-motor neural processing. We used stimuli divided into three figurativeness conditions—literal, metaphor, and anomalous—and two modality conditions—auditory (Her limousine was a privileged snort) and motion (The editorial was a brass-knuckle punch). The conditions were matched on a large number of potentially confounding factors including cloze probability. The electroencephalographic response to the final word of each sentence was measured at 64 electrode sites on the scalp of 22 participants and event-related potentials (ERPs) calculated. Analysis revealed greater amplitudes for metaphorical than literal sentences in both 350–500 ms and 500–650 ms timeframes. Results supported the possibility of different neural substrates for motion and auditory sentences. Greater differences for motion sentences were seen in the left posterior and left central electrode sites than elsewhere on the scalp. These findings are consistent with a sensory-motor neural categorization of language and with the integration of modal and amodal information during the N400 and P600 timeframes.

Introduction

Now that many neural links have been established between language and action (e.g., Wallentin et al., 2005) it is time to move beyond the debate about whether language and cognition are embodied and to begin investigating the timing and nature of the neural link between language and sensory-motor aspects of experience (Chatterjee, 2010). Many investigators have demonstrated links between literally used action words (grasp the ball) and action areas of the brain, but fewer have done so with action words used metaphorically (grasp the idea), which do not literally refer to actions. In the current study we investigate the metaphorical use of motion and auditory words using event-related potentials (ERPs). Using this method allows us to examine the timing of the link between conceptual and sensorimotor aspects of a semantic concept.

Modality and Metaphor

Most psychology and cognitive science researchers have previously regarded language and cognition as amodal; however recently the notion that cognition may be grounded in sensory-motor experience and embodied has become dominant (Barsalou, 2008). Several studies have shown the activation of sensory or motor regions of the brain during the processing of words or other stimuli depicting actions or sensory experiences (Pulvermüller, 2005; Wallentin et al., 2005; Daselaar et al., 2010). Nevertheless intense debate surrounds the embodied view of language (Gibbs, 2013a). To move forward, it is not necessary to continue to demonstrate links between cognition and action. Rather, work must now focus on the nature of that embodiment, the direction of influence between modal and amodal representations, and the timing of the connection between them (Mahon and Caramazza, 2008; Chatterjee, 2010; Gibbs, 2013a). For example, Rueschemeyer et al. (2010) found participants performing an intentional action (but not a non-intentional action) showed a priming effect for processing words depicting manipulable compared to nonmanipulable objects. If something like intentionality is important in showing a link between sensorimotor processes and language, the nature of embodiment may be more complex than previously thought.

Support for embodied theories of language has frequently come from reports of activations in sensory-motor areas of the brain triggered by action words (e.g., Barsalou, 1999; but see Mahon and Caramazza, 2008, who also discuss other interpretations of these findings). Using metaphor is a particularly compelling way to examine embodied theories of language. Showing the neural activation associated with words referring to physical actions (grasp the ball) does not go as far as extending this to action words used metaphorically (grasp the idea). When a word with sensory-motor properties used in a non-literal way recruits the sensory-motor regions of the brain, this activation provides strong support for a robust association between physical experience and completely abstract concepts in the brain, such as understanding (grasping) an idea. While some studies failed to find this association (e.g., Aziz-Zadeh and Damasio, 2008; Cardillo et al., 2012), some recent attempts have been successful (e.g., Cacciari et al., 2011; Desai et al., 2011, 2013). Most studies have reported links between action concepts and the motor system, but links in other modalities such as texture and the sensory system (e.g., Lacey et al., 2012) have also been reported. We extend this work by comparing metaphors based on two modalities, auditory (The flowers were a colorful clamor) and motion (Her inquiries were a nervous scamper).

Identifying when and how modal and amodal representations interact in the brain is important for understanding the nature of embodiment. For example, the link between the amodal and modal representation of a specific word or concept may only happen at a specific stage of processing rather than globally (Ritchie, 2008). Neuroimaging studies by their nature do not provide precise timing information, but electrophysiological methods do. In particular, the N400 ERP component, a negativity occurring about 400 ms after stimulus presentation, is sensitive to anomaly as in He took a sip from the transmitter. A larger N400 amplitude has traditionally been considered an index of the ease of semantic integration (Kutas and Hillyard, 1980). Current thinking suggests the N400 is more specifically associated with neural access to initial conceptual representations or semantic retrieval (Van Petten and Luka, 2006). In fact, Federmeier and Laszlo (2009) proposed the N400 is associated with the binding of data from various modalities, creating a multimodal conceptual representation that is dynamically created and highly context dependent (Kutas and Federmeier, 2011). The N400 is an ideal measure for investigating the timing of the neural basis of metaphor based on different modalities and is our primary dependent measure.

The Current Study

Stimuli in the current study were divided into three figurativeness conditions (literal, metaphor and anomalous) crossed with two modality conditions (auditory and motion). Sentences included auditory literal (His comeback was a haughty snort), auditory metaphor (Her limousine was a privileged snort), motion literal (The blow was a single punch), motion metaphor (The editorial was a brass-knuckle punch), and anomalous. See Table 1 for more examples. The conditions were matched on a large number of potentially confounding factors (Cardillo et al., 2010).

TABLE 1
www.frontiersin.org

Table 1. Examples of each sentence type.

The purpose of the current study was to use ERP to investigate the nature and time course of metaphor comprehension based on two different modalities. We compared the neural processing of motion and auditory modalities. It is common in ERP studies to use differences in component distribution across the scalp to infer differences in neural areas recruited. Kutas and Federmeier (2011) discuss a number of such examples with the N400. We hypothesize that if the N400 reflects the binding of data from different modal and amodal representations, different parts of the brain should be recruited in addition to language areas for each modality–for example the motor cortex for motion sentences, and the auditory cortex for auditory sentences. We predicted a difference in the scalp distribution of the N400 for the two modalities demonstrating different underlying patterns of activation at 400 ms post stimulus.

While examining our data in the present study, it became apparent that differences in positivity were occurring in the P600 time range. The P600 ERP component has traditionally been considered an index of syntactic error processing although it is now known to be involved in various complex sentences processing mechanisms (e.g., Gouvea et al., 2010; Kutas and Federmeier, 2011), including semantic integration (Brouwer et al., 2012). We thus added the P600 as an additional dependent measure.

Materials and Methods

Participants

Participants were 28 volunteers with at least 1 year of post-secondary education from the Hope College community. Data from two participants, who scored less than 60% correct in the anomalous condition, were excluded since their score suggests they may not have comprehended many metaphors. Data from an additional four participants were excluded due to insufficient acceptable trials (less than 20 per condition). The remaining 22 participants (17 women, mean age 20.8 years, range 18–23, mean years of education 14.5, range 13–16) were native English speakers, and had no history of neurological or psychiatric disorders. All participants were right-handed with a mean handedness score of 0.84 (SD = 0.16) (Annett, 1970); 11 reported left-handed family members. This study was approved by the Hope College Human Subjects Review Board and all participants provided written informed consent prior to participation.

Creation of Stimuli

A preliminary list of 411 sentences was compiled consisting of literal, metaphorical, and anomalous sentences. Literal and metaphorical sentences were obtained from Cardillo et al. (2010). Cardillo et al. matched sentences on 10 dimensions: length, frequency, concreteness, familiarity, naturalness, imageability, figurativeness, interpretability, valence, and valence judgment reaction time. The sentences began with a subject followed by the past or present tense form of the verb “be” followed by an adjective for the object (e.g., His job was an endless). Each sentence ended with either an auditory or motion target word as the object (e.g., groan). Motion words were physical actions depicting motion such as climb, dig, and stampede, whereas auditory words included sounds like sneeze, chirp, and hiss. For each target word, a literal and a metaphorical sentence were written (Table 1). Thus, each target word was used both literally and figuratively based on the context of the noun phrase. In the present study, the same sentence structure and target words were used to create anomalous sentences. Anomalous sentences were created by the authors and had neither a literal nor metaphorical meaning. These sentences were included as a control condition for comparison with the literal and metaphorical conditions.

Before the final selection of stimuli, three preliminary studies further characterized the sentences. Fifty-two native English speakers, who did not participate in the main experiment, completed a cloze probability questionnaire by finishing each sentence with the first word that came to mind. Words were keyed into a spreadsheet using a standard computer keyboard. Excluding one participant due to non-compliance with task instructions, data from the remaining 51 participants (35 women, mean age 19 years) were used to calculate the cloze probability of each sentence. The sum of answers matching the actual target word was divided by the number of participants to measure the sentence ending predictability.

A second questionnaire was completed by 20 native English speakers (14 women, mean age 18 years) who did not participate in the main experiment. Using a 7-point scale (1 = low, 7 = high), each participant rated the familiarity and imageability of 277 sentences (70 literal, 70 metaphorical, 137 anomalous). Responses were keyed into a spreadsheet using a standard computer keyboard. The anomalous sentence ratings were added to the collection of literal and metaphorical sentence ratings.

Third, a pilot test was conducted to attain average response times and accuracy ratings for each sentence. Twenty native English speakers (13 women, mean age 18 years) were tested on the original stimulus set of 411 sentences using the procedure from the main experiment.

The resulting cloze probability, familiarity, imageability, pilot response time, and pilot accuracy ratings were used in the final selection of stimuli to create the most balanced stimuli possible. In addition, several other factors were balanced. Crucially, modality (auditory, motion) and figurativeness (literal, metaphorical) factors did not differ on cloze probability ratings (ps > 0.05).

Some of the stimuli had an adjective modifying the final target word (Cardillo, 2010). Across motion and auditory sentences, there was no difference in the number of sentences having an adjective modifying the object (target) and those that did not (p > 0.05). The frequency and concreteness of adjectives in motion vs. auditory sentences did not differ as a whole or looking at literal and metaphorical sentences separately (all ps > 0.05). However, several factors across figurativeness conditions for either modality could not be balanced (ps < 0.05). Table 2 lists all the factors considered and descriptive statistics for the four sentence types. Table 3 gives the results of t-tests conducted to assess differences. The final stimulus set contained 300 sentences, 50 in each condition.

TABLE 2
www.frontiersin.org

Table 2. Characteristics of the final stimuli.

TABLE 3
www.frontiersin.org

Table 3. Comparison of final stimuli across modality and figurativeness conditions.

Procedure

Participants were tested individually in a single experimental session. Stimuli were presented using E-Prime software (Psychological Software Tools, Pittsburgh, PA, USA) in 20pt Arial bold font, with white text on a black background. During a practice block of 10 sentences, participants were acclimated to the task and given verbal feedback regarding their task performance and blinking. Each trial began with the beginning of the sentence (the entire sentence except the last word). Participants controlled the advancement of the trial by pressing the spacebar when ready. Next, an automatic timed sequence occurred in which participants were asked not to blink: fixation cross (500 ms), final word of the sentence (1200 ms), and a response screen (limited to 5000 ms). The response screen instructed participants to indicate whether the presented sentence was literal, metaphorical, or anomalous via keyboard response with the first three fingers of the right hand. This ensured that metaphorical trials were processed as metaphorical by the participant since incorrect trials were discarded. It also ensured the subjects were attending to and processing the sentences. However it may be that a certain neural pattern motivated the participants to give a particular behavior response, triggering our results and resulting in circular reasoning. The present results must be interpreted with this caveat in mind. Once an answer was given, the next trial began after a randomly assigned intertrial interval between 900 ms and 1150 ms in 50 ms increments.

Each of the 17 blocks contained an equal number of each sentence type in a unique random order for each participant. An additional version of the experiment was formed by reversing the order of the blocks. Participants were randomly assigned to one of the two block orders to reduce word priming effects in the experiment. Participants controlled their resting time upon the completion of every block. The total duration of the study was approximately two hours.

Electrophysiological Recording

Scalp activity was recorded with a 64 channel BioSemi ActiveTwo system (BioSemi Inc., Amsterdam, Netherlands) with an analog-to-digit rate of 512 Hz and a bandwidth of 104 Hz. A Common Mode Sense (CMS) active electrode was used as the reference, and a Driven Right Leg (DRL) passive electrode was used as the ground. Active Ag-AgCl pin-type electrodes were inserted into a Lycra head cap with locations based upon the American Electroencephalographic Society (1994). Electrooculograms (EOG) were recorded using flat-type electrodes placed on the left and right infraorbital ridge and outer cantus. In addition, two more flat-type electrodes were placed on the left and right mastoids. Individual electrode offsets were kept between ±30 mV.

Offline, electroencephalography (EEG)/ERP analyses were conducted using EMSE Suite software (Source Signal Imaging Inc., San Diego, CA, USA). The left and right mastoid recordings were averaged and used as the offline reference. A digital bandpass filter of 0.01–30 Hz was applied to the EEG recordings, and then an individual eye artifact filter removed eye movements for each participant. ERPs were obtained through stimulus-locked averaging of each condition with an epoch extending from 200 ms pre-stimulus to 800 ms post-stimulus. Trials in which EEG or EOG channels exceeded ±50 µV, or in which the participant did not respond correctly in 5000 ms were eliminated. The remaining segments were baseline corrected and then averaged to create ERP waveforms for each participant. The mean number of trials averaged per condition per participant across all cells of data was 35.6 (SD = 6.9, range 20–50). Across the six conditions, the condition with the smallest number of mean trials per participant per condition was the auditory metaphor condition at 30.0 (SD = 6.4) and the condition with the largest number was the auditory anomalous condition with 40.0 (SD = 7.1). Figure 1 shows how the 64 electrode sites were divided into the following eight scalp regions: Left Anterior (FP1, AF7, AF3, F7, F5, F3, F1, FT7, TCF, FC3, FC1), Left Center (T7, C5, C3, C1), Left Posterior (TP7, CP5, CP3, CP1, P9, P7, P5, P3, P1, PO7, PO3, O1) Center Anterior (FPz, AFz, Fz, FCz, Cz), Center Posterior (CPz, Pz, POz, Oz, Iz), Right Anterior (FP2, AF4, AF8, F2, F4, F6, F8, FC2, FC4, FC6, FT8), Right Center (C2, C4, C6, T8), Right Posterior (CP2, CP4, CP6, TP8, P2, P4, P6, P8, P10, PO4, PO8, O2). We operationalized the N400 amplitude as the area under the curve from 350 ms to 500 ms and the P600 amplitude as the area under the curve from 500 ms to 650 ms, based on visual inspection of grand averages.

FIGURE 1
www.frontiersin.org

Figure 1. Montage and scalp region designations used in all analyses.

Results

Behavioral

The mean accuracy score across participants was 0.76 (SD = 0.05) and only correct trials were included in the ERP and reaction time analyses. A 2 (modality) × 3 (figurativeness) repeated measures ANOVA using the Huynh-Feldt sphericity correction was conducted on mean accuracy scores revealing an effect of figurativeness, F(2,42) = 8.2, p = 0.003, ε = 0.784 and a modality × figurativeness interaction, F(2,42) = 6.1, p = 0.005, ε = 1.0 (Degrees of freedom are reported with sphericity assumed throughout this manuscript). The interaction can be explained by an effect of modality for metaphors, F(1,21) = 15.8, p = 0.001, but not for literal or anomalous sentences, ps > 0.05. Planned comparisons revealed that metaphorical sentences (M = 0.68, SD = 0.13) were processed less accurately than either literal (M = 0.78, SD = 0.09, t(21) = 3.0, p = 0.006) or anomalous (M = 0.83, SD = 0.11, t(21) = 3.2, p = 0.005) sentences.

A 2 (modality) × 3 (figurativeness) repeated measures ANOVA using the Huynh-Feldt sphericity correction was conducted on mean reaction times revealing only an effect of figurativeness, F(2,42) = 8.3, p = 0.001, ε = 0.98. Planned comparisons revealed that metaphorical sentences (M = 855 ms, SD = 201 ms) were processed more slowly than either literal (M = 772 ms, SD = 245 ms, t(21) = 2.7, p = 0.01) or anomalous (M = 705 ms, SD = 182 ms, t(21) = 3.9, p = 0.001) sentences.

Electrophysiological

N400

A 2 (modality) × 3 (literal/metaphor/anomalous) × 8 (scalp region) repeated measures ANOVA using the Huynh-Feldt sphericity correction was conducted to assess differences in N400 amplitude. This revealed a main effect of figurativeness, F(2,42) = 24.0, p > 0.001, ε = 0.79, a main effect of scalp region, F(7,147) = 3.6, p = 0.025, ε = 0.37, and a trending modality × scalp region interaction, F(7,147) = 2.5, p = 0.063, ε = 0.46.

Figure 2 shows the largest N400 amplitudes were for anomalous sentences, followed by metaphorical sentences, t(21) = 3.9, p = 0.001, followed by literal sentences, t(21) = 4.8, p < 0.001. The modality × scalp region interaction reflects larger N400 amplitudes for motion than auditory sentences, with significant differences in the Left Center, t(21) = 2.1, p = 0.047, Left Posterior, t(21) = 2.5, p = 0.02, and Center Posterior, t(21) = 2.3, p = 0.03 scalp regions (Figure 3).

FIGURE 2
www.frontiersin.org

Figure 2. Grand average ERPs of the last word in literal, metaphorical, and anomalous sentences, from representative electrodes in each of the 8 scalp regions plus Cz.

FIGURE 3
www.frontiersin.org

Figure 3. Topographic maps of the N400 and P600 responses to the last word in auditory and motion sentences (anomalous excluded). For the N400, black rectangles indicate the Left Center, Left Posterior, and Center Posterior regions which had statistical differences between auditory and motion conditions, ps < 0.05. For the P600, black rectangles indicate the Left Center and Left Posterior regions which had differences approaching significance (ps < 0.18); the location × condition interaction was significant.

To determine whether the figurativeness effect included a difference between literal and metaphorical sentences, the analysis was repeated without the anomalous condition, revealing a similar pattern with a main effect of figurativeness, F(1,21) = 18.0, p < 0.001, a main effect of scalp region, F(7,140) = 2.8, p = 0.055, ε = 0.37, and a modality × scalp region interaction, F(7,147) = 2.7, p = 0.049, ε = 0.47. No other effects or interactions in either analysis were observed, ps > 0.05.

P600

Visual inspection of the findings suggested possible effects in the 500—650 ms time window, which we called the P600. To investigate this possibility, the same two analyses were conducted for the P600 amplitude. The first analysis revealed a main effect of figurativeness, F(2,42) = 4.9, p = 0.012, ε = 1.0 (see Figure 3), a main effect of scalp region, F(7,147) = 9.7, p < 0.001, ε = 0.47, and a modality × scalp region interaction, F(7,147) = 3.5, p = 0.024, ε = 0.38, with no other effects or interactions, ps > 0.05. Figure 2 shows that anomalous sentences had a larger P600 amplitude than metaphorical sentences, t(21) = 2.2, p = 0.04, but metaphor sentences did not differ from literal sentences, p > 0.28.

With the anomalous condition removed, only an effect of scalp region was found, F(7,147) = 9.6, p < 0.001, ε = 0.43. Paired sample t-tests revealed no differences between auditory and motion sentences at any of the eight scalp regions, ts > 0.13. Similar to the N400 pattern, the modality × scalp region interaction reflects possibly larger P600 amplitudes for motion than auditory sentences in the Left Center and Left Posterior scalp regions, with few differences elsewhere (Figure 3).

Confounding Factors

The main effect of figurativeness for both the N400 and P600 may be confounded by the familiarity or imageability of the sentences. To explore this possibility, we created two levels of familiarity and imageability by performing a median split on the previously normed ratings. Separate 2 (high, low) × 8 (scalp region) ANOVA analyses using the Huynh-Feldt sphericity correction revealed significant effects for both the N400 (Familiarity, F(1,21) = 33.3, p < 0.001; Imageability, F(1.21) = 15.2, p = 0.001) and P600 (Familiarity, F(1,21) = 5.8, p = 0.03; Imageability, F(1.21) = 4.9, p = 0.04).

Discussion

The current study explored the effect of modality on metaphor processing. We used ERPs to compare the processing of motion (The partnership was a financial tailspin) and auditory (His emails were an insistent knock) unfamiliar metaphors to literal and anomalous sentences using the same final word. We hypothesized a difference in the neural basis of motion compared to auditory metaphors. As predicted, we found a modality by scalp region interaction for the N400, and we discovered the same interaction for the P600. There were no interactions with figurativeness. These results support embodied views of language and suggests that metaphorical language is not qualitatively distinct from language in general. They also support the view that integration of modality and language information may be taking place in the 400 ms timeframe and later.

Modality

This study suggests different neural processing of auditory and motion-based literal and metaphorical language for the N400 timeframe and also for the later P600 timeframe. Both components index various aspects of language processing. The N400 response to language stimuli represents aspects of semantic processing, including the possible building of a multimodal conceptual representation. The P600 is thought to underlie a revision process that occurs as more information is accounted for during the process of sentence comprehension (Kutas and Federmeier, 2011). Sensory-motor aspects of meaning may be accessed as early as 200 ms (Boulenger et al., 2012). The present findings suggest modality information is still processed and integrated in the 350–650 ms time window with two processes represented by the N400 and P600.

Many behavioral studies have demonstrated a link between the metaphorical use of language and sensory or motor processes, including novel sensory metaphors (the past is heavy) (e.g., Slepian and Ambady, 2014), conventional sensory metaphors (anger is heat) (Wilkowski et al., 2009), or conventional motion metaphors (love is a journey) (Gibbs, 2013b). Sensory motor regions of the brain have recently been shown to be activated in response to not only sensory-motor words but to those words used metaphorically (e.g., Cacciari et al., 2011; Lacey et al., 2012; Desai et al., 2013).

These studies link motor and language processing but do not provide information about the timing or nature of the link. Studies using EEG or MEG demonstrate activation of the motor cortex within 200 ms after the presentation of a word depicting action (Hauk and Pulvermüller, 2004). N400 effects have been found for the processing of visually perceived motion (Proverbio and Riva, 2009) and for the processing of a new meaning grounded in perception or action such as paddling a canoe with a Frisbee (Chwilla et al., 2007). The present findings extend these reports to literally and metaphorically used motion and auditory words presented in sentences. Our effects in the 350–650 ms timeframe suggest the integration and revision processes indexed by the N400 and P600 are likely to occur for both literal and metaphorical sentences with motion and auditory sensory-motor components in a later timeframe. Thus modality information continues to be processed during this time. This result is consistent with views that suggest the embodiment of language is not automatic and instant (Mahon and Caramazza, 2008; Rueschemeyer et al., 2010; Gibbs, 2013a) while not supporting an amodal view of language. (But see Mahon and Caramazza, 2008, who suggest that the activation of the literal meaning of metaphors during comprehension may be sufficient to modulate modality specific processes, although such process may not be required for comprehension). Since the effect existed for both literal and metaphorical sentences, metaphorical language may not be qualitatively distinct from language in general.

Figurativeness

The current findings demonstrate a graded N400 effect with the amplitude of the N400 increasing from literal to metaphorical to anomalous sentences, consistently found across metaphor ERP studies (e.g., Arzouan et al., 2007; Lai et al., 2009). We also found a similar graded effect for the P600 in the 500–650 ms time range. Because our literal sentences were more imageable and familiar than our metaphorical sentences, it is probable that these factors can partially or completely account for our findings (Lee and Federmeier, 2008; Schmidt and Seger, 2009). Indeed, a median split based on these factors revealed significant differences in both the N400 and P600. The confounding by familiarity and imageability may need to be considered in comparisons between literal and metaphorical stimuli (Schmidt et al., 2010). ERP studies reporting a difference between literal and metaphorical stimuli, including ours, either do not mention matching familiarity between the sentences or if they do, do not balance the sentence types on familiarity. In these cases, metaphorical sentences are reported to be or appear to be less familiar than literal sentences. Indeed, when the metaphors are highly familiar or conventional, N400 differences between literal and metaphorical sentences are not always present (e.g., Balconi and Amenta, 2010). Studies reporting metaphor–literal differences in the N400 have also not addressed the imageability of the sentences used (Coulson and Van Petten, 2002, 2007; Kazmerski et al., 2003; Arzouan et al., 2007; Lai et al., 2009; Gold et al., 2010; Goldstein et al., 2012; Tzuyin Lai and Curran, 2013). Similarly, our metaphorical sentences were less imageable than our literal sentences.

Conclusion

We report here the first ERP study of motion and auditory based metaphors. Our findings are consistent with the conclusion that the modality of the metaphor may influence its neural instantiation. The current findings also suggest that integration of modal and amodal meanings may be taking place during the N400 and P600 timeframes. Additional work is required to understand the exact nature of this integration. Further exploration of the interaction between the factor of modality on one hand and imageability and familiarity on the other hand is also warranted.

Author Statement

GS, EB and SA were involved in the development of stimuli, initial design of the experiment and pilot testing. GS, AD, EB, and SA revised the study design based on pilot testing and finalized the selection of stimuli. AD and EB acquired the data. AD, EB and GS analyzed and interpreted the data. GS and AD wrote the first draft of the manuscript. GS, AD, EB, and SA contributed to and approved of the final manuscript.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors thank John Shaughnessy, Audrey Weil, Elizabeth Burks, Rebecca Kresnak, Elizabeth Fast, and Nathan Axdorff for their assistance with various aspects of this work.

References

American Electroencephalographic Society. (1994). Guideline thirteen: guidelines for standard electrode position nomenclature. J. Clin. Neurophysiol. 11, 111–113. doi: 10.1097/00004691-199401000-00014

PubMed Abstract | Full Text | CrossRef Full Text

Annett, M. (1970). A classification of hand preference by association analysis. Br. J. Psychol. 61, 303–321. doi: 10.1111/j.2044-8295.1970.tb01248.x

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Arzouan, Y., Goldstein, A., and Faust, M. (2007). Dynamics of hemispheric activity during metaphor comprehension: electrophysiological measures. Neuroimage 36, 222–231. doi: 10.1016/j.neuroimage.2007.02.015

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Aziz-Zadeh, L., and Damasio, A. (2008). Embodied semantics for actions: findings from functional brain imaging. J. Physiol. Paris 102, 35–39. doi: 10.1016/j.jphysparis.2008.03.012

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Balconi, M., and Amenta, S. (2010). “A fighter is a lion”. Neuropsychological indexes in comprehending frozen metaphors. J. Pragmatics 42, 3246–3257. doi: 10.1016/j.pragma.2010.06.016

CrossRef Full Text | Google Scholar

Barsalou, L. W. (1999). Perceptual symbol systems. Behav. Brain Sci. 22, 577–609; discussion 610–660. doi: 10.1017/S0140525X99532147

PubMed Abstract | Full Text | CrossRef Full Text

Barsalou, L. W. (2008). Grounded cognition. Annu. Rev. Psychol. 59, 617–645. doi: 10.1146/annurev.psych.59.103006.093639

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Boulenger, V., Shtyrov, Y., and Pulvermüller, F. (2012). When do you grasp the idea? MEG evidence for instantaneous idiom understanding. Neuroimage 59, 3502–3513. doi: 10.1016/j.neuroimage.2011.11.011

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Brouwer, H., Fitz, H., and Hoeks, J. (2012). Getting real about semantic illusions: rethinking the functional role of the P600 in language comprehension. Brain Res. 1446, 127–143. doi: 10.1016/j.brainres.2012.01.055

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Brysbaert, M., and New, B. (2009). Moving beyond Kučera and Francis: a critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behav. Res. Methods 41, 977–990. doi: 10.3758/BRM.41.4.977

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Cacciari, C., Bolognini, N., Senna, I., Pellicciari, M. C., Miniussi, C., and Papagno, C. (2011). Literal, fictive and metaphorical motion sentences preserve the motion component of the verb: a TMS study. Brain Lang. 119, 149–157. doi: 10.1016/j.bandl.2011.05.004

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Cardillo, E. R., Schmidt, G. L., Kranjec, A., and Chatterjee, A. (2010). Stimulus design is an obstacle course: 560 matched literal and metaphorical sentences for testing neural hypotheses about metaphor. Behav. Res. Methods 42, 651–664. doi: 10.3758/BRM.42.3.651

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Cardillo, E. R., Watson, C. E., Schmidt, G. L., Kranjec, A., and Chatterjee, A. (2012). From novel to familiar: tuning the brain for metaphors. Neuroimage 59, 3212–3221. doi: 10.1016/j.neuroimage.2011.11.079

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Chatterjee, A. (2010). Disembodying cognition. Lang. Cogn. 2, 79–116. doi: 10.1515/langcog.2010.004

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Chwilla, D. J., Kolk, H. H., and Vissers, C. T. (2007). Immediate integration of novel meanings: N400 support for an embodied view of language comprehension. Brain Res. 1183, 109–123. doi: 10.1016/j.brainres.2007.09.014

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Coulson, S., and Van Petten, C. (2002). Conceptual integration and metaphor: an event-related potential study. Mem. Cognit. 30, 958–968. doi: 10.3758/bf03195780

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Coulson, S., and Van Petten, C. (2007). A special role for the right hemisphere in metaphor comprehension?: ERP evidence from hemifield presentation. Brain Res. 1146, 128–145. doi: 10.1016/j.brainres.2007.03.008

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Daselaar, S. M., Porat, Y., Huijbers, W., and Pennartz, C. M. (2010). Modality-specific and modality-independent components of the human imagery system. Neuroimage 52, 677–685. doi: 10.1016/j.neuroimage.2010.04.239

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Desai, R. H., Binder, J. R., Conant, L. L., Mano, Q. R., and Seidenberg, M. S. (2011). The neural career of sensory-motor metaphors. J. Cogn. Neurosci. 23, 2376–2386. doi: 10.1162/jocn.2010.21596

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Desai, R. H., Conant, L. L., Binder, J. R., Park, H., and Seidenberg, M. S. (2013). A piece of the action: modulation of sensory-motor regions by action idioms and metaphors. Neuroimage 83, 862–869. doi: 10.1016/j.neuroimage.2013.07.044

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Federmeier, K. D., and Laszlo, S. (2009). Time for meaning: electrophysiology provides insights into the dynamics of representation and processing in semantic memory. Psychol. Learn. Motiv. 51, 1–44. doi: 10.1016/S0079-7421(09)51001-8

CrossRef Full Text | Google Scholar

Gibbs, R. W. Jr. (2013a). The real complexities of psycholinguistic research on metaphor. Lang. Sci. 40, 45–52. doi: 10.1016/j.langsci.2013.03.001

CrossRef Full Text | Google Scholar

Gibbs, R. W. Jr. (2013b). Walking the walk while thinking about the talk: embodied interpretation of metaphorical narratives. J. Psycholinguist. Res. 42, 363–378. doi: 10.1007/s10936-012-9222-6

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Gold, R., Faust, M., and Goldstein, A. (2010). Semantic integration during metaphor comprehension in asperger syndrome. Brain Lang. 113, 124–134. doi: 10.1016/j.bandl.2010.03.002

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Goldstein, A., Arzouan, Y., and Faust, M. (2012). Killing a novel metaphor and reviving a dead one: ERP correlates of metaphor conventionalization. Brain Lang. 123, 137–142. doi: 10.1016/j.bandl.2012.09.008

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Gouvea, A. C., Phillips, C., Kazanina, N., and Poeppel, D. (2010). The linguistic processes underlying the P600. Lang. Cogn. Process. 25, 149–188. doi: 10.1080/01690960902965951

CrossRef Full Text | Google Scholar

Hauk, O., and Pulvermüller, F. (2004). Neurophysiological distinction of action words in the fronto-central cortex. Hum. Brain Mapp. 21, 191–201. doi: 10.1002/hbm.10157

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Kazmerski, V. A., Blasko, D. G., and Dessalegn, B. G. (2003). ERP and behavioral evidence of individual differences in metaphor comprehension. Mem. Cognit. 31, 673–689. doi: 10.3758/bf03196107

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Kučera, H., and Francis, W. N. (1967). Computational Analysis of Present-Day American English. Providence, RI: Brown University Press.

Kutas, M., and Federmeier, K. D. (2011). Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annu. Rev. Psychol. 62, 621–647. doi: 10.1146/annurev.psych.093008.131123

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Kutas, M., and Hillyard, S. A. (1980). Reading senseless sentences: brain potentials reflect semantic incongruity. Science 207, 203–205. doi: 10.1126/science.7350657

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Lacey, S., Stilla, R., and Sathian, K. (2012). Metaphorically feeling: comprehending textural metaphors activates somatosensory cortex. Brain Lang. 120, 416–421. doi: 10.1016/j.bandl.2011.12.016

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Lai, V. T., Curran, T., and Menn, L. (2009). Comprehending conventional and novel metaphors: an ERP study. Brain Res. 1284, 145–155. doi: 10.1016/j.brainres.2009.05.088

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Lee, C. L., and Federmeier, K. D. (2008). To watch, to see and to differ: an event-related potential study of concreteness effects as a function of word class and lexical ambiguity. Brain Lang. 104, 145–158. doi: 10.1016/j.bandl.2007.06.002

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Mahon, B. Z., and Caramazza, A. (2008). A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. J. Physiol. Paris 102, 59–70. doi: 10.1016/j.jphysparis.2008.03.004

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Proverbio, A. M., and Riva, F. (2009). RP and N400 ERP components reflect semantic violations in visual processing of human actions. Neurosci. Lett. 459, 142–146. doi: 10.1016/j.neulet.2009.05.012

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nat. Rev. Neurosci. 6, 576–582. doi: 10.1038/nrn1706

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Ritchie, L. D. (2008). X IS A JOURNEY: embodied simulation in metaphor interpretation. Metaphor. Symb. 23, 174–199. doi: 10.1080/10926480802223085

CrossRef Full Text | Google Scholar

Rueschemeyer, S. A., Lindemann, O., van Rooij, D., van Dam, W., and Bekkering, H. (2010). Effects of intentional motor actions on embodied language processing. Exp. Psychol. 57, 260–266. doi: 10.1027/1618-3169/a000031

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Schmidt, G. L., Kranjec, A., Cardillo, E. R., and Chatterjee, A. (2010). Beyond laterality: a critical assessment of research on the neural basis of metaphor. J. Int. Neuropsychol. Soc. 16, 1–5. doi: 10.1017/s1355617709990543

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Schmidt, G. L., and Seger, C. A. (2009). Neural correlates of metaphor processing: the roles of figurativeness, familiarity and difficulty. Brain Cogn. 71, 375–386. doi: 10.1016/j.bandc.2009.06.001

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Slepian, M. L., and Ambady, N. (2014). Simulating sensorimotor metaphors: novel metaphors influence embodied cognition. Cognition 130, 309–314. doi: 10.1016/j.cognition.2013.11.006

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Tzuyin Lai, V., and Curran, T. (2013). ERP evidence for conceptual mappings and comparison processes during the comprehension of conventional and novel metaphors. Brain Lang. 127, 484–496. doi: 10.1016/j.bandl.2013.09.010

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Van Petten, C., and Luka, B. J. (2006). Neural localization of semantic context effects in electromagnetic and hemodynamic studies. Brain Lang. 97, 279–293. doi: 10.1016/j.bandl.2005.11.003

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Wallentin, M., Lund, T. E., Östergaard, S., Östergaard, L., and Roepstorff, A. (2005). Motion verb sentences activate left posterior middle temporal cortex despite static context. Neuroreport 16, 649–652. doi: 10.1097/00001756-200504250-00027

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Wilkowski, B. M., Meier, B. P., Robinson, M. D., Carter, M. S., and Feltman, R. (2009). “Hot-headed” is more than an expression: the embodied representation of anger in terms of heat. Emotion 9, 464–477. doi: 10.1037/a0015764

PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar

Keywords: metaphor, motion, auditory, familiarity, imageability, embodied language, N400, P600

Citation: Schmidt-Snoek GL, Drew AR, Barile EC and Agauas SJ (2015) Auditory and motion metaphors have different scalp distributions: an ERP study. Front. Hum. Neurosci. 9:126. doi: 10.3389/fnhum.2015.00126

Received: 30 June 2014; Accepted: 23 February 2015;
Published online: 13 March 2015.

Edited by:

Seana Coulson, University of California at San Diego, USA

Reviewed by:

Bálint Forgács, Central European University, Hungary
Sabrina Schneider, University of Tuebingen, Germany

Copyright © 2015 Schmidt-Snoek, Drew, Barile and Agauas. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Gwenda L. Schmidt-Snoek, Department of Psychology, Hope College, 35 E 12th St., Holland, MI 49423, USA schmidtg@hope.edu

Present address: Ashley R. Drew, Department of Psychology, Temple University; Elizabeth C. Barile, Department of Chemistry, University of Illinois at Urbana-Champaign; Stephen J. Agauas, Department of Psychology, Central Michigan University

Download