Abstract
Objective:
The present study investigated the impact of emotion concepts obtained from external environmental experiences on the perception of facial expressions by manipulating the activation and satiation of emotion words, which was based on the argument between basic emotion theory and constructed emotion theory.
Methods:
Experiment 1 explored the effects of emotion activation on happy, disgusted, emotion-label words and emotion-laden words in a facial expression judgment task through behavioral experimentation. Experiment 2 explored the effect of semantic satiation on emotion-label words and emotion-laden words using the event-related potential technique.
Results:
Experiment 1 found that facial expression perception was influenced by both types of emotion words and showed a significant emotional consistency effect. Experiment 2 found that N170 exhibited a more negative amplitude in the consistent condition compared to the inconsistent condition in the right hemisphere. More importantly, in the later stage of facial expression processing, emotion-label words and emotion-laden words both obstructed the perception of disgusted facial expressions and elicited more negative N400 amplitude in the emotion consistency condition, showing a reversed N400 effect.
Conclusion:
These results suggested that emotion concepts in the form of language influenced the perception of facial expressions, but there were differences between happy and disgusted faces. Disgusted faces were more dependent on emotion concept information and showed different performances in semantic activation and satiation conditions.
Introduction
How do we read the emotions of others when we see their facial muscle movements? According to Ekman's basic emotion theory, the automatic recognition of the six basic emotions—happiness, sadness, anger, fear, disgust, and surprise—involves a specific neural activity that is scarcely modified by other environmental information (, ). More recent studies of emotions suggest that individuals' perceptions of emotions probably develop through experience and are not entirely innate (–). The theory of constructed emotion proposed by Barrett holds that emotion perception relies on the construction of emotion concepts () and that the development of emotion concepts is linked to the individual's acquisition of emotional language. Barrett assumed that there is an internal model based on past experiences and expressed in terms of concepts (). Concepts are the aggregation of specific stimuli that are used to predict the stimuli that will occur in the sensory environment and to initiate the most appropriate behavior. Specifically for emotion perception, the internal model shows that in the process of creating emotion concepts, individuals categorize numerous emotional stimuli from learning and experience and store them in different emotional categories, which are externalized in the form of emotion words expressed in language, such as “happy” and “fearful”. The theory of constructed emotion considers language as an important internal context that can promote, obstruct, or even shape the perception of facial expressions (–). Based on the debate between constructed emotion theory and basic emotion theory, exploring the role of emotion words derived from learning and experience in the perception of facial expressions is important for us to understand the process of emotion perception and the top-down role of emotion concepts expressed in language in the perception of facial expressions.
The relationship between the developing vocabulary and facial emotion perception was reviewed by Widen and Russell (). She suggested that at an early age, children relied on a valence-based positive–negative emotional dichotomy and that it took several years of cultural and language learning before they could categorize facial expressions, especially some complex, mixed expressions, into discrete emotional categories (). Nook et al. found that increasing verbal knowledge mediated the development of emotion representation (). These results indicated that the acquisition of emotion vocabulary knowledge facilitated the development of multidimensional emotion perception in adulthood, beyond the dichotomous valence scaling of childhood to the consideration of other qualities. Recently, studies on the language context effect also found that individuals' emotion perception was influenced by the top-down processing of semantic information and exhibited an emotional consistency effect. When words or sentences with positive or negative emotional meanings were presented with faces as background information, emotionally consistent language context promoted the processing of facial expressions and showed shorter reaction time (RT) and higher accuracy (ACC), while emotionally inconsistent language context hindered facial expression processing (–).
Researchers found that the facial-sensitive N170 component located in the temporo-occipital region showed a larger amplitude when language contexts were inconsistent with facial expressions. These suggested that the early stage of face processing was influenced by language context and showed sensitivity to emotional consistency (, , ). In the later stage of face processing, the N400 component, which is associated with cognitive conflict, had also drawn the attention of researchers. N400 is mainly located in the centroparietal regions and occurs around 400 ms after the stimulus onset. Early researchers believed that N400 is mainly sensitive to semantic inconsistency. For example, a sentence's final word would elicit a more negative N400 amplitude when it did not correspond to the rest of the sentence's meaning (). Because inconsistent scene pictures from the visual channel and inconsistencies in face and identity information could also evoke a more negative N400 component (, ), researchers have found that the N400 may be an index for the processing of meaningful stimuli as well as information integration (). Compared with emotional consistency, the sequential presentation of stimuli with conflicting emotional meanings elicited more negative N400 amplitudes, regardless of whether the target stimuli were faces (, ) or words ().
The existing studies showed that linguistic information played an important role in facial expression processing and affected neurocognitive activity. However, most previous studies had focused on the state of emotional priming induced by emotional semantic activation, while there was still less research on whether and how emotion words obstructed facial expression processing when there was semantic satiation of emotion words, making it difficult to verify the existence of a direct link between emotional semantics of words and facial expression perception.
Individuals who look at or repeatedly read words for extended periods of time may become unable to effectively identify the meaning of words because their ability to extract the meaning of words is temporarily reduced. In the 1960s, researchers detected this phenomenon and named it semantic satiation (). In an event-related potential (ERP) study that explored semantic satiation, Kounios et al. examined the stages of semantic satiation using the N400 component as an index (). Priming words were presented in the visual and auditory channels, respectively, and the participants were required to make semantic judgments about the target words and compare the N400 wave amplitude differences between the relevant and irrelevant word conditions. Semantic satiation occurred after 30 repetitions of the priming words in both visual and auditory channels, resulting in a reduction of the N400 difference wave between the relevant and irrelevant conditions. This study suggested that semantic satiation affected the processing of semantic information and that semantic satiation could occur in different sensory channels. Ströberg et al. further verified that the N400 amplitude decreased under the condition of semantic satiation resulting from 30 times the priming word presentation (). Moreover, by varying the features of the priming words (e.g., font, letter case), they found that the change in N400 amplitude resulted from the satiation of semantic processing rather than the satiation of the structural features of the priming words. Previous studies have shown that the processing of word meaning was obstructed in the semantic satiation condition, resulting in diminished cognitive conflict in the inconsistency condition, thus showing a decreased N400 effect.
It was found that the semantic satiation of emotional words affects the perception of subsequent emotional stimuli (, ). Lindquist et al. explored the relationship between language and emotion perception in three experiments (). In Experiments 1 and 2, facial expression pictures were presented after participants had repeatedly read emotion-label words 3 or 30 times; participants were then required to make emotion consistency judgments of word and face emotion. Participants showed longer RTs after semantic satiation. These experiments suggested that emotional semantic satiation obstructed individuals' judgments of face emotion categories and even caused difficulties in perceiving facial expressions. Experiment 3 explored the effect of semantic satiation of emotion-label words on the ACC of face emotion recognition. The ACC of face emotion categorization decreased in the semantic satiation condition (). Lindquist et al.'s study found that semantic satiation of emotion-label words obstructed individuals' perception of the same type of emotional faces, suggesting that emotional language was involved in the processing of facial expressions even though emotional language was not task-relevant. Furthermore, a study by Gendron et al. found that satiation of emotion-label words disrupted emotion semantic priming, thereby obstructing the perception of facial expressions (). Emotional faces of different intensities were used in their experiments, and after participants repeatedly read emotion-label words 30 times to induce semantic satiation, target faces were briefly presented (50 ms); then, participants were required to select from two pictures of emotional faces of different intensities the picture that best matched the target face (). After eliminating interference from memory, the researchers found that individuals responded more slowly in the consistent satiated word and face emotion consistent condition than in the inconsistent condition (). Combined with previous studies, changes in the semantic accessibility of emotions affect the perceptual processes of facial expressions. These findings provide evidence for the involvement of language in the construction of emotion perception and support the view of the theory of constructed emotion.
The words used in the above studies were emotion-label words, that is, words that indicate a particular emotion type or emotional response (e.g., “sadness” or “smile”). When processing emotion-label words, individuals could directly understand the emotional states expressed by the words and activate the corresponding emotions. In addition to emotion-label words, another category of words with emotional meaning (e.g., “flowers”, “death”) is commonly used in studies, so-called emotion-laden words. When processing emotion-laden words, individuals associated the words with their personal experiences, which activated the corresponding emotional experiences (–). Researchers focused on the semantic activation of emotion-label words and emotion-laden words and found that they both induce priming effect of emotions, but at the same time, there were differences between them (, , ). The priming effects of emotion-label words prompted individuals to recognize subsequent emotional picture stimuli faster than emotion-laden words (, ). The researchers further found that there were similar differences between emotion-label words and emotion-laden words primed by the second language (). In addition, emotional valence (positive and negative) might moderate the priming effects of emotion-label words and emotion-laden words. Compared with negative emotion-laden words, the priming of negative emotion-label words significantly influenced the processing of subsequent emotion picture stimuli, whereas there was no such difference between positive emotion words (, ). For the semantic satiation of emotion-label words and emotion-laden words, the researchers found that the semantic satiation of emotion words resulted in a longer RT in the subsequent emotional judgment task compared with the priming condition. But there were significant differences neither between the two word types nor between positive and negative emotional valence (). They suggested that emotional semantic satiation was strictly conditioned and that valence and word type were not sufficient to observe the semantic satiation effect (). However, in experiments restricted to specific emotion categories (e.g., anger, disgust), researchers found that semantic satiation of emotion-label words affected the perception of subsequently presented facial expressions (, ). According to the theory of constructed emotion, individuals construct emotion concepts by continuously assigning specific stimuli to different emotion categories during learning and experience. As the semantic expressions of specific stimuli, emotional categories of emotion-laden words need to be discriminated with the involvement of experience. Therefore, the influence of semantic satiation of emotion-laden words on facial expression perception also deserves further research.
The basic emotion theory suggests that some of the basic, elementary emotion concepts developed in language, such as “happiness” and “anger,” are derived from the universal biological nature of humans (). However, in a linguistic analysis of 2,474 languages, Jackson et al. found that the meaning of emotion concepts was co-constructed by our variable sociocultural environment and the common functions of emotional states related to physiological homeostasis (). The evolved neurophysiological systems provided a universal structure for the construction of emotions, while individual experiences and cultural environments caused variations in emotion semantics (). Jackson et al.'s findings supported the theory of constructed emotion. However, based on the debate between the theory of constructed emotion and basic emotion theory, previous studies have only manipulated the semantic satiation of emotion-label words, which was still insufficient to answer whether the role of emotion words such as “happy” and “angry” in facial expression processing indicated the involvement of emotion concepts or the role of universal biological principles. Semantic satiation of emotion-label words may only mean that processing is obstructed for specific category names and does not indicate the involvement of emotional concepts from experience and culture. However, previous studies have investigated the role of emotion concepts through behavioral results, while it is still unclear how emotional semantic satiation affects the processing of facial expressions and what role it plays in the early and later facial expression processing stages. Therefore, the neurophysiological activity of emotion concept information in facial expression perception deserves further exploration.
Therefore, our study manipulated the accessibility of emotion concepts through emotion word activation and satiation and used ERPs to investigate potential mechanisms of emotion concepts in the processing of facial expressions. Previous studies have found that the semantic activation of emotion words could affect the perception of facial expressions. Experiment 1 of the present study would further distinguish between emotion-label words and emotion-laden words to explore the effect of their emotion activation on facial expression perception. We hypothesized that if there was processing of emotional semantics in facial expression perception, priming effects of label words and laden words would affect facial expression perception and exhibit a significant consistency effect. In addition, there might be differences in emotional semantic activation between label words and laden words. Compared with laden words, the straightforward activation of emotional states of label words could facilitate the perception of subsequent emotional faces and thus exhibit shorter RTs. In Experiment 2, we examined how the semantic satiation of emotion-label words and emotion-laden words affected the perception of facial expressions. We hypothesized that satiation of label words and laden words would result in satiation of emotion semantics, which obstructed the perception of facial expressions. In terms of behavioral results, this would cause a change in the consistency effect. In terms of ERP components, if this obstruction occurred in the early stage of facial expression perception, the N170 component would exhibit a change between consistency conditions; if this obstruction occurred in the later stage, the N400 component would exhibit a change in consistency conditions, resulting in a reduced N400 effect.
Experiment 1
Experiment 1 would explore the role of the activation of emotional concepts in language on the perception of facial expressions using emotion word priming.
Method
Participants
In total, 55 college students (23 males) were recruited from different majors at Ningbo University through the Internet. The mean age was 20.45 years (SD = 1.31). All participants had normal or corrected-to-normal visual acuity and no color blindness or color weakness and were right-handed. The current study was approved by the Ethics Committee of Ningbo University. All participants provided written informed consent before the experiment in accordance with the Helsinki Declaration. The power analyses showed that for the current sample size, the statistical power of the main results in this study was above 0.7, and the effect size was larger than the medium effect (, ).
Stimuli
Materials for the experiment's facial expressions were chosen from the KDEF (The Karolinska Directed Emotional Faces) collection (). The valence and arousal of six different types of facial expression pictures (happiness, sadness, anger, fear, disgust, surprise, and neutral) were rated on a 9-point scale by 30 college students (12 males and 18 females; Mage = 20.82, SDage = 2.17) who were not involved in the formal experiment. For the valence, “1” is very negative, and “9” is very positive. For arousal, “1” is very low and “9” is very high. Based on the rating results, the main emotion types investigated in this study were happy and disgust, which had the highest and lowest valence scores, respectively. Furthermore, 10 happy faces and 10 disgusted faces with similar arousal scores were selected from the two types of faces, half of each sex. All pictures were converted to grayscale, and the external features like hair and ears were removed from the pictures, keeping only the internal features.
As word materials for the experiment, two-character Chinese emotion-label words and emotion-laden words associated with happiness and disgust were chosen. The valence and arousal of happy and disgusted emotion-label words and emotion-laden words were rated on a 9-point scale by 30 college students (14 males and 16 females; Mage = 21.37, SDage = 1.70) who did not take part in the formal experiment. In total, 32 emotion words were used as the word materials, including eight label words and eight laden words related to happiness (e.g., joyful, flower) and eight label words and eight laden words related to disgust (e.g., dislike, maggot; see the Supplementary material for evaluation details and results).
Task and procedure
To make the sex ratio of the two groups as equal as possible, the participants were semi-randomly assigned to the two groups: specifically, odd-numbered male participants to the labeled word group and even-numbered male participants to the laden word group, and the opposite for females. Each group, the label words group (N = 28, 11 males) or the laden words group (N = 27, 12 males), received only the emotion-label words or emotion-laden words stimulus material. In the facial expression judgment task, the emotion word was presented for 1,000 ms [e.g., presenting “讨厌” (tao yan) in the label words group, which means disgust in English; presenting “鲜花” (xian hua) in the laden words group, which means flower in English], and then, the picture of the face was presented. By pressing buttons (F/J), participants were required to classify the type of facial expression (happy/disgusted) as quickly and accurately as possible (see Figure 1). There were 136 trials in the experiment, including 16 practice trials and 120 formal trials, 30 trials for each experimental condition.
Figure 1
Results
Behavioral performance
For RT and ACC, trials outside the mean RTs ± 2.5 SD and trials with RTs longer than 2,500 ms were deleted. Deleted trials accounted for 3.6% of the total trials. Then, repeated-measures analyses of variance (ANOVAs) of 2 (word types: label words group, laden words group) × 2 (facial expressions: happy face, disgusted face) × 2 (consistency: consistent, inconsistent) were conducted for RT and ACC: word types as between-subject factors, and facial expressions and consistency as within-subject factors.
For the analysis of RT, the main effect of facial expressions was significant [F(1, 53) = 6.06, p = 0.017, η2p = 0.10]; the happy face (M = 671 ms, SE = 19.72) was faster than the disgusted face (M = 682 ms, SE = 20.71). Additionally, there was a significant interaction effect between word types and facial expressions [F(1, 53) = 6.21, p = 0.016, η2p = 0.11]. Further analysis revealed that the happy face was significantly faster than the disgusted face for the label words group (happy face: M = 669 ms, SE = 27.64; disgusted face: M = 691 ms, SE = 29.02, p = 0.001); for the laden words group, there was no significant difference across facial expressions (happy face: M = 673 ms, SE = 28.14; disgusted face: M = 672 ms, SE = 29.55, p = 0.984). The main effect of consistency was also significant [F(1, 53) = 19.48, p < 0.001, η2p = 0.27], indicating that the consistent condition (M = 659 ms, SE = 17.49) was significantly faster than the inconsistent condition (M = 694 ms, SE = 23.11).
For the analysis of ACC, the main effect of facial expressions was significant [F(1, 53) = 7.15, p = 0.01, η2p = 0.12], indicating that the happy face (M = 0.93, SE = 0.01) was more accurately classified than the disgusted face (M = 0.91, SE = 0.01). The main effect of consistency was also significant [F(1, 53) =13.55, p = 0.001, η2p = 0.20], indicating that the consistent condition (M = 0.94, SE = 0.01) was higher than the inconsistent condition (M = 0.90, SE = 0.01). In addition, there was a significant interaction effect between consistency and facial expressions [F(1, 53) = 19.58, p < 0.001, η2p = 0.27]. Further analysis indicated that the consistency condition had a significantly higher ACC than the inconsistent condition for the disgusted face (consistent: M = 0.95, SE = 0.01; inconsistent: M = 0.86, SE = 0.02, p < 0.001), while for the happy face, the difference in ACC between consistent and inconsistent was not significant (consistent: M = 0.93, SE = 0.01; inconsistent: M = 0.93, SE = 0.01, p = 0.819) (see Figure 2).
Figure 2

Participants' reaction time and accuracy in different conditions of the facial expression judgment task. The error line indicates the standard error (SE).
Discussion
Experiment 1 investigated the priming effect of emotion-label words and emotion-laden words on facial expression recognition. The results showed that facial expression recognition was influenced by emotion words. Both the RT and ACC of facial expression recognition showed significant main effects of consistency. This is in line with many previous studies on the language context effect (
Experiment 2
Experiment 2 would further explore the obstructing effect of semantic satiation of emotion words to verify, from another perspective, the role of the emotion concept externalized in language in the perception of facial expressions.
Method
Participants
In total, 45 college students (13 males) were recruited from different majors at Ningbo University through the Internet. The mean age was 20.16 years (SD = 1.08). The requirements for the participants were the same as for Experiment 1. The data of three participants were eliminated because they had more artifacts than 20% of the total number of epochs in the ERP analysis, and the data of the remaining 42 participants were used for statistical analysis. The power analyses showed that for the current sample size, the statistical power of the main results in this study was above 0.8, which was in line with Cohen's regarding the statistical power of psychological study (
Stimuli
The face and word materials used in the experiment were the same as those used in Experiment 1. We additionally recruited 30 participants who did not participate in the formal experiment to rate neutral words (such as steel, train), and then, based on the ratings, chose eight neutral words as filler stimulus materials to be used in the experiment (see the Supplementary material for evaluation details and results).
Task and procedure
Participants were randomly assigned to one of two groups: label words group (N = 22, seven males) or laden words group (N = 23, six males). After the presentation of the “+,” the words were presented 30 times in the center of the screen (in the experiment trials, the same emotion word was repeated 25 times and the neutral word was repeated five times, and the order of presentation of words was pseudo-random: The neutral word was presented only five times within the first 15 times, and the emotion word was repeatedly presented more than 15 times in the remaining times, thus achieving semantic satiation; in the filler trials, the neutral word was repeated 25 times and the emotion-label word was repeated five times, and the order of presentation of words was random). When the word was presented, the participants were required to read it silently and determine whether it had emotional meaning. Then an empty screen was presented, followed by a facial expression type judgment task in which participants were required to make a quick judgment of the expression type (see Figure 3). There were 180 trials in the experiment, including four practice trials, 160 experiment trials, 16 filler trials, and 40 trials for each experimental condition. In the experiments, neutral words and filler trials served to mask the purpose of the experiment and were not included in the data analysis.
Figure 3

Example of a single trial. A fixation point “+” was displayed for 500 ms, followed by 30 times emotion word [in the emotion-label words group, e.g., 讨厌 (tao yan), meaning disgusted in English] or neutral word [e.g., 列车 (lie che), meaning train in English]. When the word was presented, the participants were required to read the word silently and determine whether the word had emotional meaning: if related, no key was pressed, and if not, the space bar was pressed. Then, an empty screen was presented, followed by a face picture. By pressing buttons (F/J), participants had to determine the type of facial expression (happy/disgusted), and the order of buttons was balanced between the participants. After that, start the next trial after a random interval of 600–800 ms. Face reproduced from Lundqvist et al. (
Data recording and ERP analysis
The electroencephalogram (EEG) data were recorded and analyzed using the Neuroscan SynAmps2. A 68 Ag/AgCl electrode cap was used to record EEG data at the scalp position as well as vertical electrooculogram (VEOG) and horizontal electrooculogram (HEOG), with the electrode positioned according to the international 10–20 system. The reference electrode was an external electrode placed on the left ear mastoid. The HEOG recording electrodes were placed at 10 mm on the outer side of the lateral canthi of both eyes, and the VEOG recording electrodes were placed at 10 mm above and below the left eye. The sampling rate was 500 Hz. All electrodes' impedances were kept below 5 kΩ.
The EEGLAB toolbox (
Results
Behavioral performance
Behavioral data were filtered using the same method as in Experiment 1. Deleted trials accounted for 1.3% of the total trials. Repeated-measures ANOVAs of 2 (word types: label words group, laden words group) × 2 (facial expressions: happy face, disgusted face) × 2 (consistency: consistent, inconsistent) were analyzed for RT and ACC. The results showed that the main effects and interactions were not significant in each condition (ps > 0.05; see Figure 4).
Figure 4

Participants' reaction time and accuracy in different conditions of the facial expression judgment task. The error line indicates the standard error (SE).
ERPs
Figure 5 shows the scalp topographies and grand average of N170 elicited by happy and disgusted facial expressions. Figure 6 shows the scalp topographies and grand average N400 effect elicited by happy and disgusted facial expressions.
Figure 5

The grand average N170 elicited by happy and disgusted faces at the ROI (left hemisphere: P7/PO7, right hemisphere: P8/PO8) and the scalp topography of each condition.
Figure 6

The grand average N400 effect elicited by happy and disgusted faces at the ROI (frontocentral: F1/Fz/F2/FC1/FCz/FC2; centroparietal: CP1/CPz/CP2/P1/Pz/P2). The consistent condition minus the inconsistent condition was used to calculate the scalp topographies.
N170 components
The mean amplitude of N170 was analyzed by repeated-measures ANOVAs of 2 (word types: label words group, laden words group) × 2 (facial expressions: happy face, disgusted face) × 2 (consistency: consistent, inconsistent) × 2 (hemispheres: left hemisphere, right hemisphere). The results showed that the main effect of hemispheres was significant [F(1, 40) = 6.83, p = 0.013, η2p = 0.15]. The hemispheres and consistency had a significant interaction effect [F(1, 40) = 5.59, p = 0.023, η2p = 0.12]. Further analysis indicated that the N170 amplitude for the consistent condition was more negative than the inconsistent condition in the right hemisphere (consistent: M = 1.16 μV, SE = 0.80; inconsistent: M = 1.70 μV, SE = 0.73, p = 0.028); while in the left hemisphere, the difference was not significant (consistent: M = 2.91 μV, SE = 0.59; inconsistent: M = 3.07 μV, SE = 0.58, p = 0.40). In addition, there was a significant interaction effect between word types and facial expressions [F(1, 40) = 5.93, p = 0.019, η2p = 0.13], and there was a significant interaction effect between the hemispheres, word types, and facial expressions [F(1, 40) = 13.29, p = 0.001, η2p = 0.25]. Further analysis indicated that for the laden words group, the N170 amplitude of the happy face was more negative than the disgusted face in the right hemisphere (happy face: M = 1.55 μV, SE = 1.02; disgusted face: M = 2.66 μV, SE = 1.09, p < 0.001). The differences between all other conditions were not significant (ps > 0.05).
N400 effect
The mean amplitude of N400 was analyzed by repeated-measures ANOVAs of 2 (word types: label words group, laden words group) × 2 (facial expressions: happy face, disgusted face) × 2 (consistency: consistent, inconsistent) × 2 (ROIs: frontocentral, centroparietal). The results showed that the main effect of ROIs was significant [F(1, 40) = 204.19, p < 0.001, η2p = 0.836]. In addition, there was a significant interaction effect between consistency and facial expressions [F(1, 40) = 5.27, p = 0.027, η2p = 0.12]. More importantly, there was a significant interaction effect between the word types, consistency, ROIs, and facial expressions [F(1, 40) = 7.71, p = 0.008, η2p = 0.16]. Further analysis indicated that for the emotion-label words group, the N400 amplitude of the disgusted faces at the frontocentral region was more negative in the consistent condition than that in the inconsistent condition (consistent: M = −4.43 μV, SE = 1.33; inconsistent: M = −3.14 μV, SE = 1.25, p = 0.049), while for the emotion-laden words group, the N400 amplitude of the disgusted faces at the centroparietal region was more negative in the consistent condition than it was in the inconsistent condition (consistent: M = 4.374 μV, SE = 1.29; inconsistent: M =5.869 μV, SE = 1.09, p = 0.024). For the happy face, there was no significant difference across conditions (p > 0.05).
Discussion
In Experiment 2, we investigated the effect of semantic satiation of emotion words on the perception of facial expressions. In contrast to the emotional activation condition of Experiment 1, Experiment 2 obstructed the corresponding emotional perception by manipulating semantic satiation. In such experimental manipulation, we expected to observe a different or even reversed performance than in Experiment 1 in terms of behavioral results, thus verifying the manipulation effectivity of obstruction. It was found that the consistency effect exhibited in Experiment 1 was not significant in Experiment 2 on both RT and ACC, suggesting that semantic satiation effectively obstructed emotion perception, resulting in a different performance compared to emotion activation. There were also no differences between word types, suggesting that emotion concepts in words (not just emotional category words) were involved in facial expression processing. Unlike Lindquist et al., who found that emotion word satiation led to longer RT in the consistency condition (
In previous experiments of emotion priming, the N170 component amplitude was larger in the inconsistent condition than in the consistent condition (
General discussion
Based on the controversies of basic emotion theory and constructed emotion theory, our study examined the influence of emotion-label words, emotion-laden words activation, and satiation in the perception of facial expressions in order to investigate whether the perception of facial expressions was based on specific neural mechanisms of face structure or was influenced by top-down emotion concepts.
The constructed emotion theory states that emotional concepts derived from learning and experience are involved in facial expression perception. Our results provided evidence for this view. In terms of behavioral data, the present research showed similar results to previous studies on the language context effect (
Emotion words are produced in communication and are influenced by the context of society and culture. It has been found that emotion-label words and emotion-laden words evoke different neural activity in the cerebral cortex (
The present study found that there were relatively stable differences in individuals' perceptions of happy and disgusted emotions. Disgusted face processing was more susceptible to emotion words and exhibited a reversed N400 effect in both emotion-label word and emotion-laden word semantic satiation experiments. In contrast, happy faces showed consistency effects only in the semantic priming experiment, and no significant differences in N400 amplitudes were observed in the semantic satiation experiments. Previous studies exploring the semantic satiation of emotions have ignored the differences in emotion valence, especially the different representations between positive and negative emotions. For example, Lindquist et al. and Gendron et al. only discussed differences in word activation, satiation conditions, and face emotion consistency without separating specific emotion types (
The present study still has some limitations. Through the pre-experiment, we selected the two types of emotional faces with the highest valence scores, and future studies would select more emotion categories, especially negative emotions such as fear, anger, and sadness, to clarify whether there is a stable effect of emotional words in the perception of negative emotions. In addition, emotion-laden words were more dependent on cultural environment and life experiences, and the understanding of the emotional meaning of words might vary among individuals. Although the present study selected word materials through a pre-experiment, future studies still need to pay attention to the issue of individual differences. Finally, sex differences in facial expression perception were also of concern. It has been found that male participants showed a larger happy face facilitation effect of male faces compared to female faces in expression recognition (54). Female participants were found to have an advantage in the recognition of negative emotions, such as fear and anger (55). Moreover, sex differences in facial expression perception were also influenced by other factors (56). Future research needs to further balance the sex ratio of participants and focus on the sex differences in emotion word processing and its impact on facial expression perception.
Conclusion
(1) Emotion concept information influenced the perception of facial expressions, but there were differences between happy and disgusted faces. Disgusted faces were more dependent on emotion concept information and showed different performances in semantic activation and satiation conditions.
(2) Emotion-label words and emotion-laden words both obstructed the perception of disgusted facial expressions after semantic satiation and induced a more negative N400 in the emotion consistency condition, showing a reversed N400 effect.
(3) Facial expressions would be processed with the involvement of emotion concepts in the form of language, which included a broader range of emotional words, including emotion-laden words and not limited to emotion-label words.
Statements
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by Ethics Committee of Ningbo University. The patients/participants provided their written informed consent to participate in this study.
Author contributions
QX: conceptualization. WW: data curation. YY: methodology. WL: writing—original draft. All authors contributed to the article and approved the submitted version.
Funding
This study was supported by the Humanities and Social Sciences Fund of the Ministry of Education of China (Grant No. 18YJC190027).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1192450/full#supplementary-material
References
1.
EkmanP. Facial expression and emotion. Am Psychol. (1993) 48:384–92. 10.1037/0003-066X.48.4.384
2.
EkmanPCordaroD. What is meant by calling emotions basic. Emot Rev. (2011) 3:364–70. 10.1177/1754073911410740
3.
RussellJA. Core affect and the psychological construction of emotion. Psychol Rev. (2003) 770:145–72. 10.1037/0033-295X.110.1.145
4.
WidenSCRussellJA. Children's scripts for social emotions: causes and consequences are more central than are facial expressions. Br J Dev Psychol. (2011) 28:565–81. 10.1348/026151009X457550d
5.
LindquistKA. The role of language in emotion: existing evidence and future directions. Curr Opin Psychol. (2017) 17:135–9. 10.1016/j.copsyc.2017.07.006
6.
BarrettLF. The theory of constructed emotion: an active inference account of interoception and categorization. Soc Cogn Affect Neurosci. (2017) 12:1–23. 10.1093/scan/nsx060
7.
LindquistKAGendronM. What's in a word? Language constructs emotion perception. Emot Rev. (2013) 5:66–71. 10.1177/1754073912451351
8.
GendronMLindquistKABarsalouLBarrettLF. Emotion words shape emotion percepts. Emotion. (2012) 12:314–25. 10.1037/a0026007
9.
NookECLindquistKAZakiJ. A new look at emotion perception: concepts speed and shape facial emotion recognition. Emotion. (2015) 15:569–78. 10.1037/a0039166
10.
WidenSC. Children's Interpretation of facial expressions: the long path from valence-based to specific discrete categories. Emot Rev. (2013) 5:72–7. 10.1177/1754073912451492
11.
NookECSasseSFLambertHKMclaughlinKASomervilleLH. Increasing verbal knowledge mediates development of multidimensional emotion representations. Nat Hum Behav. (2017) 1:881–9. 10.1038/s41562-017-0238-7
12.
LiuSTanQHanSLiWWangXGanYet al. The language context effect in facial expression processing and its mandatory characteristic. Sci Rep. (2019) 9:1045. 10.1038/s41598-019-47075-x
13.
AguadoLDieguez-RiscoTVillalba-GarcíaCHinojosaJA. Double-checking emotions: valence and emotion category in contextual integration of facial expressions of emotion. Biol Psychol. (2019) 146:107723. 10.1016/j.biopsycho.2019.107723
14.
StewartSLKSchepmanAHaighMMchughRStewartAJ. Affective theory of mind inferences contextually influence the recognition of emotional facial expressions. Cogn Emot. (2019) 33:272–87. 10.1080/02699931.2018.1450224
15.
Diéguez-RiscoTAguadoLAlbertJHinojosaJA. Judging emotional congruency: explicit attention to situational context modulates processing of facial expressions of emotion. Biol Psychol. (2015) 9:27–38. 10.1016/j.biopsycho.2015.09.012
16.
LiWXuQLiuSYuLYangYZhangLet al. Emotion concept in perception of facial expressions: effects of emotion-label words and emotion-laden words. Neuropsychologia. (2022) 174:108345. 10.1016/j.neuropsychologia.2022.108345
17.
KutasMHillyardSA. The lateral distribution of event-related potentials during sentence processing. Neuropsychologia. (1982) 20:579–90. 10.1016/0028-3932(82)90031-8
18.
ZhangQLawsonAGuoCJiangY. Electrophysiological correlates of visual affective priming. Brain Res Bull. (2006) 71:316–23. 10.1016/j.brainresbull.2006.09.023
19.
MünteTFBrackMGrootheerOWieringaBMJohannesS. Brain potentials reveal the timing of face identity and expression judgments. Neurosci Res. (1998) 30:25–34. 10.1016/S0168-0102(97)00118-1
20.
KutasMFedermeierKD. Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annu Rev Psychol. (2011) 62:621–47. 10.1146/annurev.psych.093008.131123
21.
HoemannKHartleyLWatanabeALeonESKatsumiYBarrettLFet al. The N400 indexes acquisition of novel emotion concepts via conceptual combination. Psychophysiology. (2021) 58:e13727. 10.1111/psyp.13727
22.
LambertWEJakobovitsLA. Verbal satiation and changes in the intensity of meaning. J Exp Psychol. (1960) 60:376–83. 10.1037/h0045624
23.
KouniosJKotzSAHolcombPJ. On the locus of the semantic satiation effect: evidence from event-related brain potentials. Mem Cogn. (2001) 28:1366–77. 10.3758/BF03211837
24.
StröbergKAndersenLMWiensS. Electrocortical N400 effects of semantic satiation. Front Psychol. (2017) 8:2117. 10.3389/fpsyg.2017.02117
25.
LindquistKABarrettLFBliss-MoreauERussellJA. Language and the perception of emotion. Emotion. (2006) 6:125–38. 10.1037/1528-3542.6.1.125
26.
HildebrandtR. Investigating emotion-label and emotion-laden words in a semantic satiation paradigm (Master thesis). Rochester Institute of Technology, New York, NY, United States (2020).
27.
ZhangJWuCMengYYuanZ. Different neural correlates of emotion-label words and emotion-laden words: an ERP study. Front Hum Neurosci. (2017) 11:455. 10.3389/fnhum.2017.00455
28.
CaoYWangL. Processing of emotional information in written language. Chin Sci Bull. (2018) 63:148–63 (in Chinese). 10.1360/N972017-00701
29.
WuCZhangJ. Emotion word type should be incorporated in affective neurolinguistics: a commentary on Hinojosa, Moreno and Ferré (2019). Lang Cogn Neurosci. (2019) 35:840–3. 10.1080/23273798.2019.1696979
30.
WuCZhangJYuanZ. Affective picture processing is modulated by emotion word type in masked priming paradigm: An event-related potential study. J Cogn Psychol. (2020) 32:287–97. 10.1080/20445911.2020.1745816
31.
WuCZhangJYuanZ. An ERP investigation on the second language and emotion perception: the role of emotion word type. Int J Biling Educ Biling. (2022) 25:539–51. 10.1080/13670050.2019.1703895
32.
PlutchikR. The nature of emotions: human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am Sci. (2001) 89:344–50. 10.1511/2001.28.344
33.
JacksonJCWattsJHenryTRListJMForkelRMuchaPJet al. Emotion semantics show both cultural variation and universal structure. Science. (2019) 366:1517–22. 10.1126/science.aaw8160
34.
CohenJ. Statistical Power Analysis for the Behavioral Sciences. New York, NY: Psychology Press (1988).
35.
CohenJ. A power primer. Psychol Bull. (1992) 112:155–9. 10.1037/0033-2909.112.1.155
36.
LundqvistDFlyktAÖhmanA. The Karolinska Directed Emotional Faces-KDEF (CD ROM). Stockholm: Karolinska Institute, Department of Clinical Neuroscience, Psychology Section (1998).
37.
WieserMJGerdesABMBüngelISchwarzKAMühlbergerAPauliP. Not so harmless anymore: how context impacts the perception and electrocortical processing of neutral faces. NeuroImage. (2014) 92:74–82. 10.1016/j.neuroimage.2014.01.022
38.
DelormeAMakeigS. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. (2004) 134:9–21. 10.1016/j.jneumeth.2003.10.009
39.
LuckSJGaspelinN. How to get statistically significant effects in any ERP experiment (and why you shouldn't). Psychophysiology. (2017) 54:146–57. 10.1111/psyp.12639
40.
VossJLFedermeierKD. FN400 potentials are functionally identical to N400 potentials and reflect semantic processing during recognition testing. Psychophysiology. (2011) 48:532–46. 10.1111/j.1469-8986.2010.01085.x
41.
BridgerEKBaderRKriukovaOUngerKMecklingerA. The FN400 is functionally distinct from the N400. Neuroimage. (2012) 63:1334–42. 10.1016/j.neuroimage.2012.07.047
42.
StrozakPAbedzadehDCurranT. Separating the FN400 and N400 potentials across recognition memory experiments. Brain Res. (2016) 1635:41–60. 10.1016/j.brainres.2016.01.015
43.
LeeTHChoiJSChoYS. Context modulation of facial emotion perception differed by individual difference. PLoS ONE. (2012) 7:e32987. 10.1371/journal.pone.0032987
44.
RigoulotSPellMD. Seeing emotion with your ears: emotional prosody implicitly guides visual attention to faces. PLoS ONE. (2012) 7:e30740. 10.1371/journal.pone.0030740
45.
KrombholzASchaeferFBoucseinW. Modification of N170 by different emotional expression of schematic faces. Biol Psychol. (2007) 76:156–62. 10.1016/j.biopsycho.2007.07.004
46.
LindquistKAWagerT. Kober H, Bliss-Moreau E, Barrett LF. The brain basis of emotion: a meta-analytic review. Behav Brain Sci. (2012) 35:121–43. 10.1017/S0140525X11000446
47.
WangXShangguanCLuJ. Time course of emotion effects during emotion-label and emotion-laden word processing. Neurosci Lett. (2019) 699:1–7. 10.1016/j.neulet.2019.01.028
48.
ZhangJWuCYuanZMengY. Differentiating emotion-label words and emotion-laden words in emotion conflict: an ERP study. Exp Brain Res. (2019) 237:2423–30. 10.1007/s00221-019-05600-4
49.
NeelyJH. The effects of visual and verbal satiation on a lexical decision task. Am J Psychol. (1977) 90:447–59. 10.2307/1421875
50.
SmithLKleinR. Evidence for semantic satiation: repeating a category slows subsequent semantic processing. J Exp Psychol Learn Mem Cogn. (1990) 16:852–61. 10.1037/0278-7393.16.5.852
51.
XuQHeWYeCLuoW. Attentional bias processing mechanism of emotional faces: anger and happiness superiority effects. Acta Physiol Sin. (2020) 71:86–94 (in Chinese). 10.13294/j.aps.2018.0098
52.
ŠvegarDKardumI. Happy face superiority effect in change detection paradigm. Psychol Top. (2013) 22:249–69.
53.
BeckerDVAndersonUSMortensenCRNeufeldSLNeelR. The face in the crowd effect unconfounded: happy faces, not angry faces, are more efficiently detected in single- and multiple-target visual search tasks. J Exp Psychol Gen. (2011) 140:637–59. 10.1037/a0024060
54.
TipplesJ. When men are wonderful: A larger happy face facilitation effect for male (vs. female) faces for male participants. Emotion. (2023). 10.1037/emo0001221. [Epub ahead of print].
55.
RafieeYSchachtA. Sex differences in emotion recognition: Investigating the moderating effects of stimulus features. Cogn Emot. (2023). 10.31234/osf.io/fuqjv. [Epub ahead of print].
56.
BrenerSAFrankenhuisWEYoungESEllisBJ. Social class, sex, and the ability to recognize emotions: the main effect is in the interaction. Pers Soc Psychol Bull. (2023). 10.1177/01461672231159775. [Epub ahead of print].
Summary
Keywords
facial expressions, emotion concept, semantic satiation, emotion-label words, emotion-laden words
Citation
Xu Q, Wang W, Yang Y and Li W (2023) Effects of emotion words activation and satiation on facial expression perception: evidence from behavioral and ERP investigations. Front. Psychiatry 14:1192450. doi: 10.3389/fpsyt.2023.1192450
Received
23 March 2023
Accepted
12 July 2023
Published
31 July 2023
Volume
14 - 2023
Edited by
Gabriela Rosenblau, George Washington University, United States
Reviewed by
Chenggang Wu, Shanghai International Studies University, China; Andres Gonzalez-Garrido, University of Guadalajara, Mexico
Updates

Check for updates
Copyright
© 2023 Xu, Wang, Yang and Li.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Wanyue Li wanyueli@qq.com
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.