Abstract
In our daily lives, we form some impressions of other people. Although those impressions are affected by many factors, face-based affective signals such as facial expression, facial attractiveness, or trustworthiness are important. Previous psychological studies have demonstrated the impact of facial impressions on remembering other people, but little is known about the neural mechanisms underlying this psychological process. The purpose of this article is to review recent functional MRI (fMRI) studies to investigate the effects of face-based affective signals including facial expression, facial attractiveness, and trustworthiness on memory for faces, and to propose a tentative concept for understanding this affective-cognitive interaction. On the basis of the aforementioned research, three brain regions are potentially involved in the processing of face-based affective signals. The first candidate is the amygdala, where activity is generally modulated by both affectively positive and negative signals from faces. Activity in the orbitofrontal cortex (OFC), as the second candidate, increases as a function of perceived positive signals from faces; whereas activity in the insular cortex, as the third candidate, reflects a function of face-based negative signals. In addition, neuroscientific studies have reported that the three regions are functionally connected to the memory-related hippocampal regions. These findings suggest that the effects of face-based affective signals on memory for faces could be modulated by interactions between the regions associated with the processing of face-based affective signals and the hippocampus as a memory-related region.
Introduction
Facial stimuli convey various types of information in human society, and are very important in non-verbal communication with others. For example, when we encounter someone for the first time, we try to read their feelings from their face. The facial information that can provide us with impressions of people includes many factors such as trustworthy, caring, responsible, emotionally stable, sociable, attractive, intelligent, confident, dominant, happy, aggressive threatening, mean, or weird features (Oosterhof and Todorov, ; Todorov and Engell, ; Todorov et al., ), and it is also influenced by racial information (Stanley et al., , ). Among them, three possible factors of facial expression, attractiveness, or trustworthiness are particularly important in forming the impressions of people and in selecting which people should be remembered, because the response times for the attractiveness and trustworthiness judgments were almost identical and faster than the response times for judgments of competence, likeability, and aggressiveness (Willis and Todorov, 2006). However, there is little evidence of the neural mechanisms underlying this psychological process. The aims of this article are to review psychological and cognitive neuroscience studies related to the effects of face-based affective signals on memory for faces, particularly those concerning facial expressions, attractiveness, and trustworthiness, and to propose a tentative framework for understanding the neural mechanisms of memory for faces in the context of human social interaction.
Effects of face-based affective signals on memory for faces: psychological studies
The first main factor of face-based affective signals is facial expression. Previous psychological studies have reported that positive facial expressions such as smiling have a beneficial effect on remembering faces (D'Argembeau et al., ; D'Argembeau and van der Linden, , ; Laroi et al., ; Shimamura et al., ; Ebner and Johnson, ). For example, Shimamura and his colleagues found that faces encoded with smiling expressions were remembered more accurately than those with other expressions, including surprise, anger, or fear (Shimamura et al., ). However, there is also evidence from psychological studies that positive facial expressions have no selective advantage on memory for faces. One study showed better remembering of faces with fearful expressions than of those with happy expressions (Righi et al., ), whereas another study reported memory enhancement for faces with positive and negative expressions, compared to those with neutral expressions (Foa et al., ). Taken together, both positive and negative facial expressions could contribute to the enhancing effects on memory for faces.
The second main factor of affective signals conveyed from faces is facial attractiveness. The beneficial power of facial attractiveness has been observed in several studies investigating the recognition of other people. For example, adults (Langlois et al., ) as well as infants (Langlois et al., ) show a preference for attractive faces. Also, compared to facially unattractive people, facially attractive people are likely to show enhanced positive behavior in a social way (Langlois et al., ), and to be judged people with better personality by others (Dion et al., ). The positive bias toward attractive faces has been identified in memory for faces, in which attractive faces are better remembered than unattractive faces (Cross et al., ; Marzi and Viggiano, ). However, there is evidence from psychological studies that the distinctiveness in attractive faces is low, and the low distinctiveness of faces has little beneficial effect on memory for faces (Light et al., ). Thus, the effect of facial attractiveness on memory for faces may be advantageous, but the mechanisms underlying it and its efficiency in terms of remembering faces are still controversial.
The third main factor of face-based affective signals enhancing the memory processing of faces is facial trustworthiness. There is evidence from psychological studies that facial untrustworthiness has a beneficial power on memory for faces. For example, one psychological study demonstrated that the recognition of faces with untrustworthy impressions was better than that of faces with neutral or trustworthy impressions (Mealey et al., ). Another psychological study found that the faces of trustworthy-looking people with bad personality traits were remembered more accurately than those of untrustworthy-looking people with bad personality traits (Suzuki and Suga, ). In this study, 58 college students played a debt game, where they learned to discriminate among good, neutral, and bad lenders, who respectively charged no, moderate, and high interest on the debt. Each lender had either a trustworthy- or untrustworthy-looking faces. The findings of better memory for people associated with an untrustworthy impression or bad personality, which depends on the face-based first impression or on the later contextual information of personality, suggest that humans could be equipped with protective mechanisms against people with really bad personality traits (Suzuki and Suga, ).
Roles of the amygdala in the processing of face-based affective signals
The first candidate region associated with the processing of face-based affective signals is the amygdala (Figure 1). Previous functional neuroimaging studies have reported that the amygdala shows significant activations during the processing of face-based negative and positive signals including happy, sad, and fearful expressions (Fusar-Poli et al., ). For example, activity of the amygdala was greater during perceiving high-intensity expressions than low-intensity expressions, and the activity was identified in relation to both positive and negative signals from faces (Winston et al., 2003). This suggests that activity of the amygdala could be modulated by affective intensities of facial expressions. However, there is functional neuroimaging evidence linking amygdala activities to the processing of negative facial expressions (Vuilleumier and Pourtois, 2007). For example, one functional MRI (fMRI) study demonstrated that the amygdala showed greater activity during the processing of negative facial expressions than of neutral facial expressions (Iidaka et al., ). Amygdala responses selective to negative facial expressions have been observed in other functional neuroimaging and lesion studies (Adolphs et al., ; Morris et al., ; Broks et al., ). The amygdala, in which the activity is modulated by affective intensities of facial expressions, could be involved in the processing of both positive and negative facial expressions, but the involvement could be biased toward more negative expressions. However, given that a meta-analysis study showed no effect of angry and disgusted expressions on amygdala activations (Fusar-Poli et al., ), further investigations would be required to clarify whether the amygdala activations are modulated only by specific types of facial expressions, rather than affective intensities of facial expressions.
Figure 1
The contribution of the amygdala to the processing of facial attractiveness or trustworthiness has also been demonstrated in cognitive neuroscience studies (Bzdok et al., ). Several functional neuroimaging studies have reported greater amygdala activity in the processing of highly attractive and unattractive faces than of middle-ranked attractive faces (Winston et al., 2007; Cloutier et al., ; Liang et al., ). Additionally, there is functional neuroimaging evidence that amygdala activity increased during the processing of both trustworthy and untrustworthy faces, compared to that of neutral faces (Todorov, ). For example, one fMRI study found that the amygdala showed greater responses to highly trustworthy as well as to highly untrustworthy faces than to neutral faces (Said et al., ). The non-linear amygdala responses to face-based affective signals suggest that this region could be involved in sensing the value of social stimuli including both positive and negative affects of faces. However, other functional neuroimaging studies have demonstrated that the amygdala response to faces increased as their perceived untrustworthiness increased (Winston et al., 2002; Engell et al., ; Todorov et al., ), and this amygdala response to untrustworthy faces was supported by a lesion study (Adolphs et al., ). Taken together, amygdala responses to facial attractiveness and trustworthiness could be possibly modulated by both good and bad impressions of the two factors, but the responses could be biased to more negative signals conveyed from faces. However, further studies would be required to clarify whether the amygdala activity is modulated by facial impressions or by affective intensities of presented pictures.
Roles of the orbitofrontal cortex in the processing of face-based affective signals
The second candidate region associated with the processing of face-based affective signals is the medial orbitofrontal cortex (OFC: Figure 2). The involvement of the medial OFC region in the processing of facial expressions has been identified when the facial expression is happy or smiling. For example, activity of the medial OFC region was enhanced in the processing of happy facial expressions, compared to that of facial expressions of disgust (Gorno-Tempini et al., ). The medial OFC responses to happy facial expressions have also been found in other functional neuroimaging studies (O'Doherty et al., ; Minagawa-Kawai et al., ). However, given that a meta-analysis study failed to identify significant activations in the medial OFC region during the processing of happy facial expressions (Fusar-Poli et al., ), it is possible that a greater response of this region to happy facial expressions may be limited in some specific situations, such as the explicit processing of happy facial expressions (Gorno-Tempini et al., ) or the social processing of smiling faces (Minagawa-Kawai et al., ).
Figure 2
Moreover, functional neuroimaging studies have linked the medial OFC regions to the processing of attractive faces as one of the positive affective signals from faces (Aharon et al., ; O'Doherty et al., ; Kranz and Ishai, ; Bray and O'Doherty, ; Ishai, ; Winston et al., 2007; Cloutier et al., ; Liang et al., ; Tsukiura and Cabeza, ,). The roles of this region in the processing of face-based positive signals have also been observed when the personality traits estimated from faces are trustworthy. For example, medial OFC activity reflected an increasing function of trustworthiness for self-resembling faces (Platek et al., ), and of personality traits estimated from sentences describing hypothetical actions (Tsukiura and Cabeza, ). Taken together, activity of the medial OFC region could be modulated by facial attractiveness and positive attributes of personality estimated from faces.
The important role of the medial OFC in the processing of rewards has been demonstrated by cognitive neuroscience studies involving animal and human subjects (Rolls, ; Martin-Soelch et al., ; McClure et al., ; O'Doherty, ). For example, single unit recording studies with non-human primates have shown that the medial OFC contributes to the coding of reward values of stimuli (Rolls et al., ; Critchley and Rolls, ). Likewise, functional neuroimaging studies involving human subjects have reported that activity in the medial OFC region is associated with coding rewards from a variety of sensory modalities, including taste, olfaction, somatosensory, auditory, and vision, as well as more abstract rewards such as money (O'Doherty, ). In addition, one study found greater activity in this region when subjects viewed beautiful paintings than when they viewed ugly paintings, regardless of the category of painting (Kawabata and Zeki, ). Thus, the response bias toward affectively positive signals from faces could be strongly associated with reward-related activity in the medial OFC region. This implication is supported by functional neuroimaging evidence, in which attractive faces increased activations in the medial OFC as well as the nucleus accumbens comprising the putative reward circuit (Cloutier et al., ).
However, several studies have implied that roles in the OFC region may be dissociable between medial and lateral portions of this region. For example, one fMRI study reported that activity in the medial OFC region was positively correlated with an increasing function of facial attractiveness, whereas the lateral OFC region showed a reverse pattern of activity (O'Doherty et al., ). Another fMRI study, which investigated activations associated with the onset or offset of emotional expressions, demonstrated that the medial OFC region showed greater activity during the processing of positive expressions (offset of angry expression), and that activity in the lateral OFC region reflected both conditions of negative (onset of angry expression and offset of happy expression) and positive expressions (offset of angry expression) (Muhlberger et al., ). These findings suggest that roles of the lateral OFC in the processing of face-based affective signals may be different from those of the medial OFC, but the precise roles in the lateral OFC region are still controversial.
Roles of the insular cortex in the processing of face-based affective signals
The third candidate region associated with the processing of face-based affective signals is the insular cortex (Figure 3). Cognitive neuroscience studies have reported that the insular cortex is involved in the processing of affectively negative facial expressions, in particular expressions of disgust (Phillips et al., , ; Sprengelmeyer et al., ; Sambataro et al., ). Additionally, insular activations during the processing of negative facial expressions have been identified in association with expressions of pain (Botvinick et al., ), or with the offset of happy expressions and the onset of angry expressions (Muhlberger et al., ). There is also functional neuroimaging evidence that the insula shows greater activity during the processing of unattractive faces than during that of attractive faces (O'Doherty et al., ; Krendl et al., ; Tsukiura and Cabeza, ), and during the processing of untrustworthy faces than of trustworthy faces (Winston et al., 2002; Krendl et al., ; Tsukiura et al., 2012). Thus, insular activities could be modulated by face-based negative signals, which include both external features, such as negative facial expressions or unattractiveness of faces, and negative personality traits, such as untrustworthiness.
Figure 3
Functional neuroimaging studies have demonstrated that the insular cortex shows increasing activity associated with a variety of negative social situations, including social exclusion (Eisenberger et al., ), unfairness (Sanfey et al., ), and unreciprocated cooperation (Rilling et al., ). The insular activity has also been linked to the processing of pain (Critchley et al., ) and aversive conditioning (Seymour et al., ). These findings suggest that the insular cortex could contribute to an avoidance response away from people with face-based negative signals. The link between insular cortex and avoidance responses is consistent with findings that insular activity is involved in the anticipation of threat (Seymour et al., ), the avoidance of risky options in decision-making tests (Kuhnen and Knutson, ), and individual differences in avoidance learning (Samanez-Larkin et al., ).
Roles of the hippocampus and fusiform gyrus in memory for faces
One of the important regions in memory for face-related information is the hippocampus. Functional neuroimaging studies have reported that the hippocampus as the medial temporal lobe (MTL) memory system is involved in the encoding and retrieval of episodic memory details including contextual information of an event (Davachi, ; Diana et al., ; Eichenbaum et al., ). The importance of this region have also been observed in the encoding and retrieval of face-related memories (Small et al., ; Sperling et al., , ; Paller et al., ; Zeineh et al., 2003; Kirwan and Stark, ; Chua et al., ; Tsukiura et al., 2008, 2011). For example, one fMRI study showed hippocampal activations during the successful retrieval of both face-name associations and face-job title associations, and the hippocampal activations were significantly declined in older adults, compared to young adults (Tsukiura et al., 2011). In addition, hippocampal contributions to face-related memories have been identified in the processing of memory for face-scene associations (Hayes et al., ), or face-face and face-laugh associations (Holdstock et al., ). These findings suggest that the hippocampus could be involved in memory for details of face-related information.
Another important region in face memories is the right fusiform region, in which a region selective to the processing of face information is known as the fusiform face area (FFA; Kanwisher et al., ). Functional neuroimaging studies have reported that both FFA and hippocampal regions show significant activations during the successful encoding or retrieval of facial stimuli (Prince et al., ; Skinner et al., ). One theory of episodic memory consolidation proposes that components forming episodic memories are stored in unimodal or heteromodal association cortices, and that the hippocampus binds these components with event-specific contextual information (Alvarez and Squire, ; Mishkin et al., ; Nadel and Moscovitch, ; Fujii et al., ; Shastri, ; Norman and O'Reilly, ). Taken together, face memories could be successfully encoded or retrieved by the FFA-hippocampal network, in which facial stimuli processed in FFA are bound with the specific contextual information by the hippocampus.
Neural mechanisms underlying the effects of face-based affective signals on memory for faces
The importance of the amygdala, medial OFC, and insula in the processing of face-based affective signals has been identified in cognitive neuroscience studies. These studies have demonstrated that the amygdala contributes to the processing of both positive and negative affective signals from faces, and that medial OFC activity shows biased responses to positively affective signals from faces, whereas insular activity is modulated by negatively affective signals from faces. In addition, recent advances in effective connectivity analysis in functional neuroimaging studies have shown that the effective connectivity between the amygdala and medial OFC contributes to the differentiation of positive and neutral facial expressions from negatively valenced angry, disgust, and fear expressions (Liang et al., ), and that the effective connectivity between the amygdala and insula is associated with the processing of facial expressions of disgust (Tettamanti et al., ). Another fMRI study revealed that activities in the medial OFC region, which is involved in the processing of facial attractiveness and personality goodness, were negatively correlated with activities in the insular cortex, which is involved in the processing of facial unattractiveness and personality badness (Tsukiura and Cabeza, ). These findings suggest that the amygdala-medial OFC-insula network could contribute to forming impressions of people by face-based affective signals. The amygdala could act as a primary system of face-based affective signals by responding to their intensity, and could adjust interacting activities between the medial OFC, which is involved in the processing of positively valenced signals from faces, and insula, which is involved in the processing of negatively valenced signals from faces (Figure 4).
Figure 4
The modulatory effects of face-based affective signals on memory for faces could be mediated by an interaction between affective systems including the amygdala, medial OFC, and insula, and memory system including the hippocampus and FFA (Figure 4). For example, functional neuroimaging studies have reported that both hippocampal and FFA regions show significant activations during the encoding and retrieval of faces (Prince et al., ; Skinner et al., ), and that faces with emotional expressions are remembered more accurately than those with neutral expressions by an effect of the affect-related amygdala (Fenker et al., ) or medial OFC (Tsukiura and Cabeza, ) activities on the memory-related hippocampal activities. The effects of face-based affective signals on memory for faces have also been identified in the processing of attractive faces, better memory for which is modulated by an interaction between activities in the medial OFC and hippocampus (Tsukiura and Cabeza, ). Moreover, an interaction between the insula, which is associated with the processing of untrustworthy impressions, and the hippocampus is important in the enhancement of memory for untrustworthy faces (Tsukiura et al., 2012). These findings suggest that the amygdala, medial OFC, and insula as affective systems could directly or indirectly interact with the hippocampus-FFA network as memory system, and that the functional connection could contribute to the enhancement of memory for faces by face-based affective signals. Given that the interactions between affect-related regions and memory-related regions were identified in encoding (Tsukiura and Cabeza, ; Tsukiura et al., 2012), retrieval (Fenker et al., ), or both (Tsukiura and Cabeza, ), the functional connection could be shared between these processes.
However, the possible interaction between regions as affective systems and memory system in memory for (affective) faces has been identified in memory for other affective stimuli such as affective pictures (LaBar and Cabeza, ; Dolcos et al., 2012). Thus, the model presented here is preliminary or tentative, because evidence whether an interaction between affective- and memory-related regions in our model is applied only to the memory for faces or to the affective memory in general is still scarce. Additional supports by future studies would be needed to clarify the neural mechanisms involved in the modulatory effects of face-based affective signals on memory for faces, and which of these mechanisms are specific to facial stimuli.
Conclusion
This review article outlined the neural mechanisms underlying the effects of facial impressions on memory for faces by discussing previous functional neuroimaging findings. Information related to face-based affective signals consists of several factors such as facial expression, facial attractiveness, and trustworthiness, and is mediated by the amygdala, medial OFC, and insular regions as the affective system. Behaviorally, memory for faces is often enhanced by these kinds of face-based affective signals, and the memory enhancement is explained in terms of the modulatory effects of affect-related regions on the memory-related hippocampal region. In our daily lives, we have some impression of others on the basis of face-based affective signals, and the impression of others is important in deciding whether they should be approached or avoided. These effects of enhancement (approach) and impairment (avoidance) on perceiving people are influential in memory for faces. Face-based affective signals, as well as interpersonal relationship (Cacioppo and Cacioppo, 2012; Powers and Heatherton, 2012), could be important in remembering who should be approached or avoided in the context of social interaction.
Conflict of interest statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Statements
Acknowledgments
This work was supported by the Funding Program for Next Generation World-Leading Researchers (LZ001) from the Cabinet Office, Government of Japan.
Conflict of interest
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AdolphsR.TranelD.DamasioA. R. (1998). The human amygdala in social judgment. Nature393, 470–474. 10.1038/30982
2
AdolphsR.TranelD.DamasioH.DamasioA. (1994). Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala. Nature372, 669–672. 10.1038/372669a0
3
AharonI.EtcoffN.ArielyD.ChabrisC. F.O'ConnorE.BreiterH. C. (2001). Beautiful faces have variable reward value: fMRI and behavioral evidence. Neuron32, 537–551. 10.1016/S0896-6273(01)00491-3
4
AlvarezP.SquireL. R. (1994). Memory consolidation and the medial temporal lobe: a simple network model. Proc. Natl. Acad. Sci. U.S.A. 91, 7041–7045.
5
BotvinickM.JhaA. P.BylsmaL. M.FabianS. A.SolomonP. E.PrkachinK. M. (2005). Viewing facial expressions of pain engages cortical areas involved in the direct experience of pain. Neuroimage25, 312–319. 10.1016/j.neuroimage.2004.11.043
6
BrayS.O'DohertyJ. (2007). Neural coding of reward-prediction error signals during classical conditioning with attractive faces. J. Neurophysiol. 97, 3036–3045. 10.1152/jn.01211.2006
7
BroksP.YoungA. W.MaratosE. J.CoffeyP. J.CalderA. J.IsaacC. L.MayesA. R.HodgesJ. R.MontaldiD.CezayirliE.RobertsN.HadleyD. (1998). Face processing impairments after encephalitis: amygdala damage and recognition of fear. Neuropsychologia36, 59–70. 10.1016/S0028-3932(97)00105-X
8
BzdokD.LangnerR.CaspersS.KurthF.HabelU.ZillesK.LairdA.EickhoffS. B. (2011). ALE meta-analysis on facial judgments of trustworthiness and attractiveness. Brain Struct. Funct. 215, 209–223. 10.1007/s00429-010-0287-4
9
CacioppoS.CacioppoJ. T. (2012). Decoding the invisible forces of social connections. Front. Integr. Neurosci. 6:51. 10.3389/fnint.2012.00051
10
ChuaE. F.SchacterD. L.Rand-GiovannettiE.SperlingR. A. (2007). Evidence for a specific role of the anterior hippocampal region in successful associative encoding. Hippocampus17, 1071–1080. 10.1002/hipo.20340
11
CloutierJ.HeathertonT. F.WhalenP. J.KelleyW. M. (2008). Are attractive people rewarding? Sex differences in the neural substrates of facial attractiveness. J. Cogn. Neurosci. 20, 941–951. 10.1162/jocn.2008.20062
12
CritchleyH. D.ElliottR.MathiasC. J.DolanR. J. (2000). Neural activity relating to generation and representation of galvanic skin conductance responses: a functional magnetic resonance imaging study. J. Neurosci. 20, 3033–3040.
13
CritchleyH. D.RollsE. T. (1996). Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J. Neurophysiol. 75, 1673–1686.
14
CrossJ. F.CrossJ.DalyJ. (1971). Sex, race, age and beauty as factors in recognition of faces. Percept. Psychophys. 10, 393–396.
15
D'ArgembeauA.van der LindenM. (2004). Identity but not expression memory for unfamiliar faces is affected by ageing. Memory12, 644–654. 10.1080/09658210344000198
16
D'ArgembeauA.van der LindenM. (2007). Facial expressions of emotion influence memory for facial identity in an automatic way. Emotion7, 507–515. 10.1037/1528-3542.7.3.507
17
D'ArgembeauA.van der LindenM.ComblainC.EtienneA. M. (2003). The effects of happy and angry expressions on identity and expression memory for unfamiliar faces. Cogn. Emot. 17, 609–622.
18
DavachiL. (2006). Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 16, 693–700. 10.1016/j.conb.2006.10.012
19
DianaR. A.YonelinasA. P.RanganathC. (2007). Imaging recollection and familiarity in the medial temporal lobe: a three-component model. Trends Cogn. Sci. 11, 379–386. 10.1016/j.tics.2007.08.001
20
DionK.BerscheidE.WalsterE. (1972). What is beautiful is good. J. Pers. Soc. Psychol. 24, 285–290.
21
DolcosF.DenkovaE.DolcosS. (2012). Neural correlates of emotional memories: a review of evidence from brain imaging studies. Psychologia. (in press).
22
EbnerN. C.JohnsonM. K. (2009). Young and older emotional faces: are there age group differences in expression identification and memory?Emotion9, 329–339. 10.1037/a0015179
23
EichenbaumH.YonelinasA. P.RanganathC. (2007). The medial temporal lobe and recognition memory. Annu. Rev. Neurosci. 30, 123–152. 10.1002/hipo.20716
24
EisenbergerN. I.LiebermanM. D.WilliamsK. D. (2003). Does rejection hurt? An fMRI study of social exclusion. Science302, 290–292. 10.1126/science.1089134
25
EngellA. D.HaxbyJ. V.TodorovA. (2007). Implicit trustworthiness decisions: automatic coding of face properties in the human amygdala. J. Cogn. Neurosci. 19, 1508–1519. 10.1162/jocn.2007.19.9.1508
26
FenkerD. B.SchottB. H.Richardson-KlavehnA.HeinzeH. J.DuzelE. (2005). Recapitulating emotional context: activity of amygdala, hippocampus and fusiform cortex during recollection and familiarity. Eur. J. Neurosci. 21, 1993–1999. 10.1111/j.1460-9568.2005.04033.x
27
FoaE. B.Gilboa-SchechtmanE.AmirN.FreshmanM. (2000). Memory bias in generalized social phobia: remembering negative emotional expressions. J. Anxiety Disord. 14, 501–519. 10.1016/S0887-6185(00)00036-0
28
FujiiT.MoscovitchM.NadalL. (2000). Memory consolidation, retrograde amnesia, and the temporal lobe, in Handbook of Neuropsychology, 2nd Edn. ed CermakL. S.(Amsterdam: Elsevier), 223–250.
29
Fusar-PoliP.PlacentinoA.CarlettiF.LandiP.AllenP.SurguladzeS.BenedettiF.AbbamonteM.GasparottiR.BaraleF.PerezJ.McGuireP.PolitiP. (2009). Functional atlas of emotional faces processing: a voxel-based meta-analysis of 105 functional magnetic resonance imaging studies. J. Psychiatry Neurosci. 34, 418–432.
30
Gorno-TempiniM. L.PradelliS.SerafiniM.PagnoniG.BaraldiP.PorroC.NicolettiR.UmitaC.NichelliP. (2001). Explicit and incidental facial expression processing: an fMRI study. Neuroimage14, 465–473. 10.1006/nimg.2001.0811
31
HayesS. M.BaenaE.TruongT. K.CabezaR. (2010). Neural mechanisms of context effects on face recognition: automatic binding and context shift decrements. J. Cogn. Neurosci. 22, 2541–2554. 10.1162/jocn.2009.21379
32
HoldstockJ. S.CraneJ.BachorowskiJ. A.MilnerB. (2010). Equivalent activation of the hippocampus by face-face and face-laugh paired associate learning and recognition. Neuropsychologia48, 3757–3771. 10.1016/j.neuropsychologia.2010.08.018
33
IidakaT.OmoriM.MurataT.KosakaH.YonekuraY.OkadaT.SadatoN. (2001). Neural interaction of the amygdala with the prefrontal and temporal cortices in the processing of facial expressions as revealed by fMRI. J. Cogn. Neurosci. 13, 1035–1047. 10.1162/089892901753294338
34
IshaiA. (2007). Sex, beauty and the orbitofrontal cortex. Int. J. Psychophysiol. 63, 181–185. 10.1016/j.ijpsycho.2006.03.010
35
KanwisherN.McDermottJ.ChunM. M. (1997). The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302–4311.
36
KawabataH.ZekiS. (2004). Neural correlates of beauty. J. Neurophysiol. 91, 1699–1705. 10.1152/jn.00696.2003
37
KirwanC. B.StarkC. E. L. (2004). Medial temporal lobe activation during encoding and retrieval of novel face-name pairs. Hippocampus14, 919–930. 10.1002/hipo.20014
38
KranzF.IshaiA. (2006). Face perception is modulated by sexual preference. Curr. Biol. 16, 63–68. 10.1016/j.cub.2005.10.070
39
KrendlA. C.MacraeC. N.KelleyW. M.FugelsangJ. A.HeathertonT. F. (2006). The good, the bad, and the ugly: an fMRI investigation of the functional anatomic correlates of stigma. Soc. Neurosci. 1, 5–15. 10.1080/17470910600670579
40
KuhnenC. M.KnutsonB. (2005). The neural basis of financial risk taking. Neuron47, 763–770. 10.1016/j.neuron.2005.08.008
41
LaBarK. S.CabezaR. (2006). Cognitive neuroscience of emotional memory. Nat. Rev. Neurosci. 7, 54–64. 10.1038/nrn1825
42
LangloisJ. H.KalakanisL.RubensteinA. J.LarsonA.HallamM.SmootM. (2000). Maxims or myths of beauty? A meta-analytic and theoretical review. Psychol. Bull. 126, 390–423.
43
LangloisJ. H.RoggmanL. A.CaseyR. J.RitterJ. M. (1987). Infant preferences for attractive faces: rudiments of a stereotype?Dev. Psychol. 23, 363–369.
44
LaroiF.D'ArgembeauA.van der LindenM. (2006). The effects of angry and happy expressions on recognition memory for unfamiliar faces in delusion-prone individuals. J. Behav. Ther. Exp. Psychiatry37, 271–282. 10.1016/j.jbtep.2005.11.001
45
LiangX.ZebrowitzL. A.AharonI. (2009). Effective connectivity between amygdala and orbitofrontal cortex differentiates the perception of facial expressions. Soc. Neurosci. 4, 185–196. 10.1080/17470910802453105
46
LiangX.ZebrowitzL. A.ZhangY. (2010). Neural activation in the “reward circuit” shows a nonlinear response to facial attractiveness. Soc. Neurosci. 5, 320–334. 10.1080/17470911003619916
47
LightL. L.HollanderS.Kayra-StuartF. (1981). Why attractive people are harder to remember?Pers. Soc. Psychol. Bull. 7, 269–276.
48
Martin-SoelchC.LeendersK. L.ChevalleyA. F.MissimerJ.KunigG.MagyarS.MinoA.SchultzW. (2001). Reward mechanisms in the brain and their role in dependence: evidence from neurophysiological and neuroimaging studies. Brain Res. Brain Res. Rev. 36, 139–149. 10.1016/S0165-0173(01)00089-3
49
MarziT.ViggianoM. P. (2010). When memory meets beauty: insights from event-related potentials. Biol. Psychol. 84, 192–205. 10.1016/j.biopsycho.2010.01.013
50
McClureS. M.YorkM. K.MontagueP. R. (2004). The neural substrates of reward processing in humans: the modern role of fMRI. Neuroscientist10, 260–268. 10.1177/1073858404263526
51
MealeyL.DaoodC.KrageM. (1996). Enhanced memory for faces of cheaters. Ethol. Sociobiol. 17, 119–128.
52
Minagawa-KawaiY.MatsuokaS.DanI.NaoiN.NakamuraK.KojimaS. (2009). Prefrontal activation associated with social attachment: facial-emotion recognition in mothers and infants. Cereb. Cortex19, 284–292. 10.1093/cercor/bhn081
53
MishkinM.SuzukiW. A.GadianD. G.Vargha-KhademF. (1997). Hierarchical organization of cognitive memory. Philos. Trans. R. Soc. Lond. B Biol. Sci. 352, 1461–1467. 10.1098/rstb.1997.0132
54
MorrisJ. S.FrithC. D.PerrettD. I.RowlandD.YoungA. W.CalderA. J.DolanR. J. (1996). A differential neural response in the human amygdala to fearful and happy facial expressions. Nature383, 812–815. 10.1038/383812a0
55
MuhlbergerA.WieserM. J.GerdesA. B.FreyM. C.WeyersP.PauliP. (2011). Stop looking angry and smile, please: start and stop of the very same facial expression differentially activate threat- and reward-related brain networks. Soc. Cogn. Affect. Neurosci. 6, 321–329. 10.1093/scan/nsq039
56
NadelL.MoscovitchM. (1997). Memory consolidation, retrograde amnesia and the hippocampal complex. Curr. Opin. Neurobiol. 7, 217–227. 10.1002/hipo.20607
57
NormanK. A.O'ReillyR. C. (2003). Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. Psychol. Rev. 110, 611–646. 10.1037/0033-295X.110.4.611
58
O'DohertyJ. (2004). Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 14, 769–776. 10.1016/j.conb.2004.10.016
59
O'DohertyJ.WinstonJ.CritchleyH.PerrettD.BurtD. M.DolanR. J. (2003). Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness. Neuropsychologia41, 147–155. 10.1016/S0028-3932(02)00145-8
60
OosterhofN. N.TodorovA. (2008). The functional basis of face evaluation. Proc. Natl. Acad. Sci. U.S.A. 105, 11087–11092. 10.1073/pnas.0805664105
61
PallerK. A.RanganathC.GonsalvesB.LabarK. S.ParrishT. B.GitelmanD. R.MesulamM. M.ReberP. J. (2003). Neural correlates of person recognition. Learn. Mem. 10, 253–260. 10.1101/lm.57403
62
PhillipsM. L.YoungA. W.ScottS. K.CalderA. J.AndrewC.GiampietroV.WilliamsS. C.BullmoreE. T.BrammerM.GrayJ. A. (1998). Neural responses to facial and vocal expressions of fear and disgust. Proc. Biol. Sci. 265, 1809–1817. 10.1098/rspb.1998.0506
63
PhillipsM. L.YoungA. W.SeniorC.BrammerM.AndrewC.CalderA. J.BullmoreE. T.PerrettD. I.RowlandD.WilliamsS. C.GrayJ. A.DavidA. S. (1997). A specific neural substrate for perceiving facial expressions of disgust. Nature389, 495–498. 10.1038/39051
64
PlatekS. M.KrillA. L.WilsonB. (2009). Implicit trustworthiness ratings of self-resembling faces activate brain centers involved in reward. Neuropsychologia47, 289–293. 10.1016/j.neuropsychologia.2008.07.018
65
PowersK. E.HeathertonT. F. (2012). Characterizing socially avoidant and affiliative responses to social exclusion. Front. Integr. Neurosci. 6:46. 10.3389/fnint.2012.00046
66
PrinceS. E.DennisN. A.CabezaR. (2009). Encoding and retrieving faces and places: distinguishing process- and stimulus-specific differences in brain activity. Neuropsychologia47, 2282–2289. 10.1016/j.neuropsychologia.2009.01.021
67
RighiS.MarziT.ToscaniM.BaldassiS.OttonelloS.ViggianoM. P. (2012). Fearful expressions enhance recognition memory: electrophysiological evidence. Acta Psychol. (Amst.)139, 7–18. 10.1016/j.actpsy.2011.09.015
68
RillingJ. K.GoldsmithD. R.GlennA. L.JairamM. R.ElfenbeinH. A.DagenaisJ. E.MurdockC. D.PagnoniG. (2008). The neural correlates of the affective response to unreciprocated cooperation. Neuropsychologia46, 1256–1266. 10.1016/j.neuropsychologia.2007.11.033
69
RollsE. T. (2000). The orbitofrontal cortex and reward. Cereb. Cortex10, 284–294. 10.1093/cercor/10.3.284
70
RollsE. T.SienkiewiczZ. J.YaxleyS. (1989). Hunger modulates the responses to gustatory stimuli of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. Eur. J. Neurosci. 1, 53–60.
71
SaidC. P.BaronS. G.TodorovA. (2009). Nonlinear amygdala response to face trustworthiness: contributions of high and low spatial frequency information. J. Cogn. Neurosci. 21, 519–528. 10.1162/jocn.2009.21041
72
Samanez-LarkinG. R.HollonN. G.CarstensenL. L.KnutsonB. (2008). Individual differences in insular sensitivity during loss anticipation predict avoidance learning. Psychol. Sci. 19, 320–323. 10.1111/j.1467-9280.2008.02087.x
73
SambataroF.DimaltaS.Di GiorgioA.TaurisanoP.BlasiG.ScarabinoT.GiannatempoG.NardiniM.BertolinoA. (2006). Preferential responses in amygdala and insula during presentation of facial contempt and disgust. Eur. J. Neurosci. 24, 2355–2362. 10.1111/j.1460-9568.2006.05120.x
74
SanfeyA. G.RillingJ. K.AronsonJ. A.NystromL. E.CohenJ. D. (2003). The neural basis of economic decision-making in the Ultimatum Game. Science300, 1755–1758. 10.1126/science.1082976
75
SeymourB.O'DohertyJ. P.DayanP.KoltzenburgM.JonesA. K.DolanR. J.FristonK. J.FrackowiakR. S. (2004). Temporal difference models describe higher-order learning in humans. Nature429, 664–667. 10.1038/nature02581
76
SeymourB.SingerT.DolanR. (2007). The neurobiology of punishment. Nat. Rev. Neurosci. 8, 300–311. 10.1038/nrn2119
77
ShastriL. (2002). Episodic memory and cortico-hippocampal interactions. Trends Cogn. Sci. 6, 162–168. 10.1016/S1364-6613(02)01868-5
78
ShimamuraA. P.RossJ. G.BennettH. D. (2006). Memory for facial expressions: the power of a smile. Psychon. Bull. Rev. 13, 217–222.
79
SkinnerE. I.GradyC. L.FernandesM. A. (2010). Reactivation of context-specific brain regions during retrieval. Neuropsychologia48, 156–164. 10.1016/j.neuropsychologia.2009.08.023
80
SmallS. A.NavaA. S.PereraG. M.DelapazR.MayeuxR.SternY. (2001). Circuit mechanisms underlying memory encoding and retrieval in the long axis of the hippocampal formation. Nat. Neurosci. 4, 442–449. 10.1038/86115
81
SperlingR.BatesJ. F.CocchiarellaA. J.SchacterD. L.RosenB. R.AlbertM. S. (2001). Encoding novel face-name associations: a functional MRI study. Hum. Brain Mapp. 14, 129–139. 10.1002/hbm.1047
82
SperlingR.ChuaE.CocchiarellaA.Rand-GiovannettiE.PoldrackR.SchacterD. L.AlbertM. (2003). Putting names to faces: successful encoding of associative memories activates the anterior hippocampal formation. Neuroimage20, 1400–1410. 10.1016/S1053-8119(03)00391-4
83
SprengelmeyerR.RauschM.EyselU. T.PrzuntekH. (1998). Neural structures associated with recognition of facial expressions of basic emotions. Proc. Biol. Sci. 265, 1927–1931. 10.1098/rspb.1998.0522
84
StanleyD. A.Sokol-HessnerP.BanajiM. R.PhelpsE. A. (2011). Implicit race attitudes predict trustworthiness judgments and economic trust decisions. Proc. Natl. Acad. Sci. U.S.A. 108, 7710–7715. 10.1073/pnas.1014345108
85
StanleyD. A.Sokol-HessnerP.FareriD. S.PerinoM. T.DelgadoM. R.BanajiM. R.PhelpsE. A. (2012). Race and reputation: perceived racial group trustworthiness influences the neural correlates of trust decisions. Philos. Trans. R. Soc. Lond. B Biol. Sci. 367, 744–753. 10.1098/rstb.2011.0300
86
SuzukiA.SugaS. (2010). Enhanced memory for the wolf in sheep's clothing: facial trustworthiness modulates face-trait associative memory. Cognition117, 224–229. 10.1016/j.cognition.2010.08.004
87
TettamantiM.RognoniE.CafieroR.CostaT.GalatiD.PeraniD. (2012). Distinct pathways of neural coupling for different basic emotions. Neuroimage59, 1804–1817. 10.1016/j.neuroimage.2011.08.018
88
TodorovA. (2008). Evaluating faces on trustworthiness: an extension of systems for recognition of emotions signaling approach/avoidance behaviors. Ann. N.Y. Acad. Sci. 1124, 208–224. 10.1196/annals.1440.012
89
TodorovA.BaronS. G.OosterhofN. N. (2008a). Evaluating face trustworthiness: a model based approach. Soc. Cogn. Affect. Neurosci. 3, 119–127. 10.1093/scan/nsn009
90
TodorovA.SaidC. P.EngellA. D.OosterhofN. N. (2008b). Understanding evaluation of faces on social dimensions. Trends Cogn. Sci. 12, 455–460. 10.1016/j.tics.2008.10.001
91
TodorovA.EngellA. D. (2008). The role of the amygdala in implicit evaluation of emotionally neutral faces. Soc. Cogn. Affect. Neurosci. 3, 303–312. 10.1093/scan/nsn033
92
TsukiuraT.CabezaR. (2008). Orbitofrontal and hippocampal contributions to memory for face-name associations: the rewarding power of a smile. Neuropsychologia46, 2310–2319. 10.1016/j.neuropsychologia.2008.03.013
93
TsukiuraT.CabezaR. (2011a). Remembering beauty: roles of orbitofrontal and hippocampal regions in successful memory encoding of attractive faces. Neuroimage54, 653–660. 10.1016/j.neuroimage.2010.07.046
94
TsukiuraT.CabezaR. (2011b). Shared brain activity for aesthetic and moral judgments: implications for the Beauty-is-Good stereotype. Soc. Cogn. Affect. Neurosci. 6, 138–148. 10.1093/scan/nsq025
95
TsukiuraT.SekiguchiA.YomogidaY.NakagawaS.ShigemuneY.KambaraT.AkitsukiY.TakiY.KawashimaR. (2011). Effects of aging on hippocampal and anterior temporal activations during successful retrieval of memory for face-name associations. J. Cogn. Neurosci. 23, 200–213. 10.1162/jocn.2010.21476
96
TsukiuraT.ShigemuneY.NouchiR.KambaraT.KawashimaR. (2012). Insular and hippocampal contributions to remembering people with an impression of bad personality. Soc. Cogn. Affect. Neurosci. [Epub ahead of print]. 10.1093/scan/nss025
97
TsukiuraT.SuzukiC.ShigemuneY.Mochizuki-KawaiH. (2008). Differential contributions of the anterior temporal and medial temporal lobe to the retrieval of memory for person identity information. Hum. Brain Mapp. 29, 1343–1354. 10.1002/hbm.20469
98
VuilleumierP.PourtoisG. (2007). Distributed and interactive brain mechanisms during emotion face perception: evidence from functional neuroimaging. Neuropsychologia45, 174–194. 10.1016/j.neuropsychologia.2006.06.003
99
WillisJ.TodorovA. (2006). First impressions: making up your mind after a 100-ms exposure to a face. Psychol. Sci. 17, 592–598. 10.1111/j.1467-9280.2006.01750.x
100
WinstonJ. S.O'DohertyJ.DolanR. J. (2003). Common and distinct neural responses during direct and incidental processing of multiple facial emotions. Neuroimage20, 84–97. 10.1016/S1053-8119(03)00303-3
101
WinstonJ. S.O'DohertyJ.KilnerJ. M.PerrettD. I.DolanR. J. (2007). Brain systems for assessing facial attractiveness. Neuropsychologia45, 195–206. 10.1016/j.neuropsychologia.2006.05.009
102
WinstonJ. S.StrangeB. A.O'DohertyJ.DolanR. J. (2002). Automatic and intentional brain responses during evaluation of trustworthiness of faces. Nat. Neurosci. 5, 277–283. 10.1038/nn816
103
ZeinehM. M.EngelS. A.ThompsonP. M.BookheimerS. Y. (2003). Dynamics of the hippocampus during encoding and retrieval of face-name pairs. Science299, 577–580. 10.1126/science.1077775
Summary
Keywords
fMRI, face, memory, amygdala, orbitofrontal cortex, insula
Citation
Tsukiura T (2012) Neural mechanisms underlying the effects of face-based affective signals on memory for faces: a tentative model. Front. Integr. Neurosci. 6:50. doi: 10.3389/fnint.2012.00050
Received
22 March 2012
Accepted
03 July 2012
Published
24 July 2012
Volume
6 - 2012
Edited by
Florin Dolcos, University of Illinois at Urbana-Champaign, USA
Reviewed by
Ullrich Wagner, Charité - University Medicine Berlin, Germany; Ilona Croy, Technische Universitat, Germany; Ilana Dew, Duke University, USA
Copyright
© 2012 Tsukiura.
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: Takashi Tsukiura, Department of Cognitive and Behavioral Sciences, Graduate School of Human and Environmental Studies, Kyoto University, Yoshida-Nihonmatsu-Cho, Sakyo-ku, Kyoto 606-8501, Japan. e-mail: tsukiura.takashi.6c@kyoto-u.ac.jp
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.