Abstract
The ability to extinguish fear memories when threats are no longer present is critical for adaptive behavior. Fear extinction represents a new learning process that eventually leads to the formation of extinction memories. Understanding the neural basis of fear extinction has considerable clinical significance as deficits in extinction learning are the hallmark of human anxiety disorders. In recent years, the dopamine (DA) system has emerged as one of the key regulators of fear extinction. In this review article, we highlight recent advances that have demonstrated the crucial role DA plays in mediating different phases of fear extinction. Emerging concepts and outstanding questions for future research are also discussed.
Introduction
Learning to associate stimuli and situations with danger or safety is critical for survival and adaptive behavior. In the laboratory, these forms of learning are typically studied using Pavlovian fear conditioning and extinction. Fear conditioning is an example of associative learning in which an initially neutral stimulus such as a tone (conditioned stimulus, CS) comes to elicit fear responses after being paired in time with an aversive outcome such as a foot shock (unconditioned stimulus, US). Once the CS-US association is learned, subsequently repeated presentations of the CS in the absence of the aversive US result in a gradual decrease in conditioned fear responses, a process known as fear extinction. In the last decades, fear extinction has attracted much interest in part because deficits in extinction learning are thought to underlie human anxiety disorders, such as post-traumatic stress disorder (PTSD) and phobias (Graham and Milad, 2011; Pitman et al., 2012; Craske et al., 2017), and thus, understanding the neural basis of fear extinction has high clinical significance. Decades of research has revealed that a distributed network of brain structures including mainly the amygdala and the medial prefrontal cortex (mPFC) mediates the acquisition and consolidation of fear extinction memories (Pape and Pare, 2010; Sotres-Bayon and Quirk, 2010; Maren et al., 2013; Duvarci and Pare, 2014; Tovote et al., 2015).
In recent years, the dopamine (DA) system has also emerged as an important mediator of fear extinction. DA is a neurotransmitter critically involved in a wide range of functions including reward learning, motivation, motor control, and cognitive functioning. DA neurons that are mainly located in the ventral tegmental area (VTA) and substantia nigra (SN) in the midbrain. DA receptors are metabotropic receptors that can be classified into two main types with the DA D1-type receptors (Gs-coupled) comprised of D1 and D5 and the DA D2-type receptors (Gi-coupled) comprised of D2, D3, and D4 subtypes (Missale et al., 1998). Systemic administration of DA precursor L-DOPA or D1-type receptor agonists before or right after extinction enhances acquisition and retention of fear extinction, respectively (Haaker et al., 2013; Abraham et al., 2016; Whittle et al., 2016), indicating the involvement of DA during both acquisition and consolidation of extinction memories. In particular, DA neurons located in the VTA, through their projections to the structures involved in fear extinction such as the amygdala and mPFC, are implicated in fear extinction. In this review, we highlight recent findings that have revealed the role DA plays in mediating different phases of fear extinction. We focus the discussion on the extinction of cued fear conditioning in rodents where recent progress has been made. We begin by discussing how fear extinction learning is initiated and driven by the activity of VTA DA neurons. We also discuss the emerging concept that fear extinction may be an appetitive learning process mediated by the brain’s reward circuitry. We next focus on how DA regulates the acquisition and expression of fear extinction in the amygdala. We consider the possible targets in the amygdala microcircuitry that DA can act on to mediate fear extinction. Finally, we discuss the role of DA in the mPFC in mediating the consolidation of extinction memories.
A Dopamine Prediction Error Signal Initiates Fear Extinction Learning
Considerable evidence indicates that fear extinction represents new learning rather than forgetting or erasure of the original fear memory (Bouton et al., 2006; Myers and Davis, 2007). During extinction, the animal learns the new association between the presence of the CS and an unexpected safe outcome (i.e., the absence of the expected aversive US). Classical theories of associative learning postulate that learning is initiated by prediction errors (PE) that signal the discrepancy between expected and actual outcomes (Rescorla and Wagner, 1972) and new learning happens when outcomes do not match predictions. In fear extinction, the unexpected omission of the US induces a PE signal that leads to an update in the prediction associated with the CS so that it comes to be recognized as signaling safety. This in turn leads to a decay of conditioned fear responses.
Because not receiving an expected aversive US may be experienced as a rewarding event, the prediction error caused by the US omission during extinction (extinction prediction error, EPE) could be conceptualized as an appetitive or reward-like prediction error. Thus, fear extinction may be mediated by the reward learning system (Abraham et al., 2014; Josselyn and Frankland, 2018; Kalisch et al., 2019). It is well established that midbrain DA neurons encode reward prediction error (RPE) signals to drive reward learning (Schultz, 2006). Consistently, recent studies demonstrate that a subset of DA neurons, located in the VTA, is activated by the omission of the aversive US during fear extinction, and this increased DA neuron firing is indeed necessary to initiate fear extinction learning (Luo et al., 2018; Salinas-Hernández et al., 2018). Importantly, the timing of this DA signal fulfills the requirements of a prediction error: (i) it is specific to the time of the US omission; and (ii) it is observed during the early, but not late, trials of extinction learning indicating that it occurs specifically when the US omission is unexpected (Salinas-Hernández et al., 2018). Interestingly, a more recent study has further shown that although DA neurons located in both the medial and the lateral VTA, but not the SN, are activated by the omission of the US, particularly the medial VTA DA neurons encode an EPE signal to drive fear extinction. On the other hand, DA neurons that are found in the lateral VTA signal salience but not EPE (Cai et al., 2020). Together, these studies demonstrate that a PE signal encoded by a subset of DA neurons in the medial VTA is crucial to initiate and drive fear extinction learning (Figure 1A). If the PE encoded during fear extinction is an RPE signal, it is expected that the same DA neurons and DAergic circuits mediate these two signals. In support of this hypothesis, a recent study in fruit flies has shown that fear extinction is driven by the same distinct population of DA neurons that also mediates reward, but not fear, learning (Felsenberg et al., 2018). Whether in mammals the same DA neurons encode extinction and reward PE signals and whether these two distinct signals share similar properties are important questions for future research.
Figure 1
How and through which neural circuits this DA signal initiates extinction learning and ultimately leads to the plasticity underlying formation of extinction memories is currently unknown. The first step in addressing these questions is identifying the projection target of DA neurons that encode the EPE signal. Since DA neurons projecting to the nucleus accumbens (NAc), the main DA output region in the rodent ventral striatum, form the canonical reward circuitry (Wise, 2002), NAc constitutes a good candidate to fulfill this role (Figure 1A). Supporting this, an increase in DA release during fear extinction has been observed in the NAc (Badrinarayan et al., 2012) and the pharmacological blockade of DA receptors in the NAc impairs fear extinction learning (Holtzman-Assif et al., 2010). Furthermore, fear extinction learning in humans is accompanied by a prediction error-like activation in the ventral striatum (Raczka et al., 2011). However, in contrast with these findings, inhibition of DA terminals in NAc at the time of the US omission surprisingly does not affect extinction learning, although it does impair consolidation of extinction memory (Luo et al., 2018). Notably, single-unit recordings demonstrate that a small subpopulation of DA neurons mediate the EPE signal (Salinas-Hernández et al., 2018). It is therefore possible that this subpopulation of DA neurons projects to a specific and restricted subregion of NAc that was not targeted by Luo et al. (2018). In addition to NAc, other possible candidates include DA neurons projecting to the amygdala and/or mPFC. However, at odds with these possibilities, inhibition of DA terminals in the amygdala or mPFC during EPE signaling does not impair extinction learning (Luo et al., 2018). How a DA PE signal initiates extinction learning and leads to the acquisition and consolidation of extinction memories within the fear extinction circuitry is one of the key questions towards understanding the neural basis of fear extinction. Future research determining the exact projection target of EPE encoding DA neurons will be an important step in addressing this question (Figure 1A).
Dopamine in The Amygdala Mediates The Acquisition of Fear Extinction Memories
The amygdala is a key structure underlying the acquisition and expression of fear extinction memories. Specifically, two subregions within the amygdala microcircuitry, the basolateral amygdala (BLA) and the intercalated cell masses (ITCs) are critically involved in fear extinction (Herry et al., 2010; Duvarci and Pare, 2014). Much evidence indicates that the BLA, consisting of the lateral and basal nuclei, is particularly required for the acquisition of extinction memories (Herry et al., 2008; Amano et al., 2011; Sierra-Mercado et al., 2011). A subpopulation of BLA neurons termed “extinction neurons” increases their firing to the CS during fear extinction, specifically late in the extinction session right before the animals show a decrease in conditioned fear responses (Herry et al., 2008; Amano et al., 2011). Furthermore, considerable evidence implicates GABAergic inhibition in the BLA during fear extinction. Both strengthening and also weakening of GABAergic transmission has been shown in the BLA during extinction (Marsicano et al., 2002; Chhatwal et al., 2005; Heldt and Ressler, 2007; Sangha et al., 2009; Kasugai et al., 2019), suggesting that particular subtypes of GABAergic interneurons are likely differentially recruited during extinction (Duvarci and Pare, 2014; Krabbe et al., 2018). However, the involvement of different subtypes of BLA interneurons in extinction has remained elusive. Importantly, GABAergic neurons are critical targets of DA in the amygdala and DAergic signaling has been demonstrated to suppress feedforward inhibition onto principal BLA neurons and facilitate synaptic plasticity in the BLA through activation of both D1 and D2 receptors (Bissière et al., 2003; Marowsky et al., 2005). For more detailed information on how DA regulates activity in the amygdala circuitry, the reader is referred to prior reviews (Abraham et al., 2014; Lee et al., 2017). Pharmacological studies show that blockade of both D1 and D2 receptors in the BLA impairs fear extinction. Notably, DA receptor antagonism in the BLA selectively affects the acquisition, but not consolidation, of fear extinction memories (Hikind and Maroun, 2008; Shi et al., 2017). Whether DA exerts its effects on fear extinction in the BLA through regulation of GABAergic interneurons is a critical question for further research. Furthermore, it will also be important to determine whether and how DA controls the activity of different subtypes of GABAergic interneurons in the BLA during extinction.
While pharmacological studies indicate the important role DA plays in the BLA during fear extinction, exactly how DA modulates extinction-related neuronal activity is not well understood. Research investigating reward learning in the BLA may provide some clues. Indeed, recent studies demonstrate that a genetically distinct and projection-defined subpopulation of BLA neurons mediates reward learning (Namburi et al., 2015; Kim et al., 2016). Intriguingly, supporting the hypothesis that fear extinction is an appetitive learning process, “reward neurons” overlap with “extinction neurons” in the BLA and these two types of neurons are functionally interchangeable (Zhang et al., 2020), suggesting that reward learning and fear extinction are indeed mediated by the same population of neurons in the BLA. Thus, studies investigating the role of DA in BLA during reward learning can provide valuable insights. In keeping with this, a recent study showed that VTA DA terminals in the BLA are activated during reward learning. Specifically, these terminals are activated by rewards and also reward-predicting CSs (Lutas et al., 2019). Whether VTA DA neurons projecting to BLA are also activated by CSs following fear extinction and whether DA input is critical for the CS responsiveness of “extinction neurons” will be key questions to address for future studies (Figure 1B).
As mentioned earlier, the second component of the amygdala microcircuitry crucial for fear extinction is the intercalated cell masses (ITCs), which are a network of interconnected GABAergic cell groups located in the external and intermediate capsules surrounding the BLA. Notably, the ITCs located within the intermediate capsule are comprised of the dorsomedial (dmITCs) and ventromedial (vmITCs) clusters where dmITCs exert a unidirectional inhibitory control over vmITCs (Paré et al., 2003; Ehrlich et al., 2009). Mounting evidence indicates that particularly the vmITCs, located between the BLA and the centromedial nucleus of the amygdala (CeM) are necessary for acquisition and expression of fear extinction memories (Jüngling et al., 2008; Likhtik et al., 2008; Amano et al., 2010; Busti et al., 2011). CeM constitutes the main output station of the amygdala necessary for fear expression (Ciocchi et al., 2010); and hence, vmITCs are indeed in an ideal position to suppress the expression of fear responses during fear extinction. They receive excitatory input from BLA and send inhibitory projections to CeM, and thus mediate feedforward inhibition of CeM (Paré et al., 2003; Mańko et al., 2011; Gregoriou et al., 2019). Anatomical studies show that D1 receptors are abundantly expressed in the ITCs (Jacobsen et al., 2006), suggesting an important role for DA in regulating the activity of these neurons. D1 receptors are typically Gs-coupled receptors and when activated they are expected to function in an excitatory fashion (Missale et al., 1998). Interestingly, D1 receptor signaling is unusual in ITCs, that is, DA through activation of D1 receptors hyperpolarizes ITCs and thus inhibits these neurons (Marowsky et al., 2005; Mańko et al., 2011). Furthermore, a recent study shows that the ITCs within the vmITC cluster are likely connected (Gregoriou et al., 2019; but also see Mańko et al., 2011) and activation of D1 receptors inhibits these local connections suggesting a general reduction in the output of the vmITCs (Gregoriou et al., 2019). Together, these studies indicate that dopamine inhibits the activity of ITCs and hence reduces the output of these neurons. Dopamine is therefore anticipated to reduce vmITC mediated feedforward inhibition of CeM. Because vmITCs are expected to be excited during extinction, whether DA plays a role in regulating the activity of vmITCs to mediate fear extinction is questionable. One plausible scenario is that DA might regulate the activity of vmITCs indirectly by inhibiting dmITCs and thereby disinhibiting vmITCs during extinction. According to this scenario, DA neurons are expected to differentially innervate and modulate these two distinct clusters of ITCs (Figure 1B). It will therefore be important for future studies to investigate whether and how DA input regulates the activity in distinct ITC clusters during fear extinction.
Dopamine in The Medial Prefrontal Cortex Mediates Consolidation of Fear Extinction Memories
The mPFC, in particular the infra-limbic (IL) subregion of mPFC, is crucial for the consolidation of fear extinction memories (Sotres-Bayon and Quirk, 2010). Since dopaminergic signaling enhances signal-to-noise ratios and modulates synaptic plasticity in the mPFC (Seamans and Yang, 2004; Weele et al., 2019), DA is expected to play a vital role in the formation of extinction memories. Consistent with this, DA levels increase in the mPFC during fear extinction and remain elevated following extinction learning (Hugues et al., 2007). Conversely, selective ablation of mPFC-projecting catecholaminergic neurons has been found to impair retention of extinction (Morrow et al., 1999; Fernandez Espejo, 2003). Supporting these earlier findings, pharmacological studies have further revealed the role of prefrontal DA receptors in fear extinction. Administration of a D4 receptor antagonist in the IL following extinction impairs extinction retention the next day (Pfeiffer and Fendt, 2006). In addition, studies investigating the role of D1 and D2 receptors have found that inhibition of both D1 and D2 receptors in the IL during extinction learning impairs retention of extinction while acquisition remains intact (Hikind and Maroun, 2008; Mueller et al., 2010). Together, these findings suggest that activation of both D1- and D2-type receptors are required for consolidation, but not acquisition, of fear extinction memories in the IL.
Long-lasting plastic changes in the activity of IL neurons underlie extinction memories (Sotres-Bayon and Quirk, 2010). However, how different DA receptors contribute to the extinction-related changes in IL neurons is not yet well understood. Studies combining pharmacological manipulations with electrophysiology can provide some clues. Notably, IL neurons exhibit increased firing to the CS during retention of extinction (Milad and Quirk, 2002) and administration of a D2 receptor antagonist in the IL has been shown to attenuate these extinction-related CS responses (Mueller et al., 2010). Furthermore, consolidation of extinction memories requires NMDA receptor-dependent burst firing of IL neurons shortly after extinction learning, that is, during the period when memory consolidation takes place (Burgos-Robles et al., 2007). Since activation of D1 receptors enhances neuronal excitability in the mPFC (Seamans and Yang, 2004), activation of these receptors may play a role in the increased burst firing of IL neurons Investigating the effect of D1 receptor antagonists on the extinction-related activity of IL neurons may define the exact role these receptors play during fear extinction. In the mPFC, D1- and D2-type receptors are expressed in both glutamatergic and GABAergic neurons (Vincent et al., 1993; Gaspar et al., 1995; Benes and Berretta, 2001). An important question is therefore how DA modulates activity in the IL microcircuitry to mediate consolidation of extinction memories. Future studies combining DA receptor pharmacology with cell-type-specific recordings of IL neuronal activity during extinction will be essential to address this question.
In line with findings in rodents, a recent study in humans shows that fMRI activity patterns observed in the vmPFC (the human analog of the IL) during extinction learning are reactivated shortly after extinction during memory consolidation and the number of these reactivations predicts extinction memory strength when tested the next day. Importantly, systemic administration of L-DOPA enhances vmPFC reactivations in parallel to improving extinction memory (Gerlicher et al., 2018) suggesting a critical role of DA in this process. Whether the vmPFC activity pattern reactivations in humans are related to burst firing of IL neurons observed in rodents during the consolidation of extinction memories and whether DA receptor activation in the IL/vmPFC mediates these extinction-related neuronal activity patterns in rodents and humans are open questions for further research.
While the studies summarized above highlight the crucial role DA plays in extinction memories, the source of DA release in the mPFC during fear extinction has not yet been identified. Anatomical studies demonstrate that the mPFC-projecting DA neurons are mainly located in the VTA (Lammel et al., 2008; Beier et al., 2015). Yet, the activity patterns of mPFC-projecting VTA DA neurons during consolidation and retrieval of extinction memories have remained elusive (Figure 1C). Interestingly, recent studies show that mPFC-projecting DA neurons are involved in encoding aversive events (Lammel et al., 2011, 2012; Vander Weele et al., 2018) and optogenetic activation of VTA DA terminals in the mPFC biases behavior toward aversion (Vander Weele et al., 2018). Further supporting the aversive nature of this DA input, optogenetic inhibition of VTA DA terminals in the IL enhances, rather than impairs, fear extinction (Luo et al., 2018). Together, these studies suggest that VTA DA input to mPFC is pro-aversive and therefore is unlikely to play a role in fear extinction. This raises the question of whether fear extinction is mediated by another source of DA input to mPFC. Supporting this idea, recent studies show that noradrenaline (NA) neurons located in the locus coeruleus (LC), in addition to NA, also co-release DA in the mPFC (Devoto et al., 2020). Furthermore, memory consolidation in the hippocampus is regulated by DA released from the LC, but not VTA, neurons (Kempadoo et al., 2016; Takeuchi et al., 2016). Therefore, the source of DA release in mPFC during fear extinction could be LC NA neurons (Figure 1C). Consistent with this possibility, LC projections to mPFC are indeed critical for the consolidation of extinction memories (Uematsu et al., 2017). Identifying the source of DA release in IL during fear extinction is an important outstanding question for further research.
Concluding Remarks
Considerable progress has been made towards understanding the role DA plays in fear extinction. The studies reviewed above provide insights into how DA mediates different phases of extinction through its actions in the distinct components of the neural circuitry underlying fear extinction. The main conclusions and outstanding questions permitted from these studies are summarized in Figure 1. Overall, these findings highlight DA as a key regulator of fear extinction. An important implication of these findings is that enhancing DA signaling during extinction-based exposure therapy can be utilized as a therapeutic strategy in the treatment of anxiety disorders in humans. In line with this, systemic application of L-DOPA following fear extinction enhances extinction memories in humans (Haaker et al., 2013; Gerlicher et al., 2018); however, this enhancement depends on successful extinction learning (Gerlicher et al., 2019) indicating a boundary condition for facilitating the consolidation of extinction memories. Notably, in a genetic mouse strain with deficient extinction, systemic L-DOPA administration before extinction enhances extinction learning and memory (Whittle et al., 2016). Whether pre-extinction administration of L-DOPA can facilitate extinction learning in humans with deficient fear extinction and resistance to exposure therapy will be essential to investigate. Nevertheless, it is important to emphasize that DA is also a crucial mediator of fear learning and memory as well as aversive processing (Abraham et al., 2014; Lee et al., 2017; Likhtik and Johansen, 2019; Weele et al., 2019; Verharen et al., 2020), and hence systemic administration of pharmacological agents that enhance DA signaling globally in the brain can influence aversive processing and the strength of fear memories, as well. Caution is therefore required when systemically enhancing DA signaling. The development of more specific therapeutic approaches in the treatment of anxiety disorders would benefit from a deeper circuit-level understanding of how DA regulates different phases of fear extinction in distinct brain circuits.
Statements
Author contributions
XS-H and SD wrote the manuscript. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by the Deutsche Forschungsgemeinschaft [DFG SFB1193 Grants INST247/852-1 and INST 247/858-1 (subprojects B01 and C02) to SD].
Acknowledgments
We would like to thank Torfi Sigurdsson for helpful discussions and comments on the manuscript.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AbrahamA. D.NeveK. A.LattalK. M. (2014). Dopamine and extinction: a convergence of theory with fear and reward circuitry. Neurobiol. Learn. Mem.108, 65–77. 10.1016/j.nlm.2013.11.007
2
AbrahamA. D.NeveK. A.LattalK. M. (2016). Activation of D1/5 dopamine receptors: a common mechanism for enhancing extinction of fear and reward-seeking behaviors. Neuropsychopharmacology41, 2072–2081. 10.1038/npp.2016.5
3
AmanoT.DuvarciS.PopaD.ParéD. (2011). The fear circuit revisited: contributions of the basal amygdala nuclei to conditioned fear. J. Neurosci.31, 15481–15489. 10.1523/JNEUROSCI.3410-11.2011
4
AmanoT.UnalC. T.ParéD. (2010). Synaptic correlates of fear extinction in the amygdala. Nat. Neurosci.13, 489–494. 10.1038/nn.2499
5
BadrinarayanA.WescottS. A.Vander WeeleC. M.SaundersB. T.CouturierB. E.MarenS.et al. (2012). Aversive stimuli differentially modulate real-time dopamine transmission dynamics within the nucleus accumbens core and shell. J. Neurosci.32, 15779–15790. 10.1523/JNEUROSCI.3557-12.2012
6
BeierK. T.SteinbergE. E.DeLoachK. E.XieS.MiyamichiK.SchwarzL.et al. (2015). Circuit architecture of VTA dopamine neurons revealed by systemic input-output mapping. Cell162, 622–634. 10.1016/j.cell.2015.07.015
7
BenesF. M.BerrettaS. (2001). GABAergic interneurons: implications for understanding schizophrenia and bipolar disorder. Neuropsychopharmacology25, 1–27. 10.1016/S0893-133X(01)00225-1
8
BissièreS.HumeauY.LüthiA. (2003). Dopamine gates LTP induction in lateral amygdala by suppressing feedforward inhibition. Nat. Neurosci.6, 587–592. 10.1038/nn1058
9
BoutonM. E.WestbrookR. F.CorcoranK. A.MarenS. (2006). Contextual and temporal modulation of extinction: behavioral and biological mechanisms. Biol. Psychiatry60, 352–360. 10.1016/j.biopsych.2005.12.015
10
Burgos-RoblesA.Vidal-GonzalezI.SantiniE.QuirkG. J. (2007). Consolidation of fear extinction requires NMDA receptor-dependent bursting in the ventromedial prefrontal cortex. Neuron53, 871–880. 10.1016/j.neuron.2007.02.021
11
BustiD.GeracitanoR.WhittleN.DaleziosY.MankoM.KaufmannW.et al. (2011). Different fear states engage distinct networks within the intercalated cell clusters of the amygdala. J. Neurosci.31, 5131–5144. 10.1523/JNEUROSCI.6100-10.2011
12
CaiL. X.PizanoK.GundersenG. W.HayesC. L.FlemingW. T.HoltS.et al. (2020). Distinct signals in the medial and lateral VTA dopamine neurons modulate fear extinction at different times. eLife9:e54936. 10.7554/eLife.54936
13
ChhatwalJ. P.MyersK. M.ResslerK. J.DavisM. (2005). Regulation of gephyrin and GABAA receptor binding within the amygdala after fear acquisition and extinction. J. Neurosci.25, 502–506. 10.1523/JNEUROSCI.3301-04.2005
14
CiocchiS.HerryC.GrenierF.WolffS. B.LetzkusJ. J.VlachosI.et al. (2010). Encoding of conditioned fear in central amygdala inhibitory circuits. Nature468, 277–282. 10.1038/nature09559
15
CraskeM. G.SteinM. B.EleyT. C.MiladM. R.HolmesA.RapeeR. M.et al. (2017). Anxiety disorders. Nat. Rev. Dis. Primers3:17024. 10.1038/nrdp.2017.24
16
DevotoP.SaghedduC.SantoniM.FloreG.SabaP.PistisM.et al. (2020). Noradrenergic source of dopamine assessed by microdialysis in the medial prefrontal cortex. Front. Pharmacol.11:588160. 10.3389/fphar.2020.588160
17
DuvarciS.PareD. (2014). Amygdala microcircuits controlling learned fear. Neuron82, 966–980. 10.1016/j.neuron.2014.04.042
18
EhrlichI.HumeauY.GrenierF.CiocchiS.HerryC.LüthiA. (2009). Amygdala inhibitory circuits and the control of fear memory. Neuron62, 757–771. 10.1016/j.neuron.2009.05.026
19
FelsenbergJ.JacobP. F.WalkerT.BarnstedtO.Edmondson-StaitA. J.PleijzierM. W.et al. (2018). Integration of parallel opposing memories underlies memory extinction. Cell175, 709.e15–722.e15. 10.1016/j.cell.2018.08.021
20
Fernandez EspejoE. (2003). Prefrontocortical dopamine loss in rats delays long-term extinction of contextual conditioned fear and reduces social interaction without affecting short-term social interaction memory. Neuropsychopharmacology28, 490–498. 10.1038/sj.npp.1300066
21
GasparP.BlochB.Le MoineC. (1995). D1 and D2 receptor gene expression in the rat frontal cortex: cellular localization in different classes of efferent neurons. Eur. J. Neurosci.7, 1050–1063. 10.1111/j.1460-9568.1995.tb01092.x
22
GerlicherA. M. V.TüscherO.KalischR. (2018). Dopamine-dependent prefrontal reactivations explain long-term benefit of fear extinction. Nat. Commun.9:4294. 10.1038/s41467-018-06785-y
23
GerlicherA. M. V.TüscherO.KalischR. (2019). L-DOPA improves extinction memory retrieval after successful fear extinction. Psychopharmacology36, 3401–3412. 10.1007/s00213-019-05301-4
24
GrahamB. M.MiladM. R. (2011). The study of fear extinction: implications for anxiety disorders. Am. J. Psychiatry168, 1255–1265. 10.1176/appi.ajp.2011.11040557
25
GregoriouG. C.KissiwaaS. A.PatelS. D.BagleyE. E. (2019). Dopamine and opioids inhibit synaptic outputs of the main island of the intercalated neurons of the amygdala. Eur. J. Neurosci.50, 2065–2074. 10.1111/ejn.14107
26
HaakerJ.GaburroS.SahA.GartmannN.LonsdorfT. B.MeierK.et al. (2013). Single dose of L-dopa makes extinction memories context-independent and prevents the return of fear. Proc. Natl. Acad. Sci. U S A110, E2428–E2436. 10.1073/pnas.1303061110
27
HeldtS. A.ResslerK. J. (2007). Training-induced changes in the expression of GABAA-associated genes in the amygdala after the acquisition and extinction of pavlovian fear. Eur. J. Neurosci.26, 3631–3644. 10.1111/j.1460-9568.2007.05970.x
28
HerryC.CiocchiS.SennV.DemmouL.MüllerC.LüthiA. (2008). Switching on and off fear by distinct neuronal circuits. Nature454, 600–606. 10.1038/nature07166
29
HerryC.FerragutiF.SingewaldN.LetzkusJ. J.EhrlichI.LüthiA. (2010). Neuronal circuits of fear extinction. Eur. J. Neurosci.31, 599–612. 10.1111/j.1460-9568.2010.07101.x
30
HikindN.MarounM. (2008). Microinfusion of the D1 receptor antagonist, SCH23390 into the IL but not the BLA impairs consolidation of extinction of auditory fear conditioning. Neurobiol. Learn. Mem.90, 217–222. 10.1016/j.nlm.2008.03.003
31
Holtzman-AssifO.LaurentV.WestbrookR. F. (2010). Blockade of dopamine activity in the nucleus accumbens impairs learning extinction of conditioned fear. Learn. Mem.17, 71–75. 10.1101/lm.1668310
32
HuguesS.GarciaR.LénaI. (2007). Time course of extracellular catecholamine and glutamate levels in the rat medial prefrontal cortex during and after extinction of conditioned fear. Synapse61, 933–937. 10.1002/syn.20448
33
JacobsenK. X.HöistadM.StainesW. A.FuxeK. (2006). The distribution of dopamine D1 receptor and mu-opioid receptor 1 receptor immunoreactivities in the amygdala and interstitial nucleus of the posterior limb of the anterior commissure: relationships to tyrosine hydroxylase and opioid peptide terminal systems. Neuroscience141, 2007–2018. 10.1016/j.neuroscience.2006.05.054
34
JosselynS. A.FranklandP. W. (2018). Fear extinction requires reward. Cell175, 639–640. 10.1016/j.cell.2018.09.036
35
JünglingK.SeidenbecherT.SosulinaL.LestingJ.SanghaS.ClarkS. D.et al. (2008). Neuropeptide S-mediated control of fear expression and extinction: role of intercalated GABAergic neurons in the amygdala. Neuron59, 298–310. 10.1016/j.neuron.2008.07.002
36
KalischR.GerlicherA. M. V.DuvarciS. (2019). A dopaminergic basis for fear extinction. Trends Cogn. Sci.23, 274–277. 10.1016/j.tics.2019.01.013
37
KasugaiY.VogelE.HörtnaglH.SchönherrS.ParadisoE.HauschildM.et al. (2019). Structural and functional remodeling of amygdala gabaergic synapses in associative fear learning. Neuron104, 781.e4–794.e4. 10.1016/j.neuron.2019.08.013
38
KempadooK. A.MosharovE. V.ChoiS. J.SulzerD.KandelE. R. (2016). Dopamine release from the locus coerulous to the dorsal hippocampus promotes spatial learning and memory. Proc. Natl. Acad. Sci. U S A113, 14835–14840. 10.1073/pnas.1616515114
39
KimJ.PignatelliM.XuS.ItoharaS.TonegawaS. (2016). Antagonistic positive and negative neurons of the basolateral amygdala. Nat. Neurosci.19, 1636–1646. 10.1038/nn.4414
40
KrabbeS.GründemannJ.LüthiA. (2018). Amygdala inhibitory circuits regulate associative fear conditioning. Biol. Psychiatry83, 800–809. 10.1016/j.biopsych.2017.10.006
41
LammelS.HetzelA.HäckelO.JonesI.LissB.RoeperJ. (2008). Unique properties of mesoprefrontal neurons within a dual mesocorticolimbic dopamine system. Neuron57, 760–773. 10.1016/j.neuron.2008.01.022
42
LammelS.IonD. I.RoeperJ.MalenkaR. C. (2011). Projection-specific modulation of dopamine neuron synapses by aversive and rewarding stimuli. Neuron70, 855–862. 10.1016/j.neuron.2011.03.025
43
LammelS.LimB. K.RanC.HuangK. W.BetleyM. J.TyeK. M.et al. (2012). Input-specific control of reward and aversion in the ventral tegmental area. Nature491, 212–217. 10.1038/nature11527
44
LeeJ. H.LeeS.KimJ.-H. (2017). Amygdala circuits for fear memory: a key role for dopamine regulation. Neuroscientist23, 542–553. 10.1177/1073858416679936
45
LikhtikE.JohansenJ. P. (2019). Neuromodulation in circuits of aversive emotional learning. Nat. Neurosci.22, 1586–1597. 10.1038/s41593-019-0503-3
46
LikhtikE.PopaD.Apergis-SchouteJ.FidacaroG. A.ParéD. (2008). Amygdala intercalated neurons are required for expression of fear extinction. Nature454, 642–645. 10.1038/nature07167
47
LuoR.UematsuA.WeitemierA.AquiliL.KoivumaaJ.McHughT. J.et al. (2018). A dopaminergic switch for fear to safety transitions. Nat. Commun.9:2483. 10.1038/s41467-018-04784-7
48
LutasA.KucukdereliH.AlturkistaniO.CartyC.SugdenA. U.FernandoK.et al. (2019). State-specific gating of salient cues by midbrain dopaminergic input to basal amygdala. Nat. Neurosci.22, 1820–1833. 10.1038/s41593-019-0506-0
49
MańkoM.GeracitanoR.CapognaM. (2011). Functional connectivity of the main intercalated nucleus of the amygdala. J. Physiol.15, 1911–1925. 10.1113/jphysiol.2010.201475
50
MarenS.PhanK. L.LiberzonI. (2013). The contextual brain: implications for fear conditioning, extinction and psychopathology. Nat. Rev. Neurosci.14, 417–428. 10.1038/nrn3492
51
MarowskyA.YanagawaY.ObataK.VogtK. E. (2005). A specialized subclass of interneurons mediates dopaminergic facilitation of amygdala function. Neuron48, 1025–1037. 10.1016/j.neuron.2005.10.029
52
MarsicanoG.WotjakC. T.AzadS. C.BisognoT.RammesG.CascioM. G.et al. (2002). The endogenous cannabinoid system controls extinction of aversive memories. Nature418, 530–534. 10.1038/nature00839
53
MiladM. R.QuirkG. J. (2002). Neurons in medial prefrontal cortex signal memory for fear extinction. Nature420, 70–74. 10.1038/nature01138
54
MissaleC.NashS. R.RobinsonS. W.JaberM.CaronM. G. (1998). Dopamine receptors: from structure to function. Physiol. Rev.78, 189–225. 10.1152/physrev.1998.78.1.189
55
MorrowB. A.ElsworthJ. D.RasmussonA. M.RothR. H. (1999). The role of mesoprefrontal dopamine neurons in the acquisition and expression of conditioned fear in the rat. Neuroscience92, 553–564. 10.1016/s0306-4522(99)00014-7
56
MuellerD.Bravo-RiveraC.QuirkG. J. (2010). Infralimbic D2 receptors are necessary for fear extinction and extinction-related tone responses. Biol. Psychiatry68, 1055–1060. 10.1016/j.biopsych.2010.08.014
57
MyersK. M.DavisM. (2007). Mechanisms of fear extinction. Mol. Psychiatry12, 120–150. 10.1038/sj.mp.4001939
58
NamburiP.BeyelerA.YorozuS.CalhoonG. G.HalbertS. A.WichmannR.et al. (2015). A circuit mechanism for differentiating positive and negative associations. Nature520, 675–678. 10.1038/nature14366
59
PapeH.-C.PareD. (2010). Plastic synaptic networks of the amygdala for the acquisition, expression and extinction of conditioned fear. Physiol. Rev.90, 419–463. 10.1152/physrev.00037.2009
60
ParéD.RoyerS.SmithY.LangE. J. (2003). Contextual inhibitory gating of impulse traffic in the intra-amygdaloid network. Ann. N. Y. Acad. Sci.985, 78–91. 10.1111/j.1749-6632.2003.tb07073.x
61
PfeifferU. J.FendtM. (2006). Prefrontal dopamine D4 receptors are involved in encoding fear extinction. Neuroreport17, 847–850. 10.1097/01.wnr.0000220142.29413.6f
62
PitmanR. K.RasmussonA. M.KoenenK. C.ShinL. M.OrrS. P.GilbertsonM. W.et al. (2012). Biological studies of post-traumatic stress disorder. Nat. Rev. Neurosci.13, 769–787. 10.1038/nrn3339
63
RaczkaK. A.MechiasM.-L.GartmannN.ReifA.DeckertJ.PessiglioneM.et al. (2011). Empirical support for an involvement of the mesostriatal dopamine system in human fear extinction. Transl. Psychiatry1:e12. 10.1038/tp.2011.10
64
RescorlaR. A.WagnerA. R. (1972). “A theory of pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement,” in Classical Conditioning II: Current Research and Theory, eds BlackA. H.ProkasyW. F. (New York, NY: Appleton Century Crofts), 64–99.
65
Salinas-HernándezX. I.VogelP.BetzS.KalischR.SigurdssonT.DuvarciS. (2018). Dopamine neurons drive fear extinction learning by signaling the omission of expected aversive outcomes. eLife7:e38818. 10.7554/eLife.38818
66
SanghaS.NarayananR. T.Bergado-AcostaJ. R.StorkO.SeidenbecherT.PapeH. C. (2009). Deficiency of the 65 kDa isoform of glutamic acid decarboxylase impairs extinction of cued but not contextual fear memory. J. Neurosci.29, 15713–15720. 10.1523/JNEUROSCI.2620-09.2009
67
SchultzW. (2006). Dopamine reward prediction-error signaling: a two component response. Nat. Rev. Neurosci.17, 183–195. 10.1038/nrn.2015.26
68
SeamansJ. K.YangC. R. (2004). The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol.74, 1–58. 10.1016/j.pneurobio.2004.05.006
69
ShiY.-W.FanB.-F.XueL.WenJ.-L.ZhaoH. (2017). Regulation of fear extinction in the basolateral amygdala by dopamine D2 receptors accompanied by altered GluR1, GluR1-Ser845 and NR2B levels. Front. Behav. Neurosci.11:116. 10.3389/fnbeh.2017.00116
70
Sierra-MercadoD.Padilla-CoreanoN.QuirkG. J. (2011). Dissociable roles of prelimbic and infralimbic cortices, ventral hippocampus and basolateral amygdala in the expression and extinction of conditioned fear. Neuropsychopharmacology36, 529–538. 10.1038/npp.2010.184
71
Sotres-BayonF.QuirkG. J. (2010). Prefrontal control of fear: more than just extinction. Curr. Opin. Neurobiol.20, 231–235. 10.1016/j.conb.2010.02.005
72
TakeuchiT.DuszkiewiczA. J.SonnebornA.SpoonerP. A.YamasakiM.WatanabeM.et al. (2016). Locus coeruleus and dopaminergic consolidation of everyday memory. Nature537, 357–362. 10.1038/nature19325
73
TovoteP.FadokJ. P.LüthiA. (2015). Neuronal circuits for fear and anxiety. Nat. Rev. Neurosci.16, 317–331. 10.1038/nrn3945
74
UematsuA.TanB. Z.YcuE. A.CuevasJ. S.KoivumaaJ.JunyentF.et al. (2017). Modular organization of the brainstem noradrenalin system coordinates opposing learning states. Nat. Neurosci.20, 1602–1611. 10.1038/nn.4642
75
Vander WeeleC. M.SicilianoC. A.MatthewsG. A.NamburiP.IzadmehrE. M.EspinelI. C.et al. (2018). Dopamine enhances signal-to-noise ratioin cortical-brainstem encoding of aversive stimuli. Nature563, 397–401. 10.1038/s41586-018-0682-1
76
VerharenJ. P. H.ZhuY.LammelS. (2020). Aversion hot spots in the dopamine system. Curr. Opin. Neurobiol.64, 46–52. 10.1016/j.conb.2020.02.002
77
VincentS. L.KhanY.BenesF. M. (1993). Cellular distribution of dopamine D1 and D2 receptors in rat medial prefrontal cortex. J. Neurosci.13, 2551–2564. 10.1523/JNEUROSCI.13-06-02551.1993
78
WeeleC. M. V.SicilianoC. A.TyeK. M. (2019). Dopamine tunes prefrontal outputs to orchestrate aversive processing. Brain Res.1713, 16–31. 10.1016/j.brainres.2018.11.044
79
WhittleN.MaurerV.MurphyC.RainerJ.BindreitherD.HauschildM.et al. (2016). Enhancing dopaminergic signaling and histone acetylation promotes long-term rescue of deficient fear extinction. Transl. Psychiatry6:e974. 10.1038/tp.2016.231
80
WiseR. A. (2002). Brain reward circuitry: insights from unsensed incentives. Neuron36, 229–240. 10.1016/s0896-6273(02)00965-0
81
ZhangX.KimJ.TonegawaS. (2020). Amygdala reward neurons form and store fear extinction memory. Neuron105, 1077.e7–1093.e7. 10.1016/j.neuron.2019.12.025
Summary
Keywords
dopamine, fear extinction, amygdala, medial prefrontal cortex, nucleus accumbens
Citation
Salinas-Hernández XI and Duvarci S (2021) Dopamine in Fear Extinction. Front. Synaptic Neurosci. 13:635879. doi: 10.3389/fnsyn.2021.635879
Received
30 November 2020
Accepted
09 February 2021
Published
01 March 2021
Volume
13 - 2021
Edited by
Francesco Ferraguti, Innsbruck Medical University, Austria
Reviewed by
Nicolas Singewald, University of Innsbruck, Austria; Ingrid Ehrlich, University of Stuttgart, Germany
Updates
Copyright
© 2021 Salinas-Hernández and Duvarci.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sevil Duvarci duvarci@med.uni-frankfurt.de
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.