Abstract
Learning from punishment is a powerful means for behavioral adaptation with high relevance for various mechanisms of self-protection. Several studies have explored the contribution of released dopamine (DA) or responses of DA neurons on reward seeking using rewards such as food, water, and sex. Phasic DA signals evoked by rewards or conditioned reward predictors are well documented, as are modulations of these signals by such parameters as reward magnitude, probability, and deviation of actually occurring from expected rewards. Less attention has been paid to DA neuron firing and DA release in response to aversive stimuli, and the prediction and avoidance of punishment. In this review, we first focus on DA changes in response to aversive stimuli as measured by microdialysis and voltammetry followed by the change in electrophysiological signatures by aversive stimuli and fearful events. We subsequently focus on the role of DA and effect of DA manipulations on signaled avoidance learning, which consists of learning the significance of a warning cue through Pavlovian associations and the execution of an instrumental avoidance response. We present a coherent framework utilizing the data on microdialysis, voltammetry, electrophysiological recording, electrical brain stimulation, and behavioral analysis. We end by outlining current gaps in the literature and proposing future directions aimed at incorporating technical and conceptual progress to understand the involvement of reward circuit on punishment based decisions.
Introduction
According to Skinner (1938), events that strengthen or increase the likelihood of preceding responses are called positive reinforcers, and events whose removal strengthens preceding responses are called negative reinforcers. Based on the affective attributes that determine the reinforcing nature of the unconditioned stimulus (US), these can also be classified as appetitive and aversive reinforcers, respectively (Konorski, 1967). Decades of research have documented phasic (short latency and short duration) dopamine (DA) signals evoked by appetitive reward or conditioned reward predictors and the modification of these signals by changes in reward value (e.g., magnitude, probability, and delay) or reward omission (Schultz et al., 1997). However, the DA neuron response to aversive reinforcers as a function of punishment prediction or avoidance has received far less research attention. Here we review convergent findings, obtained utilizing microdialysis, voltammetry, electrophysiological recording, and electrical brain stimulation, indicating that DA not only plays a role in coding aversive stimuli, but also serves essential functions for the formation of behavioral learning strategies aimed at the avoidance of aversive stimuli.
The Dopaminergic System and Aversive Stimuli
The release of DA in the context of aversive stimuli has been extensively studied using microdialysis. For example, after stressful tail-stimulation extracellular DA levels were increased in the dorsal striatum, nucleus accumbens (NAc), and medial prefrontal cortex (PFC), suggesting involvement of nigrostriatal, mesolimbic, and mesocortical DA systems (Abercrombie et al., 1989; Boutelle et al., 1990; Pei et al., 1990). Moreover, regional differences in DA release have been demonstrated within the ventral striatum in response to aversive stimuli. Prolonged administration of footshock increased extracellular DA in the NAc shell but not core (Kalivas and Duffy, 1995). Furthermore, presentation of sensory stimuli preconditioned with footshock elevated DA levels in NAc (Young et al., 1993). Pretreatment with footshock over several days decreased cocaine-induced DA elevation in mPFC but increased DA in the NAc (Sorg and Kalivas, 1991, 1993; Ungless et al., 2010). In some studies, the DA response to aversive stimuli declined with repeated stress exposure (Imperato et al., 1992). Across studies, different experimental procedures (seconds vs. minutes; 1 min sampling period vs. 10 min sampling period; brief, novel aversive stimuli vs. repeated, chronic aversive stimuli) have made it difficult to draw coherent conclusions.
While microdialysis is useful for directly measuring the localized concentration of DA within a brain region, its temporal sensitivity is limited, usually reflecting more tonic fluctuations in DA release averaged across intervals of 2–10 min. Fast scan cyclic voltammetry (FSCV), on the other hand, is an indirect measure of DA release interpreted from the electrical currents associated with the oxidation and reduction of DA but has high temporal resolution (on the order of 200 ms), which is capable of detecting phasic DA signals associated with a single learning trial. A recent study clarified the role of DA for processing appetitive and aversive reinforcers by measuring the phasic DA signal every 100 ms using FSCV in response to opposite hedonic taste stimuli (rewarding sucrose vs. aversive quinine). A strong DA increase in response to sucrose and DA decrease in response to quinine was found in the NAc and dorsolateral bed nucleus of the stria terminalis, suggesting suppression of DA in these two regions in response to aversive taste stimuli (Roitman et al., 2008; Park et al., 2012). However, a 3 s tail pinch with a soft rubber glove led to different results. A phasic DA increase was time-locked to the tail pinch in the dorsal striatum and NAc core, while an increase in the NAc shell was evident once the tail pinch was removed (Budygin et al., 2012). This suggests that the delivery and removal of aversive stimuli may trigger different DA responses in different projection regions. In addition to phasic DA transients in the NAc core time-locked to aversive physical stimuli, spontaneous DA transients have also been reported in response to aversive social confrontations, such as facing an aggressive resident followed by social defeat (Anstrom et al., 2009). The difference in phasic DA transients in the NAc shell and core in response to aversive events is consistent with a specific motivational role executed by different DA pathways (Salamone, 1994; Ikemoto and Panksepp, 1999; Salamone and Correa, 2002; Ikemoto, 2007).
On the level of single neuron activity, aversive stimuli have often been reported to inhibit phasic DA neuron firing in several species (Mirenowicz and Schultz, 1996; Schultz et al., 1997; See Table 1). However, some studies also reported increased phasic firing in response to an aversive conditioned stimulus (CS; e.g., Guarraci and Kapp, 1999). To gain further insights into such discrepant results, recent studies combined extracellular recording and unit identification by juxtacellular neurobiotin labeling (Ungless et al., 2004; Brischoux et al., 2009; Mileykovskiy and Morales, 2011). In response to aversive footshock, DA neurons from different components of the VTA (the dorsal parabrachial pigmented nucleus and the ventral paranigral nucleus) showed opposite modulation of firing, i.e., a reduction and an increase, respectively (Ungless et al., 2004; Brischoux et al., 2009). Valenti et al. (2011) further demonstrated that a single footshock inhibited most of the recorded DA neurons, but repeated footshock evoked different responses on DA neuronal population activity along the mediolateral direction, with predominant excitation on the medial side. Also, DA neurons which were inhibited by the CS signaling the arrival of aversive airpuff were located more medially in VTA and substantia nigra pars compacta (SNc) medial part as opposed to the lateral SNc DA neurons which were predominantly excited (Matsumoto and Hikosaka, 2009).
Table 1
| Citation | Methodological details | Aversive stimuli (US) or Aversive conditioned stimuli (CS) | Regions recorded | % Neuron response to aversive stimuli | % Neuron response to offset of aversive stimuli | Notes |
|---|---|---|---|---|---|---|
| Brown et al. (2009) | Extracellular recording in urethane anesthetized rats | Pinches of 15 s duration to the hindpaw | SNc | 18% inhibition to aversive stimuli | Other recorded neurons did not respond to either pinch or electrical shock | |
| Footshocks (0.5 Hz and 2 ms duration) at 5 mA intensity were delivered for 100 trials to the hind paw | 20% inhibition to aversive stimuli | |||||
| Brischoux et al. (2009) | Extracellular recording and juxtacellular labeling in urethane anesthetized rats | Footshocks (20 Hz, 5 mA) and 4 s trains | VTA: dorsal parabrachial nucleus | 55% of labeled were inhibited | Others did not respond to shock | |
| VTA: ventral paranigral nucleus | Labeled DA neurons excited by footshock was reported | |||||
| Cohen et al. (2012) | Extracellular recording (Tetrode) in DAT-Cre mice identification using optical stimulation of channelrhodopsin | Air puff to the face | VTA | All optogenetically identified DA neurons were inhibited for the aversive stimuli | <50% of optogenetically identified DA neurons were excited by reward predicting CS | |
| Coizet et al. (2006) | Extracellular recording in urethane anesthetized rats | Footshock (0.5 Hz and 2 ms duration) at 5 mA intensity were delivered for 60 trials | SNc | 72% inhibited | ||
| 12% excited | ||||||
| Coizet et al. (2010) | Extracellular recording in urethane anesthetized rats | Footshock (0.5 Hz and 2 ms duration) at 5 mA intensity were delivered for 100 trials | Dorsal SNc | <80% showed inhibition of firing | Inactivation of parabrachial nucleus abolished the nociceptive responses | |
| Gao et al. (1990) | Extracellular recording in chloral hydrate anesthetized rats | Peripheral nociceptive stimulation (shock to the tail) of 1 ms and 15–20 mA | SNc | 78% inhibited | Stimulation of LHb increased the inhibitory responses | |
| 15% excited | ||||||
| Gao et al. (1996) | Extracellular recording in chloral hydrate anesthetized rats | Peripheral nociceptive stimulation (shock to the tail) of 1 ms and 15–20 mA | SNc | <90% inhibited | LHb neurons showed opposite patterns | |
| Mantz et al. (1989) | Extracellular recording and antidromic identification in ketamine anesthetized rats | Tail pinch for 10 s using forceps | Ventromedial mesencephalic tegmentum | mPFC projecting neurons: 65% excited and 25% inhibited | ||
| NAc projecting neurons: 4% inhibited | ||||||
| Matsumoto and Hikosaka (2009) | Extracellular recording in behaving monkeys | Airpuff to the face | SNc and VTA | US 45% inhibited 10.6% excited 43.6% no response CS 23% inhibited 36.8 excited 39.8% no response | Similar responses for reward omission All, aversive CS inhibited neurons were excited for the reward conditioned CS Medial VTA and medial SNc neurons are predominantly inhibited by CS predicting air puff | |
| Mirenowicz and Schultz (1996) | Extracellular recording in behaving monkeys | CS predicting air puff to the hand | SNc, VTA, and retrorubral field | 31% inhibited <14% excited | <70% excited by the CS predicting juice reward | |
| Mileykovskiy and Morales (2011) | Extracellular recording and juxtacellular labeling in awake rats | Fear conditioning: tone paired with tail shock (0.5–1.2 mA, 60 Hz, 1 s) | VTA | In fear conditioned rats | Correlations between inhibitory response and rats which discriminates the fear CS | |
| Type 1 (60%): inhibited for onset of CS+ | ||||||
| Type 2 (20%): inhibited for onset and offset of CS+ | ||||||
| Type 3 (20%): biphasic excitatory or inhibitory responses followed by inhibitory pause | ||||||
| Tsai et al. (1980) | Extracellular recording in urethane anesthetized rats | Single shock stimulation to sciatic nerve (square pulse of 4–10 V intensity and 0.3 ms duration | SNc | <85% inhibited 6% excited Prolonged duration of inhibition | Rebound excitation Rebound excitation | |
| Repeated footshocks (10–50 Hz) | ||||||
| Ungless et al. (2004) | Extracellular recording and juxtacellular labeling in urethane anesthetized rats | VTA | 83% are inhibited Others are non-responsive | |||
| Wang and Tsien (2011) | Extracellular recording (Tetrode) in behaving mice | 20 trials of fearful events (Free fall from 10 to 30 cm height and shake from 0.2–1 s) with 1–2 min inter-trial interval | VTA | Type 1 (59%): Suppression of firing in response to both events | Type 1:offset-rebound excitation | 96% of the type 1 and type 2 DA neurons excited by the CS signaling reward |
| Type 2 (13%): Suppression of firing in response to both events | No effect |
Effect of aversive stimuli on mid brain DA neurons.
Mileykovskiy and Morales (2011) studied the response of VTA DA neurons to a CS paired with a tail shock US. Three types of responses from DA neurons were observed during the presentation of the aversive CS, some of which featured biphasic inhibition and excitation. But all of the response types featured an inhibitory pause in firing, the duration of which was correlated with the expression of fear.
Furthermore, inhibition of DA neuron (59%) firing evoked by fearful events such as free fall and shake was followed by offset-rebound excitation (phasic burst firing) upon their termination. Interestingly, the same DA neurons also displayed a reward prediction signal (modulated firing in response to a stimulus that is associated with later occurrence of a reward) when conditioned later with sugar pellet (Wang and Tsien, 2011). From the available evidence including recent optogenetic insights, our understanding of DA neuron response to appetitive and aversive stimuli has broadened. The vast majority of DA neurons appear excited by appetitive rewards and their predictors, and inhibited by aversive punishments and their predictors, as well as by reward omission (Tobler et al., 2003; Mileykovskiy and Morales, 2011; Wang and Tsien, 2011; Cohen et al., 2012).
Dopamine and Avoidance Learning
Avoidance learning is the process by which an individual learns a behavioral response to avoid aversive stimuli. An important feature of avoidance learning is that it is governed by negative reinforcement; that is, the absence of a stimulus motivates behavioral change. The mechanism for exactly how the absence of something can come to serve as a reinforcer has been a puzzle for learning theorists and the focus of much behavioral research. A popular theory accounting for this phenomenon is the two-process theory of avoidance (Dinsmoor, 2001), which states that an animal first learns a Pavlovian association that a CS, such as a tone, will be followed by an aversive US, such as a shock. This Pavlovian association then becomes the basis for operant learning, in that the CS becomes aversive in its own right and thus capable of motivating an operant response. The two-process theory proposes that the CS triggers a state of fear, which the animal then acts to reduce. Thus, fear reduction becomes the ultimate mechanism for negative reinforcement learning. However, here we outline evidence for an alternative mechanism: namely, the formation of an expectation of CS-US contingency is indeed a critical prerequisite, but the violation of aversive expectation when the animal performs the correct avoidance response directly activates the DA reward system. Thus, the ultimate mechanism for negative reinforcement learning is isomorphic with that of positive reinforcement learning, and it is dopaminergic.
Numerous studies have found specific effects of DA manipulations on avoidance learning. Beninger et al. (1989) found that low doses of DA antagonists impaired active avoidance responses without affecting motor behavior. Depletion of DA by 6-hydroxydopamine (6-OHDA) in the SNc (Cooper et al., 1973; Jackson et al., 1977; Salamone, 1994), NAc (McCullough et al., 1993), or PFC (Sokolowski et al., 1994) impaired the development and maintenance of active avoidance strategies, usually without affecting motor responses, including escape responses. Active avoidance behavior was also disrupted by alpha-methyl-p-tyrosine injections in NAc and rescued by DA injections (Bracs et al., 1982). The D2 antagonist sulpiride inhibited avoidance learning when injected into NAc, but not when injected into PFC, amygdala, or caudate putamen (Wadenberg et al., 1990). However, other studies found that D2 antagonist injections into NAc did not impair acquisition but did reduce conditioned responding during subsequent tests, whereas D1 antagonist injections into NAc impaired conditioned responding during both acquisition and subsequent testing (Boschen et al., 2011; Wietzikoski et al., 2012).
While it seems clear from these studies that some dopaminergic target regions play a DA-dependent role in avoidance learning, it is not yet fully transparent what this role is or which DA receptors are essential for it. Extensive work in our laboratory has addressed these questions using shuttle-box avoidance learning, either conditioned by a frequency-modulated (FM) tone or by a GO-NO GO discrimination paradigm using rising and falling FM tones, the processing of which depends on auditory cortex (Wetzel et al., 1998, 2008; Ohl et al., 1999). Microdialysis in auditory cortex and medial PFC showed that DA release in both structures reaches a peak during the first few trials of successful avoidance (Stark et al., 2001, 2008). The consequences of this initial DA release were clarified by subsequent reversal learning experiments, in which a consolidated GO response to two oppositely modulated FM tones was challenged by switching the requirement for one of the FM tones to a NO GO response (Stark et al., 2004). This resulted in an initial breakdown in avoidance responding to chance levels for all animals. However, some animals showed improvement in discrimination learning over subsequent days, and only these animals showed strong DA release in mPFC. This suggests an association between mPFC DA and the discovery of correct discrimination contingencies, and a facilitative or perhaps even causal role for DA in the formation of successful go vs. no go discrimination.
Neuronal activity in auditory cortex is known to be influenced by dopaminergic inputs (e.g., Bao et al., 2001) compatible with the anatomical connectivity from the VTA to the auditory cortex (e.g., Budinger et al., 2008). To investigate the role of specific DA receptors in auditory discrimination learning, a variety of DA agonists and antagonists were administered bilaterally to the auditory cortex both before and after training (Tischmeyer et al., 2003; Schicknick et al., 2008, 2012). The chief conclusion from these experiments was that only drugs affecting D1/D5 receptors are capable of depressing or enhancing discrimination learning. The most interesting effect was that the D1 agonist SKF 38393 injected before training did not influence acquisition during the training session but did lead to improved retrieval the next day. This effect was blocked by concurrent application of rapamycin, a specific inhibitor of the protein kinase mTOR implicated in the control of synaptic protein synthesis and relevant for memory consolidation in discriminative avoidance learning (Kraus et al., 2002). Taken together, these experiments suggest that DA release in auditory cortex is necessary for the FM tone conditioned avoidance response, and may enhance memory consolidation via a D1-receptor-mediated pathway.
While the administration of pharmacological agents is useful for elucidating specific receptor pathways, this approach is limited in that it alters tonic neuromodulation over a prolonged period of time without informing, and perhaps even interfering with, the role of dynamic neuromodulation, i.e., the up-and-down fluctuations in neuromodulators over very short time scales. Based on the evidence outlined in the previous sections, such phasic changes in the DA signal may be especially relevant to incentivized learning. Specifically, DA neurons are known to respond to the omission of an expected appetitive stimulus with a momentary cessation in firing. We theorized that DA neurons would greet the omission of an expected aversive stimulus in a symmetrical manner, namely, with a transient burst in firing. Signaled active avoidance learning inherently leads to such a negative expectation (e.g., shock will follow tone) as well as its subsequent violation (e.g., shock does not follow tone if hurdle is promptly crossed). Could DA involvement in avoidance learning be specific to the trials when the expectation of shock is violated, that is, when the animal first performs a successful avoidance response? Could a pronounced DA increase at this critical moment be responsible for reinforcing the avoidance response?
If so, a transient disruption of DA transmission following the initial trials of successful avoidance responding (when the animal is pleasantly surprised by the absence of shock) should disrupt learning. On the other hand, an equivalent manipulation following later trials after the avoidance response is well learned (when the animal fully expects that its behavior will lead to the absence of shock) should have no effect. Electrical stimulation of the lateral habenula (LHb), which results in transient, widespread inhibition of DA neurons in rodents and primates (Christoph et al., 1986; Ji and Shepard, 2007; Matsumoto and Hikosaka, 2007), was used to test this hypothesis (Shumake et al., 2010). Specifically, we implanted the LHb with a stimulation electrode and delivered brief electrical stimulation whenever the animal performed a correct avoidance response, i.e., when the initial avoidance of foot shock was hypothesized to trigger an intrinsic reward signal. As predicted, LHb stimulation initiated early in training impaired learning, but LHb stimulation initiated late in training had no effect (Shumake et al., 2010; Figure 1). These findings suggest a vital role for phasic DA signaling in the successful acquisition of active avoidance behavior. What is not yet clear is whether the presumed phasic increases in DA add up to the tonic increases in forebrain DA levels previously observed (Stark et al., 1999, 2000; Giorgi et al., 2003), or whether phasic and tonic DA signals convey differential information in the context of avoidance learning.
Figure 1
Brain Stimulation Reward and Avoidance Learning
Since James Olds discovered intracranial self-stimulation (ICSS; Olds and Milner, 1954; Olds, 1958), several ICSS-supporting regions have been characterized. The majority of these regions lie along DA projections, such that robust ICSS can be evoked from the VTA, substantia nigra, and lateral hypothalamus. Moreover, extracellular DA elevation is necessary to maintain ICSS (Fibiger et al., 1987; Fiorino et al., 1993; Owesson-White et al., 2008). Over the years, the effects of brain stimulation reward (BSR) were studied in learning and memory experiments, and it was found that BSR applied as experimenter-delivered stimulation or self-stimulation by the animal facilitated avoidance learning (Mondadori et al., 1976; Huston et al., 1977; Destrade and Jaffard, 1978; Segura-Torres et al., 1988, 1991, 2010; Huston and Oitzl, 1989; Aldavert-Vera et al., 1997; Ruiz-Medina et al., 2008). These results show that BSR given before or after training led to improvement of avoidance learning by improving the learning efficiency. However, correct avoidance responding is reinforced not only by terminating the aversive warning signal, i.e., relief from fear, but also by producing a safety signal, i.e., response-generated feedback stimuli signaling safety (Cicala and Owen, 1976; Dinsmoor, 1977; Masterson et al., 1978). Concerning the aversive component, the potential for enhancing the strength of reinforcement, e.g., by increasing shock intensity, is rather limited. Concerning the appetitive component, however, it is possible to enhance the magnitude of reinforcement by using additional feedback stimuli, e.g., sensory cues contingent to avoidance (Morris, 1975; Cicala and Owen, 1976), access to a safe place (Modaresi, 1975; Baron et al., 1977), or handling during the inter-trial interval (Wahlsten and Sharp, 1969).
These data support the view that any stimuli negatively correlated with shock, whether exteroceptive (presented by the experimenter) or interoceptive (presented by the subject’s own behavior), are inherently rewarding (Dinsmoor, 2001). Compatible with this idea, recent MRI studies in humans have suggested that activity in the medial orbitofrontal cortex, a reinforcement evaluating area, reflects an intrinsic reward signal that serves to reinforce avoidance behavior (Kim et al., 2006). Thus, we can assume that in aversively motivated learning, avoidance learning responses come under the control of positive incentives. Earlier investigations on appetitive-aversive interactions have shown that appetitive training appears to facilitate subsequent aversive conditioning (Dickinson, 1976; Dickinson and Pearce, 1977) and that operant behavior is enhanced by using concurrent schedules of positive and negative reinforcement (Kelleher and Cook, 1959; Olds and Olds, 1962). Moreover, a few studies reported the facilitation of discrete-trial avoidance (Stein, 1965; Castro-Alamancos and Borrell, 1992) and Sidman avoidance (in which shock is not signaled but rather occurs at fixed intervals unless the animal performs the operant response; Margules and Stein, 1968; Carder, 1970) by non-contingent rewarding brain stimulation, an effect resembling the action of stimulant drugs like amphetamine on self-stimulation and avoidance performance.
These results support the idea that the brain reward system facilitates operant behavior, whether positively or negatively reinforced. Not tested, however, was the effect of BSR given contingently to a correct response, i.e., exactly during the time-point when the response-generated safety signal occurs. Thus, in our studies we used the shuttle-box two-way avoidance paradigm to provide a way to combine BSR with footshock negative reinforcement to drive the same learned operant behavior. We found that this reinforcer combination potentiated the speed of acquisition, led to superior (nearly 100% correct) performance and delayed extinction, as compared to either reinforcer alone (Ilango et al., 2010, 2011; Shumake et al., 2010). These findings demonstrate that adding intrinsic reward (by stimulating dopaminergic structures) to the relief from punishment results in maximum avoidance performance, supporting the view that brain reward circuits serve as a common neural substrate for both appetitively and aversively motivated behavior.
Perspectives
In conclusion, several lines of evidence strongly argue in favor of the involvement of reward circuitry for the processing of aversive stimuli, especially to encode their predictors and to form an instrumental strategy to avoid them (e.g., Brischoux et al., 2009; Matsumoto and Hikosaka, 2009; Bromberg-Martin et al., 2010; Ilango et al., 2010, 2011; Budygin et al., 2012). Specifically, the neurotransmitter DA is involved in neuronal and behavioral responses to cues predicting reward (approach) or punishment (avoidance), both of which are vital for adaptive behavior. Electrophysiological signatures obtained from VTA DA neurons have begun to reveal their convergent encoding strategy for mediating both appetitive and aversive learning (Kim et al., 2012). Furthermore, VTA BSR can be integrated into avoidance learning tasks to investigate the nature of reinforcer interaction, and to understand the similarity between affective states associated with absence of predicted appetitive stimuli (frustration) and predicted aversive stimuli (fear) vs. absence of predicted aversive stimuli (relief) and predicted appetitive stimuli (hope; Seymour et al., 2007; Ilango et al., 2010).
Further progress in understanding the neuronal basis of affective behaviors will rely on both technical and conceptual progress. On the technical side, optogenetic approaches will allow triggering temporally precise events in specific cell types. For example, driving DA neurons in VTA by channelrhodopsin has already been demonstrated to support vigorous intracranial self-stimulation and place preference (Tsai et al., 2009; Witten et al., 2011). Such approaches could be extended to clarify the respective roles of several cell populations in different behaviors.
On the conceptual side, behavioral paradigms that allow the assessment of DA-related neuronal signatures in flexible scenarios will be important. For example, deeper insight into the role of DA with respect to the dissociation between (1) the association of specific behavioral meaning to stimuli and (2) the organization of appropriate behaviors can be expected from comparison of Pavlovian and instrumental paradigms. Also, discriminative avoidance learning tasks can be used to investigate how the same DA neuron responds to a CS+ in a hit vs. a miss trial or to a CS- in false-alarm vs. a correct-rejection trial, thereby allowing assessment of which factors govern the recruitment of excitatory and inhibitory contributions to neuronal and behavioral responses.
Statements
Acknowledgments
This work was supported by grants from the Deutsche Forschungsgemeinschaft (DFG), SFB 779 and SFB TRR 62. We thank all the technicians involved in the work over the years especially Kathrin Ohl, and Lydia Löw for help in animal training, care, and histology.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AbercrombieE. D.KeefeK. A.DiFrischiaD. S.ZigmondM. J. (1989). Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial frontal cortex. J. Neurochem.52, 1655–1658.10.1111/j.1471-4159.1989.tb09224.x
2
Aldavert-VeraL.Costa-MiserachsD.Massanes-RotgerE.Soriano-MasC.Segura-TorresP.Morgado-BernalI. (1997). Facilitation of a distributed shuttle-box conditioning with posttraining intracranial self-stimulation in old rats. Neurobiol. Learn. Mem.67, 254–258.10.1006/nlme.1997.3760
3
AnstromK. K.MiczekK. A.BudyginE. A. (2009). Increased phasic dopamine signaling in the mesolimbic pathway during social defeat in rats. Neuroscience161, 3–12.10.1016/j.neuroscience.2009.03.023
4
BaoS.ChanV. T.MerzenichM. M. (2001). Cortical remodeling induced by activity of ventral tegmental dopamine neurons. Nature412, 79–83.10.1038/35083586
5
BaronA.DewaardR. J.LipsonJ. (1977). Increased reinforcement when timeout from avoidance includes access to a safe place. J. Exp. Anal. Behav.27, 479–494.10.1901/jeab.1977.27-479
6
BeningerR. J.HoffmanD. C.MazurskiE. J. (1989). Receptor subtype-specific dopaminergic agents and conditioned behavior. Neurosci. Biobehav. Rev.13, 113–122.10.1016/S0149-7634(89)80019-3
7
BoschenS. L.WietzikoskiE. C.WinnP.Da CunhaC. (2011). The role of nucleus accumbens and dorsolateral striatal D2 receptors in active avoidance conditioning. Neurobiol. Learn. Mem.96, 254–262.10.1016/j.nlm.2011.05.002
8
BoutelleM. G.ZetterströmT.PeiQ.SvenssonL.FillenzM. (1990). In vivo neurochemical effects of tail pinch. J. Neurosci. Methods34, 151–157.10.1016/0165-0270(90)90053-I
9
BracsP. U.JacksonD. M.GregoryP. (1982). alpha-methyl-p-tyrosine inhibition of a conditioned avoidance response: reversal by dopamine applied to the nucleus accumbens. Psychopharmacology (Berl.)77, 159–163.10.1007/BF00431940
10
BrischouxF.ChakrabortyS.BrierleyD. I.UnglessM. A. (2009). Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli. Proc. Natl. Acad. Sci. U.S.A.106, 4894–4899.10.1073/pnas.0811507106
11
Bromberg-MartinE. S.MatsumotoM.HikosakaO. (2010). Dopamine in motivational control: rewarding, aversive, and alerting. Neuron68, 815–834.10.1016/j.neuron.2010.11.022
12
BrownM. T.HennyP.BolamJ. P.MagillP. J. (2009). Activity of neurochemically heterogeneous dopaminergic neurons in the substantia nigra during spontaneous and driven changes in brain state. J. Neurosci.29, 2915–2925.10.1523/JNEUROSCI.4423-08.2009
13
BudingerE.LaszczA.LisonH.ScheichH.OhlF. W. (2008). Non-sensory cortical and subcortical connections of the primary auditory cortex in Mongolian gerbils: bottom-up and top-down processing of neuronal information via field AI. Brain Res.1220, 2–32.10.1016/j.brainres.2007.07.084
14
BudyginE. A.ParkJ.BassC. E.GrinevichV. P.BoninK. D.WightmanR. M. (2012). Aversive stimulus differentially triggers subsecond dopamine release in reward regions. Neuroscience201, 331–337.10.1016/j.neuroscience.2011.10.056
15
CarderB. (1970). Lateral hypothalamic stimulation and avoidance in rats. J. Comp. Physiol. Psychol.71, 325–333.10.1037/h0029123
16
Castro-AlamancosM. A.BorrellJ. (1992). Facilitation and recovery of shuttle box avoidance behavior after frontal cortex lesions is induced by a contingent electrical stimulation in the ventral tegmental nucleus. Behav. Brain Res.50, 69–76.10.1016/S0166-4328(05)80288-8
17
ChristophG. R.LeonzioR. J.WilcoxK. S. (1986). Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat. J. Neurosci.6, 613–619.
18
CicalaG. A.OwenI. W. (1976). Warning signal termination and a feedback signal may not serve the same function. Learn. Motiv.7, 356–367.10.1016/0023-9690(76)90042-4
19
CohenJ. Y.HaeslerS.VongL.LowellB. B.UchidaN. (2012). Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature482, 85–88.10.1038/nature10754
20
CoizetV.DommettE. J.KlopE. M.RedgraveP.OvertonP. G. (2010). The parabrachial nucleus is a critical link in the transmission of short latency nociceptive information to midbrain dopaminergic neurons. Neuroscience168, 263–272.10.1016/j.neuroscience.2010.03.049
21
CoizetV.DommettE. J.RedgraveP.OvertonP. G. (2006). Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat. Neuroscience139, 1479–1493.10.1016/j.neuroscience.2006.01.030
22
CooperB. R.BreeseG. R.GrantL. D.HowardJ. L. (1973). Effects of 6-hydroxydopamine treatments on active avoidance responding: evidence for involvement of brain dopamine. J. Pharmacol. Exp. Ther.185, 358–370.
23
DestradeC.JaffardR. (1978). Post-trial hippocampal and lateral hypothalamic electrical stimulation. Facilitation on long-term memory of appetitive and avoidance learning tasks. Behav. Biol.22, 354–374.10.1016/S0091-6773(78)92441-0
24
DickinsonA. (1976). Appetitive-aversion interactions: facilitation of aversive conditioning by prior appetitive training in the rat. Anim. Learn. Behav.4, 416–420.10.3758/BF03214432
25
DickinsonA.PearceJ. M. (1977). Inhibitory interactions between appetitive and aversive stimuli. Psychol. Bull.84, 690–711.10.1037/0033-2909.84.4.690
26
DinsmoorJ. A. (1977). Escape, avoidance, punishment: where do we stand?J. Exp. Anal. Behav.28, 83–95.10.1901/jeab.1977.28-83
27
DinsmoorJ. A. (2001). Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. J. Exp. Anal. Behav.75, 311–333.10.1901/jeab.2001.75-367
28
FibigerH. C.LePianeF. G.JakubovicA.PhillipsA. G. (1987). The role of dopamine in intracranial self-stimulation of the ventral tegmental area. J. Neurosci.7, 3888–3896.
29
FiorinoD. F.CouryA.FibigerH. C.PhillipsA. G. (1993). Electrical stimulation of reward sites in the ventral tegmental area increases dopamine transmission in the nucleus accumbens of the rat. Behav. Brain Res.55, 131–141.10.1016/0166-4328(93)90109-4
30
GaoD. M.HoffmanD.BenabidA. L. (1996). Simultaneous recording of spontaneous activities and nociceptive responses from neurons in the pars compacta of substantia nigra and in the lateral habenula. Eur. J. Neurosci.8, 1474–1478.10.1111/j.1460-9568.1996.tb01609.x
31
GaoD. M.JeaugeyL.PollakP.BenabidA. L. (1990). Intensity-dependent nociceptive responses from presumed dopaminergic neurons of the substantia nigra pars compacta in the rat and their modification by lateral habenula inputs. Brain Res.529, 315–319.10.1016/0006-8993(90)90843-Z
32
GiorgiO.LeccaD.PirasG.DriscollP.CordaM. G. (2003). Dissociation between mesocortical dopamine release and fear-related behaviours in two psychogenetically selected lines of rats that differ in coping strategies to aversive conditions. Eur. J. Neurosci.17, 2716–2726.10.1046/j.1460-9568.2003.02692.x
33
GuarraciF. A.KappB. S. (1999). An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav. Brain Res.99, 169–179.10.1016/S0166-4328(98)00102-8
34
HustonJ. P.MuellerC. C.MondadoriC. (1977). Memory facilitation by posttrial hypothalamic stimulation and other reinforcers: a central theory of reinforcement. Biobehav. Rev.1, 143–150.10.1016/0147-7552(77)90003-1
35
HustonJ. P.OitzlM. S. (1989). The relationship between reinforcement and memory: parallels in the rewarding and mnemonic effects of the neuropeptide substance P. Neurosci. Biobehav. Rev.13, 171–180.10.1016/S0149-7634(89)80027-2
36
IkemotoS. (2007). Dopamine reward circuitry: two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex. Brain Res. Rev.56, 27–78.10.1016/j.brainresrev.2007.05.004
37
IkemotoS.PankseppJ. (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Brain Res. Rev.31, 6–41.10.1016/S0165-0173(99)00023-5
38
IlangoA.WetzelW.ScheichH.OhlF. W. (2010). The combination of appetitive and aversive reinforcers and the nature of their interaction during auditory learning. Neuroscience166, 752–762.10.1016/j.neuroscience.2010.01.010
39
IlangoA.WetzelW.ScheichH.OhlF. W. (2011). Effects of ventral tegmental area stimulation on the acquisition and long term retention of active avoidance learning. Behav. Brain Res.225, 515–521.10.1016/j.bbr.2011.08.014
40
ImperatoA.AngelucciL.CasoliniP.ZocchiA.Puglisi-AllegraS. (1992). Repeated stressful experiences differently affect limbic dopamine release during and following stress. Brain Res.577, 194–199.10.1016/0006-8993(92)90274-D
41
JacksonD. M.AhleniusS.AndénN. E.EngelJ. (1977). Antagonism by locally applied dopamine into the nucleus accumbens or the corpus striatum of alpha-methyltyrosine-induced disruption of conditioned avoidance behaviour. J. Neural Transm.41, 231–239.10.1007/BF01252018
42
JiH.ShepardP. D. (2007). Lateral habenula stimulation inhibits rat midbrain dopamine neurons through a GABA(A) receptor-mediated mechanism. J. Neurosci.27, 6923–6930.10.1523/JNEUROSCI.5528-06.2007
43
KalivasP. W.DuffyP. (1995). Selective activation of dopamine transmission in the shell of the nucleus accumbens by stress. Brain Res.675, 325–328.10.1016/0006-8993(95)00013-G
44
KelleherR. T.CookL. (1959). An analysis of the behavior of rats and monkeys on concurrent fixed-ratio avoidance schedules. J. Exp. Anal. Behav.2, 203–211.10.1901/jeab.1959.2-91
45
KimH.ShimojoS.O’DohertyJ. P. (2006). Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol.4, e233.10.1371/journal.pbio.0040233
46
KimY.WoodJ.MoghaddamB. (2012). Coordinated activity of ventral tegmental neurons adapts to appetitive and aversive learning. PLoS ONE7, e29766.10.1371/journal.pone.0029766
47
KonorskiJ. (1967). The Integrative Activity of the Brain: An Interdisciplinary Approach. Chicago: Chicago University Press.
48
KrausM.SchicknickH.WetzelW.OhlF.StaakS.TischmeyerW. (2002). Memory consolidation for the discrimination of frequency-modulated tones in mongolian gerbils is sensitive to protein-synthesis inhibitors applied to the auditory cortex. Learn. Mem.9, 293–303.10.1101/lm.47502
49
MantzJ.ThierryA. M.GlowinskiJ. (1989). Effect of noxious tail pinch on the discharge rate of mesocortical and mesolimbic dopamine neurons: selective activation of the mesocortical system. Brain Res.476, 377–381.10.1016/0006-8993(89)91263-8
50
MargulesD. L.SteinL. (1968). Facilitation of sidman avoidance behavior by positive brain stimulation. J. Comp. Physiol. Psychol.66, 182–184.10.1037/h0026323
51
MastersonF. A.CrawfordM.BartterW. D. (1978). Brief escape from a dangerous place: the role of reinforcement in the rat’s one-way avoidance acquisition. Learn. Motiv.9, 141–163.10.1016/0023-9690(78)90017-6
52
MatsumotoM.HikosakaO. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature447, 1111–1115.10.1038/nature05860
53
MatsumotoM.HikosakaO. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature459, 837–841.10.1038/nature08028
54
McCulloughL. D.SokolowskiJ. D.SalamoneJ. D. (1993). A neurochemical and behavioral investigation of the involvement of nucleus accumbens dopamine in instrumental avoidance. Neuroscience52, 919–925.10.1016/0306-4522(93)90538-Q
55
MileykovskiyB.MoralesM. (2011). Duration of inhibition of ventral tegmental area dopamine neurons encodes a level of conditioned fear. J. Neurosci.31, 7471–7476.10.1523/JNEUROSCI.5731-10.2011
56
MirenowiczJ.SchultzW. (1996). Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature379, 449–451.10.1038/379449a0
57
ModaresiH. A. (1975). One-way characteristic performance of rats under two-way signaled avoidance conditions. Learn. Motiv.6, 484–497.10.1016/0023-9690(75)90006-5
58
MondadoriC.OrnsteinK.WaserP. G.HustonJ. P. (1976). Post-trial reinforcing hypothalamic stimulation can facilitate avoidance learning. Neurosci. Lett.2, 183–187.10.1016/0304-3940(76)90012-4
59
MorrisR. G. M. (1975). Preconditioning of reinforcing properties to an exteroceptive feedback stimulus. Learn. Motiv.6, 289–298.10.1016/0023-9690(75)90029-6
60
OhlF. W.WetzelW.WagnerT.RechA.ScheichH. (1999). Bilateral ablation of auditory cortex in Mongolian gerbil affects discrimination of frequency modulated tones but not of pure tones. Learn. Mem.6, 347–362.
61
OldsJ. (1958). Self-stimulation of the brain. Its use to study local effects of hunger, sex, and drugs. Science127, 315–324.10.1126/science.127.3307.1175
62
OldsJ.MilnerP. M. (1954). Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J. Comp. Physiol. Psychol.47, 419–427.10.1037/h0058775
63
OldsM. E.OldsJ. (1962). Approach-escape interactions in rat brain. Am. J. Physiol.203, 803–810.
64
Owesson-WhiteC. A.CheerJ. F.BeyeneM.CarelliR. M.WightmanR. M. (2008). Dynamic changes in accumbens dopamine correlate with learning during intracranial self-stimulation. Proc. Natl. Acad. Sci. U.S.A.105, 11957–11962.10.1073/pnas.0803896105
65
ParkJ.WheelerR. A.FontillasK.KeithleyR. B.CarelliR. M.WightmanR. M. (2012). Catecholamines in the bed nucleus of the stria terminalis reciprocally respond to reward and aversion. Biol. Psychiatry71, 327–334.10.1016/j.biopsych.2011.10.017
66
PeiQ.ZetterströmT.FillenzM. (1990). Tail pinch-induced changes in the turnover and release of dopamine and 5-hydroxytryptamine in different brain regions of the rat. Neuroscience35, 133–138.10.1016/0306-4522(90)90127-P
67
RoitmanM. F.WheelerR. A.WightmanR. M.CarelliR. M. (2008). Real-time chemical responses in the nucleus accumbens differentiate rewarding and aversive stimuli. Nat. Neurosci.12, 1376–1377.10.1038/nn.2219
68
Ruiz-MedinaJ.Redolar-RipollD.Morgado-BernalI.Aldavert-VeraL.Segura-TorresP. (2008). Intracranial self-stimulation improves memory consolidation in rats with little training. Neurobiol. Learn. Mem.89, 574–581.10.1016/j.nlm.2007.11.005
69
SalamoneJ. D. (1994). The involvement of nucleus accumbens dopamine in appetitive and aversive motivation. Behav. Brain Res.61, 117–133.10.1016/0166-4328(94)90153-8
70
SalamoneJ. D.CorreaM. (2002). Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav. Brain Res.137, 3–25.10.1016/S0166-4328(02)00282-6
71
SchicknickH.ReichenbachN.SmallaK. H.ScheichH.GundelfingerE. D.TischmeyerW. (2012). Dopamine modulates memory consolidation of discrimination learning in the auditory cortex. Eur. J. Neurosci.35, 763–774.10.1111/j.1460-9568.2012.07994.x
72
SchicknickH.SchottB. H.BudingerE.SmallaK. H.RiedelA.SeidenbecherC. I.ScheichH.GundelfingerE. D.TischmeyerW. (2008). Dopaminergic modulation of auditory cortex-dependent memory consolidation through mTOR. Cereb. Cortex18, 2646–2658.10.1093/cercor/bhn026
73
SchultzW.DayanP.MontagueP. R. (1997). A neural substrate of prediction and reward. Science275, 1593–1599.10.1126/science.275.5306.1593
74
Segura-TorresP.Aldavert-VeraL.Gatell-SeguraA.Redolar-RipollD.Morgado-BernalI. (2010). Intracranial self-stimulation recovers learning and memory capacity in basolateral amygdala-damaged rats. Neurobiol. Learn. Mem.93, 117–126.10.1016/j.nlm.2009.09.001
75
Segura-TorresP.Capdevila-OrtísL.Martí-NicoloviusM.Morgado-BernalI. (1988). Improvement of shuttle-box learning with pre- and post-trial intracranial self-stimulation in rats. Behav. Brain Res.29, 111–117.10.1016/0166-4328(88)90058-7
76
Segura-TorresP.Portell-CortésI.Morgado-BernalI. (1991). Improvement of shuttle-box avoidance with post-training intracranial self-stimulation, in rats: a parametric study. Behav. Brain Res.42, 161–167.10.1016/S0166-4328(05)80007-5
77
SeymourB.SingerT.DolanR. (2007). The neurobiology of punishment. Nat. Rev. Neurosci.8, 300–311.10.1038/nrn2119
78
ShumakeJ.IlangoA.ScheichH.WetzelW.OhlF. W. (2010). Differential neuromodulation of acquisition and retrieval of avoidance learning by the lateral habenula and ventral tegmental area. J. Neurosci.30, 5876–5883.10.1523/JNEUROSCI.3604-09.2010
79
SkinnerB. F. (1938). The Behavior of Organisms: An Experimental Analysis. New York: Appleton.
80
SokolowskiJ. D.McCulloughL. D.SalamoneJ. D. (1994). Effects of dopamine depletions in the medial prefrontal cortex on active avoidance and escape in the rat. Brain Res.65, 293–299.10.1016/0006-8993(94)90709-9
81
SorgB. A.KalivasP. W. (1991). Effects of cocaine and footshock stress on extracellular dopamine levels in the ventral striatum. Brain Res.559, 29–36.10.1016/0006-8993(91)90283-2
82
SorgB. A.KalivasP. W. (1993). Effects of cocaine and footshock stress on extracellular dopamine levels in the medial prefrontal cortex. Neuroscience53, 695–703.10.1016/0306-4522(93)90617-O
83
StarkH.BischofA.ScheichH. (1999). Increase of extracellular dopamine in prefrontal cortex of gerbils during acquisition of the avoidance strategy in the shuttle-box. Neurosci. Lett.264, 77–80.10.1016/S0304-3940(99)00174-3
84
StarkH.BischofA.WagnerT.ScheichH. (2000). Stages of avoidance strategy formation in gerbils are correlated with dopaminergic transmission activity. Eur. J. Pharmacol.405, 263–275.10.1016/S0014-2999(00)00558-6
85
StarkH.BischofA.WagnerT.ScheichH. (2001). Activation of the dopaminergic system of medial prefrontal cortex of gerbils during formation of relevant associations for the avoidance strategy in the shuttle-box. Prog. Neuropsychopharmacol. Biol. Psychiatry25, 409–426.10.1016/S0278-5846(00)00171-8
86
StarkH.RotheT.DelianoM.ScheichH. (2008). Dynamics of cortical theta activity correlates with stages of auditory avoidance strategy formation in a shuttle-box. Neuroscience151, 467–475.10.1016/j.neuroscience.2007.11.005
87
StarkH.RotheT.WagnerT.ScheichH. (2004). Learning a new behavioral strategy in the shuttle-box increases prefrontal dopamine. Neuroscience126, 21–29.10.1016/j.neuroscience.2004.02.026
88
SteinL. (1965). Facilitation of avoidance behaviour by positive brain stimulation. J. Comp. Physiol. Psychol.60, 9–19.10.1037/h0022357
89
TischmeyerW.SchicknickH.KrausM.SeidenbecherC. I.StaakS.ScheichH.GundelfingerE. D. (2003). Rapamycin-sensitive signalling in long-term consolidation of auditory cortex-dependent memory. Eur. J. Neurosci.18, 942–950.10.1046/j.1460-9568.2003.02820.x
90
ToblerP. N.DickinsonA.SchultzW. (2003). Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J. Neurosci.23, 10402–10410.
91
TsaiC. T.NakamuraS.IwamaK. (1980). Inhibition of neuronal activity of the substantia nigra by noxious stimuli and its modification by the caudate nucleus. Brain Res.195, 299–311.10.1016/0006-8993(80)90066-9
92
TsaiH. C.ZhangF.AdamantidisA.StuberG. D.BonciA.de LeceaL.DeisserothK. (2009). Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science324, 1080–1084.10.1126/science.1168878
93
UnglessM. A.ArgilliE.BonciA. (2010). Effects of stress and aversion on dopamine neurons: implications for addiction. Neurosci. Biobehav. Rev.35, 151–156.10.1016/j.neubiorev.2010.04.006
94
UnglessM. A.MagillP. J.BolamJ. P. (2004). Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science303, 2040–2042.10.1126/science.1093360
95
ValentiO.LodgeD. J.GraceA. A. (2011). Aversive stimuli alter ventral tegmental area dopamine neuron activity via a common action in the ventral hippocampus. J. Neurosci.31, 4280–4289.10.1523/JNEUROSCI.5310-10.2011
96
WadenbergM. L.EricsonE.MagnussonO.AhleniusS. (1990). Suppression of conditioned avoidance behavior by the local application of (-)sulpiride into the ventral, but not the dorsal, striatum of the rat. Biol. Psychiatry28, 297–307.10.1016/0006-3223(90)90657-N
97
WahlstenD.SharpD. (1969). Improvement of shuttle avoidance by handling during the intertrial interval. J. Comp. Physiol. Psychol.67, 252–259.10.1037/h0026787
98
WangD. V.TsienJ. Z. (2011). Convergent processing of both positive and negative motivational signals by the VTA dopamine neuronal populations. PLoS ONE6, e17047.10.1371/journal.pone.0017047
99
WetzelW.OhlF. W.ScheichH. (2008). Global versus local processing of frequency-modulated tones in gerbils: an animal model of lateralized auditory cortex functions. Proc. Natl. Acad. Sci. U.S.A.105, 6753–6758.10.1073/pnas.0707844105
100
WetzelW.OhlF. W.WagnerT.ScheichH. (1998). Right auditory cortex lesion in Mongolian gerbils impairs discrimination of rising and falling frequency-modulated tones. Neurosci. Lett.252, 115–118.10.1016/S0304-3940(98)00561-8
101
WietzikoskiE. C.BoschenS. L.MiyoshiE.BortolanzaM.Dos SantosL. M.FrankM.BrandãoM. L.WinnP.Da CunhaC. (2012). Roles of D1-like dopamine receptors in the nucleus accumbens and dorsolateral striatum in conditioned avoidance responses. Psychopharmacology (Berl.)219, 159–169.10.1007/s00213-011-2384-3
102
WittenI. B.SteinbergE. E.LeeS. Y.DavidsonT. J.ZalocuskyK. A.BrodskyM.YizharO.ChoS. L.GongS.RamakrishnanC.StuberG. D.TyeK. M.JanakP. H.DeisserothK. (2011). Recombinase-driver rat lines: tools, techniques, and optogenetic application to dopamine-mediated reinforcement. Neuron72, 721–733.10.1016/j.neuron.2011.10.028
103
YoungA. M.JosephM. H.GrayJ. A. (1993). Latent inhibition of conditioned dopamine release in rat nucleus accumbens. Neuroscience54, 5–9.10.1016/0306-4522(93)90378-S
Summary
Keywords
dopamine, aversive stimuli, avoidance learning, intracranial self-stimulation, reward and punishment, dorsal vs. ventral striatum, lateral habenula, ventral tegmental area
Citation
Ilango A, Shumake J, Wetzel W, Scheich H and Ohl FW (2012) The Role of Dopamine in the Context of Aversive Stimuli with Particular Reference to Acoustically Signaled Avoidance Learning. Front. Neurosci. 6:132. doi: 10.3389/fnins.2012.00132
Received
29 April 2012
Accepted
25 August 2012
Published
14 September 2012
Volume
6 - 2012
Edited by
Philippe N. Tobler, University of Zurich, Switzerland
Reviewed by
Shunsuke Kobayashi, Fukushima Medical University, Japan; Mitchell Roitman, University of Illinois at Chicago, USA
Copyright
© 2012 Ilango, Shumake, Wetzel, Scheich and Ohl.
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: Anton Ilango, Intramural Research Programme, National Institute on Drug Abuse, National Institutes of Health, 251 Bayview Blvd., Baltimore, MD 21224, USA. e-mail: antonilango@hotmail.com; Frank W. Ohl, Leibniz Institute for Neurobiology, Brenneckestrasse 6, D-39118 Magdeburg, Germany. e-mail: frank.ohl@ifn-magdeburg.de
†Present address: Anton Ilango, Intramural Research Programme, National Institute on Drug Abuse, National Institutes of Health, 251 Bayview Blvd., Baltimore, MD 21224, USA.
This article was submitted to Frontiers in Decision Neuroscience, a specialty of Frontiers in Neuroscience.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.