To Act or Not to Act: Endocannabinoid/Dopamine Interactions in Decision-Making
Giovanni Hernandez
Joseph F. Cheer- 1Faculté de Pharmacie, Université de Montréal, Montréal, Quebec, QC, Canada
- 2Department of Anatomy and Neurobiology, University of Maryland School of Medicine, Baltimore, Maryland, MD, USA
- 3Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland, MD, USA
Decision-making is an ethologically adaptive construct that is impaired in multiple psychiatric disorders. Activity within the mesocorticolimbic dopamine system has been traditionally associated with decision-making. The endocannabinoid system through its actions on inhibitory and excitatory synapses modulates dopamine activity and decision-making. The aim of this brief review is to present a synopsis of available data obtained when the endocannabinoid system is manipulated and dopamine activity recorded. To this end, we review research using different behavioral paradigms to provide further insight into how this ubiquitous signaling system biases dopamine-related behaviors to regulate decision-making.
Scope and Introduction
When presented with several alternatives and when deciding which course of action to take, organisms have to integrate different pieces of information. These pieces of information include, but are not limited to the size of the reward, risk, physiological states and expected time to obtain a reward. After the integration of these pieces of information, it is anticipated that the organism will choose the option with the highest value. Given the combination of different variables at the moment of making a decision, the value of the reward rarely represents its objective properties, it represents subjective desirabilities. The representation of idiosyncratic values of different goal objects is encoded in different neural systems (Kable and Glimcher, 2007). Numerous studies on decision-making have shown that dopamine (DA) plays a critical role in the representation of multiple variables underlying the perceived reward value and reward-seeking. This is not surprising, given the array of structures to which DA neurons project and the different modalities of DA release. For some researchers, DA phasic firing encodes reward value (Tobler et al., 2005; Kobayashi and Schultz, 2008). Others have emphasized the role of DA release in different brain areas in the modulation of different processes involved in reward valuation. For example, in the modulation of reward sensitivity (Wise and Rompre, 1989) or reward-gain (Hernandez et al., 2010; Hernandez and Cheer, 2012), in the modulation of effort cost and vigor (Niv et al., 2007; Salamone et al., 2007); whereas others have put an emphasis on the role of DA release in incentive salience (Berridge and Robinson, 1998).
Given the profusion of processes that DA firing and release is involved, it is of great interest to understand how other brain networks alter the DAergic system activity. One system that is pivotal in the modulation of different circuitries is the endocannabinoid (eCB) system. The eCB system, through its interaction with excitatory and inhibitory afferents to the ventral tegmental area (VTA), has proven to be critical in fine-tuning decision-making processes (Melis and Pistis, 2012). Here, we will review the effects of activation and inactivation of eCBs on diverse appetitive behavioral paradigms and how these manipulations alter the behavior and accompanying DA dynamics.
Brief Introduction to the eCB System
Ever since the cloning of the central cannabinoid receptor CB1R (Matsuda et al., 1990) and the isolation of the first endogenous cannabinoid (eCB) (Devane et al., 1992), the eCB system has been of great interest to neuroscientists. CB1Rs are the most abundant Gi/o coupled receptors found in the brain (Herkenham et al., 1991; Howlett et al., 2002) and they modulate a wide array of functions and processes, ranging from motor control to decision-making.
The eCB system is comprised of cannabinoid receptors (CB1R, CB2R), their endogenous ligands and the enzymes that degrade them. The ligands most thoroughly studied and characterized are anandamide and 2-arachidonoyl glycerol (2-AG). eCBs are lipid-derived metabolites that are produced “on-demand” by postsynaptic cells and immediate released. The signal that the cell uses to start the biochemical cascade for eCBs synthesis is, in general, an enhancement in intracellular Ca2+ concentration. This increase in Ca2+ is due to cell depolarization or mobilization of intracellular Ca2+ stores (for a detailed review on the synthesis of eCBs; see Di Marzo, 2006). Once produced and released, eCBs act retrogradely mostly onto CB1R localized on excitatory (glutamatergic) and inhibitory (GABAergic) terminals (Elphick and Egertová, 2001; Wilson and Nicoll, 2001; Alger, 2002). The activation of these receptors produces molecular changes leading to the closing of Ca2+ (N- and P/Q type) channels (Twitchell et al., 1997) and/or opening of K+ channels (Mackie et al., 1995). The effect of these changes at the cellular level is to reduce the probability of neurotransmitter release (Maejima et al., 2001; Lupica and Riegel, 2005) thus, influencing both short- and long-term forms of synaptic plasticity (Alger, 2002). After eCBs reach their target, they are rapidly degraded. Specifically, fatty acid amide hydrolase (FAAH) participates in anandamide degradation (Di Marzo et al., 1994) whereas monoacylglycerol lipase (MAGL) degrades 2-AG (Dinh et al., 2002; De Petrocellis et al., 2004).
eCB Actions in the Mesocorticolimbic Reward System
eCBs modulate decision-making in part by curbing the activity of excitatory and inhibitory neurotransmission along the mesocorticolimbic pathway. eCBs are an important neural substrate involved in decision-making processes (Wise and Rompre, 1989; Koob, 1992; Chao and Nestler, 2004) and in the processing of rewarding stimuli (Wise and Rompre, 1989; Salamone and Correa, 2002; Schultz, 2010; Hernandez et al., 2012). eCB activation of CB1Rs at the level of the ventral tegmental area (VTA), the site of origin of the mesocorticolimbic dopaminergic (DA) neurons, increases DA burst firing (French, 1997; Gessa et al., 1998; Wu and French, 2000). As consequence, it facilitates DA release in terminal areas such as the nucleus accumbens (NAc) and the prefrontal cortex (Chen et al., 1990; Pennartz et al., 1994; Tanda et al., 1997; Cheer et al., 2007a; Oleson et al., 2012). Such change in DA excitability is significant because empirical evidence implicates these neurons in the encoding of the subjective value of the reward (Tobler et al., 2005; Roesch et al., 2007; Kobayashi and Schultz, 2008; Roesch and Bryden, 2011; Lak et al., 2014). When the size or delay of a reward are manipulated, DA neurons fire at a higher rate for the cues that predict the subjective more valuable reward (i.e., larger reward or shorter delay; Roesch et al., 2007). When effort and delay to obtain a reward are manipulated, phasic DA release in the NAc is higher at the cue that predicts lesser exertion. Phasic DA release also increases at cues that predict an immediate reward (Day et al., 2011). Importantly when DA signaling is disrupted, changes in the behavior ensue so that subjects no longer adapt their behavior according to changes in reward contingencies (Cardinal et al., 2001; Ghods-Sharifi and Floresco, 2010; Stopper et al., 2014).
Given that DA neurons do not express CB1Rs (Herkenham et al., 1991; Matsuda et al., 1993; Julian et al., 2003), the modulation of their activity and release by eCBs comes indirectly from the activation of CB1R present on afferents to DA cell bodies. Under conditions of relatively high neural activity, DA neurons release eCBs (Alger, 2002; Melis et al., 2004). These molecules retrogradely bind to CB1R on presynaptic terminals to dampen the activity of DA afferents. This reduction in the activity of DA inputs allows DA neurons to regulate their activity levels (Melis et al., 2004, 2006; Marinelli et al., 2007). The precise mechanism by which eCBs facilitate DA burst firing in a behaving animal remains to be fully established. One possibility is that DA burst firing is the result of the net effect of eCBs on the combined probabilities of glutamate and GABA release (Lupica and Riegel, 2005; Melis and Pistis, 2007). Under normal resting circumstances, approximately 50% of DA neurons are under inhibitory GABAergic drive (Grace and Bunney, 1984) rendering them insensitive to excitatory inputs. Direct activation of CB1R on GABA neurons reduces inhibitory drive on DA neurons, making them more susceptible to excitatory inputs and therefore, more prone to fire in bursts (Overton and Clark, 1997; Zweifel et al., 2009). Nonetheless, activation of CB1R on glutamatergic neurons also reduces the probability of glutamate release. This reduction would have a dual effect; it would diminish the excitatory inputs to DA neurons (Melis et al., 2004), which would curtail burst firing, but it could also reduce GABAergic inhibitory drive onto DA neurons. Indeed, glutamate plays a major role in the maintenance of DA inhibitory drive by acting on NMDA receptors located in GABA neurons most likely through GluN2A receptors (Bergeron and Rompré, 2013; Hernandez et al., 2015). A reduction in glutamate release probability, therefore, adds to an overall decrease in DA inhibitory drive. Although eCBs can lower the probability of glutamate release, the effect is limited due to the greater relative presence of CB1R on GABAergic vs. glutamatergic terminals (Mackie, 2005). The combined effect of decreased glutamate release and CB1R-induced activation of GABA neurons would result in a net reduction in the number of DA neurons firing in a slow tonic manner. Under these conditions, DA neurons are ready to fire in bursts once NMDA receptors are activated (Overton and Clark, 1997; Zweifel et al., 2009; but see Lobb et al., 2010 for an alternative mechanism).
eCB-induced disinhibition of DA neurons in the VTA can be produced intrinsically by acting on GABAergic interneurons or extrinsically via GABAergic afferents (Lupica et al., 2004). This distinction is possible by the general type of GABA receptor involved. GABAergic interneurons preferentially target GABAA receptors located on VTA DA neurons; whereas GABAergic afferents target preferentially GABAB receptors (Johnson and North, 1992; Sugita et al., 1992). In vitro experiments show that the excitatory effect of the CB1R agonist HU-210 is occluded by application of the GABAA receptor antagonist bicuculline or the CB1R antagonist rimonabant to the slice (Cheer et al., 2000). Similarly, perfusion of the CB1R agonist WIN55, 212–2 decreases electrically evoked inhibitory postsynaptic currents (IPSCs) in a GABAA receptor-dependent manner (Szabo et al., 2002); whereas application of the CB1R antagonist rimonabant prevents this effect. In addition to this intrinsic mechanism for the eCB dependent disinhibition of VTA DA neurons, an extrinsic disinhibition mechanism has been hypothesized which acts predominantly on GABA afferents targeting GABAB receptors (Riegel and Lupica, 2004). Here, the application of CB1R agonist WIN55, 212–2 decreases the amplitude of the GABAB mediated IPSCs, in a CB1R-dependent fashion. However, immunocytochemical investigations have not yet identified the origin of such VTA GABA afferents (Mátyás et al., 2008). Further electrophysiological research points towards the: (a) NAc, a critical brain area mediating appetitive behaviors via the integration of inputs from cortical and limbic structures (Mogenson et al., 1980); (b) ventral pallidum, a region that plays a part in the differentiation of wanting, liking, and prediction components of a reward (Smith et al., 2011); and (c) rostromedial tegmental nucleus (RMTg), a small node that plays a pivotal role in processing both aversive and appetitive stimuli (Jhou et al., 2009b).
The projection of medium spiny neurons (MSN) of the NAc to the VTA was one of the first afferents proposed (Walaas and Fonnum, 1980; Sugita et al., 1992; Kalivas et al., 1993). It was hypothesized that these axon terminals converged onto DA neurons and directly inhibited DA activity (Einhorn et al., 1988; Rahman and McBride, 2000). However, recent evidence using genetic and optogenetics tools is at odds with this notion. Optical activation of NAc MSN demonstrated that these axons mainly synapse onto non-DA neurons, and these connections are fast–inhibitory neurons mediated by GABAA receptors (Xia et al., 2011). Moreover, it was demonstrated that CB1 expressing neurons in the NAc are fast-spiking interneurons, not MSNs. A conclusion obtained via the use of a knock-in mouse line in which CB1-expressing neurons also expressed the fluorescent protein td-Tomato (Winters et al., 2012). These results imply that synaptic projections from the NAc to the VTA should not be affected by CB1R signaling, although further research utilizing more sophisticated retrograde labeling techniques is needed.
In vivo electrophysiological studies show that GABA projections coming from the VP (Aguilar et al., 2015) and RMTg (Lecca et al., 2011, 2012) are sensitive to cannabinoid manipulations, and they modulate VTA DA neural firing. Inhibiting the degradation of eCBs in the VP decreased VTA DA neural activity observed following chronic treatment with the NMDA glutamate receptor antagonist phencyclidine (Aguilar et al., 2015). Likewise, manipulation of the RMTg nucleus has a profound effect on DA neural firing. The RMTg receives dense, mostly glutamatergic inputs from the lateral habenula (Jhou et al., 2009a,b), an area that encodes aversive stimulation (Matsumoto and Hikosaka, 2009). This nucleus mediates the inhibitory effect of the lateral habenula on midbrain DA neurons (Jhou et al., 2009a,b). The RMTg neurons that project to the VTA form inhibitory synapses, so that activation of this input, via electrical stimulation, inhibits DA firing (Lecca et al., 2011). Systemic injections of CB1R agonist produces a long-lasting decrease in the firing rate of GABA neurons located in the RMTg. The administration of a CB1R antagonist, which on its own is devoid of effects on firing rate of GABA neurons, minutes before the agonist, prevents the inhibition of RMTg GABA neurons. In vitro recordings, demonstrate that the reduction in the amplitude of excitatory postsynaptic currents is the mechanism underlying the inhibition of GABA neurons. In addition to a decrease in excitatory postsynaptic currents, CB1R agonist produced a significant increase in paired-pulse ratio, suggesting that the CB1R agonist produced a reduction in glutamate release through activation of presynaptic receptors (Lecca et al., 2011). As expected, the inhibition of GABA neurons in the RMTg correlates with an increase in firing of DA neurons in the VTA (Lecca et al., 2011, 2012).
These electrophysiological studies suggest that eCB modulation of afferents to the VTA potently regulate DA activity via multiple mechanisms. The modulation of DA responses has important implications for decision-making processes. If, by their phasic firing and release, DA neurons integrate the subjective reward value (Lak et al., 2014) then eCB signaling is crucial during reward evaluation and can alter the weight of the variables used during goal assessment. Once different alternatives are weighted, and different goals are assessed, subjects have to start an action according to their assessment; such course of action is believed to represent the option with the highest expected subjective preference. Thus, reward-seeking can be used as a proxy to infer the subjective reward value and changes in decision-making. In the following section, we will review empirical evidence that shows how altering DA signaling via CB1R manipulations biases goal-directed behavior.
eCBs and BSR
Several organisms will deliver electrical pulse trains to different brain areas via insulated macro electrodes (Olds and Milner, 1954; Olds, 1962; Shizgal and Murray, 1989). The effect of the electrical stimulation that leads organisms to seek and reinitiate the stimulation is called brain stimulation reward (BSR). Since its discovery, BSR has become the paradigm of choice for studying the neural reward circuitry and goal-directed responses. The rewarding signal that arises as a result of the delivery of electrical pulses shares properties with natural rewards. BSR can compete with, summate with natural rewards (Conover and Shizgal, 1994) and BSR can be degraded in a similar way as natural rewards (Hernandez et al., 2011). These characteristics strongly suggest that the behavior maintained by pulses of electrical brain stimulation is far from being rigid or habitual responding (Hernandez et al., 2011), but denotes the subject’s integration of different pieces of information regarding the value of different outcomes. During intracranial self-stimulation (ICSS), the experimental subject has to choose between pressing the lever to trigger electrical pulses or engage in competitive activities, i.e., exploring the box, sniffing or resting. The time allocated to each activity by the experimental subject will depend on the perceived value of the stimulation.
Can the reward induced by the electrical pulses change by altering DA neurotransmission? ICSS was the first paradigm implemented to study different reward substrates and the role of DA in reward (Crow, 1972a,b). Indeed, the electrical train pulses injected by the electrode produce an increase in DA cell firing and DA release (Moisan and Rompré, 1998; Hernández and Shizgal, 2009). A large body of evidence shows that reward induced by electrical brain stimulation is highly sensitive to changes in VTA DA neurotransmission, as measured by the curve-shift paradigm. In this experimental preparation, a series of stimulation parameters (pulse frequencies or currents) that drives response rate from a maximal to a minimal level in an S-shaped manner are used (Miliaressis et al., 1986). Drugs that enhance DA levels such as DA transporter blocker GBR12909 produce a leftward displacement of the curve that relates operant performance to stimulation parameters (Rompré and Bauco, 1990). Thus, it is inferred that these drugs boost the rewarding effect of electrical brain stimulation. Opposite effects are obtained with DA receptor antagonists like haloperidol and raclopride (Nakajima and Baker, 1989).
What are the consequences of manipulating CB1Rs on ICSS? Since CB1R agonists increase DA output (Ng Cheong Ton et al., 1988; Chen et al., 1990); it was expected that they would potentiate the rewarding signal that arises from the electrical stimulation; whereas CB1 receptor antagonists would do the opposite. However, research from different groups yielded inconsistent evidence. The first reports using Δ9-THC, showed a reward enhancement effect that was dependent on the rat strain, such differences in rat strain correlated with differences in DA efflux in the NAc. Lewis rats showed the larger behavioral effect as well as, the higher DA release following the administration of Δ9-THC. In contrast, Fisher and Sprague-Daley rats showed a minimal behavioral effect and modest DA increments (Chen et al., 1991; Lepore et al., 1996). Several other studies using Long-Evans or Sprague-Daley rats have found a decrease in reward pursuit or no effect (Stark and Dews, 1980; Vlachou et al., 2007); whereas others have found different results depending on the dosage of Δ9-THC used. At low doses (0.1 mg/kg) a facilitation on reward is seen; whereas at a higher doses (1 mg/kg) a hindrance on reward is obtained (Katsidoni et al., 2013). Similar puzzling effects were observed with other CB1R agonists (Arnold et al., 2001; Antoniou et al., 2005). Using indirect agonists such as inhibitors of the enzymes that degrade eCBs (Vlachou et al., 2006; Kwilasz et al., 2014), has yielded a lack of effect or a decrease in reward pursuit (Arnold et al., 2001; Deroche-Gamonet et al., 2001; Vlachou et al., 2006).
These disparate results obtained in ICSS experiments using the curve-shift paradigm could be due to genetic differences as Gardner’s experiments suggest (Chen et al., 1991). Another explanation could be that systemic injections of these compounds produce an indiscriminate activation of all brain areas containing CB1Rs. Given that CB1Rs are the most abundant G-protein-coupled receptors in the brain (Herkenham et al., 1990) such broad activation is problematic for studying the neural underpinnings of reward evaluation and reward-seeking. These processes most likely require the activation of eCB synthesis and release to be region, neuron or even synapse-specific (Solinas et al., 2008). Thus, a wide activation of CB1R might give rise to negative or dysphoric effects that counteract their positive action on reward-seeking (Panagis et al., 2014). However, these explanations do not resolve why when using other experimental testing procedures (i.e., progressive ratio) CB1R agonist and antagonist produce behaviorally consistent results, even when using systematic injection and dose ranges similar to the ones used in ICSS experiments.
An alternative possibility relies on findings that the effects of CB1R agonists on DA release in the NAc are moderate at best when contrasted with other DA agonist or DA receptor blockers. Such modest DA release is problematic for traditional curve-shift paradigms used in ICSS experiments. The curve-shift paradigm lacks the dimensionality to differentiate between changes in the relative reward strength, the only dimension measured in this experimental preparation from changes in costs (opportunity and effort), to obtain a goal object. All these variables contribute to goal evaluation, and different researchers have shown the modulation of these by changes in DA efflux (Wise and Rompre, 1989; Salamone and Correa, 2002; Hernandez et al., 2012). So when using a two-dimensional perspective, non-measured changes on the “hidden” dimension can be misconstrued as an effect the subjective reward intensity.
Why is this methodological distinction important? If DA release does not modulate the relative value of a reward, then moderate changes in DA release would produce unreliable changes in curves relating behavior and stimulation intensity; as it is the case with CBRs agonist. When using the “mountain-model” (Arvanitogiannis and Shizgal, 2008) a testing paradigm that measures opportunity cost in addition to changes in stimulation strength, CB1R antagonists produce consistent decreases in opportunity cost. This reduction correlates with a consistent decrease in DA release (Trujillo-Pisanty et al., 2011). This effects mimics that of DA receptor antagonists (Trujillo-Pisanty et al., 2013), and it is consistent but of opposite direction with results obtained with non-specific and specific DA transport blockers (Hernandez et al., 2010; Hernandez and Cheer, 2012).
eCBs and Motivation
When electrical stimulation is used to study the effects of different manipulations on the eCB system, the results appear contradictory. With the inclusion of a third variable in the measuring paradigm, these are reconciled with the rest of the scientific research implicating CB1Rs in reward modulation, relating the motivation for obtaining different classes of rewards evaluated by several schedules of reinforcement. One of these is the progressive ratio where the requirements to acquire a single reward is exponentially increased, within a single session until the experimental organism stops responding. “Breakpoint” is the ratio at which the subject stops responding. It is assumed that this schedule measures the relation between response effort and the value of a particular reward (Hodos, 1961). Thus, inferences about the willingness of the organism to work to obtain a goal object can be drawn.
If cannabinoid agonists are used in conjunction with this schedule, they increase breakpoints. Thus, the experimental subjects are willing to lever-press more for a single reward. This effect has been consistent across different classes of rewards (Higgs et al., 2005; Solinas and Goldberg, 2005; Ward and Dykstra, 2005; Gamaleddin et al., 2012; Jones and Kirkham, 2012; Oleson et al., 2012) and equally consistent but opposite effects have been obtained with CB1R antagonists (Solinas and Goldberg, 2005; Ward and Dykstra, 2005; Maccioni et al., 2008; Rasmussen and Huskinson, 2008; Xi et al., 2008; Gamaleddin et al., 2012; Hernandez and Cheer, 2012). Recent research shows that inhibiting 2-AG degradation, but not anandamide increases breakpoints. Moreover, intra-VTA inhibition of 2-AG degradation facilitates reward-seeking and DA phasic release (Oleson et al., 2012).
eCBs and Discounting
The value of a goal object depends on how distant in the future it is. When an organism is deciding among different goal objects, it has to consider into its computations how distant in the future different goals objects are and take a decision based on the best-perceived alternative. At the decision point, the organism will select the option with the highest perceived value. Temporal discounting can be measured by allowing experimental subjects to choose between two alternatives: one that delivers an immediate but small reward vs. another that delivers a larger but delayed reward. Under this arrangement, and when questioned about future choices humans and non-humans subjects show a preference for the larger distant reward over the immediate small one. However, as time passes the difference between the small and large reward becomes less prominent and preference switches (Ainslie, 1975), this change occurs because immediate rewarding outcomes have a greater subjective value than delayed ones. Self-control is exercised when the delayed option is still preferred, whereas impulsivity takes place if the immediate option is chosen (Rachlin and Green, 1972).
DA firing and release are critically important for temporal discounting. DA phasic firing correlates positively with the magnitude of reward and decreases in a hyperbolic fashion with reward delay (Kobayashi and Schultz, 2008). Similarly, DA release in the NAc shows patterned release at the cue that predicts different delays. It shows a decrease that correlates with the length of the delay (Saddoris et al., 2015). When phasic DA release is measured at reward delivery DA release is higher for the larger reward at small to moderate delays, and then decreases to a level comparable to that of the small immediate reward (Hernandez et al., 2014).
By pharmacologically manipulating the DA system, during intertemporal choice tasks, different studies have shown that acute challenges with drugs that increase DA availability produce an increase in self-control. Experimental subjects choose more often the large delayed reward over the immediate small one (Cardinal et al., 2000; Wade et al., 2000; Winstanley et al., 2003, 2005; van Gaalen et al., 2006; Bizot et al., 2007). Conversely, drugs that interfere with DA availability produce an increase in impulsive choice (Wade et al., 2000; van Gaalen et al., 2006; Floresco et al., 2008). Experimental subjects choose more often the small immediate reward over one large delayed one. As a modulator of the DA system, eCB signaling produces remarkable results. Acute activation of CB1Rs with Δ9-THC leads to increased self-control that is blocked by CB1R antagonists. Interestingly, CB1R antagonists attenuate the effect of DA agonists (Wiskerke et al., 2011). When given alone CB1R antagonists do not exert a significant influence on self-control. These results suggest that the eCB system does not play a role in baseline temporal discounting (Pattij et al., 2007; Wiskerke et al., 2011; Hernandez et al., 2014).
Although acute increases in DA release increase self-control, the opposite happens when subjects have chronic experience with different drugs of abuse that directly or indirectly alters DA neurotransmission (Di Chiara and Imperato, 1988). Chronic drug exposure produces plastic changes in the mesolimbic circuitry and other brain areas and neurotransmitters that underlie addiction (Nestler, 2001; Everitt and Robbins, 2005; Kalivas and Volkow, 2005). As stated above, eCBs participate in the modulation of synaptic plasticity in the VTA (Melis et al., 2004; Haj-Dahmane and Shen, 2010); where they modulate DA neuron excitability (Lupica and Riegel, 2005; Maldonado et al., 2006). eCBs play a critical role in the increase of phasic DA release observed after the administration of different types of drugs of abuse (Cheer et al., 2007b). They are necessary for the development and expression of sensitization (Viganò et al., 2004; Corbillé et al., 2007; Azizi et al., 2009; Li et al., 2009; Blanco et al., 2014; Mereu et al., 2015). Also, eCB signaling is required for conditioned drug seeking and relapse (De Vries et al., 2001; De Vries and Schoffelmeer, 2005; Maldonado et al., 2006) as well as cue-induced reinstatement (De Vries et al., 2001, 2003; Xi et al., 2006). Therefore, the eCB system is likely to play a role in impulsive behavior observed in drug addiction.
Our laboratory recently found that eCB signaling is a canonical component in the development of impulsive choice caused by chronic cocaine exposure. Specifically, after experimental subjects were sensitized to the effects of cocaine they behaved impulsively in an intertemporal choice task (Mendez et al., 2010; Hernandez et al., 2014; Smethells and Carroll, 2015). The pattern of DA release in the NAc during the task correlates with behavioral performance. Before sensitization, higher DA release is observed for the larger reward when the delay is below 10-s. After sensitization has taken place, phasic release for the small immediate reward is comparatively higher regardless of the delay. Importantly, blockade of CB1Rs before cocaine exposure prevented not only impulsive choice, but it also eliminated maladaptive patterns of phasic DA release. More importantly, from a therapeutic perspective, CB1R blockade reverted changes in self-control observed following cocaine sensitization (Hernandez et al., 2014).
Future Directions
The research showcased in the present review demonstrates that the eCB system, via modulation of phasic DA release, plays important roles in decision-making processes. eCB signaling is critical for adjudicating value to different rewards as well as for activating, organizing and maintaining goal-directed behaviors. This happens under normal circumstances and is usurped when decision-making processes are compromised. However, the current state of this body of research is only a first step that will lead to a better understanding of the potential reach of the eCB system in decision-making processes. To further our knowledge, it is important to map each eCB action in all of the relevant circuits thoroughly. This requires elucidating the exact localization of CB1 receptors and their active ligands on cell-type specific nodes and under temporally-resolved circumstances. Such a targeted approach will greatly enhance our current understanding of the anatomical frameworks engaged in decision-making processes. With this information in hand, it will be possible to create models that more accurately predict changes in the behavior and the underlying neurochemistry.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This review was supported by NIH grant DA022340 to JFC; by Groupe de Recherche sur le Système Nerveux Central Herbert H. Jasper fellowship to GH.
References
Aguilar, D. D., Chen, L., and Lodge, D. J. (2015). Increasing endocannabinoid levels in the ventral pallidum restore aberrant dopamine neuron activity in the subchronic PCP rodent model of schizophrenia. Int. J. Neuropsychopharmacol. 18:pyu035. doi: 10.1093/ijnp/pyu035
Ainslie, G. (1975). Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol. Bull. 82, 463–496. doi: 10.1037/h0076860
Alger, B. E. (2002). Retrograde signaling in the regulation of synaptic transmission: focus on endocannabinoids. Prog. Neurobiol. 68, 247–286. doi: 10.1016/s0301-0082(02)00080-1
Antoniou, K., Galamopoulos, A., Vlachou, S., Thermos, K., Panagis, G., Daifoti, Z., et al. (2005). Behavioral pharmacological properties of a novel cannabinoid 1′,1′-dithiolane delta8-THC analog, AMG-3. Behav. Pharmacol. 16, 499–510. doi: 10.1097/00008877-200509000-00024
Arnold, J. C., Hunt, G. E., and McGregor, I. S. (2001). Effects of the cannabinoid receptor agonist CP 55,940 and the cannabinoid receptor antagonist SR 141716 on intracranial self-stimulation in Lewis rats. Life Sci. 70, 97–108. doi: 10.1016/s0024-3205(01)01366-2
Arvanitogiannis, A., and Shizgal, P. (2008). The reinforcement mountain: allocation of behavior as a function of the rate and intensity of rewarding brain stimulation. Behav. Neurosci. 122, 1126–1138. doi: 10.1037/a0012679
Azizi, P., Haghparast, A., and Hassanpour-Ezatti, M. (2009). Effects of CB1 receptor antagonist within the nucleus accumbens on the acquisition and expression of morphine-induced conditioned place preference in morphine-sensitized rats. Behav. Brain Res. 197, 119–124. doi: 10.1016/j.bbr.2008.08.009
Bergeron, S., and Rompré, P.-P. (2013). Blockade of ventral midbrain NMDA receptors enhances brain stimulation reward: a preferential role for GluN2A subunits. Eur. Neuropsychopharmacol. 23, 1623–1635. doi: 10.1016/j.euroneuro.2012.12.005
Berridge, K. C., and Robinson, T. E. (1998). What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res. Brain Res. Rev. 28, 309–369. doi: 10.1016/s0165-0173(98)00019-8
Bizot, J. C., Chenault, N., Houzé, B., Herpin, A., David, S., Pothion, S., et al. (2007). Methylphenidate reduces impulsive behaviour in juvenile wistar rats, but not in adult wistar, SHR and WKY rats. Psychopharmacology (Berl) 193, 215–223. doi: 10.1007/s00213-007-0781-4
Blanco, E., Pavón, F. J., Palomino, A., Luque-Rojas, M. J., Serrano, A., Rivera, P., et al. (2014). Cocaine-induced behavioral sensitization is associated with changes in the expression of endocannabinoid and glutamatergic signaling systems in the mouse prefrontal cortex. Int. J. Neuropsychopharmacol. 18:pyu024. doi: 10.1093/ijnp/pyu024
Cardinal, R. N., Pennicott, D. R., Sugathapala, C. L., Robbins, T. W., and Everitt, B. J. (2001). Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292, 2499–2501. doi: 10.1126/science.1060818
Cardinal, R. N., Robbins, T. W., and Everitt, B. J. (2000). The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology (Berl) 152, 362–375. doi: 10.1007/s002130000536
Chao, J., and Nestler, E. J. (2004). Molecular neurobiology of drug addiction. Annu. Rev. Med. 55, 113–132. doi: 10.1146/annurev.med.55.091902.103730
Cheer, J. F., Aragona, B. J., Heien, M. L., Seipel, A. T., Carelli, R. M., and Wightman, R. M. (2007a). Coordinated accumbal dopamine release and neural activity drive goal-directed behavior. Neuron 54, 237–244. doi: 10.1016/j.neuron.2007.03.021
Cheer, J. F., Wassum, K. M., Sombers, L. A., Heien, M. L. A. V., Ariansen, J. L., Aragona, B. J., et al. (2007b). Phasic dopamine release evoked by abused substances requires cannabinoid receptor activation. J. Neurosci. 27, 791–795. doi: 10.1523/jneurosci.4152-06.2007
Cheer, J. F., Marsden, C. A., Kendall, D. A., and Mason, R. (2000). Lack of response suppression follows repeated ventral tegmental cannabinoid administration: an in vitro electrophysiological study. Neuroscience 99, 661–667. doi: 10.1016/s0306-4522(00)00241-4
Chen, J., Paredes, W., Lowinson, J. H., and Gardner, E. L. (1990). Delta 9-tetrahydrocannabinol enhances presynaptic dopamine efflux in medial prefrontal cortex. Eur. J. Pharmacol. 190, 259–262. doi: 10.1016/0014-2999(90)94136-l
Chen, J. P., Paredes, W., Lowinson, J. H., and Gardner, E. L. (1991). Strain-specific facilitation of dopamine efflux by delta 9-tetrahydrocannabinol in the nucleus accumbens of rat: an in vivo microdialysis study. Neurosci. Lett. 129, 136–180. doi: 10.1016/0304-3940(91)90739-g
Conover, K. L., and Shizgal, P. (1994). Competition and summation between rewarding effects of sucrose and lateral hypothalamic stimulation in the rat. Behav. Neurosci. 108, 537–548. doi: 10.1037/0735-7044.108.3.537
Corbillé, A.-G., Valjent, E., Marsicano, G., Ledent, C., Lutz, B., Hervé, D., et al. (2007). Role of cannabinoid type 1 receptors in locomotor activity and striatal signaling in response to psychostimulants. J. Neurosci. 27, 6937–6947. doi: 10.1523/jneurosci.3936-06.2007
Crow, T. J. (1972a). Catecholamine-containing neurones and electrical self-stimulation: 1. a review of some data. Psychol. Med. 2, 414–421. doi: 10.1017/s0033291700045232
Crow, T. J. (1972b). A map of the rat mesencephalon for electrical self-stimulation. Brain Res. 36, 265–273. doi: 10.1016/0006-8993(72)90734-2
Day, J. J., Jones, J. L., and Carelli, R. M. (2011). Nucleus accumbens neurons encode predicted and ongoing reward costs in rats. Eur. J. Neurosci. 33, 308–321. doi: 10.1111/j.1460-9568.2010.07531.x
De Petrocellis, L., Cascio, M. G., and Di Marzo, V. (2004). The endocannabinoid system: a general view and latest additions. Br. J. Pharmacol. 141, 765–774. doi: 10.1038/sj.bjp.0705666
De Vries, T. J., Homberg, J. R., Binnekade, R., Raasø, H., and Schoffelmeer, A. N. M. (2003). Cannabinoid modulation of the reinforcing and motivational properties of heroin and heroin-associated cues in rats. Psychopharmacology (Berl) 168, 164–169. doi: 10.1007/s00213-003-1422-1
De Vries, T. J., and Schoffelmeer, A. N. M. (2005). Cannabinoid CB1 receptors control conditioned drug seeking. Trends Pharmacol. Sci. 26, 420–426. doi: 10.1016/j.tips.2005.06.002
De Vries, T. J., Shaham, Y., Homberg, J. R., Crombag, H., Schuurman, K., Dieben, J., et al. (2001). A cannabinoid mechanism in relapse to cocaine seeking. Nat. Med. 7, 1151–1154. doi: 10.1038/nm1001-1151
Deroche-Gamonet, V., Le Moal, M., Piazza, P. V., and Soubrié, P. (2001). SR141716, a CB1 receptor antagonist, decreases the sensitivity to the reinforcing effects of electrical brain stimulation in rats. Psychopharmacology (Berl) 157, 254–259. doi: 10.1007/s002130100804
Devane, W. A., Hanus, L., Breuer, A., Pertwee, R. G., Stevenson, L. A., Griffin, G., et al. (1992). Isolation and structure of a brain constituent that binds to the cannabinoid receptor. Science 258, 1946–1949. doi: 10.1126/science.1470919
Di Chiara, G., and Imperato, A. (1988). Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats. Proc. Natl. Acad. Sci. U S A 85, 5274–5278. doi: 10.1073/pnas.85.14.5274
Di Marzo, V. (2006). Endocannabinoids: synthesis and degradation. Rev. Physiol. Biochem. Pharmacol. 160, 1–24. doi: 10.1007/112_0505
Di Marzo, V., Fontana, A., Cadas, H., Schinelli, S., Cimino, G., Schwartz, J. C., et al. (1994). Formation and inactivation of endogenous cannabinoid anandamide in central neurons. Nature 372, 686–691. doi: 10.1038/372686a0
Dinh, T. P., Carpenter, D., Leslie, F. M., Freund, T. F., Katona, I., Sensi, S. L., et al. (2002). Brain monoglyceride lipase participating in endocannabinoid inactivation. Proc. Natl. Acad. Sci. U S A 99, 10819–10824. doi: 10.1073/pnas.152334899
Einhorn, L. C., Johansen, P. A., and White, F. J. (1988). Electrophysiological effects of cocaine in the mesoaccumbens dopamine system: studies in the ventral tegmental area. J. Neurosci. 8, 100–112.
Elphick, M. R., and Egertová, M. (2001). The neurobiology and evolution of cannabinoid signalling. Philos. Trans. R. Soc. Lond. B Biol. Sci. 356, 381–408. doi: 10.1098/rstb.2000.0787
Everitt, B. J., and Robbins, T. W. (2005). Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 8, 1481–1489. doi: 10.1038/nn1579
Floresco, S. B., Tse, M. T. L., and Ghods-Sharifi, S. (2008). Dopaminergic and glutamatergic regulation of effort- and delay-based decision making. Neuropsychopharmacology 33, 1966–1979. doi: 10.1038/sj.npp.1301565
French, E. D. (1997). delta9-Tetrahydrocannabinol excites rat VTA dopamine neurons through activation of cannabinoid CB1 but not opioid receptors. Neurosci. Lett. 226, 159–162. doi: 10.1016/s0304-3940(97)00278-4
Gamaleddin, I., Wertheim, C., Zhu, A. Z. X., Coen, K. M., Vemuri, K., Makryannis, A., et al. (2012). Cannabinoid receptor stimulation increases motivation for nicotine and nicotine seeking. Addict. Biol. 17, 47–61. doi: 10.1111/j.1369-1600.2011.00314.x
Gessa, G., Melis, M., Muntoni, A., and Diana, M. (1998). Cannabinoids activate mesolimbic dopamine neurons by an action on cannabinoid CB1 receptors. Eur. J. Pharmacol. 341, 39–44. doi: 10.1016/s0014-2999(97)01442-8
Ghods-Sharifi, S., and Floresco, S. B. (2010). Differential effects on effort discounting induced by inactivations of the nucleus accumbens core or shell. Behav. Neurosci. 124, 179–191. doi: 10.1037/a0018932
Grace, A. A., and Bunney, B. S. (1984). The control of firing pattern in nigral dopamine neurons: burst firing. J. Neurosci. 4, 2877–2890.
Haj-Dahmane, S., and Shen, R.-Y. (2010). Regulation of plasticity of glutamate synapses by endocannabinoids and the cyclic-AMP/protein kinase A pathway in midbrain dopamine neurons. J. Physiol. 588, 2589–2604. doi: 10.1113/jphysiol.2010.190066
Herkenham, M., Lynn, A. B., Johnson, M. R., Melvin, L. S., de Costa, B. R., and Rice, K. C. (1991). Characterization and localization of cannabinoid receptors in rat brain: a quantitative in vitro autoradiographic study. J. Neurosci. 11, 563–583.
Herkenham, M., Lynn, A. B., Little, M. D., Johnson, M. R., Melvin, L. S., de Costa, B. R., et al. (1990). Cannabinoid receptor localization in brain. Proc. Natl. Acad. Sci. U S A 87, 1932–1936. doi: 10.1073/pnas.87.5.1932
Hernandez, G., Bernstein, D., Schoenbaum, G., and Cheer, J. F. (2011). Contrasting effects of lithium chloride and cb1 receptor blockade on enduring changes in the valuation of reward. Front. Behav. Neurosci. 5:53. doi: 10.3389/fnbeh.2011.00053
Hernandez, G., Breton, Y.-A., Conover, K., and Shizgal, P. (2010). At what stage of neural processing does cocaine act to boost pursuit of rewards? PLoS One 5:e15081. doi: 10.1371/journal.pone.0015081
Hernandez, G., and Cheer, J. F. (2012). Effect of CB1 receptor blockade on food-reinforced responding and associated nucleus accumbens neuronal activity in rats. J. Neurosci. 32, 11467–11477. doi: 10.1523/JNEUROSCI.1833-12.2012
Hernandez, G., Khodami-Pour, A., Lévesque, D., and Rompré, P.-P. (2015). Reduction in ventral midbrain nmda receptors reveals two opposite modulatory roles for glutamate on reward. Neuropsychopharmacology 40, 1682–1691. doi: 10.1038/npp.2015.14
Hernandez, G., Oleson, E. B., Gentry, R. N., Abbas, Z., Bernstein, D. L., Arvanitogiannis, A., et al. (2014). Endocannabinoids promote cocaine-induced impulsivity and its rapid dopaminergic correlates. Biol. Psychiatry 75, 487–498. doi: 10.1016/j.biopsych.2013.09.005
Hernández, G., and Shizgal, P. (2009). Dynamic changes in dopamine tone during self-stimulation of the ventral tegmental area in rats. Behav. Brain Res. 198, 91–97. doi: 10.1016/j.bbr.2008.10.017
Hernandez, G., Trujillo-Pisanty, I., Cossette, M.-P., Conover, K., and Shizgal, P. (2012). Role of dopamine tone in the pursuit of brain stimulation reward. J. Neurosci. 32, 11032–11041. doi: 10.1523/JNEUROSCI.1051-12.2012
Higgs, S., Barber, D. J., Cooper, A. J., and Terry, P. (2005). Differential effects of two cannabinoid receptor agonists on progressive ratio responding for food and free-feeding in rats. Behav. Pharmacol. 16, 389–393. doi: 10.1097/00008877-200509000-00011
Hodos, W. (1961). Progressive ratio as a measure of reward strength. Science 134, 943–944. doi: 10.1126/science.134.3483.943
Howlett, A. C., Barth, F., Bonner, T. I., Cabral, G., Casellas, P., Devane, W. A., et al. (2002). International union of pharmacology. XXVII. Classification of cannabinoid receptors. Pharmacol. Rev. 54, 161–202. doi: 10.1124/pr.54.2.161
Jhou, T. C., Fields, H. L., Baxter, M. G., Saper, C. B., and Holland, P. C. (2009a). The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses. Neuron 61, 786–800. doi: 10.1016/j.neuron.2009.02.001
Jhou, T. C., Geisler, S., Marinelli, M., Degarmo, B. A., and Zahm, D. S. (2009b). The mesopontine rostromedial tegmental nucleus: a structure targeted by the lateral habenula that projects to the ventral tegmental area of Tsai and substantia nigra compacta. J. Comp. Neurol. 513, 566–596. doi: 10.1002/cne.21891
Johnson, S. W., and North, R. A. (1992). Two types of neurone in the rat ventral tegmental area and their synaptic inputs. J. Physiol. 450, 455–468. doi: 10.1113/jphysiol.1992.sp019136
Jones, E. K., and Kirkham, T. C. (2012). Noladin ether, a putative endocannabinoid, enhances motivation to eat after acute systemic administration in rats. Br. J. Pharmacol. 166, 1815–1821. doi: 10.1111/j.1476-5381.2012.01888.x
Julian, M. D., Martin, A. B., Cuellar, B., Rodriguez De Fonseca, F., Navarro, M., Moratalla, R., et al. (2003). Neuroanatomical relationship between type 1 cannabinoid receptors and dopaminergic systems in the rat basal ganglia. Neuroscience 119, 309–318. doi: 10.1016/s0306-4522(03)00070-8
Kable, J. W., and Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10, 1625–1633. doi: 10.1038/nn2007
Kalivas, P. W., Churchill, L., and Klitenick, M. A. (1993). GABA and enkephalin projection from the nucleus accumbens and ventral pallidum to the ventral tegmental area. Neuroscience 57, 1047–1060. doi: 10.1016/0306-4522(93)90048-k
Kalivas, P. W., and Volkow, N. D. (2005). The neural basis of addiction: a pathology of motivation and choice. Am. J. Psychiatry 162, 1403–1413. doi: 10.1176/appi.ajp.162.8.1403
Katsidoni, V., Kastellakis, A., and Panagis, G. (2013). Biphasic effects of Δ9-tetrahydrocannabinol on brain stimulation reward and motor activity. Int. J. Neuropsychopharmacol. 16, 2273–2284. doi: 10.1017/S1461145713000709
Kobayashi, S., and Schultz, W. (2008). Influence of reward delays on responses of dopamine neurons. J. Neurosci. 28, 7837–7846. doi: 10.1523/JNEUROSCI.1600-08.2008
Koob, G. F. (1992). Drugs of abuse: anatomy, pharmacology and function of reward pathways. Trends Pharmacol. Sci. 13, 177–184. doi: 10.1016/0165-6147(92)90060-j
Kwilasz, A. J., Abdullah, R. A., Poklis, J. L., Lichtman, A. H., and Negus, S. S. (2014). Effects of the fatty acid amide hydrolase inhibitor URB597 on pain-stimulated and pain-depressed behavior in rats. Behav. Pharmacol. 25, 119–129. doi: 10.1097/fbp.0000000000000023
Lak, A., Stauffer, W. R., and Schultz, W. (2014). Dopamine prediction error responses integrate subjective value from different reward dimensions. Proc. Natl. Acad. Sci. U S A 111, 2343–2348. doi: 10.1073/pnas.1321596111
Lecca, S., Melis, M., Luchicchi, A., Ennas, M. G., Castelli, M. P., Muntoni, A. L., et al. (2011). Effects of drugs of abuse on putative rostromedial tegmental neurons, inhibitory afferents to midbrain dopamine cells. Neuropsychopharmacology 36, 589–602. doi: 10.1038/npp.2010.190
Lecca, S., Melis, M., Luchicchi, A., Muntoni, A. L., and Pistis, M. (2012). Inhibitory inputs from rostromedial tegmental neurons regulate spontaneous activity of midbrain dopamine cells and their responses to drugs of abuse. Neuropsychopharmacology 37, 1164–1176. doi: 10.1038/npp.2011.302
Lepore, M., Liu, X., Savage, V., Matalon, D., and Gardner, E. L. (1996). Genetic differences in D9-tetrahydrocannabinol-induced facilitation of brain stimulation reward as measured by a rate-frequency curve-shift electrical brain stimulation paradigm in three different rat strains. Life Sci. 58, PL365–PL372. doi: 10.1016/0024-3205(96)00237-8
Li, X., Hoffman, A. F., Peng, X.-Q., Lupica, C. R., Gardner, E. L., and Xi, Z.-X. (2009). Attenuation of basal and cocaine-enhanced locomotion and nucleus accumbens dopamine in cannabinoid CB1-receptor-knockout mice. Psychopharmacology (Berl) 204, 1–11. doi: 10.1007/s00213-008-1432-0
Lobb, C., Wilson, C., and Paladini, C. (2010). A dynamic role for GABA receptors on the firing pattern of midbrain dopaminergic neurons. J. Neurophysiol. 104, 403–413. doi: 10.1152/jn.00204.2010
Lupica, C. R., and Riegel, A. C. (2005). Endocannabinoid release from midbrain dopamine neurons: a potential substrate for cannabinoid receptor antagonist treatment of addiction. Neuropharmacology 48, 1105–1116. doi: 10.1016/j.neuropharm.2005.03.016
Lupica, C. R., Riegel, A. C., and Hoffman, A. F. (2004). Marijuana and cannabinoid regulation of brain reward circuits. Br. J. Pharmacol. 143, 227–234. doi: 10.1038/sj.bjp.0705931
Maccioni, P., Pes, D., Carai, M. A. M., Gessa, G. L., and Colombo, G. (2008). Suppression by the cannabinoid CB1 receptor antagonist, rimonabant, of the reinforcing and motivational properties of a chocolate-flavoured beverage in rats. Behav. Pharmacol. 19, 197–209. doi: 10.1097/FBP.0b013e3282fe8888
Mackie, K. (2005). “Distribution of cannabinoid receptors in the central and peripheral nervous system,” in Cannabinoids, ed. R. Pertwee (Berlin: Springer, Heidelberg: Handbook of Experimental Pharmacology), 299–325.
Mackie, K., Lai, Y., Westenbroek, R., and Mitchell, R. (1995). Cannabinoids activate an inwardly rectifying potassium conductance and inhibit Q-type calcium currents in AtT20 cells transfected with rat brain cannabinoid receptor. J. Neurosci. 15, 6552–6561.
Maejima, T., Hashimoto, K., Yoshida, T., Aiba, A., and Kano, M. (2001). Presynaptic inhibition caused by retrograde signal from metabotropic glutamate to cannabinoid receptors. Neuron 31, 463–475. doi: 10.1016/s0896-6273(01)00375-0
Maldonado, R., Valverde, O., and Berrendero, F. (2006). Involvement of the endocannabinoid system in drug addiction. Trends Neurosci. 29, 225–232. doi: 10.1016/j.tins.2006.01.008
Marinelli, S., Di Marzo, V., Florenzano, F., Fezza, F., Viscomi, M. T., van der Stelt, M., et al. (2007). N-arachidonoyl-dopamine tunes synaptic transmission onto dopaminergic neurons by activating both cannabinoid and vanilloid receptors. Neuropsychopharmacology 32, 298–308. doi: 10.1038/sj.npp.1301118
Matsuda, L. A., Lolait, S. J., Brownstein, M. J., Young a, C., and Bonner, T. I. (1990). Structure of a cannabinoid receptor and functional expression of the cloned cDNA. Nature 346, 561–564. doi: 10.1038/346561a0
Matsuda, L. A., Bonner, T. I., and Lolait, S. J. (1993). Localization of cannabinoid receptor mRNA in rat brain. J. Comp. Neurol. 327, 535–550. doi: 10.1002/cne.903270406
Matsumoto, M., and Hikosaka, O. (2009). Representation of negative motivational value in the primate lateral habenula. Nat. Neurosci. 12, 77–84. doi: 10.1038/nn.2233
Mátyás, F., Urbán, G. M., Watanabe, M., Mackie, K., Zimmer, A., Freund, T. F., et al. (2008). Identification of the sites of 2-arachidonoylglycerol synthesis and action imply retrograde endocannabinoid signaling at both GABAergic and glutamatergic synapses in the ventral tegmental area. Neuropharmacology 54, 95–107. doi: 10.1016/j.neuropharm.2007.05.028
Melis, M., Pillolla, G., Bisogno, T., Minassi, A., Petrosino, S., Perra, S., et al. (2006). Protective activation of the endocannabinoid system during ischemia in dopamine neurons. Neurobiol. Dis. 24, 15–27. doi: 10.1016/j.nbd.2006.04.010
Melis, M., and Pistis, M. (2007). Endocannabinoid signaling in midbrain dopamine neurons: more than physiology? Curr. Neuropharmacol. 5, 268–277. doi: 10.2174/157015907782793612
Melis, M., and Pistis, M. (2012). Hub and switches: endocannabinoid signaling in midbrain dopamine neurons. Philos. Trans. R. Soc. Lond. B Biol. Sci. 367, 3276–3285. doi: 10.1098/rstb.2011.0383
Melis, M., Pistis, M., Perra, S., Muntoni, A. L., Pillolla, G., and Gessa, G. L. (2004). Endocannabinoids mediate presynaptic inhibition of glutamatergic transmission in rat ventral tegmental area dopamine neurons through activation of CB1 receptors. J. Neurosci. 24, 53–62. doi: 10.1523/jneurosci.4503-03.2004
Mendez, I. A., Simon, N. W., Hart, N., Mitchell, M. R., Nation, J. R., Wellman, P. J., et al. (2010). Self-administered cocaine causes long-lasting increases in impulsive choice in a delay discounting task. Behav. Neurosci. 124, 470–477. doi: 10.1037/a0020458
Mereu, M., Tronci, V., Chun, L. E., Thomas, A. M., Green, J. L., Katz, J. L., et al. (2015). Cocaine-induced endocannabinoid release modulates behavioral and neurochemical sensitization in mice. Addict. Biol. 20, 91–103. doi: 10.1111/adb.12080
Miliaressis, E., Rompre, P. P., Laviolette, P., Philippe, L., and Coulombe, D. (1986). The curve-shift paradigm in self-stimulation. Physiol. Behav. 37, 85–91. doi: 10.1016/0031-9384(86)90388-4
Mogenson, G. J., Jones, D. L., and Yim, C. Y. (1980). From motivation to action: functional interface between the limbic system and the motor system. Prog. Neurobiol. 14, 69–97. doi: 10.1016/0301-0082(80)90018-0
Moisan, J., and Rompré, P. P. (1998). Electrophysiological evidence that a subset of midbrain dopamine neurons integrate the reward signal induced by electrical stimulation of the posterior mesencephalon. Brain Res. 786, 143–152. doi: 10.1016/s0006-8993(97)01457-1
Nakajima, S., and Baker, J. D. (1989). Psychopharmacology Effects of D2 dopamine receptor blockade with raclopride on intracranial self-stimulation and food-reinforced operant behaviour. Psychopharmacology (Berl) 98, 330–333. doi: 10.1007/bf00451683
Nestler, E. J. (2001). Molecular basis of long-term plasticity underlying addiction. Nat. Rev. Neurosci. 2, 119–128. doi: 10.1038/35053570
Ng Cheong Ton, J. M., Gerhardt, G. A., Friedemann, M., Etgen, A. M., Rose, G. M., Sharpless, N. S., et al. (1988). The effects of delta 9-tetrahydrocannabinol on potassium-evoked release of dopamine in the rat caudate nucleus: an in vivo electrochemical and in vivo microdialysis study. Brain Res. 451, 59–68. doi: 10.1016/0006-8993(88)90749-4
Niv, Y., Daw, N. D., Joel, D., and Dayan, P. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 191, 507–520. doi: 10.1007/s00213-006-0502-4
Oleson, E. B., Beckert, M. V., Morra, J. T., Lansink, C. S., Cachope, R., Abdullah, R. A., et al. (2012). Endocannabinoids shape accumbal encoding of cue-motivated behavior via CB1 receptor activation in the ventral tegmentum. Neuron 73, 360–373. doi: 10.1016/j.neuron.2011.11.018
Olds, J., and Milner, P. (1954). Positive reinforcement produced by electrical stimulation of septal area and other regions of rat brain. J. Comp. Physiol. Psychol. 47, 419–427.
Overton, P. G., and Clark, D. (1997). Burst firing in midbrain dopaminergic neurons. Brain Res. Brain Res. Rev. 25, 312–334. doi: 10.1016/s0165-0173(97)00039-8
Panagis, G., Mackey, B., and Vlachou, S. (2014). Cannabinoid regulation of brain reward processing with an emphasis on the role of cb1 receptors: a step back into the future. Front. Psychiatry 5:92. doi: 10.3389/fpsyt.2014.00092
Pattij, T., Janssen, M. C. W., Schepers, I., González-Cuevas, G., de Vries, T. J., and Schoffelmeer, A. N. M. (2007). Effects of the cannabinoid CB1 receptor antagonist rimonabant on distinct measures of impulsive behavior in rats. Psychopharmacology (Berl) 193, 85–96. doi: 10.1007/s00213-007-0773-4
Pennartz, C. M. A., Groenewegen, H. J., and Lopes da Silva, F. H. (1994). The nucleus accumbens as a complex of functionally distinct neuronal ensembles: an integration of behavioural, electrophysiological and anatomical data. Prog. Neurobiol. 42, 719–761. doi: 10.1016/0301-0082(94)90025-6
Rachlin, H., and Green, L. (1972). Commitment, choice, and self-control. J. Exp. Anal. Behav. 17, 15–22.
Rahman, S., and McBride, W. J. (2000). Feedback control of mesolimbic somatodendritic dopamine release in rat brain. J. Neurochem. 74, 684–692. doi: 10.1046/j.1471-4159.2000.740684.x
Rasmussen, E. B., and Huskinson, S. L. (2008). Effects of rimonabant on behavior maintained by progressive ratio schedules of sucrose reinforcement in obese Zucker (fa/fa) rats. Behav. Pharmacol. 19, 735–742. doi: 10.1097/FBP.0b013e3283123cc2
Riegel, A. C., and Lupica, C. R. (2004). Independent presynaptic and postsynaptic mechanisms regulate endocannabinoid signaling at multiple synapses in the ventral tegmental area. J. Neurosci. 24, 11070–11078. doi: 10.1523/jneurosci.3695-04.2004
Roesch, M. R., and Bryden, D. W. (2011). Impact of size and delay on neural activity in the rat limbic corticostriatal system. Front. Neurosci. 5:130. doi: 10.3389/fnins.2011.00130
Roesch, M. R., Calu, D. J., and Schoenbaum, G. (2007). Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat. Neurosci. 10, 1615–1624. doi: 10.1038/nn2013
Rompré, P. P., and Bauco, P. (1990). GBR 12909 reverses the SCH 23390 inhibition of rewarding effects of brain stimulation. Eur. J. Pharmacol. 182, 181–184. doi: 10.1016/0014-2999(90)90510-d
Saddoris, M. P., Sugam, J. A., Stuber, G. D., Witten, I. B., Deisseroth, K., and Carelli, R. M. (2015). Mesolimbic dopamine dynamically tracks and is causally linked to, discrete aspects of value-based decision making. Biol. Psychiatry 77, 903–911. doi: 10.1016/j.biopsych.2014.10.024
Salamone, J. D., and Correa, M. (2002). Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav. Brain Res. 137, 3–25. doi: 10.1016/s0166-4328(02)00282-6
Salamone, J. D., Correa, M., Farrar, A., and Mingote, S. M. (2007). Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology (Berl) 191, 461–482. doi: 10.1007/s00213-006-0668-9
Schultz, W. (2010). Dopamine signals for reward value and risk: basic and recent data. Behav. Brain Funct. 6:24. doi: 10.1186/1744-9081-6-24
Shizgal, P., and Murray, B. (1989). “Neuronal basis of intracranial self-stimulation,” in The Neuropharmacological Basis of Reward, eds J. M. Liebman and S. J. Cooper (Oxford: Oxford University Press), 106–163.
Smethells, J. R., and Carroll, M. E. (2015). Discrepant effects of acute cocaine on impulsive choice (delay discounting) in female rats during an increasing- and adjusting-delay procedure. Psychopharmacology (Berl) 232, 2455–2462. doi: 10.1007/s00213-015-3874-5
Smith, K. S., Berridge, K. C., and Aldridge, J. W. (2011). Disentangling pleasure from incentive salience and learning signals in brain reward circuitry. Proc. Natl. Acad. Sci. U S A 108, E255–E264. doi: 10.1073/pnas.1101920108
Solinas, M., and Goldberg, S. R. (2005). Motivational effects of cannabinoids and opioids on food reinforcement depend on simultaneous activation of cannabinoid and opioid systems. Neuropsychopharmacology 30, 2035–2045. doi: 10.1038/sj.npp.1300720
Solinas, M., Goldberg, S. R., and Piomelli, D. (2008). The endocannabinoid system in brain reward processes. Br. J. Pharmacol. 154, 369–383. doi: 10.1038/bjp.2008.130
Stark, P., and Dews, P. B. (1980). Cannabinoids. I. Behavioral effects. J. Pharmacol. Exp. Ther. 214, 124–130.
Stopper, C. M., Tse, M. T. L., Montes, D. R., Wiedman, C. R., and Floresco, S. B. (2014). Overriding phasic dopamine signals redirects action selection during risk/reward decision making. Neuron 84, 177–189. doi: 10.1016/j.neuron.2014.08.033
Sugita, S., Johnson, S. W., and North, R. A. (1992). Synaptic inputs to GABAA and GABAB receptors originate from discrete afferent neurons. Neurosci. Lett. 134, 207–211. doi: 10.1016/0304-3940(92)90518-c
Szabo, B., Siemes, S., and Wallmichrath, I. (2002). SHORT COMMUNICATION Inhibition of GABAergic neurotransmission in the ventral tegmental area by cannabinoids. Eur. J. Neurosci. 15, 2057–2061. doi: 10.1046/j.1460-9568.2002.02041.x
Tanda, G., Pontieri, F. E., and Di Chiara, G. (1997). Cannabinoid and heroin activation of mesolimbic dopamine transmission by a common mu1 opioid receptor mechanism. Science 276, 2048–2050. doi: 10.1126/science.276.5321.2048
Tobler, P. N., Fiorillo, C. D., and Schultz, W. (2005). Adaptive coding of reward value by dopamine neurons. Science 307, 1642–1645. doi: 10.1126/science.1105370
Trujillo-Pisanty, I., Conover, K., and Shizgal, P. (2013). A new view of the effect of dopamine receptor antagonism on operant performance for rewarding brain stimulation in the rat. Psychopharmacology (Berl) 231, 1351–1364. doi: 10.1007/s00213-013-3328-x
Trujillo-Pisanty, I., Hernandez, G., Moreau-Debord, I., Cossette, M.-P., Conover, K., Cheer, J. F., et al. (2011). Cannabinoid receptor blockade reduces the opportunity cost at which rats maintain operant performance for rewarding brain stimulation. J. Neurosci. 31, 5426–5435. doi: 10.1523/JNEUROSCI.0079-11.2011
Twitchell, W., Brown, S., and Mackie, K. (1997). Cannabinoids inhibit N- and P/Q-type calcium channels in cultured rat hippocampal neurons. J. Neurophysiol. 78, 43–50.
van Gaalen, M. M., van Koten, R., Schoffelmeer, A. N. M., and Vanderschuren, L. J. M. J. (2006). Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol. Psychiatry 60, 66–73. doi: 10.1016/j.biopsych.2005.06.005
Viganò, D., Valenti, M., Cascio, M. G., Di Marzo, V., Parolaro, D., and Rubino, T. (2004). Changes in endocannabinoid levels in a rat model of behavioural sensitization to morphine. Eur. J. Neurosci. 20, 1849–1857. doi: 10.1111/j.1460-9568.2004.03645.x
Vlachou, S., Nomikos, G. G., and Panagis, G. (2006). Effects of endocannabinoid neurotransmission modulators on brain stimulation reward. Psychopharmacology (Berl) 188, 293–305. doi: 10.1007/s00213-006-0506-0
Vlachou, S., Nomikos, G. G., Stephens, D. N., and Panagis, G. (2007). Lack of evidence for appetitive effects of Delta 9-tetrahydrocannabinol in the intracranial self-stimulation and conditioned place preference procedures in rodents. Behav. Pharmacol. 18, 311–319. doi: 10.1097/fbp.0b013e3282186cf2
Wade, T. R., de Wit, H., and Richards, J. B. (2000). Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology (Berl) 150, 90–101. doi: 10.1007/s002130000402
Walaas, I., and Fonnum, F. (1980). Biochemical evidence for γ-aminobutyrate containing fibres from the nucleus accumbens to the substantia nigra and ventral tegmental area in the rat. Neuroscience 5, 63–72. doi: 10.1016/0306-4522(80)90071-8
Ward, S. J., and Dykstra, L. A. (2005). The role of CB1 receptors in sweet versus fat reinforcement: effect of CB1 receptor deletion, CB1 receptor antagonism (SR141716A) and CB1 receptor agonism (CP-55940). Behav. Pharmacol. 16, 381–388. doi: 10.1097/00008877-200509000-00010
Wilson, R. I., and Nicoll, R. A. (2001). Endogenous cannabinoids mediate retrograde signalling at hippocampal synapses. Nature 410, 588–592. doi: 10.1038/35082121
Winstanley, C. A., Dalley, J. W., Theobald, D. E. H., and Robbins, T. W. (2003). Global 5-HT depletion attenuates the ability of amphetamine to decrease impulsive choice on a delay-discounting task in rats. Psychopharmacology (Berl) 170, 320–331. doi: 10.1007/s00213-003-1546-3
Winstanley, C. A., Theobald, D. E. H., Dalley, J. W., and Robbins, T. W. (2005). Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders. Neuropsychopharmacology 30, 669–682. doi: 10.1038/sj.npp.1300610
Winters, B. D., Krüger, J. M., Huang, X., Gallaher, Z. R., Ishikawa, M., Czaja, K., et al. (2012). Cannabinoid receptor 1-expressing neurons in the nucleus accumbens. Proc. Natl. Acad. Sci. U S A 109, E2717–E2725. doi: 10.1073/pnas.1206303109
Wise, R. A., and Rompre, P. P. (1989). Brain dopamine and reward. Annu. Rev. Psychol. 40, 191–225. doi: 10.1146/annurev.psych.40.1.191
Wiskerke, J., Stoop, N., Schetters, D., Schoffelmeer, A. N. M., and Pattij, T. (2011). Cannabinoid CB1 receptor activation mediates the opposing effects of amphetamine on impulsive action and impulsive choice. PLoS One 6:e25856. doi: 10.1371/journal.pone.0025856
Wu, X., and French, E. D. (2000). Effects of chronic delta9-tetrahydrocannabinol on rat midbrain dopamine neurons: an electrophysiological assessment. Neuropharmacology 39, 391–398. doi: 10.1016/s0028-3908(99)00140-9
Xi, Z.-X., Gilbert, J. G., Peng, X.-Q., Pak, A. C., Li, X., and Gardner, E. L. (2006). Cannabinoid CB1 receptor antagonist AM251 inhibits cocaine-primed relapse in rats: role of glutamate in the nucleus accumbens. J. Neurosci. 26, 8531–8536. doi: 10.1523/jneurosci.0726-06.2006
Xi, Z.-X., Spiller, K., Pak, A. C., Gilbert, J., Dillon, C., Li, X., et al. (2008). Cannabinoid CB1 receptor antagonists attenuate cocaine’s rewarding effects: experiments with self-administration and brain-stimulation reward in rats. Neuropsychopharmacology 33, 1735–1745. doi: 10.1038/sj.npp.1301552
Xia, Y., Driscoll, J. R., Wilbrecht, L., Margolis, E. B., Fields, H. L., and Hjelmstad, G. O. (2011). Nucleus accumbens medium spiny neurons target non-dopaminergic neurons in the ventral tegmental area. J. Neurosci. 31, 7811–7816. doi: 10.1523/JNEUROSCI.1504-11.2011
Zweifel, L. S., Parker, J. G., Lobb, C. J., Rainwater, A., Wall, V. Z., Fadok, J. P., et al. (2009). Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior. Proc. Natl. Acad. Sci. U S A 106, 7281–7288. doi: 10.1073/pnas.0813415106
Keywords: endocannabinoids, dopamine, pre-clinical studies, decision-making, reward
Citation: Hernandez G and Cheer JF (2015) To Act or Not to Act: Endocannabinoid/Dopamine Interactions in Decision-Making. Front. Behav. Neurosci. 9:336. doi: 10.3389/fnbeh.2015.00336
Received: 12 August 2015; Accepted: 19 November 2015;
Published: 17 December 2015.
Edited by:
Gregory B. Bissonette, University of Maryland, USAReviewed by:
J. Wayne Aldridge, University of Michigan, USAThomas J. Anastasio, University of Illinois at Urbana-Champaign, USA
Copyright © 2015 Hernandez and Cheer. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Giovanni Hernandez, giovannih@gmail.com