Abstract
An influential model suggests that dopamine signals the difference between predicted and experienced reward. In this way, dopamine can act as a learning signal that can shape behaviors to maximize rewards and avoid punishments. Dopamine is also thought to invigorate reward seeking behavior. Loss of dopamine signaling is the major abnormality in Parkinson’s disease. Dopamine agonists have been implicated in the occurrence of impulse control disorders in Parkinson’s disease patients, the most common being pathological gambling, compulsive sexual behavior, and compulsive buying. Recently, a number of functional imaging studies investigating impulse control disorders in Parkinson’s disease have been published. Here we review this literature, and attempt to place it within a decision-making framework in which potential gains and losses are evaluated to arrive at optimum choices. We also provide a hypothetical but still incomplete model on the effect of dopamine agonist treatment on these value and risk assessments. Two of the main brain structures thought to be involved in computing aspects of reward and loss are the ventral striatum (VStr) and the insula, both dopamine projection sites. Both structures are consistently implicated in functional brain imaging studies of pathological gambling in Parkinson’s disease.
Gambling as a disorder of reward and punishment processing
Pathological gambling can be conceptualized as a disorder of reward and punishment processing, whereby the gambler selects an immediate but risky opportunity to obtain money over the larger, more probable opportunity to save money (Ochoa et al., ). Indeed, gambling is typically conceptualized as a disorder of impulsivity, in which decision-making is rash and relatively uninfluenced by future consequences. Pathological gamblers demonstrate increased impulsivity and increased delayed discounting on laboratory measures (Verdejo-Garcia et al., 2008). The coupling of increased reward seeking behavior with insensitivity to negative consequences may explain the persistence of gambling in the face of overall monetary losses (Vitaro et al., 1999; Petry, 2001b; Cavedini et al., ). This conceptual framework is similar to that used in drug addiction, where seeking immediate gains while minimizing potential risks is ubiquitous. Hallmarks of addiction include cravings or compulsions, a loss of control, and continued engagement in behaviors that maintain the addiction despite repeated negative consequences (American Psychiatric Association, ). Similarly, pathological gambling can be referred to as a behavioral addiction because it shares many common features with drug-addiction, such as compulsion and loss of control over one’s behavior, as well as continuation of the behavior in the face of negative consequences (Grant et al., ; Goodman, ). Pathological gamblers exhibit uncontrollable cravings, tolerance, habituation, and withdrawal symptoms, similar to those of drug addicts (Wray and Dickerson, 1981; Castellani and Rugle, ; Duvarci and Varan, ; Potenza et al., 2003). Moreover, both pathological gambling and substance abuse are associated with the same specific personality traits, namely sensation seeking and impulsivity (Zuckerman and Neeb, 1979; Castellani and Rugle, ), which index heightened arousal to potential rewards and reduced self-control and inhibitory function. The high comorbidity between substance dependence (drugs and alcohol) and pathological gambling (Petry, 2001a; Petry et al., ), and evidence for common genetic factors, point to the two disorders having overlapping etiologies (Slutske et al., 2000; Goodman, ).
One useful model views reward and punishment learning as inherent components in the decision-making process. Decision-making can be broken down to the weighing of the probability and value of reward against potential costs (e.g., negative consequences). Other factors such as outcome ambiguity and variance (sometimes referred to as risk) also affect individual choices (Huettel et al., ), but here we will only consider potential gains and losses as determinants of decision-making while gambling. We will also take “risk” to mean the potential loss attached to any choice. Risk, as so defined, increases with the magnitude and probability of potential losses. In fact, risk-taking may be seen as an indicator of the balance existing between computations of potential gains and losses. Two of the main brain structures thought to be involved in these computations are the ventral striatum (VStr) and the insula, both dopamine projection sites. Both have been linked to computations of value, with the VStr being especially responsive to reward prediction error (RPE), encoding gain anticipation positively and loss anticipation negatively (Rutledge et al., 2010; Bartra et al., ), and the insula responding predominantly to losses and loss anticipation in some studies (Knutson and Greer, ) or to both positive and negative outcomes in others (Campbell-Meiklejohn et al., ; Rutledge et al., 2010). Bartra et al.’s meta-analysis (Figure 1) suggests that the insula encodes arousal or salience as opposed to value, as it responds positively to both gains and losses. This meta-analysis also raises the possibility of a greater role for the insula in the assessment of risk and losses than gains (compare panels A and B in Figure 1). Alteration of the balance between these gain and loss anticipation systems may underlie the inappropriate choice behaviors that occur in disorders such as addiction, gambling and impulse control disorders.
Figure 1
Recent research suggests that differences in brain function, structure, and biochemistry are present in those who develop gambling problems, with dopamine being a common etiological factor. Imaging studies have demonstrated an increase in mesolimbic dopamine release during gambling tasks in healthy subjects (Thut et al., 1997; Zald et al., 2004; Hakyemez et al., ). However it should be noted that unpredictable reward tasks have the ability to cause a suppression and enhancement of dopamine transmission in different regions of the striatum (Zald et al., 2004; Hakyemez et al., ). Earlier research on pathological gamblers suggested altered dopaminergic and noradrenergic systems, as found through a decrease in concentration of dopamine and an increase in cerebrospinal fluid levels of 3,4-dihydroxyphenyl-acetic acid and homovanilic acid (Bergh et al., ). Pathological gamblers have also been reported to have higher cerebrospinal fluid levels of 3-methoxy-4-hydroxyphenylglycol, a major metabolite of norepinephrine, as well as significantly greater urinary outputs of norepinephrine in comparison to controls (Roy et al., 1988), indicative of a functional disturbance of the noradrenergic system. In addition there is evidence that genetic polymorphisms affecting dopaminergic neurotransmission act as risk factors for problem gambling (Lobo and Kennedy, ).
Dopamine in reinforcement
Considerable evidence from animal studies, implicating dopamine in behavioral reinforcement, provides a neurobiological substrate that could encompass processing of natural rewards, such as food and sex, as well as drugs of abuse and pathological gambling (Di Chiara and Imperato, ; Wise and Rompre, 1989; Wise, 1996, 2013). The observations of Schultz and others (Schultz et al., 1998; Schultz, 2002) confirmed a role for dopamine neurons in response to rewards; however the current model of dopamine signaling can be traced to a seminal paper by Montague, Dayan and Schultz (Schultz et al., 1997), where it was argued that the firing pattern of dopamine neurons did not signal reward per se, but a RPE signal, similar to those used in machine learning. This finding, along with evidence that dopamine could modulate synaptic plasticity (Calabresi et al., ; Surmeier et al., 2010) led to the theory that dopamine acts as a learning (or reinforcement) signal that shapes future motivated behavior. Subsequent research has shown that dopamine may also encode predictions about upcoming rewards and reward rate, thus acting as a value signal in the mesocortical and mesolimbic dopaminergic pathways (Montague and Berns, ).
The main projection site of dopamine neurons is the striatum, whose connectivity to frontal, limbic and insular cortex, provides a mechanism whereby dopamine can act as a prediction error signal driving both “Go” learning, which relates to actions with positive outcomes, and “No Go” or avoidance learning, which relates to actions that lead to punishment or an absence of reward. First, dopamine signaling operates in two modes (Grace, ): slow constant release of dopamine regulates tonic levels, which mostly signal via dopamine D2 receptors on striatal medium spiny neurons; phasic bursts of dopamine firing lead to large increases in synaptic dopamine which signal via both the D1 and D2 receptor systems. D1 receptors have low affinity for dopamine (Marcellino et al., ) and only respond to large increases in synaptic dopamine released during phasic dopamine neuron bursts that reflect positive RPEs, supporting learning to approach rewarding stimuli (Frank, ). Dopamine D2 receptors, on the other hand, have a higher affinity for dopamine, allowing them to respond to tonic dopamine signaling, and to detect transient reductions in tonic dopamine levels that follow pauses in dopamine neuron firing during negative RPEs. This facilitates learning to avoid negative outcomes (Frank, ). The cortico-striatal system can be divided into a direct and an indirect pathway (Figure 2), which have opposite effects on the thalamus and hence cortex (Albin et al., ). In the dorsal striatum, receptors are segregated, with the D1 receptors within the direct pathway, related to action selection, while the D2 receptors control response inhibition within the indirect pathway (Mink, ). This separation allows dopamine to drive both reward (increases in dopamine signaling a better outcome than expected) and punishment (reductions in tonic dopamine indicated a worse outcome than expected). Frank proposed a model in which phasic dopamine bursts following rewards promote positive reinforcement while reductions in tonic dopamine levels lead to negative reinforcement, each controlled by the D1/direct pathway and the D2/indirect pathway, respectively (Cohen and Frank, ). This computational model suggests that the RPE dopamine signal promotes learning from positive outcomes via stimulation of D1 receptors, whereas learning to avoid negative outcomes is mediated via disinhibition of indirect pathway striatal neurons secondary to a reduction of D2 receptor stimulation during dopamine pauses (Cohen and Frank, ). A negative outcome (punishment or lack of an expected reward) leads to pause in the firing of dopamine neurons, which then leads to a transient reduction in tonic dopamine. It should also be noted that D2 receptor stimulation reduces excitability of neurons in the indirect pathway (Hernandez-Lopez et al., ), therefore, reductions in D2 receptor signaling have the effect of activating the inhibitory “No Go” pathway. This allows for bidirectional positive and negative reinforcement signaling by dopamine neurons. Support for this model has been provided by numerous experiments. Parkinson’s disease patients show enhanced positive learning when on their medications, but improved negative learning while off medication (Frank et al., ). Pharmacological manipulations also support the model (Frank and O’Reilly, ; Pizzagalli et al., 2008). The striatal release of dopamine is linked to associative learning and habit formation via control of corticostriatal synaptic plasticity, which is affected in an opposite manner by D1 and D2 signaling (Shen et al., 2008). D1 dopamine receptor signaling promotes long-term potentiation (Reynolds et al., 2001; Calabresi et al., ), whereas D2 receptor signaling promotes long-term depression (Gerdeman et al., ; Kreitzer and Malenka, ). Note that this model has been tested most thoroughly at the level of the striatum. Multivariate analysis of fMRI data shows that reinforcement and punishment signals are ubiquitous in the brain, most notably in the entire frontal cortex and striatum (Vickery et al., 2011). Less is known about the information signaled by dopamine projections to brain areas other than the striatum, such as frontal cortex, insula, hippocampus and amygdala, or how the RPE signal is used by these areas.
Figure 2
Striatum and monetary reward
In human functional neuroimaging studies, changes in brain activation have been demonstrated consistently in response to monetary rewards (Thut et al., 1997; Elliott et al., ; Knutson et al., ; Breiter et al., ; O’Doherty et al., ). Further, studies have teased apart the different brain areas involved in the various components of monetary reward, such as anticipation, feedback, winning and losing. There seems to be a specialization within dopamine projection sites in relation to monetary reward: anticipation of monetary reward increases activation in the VStr, which includes the nucleus accumbens, while rewarding outcomes increase activation in the ventral medial prefrontal cortex, dorsal striatum, and posterior cingulate, with deactivation in the aforementioned regions during reward omission (Elliott et al., ; Breiter et al., ; Knutson et al., ; Tricomi et al., 2004). Neuroimaging experiments in humans suggest that VStr activity strongly correlates with expected value, as well as magnitude and probability (Breiter et al., ; Knutson et al., , 2005; Abler et al., 2006; Yacubian et al., 2006; Rolls et al., 2008). Work by D’Ardenne et al. () supports a role for the mesolimbic dopamine system in monetary RPE signaling. Activation of the ventral tegmental area, the origin of the mesolimbic dopamine circuit, reflected positive RPEs, whereas the VStr encoded positive and negative RPEs. Similarly, Tom et al. (2007) showed that VStr activity reflected potential monetary gains and losses bidirectionally. This study also demonstrated that these neural signals reflected individual variations in loss aversion, the tendency for losses to be more impactful than potential gains. Finally, the influential actor-critic model (Sutton and Barto, 1998) proposes that the VStr uses prediction errors to update information about expected future rewards while the dorsal striatum uses this same prediction error signal to encode information about actions that are likely to lead to reward. This distinction has found support from fMRI experiments (O’Doherty et al., ; Kahnt et al., ). Interestingly, the ability to update behavior in response to RPE was shown to correlate with functional connectivity between dorsal striatum and dopaminergic midbrain (Kahnt et al., ). The imaging studies mentioned here support the theory of dopamine as a RPE signal, at least in its striatal projection.
Insula and risk
The insula is frequently activated in functional neuroimaging experiments (Duncan and Owen, ; Yarkoni et al., 2011). Functionally it can be divided into three distinct subregions: a ventroanterior region associated with chemosensory (Pritchard et al., 1999) and socio-emotional processing (Sanfey et al., 2003; Chang and Sanfey, ), a dorsoanterior region associated with higher cognitive processing (Eckert et al., ), and a posterior region associated with pain and sensorimotor processing (Craig, ; Wager et al., 2004). Different functional insular areas project to different striatal targets: the VStr receives insular projections primarily related to food and reward, whereas the dorsolateral striatum receives insular inputs related to somatosensation (Chikama et al., ).
The insular cortex is involved in decision-making processes that involve uncertain risk and reward. Specifically, fMRI studies have reported insular cortex involvement in risk-averse decisions (Kuhnen and Knutson, ), risk avoidance and the representation of loss prediction (Paulus et al., ), monetary uncertainty (Critchley et al., ), and encoding a risk prediction error (Preuschoff et al., 2008). Patients with insular cortex damage place higher wagers in comparison with healthy participants and their betting is less sensitive to the odds of winning, with high wagers even at unfavorable odds (Clark et al., ). Other research suggests that optimum decisions involving risk depend on the integrity of the insular cortex, showing that insula lesion patients have altered decision-making involving both risky gains and risky losses (Weller et al., 2009) (However see Christopoulos et al., ). Specifically, insula damage was associated with a relative insensitivity to expected value differences between choices. Previous research has shown that there is a dissociation between insula and VStr, with VStr activation preceding risk-seeking choices, and anterior insula activation predicting risk-averse choices (Kuhnen and Knutson, ) suggesting that the VStr represents gain prediction (Knutson et al., ), while anterior insula represents loss prediction (Paulus et al., ). While imaging studies also demonstrate a more general role of the anterior insula in signaling the valence (positive or negative) of potential rewards (Litt et al., ; Bartra et al., ) the lesion data argue that the anterior insular cortex has a role in risk evaluation, specifically in making risk-averse decisions. Indeed, in healthy subjects, the insula is part of a value network that appears to track potential losses in a way that correlates with individual loss aversion level (Canessa et al., ). It is possible that an imbalance between prefrontal-striatal circuitry and insular-striatal circuitry may lead to suboptimal choices when weighing potential gains and losses, as observed in pathological gamblers (Petry, 2001a; Goudriaan et al., ).
Pathological gambling among patients with Parkinson’s disease
Pathological gambling was first reported in the context of Parkinson’s disease and dopamine replacement therapy in 2000 (Molina et al., ). The lifetime prevalence of pathological gambling in the general public is approximately 0.9 to 2.5% (Shaffer et al., 1999). In Parkinson’s disease, the prevalence rates are higher, from 1.7 to 6.1% (Ambermoon et al., ; Callesen et al., ). The risk factors associated with the occurrence of pathological gambling in Parkinson’s disease are young age of Parkinson’s disease onset, a personal or family history of drug or alcohol abuse, depression, and relatively high impulsivity and novelty seeking personality scores (Voon et al., 2007b). Interestingly, these are similar to the risk factors for drug addiction and pathological gambling in the general population. Also, there have been reports of addiction to L-dopa in certain patients (e.g., Giovannoni et al., ), a phenomenon that had already been noted in the 1980s. It was perhaps initially surprising to find that Parkinson’s disease patients can become addicted to their own medication or develop behavioral addictions because they were thought to not possess the personality type typical of addicted individuals. They are generally described as industrious, punctual, inflexible, cautious, rigid, introverted, slow-tempered, with lack of impulsiveness and novelty seeking, and they have low lifetime risks for cigarette smoking, coffee drinking, and alcohol use predating Parkinson’s disease onset (Menza et al., ; Menza, ).
Dopamine replacement therapy has been implicated in the development of pathological gambling in Parkinson’s disease (Gschwandtner et al., ; Dodd et al., ) and a remission or reduction of pathological gambling is typically noted after reduction or cessation of dopamine agonist medication (Gschwandtner et al., ; Dodd et al., ). A broader set of behavioral addictions termed impulse control disorders, including but not limited to pathological gambling, compulsive sexual behavior, and compulsive buying, have been reported in association with dopamine replacement therapy (Weintraub et al., 2006; Voon et al., 2007a; Dagher and Robbins, ). Dopamine agonists (pramipexole, ropinirole and pergolide) appear to pose a greater risk than L-Dopa monotherapy (Seedat et al., 2000; Dodd et al., ; Pontone et al., 2006). Reducing the dopamine agonist and increasing L-Dopa to achieve same motor response abolished pathological gambling in affected individuals (Mamikonyan et al., ), while a cross-sectional study of over 3000 Parkinson’s disease patients found that taking a dopamine agonist increased the odds of developing an impulse control disorder by 2.72 (Weintraub et al., 2010). Finally, these side-effects of dopamine agonist therapy have been recently noted in other diseases, such as restless leg syndrome, fibromyalgia and prolactinomas (Davie, ; Driver-Dunckley et al., ; Quickfall and Suchowersky, 2007; Tippmann-Peikert et al., 2007; Falhammar and Yarker, ; Holman, ). It should be noted however that some studies have reported behavioral addictions and/or impulsivity and compulsivity in association with high-dose L-Dopa monotherapy (Molina et al., ), deep brain stimulation for Parkinson’s disease (Smeding et al., 2007), and in drug naïve Parkinson’s disease patients (Antonini et al., ), all in the absence of dopamine agonists. Nonetheless, the clinical evidence overwhelmingly supports the theory that dopamine agonism at the D2 receptor family is sufficient to cause impulse control disorders.
Brain imaging studies
Neurotransmitter imaging
Positron emission tomography (PET) imaging allows for changes in endogenous levels of dopamine to be inferred from changes in the binding of the [11C]raclopride to the dopamine D2 receptors. The first [11C]raclopride PET study in this area was on Parkinson’s patients with dopamine dysregulation syndrome. Dopamine dysregulation syndrome is characterized by the compulsive taking of dopaminergic drugs, which is often comorbid with impulse control disorders (Lawrence et al., ). Patients with dopamine dysregulation syndrome exhibited enhanced L-Dopa induced VStr dopamine release compared to similarly treated Parkinson’s disease patients not compulsively taking dopaminergic drugs (Evans et al., ). This was the first study to provide evidence for sensitization of mesolimbic dopamine circuitry in Parkinson’s disease patients prone to compulsive drug use. Subsequent studies have supported a relative hyperdopaminergic state in Parkinson’s disease patients with pathological gambling. Three studies mapping the concentration of dopamine reuptake transporters (DAT) have shown reduced levels in the VStr of Parkinson’s disease patients with impulse control disorders compared to unaffected patients (Cilia et al., ; Lee et al., ; Voon et al., 2014). Unfortunately the finding is non-specific, as reduced DAT concentration can index either reduced nerve terminals (and reduced dopamine signaling) or reduced DAT expression (and therefore increased tonic dopamine levels). Supporting the latter hypothesis, impulse control patients demonstrate reduced [11C]raclopride binding in the VStr compared to Parkinson’s controls (Steeves et al., 2009), which is also consistent with elevated tonic dopamine in this group. Note, however that this result failed to be replicated in a similar study (O’Sullivan et al., ).
However, these two [11C]raclopride PET studies reported a greater reduction of VStr binding potential (an index of dopamine release) during gambling (Steeves et al., 2009) and following reward-related cue exposure (images of food, money, sex) compared to neutral cues (O’Sullivan et al., ) in Parkinson’s disease patients with impulse control disorders compared to unaffected patients. This suggests an increased responsiveness of striatal reward circuitry to gambling and reward-related cues in those patients with impulse control disorders. In O’Sullivan et al. () dopamine release was only detected in the VStr and only when subjects received a dose of oral L-Dopa just prior to scanning, consistent with post-mortem data in Parkinson’s disease showing that brain dopamine levels are much lower in dorsal than VStr (Kish et al., ). These results are therefore consistent with the sensitization hypothesis proposed by Evans et al. (). More recently it was reported that Parkinson’s disease patients with pathological gambling have a reduced concentration of dopamine autoreceptors in the midbrain (Ray et al., 2012), which is known to correlate with elevated dopaminergic responsivity and increased impulsivity (Buckholtz et al., ). Finally, in Parkinson’s disease patients, dopamine synthesis capacity, as measured by [18F]DOPA PET, correlates with a personality measure of disinhibition, itself a risk factor for pathological gambling and other addictions (Lawrence et al., ). In summary, PET studies provide converging evidence of heightened dopaminergic tone and increased dopamine response to reward cues as the underlying vulnerability in Parkinson’s disease patients who develop pathological gambling during dopamine agonist treatment.
Functional magnetic resonance imaging
Parkinson’s disease patients with pathological gambling show enhanced hemodynamic responses to gambling-related visual cues in the bilateral anterior cingulate cortex, left VStr, right precuneus and medial prefrontal cortex (Frosini et al., ). This is in line with similar experiments in pathological gambling without Parkinson’s disease (Crockford et al., ; Ko et al., ) and drug addiction (Wexler et al., 2001), supporting the view that impulse control disorders in Parkinson’s disease may be conceptualized as behavioral addictions.
Parkinson’s disease patients with an impulse control disorder show diminished BOLD activity in the right VStr during risk taking and significantly reduced resting cerebral blood flow in the right VStr compared to their healthy disease counterparts (Rao et al., 2010). Similarly, it was found that Parkinson’s disease patients with impulse control disorders showed a bias toward risky gambles compared to control patients, and that dopamine agonists enhanced risk taking while decreasing VStr activity (Voon et al., 2011). The authors suggested that dopamine agonists may decouple brain activity from risk information in vulnerable patients, thus favoring risky choices. Another fMRI study reported that, relative to Parkinson’s controls, impulse control disorder Parkinson’s patients had decreased anterior insular and orbitofrontal cortex RPE signals. They also showed that dopamine agonists increased the rate of learning from gain outcomes, and increased striatal RPE activity, suggesting that dopamine agonists may skew neural activity to encode “better than expected” outcomes in Parkinson’s disease patients susceptible to impulse control disorders (Voon et al., 2010).
While differences in striatal dopamine signaling may distinguish Parkinson’s disease patients who do and do not develop pathological gambling, the mechanism of action by which dopamine agonists change risk assessment remains unclear. Dopamine agonists change the way in which the brains of healthy individuals respond to the anticipation and feedback of rewards. During reward feedback, administration of a single dose of pramipexole to healthy adults caused decreased VStr activity in a lottery game (Riba et al., 2008). Similarly, there was reduced VStr activation when Parkinson’s patients received a dose of L-Dopa compared to placebo (Cools et al., ). This pattern of hypoactivation is reminiscent of that found in pathological gamblers without Parkinson’s disease (Reuter et al., 2005): during a simulated gambling task, pathological gamblers showed decreased activation with respect to controls in the ventromedial prefrontal cortex and the VStr. Severity of gambling was negatively correlated with the BOLD effect in the VStr and ventromedial prefrontal cortex, suggesting that hypoactivity is a predictor of gambling severity. As noted above, impulse control disorder Parkinson’s patients were found to have diminished resting perfusion as well as diminished BOLD activity during risk taking in the VStr compared to Parkinson’s controls (Rao et al., 2010). These studies suggest that dopamine agonists cause individuals to seek rewards and make risky choices (Riba et al., 2008), in the face of suppressed VStr response to rewards.
It should be noted however that reduced VStr activation in fMRI experiments does not necessarily indicate reduced dopaminergic signaling. There is evidence to support relatively spared mesolimbic dopamine signaling as the risk factor for pathological gambling in Parkinson’s disease. First, the repeated taking of a dopaminergic medication for the treatment of Parkinson’s disease could lead to sensitization of dopamine signaling. VStr sensitization has been shown following repeated amphetamine administration in humans (Boileau et al., ). Moreover, in Parkinson’s disease the ventral portion of striatum is relatively spared by the disease compared to the dorsal areas (Kish et al., ), and thus dopamine replacement therapy, while correcting the dopamine deficiency in the dorsal striatum to normal levels, has the potential to raise dopamine levels in the VStr circuit to higher than optimal levels (Cools et al., ). This “overdose” theory was first proposed by Gotham et al. () to explain the fact that L-Dopa administration to Parkinson’s disease patients, while improving some cognitive deficits, could also cause specific impairments in other fronto-striatal cognitive tasks. In the case of impulse control disorders, we propose that excessive dopaminergic stimulation in the VStr obscures the dips in dopamine signaling related to negative prediction errors.
The insula has also been implicated in imaging studies of pathological gambling in Parkinson’s disease. In an fMRI study, Ye et al. (2010) found that during the anticipation of monetary rewards, a single dose of pramipexole (compared to placebo) increased the activity of the VStr, enhanced the interaction between the VStr and the anterior insula, but weakened the interaction between the VStr and the prefrontal cortex, leading to increased impulsivity. Cilia et al. () found Parkinson’s patients with pathological gambling showed resting over-activity in brain areas in the mesocorticolimbic network, including the insula. In an fMRI study, relative to Parkinson’s controls, impulse control disorder patients had decreased anterior insular and orbitofrontal cortex activity (van Eimeren et al., 2009; Voon et al., 2010). Finally, in a study of Parkinson’s disease patients with and without hypersexuality, a single dose of L-Dopa abolished the normal insular deactivation seen in response to erotic pictures, only in the hypersexual patients (Politis et al., 2013). Taken together these results may suggest an imbalance between the prefrontal-striatum connectivity and insula-striatum connectivity, favoring the influence of potential gains over that of potential risks (losses) in decision-making.
Risk taking and loss aversion
An influential framework for studying risky decision making is prospect theory, developed by Kahneman and Tversky (). A key finding of their work is loss aversion, a tendency for losses to loom larger than potential gains, and for individuals to typically forego risky choices when less valuable safer alternatives exist. For example most people will reject the offer of a coin flip unless the potential gain is considerably larger than the potential loss. Impulsiveness, at least in a gambling context, can be characterized as a reversal of loss aversion, and an over-weighing of potential rewards relative to losses. It remains to be seen whether loss aversion results from asymmetrical weighting of gains and losses along a single value axis (Tom et al., 2007), or from a competitive interaction between separate systems for gains and losses (Kuhnen and Knutson, ; De Martino et al., ). Possibly, both models are correct: recent fMRI evidence (Canessa et al., ) shows bidirectional responses to losses and gains in the VStr and ventromedial prefrontal cortex (positive for gains) and the amygdala and insula (positive for losses). In both cases, there is greater activation to potential losses, correlating with individual loss aversion measured using prospect theory (Kahneman and Tversky, ). However, there are also brain regions that respond uniquely to potential losses, namely the right insula and the amygdala, once again reflecting individual variation in loss aversion (Canessa et al., ). In sum, a network of regions centered on VStr, insula and amygdala seems to compute gain and loss anticipation in a way that typically results in loss aversion. Interestingly these structures, along with dorsal anterior cingulate, form an intrinsic connectivity network as identified by resting state fMRI. This network is thought to be involved in detecting and processing emotionally salient events (Seeley et al., 2007).
Loss aversion can be explained on an emotional basis, with both potential gains and losses influencing behavior via different emotions (Loewenstein et al., ), namely motivation on the gain side and anxiety for losses. Such a model might tie the former to the nucleus accumbens and the latter to the amygdala and insula. In either case, it is conceivable that individuals who are relatively less loss averse may also be at risk for impulsive behaviors such as drug addiction and gambling, due to relative under valuation of losses, although surprisingly this has yet to be formally tested.
There is some evidence implicating the striatum in reversal of normal loss aversion in pathological gamblers. Loss of striatal dopamine neurons in Parkinson’s disease is associated with reduced risk-taking behavior compared to control subjects (Brand et al., ; Labudda et al., ), while chronic administration of dopamine agonists, especially in high doses, reverses this tendency and promotes risky behavior and impulsivity (Dagher and Robbins, ). In the healthy brain, acute administration of D2 dopamine agonists may also cause an increase in risky choices in humans (Riba et al., 2008) and rats (St Onge and Floresco, 2009). Acute D2/D3 receptor stimulation has been found to produce complex changes in the value of losses judged worth chasing (chasing being the continued gambling to recover losses) (Campbell-Meiklejohn et al., ). Taken together, this suggests dopamine, acting on the striatum and possibly other mesolimbic structures, may modulate loss aversion. Two studies in Parkinson’s disease patients not affected by impulse control disorders found that a single dose of the dopamine agonist pramipexole reduced loss prediction error coding in the orbitofrontal cortex in one case (van Eimeren et al., 2009) and the orbitofrontal cortex and insula in the other (Voon et al., 2010). In sum, tonic dopamine activity appears to reduce loss prediction signaling, and may therefore reduce loss aversion.
We propose a general framework based on prospect theory, in which the anticipation of potential losses and rewards is computed, possibly in separate brain regions initially, and integrated to compute a decision value (Figure 3). We speculate that gain anticipation might be computed in the ventral medial prefrontal cortex, based on numerous imaging studies implicating this area in computation of value (Kable and Glimcher, ; Plassmann et al., 2007; Bartra et al., ). As reviewed above, the amygdala and insula may be involved in computing loss anticipation. A possible site for the final computation of value, at least for the purpose of updating choices and action plans, is the striatum, which has fairly direct access to brain regions involved in action planning (van der Meer et al., 2012). The striatum has inherent roles in both response-reward associations (dorsal striatum) (Alexander and Crutcher, ) and creating stimulus-reward contingencies (VStr), which afford it the unique opportunity for computation of value (Packard and Knowlton, ). Striatal value signals can promote reinforcement processes leading to the updating of future actions, strategies and habits, mediated by the dorsal striatum, while also driving appetitive reward seeking behavior via the VStr. For a review of the role of the striatum in value coding see Knutson et al. (); Bartra et al. (). The balance between gain and loss evaluation systems may be modulated at least in part by dopamine. We propose a model in which tonic dopamine, acting via the indirect basal ganglia pathway (Figure 2) regulates inhibitory control manifesting as loss aversion. Here lower levels of tonic dopamine would be associated with increased loss aversion. Conversely, phasic dopamine, acting via the direct pathway, would increase the value of gains. This is based on the finding that young healthy subjects given a single dose of the dopamine agonist cabergoline show reduced learning in response to gains (positive feedback), due presumably to a presynaptic effect (in low doses, cabergoline, a D2 agonist, reduces phasic dopamine neuron firing via actions on the high affinity D2 autoreceptor, located pre-synaptically on dopamine neurons) (Frank and O’Reilly, ). Conversely, haloperidol, a D2 antagonist, increased learning from gains, probably due to its ability to enhance phasic dopamine firing. With respect to Parkinson’s disease, if a patient has an individual vulnerability to undervalue losses, then dopamine agonist therapy, which tonically stimulates D2 receptors and blocks sensing of the phasic dopamine dips associated with negative rewards, (Frank et al., , ), could result in even lower loss aversion. One interpretation is that the intensity of phasic activity sets the gain on the value of potential rewards, while the tonic stimulation of D2 receptors blocks the negative feedback associated with losses.
Figure 3
Parkinson’s disease patients show enhanced positive learning when on dopaminergic medications, and improved negative learning while off medication, compared to age-matched controls (Frank et al., ). Treatment with dopamine D2 agonists is now accepted as the cause of impulse control disorders in Parkinson’s disease, in which problem gambling is phase locked to medication use. In the model proposed here, D2 stimulation would reduce loss aversion via the indirect corticostriatal pathway. We suggest that under D2 agonist treatment, these patients have a tendency to undervalue losses and be more risk seeking. This is consistent with the observation that Parkinson’s disease patients’ deficits in risky decision making is dominated by impaired ability to use negative feedback (Labudda et al., ). The effect on gain, risk, and loss processing of dopamine signaling in other parts of the mesolimbic and mesocortical system, notably the vmPFC, OFC, insula and amygdala, remains to be investigated in greater depth.
Loss tolerance profile may also be affected by norepinephrine signaling. In healthy volunteers, a single dose of the centrally acting beta blocker propranolol reduced the perceived magnitude of losses (Rogers et al., 2004) and normal variations in norepinephrine reuptake transporter in the thalamus, as assessed by PET, correlate with loss aversion (Takahashi et al., 2013). An explanation for this is that norepinephrine increases the arousal response to potential losses, and low norepinephrine signaling may therefore reduce loss aversion. While norepinephrine neurons are also affected in Parkinson’s disease, their role in the motivational and impulsive aspects of the disease have yet to be investigated (Vazey and Aston-Jones, 2012).
Conclusion
The causal association between dopamine D2 receptor agonism and impulse control disorders in Parkinson’s disease has implications for addiction more generally. First, not all individuals develop addictive syndromes following dopamine replacement therapy; those who do appear to have relatively preserved dopamine signaling in the mesolimbic pathway, possibly through a combination of their specific pattern of neurodegeneration, sensitization and pre-morbid vulnerability (as evidenced by the fact that a family history of addiction is a risk factor). It is conceivable that enhanced mesolimbic transmission is also a risk factor in the general population (Buckholtz et al., ). Second, it is clear that D2 receptor agonism alone is sufficient for the development of the addictive syndrome. While combined D1/D2 agonists such as L-Dopa may themselves be addictive (Lawrence et al., ), D2 agonists are not typically administered compulsively; rather, they have the ability to promote other addictions such as pathological gambling (O’Sullivan et al., ). This is supported by animal experiments (Collins and Woods, ), computational neuroscience models (Cohen and Frank, ), and molecular biology evidence (Shen et al., 2008) suggesting that D1 receptor stimulation is reinforcing while D2 receptor stimulation inhibits the inhibitory indirect pathway. We suggest that D2 agonism, in vulnerable individuals, has the effect of “releasing the brake” on reinforcement systems, thus facilitating the development of impulse control disorders. The time-locked nature of the D2 effect, and the fact that addictive behaviors typically resolve upon discontinuation of the dopamine agonist, is consistent with the theory that tonic dopamine has an invigorating effect on reward seeking behavior (Niv et al., ; Dagher and Robbins, ).
We note however that other mechanisms besides dopamine-mediated disruption of responses to reinforcing events and stimuli may play a role. For example, Averbeck et al. () have proposed that Parkinson’s disease patients with impulse control disorders are uncertain about using future information to guide behavior, which could lead to impulsivity (a tendency to privilege immediate action). Also, frontal lobe deficits (Djamshidian et al., ) could also lead to impulsivity through impaired self-control. These mechanisms need not be mutually exclusive.
Statements
Acknowledgments
This work was supported through grants from the Canadian Institutes of Health Research and Parkinson Society Canada to Alain Dagher and fellowships from the National Sciences and Engineering Research Council of Canada to Crystal A. Clark.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AblerB.WalterH.ErkS.KammererH.SpitzerM. (2006). Prediction error as a linear function of reward probability is coded in human nucleus accumbens. Neuroimage31, 790–795. 10.1016/j.neuroimage.2006.01.001
2
AlbinR. L.YoungA. B.PenneyJ. B. (1989). The functional anatomy of basal ganglia disorders. Trends Neurosci.12, 366–375. 10.1016/0166-2236(89)90074-x
3
AlexanderG. E.CrutcherM. D. (1990). Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci.13, 266–271. 10.1016/0166-2236(90)90107-l
4
AmbermoonP.CarterA.HallW. D.DissanayakaN. N.O’SullivanJ. D. (2011). Impulse control disorders in patients with Parkinson’s disease receiving dopamine replacement therapy: evidence and implications for the addictions field. Addiction106, 283–293. 10.1111/j.1360-0443.2010.03218.x
5
American Psychiatric Association. (2000). Diagnostic and Statistical Manual of Mental Disorders.4th Edn., Text Revision, Washington, DC: APA.
6
AntoniniA.SiriC.SantangeloG.CiliaR.PolettiM.CanesiM.et al. (2011). Impulsivity and compulsivity in drug-naive patients with Parkinson’s disease. Mov. Disord.26, 464–468. 10.1002/mds.23501
7
AverbeckB. B.O’SullivanS. S.DjamshidianA. (2014). Impulsive and compulsive behaviors in Parkinson’s disease. Annu. Rev. Clin. Psychol.10, 553–580. 10.1146/annurev-clinpsy-032813-153705
8
BartraO.McGuireJ. T.KableJ. W. (2013). The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage76, 412–427. 10.1016/j.neuroimage.2013.02.063
9
BerghC.EklundT.SoderstenP.NordinC. (1997). Altered dopamine function in pathological gambling. Psychol. Med.27, 473–475. 10.1017/s0033291796003789
10
BoileauI.DagherA.LeytonM.GunnR. N.BakerG. B.DiksicM.et al. (2006). Modeling sensitization to stimulants in humans: an [11C]raclopride/positron emission tomography study in healthy men. Arch. Gen. Psychiatry63, 1386–1395. 10.1001/archpsyc.63.12.1386
11
BrandM.LabuddaK.KalbeE.HilkerR.EmmansD.FuchsG.et al. (2004). Decision-making impairments in patients with Parkinson’s disease. Behav. Neurol.15, 77–85. 10.1155/2004/578354
12
BreiterH. C.AharonI.KahnemanD.DaleA.ShizgalP. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and loses. Neuron30, 619–639. 10.1016/s0896-6273(01)00303-8
13
BuckholtzJ. W.TreadwayM. T.CowanR. L.WoodwardN. D.LiR.AnsariM. S.et al. (2010). Dopaminergic network differences in human impulsivity. Science329:532. 10.1126/science.1185778
14
CalabresiP.PicconiB.TozziA.Di FilippoM. (2007). Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends Neurosci.30, 211–219. 10.1016/j.tins.2007.03.001
15
CallesenM. B.Scheel-KrugerJ.KringelbachM. L.MollerA. (2013). A systematic review of impulse control disorders in Parkinson’s disease. J. Parkinsons Dis.3, 105–138. 10.3233/JPD-120165
16
Campbell-MeiklejohnD.WakeleyJ.HerbertV.CookJ.ScolloP.RayM. K.et al. (2011). Serotonin and dopamine play complementary roles in gambling to recover losses. Neuropsychopharmacology36, 402–410. 10.1038/npp.2010.170
17
Campbell-MeiklejohnD. K.WoolrichM. W.PassinghamR. E.RogersR. D. (2008). Knowing when to stop: the brain mechanisms of chasing losses. Biol. Psychiatry63, 293–300. 10.1016/j.biopsych.2007.05.014
18
CanessaN.CrespiC.MotterliniM.Baud-BovyG.ChierchiaG.PantaleoG.et al. (2013). The functional and structural neural basis of individual differences in loss aversion. J. Neurosci.33, 14307–14317. 10.1523/jneurosci.0497-13.2013
19
CastellaniB.RugleL. (1995). A comparison of pathological gamblers to alcoholics and cocaine misusers on impulsivity, sensation seeking and craving. Int. J. Addict.30, 275–289. 10.3109/10826089509048726
20
CavediniP.RiboldiG.KellerR.D’AnnucciA.BellodiL. (2002). Frontal lobe dysfunction in pathological gambling patients. Biol. Psychiatry51, 334–341. 10.1016/s0006-3223(01)01227-6
21
ChangL. J.SanfeyA. G. (2009). Unforgettable ultimatums? Expectation violations promote enhanced social memory following economic bargaining. Front. Behav. Neurosci.3:36. 10.3389/neuro.08.036.2009
22
ChikamaM.McFarlandN. R.AmaralD. G.HaberS. N. (1997). Insular cortical projections to functional regions of the striatum correlate with cortical cytoarchitectonic organization in the primate. J. Neurosci.17, 9686–9705.
23
ChristopoulosG. I.ToblerP. N.BossaertsP.DolanR. J.SchultzW. (2009). Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J. Neurosci.29, 12574–12583. 10.1523/JNEUROSCI.2614-09.2009
24
CiliaR.KoJ. H.ChoS. S.van EimerenT.MarottaG.PellecchiaG.et al. (2010). Reduced dopamine transporter density in the ventral striatum of patients with Parkinson’s disease and pathological gambling. Neurobiol. Dis.39, 98–104. 10.1016/j.nbd.2010.03.013
25
CiliaR.SiriC.MarottaG.IsaiasI. U.De GaspariD.CanesiM.et al. (2008). Functional abnormalities underlying pathological gambling in parkinson disease. Arch. Neurol.65, 1604–1611. 10.1001/archneur.65.12.1604
26
ClarkL.BecharaA.DamasioH.AitkenM. R.SahakianB. J.RobbinsT. W. (2008). Differential effects of insular and ventromedial prefrontal cortex lesions on risky decision-making. Brain131, 1311–1322. 10.1093/brain/awn066
27
CohenM. X.FrankM. J. (2009). Neurocomputational models of basal ganglia function in learning, memory and choice. Behav. Brain Res.199, 141–156. 10.1016/j.bbr.2008.09.029
28
CollinsG. T.WoodsJ. H. (2009). Influence of conditioned reinforcement on the response-maintaining effects of quinpirole in rats. Behav. Pharmacol.20, 492–504. 10.1097/fbp.0b013e328330ad9b
29
CoolsR.LewisS. J. G.ClarkL.BarkerR. A.RobbinsT. W. (2007). L-DOPA disrupts activity in the nucleus accumbens during reversal learning in Parkinson’s disease. Neuropsychopharmacology32, 180–189. 10.1038/sj.npp.1301153
30
CraigA. D. (2002). How do you feel? Interoception: the sense of the physiological condition of the body. Nat. Rev. Neurosci.3, 655–666. 10.1038/nrn894
31
CritchleyH. D.MathiasC. J.DolanR. J. (2001). Neural activity in the human brain relating to uncertainty and arousal during anticipation. Neuron29, 537–545. 10.1016/s1053-8119(01)91735-5
32
CrockfordD. N.GoodyearB.EdwardsJ.QuickfallJ.el-GuebalyN. (2005). Cue-Induced brain activity in pathological gamblers. Biol. Psychiatry58, 787–795. 10.1016/j.biopsych.2005.04.037
33
D’ArdenneK.McClureS. M.NystromL. E.CohenJ. D. (2008). BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science319, 1264–1267. 10.1126/science.1150605
34
DagherA.RobbinsT. W. (2009). Personality, addiction, dopamine: insights from Parkinson’s disease. Neuron61, 502–510. 10.1016/j.neuron.2009.01.031
35
DavieM. (2007). Pathological gambling associated with cabergoline therapy in a patient with a pituitary prolactinoma. J. Neuropsychiatry Clin. Neurosci.19, 473–474. 10.1176/appi.neuropsych.19.4.473
36
De MartinoB.CamererC. F.AdolphsR. (2010). Amygdala damage eliminates monetary loss aversion. Proc. Natl. Acad. Sci. U S A107, 3788–3792. 10.1073/pnas.0910230107
37
Di ChiaraG.ImperatoA. (1988). Drugs abused by humans preferentially increase synaptic dopamine concentrations in the mesolimbic system of freely moving rats. Proc. Natl. Acad. Sci. U S A85, 5274–5278. 10.1073/pnas.85.14.5274
38
DjamshidianA.JhaA.O’SullivanS. S.Silveira-MoriyamaL.JacobsonC.BrownP.et al. (2010). Risk and learning in impulsive and nonimpulsive patients with Parkinson’s disease. Mov. Disord.25, 2203–2210. 10.1002/mds.23247
39
DoddM. L.KlosK. J.BowerJ. H.GedaY. E.JosephsK. A.AhlskogJ. E. (2005). Pathological gambling caused by drugs used to treat Parkinson disease. Arch. Neurol.62, 1377–1381. 10.1001/archneur.62.9.noc50009
40
Driver-DunckleyE. D.NobleB. N.HentzJ. G.EvidenteV. G.CavinessJ. N.ParishJ.et al. (2007). Gambling and increased sexual desire with dopaminergic medications in restless legs syndrome. Clin. Neuropharmacol.30, 249–255. 10.1097/wnf.0b013e31804c780e
41
DuncanJ.OwenA. M. (2000). Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends Neurosci.23, 475–483. 10.1016/s0166-2236(00)01633-7
42
DuvarciI.VaranA. (2000). Descriptive features of Turkish pathological gamblers. Scand. J. Psychol.41, 253–260. 10.1111/1467-9450.00195
43
EckertM. A.MenonV.WalczakA.AhlstromJ.DenslowS.HorwitzA.et al. (2009). At the heart of the ventral attention system: the right anterior insula. Hum. Brain Mapp.30, 2530–2541. 10.1002/hbm.20688
44
ElliottR.FristonK. J.DolanR. J. (2000). Dissociable neural responses in human reward systems. J. Neurosci.20, 6159–6165.
45
EvansA. H.PaveseN.LawrenceA. D.TaiY. F.AppelS.DoderM.et al. (2006). Compulsive drug use linked to senstized ventral striatal dopamine transmission. Ann. Neurol.59, 852–858. 10.1002/ana.20822
46
FalhammarH.YarkerJ. Y. (2009). Pathological gambling and hypersexuality in cabergoline-treated prolactinoma. Med. J. Aust.190, 97.
47
FrankM. J.O’ReillyR. C. (2006). A mechanistic account of striatal dopamine function in human cognition: psychopharmacological studies with cabergoline and haloperidol. Behav. Neurosci.120, 497–517. 10.1037/0735-7044.120.3.497.supp
48
FrankM. J.SamantaJ.MoustafaA. A.ShermanS. J. (2007). Hold your horses: impulsivity, deep brain stimulation and medication in parkinsonism. Science318, 1309–1312. 10.1126/science.1146157
49
FrankM. J.SeebergerL. C.O’ReillyR. C. (2004). By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science306, 1940–1943. 10.1126/science.1102941
50
FrankM. J. (2005). Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J. Cogn. Neurosci.17, 51–72. 10.1162/0898929052880093
51
FrosiniD.PesaresiI.CosottiniM.BelmonteG.RossiC.Dell’OssoL.et al. (2010). Parkinson’s disease and pathological gambling: results from a functional MRI study. Mov. Disord.25, 2449–2453. 10.1002/mds.23369
52
GerdemanG. L.RonesiJ.LovingerD. M. (2002). Postsynaptic endocannabinoid release is critical to long-term depression in the striatum. Nat. Neurosci.5, 446–451. 10.1038/nn832
53
GiovannoniG.O’SullivanJ. D.TurnerK.MansonA. J.LeesA. J. (2000). Hedonistic homeostatic dysregulation in patients with Parkinson’s disease on dopamine replacement therapies. J. Neurol. Neurosurg. Psychiatry68, 423–428. 10.1136/jnnp.68.4.423
54
GoodmanA. (2008). Neurobiology of addiction: an integrative review. Biochem. Pharmacol.75, 266–322. 10.1016/j.bcp.2007.07.030
55
GothamA. M.BrownR. G.MarsdenC. D. (1988). ‘Frontal’ cognitive function in patients with Parkinson’s disease ‘on’ and ‘off’ levodopa. Brain111(Pt. 2), 299–321. 10.1093/brain/111.2.299
56
GoudriaanA. E.OosterlaanJ.de BeursE.van den BrinkW. (2005). Decision making in pathological gambling: a comparison between pathological gamblers, alcohol dependents, persons with Tourette syndrome and normal controls. Brain Res. Cogn. Brain Res.23, 137–151. 10.1016/j.cogbrainres.2005.01.017
57
GraceA. A. (2000). The tonic/phasic model of dopamine system regulation and its implications for understanding alcohol and psychostimulant craving. Addiction95, 119–128. 10.1046/j.1360-0443.95.8s2.1.x
58
GrantJ. E.BrewerJ. A.PotenzaM. N. (2006). The neurobiology of substance and behavioural addictions. CNS Spectr.11, 924–930.
59
GschwandtnerU.AstonJ.RenaudS.FuhrP. (2001). Pathologic gambling in patients with Parkinson’s disease. Clin. Neuropharmacol.24, 170–172. 10.1097/00002826-200105000-00009
60
HakyemezH. S.DagherA.SmithS. D.ZaldD. H. (2008). Striatal dopamine transmission in healthy humans during a passive monetary reward task. Neuroimage39, 2058–2065. 10.1016/j.neuroimage.2007.10.034
61
Hernandez-LopezS.TkatchT.Perez-GarciE.GalarragaE.BargasJ.HammH.et al. (2000). D2 dopamine receptors in striatal medium spiny neurons reduce L-type Ca2+ currents and excitability via a novel PLC[beta]1-IP3-calcineurin-signaling cascade. J. Neurosci.20, 8987–9895.
62
HolmanA. (2009). Impulse control disorder behaviors associated with pramipexole used to treat fibromyalgia. J. Gambl. Stud.25, 425–431. 10.1007/s10899-009-9123-2
63
HuettelS. A.StoweC. J.GordonE. M.WarnerB. T.PlattM. L. (2006). Neural signatures of economic preferences for risk and ambiguity. Neuron49, 765–775. 10.1016/j.neuron.2006.01.024
64
KableJ. W.GlimcherP. W. (2007). The neural correlates of subjective value during intertemporal choice. Nat. Neurosci.10, 1625–1633. 10.1038/nn2007
65
KahnemanD.TverskyA. (1979). Prospect theory: an analysis of decision under risk. Econometrica47, 263–291. 10.2307/1914185
66
KahntT.ParkS. Q.CohenM. X.BeckA.HeinzA.WraseJ. (2009). Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions. J. Cogn. Neurosci.21, 1332–1345. 10.1162/jocn.2009.21092
67
KishS. J.ShannakK.HornykiewiczO. (1988). Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson’s disease. Pathophysiologic and clinical implications. N. Engl. J. Med.318, 876–880. 10.1056/nejm198804073181402
68
KnutsonB.AdamsC. M.FongG. W.HommerD. (2001a). Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J. Neurosci.21:RC159.
69
KnutsonB.GreerS. M. (2008). Anticipatory affect: neural correlates and consequences for choice. Philos. Trans. R. Soc. Lond B Biol. Sci.363, 3771–3786. 10.1098/rstb.2008.0155
70
KnutsonB.DelgadoM. R.PhillipsP. E. M. (2008). “Representation of subjective value in the striatum,” in Neuroeconomics: Decision Making and the Brain, eds CamererC.GlimcherP. W.FehrE.PoldrackR. A. (New York: Academic Press), 398–406.
71
KnutsonB.FongG. W.AdamsC. M.VarnerJ. L.HommerD. (2001b). Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport12, 3683–3687. 10.1097/00001756-200112040-00016
72
KnutsonB.TaylorJ.KaufmanM.PetersonR.GloverG. (2005). Distributed neural representation of expected value. J. Neurosci.25, 4806–4812. 10.1523/JNEUROSCI.0642-05.2005
73
KnutsonB.WestdorpA.KaiserE.HommerD. (2000). FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage12, 20–27. 10.1006/nimg.2000.0593
74
KoC. H.LiuG. C.HsiaoS.YenJ. Y.YangM. J.LinW. C.et al. (2009). Brain activities associated with gaming urge of online gaming addiction. J. Psychiatr. Res.43, 739–747. 10.1016/j.jpsychires.2008.09.012
75
KreitzerA. C.MalenkaR. C. (2007). Endocannabinoid-mediated rescue of striatal LTD and motor deficits in Parkinson’s disease models. Nature445, 643–647. 10.1038/nature05506
76
KuhnenC. M.KnutsonB. (2005). The neural basis of financial risk taking. Neuron47, 763–770. 10.1016/j.neuron.2005.08.008
77
LabuddaK.BrandM.MertensM.OllechI.MarkowitschH. J.WoermannF. G. (2010). Decision making under risk condition in patients with Parkinson’s disease: a behavioural and fMRI study. Behav. Neurol.23, 131–143. 10.1155/2010/743141
78
LawrenceA. D.BrooksD. J.WhoneA. L. (2013). Ventral striatal dopamine synthesis capacity predicts financial extravagance in Parkinson’s disease. Front. Psychol.4:90. 10.3389/fpsyg.2013.00090
79
LawrenceA. D.EvansA. H.LeesA. J. (2003). Compulsive use of dopamine replacement therapy in parkinson’s disease: reward systems gone awry?Lancet Neurol.2, 595–604. 10.1016/S1474-4422(03)00529-5
80
LeeJ. Y.SeoS. H.KimY. K.YooH. B.KimY. E.SongI. C.et al. (2014). Extrastriatal dopaminergic changes in Parkinson’s disease patients with impulse control disorders. J. Neurol. Neurosurg. Psychiatry85, 23–30. 10.1136/jnnp-2013-305549
81
LittA.PlassmannH.ShivB.RangelA. (2011). Dissociating valuation and saliency signals during decision-making. Cereb. Cortex21, 95–102. 10.1093/cercor/bhq065
82
LoboD. S.KennedyJ. L. (2006). The genetics of gambling and behavioural addictions. CNS Spectr.11, 931–939.
83
LoewensteinG. F.WeberE. U.HseeC. K.WelchN. (2001). Risk as feelings. Psychol. Bull.127, 267–286. 10.1037/0033-2909.127.2.267
84
MamikonyanE.SiderowfA. D.DudaJ. E.PotenzaM. N.HornS.SternM. B.et al. (2008). Long-term follow-up of impulse control disorders in Parkinson’s disease. Mov. Disord.23, 75–80. 10.1002/mds.21770
85
MarcellinoD.KehrJ.AgnatiL. F.FuxeK. (2012). Increased affinity of dopamine for D(2) -like versus D(1) -like receptors. Relevance for volume transmission in interpreting PET findings. Synapse66, 196–203. 10.1002/syn.21501
86
MenzaM. A.GolbeL. I.CodyR. A.FormanN. E. (1993). Dopamine-related personality traits in parkinson’s disease. Neurology43(Pt. 1), 505–508. 10.1212/wnl.43.3_part_1.505
87
MenzaM. A. (2000). The personality associated with parkinson’s disease. Curr. Psychiatry Rep.2, 421–426. 10.1007/s11920-000-0027-1
88
MinkJ. W. (1996). The basal ganglia: focused selection and inhibition of competing motor programs. Prog. Neurobiol.50, 381–425. 10.1016/s0301-0082(96)00042-1
89
MolinaJ. A.Sainz-ArtigaM. J.FraileA.Jimenez-JimenezF. J.VillanuevaC.Orti-ParejaM.et al. (2000). Pathologic gambling in Parkinson’s disease: a behavioral manifestation of pharmacologic treatment?Mov. Disord.15, 869–872. 10.1002/1531-8257(200009)15:5<869::aid-mds1016>3.0.co;2-i
90
MontagueP. R.BernsG. S. (2002). Neural economics and the biological substrates of valuation. Neuron36, 265–284. 10.1016/s0896-6273(02)00974-1
91
NivY.DawN. D.JoelD.DayanP. (2007). Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl)191, 507–520. 10.1007/s00213-006-0502-4
92
O’DohertyJ.DayanP.SchultzJ.DeichmannR.FristonK.DolanR. J. (2004). Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science304, 452–454. 10.1126/science.1094285
93
O’DohertyJ. P.HamptonA.KimH. (2007). Model-Based fMRI and its application to reward learning and decision making. Ann. N Y Acad. Sci.1104, 35–53. 10.1196/annals.1390.022
94
O’SullivanS. S.WuK.PolitisM.LawrenceA. D.EvansA. H.BoseS. K.et al. (2011). Cue-induced striatal dopamine release in Parkinson’s disease-associated impulsive-compulsive behaviours. Brain134(Pt. 4), 969–978. 10.1093/brain/awr003
95
OchoaC.Alvarez-MoyaE. M.PeneloE.AymamiM. N.Gomez-PenaM.Fernandez-ArandaF.et al. (2013). Decision-making deficits in pathological gambling: the role of executive functions, explicit knowledge and impulsivity in relation to decisions made under ambiguity and risk. Am. J. Addict.22, 492–499. 10.1111/j.1521-0391.2013.12061.x
96
PackardM. G.KnowltonB. J. (2002). Learning and memory functions of the Basal Ganglia. Annu. Rev. Neurosci.25, 563–593. 10.1146/annurev.neuro.25.112701.142937
97
PaulusM. P.RogalskyC.SimmonsA.FeinsteinJ. S.SteinM. B. (2003). Increased activation in the right insula during risk-taking decision making is related to harm avoidance and neuroticism. Neuroimage19, 1439–1448. 10.1016/s1053-8119(03)00251-9
98
PetryN. M.StinsonF. S.GrantB. F. (2005). Comorbidity of DSM-IV pathological gambling and other psychiatric disorders: results from the National epidemiologic survey on alcohol and related conditions. J. Clin. Psychiatry66, 564–574. 10.4088/jcp.v66n0504
99
PetryN. M. (2001a). Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. J. Abnorm. Psychol.110, 482–487. 10.1037//0021-843x.110.3.482
100
PetryN. M. (2001b). Substance abuse, pathological gambling and impulsiveness. Drug Alcohol Depend.63, 29–38. 10.1016/s0376-8716(00)00188-5
101
PizzagalliD.EvinsA.Schetter ErikaC.FrankM. J.PajtasP.SantessoD.et al. (2008). Single dose of a dopamine agonist impairs reinforcement learning in humans: behavioral evidence from a laboratory-based measure of reward responsiveness. Psychopharmacology (Berl)196, 221–232. 10.1007/s00213-007-0957-y
102
PlassmannH.O’DohertyJ.RangelA. (2007). Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. J. Neurosci.27, 9984–9988. 10.1523/jneurosci.2131-07.2007
103
PolitisM.LoaneC.WuK.O’SullivanS. S.WoodheadZ.KiferleL.et al. (2013). Neural response to visual sexual cues in dopamine treatment-linked hypersexuality in Parkinson’s disease. Brain136(Pt. 2), 400–411. 10.1093/brain/aws326
104
PontoneG.WilliamsJ. R.BassettS. S.MarshL. (2006). Clinical features associated with impulse control disorders in Parkinson disease. Neurology67, 1258–1261. 10.1212/01.wnl.0000238401.76928.45
105
PotenzaM. N.SteinbergM. A.SkudlarskiP.FulbrightR. K.LacadieC. M.WilberM. K.et al. (2003). Gambling urges in pathological gambling: a functional magnetic resonance imaging study. Arch. Gen. Psychiatry60, 828–836. 10.1001/archpsyc.60.8.828
106
PreuschoffK.QuartzS. R.BossaertsP. (2008). Human insula activation reflects risk prediction errors as well as risk. J. Neurosci.28, 2745–2752. 10.1523/jneurosci.4286-07.2008
107
PritchardT. C.MacalusoD. A.EslingerP. J. (1999). Taste perception in patients with insular cortex lesions. Behav. Neurosci.113, 663–671. 10.1037//0735-7044.113.4.663
108
QuickfallJ.SuchowerskyO. (2007). Pathological gambling associated with dopamine agonist use in restless legs syndrome. Parkinsonism Relat. Disord.13, 535–536. 10.1016/j.parkreldis.2006.10.001
109
RaoH.MamikonyanE.DetreJ. A.SiderowfA. D.SternM. B.PotenzaM. N.et al. (2010). Decreased ventral striatal activity with impulse control disorders in Parkinson’s disease. Mov. Disord.25, 1660–1669. 10.1002/mds.23147
110
RayN. J.MiyasakiJ. M.ZurowskiM.KoJ. H.ChoS. S.PellecchiaG.et al. (2012). Extrastriatal dopaminergic abnormalities of DA homeostasis in Parkinson’s patients with medication-induced pathological gambling: a [11C] FLB-457 and PET study. Neurobiol. Dis.48, 519–525. 10.1016/j.nbd.2012.06.021
111
ReuterJ.RaedlerT.RoseM.HandI.GlascherJ.BuchelC. (2005). Pathological gambling is linked to reduced activation of the mesolimbic reward system. Nat. Neurosci.8, 147–148. 10.1038/nn1378
112
ReynoldsJ. N.HylandB. I.WickensJ. R. (2001). A cellular mechanism of reward-related learning. Nature413, 67–70. 10.1038/35092560
113
RibaJ.KrämerU. M.HeldmannM.RichterS.MünteT. F. (2008). Dopamine agonist increases risk taking but blunts reward-related brain activity. PLoS One3:e2479. 10.1371/journal.pone.0002479
114
RogersR. D.LancasterM.WakeleyJ.BhagwagarZ. (2004). Effects of beta-adrenoceptor blockade on components of human decision-making. Psychopharmacology (Berl)172, 157–164. 10.1007/s00213-003-1641-5
115
RollsE. T.MccabeC.RedouteJ. (2008). Expected value, reward outcome, and temporal difference error representations in a probabilistic decision task. Cereb. Cortex18, 652–663. 10.1093/cercor/bhm097
116
RoyA.AdinoffB.RoehrichL.LamparskiD.CusterR.LorenzV.et al. (1988). Pathological gambling. A psychobiological study. Arch. Gen. Psychiatry45, 369–373. 10.1001/archpsyc.1988.01800280085011
117
RutledgeR. B.DeanM.CaplinA.GlimcherP. W. (2010). Testing the reward prediction error hypothesis with an axiomatic model. J. Neurosci.30, 13525–13536. 10.1523/jneurosci.1747-10.2010
118
SanfeyA. G.RillingJ. K.AronsonJ. A.NystromL. E.CohenJ. D. (2003). The neural basis of economic decision-making in the Ultimatum Game. Science300, 1755–1758. 10.1126/science.1082976
119
SchultzW.DayanP.MontagueP. R. (1997). A neural substrate of prediction and reward. Science275, 1593–1599. 10.1126/science.275.5306.1593
120
SchultzW.TremblayL. È.HollermanJ. R. (1998). Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology37, 421–429. 10.1016/s0028-3908(98)00071-9
121
SchultzW. (2002). Getting formal with dopamine and reward. Neuron36, 241–263. 10.1016/s0896-6273(02)00967-4
122
SeedatS.KeslerS.NiehausD. J.SteinD. J. (2000). Pathological gambling behaviour: emergence secondary to treatment of Parkinson’s disease with dopaminergic agents. Depress. Anxiety11, 185–186. 10.1002/1520-6394(2000)11:4<185::aid-da8>3.3.co;2-8
123
SeeleyW. W.MenonV.SchatzbergA. F.KellerJ.GloverG. H.KennaH.et al. (2007). Dissociable intrinsic connectivity networks for salience processing and executive control. J. Neurosci.27, 2349–2356. 10.1523/jneurosci.5587-06.2007
124
ShafferH. J.HallM. N.Vander BiltJ. (1999). Estimating the prevalence of disordered gambling behavior in the United States and Canada: a research synthesis. Am. J. Public Health89, 1369–1376. 10.2105/ajph.89.9.1369
125
ShenW.FlajoletM.GreengardP.SurmeierD. J. (2008). Dichotomous dopaminergic control of striatal synaptic plasticity. Science321, 848–851. 10.1126/science.1160575
126
SlutskeW. S.EisenS.TrueW. R.LyonsM. J.GoldbergJ.TsuangM. (2000). Common genetic vulnerability for pathological gambling and alcohol dependence in men. Arch. Gen. Psychiatry57, 666–673. 10.1001/archpsyc.57.7.666
127
SmedingH.GoudriaanA.FonckeE.SchuurmanP.SpeelmanJ.SchmandB. (2007). Pathological gambling after bilateral STN stimulation in Parkinson disease. J. Neurol. Neurosurg. Psychiatry78, 517–519. 10.1136/jnnp.2006.102061
128
St OngeJ. R.FlorescoS. B. (2009). Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology34, 681–697. 10.1038/npp.2008.121
129
SteevesT. D.MiyasakiJ.ZurowskiM.LangA. E.PellecchiaG.Van EimerenT.et al. (2009). Increased striatal dopamine release in Parkinsonian patients with pathological gambling: a [11C] raclopride PET study. Brain132, 1376–1385. 10.1093/brain/awp054
130
SurmeierD. J.ShenW.DayM.GertlerT.ChanS.TianX.et al. (2010). The role of dopamine in modulating the structure and function of striatal circuits. Prog. Brain Res.183, 149–167. 10.1016/s0079-6123(10)83008-0
131
SuttonR. S.BartoA. G. (1998). Reinforcement Learning: An Introduction.Cambridge, MA: The MIT Press.
132
TakahashiH.FujieS.CamererC.ArakawaR.TakanoH.KodakaF.et al. (2013). Norepinephrine in the brain is associated with aversion to financial loss. Mol. Psychiatry18, 3–4. 10.1038/mp.2012.7
133
ThutG.SchultzW.RoelckeU.NienhusmeierM.MissimerJ.MaguireR. P.et al. (1997). Activation of the human brain by monetary reward. Neuroreport8, 1225–1228. 10.1097/00001756-199703240-00033
134
Tippmann-PeikertM.ParkJ. G.BoeveB. F.ShepardJ. W.SilberM. H. (2007). Pathologic gambling in patients with restless legs syndrome treated with dopaminergic agonists. Neurology68, 301–303. 10.1212/01.wnl.0000252368.25106.b6
135
TomS. M.FoxC. R.TrepelC.PoldrackR. A. (2007). The neural basis of loss aversion in decision-making under risk. Science315, 515–518. 10.1126/science.1134239
136
TricomiE. M.DelgadoM. R.FiezJ. A. (2004). Modulation of caudate activity by action contingency. Neuron41, 281–292. 10.1016/s0896-6273(03)00848-1
137
van der MeerM.Kurth-NelsonZ.RedishA. D. (2012). Information processing in decision-making systems. Neuroscientist18, 342–359. 10.1177/1073858411435128
138
van EimerenT.BallangerB.PellecchiaG.MiyasakiJ. M.LangA. E.StrafellaA. P. (2009). Dopamine agonists diminish value sensitivity of the orbitofrontal cortex: a trigger for pathological gambling in Parkinson’s disease[quest]. Neuropsychopharmacology34, 2758–2766. 10.1038/sj.npp.npp2009124
139
VazeyE. M.Aston-JonesG. (2012). The emerging role of norepinephrine in cognitive dysfunctions of Parkinson’s disease. Front. Behav. Neurosci.6:48. 10.3389/fnbeh.2012.00048
140
Verdejo-GarciaA.LawrenceA. J.ClarkL. (2008). Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies. Neurosci. Biobehav. Rev.32, 777–810. 10.1016/j.neubiorev.2007.11.003
141
VickeryT. J.ChunM. M.LeeD. (2011). Ubiquity and specificity of reinforcement signals throughout the human brain. Neuron72, 166–177. 10.1016/j.neuron.2011.08.011
142
VitaroF.ArseneaultL.TremblayR. E. (1999). Impulsivity predicts problem gambling in low SES adolescent males. Addiction94, 565–575. 10.1046/j.1360-0443.1999.94456511.x
143
VoonV.GaoJ.BrezingC.SymmondsM.EkanayakeV.FernandezH.et al. (2011). Dopamine agonists and risk: impulse control disorders in Parkinson’s; disease. Brain134(Pt. 5), 1438–1446. 10.1093/brain/awr080
144
VoonV.PessiglioneM.BrezingC.GalleaC.FernandezH. H.DolanR. J.et al. (2010). Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors. Neuron65, 135–142. 10.1016/j.neuron.2009.12.027
145
VoonV.PotenzaM. N.ThomsenT. (2007a). Medication-related impulse control and repetitive behaviors in Parkinson’s disease. Curr. Opin. Neurol.20, 484–492. 10.1097/WCO.0b013e32826fbc8f
146
VoonV.RizosA.ChakravarttyR.MulhollandN.RobinsonS.HowellN. A.et al. (2014). Impulse control disorders in Parkinson’s disease: decreased striatal dopamine transporter levels. J. Neurol. Neurosurg. Psychiatry85, 148–152. 10.1136/jnnp-2013-305395
147
VoonV.ThomsenT.MiyasakiJ. M.de SouzaM.ShafroA.FoxS. H.et al. (2007b). Factors associated with dopaminergic drug-related pathological gambling in Parkinson disease. Arch. Neurol.64, 212–216. 10.1001/archneur.64.2.212
148
WagerT. D.RillingJ. K.SmithE. E.SokolikA.CaseyK. L.DavidsonR. J.et al. (2004). Placebo-induced changes in FMRI in the anticipation and experience of pain. Science303, 1162–1167. 10.1126/science.1093065
149
WeintraubD.KoesterJ.PotenzaM. N.SiderowfA. D.StacyM.VoonV.et al. (2010). Impulse control disorders in Parkinson disease: a cross-sectional study of 3090 patients. Arch. Neurol.67, 589–595. 10.1001/archneurol.2010.65
150
WeintraubD.SiderowfA. D.PotenzaM. N.GoveasJ.MoralesK. H.DudaJ. E.et al. (2006). Association of dopamine agonist use with impulse control disorders in Parkinson disease. Arch. Neurol.63, 969–973. 10.1001/archneur.63.7.969
151
WellerJ. A.LevinI. P.ShivB.BecharaA. (2009). The effects of insula damage on decision-making for risky gains and losses. Soc. Neurosci.4, 347–358. 10.1080/17470910902934400
152
WexlerB. E.GottschalkC. H.FulbrightR. K.ProhovnikI.LacadieC. M.RounsavilleB. J.et al. (2001). Functional magnetic resonance imaging of cocaine craving. Am. J. Psychiatry158, 86–95. 10.1176/appi.ajp.158.1.86
153
WiseR. A.RompreP. P. (1989). Brain dopamine and reward. Annu. Rev. Psychol.40, 191–225. 10.1146/annurev.psych.40.1.191
154
WiseR. A. (1996). Addictive drugs and brain stimulation reward. Annu. Rev. Neurosci.19, 319–340. 10.1146/annurev.neuro.19.1.319
155
WiseR. A. (2013). Dual roles of dopamine in food and drug seeking: the drive-reward paradox. Biol. Psychiatry73, 819–826. 10.1016/j.biopsych.2012.09.001
156
WrayI.DickersonM. G. (1981). Cessation of high frequency gambling and withdrawal’ symptoms. Br. J. Addict.76, 401–405. 10.1111/j.1360-0443.1981.tb03238.x
157
YacubianJ.GlascherJ.SchroederK.SommerT.BrausD. F.BuchelC. (2006). Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J. Neurosci.26, 9530–9537. 10.1523/JNEUROSCI.2915-06.2006
158
YarkoniT.PoldrackR. A.NicholsT. E.Van EssenD. C.WagerT. D. (2011). Large-scale automated synthesis of human functional neuroimaging data. Nat. Methods8, 665–670. 10.1038/nmeth.1635
159
YeZ.HammerA.CamaraE.MünteT. F. (2010). Pramipexole modulates the neural network of reward anticipation. Hum. Brain Mapp.32, 800–811. 10.1002/hbm.21067
160
ZaldD. H.BoileauI.El-DearedyW.GunnR.McGloneF.DichterG. S.et al. (2004). Dopamine transmission in the human striatum during monetary reward tasks. J. Neurosci.24, 4105–4112. 10.1523/jneurosci.4643-03.2004
161
ZuckermanM.NeebM. (1979). Sensation seeking and psychopathology. Psychiatry Res.1, 255–264. 10.1016/0165-1781(79)90007-6
Summary
Keywords
impulse control disorders, impulsivity, reward, loss aversion, insula, ventral striatum
Citation
Clark CA and Dagher A (2014) The role of dopamine in risk taking: a specific look at Parkinson’s disease and gambling. Front. Behav. Neurosci. 8:196. doi: 10.3389/fnbeh.2014.00196
Received
16 March 2014
Accepted
12 May 2014
Published
30 May 2014
Volume
8 - 2014
Edited by
Paul Vezina, The University of Chicago, USA
Reviewed by
Walter Adriani, Istituto Superiore di Sanita, Italy; Andrew David Lawrence, Cardiff University, UK
Copyright
© 2014 Clark and Dagher.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alain Dagher, Montreal Neurological Institute, McGill University, 3801 University St., Montreal, QC H3A 2B4, Canada e-mail: alain.dagher@mcgill.ca
This article was submitted to the journal Frontiers in Behavioral Neuroscience.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.