- 1Netherlands Institute for Neuroscience, Institute of the Royal Netherlands Academy of Arts and Sciences, Amsterdam, Netherlands
- 2Department of Psychiatry, Academic Medical Center, University of Amsterdam, Amsterdam, Netherlands
Striatal dopamine (DA) is thought to code for learned associations between cues and reinforcers and to mediate approach behavior toward a reward. Less is known about the contribution of DA to cognitive flexibility—the ability to adapt behavior in response to changes in the environment. Altered reward processing and impairments in cognitive flexibility are observed in psychiatric disorders such as obsessive compulsive disorder (OCD). Patients with this disorder show a disruption of functioning in the frontostriatal circuit and alterations in DA signaling. In this review we summarize findings from animal and human studies that have investigated the involvement of striatal DA in cognitive flexibility. These findings may provide a better understanding of the role of dopaminergic dysfunction in cognitive inflexibility in psychiatric disorders, such as OCD.
Introduction
In a constantly changing environment behavior has to be adaptive and flexible. Cognitive flexibility is the ability to adapt goal-directed behavior in response to changing situational demands. Cognitive flexibility is one of the cognitive domains that are grouped together as executive functions or executive control (Gilbert and Burgess, 2008). Despite the necessity of cognitive flexibility for everyday functioning there is a substantial variation within the healthy population (Miyake and Friedman, 2012) that can be related to variations in dopamine (DA) related genes in humans (Braver et al., 2010; Barnes et al., 2011) and mice (Laughlin et al., 2011). Specific deficits in the ability to flexibly update behavior are observed in various neurological and psychiatric disorders such as Parkinson's disease, schizophrenia, autism, addiction and obsessive compulsive disorder (OCD) (Cools et al., 2001; Chamberlain et al., 2006; Verdejo-Garcia et al., 2006; Ceaser et al., 2008; Yerys et al., 2009).
Here, we intend to provide an overview of animal and human studies on the relation between cognitive flexibility and DA neurotransmission and relate this to OCD, a psychiatric disease that combines defects in cognitive flexibility and alterations in DA processes.
Testing Cognitive Flexibility
The successful adaptation of behavior following changes in the environment encompasses several cognitive processes, such as associative learning, decision making, response selection and inhibition, working memory and attention. Several neuropsychological tests have been constructed to study different types of cognitive flexibility, which may recruit varied cognitive functions and depend on parallel neurobiological substrates. The use and translational applicability of a number of these tasks was discussed by Barch et al. (2009). One set of tasks probes flexibility of choice behavior, where selection of one from two or more options leads to a wanted outcome. For a specific response to be adapted, the behavior has to be acquired first. During discrimination learning, subjects learn to discriminate between a certain rewarded/correct stimulus, strategy or response rule and another one that is not rewarded/correct. When task demands change, the response that has been successful so far no longer yields reward and has to be inhibited, whilst another response/stimulus/strategy has to be chosen, initiated and maintained. This requires extinction of the old association and acquisition of a novel association. Classical reversal learning and intra- and extradimensional attentional set-shifting fall in this category.
Reversal learning
With reversal learning, the ability to adapt behavior in response to a reversal of reinforcement contingencies is studied. This requires a shift in valence between stimuli or locations that have been associated with a specific outcome (e.g., a reward) previously. Depending on the operationalization of the reversal task used, this can be a reversal of all sorts of cues, but the choice options remain the same.
Attentional set-shifting and strategy shifting
Attentional set-shifting requires adaptation of behavior following changes in the relevance of perceptual categories or dimensions. In an intradimensional set-shift, new stimulus exemplars (i.e., novel choice options) are presented but the relevant stimulus dimension does not change between trials. Successful shifting requires maintenance of the current rule (attentional set) and adapting behavior accordingly. In an extradimensional set-shift, not only are the stimulus exemplars novel, but the reinforced dimension has also changed. This requires a response shift to a dimension that has previously been irrelevant and bypassing of an acquired attentional bias (Rogers et al., 2000).
In human subjects, the ability to shift cognitive sets is commonly tested with the Wisconsin Card Sorting Test (WCST). The WCST requires matching of a multi-dimensional cue card to one of four reference cards according to a specific stimulus aspect. The attentional set-shifting task has been developed as a non-human primate version of the WCST (Roberts et al., 1988). Because it is a more direct measure of the ability to shift cognitive set and a better measure for frontal lobe impairments (Rogers et al., 2000), it is now often used in human subjects as well.
Both reversal learning and attentional set-shifting paradigms have been developed for humans, non-human primates and rodents. Stimulus dimensions consist of different visual stimulus sets that can be simple or compound in nature (human, non-human primate, rodent) or stimulus sets consisting of multiple sensory dimensions (spatial, odor, touch, visual); rodent bowl digging procedure (Birrell and Brown, 2000; Garner et al., 2006). Discriminations based on stimulus valence have been classified as representing a lower order of abstraction, whereas discriminations based on stimulus components or abstract rules may represent a higher order of abstraction (Wise et al., 1996; Ragozzino, 2007).
Another example of a procedure based on a response rule or strategy and an unannounced switch to a different rule or strategy is response-based versus cue-based responding on a T-maze, often applied in rodents (Packard, 2009).
A general problem with switching responses in these tasks is that several processes occur simultaneously and that incorrect responses may reflect different mechanisms, i.e., resistance to extinction versus learned irrelevance (Maes et al., 2004). Task adaptation (Tait and Brown, 2007) or detailed analysis (e.g., Dias et al., 1996a) lead to more informative outcomes. Three-choice paradigms have been used in non-human primates and may offer superior experimental approaches as they allow testing of more variable conditions and require animals to trace the value of several alternative options, as a change in one option does not automatically imply a change in the other alternative options (Walton et al., 2010).
Task switching
Task switching is a paradigm that is mostly, but not exclusively (Stoet and Snyder, 2003; Leenaars et al., 2012) used in human subjects and requires the rapid switching between stimulus-response sets that have been acquired previously (Sohn et al., 2000; Monsell, 2003). Presentation of an external cue indicates which task (stimulus-response set) has to be executed in a given trial. This differs fundamentally from reversal learning and set-shifting procedures, where the presentation of altered contingencies (i.e., “the switch”) is not cued and subjects have to use the change in reinforcing feedback to adapt behavior accordingly.
Control over prepotent or automatic responses
Another category incorporates tasks that probe the ability to behave flexibly in conditions that previously allowed automatic or habitual performance. A well-known example is the countermanding or stop-signal task (Logan et al., 1984; Eagle et al., 2008), testing inhibitory control over actions. Another example is the anti-saccade task where a more or less automatic action needs to be suppressed to allow flexible responding (Munoz and Everling, 2004). In the present review we focus on studies using reversal learning, attentional set-shifting (including WCST) and task-switching as these tasks have received most translational interest, have been related to DA function and have been performed in OCD patients.
Neural Circuitry Supporting Cognitive Flexibility
Prefrontal cortex
Within the prefrontal cortex (PFC), damage to different prefrontal areas results in dissociable deficits in separate forms of cognitive flexibility. Damage to the orbitofrontal cortex (OFC) is thought to specifically impair reversal learning, but not attentional set-shifting (Dias et al., 1996a; McAlonan and Brown, 2003; Hornak et al., 2004; Boulougouris et al., 2007). Damage to the lateral PFC [or medial PFC in rodents, suggested to be functionally equivalent; (Uylings et al., 2003)] specifically impairs (extradimensional) shifting of attentional sets but not reversal learning (Owen et al., 1991; Dias et al., 1996a, 1997; Birrell and Brown, 2000; Bissonette et al., 2008). However, the proposed unique role of the OFC in reversal learning is under discussion and alternative views have been presented (Schoenbaum et al., 2009). Recent findings suggest that impaired reversal learning in Rhesus monkeys is only observed following aspiration but not excitotoxic OFC lesions (Rudebeck et al., 2013), suggesting that reversal learning does not depend on an intact OFC but instead on intact communication between other prefrontal areas and more caudal structures. While human brain lesions generally involve passing fibers and brain parenchym, many studies in rodents and new world monkeys report deficits after fiber-sparing lesions. The transient character of impairments in these studies may reflect evolution-related differences in neurobiological and/or anatomical substrates of reversal learning (Rudebeck et al., 2013).
Striatum
Reciprocal projections from PFC to the striatum and thalamus form parallel frontostriatal loops, suggesting striatal regions also contribute to the regulation of cognitive flexibility (Rogers et al., 2000; Floresco et al., 2006a; Ragozzino, 2007; Clarke et al., 2008; Castane et al., 2010). Combined results from lesion and functional imaging studies suggest that different types of cognitive flexibility are regulated by segregated fronto-striatal circuits: OFC and dorsomedial striatum (human/non-human primate: caudate nucleus; functional equivalent rodent area: dorsomedial striatum) are implicated in reversal learning (Divac, 1971; Dias et al., 1996a; Rogers et al., 2000; McAlonan and Brown, 2003; Bellebaum et al., 2008; Clarke et al., 2008; Castane et al., 2010; Ghahremani et al., 2010). Set- and task switching performance relies on connections between the dorsolateral PFC (or the medial PFC in rodents which is in this task functionally equivalent) and striatum (Owen et al., 1991; Dias et al., 1996a,b; Birrell and Brown, 2000; Sohn et al., 2000; Manes et al., 2002; Ragozzino, 2007; Graham et al., 2009). It should be noted that these circuits are not fully segregated but overlapping. Importantly, these circuits show consistent similarities between primates and rodents (Mailly et al., 2013).
Dopamine
DA is an important neuromodulator in fronto-striatal circuits. A substantial amount of work has described a role for DA in reward-related learning and motivated behavior. More specifically, burst firing of DA neurons (associated with phasic DA release) may code a quantitative prediction error that serves as a teaching signal to guide behavior and is essential for a range of learning situations (Montague et al., 1996; Schultz et al., 1997; Schultz, 2013; Steinberg et al., 2013). Yet not much is known about the contribution of DA to the adaptation of behavior following changing task demands, such as a reversal of contingencies. A common factor in all tests of cognitive flexibility is the expectation of a reward (or absence of punishment) when a correct response is made. The absence of an expected reward and presence of an unexpected reward following a reversal or shift is the archetypal situation for the occurrence of reward prediction errors coded by DA. Therefore, one would expect that DA is in some way involved in the regulation of cognitive flexibility. However, in the past decade the role of the PFC and its serotonergic innervation in cognitive flexibility received most attention (e.g., Robbins and Arnsten, 2009).
In this review, we summarize findings from animal and human studies that investigated whether DA contributes to the regulation of cognitive flexibility. First, we will describe pharmacological manipulations to the DA system in humans and animals, then DA-related genetics in humans and animals. Next, we report on DA changes and cognitive flexibility in OCD, to investigate whether alterations in DA signaling contribute to cognitive inflexibility in this disorder. Previously, OCD has been proposed to be characterized by a hyperdopaminergic state (Denys et al., 2004b) and similar states in animals have repeatedly been described as leading to OCD-like behaviors (see further). This, combined with the suggestion that impairments in the ability to flexibly adapt behavior may be an endophenotype for OCD (Robbins et al., 2012) drove us to review the evidence for a relation between the two.
Pharmacological Manipulations and Imaging Studies in Human Subjects
DA Synthesis
DA synthesis capacity in humans is determined after administration of radio labeled F-DOPA or F-tyrosine and imaging the resulting fluorinated amines using PET. The observed variations in DA synthesis capacity may relate to variations in DA neurotransmission, as a significant negative correlation between synthesis capacity and D2- receptor availability was reported (Ito et al., 2011). Decreasing DA synthesis by dietary omission of DA precursors tyrosine and phenylalanine reduces occupation of D2 receptors by endogenous DA, suggesting decreased DA transmission (Montgomery et al., 2003). Administration of the tyrosine hydroxylase inhibitor alpha-methyl-paratyrosine also reduces D2 occupation by endogenous DA (Verhoeff et al., 2003), but affects noradrenergic signaling as well (Krahn et al., 1999).
The small number of studies using these approaches does not support a general relation between DA synthesis and flexible updating of task information: no correlation was observed between DA synthesis capacity and task performance on the WCST (Vernaleken et al., 2007), and reward- and punishment-based reversal learning was not impaired following DA depletion in males (Robinson et al., 2010). In contrast, catecholamine depletion (affecting both DA and NA) impaired performance during probabilistic reversal learning (Hasler et al., 2009).
Other studies suggest that when tasks are used that allow more selective approaches, a differential involvement of DA synthesis is observed. Thus, subjects with high DA synthesis capacity perform worse compared to subjects with low DA synthesis capacity when presented with shifts in object features but not in abstract rules in a task-switching paradigm (Dang et al., 2012). Cools et al. (2009) reported that individuals with high DA synthesis capacity perform better when presentation of an unexpected reward signals reversal compared to reversals that are signaled by presentation of an unexpected punishment, whereas the opposite is observed for individuals with low DA synthesis capacity. Females tend to have a higher DA synthesis capacity (Laakso et al., 2002) and this may explain gender-related differences such as the DA depletion-induced improvement of punishment-based but not reward-based reversal learning in females (Robinson et al., 2010).
In conclusion, DA synthesis is differentially associated with task features in cognitive flexibility and variations in synthesis capacity affect performance only in some task conditions, probably depending on specific DA homeostasis parameters in cortical and striatal areas (cf. Cools and D'Esposito, 2011).
DA Receptor/Transporter Binding
Using imaging techniques, baseline availability of DA receptors and transporters can be investigated and related to task performance. Receptor availability in resting conditions provides an index of the number of receptors unoccupied by the endogenous transmitter. Subjects with higher availability of DA transporters in the striatum make less perseverative errors in the WCST (Hsieh et al., 2010) but the interpretation of this finding depends on whether the higher availability reflects the density of the DA innervation or a possible substrate-induced adaptation (Chen et al., 2010).
WCST performance has also been linked to differences in DA receptor availability (see Table 1). Decreased striatal D2 availability is associated with impaired performance (Volkow et al., 1998), but D2/D3 receptor binding in the anterior cingulate cortex correlates positively with the number of errors made in the WCST (Lumme et al., 2007).
Table 1. Summary of effects of pharmacological manipulations to the dopamine system on cognitive flexibility in human subjects.
For DA transmission through D1 receptors, an optimal level of DA activity is required for best working memory performance (Williams and Goldman-Rakic, 1995; Zahrt et al., 1997; Vijayraghavan et al., 2007). Similar results were obtained for flexible responding in the WCST where impaired performance is observed for both high and low prefrontal D1 (but not D2) binding [(Takahashi et al., 2008), but see Karlsson et al. (2011)].
When receptor availability is assessed during task performance, it provides a measure of task-related release of endogenous DA. Reduced binding to D2 receptors in the dorsal striatum (Monchi et al., 2006a) and anterior cingulate cortex (Ko et al., 2009) during set-shifting (see Monchi et al., 2006b) suggests that DA is indeed released during tasks requiring flexibility. Transient inactivation of dorsolateral PFC activity impaired striatal DA release as well as task performance, suggesting both are under top–down control by the dorsolateral PFC (Ko et al., 2008).
Taken together, these findings indicate that DA is activated and can influence performance on set-shifting tasks through D2 receptors in the striatum and anterior cingulate cortex, whereas in the PFC, DA activity through D1 receptors can modulate performance. In addition, optimum values may exist for both extracellular DA concentrations and DA receptor numbers. The majority of studies relating performance on cognitive flexibility tasks to DA-receptor binding potential have specifically focused on binding to D2 receptors in specifically delineated brain areas. Therefore, although this provides evidence that D2 receptors modulate performance in these types of tasks, one cannot exclude the involvement of D1 receptors.
Pharmacological Manipulations Affecting DA Signaling
DA neurotransmission during task performance can be influenced by administration of pharmacological agents that directly bind to DA receptors or by drugs that induce DA release. Combining the administration of pharmacological agents with functional imaging during task performance indicates in which brain areas modulation by DA is most pronounced.
DA Antagonist
Systemic administration of the D2 receptor antagonist sulpiride slows response times during task-switching (Mehta et al., 2004) and impairs performance of an extra-dimensional set-shift, without affecting intra-dimensional set-shifting (Mehta et al., 1999, 2004). Sulpiride enhances performance on reward-based reversal learning (van der Schaaf et al., 2012). This behavioral effect was stronger in subjects with higher working memory capacity [which is assumed to reflect higher striatal DA synthesis capacity (Cools et al., 2008)]. In addition to behavioral effects, sulpiride also increased striatal BOLD signals during unexpected outcomes, irrespective of whether the unexpected outcome was a reward or a punishment (van der Schaaf et al., 2012).
Indirect DA Agonist
Methylphenidate is a psychostimulant that increases striatal extracellular DA levels (Volkow et al., 2001), but also affects serotonin (5-hydroxytryptamin, 5-HT) and noradrenaline (Kuczenski and Segal, 1997). Administration of methylphenidate leads to displacement of raclopride binding to D2/3 receptors (Clatworthy et al., 2009). These changes in the post commissural part of the caudate nucleus were associated with effects on reversal learning, such that a large displacement following methylphenidate was associated with impaired performance and a small displacement with improved performance (Clatworthy et al., 2009). As these effects may depend on individual variation in receptor availability and DA synthesis capacity, behavioral effects of the psychostimulant on measures of flexibility are likely to be averaged out when the individual variation is not taken into account—which may explain the negative results on attentional set-shifting (Elliott et al., 1997).
Administration of methylphenidate influences brain activation in ventral striatal regions during behavioral adaptation and modulates activity in frontal regions during cognitive control. Thus, activation in ventral striatal regions was reduced during reversal errors (even in the absence of behavioral effects), whereas in prefrontal regions, increased activation was observed following correct responses (Dodds et al., 2008). The balance of DA in frontal and striatal regions may therefore be crucial in regulating the balance between cognitive control and cognitive flexibility.
DA Agonist
Interestingly, DA synthesis capacity also influences the effect of direct DA agonists on task performance. While (Mehta et al., 2001) originally observed an increase in non-perseverative errors and slowed reaction times during probabilistic reversal learning after administration of the D2 agonist bromocriptine, Cools et al. (2009) later showed that this drug impaired reversal learning from unexpected rewards in subjects with high DA synthesis capacity, but improved the same parameter in subjects with low synthesis capacity in striatal regions.
The beneficial effect of D2 receptor stimulation in subjects with low DA synthesis capacity is not limited to reversal learning. Bromocriptine can also improve performance on the WCST (Kimberg et al., 1997) and task-switching performance (van Holstein et al., 2011) in subjects with low DA synthesis capacity, whereas no effects are observed following administration of pergolide, which differs from bromocriptine in that it also activates D1 receptors (Kimberg and D'Esposito, 2003). That the improvement on task switching after bromocriptine can be specifically related to the function of D2 receptors was shown by (van Holstein et al., 2011), as pre-treatment with the D2 antagonist sulpiride blocked the beneficial effect. Therefore, performance of subjects with high DA synthesis capacity is impaired following administration of bromocriptine, and increases following administration of sulpiride.
Summary and Conclusion
To conclude (see Table 1), flexible updating of behavior in set-shifting tasks (WCST and attentional set-shifting) as well as task switching is associated with increased DA neurotransmission through D2-receptors. In particular, the mediating effects of D2 signaling on task performance have been observed in the dorsal striatum and anterior cingulate cortex, which is in line with observations from imaging and lesion studies suggesting the involvement of the connections between PFC and dorsal striatum in the regulation of these types of flexibility (Owen et al., 1991; Sohn et al., 2000). This also concurs with observations in patients with PD. In the early stages of PD, when DA depletion is largely limited to the dorsal striatum, patients show impairments in task switching whereas reversal learning performance is spared. Administration of levodopa reverses the impairments in task switching, whilst it impairs performance on reversal learning probably due to overstimulation of DA receptors in ventral striatal regions (Cools, 2006; Kehagia et al., 2010). In control subjects increased D2-mediated transmission also impairs reversal learning, although this may turn into an improvement when DA synthesis capacity is low.
Human studies have particularly shown the importance of individual differences in the DA system. Individual differences in DA synthesis capacity influence both task performance and effects of manipulations to the DA system in different types of flexibility. Individual differences in D2 receptor availability also influence stimulation-induced changes in performance during reversal learning. The combined study of manipulations to the DA system with performance on behavioral tasks, indicate that DA transmission in the ventral striatum changes during reversal learning.
These results also indicate that there may be differences in the involvement of DA in reversal learning compared to set-shifting and task switching. As noted before, these paradigms are thought to represent different levels of complexity and may depend on different brain areas. However, studies differ in the task designs used to study one type of cognitive flexibility. Therefore, replication of effects of DAergic manipulations using similar task designs would help in delineating the possible differences in DA contribution to reversal, set-shifting and task switching.
A question remains in what way D1 receptors contribute to behavioral performance during cognitive flexibility tasks. Direct manipulations of D1 signaling or studies relating performance on behavioral task to D1 receptors availability are scarce. Combining the administration of pharmacological agents with functional imaging during performance of different behavioral paradigms may provide more insight on the effects of DA on cognitive flexibility in prefrontal and striatal regions.
Pharmacological Manipulations in Animals
The use of pharmacological imaging in human subjects provides insight into the role of DA in cognitive flexibility, but the use of animals permits direct (and invasive) manipulations and measurements and can extend and specify findings obtained in human subjects. Here, we will discuss animal studies that have used pharmacological manipulations of the DA system or DA depletion to investigate in what way DA in prefrontal and striatal regions contributes to cognitive flexibility.
DA Depletion Studies
In rodents, lesioning DAergic projections in the nucleus accumbens core (though DA in the medial PFC was similarly affected) impairs both spatial discrimination and reversal learning on a T-maze (Taghzouti et al., 1985). Selective depletion of DA neurotransmission in the dorsomedial striatum impairs odor guided reversal learning, without affecting initial discrimination learning (O'Neill and Brown, 2007). A selective deficit in reversal learning following DA depletion in the dorsomedial striatum was observed in primates as well (Clarke et al., 2011). The deficit in reversal learning following DA depletion is not perseverative, suggesting that DA may be particularly important for the learning phase after reversal, rather than mediating response inhibition to the previously rewarded side. The effect was not only shown in the first, but also in subsequent reversals. Importantly, the deficit is neurochemically specific, as depletion of 5-HT neurotransmission in the mediate caudate nucleus does not affect behavioral performance during reversal learning (Clarke et al., 2011). A previous study also found decreased performance on reversal learning (although this did not reach significance) (Collins et al., 2000). Subsequently, Crofts et al. (2001) showed that although acquisition, maintenance and initial shifting of an attentional set are intact, monkeys with DA depletion in the caudate are impaired when they have to make an attentional shift to a stimulus dimension that was learned to be irrelevant in a previous extra dimensional shift (Collins et al., 2000; Crofts et al., 2001). Therefore, DA in the caudate nucleus appears to be involved in situations that require a shift of established cognitive sets (Collins et al., 2000).
In contrast to DA depletion in striatal regions, selective DA depletion in frontal regions is complicated by the accompanied depletion of noradrenaline (Roberts et al., 1994; Crofts et al., 2001). Although Roberts et al. (1994) observed a specific improvement in performance on extra-dimensional set-shifts after prefrontal catecholamine depletion in non-human primates, a later study suggests that this may actually result from an inability to maintain an attentional set (Crofts et al., 2001). Prefrontal catecholamine depletion is associated with long lasting enhancement of striatal DA release, suggesting that it may be the balance between DA levels in prefrontal and striatal regions rather than DA levels in either region that affects behavior (Roberts et al., 1994).
DA Versus 5-HT
Based on data from depletion studies, a neurochemical dissociation between prefrontal and striatal regions in the control of cognitive flexibility during reversal learning has been suggested. In the caudate nucleus, DA, but not 5-HT depletion impairs performance during reversal learning. Previously, it was reported that 5-HT, but not DA neurotransmission in the OFC is required for successful behavioral adaptation in a spatial reversal learning task (Clarke et al., 2004, 2007). Depletion of 5-HT in the OFC specifically impairs reversal learning by increasing perseverative responding, but does not affect attentional set-shifting (Clarke et al., 2005). OFC DA depletion, however, leads to impaired extinction, albeit not in a perseverative manner (Walker et al., 2009). The contributions of 5-HT and DA neurotransmission to cognitive flexibility therefore appear to be confined to separate functions related to regions of the cortico-striatal circuit. Recently, (Groman et al., 2013) suggested that the balance between 5-HT levels in the OFC and DA levels in the dorsal striatum contributes to individual differences in cognitive flexibility. Reduced performance on a reversal learning task is associated with low levels of 5HT in the OFC when DA levels in the putamen are low, but not when DA levels in the putamen are high (Groman et al., 2013). These findings indicate that cognitive flexibility is under control of DA and 5-HT, while other data show involvement of noradrenaline, as well (Bouret and Sara, 2004; Lapiz and Morilak, 2006; Seu et al., 2009).
Effects of Psychostimulants
Psychostimulants such as methylphenidate, (meth)amphetamine and cocaine increase release of DA and other monoamines by blocking catecholamine re-uptake or promoting DA release (Sulzer et al., 2005). Administration of methylphenidate in rodents does not affect reversal learning (Seu and Jentsch, 2009; Cheng and Li, 2013), although the latter authors observed beneficial effects in animals with reversal learning impairments (spontaneously hypertensive rats). Effects of amphetamine and methamphetamine on reversal learning have been variable, but possibly dose-dependent: high doses (5 mg/kg) impair reversal learning (Ridley et al., 1981; Arushanian and Baturin, 1982; Idris et al., 2005; Cheng et al., 2007; White et al., 2009; Izquierdo et al., 2010; Kosheleff et al., 2012; Talpos et al., 2012), while intermediate doses 1–2 mg/kg show no effect or improved learning (Wilpizeski and Hamilton, 1964; Kulig and Calhoun, 1972; Mead, 1974; Weiner and Feldon, 1986; Weiner et al., 1986; Daberkow et al., 2008; Pastuzyn et al., 2012; Soto et al., 2012) and low doses again impair reversal performance (Ridley et al., 1981; Idris et al., 2005). These results are compatible with the general idea that cognitive function depends on DA activity in an inverse U-shaped fashion (Cools and D'Esposito, 2011; Arnsten et al., 2012). However, given the multiple and differential effects of psychostimulants on monoamine release in prefrontal and striatal regions it is often difficult to conclude whether these effects depend on increased DA release. Yet, for methylphenidate Cheng and Li (2013) showed that the beneficial effect were blocked by local injections with haloperidol in the OFC.
Systemic Effects of DA (Ant)Agonists
While selective depletion studies indicate specific brain areas where DA modulates flexible behavior, administration of pharmacological agents that are selective for a specific receptor subtype indicate how D1 and D2 receptor subtypes are involved. In primates, both stimulation and inhibition of D2/D3 receptor function results in difficulties in adapting behavior following changing task demands, but not during acquisition of the original discrimination (Smith et al., 1999; Lee et al., 2007). Administration of the D2/D3 antagonist raclopride affects performance on reversal learning when administered alone, but only when the reversal is preceded by retention of the originally acquired discrimination (Lee et al., 2007). Performance is also reduced by the D3/D2 agonist 7-OH-DPAT (Smith et al., 1999) and this deficit is antagonized by co-administration with the D2/D3 antagonist raclopride, but not the D2-selective antagonist sulpiride, suggesting stimulation of D3 receptors impairs performance (Smith et al., 1999).
In rodents, like in primates, administration of a D2/D3 agonist (quinpirole) impaired spatial reversal learning in an operant chamber by increasing the number of perseverative errors. Administration of a D2/D3 antagonist (raclopride) or selective D3 antagonist (nafadotride) had no effect (Boulougouris et al., 2009). The quinpirole-induced deficit is attenuated when raclopride is co-administered, but worsens after co-administration with nafadotride. Selective stimulation of D2-receptors (co-administration of quinpirole and nafadotride) increased both the number of discrimination errors and of perseverative and learning errors in the reversal phase (Boulougouris et al., 2009). Thus, stimulation of D3 receptors may be important for the acquisition of altered response-reward contingencies during reversal learning whereas D2-receptor activation may cause a more generalized impairment (Boulougouris et al., 2009).
Systemic administration of a D1/D5 antagonist does not affect reversal learning in primates (Lee et al., 2007), though in rodents systemic administration of a D1 agonist (SKF-812979) impairs early, but not late stages of reversal learning (Izquierdo et al., 2006). Extradimensional set-shifting on the other hand improves following intermediate, but not high or low doses of a D1 agonist (Nikiforuk, 2012).
These findings suggest that D2-like receptors contribute to the regulation of cognitive flexibility, possibly in a dose-dependent manner. System administration of D1-like receptors has received less attention and could affect cognitive flexibility depending on the species or behavioral task used.
Local Effects in the Striatum
Local manipulations of DA neurotransmission can elucidate in which way DA neurotransmission in specific subregions of the fronto-striatal circuit can contribute to cognitive flexibility (although see, Arnt, 1985) for the limitations of this approach). Execution or suppression of actions leading to reward are controlled by two parallel cortico-striato-thalamo-cortical pathways (Frank and Claus, 2006). From the striatum, output neurons in the direct pathway connect to cortical regions via connections to globus pallidus pars interna (GPi)/substantia nigra pars reticulata (SNr) and thalamus. Output neurons in the indirect pathway project via globus pallidus pars externa, subthalamic nucleus to GPi/SNr, thalamus and cortex. Activity in these pathways can be differentially modulated by activation of D1 or D2 receptors in the striatum (Frank and Claus, 2006). Yawata et al. (2012) investigated pathway specific control of reward learning and cognitive flexibility. Blocked neurotransmission in the direct pathway, combined with D1 blockade in the contralateral nucleus accumbens impaired the acquisition phases of the original discrimination as well as the discrimination presented after a reversal or a rule shift, while stimulation of D1 receptors did not influence behavior (Yawata et al., 2012). Application of a D2 agonist combined with contralateral blockade of the indirect pathway induced perseverative responding during reversal learning and also affected rule shifting, without affecting acquisition of the original discrimination problem (Yawata et al., 2012). These findings suggest that within the nucleus accumbens, stimulation of DA D1 receptors (direct pathway) aids the acquisition and relearning of behavioral responses to a particular stimulus, whereas suppression (i.e., a phasic interruption) of D2-mediated transmission (indirect pathway) may be required to allow reorganization of ongoing behavioral patterns. These results are in line with previous findings reporting impaired reversal learning after local stimulation of D2 receptors, while during set-shifting blocking D1 receptors impaired maintenance of the new strategy and stimulation of D2 receptors induced perseverative responding (Haluk and Floresco, 2009).
Local Effects in the Prefrontal Cortex
DA depletion in the OFC did not affect reversal learning (Clarke et al., 2007), but local manipulation of DA receptors in the OFC can influence aspects of cognitive flexibility. Blockage of D1 or D2 receptors in OFC prevents development of discriminative reaction times to high and low rewards under reversal conditions, without affecting accuracy (Calaminus and Hauber, 2008). In a task that required rats to adapt behavior following a change in reward value, by manipulating the amount of lever presses required to obtain a food pellet, local inhibition of D1 but not D2 receptors in the OFC impaired performance (Winter et al., 2009). In the MPFC, local inhibition of both D1 and D2 receptors inhibits performance (Winter et al., 2009). Set-shifting ability in a maze-based shifting task is affected by manipulations of several DA receptors in the MPFC. Local blockade of D1 and D2 receptors as well as stimulation of D4 receptors results in perseverative responding, whereas blockade of the D4 receptor improves performance (Ragozzino, 2002; Floresco et al., 2006b). This contrasts with the findings of D1 blockade in the nucleus accumbens, which did not induce perseverative responding, but affected maintenance of the new strategy.
In vivo DA Measurements Related to Cognitive Flexibility
Only a few reports on the measurement of extracellular levels of DA in the brain (reflecting DA release) are available. In the nucleus accumbens, these levels are higher during acquisition of a rule shift compared to simple rule acquisition in a T-maze set-shift paradigm (Stefani and Moghaddam, 2006), clearly suggesting a role for DA in the nucleus accumbens in the regulation of cognitive flexibility, in particular strategy or set-shifting. In the mPFC, both rule acquisition and rule shifting in a T-maze are accompanied by increased DA levels and higher basal mPFC DA levels were associated with rapid shifting between discrimination rules (Stefani and Moghaddam, 2006). After inhibiton of COMT, animals also show increased task-related, but not basal extracellular DA levels in the medial PFC, suggesting that task-induced increases in PFC DA release may contribute to set-shifting performance (Tunbridge et al., 2004).
DA (but not noradrenaline) release in the MPFC is elevated and prolonged during performance of a spatial reversal session in a skinnerbox, compared to release in a discrimination session preceding reversal (van der Meulen et al., 2007). Within the reversal session, the DA elevation was most pronounced during the phase in which rats improved performance.
These findings suggest elevated DA release in both striatal and prefrontal regions during execution of cognitive flexibility tasks.
Summary and Conclusion
Taken together (see Table 2), DA appears to be actively involved in the performance of tasks requiring cognitive flexibility: DA release is increased, local DA depletion impairs performance and pharmacological interference alters task execution. Whereas DA depletion studies indicated ventral and dorsomedial striatum as the primary location where DA influences cognitive flexibility, specific DA receptor stimulation/blockade studies and in vivo release measurements implicate prefrontal regions as well. A complicating factor is that manipulation of prefrontal DA also affects striatal DA transmission (Roberts et al., 1994).
Table 2. Summary of effects of pharmacological manipulations to the dopamine system on cognitive flexibility in animals.
It is important to note that impairment of reward-related learning and cognitive flexibility following perturbations in DA signaling is almost always of transient nature: subjects eventually do make the switch when sufficient trials are presented, suggesting that DA may facilitate these behaviors, but is not indispensable.
Interestingly, most pharmacological studies investigating the involvement of DA-subtype selective receptors have indicated that striatal blockade of D1-receptors and overactivation of D2-receptors impairs performance. This was most elegantly shown in the study of Yawata et al. (2012): DA signaling through D1 receptors in the nucleus accumbens and the direct basal ganglia pathway contributes to the acquisition of a new reward-directed behavior in a four-armed maze once switching has occurred (i.e., D1 stimulation could contribute to new learning following a behavioral switch), whereas suppression of D2-mediated transmission in the accumbens and the indirect pathway is required for the reorganization of behavioral patterns. A transient elevation in DA potentiates connections in the direct pathway to initiate movement toward reward, whereas a transient dip in DA potentiates connections in the indirect pathway to suppress movements that are no longer rewarded (Hong and Hikosaka, 2011). The findings from animal studies do indicate a role for the DA in the nucleus accumbens mediating cognitive flexibility, both reversal and strategy or set-shifting, whereas less research has focused on local manipulation of D1 or D2 receptors in dorsomedial or dorsolateral striatal regions. However, a role for dorsal striatal regions has been indicated by selective DA depletion studies as well as a significant amount of human data. Moreover, in the primate dorsal striatum (caudate and putamen), availability of D2-receptors can be related to performance during reversal but not discrimination learning (Groman et al., 2011). This warrants further investigation of the effects of manipulating D1 or D2 signaling in striatal regions other than the nucleus accumbens.
In general, these conclusions are similar to those based on human data, as discussed in the previous section. However, unlike what was reported in humans, D2-based manipulations seem to affect lower order (cue reversal) and higher order (rule or task switch) processes in a similar way. It is unclear if D2-mediated effects in animals depend on DA synthesis capacity.
Contributions of DA Genotype to Cognitive Flexibility in Humans
Individual variability in executive functioning may be subserved by a strong genetic component (Friedman et al., 2008). The expression of complex traits such as cognitive flexibility is likely regulated by multiple genes that each contribute a small effect. Several polymorphisms in genes affecting DA functioning have been investigated to explain individual variability in cognitive flexibility.
DA Receptors and Intracellular Signaling
D1
DARPP-32 (DA and cAMP regulated phosphoprotein of 32kDA) is strongly expressed in medial spiny neurons in the striatum, where it is stimulated by D1 and inhibited by D2 receptor activation and mediates post-receptor effects of DA (Nishi et al., 1997; Svenningsson et al., 2004). Enhanced performance on several cognitive tasks, including the WCST, was observed for a frequent haplotype in the DARPP-32 gene that is associated with increased post-mortem DARPP-32 expression and affects structural and functional connectivity between PFC and striatum (Meyer-Lindenberg et al., 2007). The polymorphism was also associated with better learning from positive feedback (Frank et al., 2007). This suggests D1 receptors in the striatum could contribute to learning after positive feedback, supporting successful switching of behavior in cognitive flexibility tasks by maintaining responses to the newly rewarded site.
D2
The DRD2-TAQ1 polymorphism is located close to the exon coding for the D2 receptor. A1-allele carriers show a reduced number of available D2 receptors [(Thompson et al., 1997; Pohjalainen et al., 1998), but see Lucht and Rosskopf (2008)] and the A1-allele is associated with increased DA synthesis in the striatum (indicating reduced autoreceptor-mediated feedback regulation) (Laakso et al., 2005). In a probabilistic learning task, carriers of the A1-allele showed reduced ability to learn from errors accompanied by functional changes in the frontostriatal circuitry (Klein et al., 2007). A1-carriers showed blunted reward-related activity in the NAC, reduced activity in the posterior medial frontal cortex during negative feedback and reduced interactions between the medial frontal cortex and hippocampus (Klein et al., 2007). The use of feedback is required to adapt responding during reversal learning and, not surprisingly, A1-carriers perform worse (Jocham et al., 2009). Following presentation of a reversal, they were less likely to maintain the newly rewarded response, but kept alternating responses and showed diminished activation of orbitofrontal and ventral striatal regions during reversals (Jocham et al., 2009). Task-switching performance on the other hand is improved in A1-carriers, who show reduced switch costs associated with decreased activity in the lateral PFC and decreased connectivity between PFC and dorsal striatal regions (Stelzel et al., 2010). Switching tasks does not depend on the use of feedback and is supported by different circuits/areas than switching responses based on the use of feedback (Stelzel et al., 2010). This illustrates how impaired DA transmission could have different effects depending on the operationalization of the cognitive flexibility task that is used, i.e., whether on-line feedback-induced response adaptation (“learning”) is essential or not.
A second polymorphism affecting availability of striatal D2 receptors is the C957T polymorphism of the DRD2 gene (Hirvonen et al., 2004, 2005). CC-allele carriers show reduced binding potential to striatal D2 receptors (Hirvonen et al., 2004, 2005) and impaired responding in the WCST (Rodriguez-Jimenez et al., 2006). In addition, CC-allele carriers are reduced in their ability to use negative feedback in a probabilistic reinforcement learning task (Frank et al., 2007). These concurrent findings suggest that reduced availability of D2 receptors is associated with impaired cognitive flexibility, resulting from an inability to use negative feedback to adapt behavior.
DA Transporter and Metabolizing Enzymes
The DA transporter (DAT) regulates re-uptake of DA from the synaptic cleft in striatal regions, whereas its influence in the PFC is less pronounced (Sesack et al., 1998). Using a task-switching protocol based on the WCST, Garcia-Garcia et al. (2010) observed impaired performance and electrophysiological differences in 9-repeat allele carriers compared to 10-repeat allele carriers of the DAT gene. During task-switching, manipulation of reward anticipation affects performance and striatal activity depending on DAT genotype, suggesting striatal DA levels mediate the influence of motivational effects on cognitive flexibility (Aarts et al., 2010). However, considering that it is unclear how this polymorphism relates to DAT expression in vivo [Heinz et al., 2000; Martinez et al., 2001; van Dyck et al., 2005; van de Giessen et al., 2009; meta-analysis by Costa et al., 2011], these results should be interpreted with caution.
The polymorphism that has received most attention relating DAergic gene function to executive functioning is the Valine (Val)/Methione (Met) polymorphism at codon 158 of the Catechol-O-methyltranserase (COMT) gene (Lotta et al., 1995). Activity of COMT is thought to be lower in homozygote Met allele carriers compared to homozygote Val carriers, presumably resulting in higher prefrontal DA levels in Met homozygotes (Lotta et al., 1995; Chen et al., 2004; Meyer-Lindenberg et al., 2005), although striatal DA levels may also be altered (Akil et al., 2003). Most studies investigating the association between the COMT Val/Met polymorphism and cognitive flexibility used perseverative responding or perseverative errors in the WCST as a measure of flexible behavior. Results have not been consistent: although an initial meta-analysis (Barnett et al., 2007) reported a small effect of COMT genotype on performance in the WCST, with reduced perseverative errors for the Met homozygotes, a second meta-analysis could not confirm an association between COMT genotype and perseverative responding on the WCST and several other cognitive measures, suggesting that the COMT polymorphism does not consistently relate to cognitive functioning (Barnett et al., 2008). It has been suggested that the variety of cognitive functions contributing to WCST performance complicate attribution of impaired performance to deficits in cognitive flexibility or deficits in cognitive stability (Bilder et al., 2004). Other test measures of cognitive flexibility might be more sensitive and more selective indicators of alterations in this function.
Despite the inconsistent effects of COMT genotype on perseverative errors in the WCST, the COMT Val/Met genotype is associated with differential activation patterns in the PFC during other cognitive paradigms (Mier et al., 2010). Therefore, it is interesting to relate COMT genotype to neural activation during other tasks that measure separate aspects of cognitive flexibility more specifically, to see whether this genotype influences neural activation in these tasks. Indeed, when (Krugel et al., 2009) studied the influence of COMT gene polymorphisms on performance and neural activity during probabilistic reversal learning, Val homozygotes performed better than Met homozygotes and showed increased striatal BOLD responses during prediction errors. In addition, higher connectivity between frontal and ventral striatal regions could be related to learning rate in Val homozygotes (Krugel et al., 2009). Interestingly, these findings suggest that striatal activity reflecting prediction errors might be modulated by DA levels in the PFC. However, during acquisition of probabilistic reinforcement learning, Val homozygotes show reduced switching of responses following negative outcomes on a trial-by-trial basis (Frank et al., 2007). This suggests that striatal DA function may be differentially regulated by DA levels in the PFC during response acquisition or adaptation of an existing response. In addition to a behavioral advantage during reversal learning, Val homozygotes also have smaller switch costs on a task switching paradigm when trials have short intervals (Colzato et al., 2010). Together these findings indicate a behavioral advantage on both reversal learning and task switching paradigms for Val homozygotes, suggesting that lower baseline levels of prefrontal DA may benefit cognitive flexibility in humans.
Summary and Conclusion
A substantial amount of studies investigating the influence of genes mediating DA function on cognitive flexibility have limited analysis to a task that likely measures several complex cognitive functions, i.e., the WCST (Friedman et al., 2008). A more promising approach may be to study the effect of DA related genes on well-defined operationalizations of cognitive flexibility, such as initial discrimination learning, reversal learning, attentional set-shifting or task switching. A confound in the study of cognitive effects of genetic polymorphisms is that the effect of a polymorphism on DA transmission or even on gene expression is often not known. This hampers translational approaches, in which effects of increased or decreased expression and/or DA transmission might be studied in a controlled and reproducible manner.
To summarize, the studies reviewed above suggest an association between polymorphisms regulating DA function and cognitive flexibility. Reduced availability of D2 receptors, presumably affecting striatal DA activity, impairs the use of negative feedback and the maintenance of a new response during reversal learning and set-shifting (in the WCST), whereas increased availability of D2 receptors impairs task switching, suggesting different involvement of D2 receptors in these tasks. Striatal D1 signaling, mediated by DARPP-32 function, also contributes to cognitive functioning, although this has not yet been verified using specific measures of cognitive flexibility. Presumed lower levels of prefrontal DA, mediated by COMT-genotype appear to facilitate behavioral adaptation in both reversal learning and task-switching paradigms (see Table 3).
Table 3. Effects of polymorphisms in dopamine related genes on cognitive flexibility in human subjects.
To conclude, considering that the genetic underpinnings of complex cognitive functions are likely to be polygenic and not limited to DA, studying additive genetic effects of DA related genes on cognitive flexibility as well as the study of interactions between DA related genes and other genes regulating frontostriatal function could provide a better understanding of the genetic basis of cognitive flexibility (Frank and Fossella, 2011).
Effects of Genetic Manipulations in DA Related Genes on Cognitive Flexibility in Animals
The use of genetically modified animals provides an invaluable tool to study the role of DA related genes in cognitive flexibility. Selectively targeted mutations on a known genetic background can elucidate the genetic and neurobiological basis of complex behavior.
DA Deficiency
An example of an advanced genetic approach is selective reinstatement of DA signaling in ventral or dorsal striatum of DA-deficient mice (Darvas and Palmiter, 2011). Restoring DA signaling specifically to either dorsal or ventral striatum supports acquisition and reversal of a turn-based escape strategy in a water maze (Darvas and Palmiter, 2011). However, the ability to switch from one escape strategy to another (strategy set-shift) is impaired when DA signaling is limited to the ventral striatum, suggesting DA neurotransmission in the dorsal striatum is required for strategy set-shifting, whereas DA in either ventral or dorsal striatum is sufficient to support reversal learning (Darvas and Palmiter, 2011). It should be noted, however, that the translational value of the tasks used is not established.
DA Receptors and Intracellular Signaling
D1
Mice lacking functional D1 receptors show attenuated operant responding for reward (El-Ghundi et al., 2003). They show a general deficit in reinforcement learning, impaired motivation to work for a reward, are slow to discriminate between a reinforced and non-reinforced lever and are impaired in reversal learning, during which they maintain responding to both levers. Heterozygote mice are also impaired on reversals, although not as severely (El-Ghundi et al., 2003). The observed general deficits in motivation and reinforcement learning in D1-knockout mice, however, prevent the drawing of conclusions about the contribution of D1 receptors to cognitive flexibility.
Activation of D1 receptors modulates striatal function through phosphorylation of DARPP (Walaas and Greengard, 1984). Next to a minor reduction in performance during discrimination learning, DARPP-32 knockout mice show a pronounced deficit in reversal learning. Although knockout mice eventually were able to switch responding to the newly rewarded side, it took them significantly more sessions to do so (Heyser et al., 2000). This is indirect evidence that D1 receptor activation is needed for reversal learning.
D2
Genetic manipulations of D2 receptors also affect performance on cognitive flexibility tasks. Female mice with a complete knock-out of functional D2 receptors make more errors during odor discrimination and reversal learning whereas male D2-knockouts are impaired during reversal learning only; both sexes show perseveration to the previously rewarded side (Kruzich and Grandy, 2004; Kruzich et al., 2006). This was confirmed by De Steno and Schmauss (2009), who also showed a similar impairment with chronic treatment with the D2 antagonist haloperidol. Glickstein et al. (2005) observed a deficit of male D2-knockouts during compound discrimination, but not reversal, whereas D3 receptor knockouts showed increased performance during the reversal. The differences in behavioral performance were paralleled by opposite prefrontal activation patterns following the task sequence: activity dependent gene expression in the MPFC is increased for D3 mutants and decreased for D2 mutants (Glickstein et al., 2005; De Steno and Schmauss, 2009). Interestingly, knockout of neither D2 nor D3 receptors affects performance on intra- or extradimensional set-shifts (De Steno and Schmauss, 2009), suggesting differential contribution of D2/D3 receptors to the regulation of reversal learning or set-shifting.
Selective overexpression of D2 receptors in the striatum does not affect learning of a discrimination, a reversal or an intra- or extradimensional set-shift. Response latencies were longer during reversal trials only, suggesting the animals had some difficulties adapting established responses (Kellendonk et al., 2006). Interestingly, these mice also show physiological changes in the medial PFC where DA turnover was decreased and activation of D1 receptors increased (Kellendonk et al., 2006).
Metabolizing Enzymes
Overexpression of the human COMT-Val polymorphism in mice increases COMT enzyme activity (suggesting lower prefrontal extracellular DA) and induces specific deficits in cognitive flexibility. Although discrimination and reversal learning are not affected, these mice make more errors and need more time to complete an extra-dimensional set-shift (Papaleo et al., 2008). In contrast to behavioral impairments observed after increased COMT enzyme activity, pharmacological inhibition of COMT can improve performance (Tunbridge et al., 2004).
Summary and Conclusion
The studies using selective DA-reinstatement in DA-deficient mice show that higher order flexibility [strategy shifting (Wise et al., 1996)] is associated with dorsal striatal DA, whereas lower order flexibility (reversal learning) may be supported by DA in all striatal areas. Similarly, human studies suggest influence of DA genotype on activity in ventral striatal regions or increased connectivity between PFC and ventral striatum during reversal learning and in dorsal striatal regions during task switching.
The D1 receptor is involved in cognitive flexibility, although this is overshadowed by a general impairment in goal-directed behavior in full knock-outs. DARPP-32 expression (reflecting D1 activity) is associated with cognitive performance in both humans and animals.
The findings described above, and the observation that performance of reversal learning in mice covaries with D2 receptor levels in the ventral midbrain (Laughlin et al., 2011), indicate the importance of D2 receptors for flexible behavior, specifically in a situation where response-reward contingencies are reversed (see Table 4). This compares to the influence of polymorphisms in the D2 receptor gene on the ability to learn from negative feedback in human subjects.
Table 4. Effects of genetic manipulations to dopamine related genes on cognitive flexibility in animals.
Expressing the human COMT-Val polymorphism (increasing COMT-activity and presumably decreasing extracellular prefrontal DA) in mice impairs extra dimensional set-shift. This concurs with the improved set-shifting performance after COMT-inhibition in rats. However, presence of the Val-polymorphism in humans has been associated with a behavioral advantage during reversal learning and task-switching suggesting that confirmation of these studies is needed before we can draw conclusions.
Caution should be exerted when interpreting results from animals in which a receptor is completely knocked out as compensatory mechanisms (such as increased neurotransmitter levels) during development may contribute to the observed deficits. Also, in the case of complete knock-outs it is not possible to locate the neurobiological substrate of the impairment as the knock-out is present throughout the brain. Finally, mice with intermediate expression of specific receptors (heterozygotes) are useful for studying gene-dosage effects on behavior, which could be particularly relevant when compared to differences in receptor expression levels observed in humans.
OCD
OCD is a psychiatric disorder that is characterized by recurrent intrusive, unwanted thoughts (obsessions) that are often accompanied by repetitive ritualistic behaviors (compulsions). Although the precise neurobiological substrates underlying OCD symptoms are not known, structural and functional imaging studies show alterations in frontal and orbitofrontal cortices and basal ganglia in OCD patients (Pujol et al., 2004; Menzies et al., 2008a,b; van den Heuvel et al., 2009; Rotge et al., 2010). Symptom severity correlates with increased functional connectivity between OFC and striatal regions (Harrison et al., 2009), which normalizes after treatment (Figee et al., 2013).
The repeated performance of ritual-like action sequences has led to the hypothesis that decreased cognitive flexibility or increased habitual behavior (Gillan et al., 2011) is a major underlying factor of OCD and could be a potential endophenotype for the disorder (Robbins et al., 2012). This might be an attractive suggestion considering that associated circuits and neurotransmitters related to these processes are (partly) known. Indications for abnormal flexibility have been described in OCD patients (Chamberlain et al., 2006; Gu et al., 2008) and there is evidence for altered DA signaling (Denys et al., 2004a,b; Moresco et al., 2007; Perani et al., 2008). Therefore, an important question is how DA contributes to this disorder. In the next sections, we will describe studies reporting alterations in the DA system in OCD patients as well as studies investigating cognitive flexibility in OCD.
DA Alterations in OCD
Although there is strong evidence that serotonin plays a role in the treatment of OCD (van Dijk et al., 2010), it is clear that OCD pathophysiology also involves alterations in fronto-striatal circuitry and its neuromodulation by DA. Indirect evidence comes from clinical observations that administration of DA antagonists can improve symptoms in OCD-patients that do not respond to SSRI's alone [(McDougle et al., 2000; Dougherty et al., 2004); see Denys et al. (2004b) for review]. In animals, administration of drugs acting on DAergic receptors and genetic manipulations of DA receptors induces compulsive, stereotypic behaviors similar to the repetitive behaviors of OCD patients (Szechtman et al., 1998; Campbell et al., 1999; Joel and Doljansky, 2003; Denys et al., 2004b; Sesia et al., 2013).
Importantly, direct evidence indicating altered DA signaling in OCD patients is also available. Kim et al. (2003) observed a higher density of the DA transporter (DAT) in the right basal ganglia that normalized after SSRI treatment (Kim et al., 2007). However, these findings were not consistently replicated (Nikolaus et al., 2010): van der Wee et al. (2004) also showed higher binding ratios using OCD patients without co-morbid disorders, but Hesse et al. (2005) observed reduced striatal DAT binding and Pogarell et al. (2003) did not observe differences in DAT availability between OCD patients and healthy controls. The latter authors also reported increased instead of decreased DAT binding after SSRI's.
OCD-patients show reduced binding to D1 receptors in caudate nucleus and putamen (Olver et al., 2009) and in anterior cingulate cortex (Olver et al., 2010), although reduced binding does not correlate with symptom severity.
Studies investigating binding to striatal D2 receptors in OCD patients present a more consistent picture. The original finding by Denys et al. (2004a) of reduced binding to D2 receptors in the caudate nucleus of OCD patients was replicated by others (Perani et al., 2008; Schneier et al., 2008; Denys et al., 2013). In medication-naïve OCD patients, repeated administration of an SSRI increased binding to striatal D2 receptors, illustrating that regulation of DA release can be modulated by 5-HT (Moresco et al., 2007).
Taken together, the studies mentioned here described reduced binding to DA receptors in OCD patients, mainly in, but not limited to striatal regions. The most replicated finding is reduced availability of D2 receptors in striatal regions. It has been hypothesized that reduced availability of DA receptors in OCD patients could be the result of increased DA release in the striatum (Denys et al., 2004a). However, the observed changes in the DA system do not correlate with symptom severity or duration of illness and it is possible that the DAergic alterations are secondary to diminished serotonergic tone.
Cognitive Flexibility in OCD
Although the repetitive execution of behavioral patterns that is often observed in OCD patients could be defined as inflexible or perseverative behavior, the question is whether this translates to impaired performance on measurements of cognitive flexibility that are currently used in tests of executive functioning.
Findings using the WCST have been contradictory, with some studies observing impaired performance in OCD patients (Lucey et al., 1997; Lacerda et al., 2003; Bohne et al., 2005; Lawrence et al., 2006; Bucci et al., 2007; de Geus et al., 2007; Cavedini et al., 2010), whilst others do not (Gambini et al., 1993; Abbruzzese et al., 1995, 1997; Cavedini et al., 1998; Moritz et al., 2002; Fenger et al., 2005; Henry, 2006). The former studies often describe an increase in the number of perseverative errors. The observation that deficits in flexibility may persist after remission or use of medication and that unaffected family members also show reduced flexibility, suggests that these deficits are trait-like and independent of OCD-symptomatology (Bannon et al., 2006; Cavedini et al., 2010), supporting the hypothesis that inflexible, rigid and habit-like behavior is an endophenotype in OCD.
Reversal learning
Alterations in recruitment of fronto-striatal circuitry in the absence of behavioral impairments have been observed in both OCD patients and their unaffected first-degree relatives during reversal learning (Chamberlain et al., 2008). Remijnse et al. (2006) observed attenuated responsiveness of OFC and striatal regions during reward and affective switching in OCD patients with and without comorbidities. In these studies, as well as in others (Valerius et al., 2008; Ersche et al., 2011) no clear evidence for behavioral impairments during task performance was obtained, although OCD patients do show a somewhat slowed response pattern, suggesting they may require more processing time when faced with altered response-reward contingencies. Altered recruitment of fronto-striatal circuitry during these tests suggests that even though overt behavioral performance (i.e., reaction times, number of errors, number of trials required to reach criterion) may not be impaired, the processing of cognitive information is altered in OCD patients during reversal learning.
Attentional set-shifting
Performance on tasks that require shifting between different stimulus dimensions does appear to be affected in OCD patients. Behavioral impairments have been observed in OCD patients and unaffected first-degree relatives in an attentional set-shifting task (Veale et al., 1996; Fenger et al., 2005; Watkins et al., 2005; Chamberlain et al., 2006, 2007) but see (Purcell et al., 1998a,b), with some reporting reduced performance on extra-dimensional set-shifts (Veale et al., 1996; Watkins et al., 2005; Chamberlain et al., 2006, 2007) and others on intra-dimensional set-shifts (Veale et al., 1996; Fenger et al., 2005). Response to SSRI-treatment was found to be related to set-shifting ability (Fontenelle et al., 2001).
Task switching
Increased switch costs (decreased accuracy or increased response times) have been observed in OCD patients during performance of task switching paradigms (Moritz et al., 2004; Gu et al., 2008; Page et al., 2009). Gu et al. (2008) found an increase in the number of errors made during task-switching trials in OCD patients, but others report slowed responding (Moritz et al., 2004; Remijnse et al., 2013) or no effect (Page et al., 2009). However, when task switching is combined with functional imaging, activity in the dorsal fronto-striatal circuit is consistently found to differ between OCD patients and healthy controls. Whereas activation of the dorsal fronto-striatal circuit is observed in healthy controls during task-switching trials, this is not the case in OCD patients (Gu et al., 2008; Page et al., 2009; Remijnse et al., 2013).
Summary and Conclusion
Several problems arise when interpreting the deficits of OCD patients on cognitive flexibility and the mixed outcomes of the studies investigating these deficits. Next to the influence of medication and the need for careful matching of patient and control groups, the high comorbidity with other psychiatric disorders, in particular depression is an important confounding factor. Although the use of subject groups with OCD as the only clinical diagnosis could be thought of as misrepresentative for the population of OCD patients because comorbidity is so common (Olley et al., 2007), the use of well-defined clinical populations in studies combining neuropsychological testing with measurements of brain activity in particular, could contribute to the knowledge about distorted recruitment of frontostriatal circuitry in cognitive flexibility.
As far as we know, studies directly linking measurements of cognitive flexibility to alterations in DA signaling have not been performed in OCD patients. The most consistent alteration in the DA system is changed DA receptor binding, mostly in striatal regions. Replication of these findings, especially of both D1 and D2 receptor binding, in different OCD samples would enhance our understanding of the contribution of DA to OCD. For performance on cognitive flexibility tasks, behavioral performance on lower order cognitive flexibility (reversal learning) is not altered, whilst OCD patients may be impaired on higher order flexibility tasks (attentional set-shift and task switching). Irrespective of the presence of behavioral impairments, activity and connectivity in neural circuits regulating flexible behavior (OFC-ventral striatum for reversal learning, PFC-dorsal striatum for task-switching) are altered in OCD patients during task execution. Considering the modulatory effect of DA in these neural circuits, it is possible that altered striatal DA contributes to different activity in these circuits during task performance.
OCD Animal Models: Dopamine and Cognitive Flexibility
Animal models of psychiatric disorders cannot reflect all aspects of the disease (Nestler and Hyman, 2010). In line with this, OCD models that show a combination of the critical face, predictive and construct validities (Korff and Harvey, 2006; Wang et al., 2009; Fineberg et al., 2011; Albelda and Joel, 2012b) predominantly mirror the compulsive acts of OCD patients. This applies for models based on spontaneous behavior [ethological models, e.g., compulsive dogs, (Vermeire et al., 2012)], behavioral models [e.g., compulsive lever-pressing during signal attenuation in rats (Joel, 2006)], pharmacological models [e.g., quinpirole-induced checking in rats (Szechtman et al., 1998)], and transgenic models [e.g., compulsive grooming in Sapap3-mutant mice, (Welch et al., 2007)]. Compulsive acts are behaviorally and conceptually not always clearly differentiated from simple repetitive behaviors. Repetitive, stereotyped, perseverative, rigid and habitual behavior have been grouped together into (overlapping) clusters of compulsive-like behavior [(Langen et al., 2011; Ting and Feng, 2011; Robbins et al., 2012); for a critical discussion of the distinction between stereotypies and compulsions, see (Lewis et al., 2007)]. These clusters are relevant not only for OCD, but also for other psychiatric disorders and may share a relative DAergic hyperactivity in the basal ganglia (Pitman, 1989). Two recent studies highlight the direct involvement of specific projections from OFC to ventromedial striatum in the regulation of compulsive-like, repetitive behavior in normal mice (Ahmari et al., 2013) and compulsively grooming Sapap-3 mice (Burguiere et al., 2013).
Stereotyped repetitive behavior, in particular, is strongly linked to DA mechanisms (Randrup and Munkvad, 1975; Ridley, 1994). Next to the quinpirole-model (repeated administration of a D2/3-selective agonist), the DAT-knockdown mouse that shows stronger and more rigid grooming behavior, has been proposed as an OCD-model based on DA hyperactivation (Berridge et al., 2005). Another model of increased DA-related neuronal activity is the D1CT transgenic mouse, showing repetition of all normal behaviors (Campbell et al., 1999). Most other validated OCD-models also show involvement of DA mechanisms in their compulsive behavior (Joel and Doljansky, 2003; Presti et al., 2003; Albelda and Joel, 2012a; Moreno and Flores, 2012; Vermeire et al., 2012; Sesia et al., 2013), although DA mechanisms were not tested in compulsively grooming transgenic mouse models (Welch et al., 2007; Shmelkov et al., 2010).
The relationship between repetitive behavior and cognitive flexibility as probed in tasks using translationally valid constructs of reversal learning, attentional set-shifting or task switching has received only limited attention. In deer mice, stereotyped jumping was correlated with the number of incorrect responses in a reversal of escape-learning in a water-filled T-maze (Tanimura et al., 2008). BTBR T+ tf.J mice, showing compulsive grooming and increased marble burying, show impaired probabilistic reversal learning (Amodeo et al., 2012). A task probing recurrent perseveration (two-choice task where continuous switching provides the optimal strategy) showed a correlation between stereotyped behavior and recurrent perseveration in farmed minks, but not in ICR CD-1 mice (Gross et al., 2011). Finally, rats compulsively drinking in the schedule-induced polydipsia model displayed increased perseveration during extinction of the 5-choice serial reaction time task and perseveration during extinction of other operant procedures was reported in bank voles (Garner and Mason, 2002) and caged bears (Vickery and Mason, 2005).
However, if we focus on reversal learning, attentional set-shifting or task switching there are no studies available that show task impairments in OCD animal models, let alone impairments related to DA mechanisms. The only possible exception is stereotyped behavior in deer mice, which correlated to the number of incorrect responses during reversal learning and decreased after striatal administration of a D1-selective antagonist (Presti et al., 2003; Tanimura et al., 2008), though the relation between reversal learning and DA was not directly investigated.
In conclusion, a possible relation between compulsive behavior and cognitive flexibility, including the possibility that DA mechanisms might play a role in this, did not receive much attention up to now. One can understand that the introduction of translational valid paradigms for cognitive flexibility in exotic species such as bank voles, mink or bears is not an easy task. But using behavioral testing in reversal learning, attentional set-shifting or task switching in rodent OCD-models should be a priority for researchers who want to study the neurobiological underpinnings of OCD.
Conclusion
Evidence for a role of DA in the control of cognitive flexibility comes from a range of human and animal studies that have been reviewed above. This overview indicates that DA is involved in different facets of cognitive flexibility, including reversal learning, set-shifting and task-switching. Moreover, DA in both cortical and subcortical parts of the corticostriatal circuits seem to be involved in the regulation of these different aspects of cognitive flexibility. The idea that DA facilitates flexibility or switching behavior can be traced back to older studies that used different behavioral paradigms than the studies reviewed here. For example, a role for DA in switching strategies in a swim test was suggested by Cools (1980) and van den Bos and Cools (1989), while the importance of DA in switching (increasing the probability that another behavioral output is chosen) was advocated by Oades (1985).
However, the general picture arises that although DA may facilitate cognitive flexibility, it is not required. Following a variety of manipulations to the DA system the ability to successfully shift behavior following changes in reinforcer contingencies is impaired but not completely absent (in rodents, non-human primates and humans). How does the supportive role of DA in cognitive flexibility (i.e., behavioral adaptation to a change in conditions) compare to its role in initial learning about rewards? The question whether DA is necessary for learning has been addressed by studying acquisition of learning in DA deficient mice—the conclusion was that loss of DA may impair, but does not inhibit reward learning (Berridge, 2005; Robinson et al., 2005; Palmiter, 2008; Darvas and Palmiter, 2010). Animals may become less motivated, but were still able to learn cue-reward associations. Disruption of phasic DA activity by deletion of NMDA-receptors from DA neurons again showed that learning may be retarded, but not inhibited (Zweifel et al., 2009). A recent study using an optogenetics approach showed that phasic DA stimulation may drive associative learning or impair extinction learning, suggesting a causal role for DA (Steinberg et al., 2013). However, DA stimulation could not maintain the original behavior, so that other processes are probably involved as well. During performance of cognitive flexibility tasks, a number of cognitive processes act simultaneously and DA may be especially important to switch behavior rapidly. The contribution of DA to new learning therefore appears to be facilitatory rather than a prerequisite and the supportive role of DA appears to be present both in initial learning and adaptation of learning.
Both pharmacological and genetic studies in human subjects and animals point to a role for D2 receptors in the regulation of cognitive flexibility. However, the regulation is not limited to D2 receptor activity: D1 and D2 receptors both contribute and appear to be cooperatively involved in discrimination learning and the flexible adaptation of behavior. One could argue that successful behavioral switching requires three processes that may partly occur in parallel: extinction of the response that is no longer rewarded, behavioral switch to the newly rewarded side and response maintenance. A complication in delineating the contribution of DA to either process is that these processes occur simultaneously during behavioral adaptation. DA signaling through D1 receptors may not be essential for switching behavior per se, but animal studies suggest that activation of D1 receptors contributes to the acquisition and maintenance of a new response, also when acquisition follows a reversal. In contrast, inactivation of D2 receptors may allow switching of behavior patterns. The contributions of D1 versus D2 receptors in the regulation of reward learning and behavior switching has been related to involvement of the direct and indirect pathway of the basal ganglia in these processes, and several models have been put forward to describe the possible components involved in regulating this behavior (Frank and Claus, 2006; Hong and Hikosaka, 2011). In general these models assume the presence of D1 receptors in the direct pathway (direct projections from striatal medium spiny neurons (MSN) to the substantia nigra) and expression of D2 receptors on MSN's of the indirect pathway (projections from MSN to substantia nigra via the globus pallidus) (Deng et al., 2006). Because binding affinity differs for D1 and D2 receptors (Richfield et al., 1989), fluctuations in DA levels during different stages of discrimination and reversal learning may result in different activation of D1 (direct pathway) or D2 (indirect pathway) expressing neurons. When a reward is presented unexpectedly, or when a stimulus that predicts reward is presented, a transient increase in DA release occupies low affinity D1 receptors and activates the direct pathway, allowing facilitation of response execution and prompting reward-related learning. Switching of behavioral patterns on the other hand might require reduced occupancy of high affinity D2 receptors. Omission of an expected reward following altered reinforcer contingencies results in transient reductions in striatal DA levels and diminished inhibition of the indirect pathway by D2 receptors, resulting in inhibition of the previously successful response. Both facilitation of behavioral adaptation by deactivation of striatal D2 receptors and facilitation of the acquisition of the “new” behavioral response by striatal D1 activation suggests the importance of phasic fluctuations in striatal DA levels during execution of cognitive flexibility. This may be illustrated for the D2-mediated response: both continuously higher and lower tonic D2 activation could impair detection of the transient reduction of DA. As tonic DA may be related to general synaptic factors such as synthesis capacity, uptake activity and metabolic efficiency, all these factors may influence flexible responding through D2 receptor dependent transmission. However, it is difficult to separate tonic from phasic DA signaling with most manipulations used. Tonic prefrontal DA (Seamans and Yang, 2004) probably contributes as well. In addition, activation of D1/D2 receptors in prefrontal regions may differ from the activation in striatal regions. It has been suggested, for example, that D2 stimulation in prefrontal regions may facilitate flexible behavior (Durstewitz and Seamans, 2008) whereas in striatal regions, deactivation of D2 receptors is suggested to facilitate cognitive flexibility (Yawata et al., 2012). The combined study of genetic effects on behavioral performance and patterns of neural activation also suggests that although DA genotype may primarily affect expression of DA related genes in either striatal or prefrontal areas, functional effects of DA genotype are not limited to either region but are observed throughout the frontostriatal circuit. Genetic and imaging studies suggest that DA in ventral regions of the striatum (or connections between PFC and ventral striatum) contributes to reversal learning (lower order complexity), whereas DA in dorsal regions may be more important for attentional set-shifting and task switching (higher order complexity). However, animal studies have also described effects of DA in the NAC on attentional set-shifts and animals that only have DA signaling in dorsal striatal regions are able to learn a reversal. In addition, in human imaging studies it is not always clear if activation is limited to either ventral or dorsal striatum because analysis was limited to that particular striatal region or because the other striatal region was not activated. Therefore, it appears to be more likely that the relative activation of D1/D2 in prefrontal and striatal regions as well as the interaction with other neuromodulators (5-HT, NA) determines the control of cognitive flexibility. Considering the complexity of DA modulation in frontostriatal circuitry (Seamans and Yang, 2004), it may not be surprising DA modulation in neither frontal nor striatal regions that exclusively determines behavioral performance on tasks of cognitive flexibility.
So how do these findings relate to altered cognitive flexibility in OCD patients? If cognitive flexibility can indeed be used as an endophenotype for OCD, do the alterations in DA signaling that have been observed in OCD patients comply with the proposed role for DA in cognitive flexibility? The most replicated alteration in the DA system of OCD patients is reduced binding to D2 receptors in the striatum. A questions remains, how reduced D2 receptor binding relates to DAergic activity in vivo. A reduction in binding potential to D2 receptors may result from increased striatal DA levels or altered availability of D2 receptors. In both cases, reduced flexibility could be expected. However, behavioral performance (i.e., accuracy) on reversal learning tasks is not impaired in OCD patients. On reversal learning tasks, if any behavioral effect is found, it is a slowing of response times rather than an effect on the amount of errors that are made. Differences in accuracy have been observed in attentional set-shifting and task switching paradigms. It is possible that reversal learning may be a paradigm that is too simple for gross behavioral abnormalities to be observed in OCD patients. Increased reactions times on flexibility tasks, however, do suggest altered cognitive processing in OCD patients during cognitive flexibility and the measurement of reaction times should therefore be included in studies investigating differences in cognitive flexibility between healthy controls and OCD patients. The altered recruitment of frontostriatal circuitry during the execution of reversal learning as well as task switching is another indication for altered cognitive processing in OCD patients. Altered DA signaling is a potential contributor to changes in frontostriatal activity when performing cognitive tasks. Altered activity in the frontostriatal circuit (OFC-ventral striatum) during reversal learning, as observed in OCD patients is also found in subjects with polymorphisms in the D2 gene that result in reduced binding to D2 receptors. Most likely, however, abnormalities in prefrontal regions and 5-HT modulation in OCD patients also contribute.
An important step in investigating the possibility of altered cognitive processing in cognitive flexibility tasks as an endophenotype for OCD would be the replication of studies using cognitive flexibility tasks in OCD patients with the use of strictly defined patient and control groups. Considering that altered neural correlates of OCD could be symptom dimension-specific (van den Heuvel et al., 2009), separate study of the different symptom dimensions contributes to the identification of possible endophenotypes. Preferably, these studies combine behavioral testing with measurements of brain activity and/or DA activity to further investigate the neurobiological basis of altered cognitive processing during cognitive flexibility tests in OCD patients.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Aarts, E., Roelofs, A., Franke, B., Rijpkema, M., Fernandez, G., Helmich, R. C., et al. (2010). Striatal dopamine mediates the interface between motivational and cognitive control in humans: evidence from genetic imaging. Neuropsychopharmacology 35, 1943–1951. doi: 10.1038/npp.2010.68
Abbruzzese, M., Ferri, S., and Scarone, S. (1995). Wisconsin Card Sorting Test performance in obsessive-compulsive disorder: no evidence for involvement of dorsolateral prefrontal cortex. Psychiatry Res. 58, 37–43. doi: 10.1016/0165-1781(95)02670-R
Abbruzzese, M., Ferri, S., and Scarone, S. (1997). The selective breakdown of frontal functions in patients with obsessive-compulsive disorder and in patients with schizophrenia: a double dissociation experimental finding. Neuropsychologia 35, 907–912. doi: 10.1016/S0028-3932(96)00095-4
Ahmari, S. E., Spellman, T., Douglass, N. L., Kheirbek, M. A., Simpson, H. B., Deisseroth, K., et al. (2013). Repeated cortico-striatal stimulation generates persistent OCD-like behavior. Science 340, 1234–1239. doi: 10.1126/science.1234733
Akil, M., Kolachana, B. S., Rothmond, D. A., Hyde, T. M., Weinberger, D. R., and Kleinman, J. E. (2003). Catechol-O-methyltransferase genotype and dopamine regulation in the human brain. J. Neurosci. 23, 2008–2013.
Albelda, N., and Joel, D. (2012a). Animal models of obsessive-compulsive disorder: exploring pharmacology and neural substrates. Neurosci. Biobehav. Rev. 36, 47–63. doi: 10.1016/j.neubiorev.2011.04.006
Albelda, N., and Joel, D. (2012b). Current animal models of obsessive compulsive disorder: an update. Neuroscience 211, 83–106. doi: 10.1016/j.neuroscience.2011.08.070
Amodeo, D. A., Jones, J. H., Sweeney, J. A., and Ragozzino, M. E. (2012). Differences in BTBR T+ tf/J and C57BL/6J mice on probabilistic reversal learning and stereotyped behaviors. Behav. Brain Res. 227, 64–72. doi: 10.1016/j.bbr.2011.10.032
Arnsten, A. F., Wang, M. J., and Paspalas, C. D. (2012). Neuromodulation of thought: flexibilities and vulnerabilities in prefrontal cortical network synapses. Neuron 76, 223–239. doi: 10.1016/j.neuron.2012.08.038
Arnt, J. (1985). Antistereotypic effects of dopamine D-1 and D-2 antagonists after intrastriatal injection in rats. Pharmacological and regional specificity. Naunyn. Schmiedebergs. Arch. Pharmacol. 330, 97–104. doi: 10.1007/BF00499901
Arushanian, E. B., and Baturin, V. A. (1982). Effect of haloperidol and chlorpromazine on reversal learning of normal and striatectomized rats in a Y-maze. Pharmacol. Biochem. Behav. 16, 541–545. doi: 10.1016/0091-3057(82)90411-7
Bannon, S., Gonsalvez, C. J., Croft, R. J., and Boyce, P. M. (2006). Executive functions in obsessive-compulsive disorder: state or trait deficits? Aust. N. Z. J. Psychiatry 40, 1031–1038.
Barch, D. M., Carter, C. S., Arnsten, A., Buchanan, R. W., Cohen, J. D., Geyer, M., et al. (2009). Selecting paradigms from cognitive neuroscience for translation into use in clinical trials: proceedings of the third CNTRICS meeting. Schizophr. Bull. 35, 109–114. doi: 10.1093/schbul/sbn163
Barnes, J. J., Dean, A. J., Nandam, L. S., O'Connell, R. G., and Bellgrove, M. A. (2011). The molecular genetics of executive function: role of monoamine system genes. Biol. Psychiatry 69, e127–e143. doi: 10.1016/j.biopsych.2010.12.040
Barnett, J. H., Jones, P. B., Robbins, T. W., and Muller, U. (2007). Effects of the catechol-O-methyltransferase Val158Met polymorphism on executive function: a meta-analysis of the Wisconsin Card Sort Test in schizophrenia and healthy controls. Mol. Psychiatry 12, 502–509.
Barnett, J. H., Scoriels, L., and Munafo, M. R. (2008). Meta-analysis of the cognitive effects of the catechol-O-methyltransferase gene Val158/108Met polymorphism. Biol. Psychiatry 64, 137–144. doi: 10.1016/j.biopsych.2008.01.005
Bellebaum, C., Koch, B., Schwarz, M., and Daum, I. (2008). Focal basal ganglia lesions are associated with impairments in reward-based reversal learning. Brain 131, 829–841. doi: 10.1093/brain/awn011
Berridge, K. C. (2005). Espresso reward learning, hold the dopamine: theoretical comment on Robinson et al. (2005). Behav. Neurosci. 119, 336–341. doi: 10.1037/0735-7044.119.1.336
Berridge, K. C., Aldridge, J. W., Houchard, K. R., and Zhuang, X. (2005). Sequential super-stereotypy of an instinctive fixed action pattern in hyper-dopaminergic mutant mice: a model of obsessive compulsive disorder and Tourette's. BMC Biol. 3:4. doi: 10.1186/1741-7007-3-4
Bilder, R. M., Volavka, J., Lachman, H. M., and Grace, A. A. (2004). The catechol-O-methyltransferase polymorphism: relations to the tonic-phasic dopamine hypothesis and neuropsychiatric phenotypes. Neuropsychopharmacology 29, 1943–1961. doi: 10.1038/sj.npp.1300542
Birrell, J. M., and Brown, V. J. (2000). Medial frontal cortex mediates perceptual attentional set shifting in the rat. J. Neurosci. 20, 4320–4324.
Bissonette, G. B., Martins, G. J., Franz, T. M., Harper, E. S., Schoenbaum, G., and Powell, E. M. (2008). Double dissociation of the effects of medial and orbital prefrontal cortical lesions on attentional and affective shifts in mice. J. Neurosci. 28, 11124–11130. doi: 10.1523/JNEUROSCI.2820-08.2008
Bohne, A., Savage, C. R., Deckersbach, T., Keuthen, N. J., Jenike, M. A., Tuschen-Caffier, B., et al. (2005). Visuospatial abilities, memory, and executive functioning in trichotillomania and obsessive-compulsive disorder. J. Clin. Exp. Neuropsychol. 27, 385–399. doi: 10.1080/13803390490520418
Boulougouris, V., Castane, A., and Robbins, T. W. (2009). Dopamine D2/D3 receptor agonist quinpirole impairs spatial reversal learning in rats: investigation of D3 receptor involvement in persistent behavior. Psychopharmacology (Berl.) 202, 611–620. doi: 10.1007/s00213-008-1341-2
Boulougouris, V., Dalley, J. W., and Robbins, T. W. (2007). Effects of orbitofrontal, infralimbic and prelimbic cortical lesions on serial spatial reversal learning in the rat. Behav. Brain Res. 179, 219–228. doi: 10.1016/j.bbr.2007.02.005
Bouret, S., and Sara, S. J. (2004). Reward expectation, orientation of attention and locus coeruleus-medial frontal cortex interplay during learning. Eur. J. Neurosci. 20, 791–802. doi: 10.1111/j.1460-9568.2004.03526.x
Braver, T. S., Cole, M. W., and Yarkoni, T. (2010). Vive les differences! Individual variation in neural mechanisms of executive control. Curr. Opin. Neurobiol. 20, 242–250. doi: 10.1016/j.conb.2010.03.002
Bucci, P., Galderisi, S., Catapano, F., Di, B. R., Piegari, G., Mucci, A., et al. (2007). Neurocognitive indices of executive hypercontrol in obsessive-compulsive disorder. Acta Psychiatr. Scand 115, 380–387. doi: 10.1111/j.1600-0447.2006.00911.x
Burguiere, E., Monteiro, P., Feng, G., and Graybiel, A. M. (2013). Optogenetic stimulation of lateral orbitofronto-striatal pathway suppresses compulsive behaviors. Science 340, 1243–1246. doi: 10.1126/science.1232380
Calaminus, C., and Hauber, W. (2007). Intact discrimination reversal learning but slowed responding to reward-predictive cues after dopamine D1 and D2 receptor blockade in the nucleus accumbens of rats. Psychopharmacology (Berl.) 191, 551–566. doi: 10.1007/s00213-006-0532-y
Calaminus, C., and Hauber, W. (2008). Guidance of instrumental behavior under reversal conditions requires dopamine D1 and D2 receptor activation in the orbitofrontal cortex. Neuroscience 154, 1195–1204. doi: 10.1016/j.neuroscience.2008.04.046
Campbell, K. M., de Lecea, L., Severynse, D. M., Caron, M. G., McGrath, M. J., Sparber, S. B., et al. (1999). OCD-Like behaviors caused by a neuropotentiating transgene targeted to cortical and limbic D1+ neurons. J. Neurosci. 19, 5044–5053.
Castane, A., Theobald, D. E., and Robbins, T. W. (2010). Selective lesions of the dorsomedial striatum impair serial spatial reversal learning in rats. Behav. Brain Res. 210, 74–83. doi: 10.1016/j.bbr.2010.02.017
Cavedini, P., Ferri, S., Scarone, S., and Bellodi, L. (1998). Frontal lobe dysfunction in obsessive-compulsive disorder and major depression: a clinical-neuropsychological study. Psychiatry Res. 78, 21–28. doi: 10.1016/S0165-1781(97)00153-4
Cavedini, P., Zorzi, C., Piccinni, M., Cavallini, M. C., and Bellodi, L. (2010). Executive dysfunctions in obsessive-compulsive patients and unaffected relatives: searching for a new intermediate phenotype. Biol. Psychiatry 67, 1178–1184. doi: 10.1016/j.biopsych.2010.02.012
Ceaser, A. E., Goldberg, T. E., Egan, M. F., McMahon, R. P., Weinberger, D. R., and Gold, J. M. (2008). Set-shifting ability and schizophrenia: a marker of clinical illness or an intermediate phenotype? Biol. Psychiatry 64, 782–788. doi: 10.1016/j.biopsych.2008.05.009
Chamberlain, S. R., Fineberg, N. A., Blackwell, A. D., Robbins, T. W., and Sahakian, B. J. (2006). Motor inhibition and cognitive flexibility in obsessive-compulsive disorder and trichotillomania. Am. J. Psychiatry 163, 1282–1284. doi: 10.1176/appi.ajp.163.7.1282
Chamberlain, S. R., Fineberg, N. A., Menzies, L. A., Blackwell, A. D., Bullmore, E. T., Robbins, T. W., et al. (2007). Impaired cognitive flexibility and motor inhibition in unaffected first-degree relatives of patients with obsessive-compulsive disorder. Am. J. Psychiatry 164, 335–338. doi: 10.1176/appi.ajp.164.2.335
Chamberlain, S. R., Menzies, L., Hampshire, A., Suckling, J., Fineberg, N. A., Del, C. N., et al. (2008). Orbitofrontal dysfunction in patients with obsessive-compulsive disorder and their unaffected relatives. Science 321, 421–422. doi: 10.1126/science.1154433
Chen, R., Furman, C. A., and Gnegy, M. E. (2010). Dopamine transporter trafficking: rapid response on demand. Future Neurol. 5, 123–134. doi: 10.2217/fnl.09.76
Chen, J., Lipska, B. K., Halim, N., Ma, Q. D., Matsumoto, M., Melhem, S., et al. (2004). Functional analysis of genetic variation in catechol-O-methyltransferase (COMT): effects on mRNA. protein, and enzyme activity in postmortem human brain. Am. J. Hum. Genet. 75, 807–821. doi: 10.1086/425589
Cheng, J. T., and Li, J. S. (2013). Intra-orbitofrontal cortex injection of haloperidol removes the beneficial effect of methylphenidate on reversal learning of spontaneously hypertensive rats in an attentional set-shifting task. Behav. Brain Res. 239, 148–154. doi: 10.1016/j.bbr.2012.11.006
Cheng, R. K., Etchegaray, M., and Meck, W. H. (2007). Impairments in timing, temporal memory, and reversal learning linked to neurotoxic regimens of methamphetamine intoxication. Brain Res. 1186, 255–266. doi: 10.1016/j.brainres.2007.10.002
Clarke, H. F., Dalley, J. W., Crofts, H. S., Robbins, T. W., and Roberts, A. C. (2004). Cognitive inflexibility after prefrontal serotonin depletion. Science 304, 878–880. doi: 10.1126/science.1094987
Clarke, H. F., Hill, G. J., Robbins, T. W., and Roberts, A. C. (2011). Dopamine, but not serotonin, regulates reversal learning in the marmoset caudate nucleus. J. Neurosci. 31, 4290–4297. doi: 10.1523/JNEUROSCI.5066-10.2011
Clarke, H. F., Robbins, T. W., and Roberts, A. C. (2008). Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex. J. Neurosci. 28, 10972–10982. doi: 10.1523/JNEUROSCI.1521-08.2008
Clarke, H. F., Walker, S. C., Crofts, H. S., Dalley, J. W., Robbins, T. W., and Roberts, A. C. (2005). Prefrontal serotonin depletion affects reversal learning but not attentional set shifting. J. Neurosci. 25, 532–538. doi: 10.1523/JNEUROSCI.3690-04.2005
Clarke, H. F., Walker, S. C., Dalley, J. W., Robbins, T. W., and Roberts, A. C. (2007). Cognitive inflexibility after prefrontal serotonin depletion is behaviorally and neurochemically specific. Cereb. Cortex 17, 18–27. doi: 10.1093/cercor/bhj120
Clatworthy, P. L., Lewis, S. J., Brichard, L., Hong, Y. T., Izquierdo, D., Clark, L., et al. (2009). Dopamine release in dissociable striatal subregions predicts the different effects of oral methylphenidate on reversal learning and spatial working memory. J. Neurosci. 29, 4690–4696. doi: 10.1523/JNEUROSCI.3266-08.2009
Collins, P., Wilkinson, L. S., Everitt, B. J., Robbins, T. W., and Roberts, A. C. (2000). The effect of dopamine depletion from the caudate nucleus of the common marmoset (Callithrix jacchus) on tests of prefrontal cognitive function. Behav. Neurosci. 114, 3–17. doi: 10.1037/0735-7044.114.1.3
Colzato, L. S., Waszak, F., Nieuwenhuis, S., Posthuma, D., and Hommel, B. (2010). The flexible mind is associated with the catechol-O-methyltransferase (COMT) Val158Met polymorphism: evidence for a role of dopamine in the control of task-switching. Neuropsychologia 48, 2764–2768. doi: 10.1016/j.neuropsychologia.2010.04.023
Cools, A. R. (1980). Role of the neostriatal dopaminergic activity in sequencing and selecting behavioural strategies: facilitation of processes involved in selecting the best strategy in a stressful situation. Behav. Brain Res. 1, 361–378. doi: 10.1016/0166-4328(80)90035-2
Cools, R. (2006). Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease. Neurosci. Biobehav. Rev. 30, 1–23. doi: 10.1016/j.neubiorev.2005.03.024
Cools, R., Barker, R. A., Sahakian, B. J., and Robbins, T. W. (2001). Mechanisms of cognitive set flexibility in Parkinson's disease. Brain 124, 2503–2512. doi: 10.1093/brain/124.12.2503
Cools, R., and D'Esposito, M. (2011). Inverted-U-shaped dopamine actions on human working memory and cognitive control. Biol. Psychiatry 69, e113–e125. doi: 10.1016/j.biopsych.2011.03.028
Cools, R., Frank, M. J., Gibbs, S. E., Miyakawa, A., Jagust, W., and D'Esposito, M. (2009). Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J. Neurosci. 29, 1538–1543. doi: 10.1523/JNEUROSCI.4467-08.2009
Cools, R., Gibbs, S. E., Miyakawa, A., Jagust, W., and D'Esposito, M. (2008). Working memory capacity predicts dopamine synthesis capacity in the human striatum. J. Neurosci. 28, 1208–1212. doi: 10.1523/JNEUROSCI.4475-07.2008
Costa, A., Riedel, M., Muller, U., Moller, H. J., and Ettinger, U. (2011). Relationship between SLC6A3 genotype and striatal dopamine transporter availability: a meta-analysis of human single photon emission computed tomography studies. Synapse 65, 998–1005. doi: 10.1002/syn.20927
Crofts, H. S., Dalley, J. W., Collins, P., Van Denderen, J. C., Everitt, B. J., Robbins, T. W., et al. (2001). Differential effects of 6-OHDA lesions of the frontal cortex and caudate nucleus on the ability to acquire an attentional set. Cereb. Cortex 11, 1015–1026. doi: 10.1093/cercor/11.11.1015
Daberkow, D. P., Riedy, M. D., Kesner, R. P., and Keefe, K. A. (2008). Effect of methamphetamine neurotoxicity on learning-induced Arc mRNA expression in identified striatal efferent neurons. Neurotox Res. 14, 307–315. doi: 10.1007/BF03033855
Dang, L. C., Donde, A., Madison, C., O'Neil, J. P., and Jagust, W. J. (2012). Striatal dopamine influences the default mode network to affect shifting between object features. J. Cogn. Neurosci. 24, 1960–1970. doi: 10.1162/jocn_a_00252
Darvas, M., and Palmiter, R. D. (2010). Restricting dopaminergic signaling to either dorsolateral or medial striatum facilitates cognition. J. Neurosci. 30, 1158–1165. doi: 10.1523/JNEUROSCI.4576-09.2010
Darvas, M., and Palmiter, R. D. (2011). Contributions of striatal dopamine signaling to the modulation of cognitive flexibility. Biol. Psychiatry 69, 704–707. doi: 10.1016/j.biopsych.2010.09.033
de Geus, F., Denys, D. A., Sitskoorn, M. M., and Westenberg, H. G. (2007). Attention and cognition in patients with obsessive-compulsive disorder. Psychiatry Clin. Neurosci. 61, 45–53. doi: 10.1111/j.1440-1819.2007.01609.x
De Steno, D. A., and Schmauss, C. (2009). A role for dopamine D2 receptors in reversal learning. Neuroscience 162, 118–127. doi: 10.1016/j.neuroscience.2009.04.052
Deng, Y. P., Lei, W. L., and Reiner, A. (2006). Differential perikaryal localization in rats of D1 and D2 dopamine receptors on striatal projection neuron types identified by retrograde labeling. J. Chem. Neuroanat. 32, 101–116. doi: 10.1016/j.jchemneu.2006.07.001
Denys, D., de Vries, F., Cath, D., Figee, M., Vulink, N., Veltman, D. J., et al. (2013). Dopaminergic activity in Tourette syndrome and obsessive-compulsive disorder. Eur. Neuropsychopharmacol. doi: 10.1016/j.euroneuro.2013.05.012. [Epub ahead of print].
Denys, D., van der Wee, N., Janssen, J., de Geus, F., and Westenberg, H. G. (2004a). Low level of dopaminergic D2 receptor binding in obsessive-compulsive disorder. Biol. Psychiatry 55, 1041–1045. doi: 10.1016/j.biopsych.2004.01.023
Denys, D., Zohar, J., and Westenberg, H. G. (2004b). The role of dopamine in obsessive-compulsive disorder: preclinical and clinical evidence. J. Clin. Psychiatry 65(Suppl. 14), 11–17.
Dias, R., Robbins, T. W., and Roberts, A. C. (1996a). Dissociation in prefrontal cortex of affective and attentional shifts. Nature 380, 69–72. doi: 10.1038/380069a0
Dias, R., Robbins, T. W., and Roberts, A. C. (1996b). Primate analogue of the Wisconsin Card Sorting Test: effects of excitotoxic lesions of the prefrontal cortex in the marmoset. Behav. Neurosci. 110, 872–886. doi: 10.1037/0735-7044.110.5.872
Dias, R., Robbins, T. W., and Roberts, A. C. (1997). Dissociable forms of inhibitory control within prefrontal cortex with an analog of the Wisconsin Card Sort Test: restriction to novel situations and independence from “on-line” processing. J. Neurosci. 17, 9285–9297.
Divac, I. (1971). Frontal lobe system and spatial reversal in the rat. Neuropsychologia 9, 175–183. doi: 10.1016/0028-3932(71)90041-8
Dodds, C. M., Muller, U., Clark, L., van Loon, A., Cools, R., and Robbins, T. W. (2008). Methylphenidate has differential effects on blood oxygenation level-dependent signal related to cognitive subprocesses of reversal learning. J. Neurosci. 28, 5976–5982. doi: 10.1523/JNEUROSCI.1153-08.2008
Dougherty, D. D., Rauch, S. L., and Jenike, M. A. (2004). Pharmacotherapy for obsessive-compulsive disorder. J. Clin. Psychol. 60, 1195–1202. doi: 10.1002/jclp.20083
Durstewitz, D., and Seamans, J. K. (2008). The dual-state theory of prefrontal cortex dopamine function with relevance to catechol-o-methyltransferase genotypes and schizophrenia. Biol. Psychiatry 64, 739–749. doi: 10.1016/j.biopsych.2008.05.015
Eagle, D. M., Bari, A., and Robbins, T. W. (2008). The neuropsychopharmacology of action inhibition: cross-species translation of the stop-signal and go/no-go tasks. Psychopharmacology (Berl.) 199, 439–456. doi: 10.1007/s00213-008-1127-6
El-Ghundi, M., O'Dowd, B. F., Erclik, M., and George, S. R. (2003). Attenuation of sucrose reinforcement in dopamine D1 receptor deficient mice. Eur. J. Neurosci. 17, 851–862. doi: 10.1046/j.1460-9568.2003.02496.x
Elliott, R., Sahakian, B. J., Matthews, K., Bannerjea, A., Rimmer, J., and Robbins, T. W. (1997). Effects of methylphenidate on spatial working memory and planning in healthy young adults. Psychopharmacology (Berl.) 131, 196–206. doi: 10.1007/s002130050284
Ersche, K. D., Roiser, J. P., Abbott, S., Craig, K. J., Muller, U., Suckling, J., et al. (2011). Response perseveration in stimulant dependence is associated with striatal dysfunction and can be ameliorated by a D(2/3) receptor agonist. Biol. Psychiatry 70, 754–762. doi: 10.1016/j.biopsych.2011.06.033
Fenger, M. M., Gade, A., Adams, K. H., Hansen, E. S., Bolwig, T. G., and Knudsen, G. M. (2005). Cognitive deficits in obsessive-compulsive disorder on tests of frontal lobe functions. Nord. J. Psychiatry 59, 39–44. doi: 10.1080/08039480510018814
Figee, M., Luigjes, J., Smolders, R., Valencia-Alfonso, C. E., van Wingen, G., de Kwaasteniet, B., et al. (2013). Deep brain stimulation restores frontostriatal network activity in obsessive-compulsive disorder. Nat. Neurosci. 16, 386–387. doi: 10.1038/nn.3344
Fineberg, N. A., Chamberlain, S. R., Hollander, E., Boulougouris, V., and Robbins, T. W. (2011). Translational approaches to obsessive-compulsive disorder: from animal models to clinical treatment. Br. J. Pharmacol. 164, 1044–1061. doi: 10.1111/j.1476-5381.2011.01422.x
Floresco, S. B., Ghods-Sharifi, S., Vexelman, C., and Magyar, O. (2006a). Dissociable roles for the nucleus accumbens core and shell in regulating set shifting. J. Neurosci. 26, 2449–2457. doi: 10.1523/JNEUROSCI.4431-05.2006
Floresco, S. B., Magyar, O., Ghods-Sharifi, S., Vexelman, C., and Tse, M. T. (2006b). Multiple dopamine receptor subtypes in the medial prefrontal cortex of the rat regulate set-shifting. Neuropsychopharmacology 31, 297–309. doi: 10.1038/sj.npp.1300825
Fontenelle, L., Marques, C., Engelhardt, E., and Versiani, M. (2001). Impaired set-shifting ability and therapeutic response in obsessive-compulsive disorder. J. Neuropsychiatry Clin. Neurosci. 13, 508–510. doi: 10.1176/appi.neuropsych.13.4.508
Frank, M. J., and Claus, E. D. (2006). Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol. Rev. 113, 300–326. doi: 10.1037/0033-295X.113.2.300
Frank, M. J., and Fossella, J. A. (2011). Neurogenetics and pharmacology of learning, motivation, and cognition. Neuropsychopharmacology 36, 133–152. doi: 10.1038/npp.2010.96
Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T., and Hutchison, K. E. (2007). Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proc. Natl. Acad. Sci. U.S.A. 104, 16311–16316. doi: 10.1073/pnas.0706111104
Friedman, N. P., Miyake, A., Young, S. E., Defries, J. C., Corley, R. P., and Hewitt, J. K. (2008). Individual differences in executive functions are almost entirely genetic in origin. J. Exp. Psychol. Gen. 137, 201–225. doi: 10.1037/0096-3445.137.2.201
Gambini, O., Abbruzzese, M., and Scarone, S. (1993). Smooth pursuit and saccadic eye movements and Wisconsin Card Sorting Test performance in obsessive-compulsive disorder. Psychiatry Res. 48, 191–200. doi: 10.1016/0165-1781(93)90071-N
Garcia-Garcia, M., Barcelo, F., Clemente, I. C., and Escera, C. (2010). The role of the dopamine transporter DAT1 genotype on the neural correlates of cognitive flexibility. Eur. J. Neurosci. 31, 754–760. doi: 10.1111/j.1460-9568.2010.07102.x
Garner, J. P., and Mason, G. J. (2002). Evidence for a relationship between cage stereotypies and behavioural disinhibition in laboratory rodents. Behav. Brain Res. 136, 83–92. doi: 10.1016/S0166-4328(02)00111-0
Garner, J. P., Thogerson, C. M., Wurbel, H., Murray, J. D., and Mench, J. A. (2006). Animal neuropsychology: validation of the Intra-Dimensional Extra-Dimensional set shifting task for mice. Behav. Brain Res. 173, 53–61. doi: 10.1016/j.bbr.2006.06.002
Ghahremani, D. G., Monterosso, J., Jentsch, J. D., Bilder, R. M., and Poldrack, R. A. (2010). Neural components underlying behavioral flexibility in human reversal learning. Cereb. Cortex 20, 1843–1852. doi: 10.1093/cercor/bhp247
Gilbert, S. J., and Burgess, P. W. (2008). Executive function. Curr. Biol. 18, R110–R114. doi: 10.1016/j.cub.2007.12.014
Gillan, C. M., Papmeyer, M., Morein-Zamir, S., Sahakian, B. J., Fineberg, N. A., Robbins, T. W., et al. (2011). Disruption in the balance between goal-directed behavior and habit learning in obsessive-compulsive disorder. Am. J. Psychiatry 168, 718–726. doi: 10.1176/appi.ajp.2011.10071062
Glickstein, S. B., Desteno, D. A., Hof, P. R., and Schmauss, C. (2005). Mice lacking dopamine D2 and D3 receptors exhibit differential activation of prefrontal cortical neurons during tasks requiring attention. Cereb. Cortex 15, 1016–1024. doi: 10.1093/cercor/bhh202
Graham, S., Phua, E., Soon, C. S., Oh, T., Au, C., Shuter, B., et al. (2009). Role of medial cortical, hippocampal and striatal interactions during cognitive set-shifting. Neuroimage 45, 1359–1367. doi: 10.1016/j.neuroimage.2008.12.040
Groman, S. M., James, A. S., Seu, E., Crawford, M. A., Harpster, S. N., and Jentsch, J. D. (2013). Monoamine levels within the orbitofrontal cortex and putamen interact to predict reversal learning performance. Biol. Psychiatry 73, 756–762. doi: 10.1016/j.biopsych.2012.12.002
Groman, S. M., Lee, B., London, E. D., Mandelkern, M. A., James, A. S., Feiler, K., et al. (2011). Dorsal striatal D2-like receptor availability covaries with sensitivity to positive reinforcement during discrimination learning. J. Neurosci. 31, 7291–7299. doi: 10.1523/JNEUROSCI.0363-11.2011
Gross, A. N., Engel, A. K., Richter, S. H., Garner, J. P., and Wurbel, H. (2011). Cage-induced stereotypies in female ICR CD-1 mice do not correlate with recurrent perseveration. Behav. Brain Res. 216, 613–620. doi: 10.1016/j.bbr.2010.09.003
Gu, B. M., Park, J. Y., Kang, D. H., Lee, S. J., Yoo, S. Y., Jo, H. J., et al. (2008). Neural correlates of cognitive inflexibility during task-switching in obsessive-compulsive disorder. Brain 131, 155–164. doi: 10.1093/brain/awm277
Haluk, D. M., and Floresco, S. B. (2009). Ventral striatal dopamine modulation of different forms of behavioral flexibility. Neuropsychopharmacology 34, 2041–2052. doi: 10.1038/npp.2009.21
Harrison, B. J., Soriano-Mas, C., Pujol, J., Ortiz, H., Lopez-Sola, M., Hernandez-Ribas, R., et al. (2009). Altered corticostriatal functional connectivity in obsessive-compulsive disorder. Arch. Gen. Psychiatry 66, 1189–1200. doi: 10.1001/archgenpsychiatry.2009.152
Hasler, G., Mondillo, K., Drevets, W. C., and Blair, J. R. (2009). Impairments of probabilistic response reversal and passive avoidance following catecholamine depletion. Neuropsychopharmacology 34, 2691–2698. doi: 10.1038/npp.2009.95
Heinz, A., Goldman, D., Jones, D. W., Palmour, R., Hommer, D., Gorey, J. G., et al. (2000). Genotype influences in vivo dopamine transporter availability in human striatum. Neuropsychopharmacology 22, 133–139. doi: 10.1016/S0893-133X(99)00099-8
Henry, J. D. (2006). A meta-analytic review of Wisconsin Card Sorting Test and verbal fluency performance in obsessive-compulsive disorder. Cogn. Neuropsychiatry 11, 156–176. doi: 10.1080/13546800444000227
Hesse, S., Muller, U., Lincke, T., Barthel, H., Villmann, T., Angermeyer, M. C., et al. (2005). Serotonin and dopamine transporter imaging in patients with obsessive-compulsive disorder. Psychiatry Res. 140, 63–72. doi: 10.1016/j.pscychresns.2005.07.002
Heyser, C. J., Fienberg, A. A., Greengard, P., and Gold, L. H. (2000). DARPP-32 knockout mice exhibit impaired reversal learning in a discriminated operant task. Brain Res. 867, 122–130. doi: 10.1016/S0006-8993(00)02272-1
Hirvonen, M., Laakso, A., Nagren, K., Rinne, J. O., Pohjalainen, T., and Hietala, J. (2004). C957T polymorphism of the dopamine D2 receptor (DRD2) gene affects striatal DRD2 availability in vivo. Mol. Psychiatry 9, 1060–1061. doi: 10.1038/sj.mp.4001561
Hirvonen, M., Laakso, A., Nagren, K., Rinne, J. O., Pohjalainen, T., and Hietala, J. (2005). C957T polymorphism of the dopamine D2 receptor (DRD2) gene affects striatal DRD2 availability in vivo. Mol. Psychiatry 10, 889 (Corrigendum). doi: 10.1038/sj.mp.4001707
Hong, S., and Hikosaka, O. (2011). Dopamine-mediated learning and switching in cortico-striatal circuit explain behavioral changes in reinforcement learning. Front. Behav. Neurosci. 5:15. doi: 10.3389/fnbeh.2011.00015
Hornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., et al. (2004). Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. J. Cogn. Neurosci. 16, 463–478. doi: 10.1162/089892904322926791
Hsieh, P. C., Yeh, T. L., Lee, I. H., Huang, H. C., Chen, P. S., Yang, Y. K., et al. (2010). Correlation between errors on the Wisconsin Card Sorting Test and the availability of striatal dopamine transporters in healthy volunteers. J. Psychiatry Neurosci. 35, 90–94. doi: 10.1503/jpn.090007
Idris, N. F., Repeto, P., Neill, J. C., and Large, C. H. (2005). Investigation of the effects of lamotrigine and clozapine in improving reversal-learning impairments induced by acute phencyclidine and D-amphetamine in the rat. Psychopharmacology (Berl.) 179, 336–348. doi: 10.1007/s00213-004-2058-5
Ito, H., Kodaka, F., Takahashi, H., Takano, H., Arakawa, R., Shimada, H., et al. (2011). Relation between presynaptic and postsynaptic dopaminergic functions measured by positron emission tomography: implication of dopaminergic tone. J. Neurosci. 31, 7886–7890. doi: 10.1523/JNEUROSCI.6024-10.2011
Izquierdo, A., Belcher, A. M., Scott, L., Cazares, V. A., Chen, J., O'Dell, S. J., et al. (2010). Reversal-specific learning impairments after a binge regimen of methamphetamine in rats: possible involvement of striatal dopamine. Neuropsychopharmacology 35, 505–514. doi: 10.1038/npp.2009.155
Izquierdo, A., Wiedholz, L. M., Millstein, R. A., Yang, R. J., Bussey, T. J., Saksida, L. M., et al. (2006). Genetic and dopaminergic modulation of reversal learning in a touchscreen-based operant procedure for mice. Behav. Brain Res. 171, 181–188. doi: 10.1016/j.bbr.2006.03.029
Jocham, G., Klein, T. A., Neumann, J., von Cramon, D. Y., Reuter, M., and Ullsperger, M. (2009). Dopamine DRD2 polymorphism alters reversal learning and associated neural activity. J. Neurosci. 29, 3695–3704. doi: 10.1523/JNEUROSCI.5195-08.2009
Joel, D. (2006). The signal attenuation rat model of obsessive-compulsive disorder: a review. Psychopharmacology (Berl.) 186, 487–503. doi: 10.1007/s00213-006-0387-2
Joel, D., and Doljansky, J. (2003). Selective alleviation of compulsive lever-pressing in rats by D1, but not D2, blockade: possible implications for the involvement of D1 receptors in obsessive-compulsive disorder. Neuropsychopharmacology 28, 77–85. doi: 10.1038/sj.npp.1300010
Karlsson, S., Rieckmann, A., Karlsson, P., Farde, L., Nyberg, L., and Backman, L. (2011). Relationship of dopamine D1 receptor binding in striatal and extrastriatal regions to cognitive functioning in healthy humans. Neuroimage 57, 346–351. doi: 10.1016/j.neuroimage.2011.04.047
Kehagia, A. A., Barker, R. A., and Robbins, T. W. (2010). Neuropsychological and clinical heterogeneity of cognitive impairment and dementia in patients with Parkinson's disease. Lancet Neurol. 9, 1200–1213. doi: 10.1016/S1474-4422(10)70212-X
Kellendonk, C., Simpson, E. H., Polan, H. J., Malleret, G., Vronskaya, S., Winiger, V., et al. (2006). Transient and selective overexpression of dopamine D2 receptors in the striatum causes persistent abnormalities in prefrontal cortex functioning. Neuron 49, 603–615. doi: 10.1016/j.neuron.2006.01.023
Kim, C. H., Cheon, K. A., Koo, M.-S., Ryu, Y. H., Lee, J. D., Chang, J. W., et al. (2007). Dopamine transporter density in the basal ganglia in obsessive-compulsive disorder, measured with [123I]IPT SPECT before and after treatment with serotonin reuptake inhibitors. Neuropsychobiology 55, 156–162. doi: 10.1159/000106474
Kim, C. H., Koo, M. S., Cheon, K. A., Ryu, Y. H., Lee, J. D., and Lee, H. S. (2003). Dopamine transporter density of basal ganglia assessed with [123I]IPT SPET in obsessive-compulsive disorder. Eur. J. Nucl. Med. Mol. Imag. 30, 1637–1643. doi: 10.1007/s00259-003-1245-7
Kimberg, D. Y., and D'Esposito, M. (2003). Cognitive effects of the dopamine receptor agonist pergolide. Neuropsychologia 41, 1020–1027. doi: 10.1016/S0028-3932(02)00317-2
Kimberg, D. Y., D'Esposito, M., and Farah, M. J. (1997). Effects of bromocriptine on human subjects depend on working memory capacity. Neuroreport 8, 3581–3585. doi: 10.1097/00001756-199711100-00032
Klein, T. A., Neumann, J., Reuter, M., Hennig, J., von Cramon, D. Y., and Ullsperger, M. (2007). Genetically determined differences in learning from errors. Science 318, 1642–1645. doi: 10.1126/science.1145044
Ko, J. H., Monchi, O., Ptito, A., Bloomfield, P., Houle, S., and Strafella, A. P. (2008). Theta burst stimulation-induced inhibition of dorsolateral prefrontal cortex reveals hemispheric asymmetry in striatal dopamine release during a set-shifting task: a TMS-[(11)C]raclopride PET study. Eur. J. Neurosci. 28, 2147–2155. doi: 10.1111/j.1460-9568.2008.06501.x
Ko, J. H., Ptito, A., Monchi, O., Cho, S. S., Van, E. T., Pellecchia, G., et al. (2009). Increased dopamine release in the right anterior cingulate cortex during the performance of a sorting task: a [11C]FLB 457 PET study. Neuroimage 46, 516–521. doi: 10.1016/j.neuroimage.2009.02.031
Korff, S., and Harvey, B. H. (2006). Animal models of obsessive-compulsive disorder: rationale to understanding psychobiology and pharmacology. Psychiatry Clin. North Am. 29, 371–390. doi: 10.1016/j.psc.2006.02.007
Kosheleff, A. R., Rodriguez, D., O'Dell, S. J., Marshall, J. F., and Izquierdo, A. (2012). Comparison of single-dose and extended methamphetamine administration on reversal learning in rats. Psychopharmacology (Berl.) 224, 459–467. doi: 10.1007/s00213-012-2774-1
Krahn, L. E., Lin, S. C., Klee, G. G., Lu, P. Y., Ory, S. J., and Zimmermann, R. C. (1999). The effect of presynaptic catecholamine depletion on 6-hydroxymelatonin sulfate: a double blind study of alpha-methyl-para-tyrosine. Eur. Neuropsychopharmacol. 9, 61–66. doi: 10.1016/S0924-977X(98)00006-6
Krugel, L. K., Biele, G., Mohr, P. N., Li, S. C., and Heekeren, H. R. (2009). Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions. Proc. Natl. Acad. Sci. U.S.A. 106, 17951–17956. doi: 10.1073/pnas.0905191106
Kruzich, P. J., and Grandy, D. K. (2004). Dopamine D2 receptors mediate two-odor discrimination and reversal learning in C57BL/6 mice. BMC Neurosci. 5:12. doi: 10.1186/1471-2202-5-12
Kruzich, P. J., Mitchell, S. H., Younkin, A., and Grandy, D. K. (2006). Dopamine D2 receptors mediate reversal learning in male C57BL/6J mice. Cogn. Affect. Behav. Neurosci. 6, 86–90. doi: 10.3758/CABN.6.1.86
Kuczenski, R., and Segal, D. S. (1997). Effects of methylphenidate on extracellular dopamine, serotonin, and norepinephrine: comparison with amphetamine. J. Neurochem. 68, 2032–2037. doi: 10.1046/j.1471-4159.1997.68052032.x
Kulig, B. M., and Calhoun, W. H. (1972). Enhancement of successive discrimination reversal learning by methamphetamine. Psychopharmacologia 27, 233–240. doi: 10.1007/BF00422803
Laakso, A., Pohjalainen, T., Bergman, J., Kajander, J., Haaparanta, M., Solin, O., et al. (2005). The A1 allele of the human D2 dopamine receptor gene is associated with increased activity of striatal L-amino acid decarboxylase in healthy subjects. Pharmacogenet. Genom. 15, 387–391. doi: 10.1097/01213011-200506000-00003
Laakso, A., Vilkman, H., Bergman, J., Haaparanta, M., Solin, O., Syvälahti, E., Salokangas, R. K. R., and Hietala, J. (2002). Sex differences in striatal presynaptic dopamine synthesis capacity in healthy subjects. Biol. Psychiatry 52, 759–763. doi: 10.1016/S0006-3223(02)01369-0
Lacerda, A. L., Dalgalarrondo, P., Caetano, D., Haas, G. L., Camargo, E. E., and Keshavan, M. S. (2003). Neuropsychological performance and regional cerebral blood flow in obsessive-compulsive disorder. Prog. Neuropsychopharmacol. Biol. Psychiatry 27, 657–665. doi: 10.1016/S0278-5846(03)00076-9
Langen, M., Durston, S., Kas, M. J., van Engel, H., and Staal, W. G. (2011). The neurobiology of repetitive behavior:…and men. Neurosci. Biobehav. Rev. 35, 356–365. doi: 10.1016/j.neubiorev.2010.02.005
Lapiz, M. D., and Morilak, D. A. (2006). Noradrenergic modulation of cognitive function in rat medial prefrontal cortex as measured by attentional set shifting capability. Neuroscience 137, 1039–1049. doi: 10.1016/j.neuroscience.2005.09.031
Laughlin, R. E., Grant, T. L., Williams, R. W., and Jentsch, J. D. (2011). Genetic dissection of behavioral flexibility: reversal learning in mice. Biol. Psychiatry 69, 1109–1116. doi: 10.1016/j.biopsych.2011.01.014
Lawrence, N. S., Wooderson, S., Mataix-Cols, D., David, R., Speckens, A., and Phillips, M. L. (2006). Decision making and set shifting impairments are associated with distinct symptom dimensions in obsessive-compulsive disorder. Neuropsychology 20, 409–419. doi: 10.1037/0894-4105.20.4.409
Lee, B., Groman, S., London, E. D., and Jentsch, J. D. (2007). Dopamine D2/D3 receptors play a specific role in the reversal of a learned visual discrimination in monkeys. Neuropsychopharmacology 32, 2125–2134. doi: 10.1038/sj.npp.1301337
Leenaars, C. H., Joosten, R. N., Zwart, A., Sandberg, H., Ruimschotel, E., Hanegraaf, M. A., et al. (2012). Switch-task performance in rats is disturbed by 12 h of sleep deprivation but not by 12 h of sleep fragmentation. Sleep 35, 211–221.
Lewis, M. H., Tanimura, Y., Lee, L. W., and Bodfish, J. W. (2007). Animal models of restricted repetitive behavior in autism. Behav. Brain Res. 176, 66–74. doi: 10.1016/j.bbr.2006.08.023
Logan, G. D., Cowan, W. B., and Davis, K. A. (1984). On the ability to inhibit simple and choice reaction time responses: a model and a method. J. Exp. Psychol. Hum. Percept. Perform. 10, 276–291. doi: 10.1037/0096-1523.10.2.276
Lotta, T., Vidgren, J., Tilgmann, C., Ulmanen, I., Melen, K., Julkunen, I., et al. (1995). Kinetics of human soluble and membrane-bound catechol O-methyltransferase: a revised mechanism and description of the thermolabile variant of the enzyme. Biochemistry 34, 4202–4210. doi: 10.1021/bi00013a008
Lucey, J. V., Burness, C. E., Costa, D. C., Gacinovic, S., Pilowsky, L. S., Ell, P. J., et al. (1997). Wisconsin Card Sorting Task (WCST) errors and cerebral blood flow in obsessive-compulsive disorder (OCD). Br. J. Med. Psychol. 70(Pt 4), 403–411. doi: 10.1111/j.2044-8341.1997.tb01916.x
Lucht, M., and Rosskopf, D. (2008). Comment on “Genetically determined differences in learning from errors”. Science 321, 200. doi: 10.1126/science.1155372
Lumme, V., Aalto, S., Ilonen, T., Nagren, K., and Hietala, J. (2007). Dopamine D2/D3 receptor binding in the anterior cingulate cortex and executive functioning. Psychiatry Res. 156, 69–74. doi: 10.1016/j.pscychresns.2006.12.012
Maes, J. H., Damen, M. D., and Eling, P. A. (2004). More learned irrelevance than perseveration errors in rule shifting in healthy subjects. Brain Cogn. 54, 201–211. doi: 10.1016/j.bandc.2004.01.003
Mailly, P., Aliane, V., Groenewegen, H. J., Haber, S. N., and Deniau, J. M. (2013). The rat prefrontostriatal system analyzed in 3D: evidence for multiple interacting functional units. J. Neurosci. 33, 5718–5727. doi: 10.1523/JNEUROSCI.5248-12.2013
Manes, F., Sahakian, B., Clark, L., Rogers, R., Antoun, N., Aitken, M., et al. (2002). Decision-making processes following damage to the prefrontal cortex. Brain 125, 624–639. doi: 10.1093/brain/awf049
Martinez, D., Gelernter, J., Abi-Dargham, A., van Dyck, C. H., Kegeles, L., Innis, R. B., et al. (2001). The variable number of tandem repeats polymorphism of the dopamine transporter gene is not associated with significant change in dopamine transporter phenotype in humans. Neuropsychopharmacology 24, 553–560. doi: 10.1016/S0893-133X(00)00216-5
McAlonan, K., and Brown, V. J. (2003). Orbital prefrontal cortex mediates reversal learning and not attentional set shifting in the rat. Behav. Brain Res. 146, 97–103. doi: 10.1016/j.bbr.2003.09.019
McDougle, C. J., Epperson, C. N., Pelton, G. H., Wasylink, S., and Price, L. H. (2000). A double-blind, placebo-controlled study of risperidone addition in serotonin reuptake inhibitor-refractory obsessive-compulsive disorder. Arch. Gen. Psychiatry 57, 794–801. doi: 10.1001/archpsyc.57.8.794
Mead, P. G. (1974). Effects of overtraining and pretrial administration of dextroamphetamine on reversal learning in rats. Percept. Mot. Skills 38:566. doi: 10.2466/pms.1974.38.2.566
Mehta, M. A., Manes, F. F., Magnolfi, G., Sahakian, B. J., and Robbins, T. W. (2004). Impaired set-shifting and dissociable effects on tests of spatial working memory following the dopamine D2 receptor antagonist sulpiride in human volunteers. Psychopharmacology (Berl.) 176, 331–342. doi: 10.1007/s00213-004-1899-2
Mehta, M. A., Sahakian, B. J., McKenna, P. J., and Robbins, T. W. (1999). Systemic sulpiride in young adult volunteers simulates the profile of cognitive deficits in Parkinson's disease. Psychopharmacology (Berl.) 146, 162–174. doi: 10.1007/s002130051102
Mehta, M. A., Swainson, R., Ogilvie, A. D., Sahakian, J., and Robbins, T. W. (2001). Improved short-term spatial memory but impaired reversal learning following the dopamine D(2) agonist bromocriptine in human volunteers. Psychopharmacology (Berl.) 159, 10–20. doi: 10.1007/s002130100851
Menzies, L., Chamberlain, S. R., Laird, A. R., Thelen, S. M., Sahakian, B. J., and Bullmore, E. T. (2008a). Integrating evidence from neuroimaging and neuropsychological studies of obsessive-compulsive disorder: the orbitofronto-striatal model revisited. Neurosci. Biobehav. Rev. 32, 525–549. doi: 10.1016/j.neubiorev.2007.09.005
Menzies, L., Williams, G. B., Chamberlain, S. R., Ooi, C., Fineberg, N., Suckling, J., et al. (2008b). White matter abnormalities in patients with obsessive-compulsive disorder and their first-degree relatives. Am. J. Psychiatry. 165, 1308–1315. doi: 10.1176/appi.ajp.2008.07101677
Meyer-Lindenberg, A., Kohn, P. D., Kolachana, B., Kippenhan, S., McInerney-Leo, A., Nussbaum, R., et al. (2005). Midbrain dopamine and prefrontal function in humans: interaction and modulation by COMT genotype. Nat. Neurosci. 8, 594–596. doi: 10.1038/nn1438
Meyer-Lindenberg, A., Straub, R. E., Lipska, B. K., Verchinski, B. A., Goldberg, T., Callicott, J. H., et al. (2007). Genetic evidence implicating DARPP-32 in human frontostriatal structure, function, and cognition. J. Clin. Invest. 117, 672–682. doi: 10.1172/JCI30413
Mier, D., Kirsch, P., and Meyer-Lindenberg, A. (2010). Neural substrates of pleiotropic action of genetic variation in COMT: a meta-analysis. Mol. Psychiatry 15, 918–927. doi: 10.1038/mp.2009.36
Miyake, A., and Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: four general conclusions. Curr. Dir. Psychol. Sci. 21, 8–14. doi: 10.1177/0963721411429458
Monchi, O., Ko, J. H., and Strafella, A. P. (2006a). Striatal dopamine release during performance of executive functions: a [(11)C] raclopride PET study. Neuroimage 33, 907–912. doi: 10.1016/j.neuroimage.2006.06.058
Monchi, O., Petrides, M., Strafella, A. P., Worsley, K. J., and Doyon, J. (2006b). Functional role of the basal ganglia in the planning and execution of actions. Ann. Neurol. 59, 257–264. doi: 10.1002/ana.20742
Monsell, S. (2003). Task switching. Trends Cogn. Sci. 7, 134–140. doi: 10.1016/S1364-6613(03)00028-7
Montague, P. R., Dayan, P., and Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936–1947.
Montgomery, A. J., McTavish, S. F., Cowen, P. J., and Grasby, P. M. (2003). Reduction of brain dopamine concentration with dietary tyrosine plus phenylalanine depletion: an [11C]raclopride PET study. Am. J. Psychiatry 160, 1887–1889. doi: 10.1176/appi.ajp.160.10.1887
Moreno, M., and Flores, P. (2012). Schedule-induced polydipsia as a model of compulsive behavior: neuropharmacological and neuroendocrine bases. Psychopharmacology (Berl.) 219, 647–659. doi: 10.1007/s00213-011-2570-3
Moresco, R. M., Pietra, L., Henin, M., Panzacchi, A., Locatelli, M., Bonaldi, L., et al. (2007). Fluvoxamine treatment and D2 receptors: a pet study on OCD drug-naive patients. Neuropsychopharmacology 32, 197–205. doi: 10.1038/sj.npp.1301199
Moritz, S., Birkner, C., Kloss, M., Jahn, H., Hand, I., Haasen, C., et al. (2002). Executive functioning in obsessive-compulsive disorder, unipolar depression, and schizophrenia. Arch. Clin. Neuropsychol. 17, 477–483.
Moritz, S., Hubner, M., and Kluwe, R. (2004). Task switching and backward inhibition in obsessive-compulsive disorder. J. Clin. Exp. Neuropsychol. 26, 677–683.
Munoz, D. P., and Everling, S. (2004). Look away: the anti-saccade task and the voluntary control of eye movement. Nat. Rev. Neurosci. 5, 218–228. doi: 10.1038/nrn1345
Nagano-Saito, A., Leyton, M., Monchi, O., Goldberg, Y. K., He, Y., and Dagher, A. (2008). Dopamine depletion impairs frontostriatal functional connectivity during a set-shifting task. J. Neurosci. 28, 3697–3706. doi: 10.1523/JNEUROSCI.3921-07.2008
Nestler, E. J., and Hyman, S. E. (2010). Animal models of neuropsychiatric disorders. Nat. Neurosci. 13, 1161–1169. doi: 10.1038/nn.2647
Nikiforuk, A. (2012). Dopamine D1 receptor modulation of set shifting: the role of stress exposure. Behav. Pharmacol. 23, 434–438. doi: 10.1097/FBP.0b013e328356522f
Nikolaus, S., Antke, C., Beu, M., and Muller, H. W. (2010). Cortical GABA striatal dopamine and midbrain serotonin as the key players in compulsive and anxiety disorders–results from in vivo imaging studies. Rev. Neurosci. 21, 119–139. doi: 10.1515/REVNEURO.2010.21.2.119
Nishi, A., Snyder, G. L., and Greengard, P. (1997). Bidirectional regulation of DARPP-32 phosphorylation by dopamine. J. Neurosci. 17, 8147–8155.
Oades, R. D. (1985). The role of noradrenaline in tuning and dopamine in switching between signals in the CNS. Neurosci. Biobehav. Rev. 9, 261–282. doi: 10.1016/0149-7634(85)90050-8
Olley, A., Malhi, G., and Sachdev, P. (2007). Memory and executive functioning in obsessive-compulsive disorder: a selective review. J. Affect Disord. 104, 15–23. doi: 10.1016/j.jad.2007.02.023
Olver, J. S., O'Keefe, G., Jones, G. R., Burrows, G. D., Tochon-Danguy, H. J., Ackermann, U., et al. (2009). Dopamine D1 receptor binding in the striatum of patients with obsessive-compulsive disorder. J. Affect Disord. 114, 321–326. doi: 10.1016/j.jad.2008.06.020
Olver, J. S., O'Keefe, G., Jones, G. R., Burrows, G. D., Tochon-Danguy, H. J., Ackermann, U., et al. (2010). Dopamine D(1) receptor binding in the anterior cingulate cortex of patients with obsessive-compulsive disorder. Psychiatry Res. 183, 85–88. doi: 10.1016/j.pscychresns.2010.04.004
O'Neill, M., and Brown, V. J. (2007). The effect of striatal dopamine depletion and the adenosine A2A antagonist KW-6002 on reversal learning in rats. Neurobiol. Learn. Mem. 88, 75–81. doi: 10.1016/j.nlm.2007.03.003
Owen, A. M., Roberts, A. C., Polkey, C. E., Sahakian, B. J., and Robbins, T. W. (1991). Extra-dimensional versus intra-dimensional set shifting performance following frontal lobe excisions, temporal lobe excisions or amygdalo-hippocampectomy in man. Neuropsychologia 29, 993–1006. doi: 10.1016/0028-3932(91)90063-E
Packard, M. G. (2009). Exhumed from thought: basal ganglia and response learning in the plus-maze. Behav. Brain Res. 199, 24–31. doi: 10.1016/j.bbr.2008.12.013
Page, L. A., Rubia, K., Deeley, Q., Daly, E., Toal, F., Mataix-Cols, D., et al. (2009). A functional magnetic resonance imaging study of inhibitory control in obsessive-compulsive disorder. Psychiatry Res. 174, 202–209. doi: 10.1016/j.pscychresns.2009.05.002
Palmiter, R. D. (2008). Dopamine signaling in the dorsal striatum is essential for motivated behaviors: lessons from dopamine-deficient mice. Ann. N.Y. Acad. Sci. 1129, 35–46. doi: 10.1196/annals.1417.003
Papaleo, F., Crawley, J. N., Song, J., Lipska, B. K., Pickel, J., Weinberger, D. R., et al. (2008). Genetic dissection of the role of catechol-O-methyltransferase in cognition and stress reactivity in mice. J. Neurosci. 28, 8709–8723. doi: 10.1523/JNEUROSCI.2077-08.2008
Pastuzyn, E. D., Chapman, D. E., Wilcox, K. S., and Keefe, K. A. (2012). Altered learning and Arc-regulated consolidation of learning in striatum by methamphetamine-induced neurotoxicity. Neuropsychopharmacology 37, 885–895. doi: 10.1038/npp.2011.265
Perani, D., Garibotto, V., Gorini, A., Moresco, R. M., Henin, M., Panzacchi, A., et al. (2008). In vivo PET study of 5HT(2A) serotonin and D(2) dopamine dysfunction in drug-naive obsessive-compulsive disorder. Neuroimage 42, 306–314. doi: 10.1016/j.neuroimage.2008.04.233
Pitman, R. K. (1989). Animal models of compulsive behavior. Biol. Psychiatry 26, 189–198. doi: 10.1016/0006-3223(89)90022-X
Pogarell, O., Hamann, C., Popperl, G., Juckel, G., Chouker, M., Zaudig, M., et al. (2003). Elevated brain serotonin transporter availability in patients with obsessive-compulsive disorder. Biol. Psychiatry 54, 1406–1413. doi: 10.1016/S0006-3223(03)00183-5
Pohjalainen, T., Rinne, J. O., Nagren, K., Lehikoinen, P., Anttila, K., Syvalahti, E. K., et al. (1998). The A1 allele of the human D2 dopamine receptor gene predicts low D2 receptor availability in healthy volunteers. Mol. Psychiatry 3, 256–260. doi: 10.1038/sj.mp.4000350
Presti, M. F., Mikes, H. M., and Lewis, M. H. (2003). Selective blockade of spontaneous motor stereotypy via intrastriatal pharmacological manipulation. Pharmacol. Biochem. Behav. 74, 833–839. doi: 10.1016/S0091-3057(02)01081-X
Pujol, J., Soriano-Mas, C., Alonso, P., Cardoner, N., Menchon, J. M., Deus, J., et al. (2004). Mapping structural brain alterations in obsessive-compulsive disorder. Arch. Gen. Psychiatry 61, 720–730. doi: 10.1001/archpsyc.61.7.720
Purcell, R., Maruff, P., Kyrios, M., and Pantelis, C. (1998a). Cognitive deficits in obsessive-compulsive disorder on tests of frontal-striatal function. Biol. Psychiatry 43, 348–357. doi: 10.1016/S0006-3223(97)00201-1
Purcell, R., Maruff, P., Kyrios, M., and Pantelis, C. (1998b). Neuropsychological deficits in obsessive-compulsive disorder: a comparison with unipolar depression, panic disorder, and normal controls. Arch. Gen. Psychiatry 55, 415–423. doi: 10.1001/archpsyc.55.5.415
Ragozzino, M. E. (2002). The effects of dopamine D(1) receptor blockade in the prelimbic-infralimbic areas on behavioral flexibility. Learn. Mem. 9, 18–28. doi: 10.1101/lm.45802
Ragozzino, M. E. (2007). The contribution of the medial prefrontal cortex, orbitofrontal cortex, and dorsomedial striatum to behavioral flexibility. Ann. N.Y. Acad. Sci. 1121, 355–375. doi: 10.1196/annals.1401.013
Randrup, A., and Munkvad, I. (1975). Stereotyped behavior. Pharmacol. Ther. B 1, 757–768. doi: 10.1016/0306-039X(75)90027-6
Remijnse, P. L., Nielen, M. M., van Balkom, A. J., Cath, D. C., van Oppen, P., Uylings, H. B., et al. (2006). Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder. Arch. Gen. Psychiatry 63, 1225–1236. doi: 10.1001/archpsyc.63.11.1225
Remijnse, P. L., van den Heuvel, O. A., Nielen, M. M., Vriend, C., Hendriks, G. J., Hoogendijk, W. J., et al. (2013). Cognitive inflexibility in obsessive-compulsive disorder and major depression is associated with distinct neural correlates. PLoS ONE 8:e59600. doi: 10.1371/journal.pone.0059600
Richfield, E. K., Penney, J. B., and Young, A. B. (1989). Anatomical and affinity state comparisons between dopamine D1 and D2 receptors in the rat central nervous system. Neuroscience 30, 767–777. doi: 10.1016/0306-4522(89)90168-1
Ridley, R. M. (1994). The psychology of perserverative and stereotyped behaviour. Prog. Neurobiol. 44, 221–231. doi: 10.1016/0301-0082(94)90039-6
Ridley, R. M., Haystead, T. A., and Baker, H. F. (1981). An analysis of visual object reversal learning in the marmoset after amphetamine and haloperidol. Pharmacol. Biochem. Behav. 14, 345–351. doi: 10.1016/0091-3057(81)90401-9
Robbins, T. W., and Arnsten, A. F. (2009). The neuropsychopharmacology of fronto-executive function: monoaminergic modulation. Annu. Rev. Neurosci. 32, 267–287. doi: 10.1146/annurev.neuro.051508.135535
Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., and Ersche, K. D. (2012). Neurocognitive endophenotypes of impulsivity and compulsivity: towards dimensional psychiatry. Trends Cogn. Sci. 16, 81–91. doi: 10.1016/j.tics.2011.11.009
Roberts, A. C., De Salvia, M. A., Wilkinson, L. S., Collins, P., Muir, J. L., Everitt, B. J., et al. (1994). 6-Hydroxydopamine lesions of the prefrontal cortex in monkeys enhance performance on an analog of the Wisconsin Card Sort Test: possible interactions with subcortical dopamine. J. Neurosci. 14, 2531–2544.
Roberts, A. C., Robbins, T. W., and Everitt, B. J. (1988). The effects of intradimensional and extradimensional shifts on visual discrimination learning in humans and non-human primates. Q. J. Exp. Psychol. B 40, 321–341.
Robinson, O. J., Standing, H. R., DeVito, E. E., Cools, R., and Sahakian, B. J. (2010). Dopamine precursor depletion improves punishment prediction during reversal learning in healthy females but not males. Psychopharmacology (Berl.) 211, 187–195. doi: 10.1007/s00213-010-1880-1
Robinson, S., Sandstrom, S. M., Denenberg, V. H., and Palmiter, R. D. (2005). Distinguishing whether dopamine regulates liking, wanting, and/or learning about rewards. Behav. Neurosci. 119, 5–15. doi: 10.1037/0735-7044.119.1.5
Rodriguez-Jimenez, R., Hoenicka, J., Jimenez-Arriero, M. A., Ponce, G., Bagney, A., Aragues, M., et al. (2006). Performance in the Wisconsin Card Sorting Test and the C957T polymorphism of the DRD2 gene in healthy volunteers. Neuropsychobiology 54, 166–170. doi: 10.1159/000098652
Rogers, R. D., Andrews, T. C., Grasby, P. M., Brooks, D. J., and Robbins, T. W. (2000). Contrasting cortical and subcortical activations produced by attentional-set shifting and reversal learning in humans. J. Cogn. Neurosci. 12, 142–162. doi: 10.1162/089892900561931
Rotge, J. Y., Langbour, N., Guehl, D., Bioulac, B., Jaafari, N., Allard, M., et al. (2010). Gray matter alterations in obsessive-compulsive disorder: an anatomic likelihood estimation meta-analysis. Neuropsychopharmacology 35, 686–691. doi: 10.1038/npp.2009.175
Rudebeck, P. H., Saunders, R. C., Prescott, A. T., Chau, L. S., and Murray, E. A. (2013). Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nat. Neurosci. 16, 1140–1145. doi: 10.1038/nn.3440
Schneier, F. R., Martinez, D., Abi-Dargham, A., Zea-Ponce, Y., Simpson, H. B., Liebowitz, M. R., et al. (2008). Striatal dopamine D(2) receptor availability in OCD with and without comorbid social anxiety disorder: preliminary findings. Depress Anxiety 25, 1–7. doi: 10.1002/da.20268
Schoenbaum, G., Roesch, M. R., Stalnaker, T. A., and Takahashi, Y. K. (2009). A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat. Rev. Neurosci. 10, 885–892.
Schultz, W. (2013). Updating dopamine reward signals. Curr. Opin. Neurobiol. 23, 229–238. doi: 10.1016/j.conb.2012.11.012
Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593–1599. doi: 10.1126/science.275.5306.1593
Seamans, J. K., and Yang, C. R. (2004). The principal features and mechanisms of dopamine modulation in the prefrontal cortex. Prog. Neurobiol. 74, 1–58. doi: 10.1016/j.pneurobio.2004.05.006
Sesack, S. R., Hawrylak, V. A., Matus, C., Guido, M. A., and Levey, A. I. (1998). Dopamine axon varicosities in the prelimbic division of the rat prefrontal cortex exhibit sparse immunoreactivity for the dopamine transporter. J. Neurosci. 18, 2697–2708.
Sesia, T., Bizup, B., and Grace, A. A. (2013). Evaluation of animal models of obsessive-compulsive disorder: correlation with phasic dopamine neuron activity. Int. J. Neuropsychopharmacol. 16, 1295–1307. doi: 10.1017/S146114571200154X.
Seu, E., and Jentsch, J. D. (2009). Effect of acute and repeated treatment with desipramine or methylphenidate on serial reversal learning in rats. Neuropharmacology 57, 665–672. doi: 10.1016/j.neuropharm.2009.08.007
Seu, E., Lang, A., Rivera, R. J., and Jentsch, J. D. (2009). Inhibition of the norepinephrine transporter improves behavioral flexibility in rats and monkeys. Psychopharmacology (Berl.) 202, 505–519. doi: 10.1007/s00213-008-1250-4
Shmelkov, S. V., Hormigo, A., Jing, D., Proenca, C. C., Bath, K. G., Milde, T., et al. (2010). Slitrk5 deficiency impairs corticostriatal circuitry and leads to obsessive-compulsive-like behaviors in mice. Nat. Med. 16, 598–602, 1p.
Smith, A. G., Neill, J. C., and Costall, B. (1999). The dopamine D3/D2 receptor agonist 7-OH-DPAT induces cognitive impairment in the marmoset. Pharmacol. Biochem. Behav. 63, 201–211. doi: 10.1016/S0091-3057(98)00230-5
Sohn, M. H., Ursu, S., Anderson, J. R., Stenger, V. A., and Carter, C. S. (2000). The role of prefrontal cortex and posterior parietal cortex in task switching. Proc. Natl. Acad. Sci. U.S.A. 97, 13448–13453. doi: 10.1073/pnas.240460497
Soto, P. L., Wilcox, K. M., Zhou, Y., Ator, N. A., Riddle, M. A., Wong, D. F., et al. (2012). Long-term exposure to oral methylphenidate or dl-amphetamine mixture in peri-adolescent rhesus monkeys: effects on physiology, behavior, and dopamine system development. Neuropsychopharmacology 37, 2566–2579. doi: 10.1038/npp.2012.119
Stefani, M. R., and Moghaddam, B. (2006). Rule learning and reward contingency are associated with dissociable patterns of dopamine activation in the rat prefrontal cortex, nucleus accumbens, and dorsal striatum. J. Neurosci. 26, 8810–8818. doi: 10.1523/JNEUROSCI.1656-06.2006
Steinberg, E. E., Keiflin, R., Boivin, J. R., Witten, I. B., Deisseroth, K., and Janak, P. H. (2013). A causal link between prediction errors, dopamine neurons and learning. Nat. Neurosci. 16, 966–973. doi: 10.1038/nn.3413
Stelzel, C., Basten, U., Montag, C., Reuter, M., and Fiebach, C. J. (2010). Frontostriatal involvement in task switching depends on genetic differences in d2 receptor density. J. Neurosci. 30, 14205–14212. doi: 10.1523/JNEUROSCI.1062-10.2010
Stoet, G., and Snyder, L. H. (2003). Executive control and task-switching in monkeys. Neuropsychologia 41, 1357–1364. doi: 10.1016/S0028-3932(03)00048-4
Sulzer, D., Sonders, M. S., Poulsen, N. W., and Galli, A. (2005). Mechanisms of neurotransmitter release by amphetamines: a review. Prog. Neurobiol. 75, 406–433. doi: 10.1016/j.pneurobio.2005.04.003
Svenningsson, P., Nishi, A., Fisone, G., Girault, J. A., Nairn, A. C., and Greengard, P. (2004). DARPP-32: an integrator of neurotransmission. Annu. Rev. Pharmacol. Toxicol. 44, 269–296. doi: 10.1146/annurev.pharmtox.44.101802.121415
Szechtman, H., Sulis, W., and Eilam, D. (1998). Quinpirole induces compulsive checking behavior in rats: a potential animal model of obsessive-compulsive disorder (OCD). Behav. Neurosci. 112, 1475–1485. doi: 10.1037/0735-7044.112.6.1475
Taghzouti, K., Louilot, A., Herman, J. P., Le, M. M., and Simon, H. (1985). Alternation behavior, spatial discrimination, and reversal disturbances following 6-hydroxydopamine lesions in the nucleus accumbens of the rat. Behav. Neural. Biol. 44, 354–363. doi: 10.1016/S0163-1047(85)90640-5
Tait, D. S., and Brown, V. J. (2007). Difficulty overcoming learned non-reward during reversal learning in rats with ibotenic acid lesions of orbital prefrontal cortex. Ann. N.Y. Acad. Sci. 1121, 407–420. doi: 10.1196/annals.1401.010
Takahashi, H., Kato, M., Takano, H., Arakawa, R., Okumura, M., Otsuka, T., et al. (2008). Differential contributions of prefrontal and hippocampal dopamine D(1) and D(2) receptors in human cognitive functions. J. Neurosci. 28, 12032–12038. doi: 10.1523/JNEUROSCI.3446-08.2008
Talpos, J. C., Fletcher, A. C., Circelli, C., Tricklebank, M. D., and Dix, S. L. (2012). The pharmacological sensitivity of a touchscreen-based visual discrimination task in the rat using simple and perceptually challenging stimuli. Psychopharmacology (Berl.) 221, 437–449. doi: 10.1007/s00213-011-2590-z
Tanimura, Y., Yang, M. C., and Lewis, M. H. (2008). Procedural learning and cognitive flexibility in a mouse model of restricted, repetitive behaviour. Behav. Brain Res. 189, 250–256. doi: 10.1016/j.bbr.2008.01.001
Thompson, J., Thomas, N., Singleton, A., Piggott, M., Lloyd, S., Perry, E. K., et al. (1997). D2 dopamine receptor gene (DRD2) Taq1 A polymorphism: reduced dopamine D2 receptor binding in the human striatum associated with the A1 allele. Pharmacogenetics 7, 479–484. doi: 10.1097/00008571-199712000-00006
Ting, J. T., and Feng, G. (2011). Neurobiology of obsessive-compulsive disorder: insights into neural circuitry dysfunction through mouse genetics. Curr. Opin. Neurobiol. 21, 842–848. doi: 10.1016/j.conb.2011.04.010
Tunbridge, E. M., Bannerman, D. M., Sharp, T., and Harrison, P. J. (2004). Catechol-o-methyltransferase inhibition improves set-shifting performance and elevates stimulated dopamine release in the rat prefrontal cortex. J. Neurosci. 24, 5331–5335. doi: 10.1523/JNEUROSCI.1124-04.2004
Uylings, H. B., Groenewegen, H. J., and Kolb, B. (2003). Do rats have a prefrontal cortex? Behav. Brain Res. 146, 3–17. doi: 10.1016/j.bbr.2003.09.028
Valerius, G., Lumpp, A., Kuelz, A. K., Freyer, T., and Voderholzer, U. (2008). Reversal learning as a neuropsychological indicator for the neuropathology of obsessive compulsive disorder? A behavioral study. J. Neuropsychiatry Clin. Neurosci. 20, 210–218. doi: 10.1176/appi.neuropsych.20.2.210
van de Giessen, E., de Win, M. M., Tanck, M. W., van den Brink, W., Baas, F., and Booij, J. (2009). Striatal dopamine transporter availability associated with polymorphisms in the dopamine transporter gene SLC6A3. J. Nucl. Med. 50, 45–52. doi: 10.2967/jnumed.108.053652
van den Bos, R., and Cools, A. R. (1989). The involvement of the nucleus accumbens in the ability of rats to switch to cue-directed behaviours. Life Sci. 44, 1697–1704. doi: 10.1016/0024-3205(89)90486-4
van den Heuvel, O. A., Remijnse, P. L., Mataix-Cols, D., Vrenken, H., Groenewegen, H. J., Uylings, H. B., et al. (2009). The major symptom dimensions of obsessive-compulsive disorder are mediated by partially distinct neural systems. Brain 132, 853–868. doi: 10.1093/brain/awn267
van der Meulen, J. A., Joosten, R. N., de Bruin, J. P., and Feenstra, M. G. (2007). Dopamine and noradrenaline efflux in the medial prefrontal cortex during serial reversals and extinction of instrumental goal-directed behavior. Cereb. Cortex 17, 1444–1453. doi: 10.1093/cercor/bhl057
van der Schaaf, M. E., van Schouwenburg, M. R., Geurts, D. E., Schellekens, A. F., Buitelaar, J. K., Verkes, R. J., et al. (2012). Establishing the dopamine dependency of human striatal signals during reward and punishment reversal learning. Cereb. Cortex. doi: 10.1093/cercor/bhs344. [Epub ahead of print].
van der Wee, N. J., Stevens, H., Hardeman, J. A., Mandl, R. C., Denys, D. A., Van Megen, H. J., et al. (2004). Enhanced dopamine transporter density in psychotropic-naive patients with obsessive-compulsive disorder shown by [123I]{beta}-CIT SPECT. Am. J. Psychiatry 161, 2201–2206. doi: 10.1176/appi.ajp.161.12.2201
van Dijk, A., Klompmakers, A., and Denys, D. (2010). “The serotonergic system in obsessive compulsive disorder,” in Handbook of the Behavioral Neurobiology of Serotonin, eds C. P. Muüller and B. L. Jacobs (London: Academic Press), 547–564.
van Dyck, C. H., Malison, R. T., Jacobsen, L. K., Seibyl, J. P., Staley, J. K., Laruelle, M., et al. (2005). Increased dopamine transporter availability associated with the 9-repeat allele of the SLC6A3 gene. J. Nucl. Med. 46, 745–751.
van Holstein, M., Aarts, E., van der Schaaf, M. E., Geurts, D. E., Verkes, R. J., Franke, B., et al. (2011). Human cognitive flexibility depends on dopamine D2 receptor signaling. Psychopharmacology (Berl.) 218, 567–578. doi: 10.1007/s00213-011-2340-2
Veale, D. M., Sahakian, B. J., Owen, A. M., and Marks, I. M. (1996). Specific cognitive deficits in tests sensitive to frontal lobe dysfunction in obsessive-compulsive disorder. Psychol. Med. 26, 1261–1269. doi: 10.1017/S0033291700035984
Verdejo-Garcia, A., Bechara, A., Recknor, E. C., and Perez-Garcia, M. (2006). Executive dysfunction in substance dependent individuals during drug use and abstinence: an examination of the behavioral, cognitive and emotional correlates of addiction. J. Int. Neuropsychol. Soc. 12, 405–415. doi: 10.1017/S1355617706060486
Verhoeff, N. P., Christensen, B. K., Hussey, D., Lee, M., Papatheodorou, G., Kopala, L., et al. (2003). Effects of catecholamine depletion on D2 receptor binding, mood, and attentiveness in humans: a replication study. Pharmacol. Biochem. Behav. 74, 425–432. doi: 10.1016/S0091-3057(02)01028-6
Vermeire, S., Audenaert, K., De Meester, R., Vandermeulen, E., Waelbers, T., De Spiegeleer, B., et al. (2012). Serotonin 2A receptor, serotonin transporter and dopamine transporter alterations in dogs with compulsive behaviour as a promising model for human obsessive-compulsive disorder. Psychiatry Res. 201, 78–87. doi: 10.1016/j.pscychresns.2011.06.006
Vernaleken, I., Buchholz, H. G., Kumakura, Y., Siessmeier, T., Stoeter, P., Bartenstein, P., et al. (2007). ‘Prefrontal’ cognitive performance of healthy subjects positively correlates with cerebral FDOPA influx: an exploratory [18F]-fluoro-L-DOPA-PET investigation. Hum. Brain Mapp. 28, 931–939. doi: 10.1002/hbm.20325
Vickery, S. S., and Mason, G. J. (2005). Stereotypy and perseverative responding in caged bears: further data and analyses. Appl. Anim. Behav. Sci. 247–260. doi: 10.1016/j.applanim.2005.01.005
Vijayraghavan, S., Wang, M., Birnbaum, S. G., Williams, G. V., and Arnsten, A. F. (2007). Inverted-U dopamine D1 receptor actions on prefrontal neurons engaged in working memory. Nat. Neurosci. 10, 376–384. doi: 10.1038/nn1846
Volkow, N. D., Gur, R. C., Wang, G. J., Fowler, J. S., Moberg, P. J., Ding, Y. S., et al. (1998). Association between decline in brain dopamine activity with age and cognitive and motor impairment in healthy individuals. Am. J. Psychiatry 155, 344–349.
Volkow, N. D., Wang, G., Fowler, J. S., Logan, J., Gerasimov, M., Maynard, L., et al. (2001). Therapeutic doses of oral methylphenidate significantly increase extracellular dopamine in the human brain. J. Neurosci. 21:RC121.
Walaas, S. I., and Greengard, P. (1984). DARPP-32, a dopamine- and adenosine 3':5'-monophosphate-regulated phosphoprotein enriched in dopamine-innervated brain regions. I. Regional and cellular distribution in the rat brain. J. Neurosci. 4, 84–98.
Walker, S. C., Robbins, T. W., and Roberts, A. C. (2009). Differential contributions of dopamine and serotonin to orbitofrontal cortex function in the marmoset. Cereb. Cortex 19, 889–898. doi: 10.1093/cercor/bhn136
Walton, M. E., Behrens, T. E., Buckley, M. J., Rudebeck, P. H., and Rushworth, M. F. (2010). Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65, 927–939. doi: 10.1016/j.neuron.2010.02.027
Wang, L., Simpson, H. B., and Dulawa, S. C. (2009). Assessing the validity of current mouse genetic models of obsessive-compulsive disorder. Behav. Pharmacol. 20, 119–133. doi: 10.1097/FBP.0b013e32832a80ad
Watkins, L. H., Sahakian, B. J., Robertson, M. M., Veale, D. M., Rogers, R. D., Pickard, K. M., et al. (2005). Executive function in Tourette's syndrome and obsessive-compulsive disorder. Psychol. Med. 35, 571–582. doi: 10.1017/S0033291704003691
Weiner, I., and Feldon, J. (1986). Reversal and nonreversal shifts under amphetamine. Psychopharmacology (Berl.) 89, 355–359. doi: 10.1007/BF00174374
Weiner, I., Feldon, J., and Ben-Shahar, O. (1986). Simultaneous brightness discrimination and reversal: the effects of amphetamine administration in the two stages. Pharmacol. Biochem. Behav. 25, 939–942. doi: 10.1016/0091-3057(86)90066-3
Welch, J. M., Lu, J., Rodriguiz, R. M., Trotta, N. C., Peca, J., Ding, J. D., et al. (2007). Cortico-striatal synaptic defects and OCD-like behaviours in Sapap3-mutant mice. Nature 448, 894–900. doi: 10.1038/nature06104
White, I. M., Minamoto, T., Odell, J. R., Mayhorn, J., and White, W. (2009). Brief exposure to methamphetamine (METH) and phencyclidine (PCP) during late development leads to long-term learning deficits in rats. Brain Res. 1266, 72–86. doi: 10.1016/j.brainres.2009.02.024
Williams, G. V., and Goldman-Rakic, P. S. (1995). Modulation of memory fields by dopamine D1 receptors in prefrontal cortex. Nature 376, 572–575. doi: 10.1038/376572a0
Wilpizeski, C. R., and Hamilton, C. L. (1964). Drug-induced decrement in spatial reversal learning in the white rat. Psychopharmacologia 6, 475–479. doi: 10.1007/BF00429574
Winter, S., Dieckmann, M., and Schwabe, K. (2009). Dopamine in the prefrontal cortex regulates rats behavioral flexibility to changing reward value. Behav. Brain Res. 198, 206–213. doi: 10.1016/j.bbr.2008.10.040
Wise, S. P., Murray, E. A., and Gerfen, C. R. (1996). The frontal cortex-basal ganglia system in primates. Crit. Rev. Neurobiol. 10, 317–356. doi: 10.1615/CritRevNeurobiol.v10.i3-4.30
Yawata, S., Yamaguchi, T., Danjo, T., Hikida, T., and Nakanishi, S. (2012). Pathway-specific control of reward learning and its flexibility via selective dopamine receptors in the nucleus accumbens. Proc. Natl. Acad. Sci. U.S.A. 109, 12764–12769. doi: 10.1073/pnas.1210797109
Yerys, B. E., Wallace, G. L., Harrison, B., Celano, M. J., Giedd, J. N., and Kenworthy, L. E. (2009). Set-shifting in children with autism spectrum disorders: reversal shifting deficits on the Intradimensional/Extradimensional Shift Test correlate with repetitive behaviors. Autism 13, 523–538.
Zahrt, J., Taylor, J. R., Mathew, R. G., and Arnsten, A. F. (1997). Supranormal stimulation of D1 dopamine receptors in the rodent prefrontal cortex impairs spatial working memory performance. J. Neurosci. 17, 8528–8535.
Zweifel, L. S., Parker, J. G., Lobb, C. J., Rainwater, A., Wall, V. Z., Fadok, J. P., et al. (2009). Disruption of NMDAR-dependent burst firing by dopamine neurons provides selective assessment of phasic dopamine-dependent behavior. Proc. Natl. Acad. Sci. U.S.A. 106, 7281–7288. doi: 10.1073/pnas.0813415106
Keywords: dopamine, cognitive flexibility, obsessive-compulsive disorder, reversal learning, set-shifting, task switching
Citation: Klanker M, Feenstra M and Denys D (2013) Dopaminergic control of cognitive flexibility in humans and animals. Front. Neurosci. 7:201. doi: 10.3389/fnins.2013.00201
Received: 22 May 2013; Accepted: 11 October 2013;
Published online: 05 November 2013.
Edited by:
Roshan Cools, University of Cambridge, UKReviewed by:
Mark Walton, University of Oxford, UKChung-Chuan Lo, National Tsing Hua University, Taiwan
Copyright © 2013 Klanker, Feenstra and Denys. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Marianne Klanker, Netherlands Institute for Neuroscience, Meibergdreef 47, 1105 BA Amsterdam, Netherlands e-mail: m.klanker@nin.knaw.nl