Habitual behavior and dopamine cell vulnerability in Parkinson disease
Ledia F. Hernández
Peter Redgrave
José A. Obeso- 1Fundacion HM, Hospital HM Puerta del Sur, Centre for Integrative Neuroscience A.C., Mostoles and CEU San Pablo University, Madrid, Spain
- 2Center for Networked Biomedical Research on Neurodegenerative Diseases, Institute Carlos III, Madrid, Spain
- 3Department of Psychology, University of Sheffield, Sheffield, UK
The cardinal features of Parkinson disease (PD) often begin focally, typically in one limb, and may remain relatively restricted to one side of the body for many years. It is now well established that dopaminergic neurons in the ventro-lateral tier of the substantia nigra pars compacta (SNpc), which project mainly to the caudal putamen, are the first to degenerate in the initial phase of PD (Fearnley and Lees, 1991; Halliday et al., 2008; Blesa et al., 2010) indicating differential vulnerability. The caudal region of the striatum (dorsolateral striatum in rodents) has been associated with habitual (or automatic) behavior (Redgrave et al., 2010), consequently the differential loss of dopamine (DA) from this region provides the pathophysiological substrate for the early impairment of automatic movements (walking, writing, …) in early PD.
The brain has two major systems for controlling behavior: a goal directed mechanism (GD) and a mechanism mediating stimulus-response habits (Figure 1). The goal directed system entails conscious, voluntary control of actions aimed toward obtaining rewards or avoiding punishments. Action selection is determined by competitions between relative outcome values, i.e. if outcome A is more valuable than outcome B, then learned behavior that will lead to outcome A will be selected. Examples of goal-directed control would be: heading to the fridge or going to a restaurant when we are hungry, taking the elevator or taking the stairs back to the apartment. This goal-directed process engages the prefrontal cortex and dorsolateral striatum (Yin et al., 2004). On the other hand, the habitual system detects well-learned cues that have been associated with specific responses, and therefore elicit automatic stimulus-response behavior via the re-entrant loop that connect sensorimotor cortical areas with the posterior putamen (dorsolateral striatum in rodents) (Barnes et al., 2005). Habits are established gradually over time. They evolve after many repetitions of a task being performed under flexible goal-directed learning and depend heavily on the statistical regularities between specific stimuli and consequent responses. Examples of habitual control would be, walking, riding a bike or driving. The critical test for habits is that they are resistant to outcome-devaluation (Adams and Dickinson, 1981). Inappropriate habitual responses are frequently difficult to eradicate and have to be corrected by goal-directed interventions after they fail to achieve their original intention. In this Opinion article we put forward the hypothesis that a significant factor that confers vulnerability to the ventro-lateral tier of SNpc at the onset of PD may reside in the key functional role that these neurons play in the performance of habitual behavior, switching between habitual and goal-directed control, and engaging both goal-directed and habitual control when carrying out multiple tasks simultaneously.
Figure 1. Diagram of the functional loops involved in goal-directed and habitual behavior.
Functional Anatomy of Habitual vs. Goal Directed Behavior
The nigro-striatal system has two major components, the associative loop and the motor loop. The associative loop comprises the dorso-medial SNpc that projects to the head of the caudate and rostral putamen, regions that have been associated with goal-directed behavior and executive functions (Yin and Knowlton, 2006). On the other hand, the ventro-lateral SNpc projects to the posterior putamen, which engages the sensorimotor circuits and habitual performance (Jog et al., 1999; Haber et al., 2000; Packard and Knowlton, 2002; Redgrave et al., 2010).
As humans, much of our thinking in daily life is made possible by engaging automatic or habitual control, e.g., walking, typing, etc…In fact, depending on the predictability of what we are doing, we frequently switch back and forth between goal-directed to habitual control. Goal-directed cognition (e.g. listening, talking) is often performed simultaneously while carrying out predictable sensorimotor tasks under habitual control (e.g. making tea, driving). Social interactions are characterized by the need to perform simultaneous and sequential activities while attending to multiple stimuli. We suggest that multi-tasking in humans could be an important vulnerability factor that puts the ventro-lateral subpopulation of dopaminergic neurons at greater pathological risk. Our hypothesis is that switching in and out of habitual control requires an unusually demanding anatomo-physiological network, which makes the dopaminergic neurons servicing sensorimotor territories of the basal ganglia especially vulnerable. We will argue that this represents a key factor for the neuronal degeneration associated with PD. As the ventro-lateral SNpc/caudal putamen (habitual system) becomes dysfunctional in PD, the goal-directed system has to be recruited to perform the previously automatic habitual tasks. This compensatory mechanism could have a “double-sword” effect by shifting the vulnerability to the now overloaded dopaminergic neurons in dorso-medial SNpc. This process could further propagate the neurodegeneration (Halliday and McCann, 2010).
Factors Associated with SNpc Degeneration
Several studies analyse and discuss the nigro-striatal features that have been associated with potential degeneration of dopaminergic SNpc cells in PD (Hirsch et al., 2013; Sulzer and Surmeier, 2013). However, most of the identified characteristics are shared with the more medially located DA cells that seem to be less vulnerable in PD. Here we summarize some of the more relevant anatomo-functional markers that have been suggested to confer vulnerability to nigro-striatal neurodegeneration, which is the preferential and initial site of significant neuronal death in PD. We acknowledge the major current interest in the evolution of synuclein deposits (typically giving rise to Lewy bodies) in different regions of the nervous system. However, the actual significance of such aggregates to explain symptoms and to cause neurodegeneration in PD is unsettled yet (van de Berg et al., 2012).
Neuromelanin
Interestingly, mammals generally show few melanized dopaminergic cells, which become more prominent in primate species and are particularly abundant in the human mesencephalon (Herrero et al., 1993). However, the presence of neuromelanin per se seems not to account for the specific vulnerability pattern of ventro-lateral tier, because not all brainstem (or anywhere else) pigmented neurons die in early PD (Gibb, 1992; Fedorow et al., 2005).
Mitochondrial Stress
Dopaminergic neurons are under a high mitochondrial oxidant stress (Surmeier et al., 2011). In fact, calcium entry through L-type channels during autonomous spiking, which characterizes this population, increases the vulnerability of SNpc dopaminergic neurons to the toxins 6-OHDA and MPTP; substances that are used to create animal models of PD (Chan et al., 2007). Thus, reduced complex I mitochondrial activity and elevated oxidant stress (Guzman et al., 2009) is a likely important factor in the PD-related pathogenesis of SNpc (Schapira, 2008; Blesa et al., 2015).
DA and Vesicular Transporters
The activity and distribution of the synaptic dopamine transport (DAT) protein represents an entry for neurotoxic substances such MPTP and 6-OHDA (Dauer and Przedborski, 2003). DAT shows a dorso-ventral gradient with the expression of higher levels of glycosylated (mature, highly functional) protein found in the vulnerable ventral SNpc (Reyes et al., 2013). However, these neurons did not show a uniform expression of glycosylated DAT (Reyes et al., 2013). Together with the fact that other midbrain areas show glycosylated DAT, makes it unclear how these small expression differences could account for the differential vulnerability observed between SNpc and VTA neurons or between dorsal and ventral SNpc DA neurons (Gonzalez-Hernandez et al., 2004). Alternatively, another possible vulnerability feature for these neurons is their decreased vesicular accumulation of DA57 (Liang et al., 1996; Damier et al., 1999) and reduced levels of VMAT2 (Pifl et al., 2014). Failure to store DA into pre-synaptic vesicles appropriately would lead to higher cytoplasm levels of free dopamine and formation of cytotoxic free radicals. However, the extent to which this factor is able to account for the regional vulnerability of ventral midbrain DA neurons remains to be established.
Dopaminergic Striatal Axonal Arborization
The nigro-striatal projection exhibits one of the highest levels of divergent arborization (Matsuda et al., 2009; Bolam and Pissadaki, 2012). Thus, it has been estimated that a DA neuron that terminates in the rodent dorsal striatum has 102.165–245.103 synapses, while the number of synapse associated with corresponding neurons from the VTA are in the range of 12.351–29.644 (Bolam and Pissadaki, 2012). Importantly, in humans, the increase in the numbers of DA neurons (12.000 in rats vs. 382.000 in humans) has not kept pace with the striatal volume that these neurons innervate (Vol str in mm3: rats: 19.930; humans: 6,28043) (Bolam and Pissadaki, 2012). The inference is that the degree of divergence in humans must therefore be even greater, thereby creating a substantially greater metabolic and proteostatic load on the human DA cells that innervate the sensorimotor striatum (Dryanovski et al., 2013). It remains to be ascertained if the latero-medial gradient of neuronal loss exhibited in the SNpc in PD is paralleled by degree of arborization.
PD Etiopathogenesis is Multifactorial
While the differential features summarized above may play a significant role in nigro-striatal neurodegeneration, current evidence strongly indicates a multi-factorial origin for PD. Thus, mutation of single genes (i.e. parkin, LRRK-2, DJ-1, synuclein) can lead to DA neuronal loss (with or without Lewy body aggregates), glucocerebrosidase (GBA) expression correlates not only with the risk of developing PD (Beavan and Schapira, 2013) but also with its progression (Brockmann et al., 2015). Moreover, several genetic loci have been associated with increased risk of developing PD (Nalls et al., 2014). Finally, several environmental, life-style habits and toxic exposure have also been associated with higher or lesser risk of developing PD (Ross and Abbott, 2014; Tanner et al., 2014; Tanner and Comella, 2015). Accordingly, it is unlikely that the origin of neurodegeneration in PD could be tight to a single pathogenic mechanism or event.
Here, we would like to stress some clinical observations. Thus, that at the onset of PD the neuronal cell loss is highly asymmetrical, and mainly affecting one unilateral sub-group of DA neurons that innervate sensorimotor territories of the caudal putamen. As a consequence, the motor deficit is typically restricted to just one body part. These specificities are difficult to explain by changes in cellular markers that are widespread and feature in a high proportion of neurons.
A more integrative explanation that might bridge the gap between specific molecular abnormalities and the selective vulnerability of SNpc is to consider the functional anatomy of the nigro-striatal system as a significant risk factor. Our suggestion is that the early loss of ventro-lateral tier neurons could be determined by their role in the acquisition and control of automatic movements, and the resultant switching between goal-directed and habitual modes. This suggestion is supported by recent data where it has been reported that DA neurons are engaged by multiple events in tasks that have cognitive and sensorimotor components (Matsumoto and Takada, 2013), in addition to events associated with reward prediction (Schultz et al., 1997). It seems then, that DA neurons can be subdivided into functionally separate subpopulations; the ones specially coding reward prediction errors that are concentrated medially in the VTA, and neurons located in lateral SNpc that are responsive to a much wider range of salient sensory events, including to those associated with reward (Matsumoto and Hikosaka, 2009; Matsumoto and Takada, 2013). In rodents, these data are supported by observations that SNpc neurons also signal the initiation or termination of self-paced sequential behavior (Jin and Costa, 2010). This start/stop related activity emerged with learning, was specific for particular actions, and did not reflect timing or movement speed related actions. These data further support our hypothesis that, ventro-lateral DA neurons are sensitive to and activated by numerous aspects of action performance, learning and task switching. This more frequent pattern of activation of lateral SNpc neurons could represent an additional if not fundamental metabolic load that, associated with the features summarized above, could confer specific vulnerability to these cells.
Parkinson's Disease as a Consequence of Human Behavior
Early in life, humans undergo an extended period of learning, during which a wide range sensorimotor, perceptual, cognitive and social skills, are acquired. Many of these skills have repetitive components, so after the first few decades, much of our behavior contains embedded fragments of automatic stimulus-response control. Many of these naturalistic automatic ‘chunks’ would, in a laboratory setting, turn out to satisfy formal criteria for stimulus-response habits—comparative insensitivity to outcome devaluation (Adams and Dickinson, 1981). An important consequence of establishing automatic habits is that it affords the possibility of undertaking multiple tasks simultaneously. These may consist of two or more automatic actions (walking and chewing gum), or a combination of an automatic and a goal directed action (walking and talking).
Becoming bipedal, thereby freeing the upper extremities to manipulate, allowed independent cognitive functions while doing things on the move. Consequently, the motor system in general, and the cortico-basal ganglia loops in particular, adapted to accommodate parallel processing. Dopaminergic activity, with its ability to modulate striatal excitability, plays an essential role in the initiation and expressions of self-paced stimulus-response. Accordingly, the dopaminergic nigro-striatal system becomes under increasing demand, especially the portion regulating habitual behavior. As a result, we believe, PD is the pathological result of increased functional demand on the nigro-striatal system produced by the evolutionary imperative for multitasking. Until recently this increased load had no apparent negative consequences, perhaps because life expectancy was short and below the risk age for developing PD. However, this has changed drastically, and the anticipated increase in future life expectancy is likely only to exacerbate this situation.
Thinking ahead, we realize that an ultimate research goal would be to replicate or simulate comparable levels of multitasking in suitable animal models to test the proposed hypothesis. This will pose a significant experimental challenge. However, our specific aim will be to establish non-human primate and rodent models in which ventro-lateral dopaminergic neurons are put under long-term functional stress.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Adams, C. D., and Dickinson, A. (1981). Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol. 33B, 109–121. doi: 10.1080/14640748108400816
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z., and Graybiel, A. M. (2005). Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437, 1158–1161. doi: 10.1038/nature04053
Beavan, M. S., and Schapira, A. H. (2013). Glucocerebrosidase mutations and the pathogenesis of Parkinson disease. Ann. Med. 45, 511–521. doi: 10.3109/07853890.2013.849003
Blesa, J., Juri, C., Collantes, M., Penuelas, I., Prieto, E., Iglesias, E., et al. (2010). Progression of dopaminergic depletion in a model of MPTP-induced Parkinsonism in non-human primates. An (18)F-DOPA and (11)C-DTBZ PET study. Neurobiol. Dis. 38, 456–463. doi: 10.1016/j.nbd.2010.03.006
Blesa, J., Trigo-Damas, I., Quiroga-Varela, A., and Jackson-Lewis, V. R. (2015). Oxidative stress and Parkinson's disease. Front. Neuroanat. 9:91. doi: 10.3389/fnana.2015.00091
Bolam, J. P., and Pissadaki, E. K. (2012). Living on the edge with too many mouths to feed: why dopamine neurons die. Mov. Disord. 27, 1478–1483. doi: 10.1002/mds.25135
Brockmann, K., Srulijes, K., Pflederer, S., Hauser, A. K., Schulte, C., Maetzler, W., et al. (2015). GBA-associated Parkinson's disease: reduced survival and more rapid progression in a prospective longitudinal study. Mov. Disord. 30, 407–411. doi: 10.1002/mds.26071
Chan, C. S., Guzman, J. N., Ilijic, E., Mercer, J. N., Rick, C., Tkatch, T., et al. (2007). 'Rejuvenation' protects neurons in mouse models of Parkinson's disease. Nature 447, 1081–1086. doi: 10.1038/nature05865
Damier, P., Hirsch, E. C., Agid, Y., and Graybiel, A. M. (1999). The substantia nigra of the human brain. II. Patterns of loss of dopamine-containing neurons in Parkinson's disease. Brain 122(Pt 8), 1437–1448. doi: 10.1093/brain/122.8.1437
Dauer, W., and Przedborski, S. (2003). Parkinson's disease: mechanisms and models. Neuron 39, 889–909. doi: 10.1016/S0896-6273(03)00568-3
Dryanovski, D. I., Guzman, J. N., Xie, Z., Galteri, D. J., Volpicelli-Daley, L. A., Lee, V. M., et al. (2013). Calcium entry and alpha-synuclein inclusions elevate dendritic mitochondrial oxidant stress in dopaminergic neurons. J. Neurosci. 33, 10154–10164. doi: 10.1523/JNEUROSCI.5311-12.2013
Fearnley, J. M., and Lees, A. J. (1991). Ageing and Parkinson's disease: substantia nigra regional selectivity. Brain 114(Pt 5), 2283–2301. doi: 10.1093/brain/114.5.2283
Fedorow, H., Tribl, F., Halliday, G., Gerlach, M., Riederer, P., and Double, K. L. (2005). Neuromelanin in human dopamine neurons: comparison with peripheral melanins and relevance to Parkinson's disease. Prog. Neurobiol. 75, 109–124. doi: 10.1016/j.pneurobio.2005.02.001
Gibb, W. R. (1992). Melanin, tyrosine hydroxylase, calbindin and substance P in the human midbrain and substantia nigra in relation to nigrostriatal projections and differential neuronal susceptibility in Parkinson's disease. Brain Res. 581, 283–291. doi: 10.1016/0006-8993(92)90719-P
Gonzalez-Hernandez, T., Barroso-Chinea, P., De La Cruz Muros, I., Del Mar Perez-Delgado, M., and Rodriguez, M. (2004). Expression of dopamine and vesicular monoamine transporters and differential vulnerability of mesostriatal dopaminergic neurons. J. Comp. Neurol. 479, 198–215. doi: 10.1002/cne.20323
Guzman, J. N., Sanchez-Padilla, J., Chan, C. S., and Surmeier, D. J. (2009). Robust pacemaking in substantia nigra dopaminergic neurons. J. Neurosci. 29, 11011–11019. doi: 10.1523/JNEUROSCI.2519-09.2009
Haber, S. N., Fudge, J. L., and McFarland, N. R. (2000). Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J. Neurosci. 20, 2369–2382.
Halliday, G., Hely, M., Reid, W., and Morris, J. (2008). The progression of pathology in longitudinally followed patients with Parkinson's disease. Acta Neuropathol. 115, 409–415. doi: 10.1007/s00401-008-0344-8
Halliday, G. M., and McCann, H. (2010). The progression of pathology in Parkinson's disease. Ann. N.Y. Acad. Sci. 1184, 188–195. doi: 10.1111/j.1749-6632.2009.05118.x
Herrero, M. T., Hirsch, E. C., Kastner, A., Luquin, M. R., Javoy-Agid, F., Gonzalo, L. M., et al. (1993). Neuromelanin accumulation with age in catecholaminergic neurons from Macaca fascicularis brainstem. Dev. Neurosci. 15, 37–48. doi: 10.1159/000111315
Hirsch, E. C., Jenner, P., and Przedborski, S. (2013). Pathogenesis of Parkinson's disease. Mov. Disord. 28, 24–30. doi: 10.1002/mds.25032
Jin, X., and Costa, R. M. (2010). Start/stop signals emerge in nigrostriatal circuits during sequence learning. Nature 466, 457–462. doi: 10.1038/nature09263
Jog, M. S., Kubota, Y., Connolly, C. I., Hillegaart, V., and Graybiel, A. M. (1999). Building neural representations of habits. Science 286, 1745–1749. doi: 10.1126/science.286.5445.1745
Liang, C. L., Sinton, C. M., Sonsalla, P. K., and German, D. C. (1996). Midbrain dopaminergic neurons in the mouse that contain calbindin-D28k exhibit reduced vulnerability to MPTP-induced neurodegeneration. Neurodegeneration 5, 313–318. doi: 10.1006/neur.1996.0042
Matsuda, W., Furuta, T., Nakamura, K. C., Hioki, H., Fujiyama, F., Arai, R., et al. (2009). Single nigrostriatal dopaminergic neurons form widely spread and highly dense axonal arborizations in the neostriatum. J. Neurosci. 29, 444–453. doi: 10.1523/JNEUROSCI.4029-08.2009
Matsumoto, M., and Hikosaka, O. (2009). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837–841. doi: 10.1038/nature08028
Matsumoto, M., and Takada, M. (2013). Distinct representations of cognitive and motivational signals in midbrain dopamine neurons. Neuron 79, 1011–1024. doi: 10.1016/j.neuron.2013.07.002
Nalls, M. A., Pankratz, N., Lill, C. M., Do, C. B., Hernandez, D. G., Saad, M., et al. (2014). Large-scale meta-analysis of genome-wide association data identifies six new risk loci for Parkinson's disease. Nat. Genet. 46, 989–993. doi: 10.1038/ng.3043
Packard, M. G., and Knowlton, B. J. (2002). Learning and memory functions of the Basal Ganglia. Annu. Rev. Neurosci. 25, 563–593. doi: 10.1146/annurev.neuro.25.112701.142937
Pifl, C., Rajput, A., Reither, H., Blesa, J., Cavada, C., Obeso, J. A., et al. (2014). Is Parkinson's disease a vesicular dopamine storage disorder? Evidence from a study in isolated synaptic vesicles of human and nonhuman primate striatum. J. Neurosci. 34, 8210–8218. doi: 10.1523/JNEUROSCI.5456-13.2014
Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M. C., Lehericy, S., Bergman, H., et al. (2010). Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease. Nat. Rev. Neurosci. 11, 760–772. doi: 10.1038/nrn2915
Reyes, S., Cottam, V., Kirik, D., Double, K. L., and Halliday, G. M. (2013). Variability in neuronal expression of dopamine receptors and transporters in the substantia nigra. Mov. Disord. 28, 1351–1359. doi: 10.1002/mds.25493
Ross, G. W., and Abbott, R. D. (2014). Living and dying with Parkinson's disease. Mov. Disord. 29, 1571–1573. doi: 10.1002/mds.25955
Schapira, A. H. (2008). Mitochondria in the aetiology and pathogenesis of Parkinson's disease. Lancet Neurol. 7, 97–109. doi: 10.1016/S1474-4422(07)70327-7
Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593–1599. doi: 10.1126/science.275.5306.1593
Sulzer, D., and Surmeier, D. J. (2013). Neuronal vulnerability, pathogenesis, and Parkinson's disease. Mov. Disord. 28, 715–724. doi: 10.1002/mds.25187
Surmeier, D. J., Guzman, J. N., Sanchez-Padilla, J., and Schumacker, P. T. (2011). The role of calcium and mitochondrial oxidant stress in the loss of substantia nigra pars compacta dopaminergic neurons in Parkinson's disease. Neuroscience 198, 221–231. doi: 10.1016/j.neuroscience.2011.08.045
Tanner, C. M., and Comella, C. L. (2015). When brawn benefits brain: physical activity and Parkinson's disease risk. Brain 138, 238–239. doi: 10.1093/brain/awu351
Tanner, C. M., Goldman, S. M., Ross, G. W., and Grate, S. J. (2014). The disease intersection of susceptibility and exposure: chemical exposures and neurodegenerative disease risk. Alzheimers. Dement. 10, S213–S225. doi: 10.1016/j.jalz.2014.04.014
van de Berg, W. D., Hepp, D. H., Dijkstra, A. A., Rozemuller, J. A., Berendse, H. W., and Foncke, E. (2012). Patterns of α-synuclein pathology in incidental cases and clinical subtypes of Parkinson's disease. Parkinsonism Relat. Disord. 18(Suppl. 1), S28–S30. doi: 10.1016/S1353-8020(11)70011-6
Yin, H. H., and Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464–476. doi: 10.1038/nrn1919
Keywords: Parkinson disease, dopamine, substantia nigra, habits, goal directed behavior, vulnerability factors, striatum
Citation: Hernández LF, Redgrave P and Obeso JA (2015) Habitual behavior and dopamine cell vulnerability in Parkinson disease. Front. Neuroanat. 9:99. doi: 10.3389/fnana.2015.00099
Received: 22 April 2015; Accepted: 10 July 2015;
Published: 06 August 2015.
Edited by:
Ricardo Insausti, University of Castilla-La Mancha, SpainReviewed by:
Rosario Moratalla, Cajal Institute, SpainAntonio Pisani, Università degli Studi di Roma Tor Vergata, Italy
Copyright © 2015 Hernández, Redgrave and Obeso. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: José A. Obeso, jobeso52@gmail.com