Functional opposition between habenula metabolism and the brain reward system
Jason Shumake
F. Gonzalez-Lima- Department of Psychology, University of Texas at Austin, Austin, TX, USA
Matsumoto and Hikosaka (2007) provided the first electrophysiological evidence that lateral habenula (LHb) neurons are inhibited by stimuli predicting reward and excited by stimuli predicting no reward, in exact opposition to the firing responses of midbrain dopamine (DA) neurons. Discovering the temporal relationship between LHb neuronal activity and negative reward prediction was groundbreaking. But for the metabolic brain-mapping field, development of a more general model of functional opposition between the LHb and the brain reward system (BRS) began with metabolic findings in the 1980s (Shumake and Gonzalez-Lima, 2003).
2-Deoxyglucose (2-DG) Studies of LHb Function in the 1980s
Louis Sokoloff and colleagues were the first to demonstrate that DA manipulations profoundly influence metabolism in the LHb. Specifically, amphetamine and apomorphine, drugs which increase DA levels and activate DA receptors, respectively, markedly decreased LHb glucose consumption; in contrast, haloperidol, which blocks DA receptors, markedly enhanced glucose utilization by the LHb (Wechsler et al., 1979; McCulloch et al., 1980). Rewarding electrical stimulation of the medial forebrain bundle (MFB) also suppressed LHb metabolism, whereas doses of the DA-antagonist pimozide both abolished self-stimulation of the MFB and caused dramatic elevations in LHb metabolism (Gomita and Gallistel, 1982; Gallistel et al., 1985).
Decreased LHb metabolism in response to increased DA levels was further demonstrated by Porrino and colleagues, who found a strong inverse relationship between LHb glucose uptake and both the dose of DA-increasing drugs and their associated locomotor effects (Porrino and Lucignani, 1987; Porrino et al., 1988). Increased LHb metabolism was further demonstrated in response to an array of DA-receptor blockers (Ramm et al., 1984), catecholamine depletion with alpha-methyl-para-tyrosine (AMPT), and amphetamine withdrawal (Caldecott-Hazard et al., 1988). Because amphetamine suppresses LHb metabolism when administered acutely, elevated LHb metabolism during amphetamine withdrawal implies that the LHb develops a compensatory response against chronic drug administration, rebounding in the opposite direction when treatment is withdrawn.
Whereas most of the 2-DG studies during this time period relied on pharmacological manipulations to effect change in LHb metabolism, Gonzalez-Lima and Scheich (1986) were the first to link changes in LHb activity to learning. They found that LHb metabolism was selectively increased by contiguous pairings of a conditioned stimulus (CS) with an aversive unconditioned stimulus (US). Since the LHb was not activated by presentations of the CS alone or the US alone, this implied that the LHb responded to the prediction of the US by the CS. This finding not only anticipated the discovery of the negative-reward predicting properties of LHb neurons, but also suggested that LHb neurons may be involved in the prediction of aversive events more generally, i.e., the withdrawal of a pleasant stimulus or the delivery of an unpleasant one.
Reciprocal Inhibition and Bistable States
In general, then, the LHb and the BRS display a mutually inhibitory relationship in terms of functional connectivity. This does not mean, for example, that the LHb and VTA send inhibitory anatomical projections directly to one another. The major anatomical pathway of influence to the VTA from the LHb appears to be an excitatory projection to the rostromedial tegmental nucleus, which then sends an inhibitory projection to the VTA (Balcita-Pedicino et al., 2011; Hong et al., 2011). Nevertheless, the functional relationship between the LHb and BRS can be modeled as a circuit of reciprocal inhibition. Based on other models of reciprocal inhibition between other neuronal populations (e.g., Mysore and Knudsen, 2012), we suggest that LHb activity is a negative sigmoid function of BRS activation in response to reinforcing events (Figure 1). BRS activity could likewise be graphed as a negative sigmoid of LHb activity in response to punishing events. A simple linear function would be unsuitable because it does not capture that there are maximum and minimum limits on the brain's activity, nor does it capture the bidirectional nature of the relationship between the LHb and BRS.
Figure 1. Theoretical model of the functional opposition between lateral habenula (LHb) energy metabolism and the brain reward system (BRS). In the model, LHb metabolism (Y-axis) may oscillate between a neutral baseline (0) to maximal metabolism (+1) and minimal metabolism (−1). The X-axis represents BRS inhibition or activation in response to an emotional event that ranges from −1, the maximum negative reward/punishment (withdrawal of pleasant stimulus or infliction of unpleasant stimulus) to +1, the maximum reward/negative reinforcement (delivery of pleasant stimulus or withdrawal of unpleasant stimulus). Note that the choice of axes is arbitrary in terms of independent and dependent variables; in reality, the BRS and LHb are mutually interdependent. Differences in reinforcement sensitivity are represented by three separate curves (normal, low, and anhedonic) defined by the function where A is the preexisting affective state, E is an emotional event represented on the X-axis, and B is the degree of bistability (the steepness of the transition between high and low energetic states), held constant here at an arbitrary value of 50. The model captures the dramatic, bimodal shifts in LHb metabolism that have been empirically observed in response to manipulating the brain reward system (BRS) in “euthymic” animals with normal reward sensitivity (A = 0). High energy states of the LHb (positive values on Y-axis) are presumed to inhibit the BRS, and low energy states (negative values on Y-axis) are presumed to disinhibit it. The model predicts that increasing levels of depressive predisposition × environmental stress (negative affect, A < 0) are reflected by increasing rightward shifts in the reinforcement-response curves such that increasing levels of reinforcement frequency or intensity are needed to bring the LHb into a low energy state until eventually a state of anhedonia is reached in which no amount of reinforcement is sufficient. The model predicts that differences in LHb function between depressives and healthy controls are more likely to be revealed under conditions of rewarding feedback (diverging curves on right side of graph) than under punitive feedback (converging curves on left side of graph).
Specifically, the function is sigmoid because when LHb neurons are activated during the prediction of a negative event, they inhibit the BRS and thereby disinhibit their own activity until they approach asymptotic levels of activation. Similarly, when BRS neurons are activated during the prediction of a positive event, they inhibit the LHb and thereby disinhibit their own activity until they approach asymptotic levels of activation. This would result in a tendency for the LHb and BRS to “switch” between bistable states whenever one component is perturbed by external stimulation, i.e., rewarding or punishing events. Thus, in terms of energy metabolism, a well-functioning LHb should be able to fluctuate between high and low energetic extremes, which might account for the large spontaneous variability (Gonzalez-Lima and Scheich, 1986) and the dramatic shifts in LHb metabolism relative to other brain regions that have been reported across multiple metabolic mapping studies (e.g., Gomita and Gallistel, 1982; Shumake et al., 2003).
What would happen if the LHb lost its capacity to dynamically shift its activational state in response to environmental changes? What if it became “stuck” in either a low or high energetic state? If the LHb were stuck in a low energetic state, the BRS would no longer be constrained by negative feedback. This could result in the auto-reinforcement of inappropriate behaviors and ideas that would normally be inhibited and discounted, possibly leading to disinhibition and delusions. Consistent with this conjecture, low LHb activity has been linked with schizophrenia (Lecourtier et al., 2004; Shepard et al., 2006). If the LHb were stuck in a high energetic state, the BRS would be indiscriminately constrained. This could result in the inappropriate discounting of events that would normally be regarded as reinforcing, with a consequential tendency toward apathy and anergia. Consistent with this conjecture, high LHb activity has been linked with depression (Morris et al., 1999; Roiser et al., 2009).
Origins and Consequences of Persistently High LHb Activity
Our own work suggests that persistently high LHb activity can be a consequence of genetic predisposition. Rats selectively bred for vulnerability to learned helplessness showed a striking baseline elevation of LHb metabolism compared to rats bred for resilience to learned helplessness, coincident with metabolic decreases throughout the BRS (Shumake et al., 2003). While learned helplessness results in a syndrome of behaviors resembling depression (Seligman, 1975), learned helplessness at its core represents a failure to detect a negative reinforcement contingency that would enable an organism to escape or avoid a stressor. Thus, we hypothesized that the association between greater LHb metabolism and vulnerability to learned helplessness exists because, if the LHb is stuck in a high energetic state, the response of the BRS to reinforcing events is chronically inhibited. This includes negative reinforcing events, such as terminating a foot shock, which activate the BRS in much the same way as positive reinforcing events (for review, see Ilango et al., 2012). Decreased salience of reinforcing events would impair the detection of stimulus-response contingences and lead to deficits in reinforcement learning.
We tested this hypothesis by implanting electrodes into the LHb and stimulating animals as they underwent training in a two-way active avoidance task (Shumake et al., 2010). Timing of LHb stimulation was coincident with and limited to the occurrence of each negative reinforcement event (in this case, crossing a hurdle to avoid a foot shock). As a consequence, learning of the avoidance response was impaired, demonstrating that inappropriate activity of the LHb during negative reinforcement can interfere with the acquisition of stimulus-response associations. Interestingly, this manipulation leads to a sustained deficit in avoidance responding that persists even after LHb stimulation is discontinued. Specifically, when five days of training are given with LHb stimulation, no behavioral improvement is seen after an additional five days of training without LHb stimulation (Shumake et al., 2010; Ilango et al., 2013). This suggests that repeated, sustained activation of the LHb not only serves to interrupt the concurrent behavior, but also serves to suppress future occurrences of the behavior. Similar effects of cumulative LHb stimulation on the suppression of positively reinforced eye saccades have also been reported (Matsumoto and Hikosaka, 2011).
Hypothetically, a cumulative function of LHb activations would have informative value across most motivated learning tasks in which the LHb is metabolically excited by failure and inhibited by success. For example, when learning a new task, intermittent failures provide information that, although improvement is needed, one is generally on the right track. However, repeated failures indicate that one is on the wrong track and that a more radical shift in strategy may be required. In this case, it would be adaptive for the LHb to have a mechanism by which it not only responds to immediate failure but also accumulates past failures. At some critical threshold of accumulated failure/frustration, we hypothesize that LHb activation becomes self-sustaining, providing a neural “give up” signal.
In normal circumstances, this signal should be temporary and adaptive. Abandoning an unsuccessful strategy makes way for learning a successful one, and, even if it doesn't, a variety of other reinforcing experiences in daily life should insure that the LHb does not become stuck in a high-activation state because of failure to obtain reinforcement in any one domain. However, for laboratory animals that are deprived of experiences of reinforcement outside of the experimental task, or for humans whose lives are dominated by chronic, unmanageable stress, repeated failure may result in “runaway” activation of the LHb that persists across situations and leads to symptoms of depression.
In summary, we hypothesize that the LHb is capable of entering into a self-sustaining high energetic state, which is reflected by large elevations in LHb resting metabolic activity. Laboratory experiments show that such elevations can be caused by genetics (Shumake et al., 2003) or by adverse environments (Caldecott-Hazard et al., 1988), but their ecological occurrence is likely a product of a gene × environment interaction. An individual born with the endophenotype of a highly energetic LHb should show relatively high sensitivity to punishment and relatively low sensitivity to reward. Over time, this could develop into an attentional bias toward negative stimuli and away from positive stimuli, a hallmark of the depressive phenotype (Disner et al., 2011).
However, endogenous inhibition of the BRS by the LHb is likely not absolute; rather, a hyperactive LHb is expected to raise the threshold for what is considered rewarding, such that only intense rewarding stimuli are capable of “flipping” the LHb-BRS metabolic “switch.” In the absence of adverse life events, this could manifest as a sensation-seeking personality, with the individual driven to pursue forms of reinforcement capable of overcoming LHb hyperinhibition, such as the intense positive reinforcement of using recreational drugs or the intense negative reinforcement of escaping from life-threatening situations. However, in the presence of adverse life events, LHb activity could be potentiated to such an extreme that no source of reinforcement is capable of overcoming its inertia, at which point the person enters a state of anhedonic withdrawal. There is indirect evidence to support this prediction: rats predisposed to helplessness in response to the severe stress of repeated foot shocks show baseline LHb hyperactivity (Shumake et al., 2003). However, before they are exposed to severe stress, these rats show increased risk-taking behavior and locomotor activation in response to novel environments (Shumake et al., 2005; Padilla et al., 2010), behaviors which are consistently linked to greater self-administration of DA drugs (Kabbaj et al., 2000).
Conclusion: LHb Metabolism as an Inverse Barometer of Reinforcement Sensitivity
The above scenario outlines one endophenotype that confers risk for depression; there are likely many others. The endophenotype we are describing is one of brief switches into an elevated mood state, but dominated by more protracted depressive states. In terms of clinical typology, this resembles bipolar II disorder, which may be the patient population most likely to show LHb effects. Supporting this, volumetric differences in the habenula are specifically associated with bipolar depression (Savitz et al., 2011). We have demonstrated how this endophenotype can be reduced to the dynamics of the LHb and its interactions with the BRS, but this should not be taken as an argument that the LHb is the only, or even the primary, locus of neuropathology. Rather, our argument is that baseline LHb hypermetabolism is a prominent neural sign of reinforcement insensitivity. The precise cellular-molecular causes of LHb hyperactivity could be distributed anywhere within the circuit (e.g., localized to the LHb itself, the regions from which it receives input, or in its projections to the midbrain). For example, potentiation of excitatory synapses onto LHb neurons projecting to the VTA (Li et al., 2011) provides one such cellular-molecular mechanism, but it is conceivable that the system could break down at other points in different individuals. Regardless, at the circuit level, LHb metabolism emerges as a common endpoint offering an index of trait reinforcement sensitivity and a potential therapeutic target for enhancing reinforcement sensitivity for patients in an anhedonic state.
References
Balcita-Pedicino, J. J., Omelchenko, N., Bell, R., and Sesack, S. R. (2011). The inhibitory influence of the lateral habenula on midbrain dopamine cells: ultrastructural evidence for indirect mediation via the rostromedial mesopontine tegmental nucleus. J. Comp. Neurol. 519, 1143–1164. doi: 10.1002/cne.22561
Caldecott-Hazard, S., Mazziotta, J., and Phelps, M. (1988). Cerebral correlates of depressed behavior in rats, visualized using 14C-2-deoxyglucose autoradiography. J. Neurosci. 8, 1951–1961.
Disner, S. G., Beevers, C. G., Haigh, E. A. P., and Beck, A. T. (2011). Neural mechanisms of the cognitive model of depression. Nat. Rev. Neurosci. 12, 467–477. doi: 10.1038/nrn3027
Gallistel, C. R., Gomita, Y., Yadin, E., and Campbell, K. A. (1985). Forebrain origins and terminations of the medial forebrain bundle metabolically activated by rewarding stimulation or by reward-blocking doses of pimozide. J. Neurosci. 5, 1246–1261.
Gomita, Y., and Gallistel, C. R. (1982). Effects of reinforcement-blocking doses of pimozide on neural systems driven by rewarding stimulation of the MFB: a 14C-2-deoxyglucose analysis. Pharmacol. Biochem. Behav. 17, 841–845. doi: 10.1016/0091-3057(82)90369-0
Gonzalez-Lima, F., and Scheich, H. (1986). Classical conditioning of tone-signaled bradycardia modifies 2-deoxyglucose uptake patterns in cortex, thalamus, habenula, caudate-putamen and hippocampal formation. Brain Res. 363, 239–256. doi: 10.1016/0006-8993(86)91009-7
Hong, S., Jhou, T. C., Smith, M., Saleem, K. S., and Hikosaka, O. (2011). Negative reward signals from the lateral habenula to dopamine neurons are mediated by rostromedial tegmental nucleus in primates. J. Neurosci. 31, 11457–11471. doi: 10.1523/JNEUROSCI.1384-11.2011
Ilango, A., Shumake, J., Wetzel, W., Scheich, H., and Ohl, F. W. (2012). The role of dopamine in the context of aversive stimuli with particular reference to acoustically signaled avoidance learning. Front. Neurosci. 6:132. doi: 10.3389/fnins.2012.00132
Ilango, A., Shumake, J., Wetzel, W., Scheich, H., and Ohl, F. W. (2013). Electrical stimulation of lateral habenula during learning: frequency-dependent effects on acquisition but not retrieval of a two-way active avoidance response. PLoS ONE 8:e65684. doi: 10.1371/journal.pone.0065684
Kabbaj, M., Devine, D. P., Savage, V. R., and Akil, H. (2000). Neurobiological correlates of individual differences in novelty-seeking behavior in the rat: differential expression of stress-related molecules. J. Neurosci. 20, 6983–6988.
Lecourtier, L., Neijt, H. C., and Kelly, P. H. (2004). Habenula lesions cause impaired cognitive performance in rats: implications for schizophrenia. Eur. J. Neurosci. 19, 2551–2560. doi: 10.1111/j.0953-816X.2004.03356.x
Li, B., Piriz, J., Mirrione, M., Chung, C., Proulx, C. D., Schulz, D., et al. (2011). Synaptic potentiation onto habenula neurons in the learned helplessness model of depression. Nature 470, 535–539. doi: 10.1038/nature09742
Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111–1115. doi: 10.1038/nature05860
Matsumoto, M., and Hikosaka, O. (2011). Electrical stimulation of the primate lateral habenula suppresses saccadic eye movement through a learning mechanism. PLoS ONE 6:e26701. doi: 10.1371/journal.pone.0026701
McCulloch, J., Savaki, H. E., and Sokoloff, L. (1980). Influence of dopaminergic systems on the lateral habenular nucleus of the rat. Brain Res. 194, 117–124. doi: 10.1016/0006-8993(80)91322-0
Morris, J. S., Smith, K. A., Cowen, P. J., Friston, K. J., and Dolan, R. J. (1999). Covariation of activity in habenula and dorsal raphe nuclei following tryptophan depletion. Neuroimage 10, 163–172. doi: 10.1006/nimg.1999.0455
Mysore, S. P., and Knudsen, E. I. (2012). Reciprocal inhibition of inhibition: a circuit motif for flexible categorization in stimulus selection. Neuron 73, 193–205. doi: 10.1016/j.neuron.2011.10.037
Padilla, E., Shumake, J., Barrett, D. W., Holmes, G., Sheridan, E. C., and Gonzalez-Lima, F. (2010). Novelty-evoked activity in open field predicts susceptibility to helpless behavior. Physiol. Behav. 101, 746–754. doi: 10.1016/j.physbeh.2010.08.017
Porrino, L. J., Domer, F. R., Crane, A. M., and Sokoloff, L. (1988). Selective alterations in cerebral metabolism within the mesocorticolimbic dopaminergic system produced by acute cocaine administration in rats. Neuropsychopharmacology 1, 109–118. doi: 10.1016/0893-133X(88)90002-4
Porrino, L. J., and Lucignani, G. (1987). Different patterns of local brain energy metabolism associated with high and low doses of methylphenidate. Relevance to its action in hyperactive children. Biol. Psychiatry 22, 126–138. doi: 10.1016/0006-3223(87)90223-X
Ramm, P., Beninger, R. J., and Frost, B. J. (1984). Functional activity in the lateral habenular and dorsal raphe nuclei following administration of several dopamine receptor antagonists. Can. J. Physiol. Pharmacol. 62, 1530–1533. doi: 10.1139/y84-253
Roiser, J. P., Levy, J., Fromm, S. J., Nugent, A. C., Talagala, S. L., Hasler, G., et al. (2009). The effects of tryptophan depletion on neural responses to emotional words in remitted depression. Biol. Psychiatry 66, 441–450. doi: 10.1016/j.biopsych.2009.05.002
Savitz, J. B., Nugent, A. C., Bogers, W., Roiser, J. P., Bain, E. E., Neumeister, A., et al. (2011). Habenula volume in bipolar disorder and major depressive disorder: a high-resolution magnetic resonance imaging study. Biol. Psychiatry 69, 336–343. doi: 10.1016/j.biopsych.2010.09.027
Seligman, M. E. P. (1975). Helplessness: on Depression, Development, and Death. San Francisco, CA: W.H. Freeman and Company.
Shepard, P. D., Holcomb, H. H., and Gold, J. M. (2006). The presence of absence: habenular regulation of dopamine neurons and the encoding of negative outcomes. Schizophr. Bull. 32, 417–421. doi: 10.1093/schbul/sbj083
Shumake, J., Barrett, D., and Gonzalez-Lima, F. (2005). Behavioral characteristics of rats predisposed to learned helplessness: reduced reward sensitivity, increased novelty seeking, and persistent fear memories. Behav. Brain Res. 164, 222–230. doi: 10.1016/j.bbr.2005.06.016
Shumake, J., Edwards, E., and Gonzalez-Lima, F. (2003). Opposite metabolic changes in the habenula and ventral tegmental area of a genetic model of helpless behavior. Brain Res. 963, 274–281. doi: 10.1016/S0006-8993(02)04048-9
Shumake, J., and Gonzalez-Lima, F. (2003). Brain systems underlying susceptibility to helplessness and depression. Behav. Cogn. Neurosci. Rev. 2, 198–221. doi: 10.1177/1534582303259057
Shumake, J., Ilango, A., Scheich, H., Wetzel, W., and Ohl, F. W. (2010). Differential neuromodulation of acquisition and retrieval of avoidance learning by the lateral habenula and ventral tegmental area. J. Neurosci. 30, 5876–5883. doi: 10.1523/JNEUROSCI.3604-09.2010
Keywords: habenula, reward, brain metabolism, depression, emotion
Citation: Shumake J and Gonzalez-Lima F (2013) Functional opposition between habenula metabolism and the brain reward system. Front. Hum. Neurosci. 7:662. doi: 10.3389/fnhum.2013.00662
Received: 16 August 2013; Accepted: 23 September 2013;
Published online: 10 October 2013.
Edited by:
Ramiro Salas, Baylor College of Medicine, USAReviewed by:
Markus Ullsperger, Max Planck Institute for Neurological Research, GermanyJaime S. Ide, Yale University, USA
Copyright © 2013 Shumake and Gonzalez-Lima. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: gonzalezlima@utexas.edu