Abstract
Motivation is a key neurobehavioral concept underlying adaptive responses to environmental incentives and threats. As such, dysregulation of motivational processes may be critical in the formation of abnormal behavioral patterns/tendencies. According to the long standing model of the Reinforcement Sensitivity Theory (RST), motivation behaviors are driven by three neurobehavioral systems mediating the sensitivity to punishment, reward or goal-conflict. Corresponding to current neurobehavioral theories in psychiatry, this theory links abnormal motivational drives to abnormal behavior; viewing depression and mania as two abnormal extremes of reward driven processes leading to either under or over approach tendencies, respectively. We revisit the RST framework in the context of bipolar disorder (BD) and challenge this concept by suggesting that dysregulated interactions of both punishment and reward related processes better account for the psychological and neural abnormalities observed in BD. We further present an integrative model positing that the three parallel motivation systems currently proposed by the RST model, can be viewed as subsystems in a large-scale neurobehavioral network of motivational decision making.
The term motivation as used in neuroscience refers to the processes which modulate the organism’s responses to environmental reinforcing cues, according to their perceived value (i.e., reward/punishment) (Smillie, 2008). As it is a major determinant of adaptive goal-directed behavior, it may be useful to look at human psychopathological conditions in terms of aberrant neuro-behavioral functioning of motivational processes. Accordingly, in this perspective paper we revisit a long-standing framework stemmed from rodent research, the Reinforcement Sensitivity Theory (RST; Gray, 1982), which defines sensitivity to reward and punishment as the main underlying forces of goal-directed behavior. Specifically, we inspect the neural organization proposed by the RST with respect to its possible involvement in a specific mood dysregulation condition- Bipolar Disorder (BD). We briefly review previous attempts to formulate a conceptual model linking motivation-related abnormalities and BD, and suggest an alternative perspective regarding the compound interactions between the different neural systems underlying motivational processes.
Motivation systems and their relevance to affective disorders
The basic concept regarding the consequential effects of stimuli on behavior, depending on their incentive values for the organism (reward or punishment) originated with the seminal work of Pavlov (Pavlov, 1927). Essentially, animals tend to approach rewarding and avoid punishing cues, creating the idea of sensitivity to reward and punishment as the main underlying forces of goal-oriented behavior (Corr and Perkins, 2006). Following this view the RST (Gray, 1982) assigned theses sensitivities to three specific neural systems mediating different motivational processes: (1) The “Fight, Flight, Freeze System” (FFFS), sensitive to punishment stimuli and facilitates behavioral responses via activation of the periaquaductal Gray (PAG), medial hypothalamus, central amygdala, and subgenual anterior cingulate cortex (sgACC); (2) The “Behavioral Activation System” (BAS), sensitive to reward stimuli and facilitates behavioral responses via the ventral tegmental area (VTA), nucleus accumbens (NAcc) and dorsomedial prefrontal cortex (dmPFC); and (3) The “Behavioral Inhibition System” (BIS), sensitive to goal-conflict situations (i.e., stimuli of mixed value) and thus triggered when the other two systems are simultaneously activated, relying mainly on the septo-hippocampal system (SHS) and the ventromedial prefrontal cortex (vmPFC) recursive circuit, along with the Anterior Cingulate Cortex (ACC) and entorhinal cortex (Gray and McNaughton, 2000). Figure 1 depicts the detailed neuroanatomy of these systems. Research on the neural dynamics and interactions of these proposed motivation systems has been mainly carried out in animals (rodents), with translation of the experimental paradigms to the complexity of human behavior somewhat lacking (Avila et al., 2008; Barrós-Loscertales et al., 2010; Costumero et al., 2013). With this in mind, in a recent fMRI study we used an interactive computer game and Dynamic Causal Model analysis to demonstrate the effective connectivity and stimulus specificity in similar neural networks in humans as described in the RST model (Gonen et al., 2012). This finding has encouraged us to revisit RST in light of current evidence on the relevance of motivation systems to psychopathology.
Figure 1
The relevance of motivation systems to abnormal mood conditions is supported by recent studies focusing mainly on reward processing. This has reflected developments in the investigation of the neural underpinnings of reward processes in terms of their neurochemistry (Berridge and Kringelbach, 2013) and mechanistic circuitry (Haber and Knutson, 2009; Miller et al., 2013). Furthermore, various aspects of motivation induced behaviors, such as reward learning (Pizzagalli et al., 2008; Dayan and Berridge, 2014), reward prediction (Dowd and Barch, 2012) or aversion processing (Hayes and Northoff, 2011) were proposed as related to psychopathological conditions (Phillips and Swartz, 2014). For example, altered effort-based motivational decision making has been demonstrated in Major Depressive Disorder (MDD) patients, who were not only willing to devote less effort for rewards than healthy controls, but were also less efficient in using information regarding the magnitude and probability of the rewards to guide effort based motivational decision making (Treadway et al., 2012). Such effort based decision making has been shown to rely on striatal dopamine transmission (Salamone and Correa, 2012) and its interaction with Ach muscarinic function, mostly in the NAcc core (Nunes et al., 2013). These findings have led to the idea that poor DA-ACh regulation within the NAcc may underlie common depressive symptoms such as anhedonia, fatigue or psychomotor slowness (Treadway and Zald, 2011). In the framework of the RST, these recent mechanistic evidence may provide new neurobiological support for involvement of the BAS in pathological affective states, since NAcc is a core region of this system. The contribution of abnormal motivational processes to human psychopathology in terms of the RST model has been formulated by two central models thus far. The first and most prominent is the “Neuropsychology Theory of Anxiety” (Gray and McNaughton, 2000), and the second is the “BAS Dysregulation Theory” (Depue and Iacono, 1989; Johnson et al., 2012). The first model posits that hyperactive nodes of FFFS, as well as BIS underlie different anxiety disorders (e.g., generalized anxiety, phobias etc.). A thorough discussion of the relation of RST to anxiety disorders is beyond the scope of this paper and can be found elsewhere (McNaughton and Corr, 2008). In the following section we will re-visit the BAS dysregulation theory and its limitations in thoroughly elucidating the underlying neural pathology in BD.
Revisiting RST in the context of BD: dysregulated motivation processing
The “BAS Dysregulation Theory” suggests that it is BAS hyper- or hypo-activation that underlies BD manic or depressive states, respectively. Indeed, the model seems compatible with the nature of the symptoms often observed in BD patients. For example, decreased energy in depression or increased engagement in goal-directed activities in mania, support the consideration of motivational abnormalities when modeling these illnesses. Therefore, it seems quite straightforward that extreme over- and/or under- sensitivity to reward (manifested as over and under activation of the BAS) underlies mania or depression, respectively. Accordingly, numerous self-report studies using RST based questionnaires have shown higher BAS sensitivity in bipolar patients (Salavert et al., 2007) and also found it to be related to vulnerability to manic episodes (Meyer et al., 2007; Alloy et al., 2008). However, some have found relation of BIS sensitivity (measured by the self-report BIS/BAS scales) to depressive symptoms. For example, in a longitudinal study, within-patient fluctuations in depressive symptoms were correlated to changes in BIS levels (Meyer et al., 2001). Highly sensitive BIS was found related to proneness to- or concurrent depressive symptoms as well (Alloy et al., 2006). This inspires a reconsideration of the RST relevance to BD in a broader perspective of two processes, reward and punishment dysregulation.
In this context we suggest that dysregulation of the BIS system may result in insensitivity to costs and efforts, a symptomatic phenomenology of the manic state in BD. Recent evidence considering the inter-regional regulation of effort based behavioral choice via NAcc and ACC may support this notion. The ACC has been implicated in evaluating the costs and benefits and comparing between current and future costs /benefits of optional behavioral plans (Phillips and Vieta, 2007). Of note, the ACC has been shown to be involved in effort based decision processs only in cases where there were more than one potential reward (Schweimer et al., 2005), supporting its role in the RST’s BIS as evaluating optional behavioral plans under a goal conflict. However, while the RST postulated that motivational behavioral decisions are guided by the septo-hippocampal-vmPFC recursive signaling, with the ACC signaling information to the hippocampus; more recent models show in addition direct connections from the ACC to the NAC (Knutson and Gibbs, 2007; Phillips and Vieta, 2007). Lesions to the ACC or its afferent connections with NAcc have been shown to diminish the effort an animal is willing to invest in a reward (Schweimer et al., 2005; Phillips et al., 2007; Treadway and Zald, 2011).
Taken together, we feel that the BAS dysregulation model does not adequately capture the complex dysfunction of motivational processes in BD and that a conceptual revision is needed to better account for both phenomenological and neuroscientific observations in BD. Our premise echoes recent advances in neuroscientific research which repeatedly point to large-scale neural networks, rather than localized regions, as the underpinnings of cognitive and emotional processes (e.g., Bressler and Menon, 2010). We propose to regard the three motivational RST systems as functionally specialized subsystems of one larger system, interacting together in order to mediate motivational behavior. Thus, ineffective compound interactions between the three subsystems, rather than one subsystem’s abnormal activity, may underlie the different abnormal behaviors in mood disorders such as BD (see Figure 2). To establish this view, the following sections present a conceptual framework alongside supporting evidence from structural as well as functional neuroanatomical studies.
Figure 2
Evidence for abnormal RST processes in BD
Cognitive-behavioral findings
The clinical presentation of the manic state includes by definition, among other symptoms, an increase in goal-directed activity and excessive indulgence in pleasurable activities that have an increased potential for painful consequences; whereas depression is characterized by symptoms including anhedonia and fatigue or loss of energy. It is thus rather intuitive that extreme over- and/or under- reactivity of the BAS may underlie mania or depression, respectively, as suggested by the “BAS dysregulation theory” (Depue and Iacono, 1989; Johnson et al., 2012). However, there seems to be an important role for abnormal punishment sensitivity as well. Manic patients lack accurate perception of possible aversive consequences of their behaviors, especially the concept of punishment and its related results (Diekhof et al., 2008), leading to damaging interactions or consequences (Malhi et al., 2004a). Manic patients have also been shown to display positive cognitive bias (e.g., remembering more positive self-descriptive words than healthy controls (Pavlickova et al., 2013)). Nevertheless their behavior seems to be guided more by sensitivity to potential rewards than by avoiding dangers (Swann et al., 2004). We suggest that this complex positive cognitive-behavioral bias may reflect impaired generation, or resolution, of goal-conflict processes, which according to RST depends on normal activation of the BIS. Thus, in the search for the motivational processes underlying the manic state, BIS dysregulation should also be considered (as demonstrated in Figure 2B).
A parallel argument applies to the depressive state in BD patients in whom lack of incentive motivation is a prominent feature: depressed BD patients exhibit decreased reward seeking behavior and a reduced ability to experience reward, even in the absence of acute stressors, resulting in dominance of persistent dysphoric emotions and thoughts (Drevets, 2001), together corresponding to a hypoactive BAS. Other characteristics of the depressive state, such as the well-established negative cognitive bias, may hint at the involvement of a dysregulated FFFS/BIS (Leppänen, 2006; Haas and Canli, 2008; Zinbarg and Yoon, 2008; Figure 2C). Altogether it seems that one RST system’s abnormality is not sufficient to account for the complex behavioral abnormalities observed in BD. Rather, imbalanced interactions of both BAS and FFFS/BIS, resulting from over/under activation of one or both systems or from abnormal inter-system connectivity, can account for what seems to be both incentive and regulatory dysfunction. From this perspective, mania and depression can be viewed as two separate entities, rather than opposite ends of the same continuum along the BAS axis, a view that may also better account for their co-occurrence during mixed episodes (i.e., simultaneous episodes of mania and depression) (Cuellar et al., 2005).
Brain imaging findings
Considerable evidence from morphometric MRI and post-mortem histological studies in BD patients demonstrate abnormalities in brain structures related to the three RST systems, thereby supporting the involvement of multiple dysregulated motivation systems and our integrative model (Diekhof et al., 2008; Savitz and Drevets, 2009). For example, the common finding of reduced gray matter volumes of the ACC (Phillips and Vieta, 2007; Strakowski et al., 2012) is compatible with disrupted function within a major BIS area. To note, these abnormalities have mostly been described in the sub-genual ACC, which is regarded as a central node of the FFFS (Pearlson, 1999; Fountoulakis, 2008; Sanches et al., 2008). In a similar manner, reduced gray matter volumes have been found in BD in several prefrontal cortices (PFC), spanning more than one motivation subsystem, including ventro-medial PFC for BIS (Doris et al., 2004; Lyoo et al., 2004), dorso-medial PFC for BAS (Locke and Braver, 2008) and Orbito Frontal Cortex (OFC; Haznedar et al., 2005; Lyoo et al., 2006), a region which some relate to BAS (Depue and Collins, 1999). Interestingly, Diffusion Tensor Imaging (DTI) analysis further demonstrated reduced integrity of white matter tracts in OFC (Beyer et al., 2005). Although the inter-segregation of the PFC is somewhat simplistic, given the multiple different processes these regions are involved in, these findings suggest possible deficits in PFC regulation and control functions affecting both BAS and BIS. To sum up the structural findings in the PFC—abnormalities were found in the sgACC related to the FFFS, the dmPFC and OFC related to BAS and in the vmPFC and ACC related to BIS.
Structural variations in amygdala and hippocampal volume are also common in BD (Strakowski et al., 2012; Phillips and Swartz, 2014), suggesting the involvement of BAS, FFFS and BIS. Yet, results in these regions vary with respect to the type of abnormality (e.g., Pearlson et al., 1997; Altshuler et al., 1998), possibly due to inter-study variations in medication regimes and comorbidities.
Several functional imaging studies using functional MRI (fMRI) indicate combined system involvement in BD (see summary in Table 1). Together these finding suggest two patterns of RST activations depending on BD states: hyperactivation of BAS along with hypoactivation in the FFFS/BIS in mania and vice versa depression.
Table 1
| RST systems | State | Paradigm/Stimuli | Activation/Regions | Reference |
|---|---|---|---|---|
| FFFS | Manic | Emotional inhibition control | Hypo: sgACC | Elliott et al. (2004) |
| Depressive | Affective generation (positive and negative) | Hyper: sgACC | Malhi et al. (2004b) | |
| BAS | Manic | Rewarding, positive | Hyper: NAcc, caudate nucleus, OFC, dmPFC, amygdala | Yurgelun-Todd et al. (2000), Elliott et al. (2004), Lawrence et al. (2004), Altshuler et al. (2005), Chen et al. (2006), Wessa et al. (2007), Killgore et al. (2008), Bermpohl et al. (2010) |
| BIS | Manic | Emotional inhibition control | Hypo: vmPFC | Elliott et al. (2004) |
| Depressive | Affective generation (positive and negative). Reward anticipation | Hyper: Parahippocampal gyrus | Malhi et al. (2004b), Deckersbach et al. (2008), Knutson et al. (2008) |
Evidence from functional imaging studies.
This pattern has been convincingly demonstrated in the study by Blumberg et al. (2003) who investigated three BD patient groups: hypomanic, euthymic and depressed, while performing a Stroop task. Intriguingly, the hypomanic group showed decreased activity in the sgACC compared to the euthymic group, contrary to depressed patients who showed increased sgACC activity compared with the euthymic group, suggesting that FFFS, a punishment sensitive system, is under-activated in the manic state and over-activated in depression. In addition, the depressed group showed decreased dorsal and increased ventral activity in mPFC but the hypomanic group showed increased dorsal and decreased ventral activity in mPFC. These findings are compatible with decreased BAS and increased BIS activity in depression and vice versa in the manic state. This study thus points to deficits in prefrontal signaling in BD, possibly resulting from reduced FFFS-related punishment alerts, coupled with a diminished regulatory control of the BIS in manic state and vice versa in the depressed state. Further supporting this view is evidence from Positron Emission Tomography (PET) studies, showing increased sgACC, ACC and hippocampal metabolism in depressed BD patients during the resting state (Bauer et al., 2005; Mah et al., 2007).
Altogether, imaging findings strongly support our proposal for the involvement of several RST systems in BD, suggesting that rather than a deficit in BAS alone, the coupled interaction of BAS with BIS/FFFS is impaired (Figure 2). To note, this systems imbalance shows opposite directions for manic vs. depressed states, which may reflect a more general rule for explaining swings in mood states in other psychiatric conditions such as personality disorders.
Discussion
We argue here for considering abnormal motivational processes in the pathophysiological study of mental illnesses, driven by neural system sensitive to reward, punishment or their regulation during goal-conflict. Based on a theoretical framework and converging empirical evidence, we suggest that although the BAS dysregulation theory has indeed provided a parsimonious and intuitive model for the involvement of motivational processes in BD, a conceptual revision is needed to further adapt these insights to the complexity of human psychopathology. Our new model maintains that since combined activity of the three motivation systems is responsible for the varied encounters with the external environment, BD is probably underpinned by compound motivational abnormalities: depression involves a hyperactive BIS and a hypoactive BAS, while mania results from a hyperactive BAS coupled with a hypoactive BIS (as illustrated in Figure 2). Notably, while it is possible that abnormal activity in BIS stems entirely from primary system abnormalities, deficits in FFFS activation may also be a contributing factor.
Thinking along this theoretical framework may provide useful insights into other psychiatric disorders as well. For example, similar abnormalities in motivation may also exist in unipolar depression MDD (Kasch et al., 2002; Kircanski et al., 2013), as was previously suggested (Eshel and Roiser, 2010).
Such a complex large-scale network model has recently become a common conceptual framework in neuroscientific research (Bressler and Menon, 2010) and especially with regard to emotional processing (Raz et al., 2012). Recent findings indeed point to abnormalities in large-scale network configuration in various psychopathologic states (e.g., Bassett and Bullmore, 2009), as we have recently discussed for the case of OCD (Hendler et al., 2014). By delineating the neurobiological underpinnings of basic psychological processes such as motivation and their dysfunction, this mechanistic approach may offer substantial progress in understanding the clinical presentation of mental illnesses and in treating them. This idea echoes the growing interest in the new approach termed Research Domain Criteria (RDoC; Sanislow et al., 2010) advanced by the NIMH, which aims to classify mental disorders based on dimensions of observable behavior and neurobiological measures. Indeed, within the framework of this approach motivational mechanisms were formulated into two RDoC domains: the “positive valence system” domain is related to approach motivation and reward processing, whereas the “negative valence system” domain is related to threat, loss and frustrative non-reward processing. The centrality of motivational processes in normal behavior attests to their probable involvement in pathological behavior as well. Inversely, looking at the complex abnormalities in motivation systems in human psychopathology may help determine the relations between these different constructs of motivation in normal behavior. Similar to studies in classic “lesion-neurology”, which advanced our understanding of normal brain function by exploring patients with focal brain lesions, the study of abnormalities of motivation as expressed across a range of pathological mental states may yield a deeper understanding of this primal yet complex neurobehavioral process.
To further investigate the core features of our model, such as dysfunction within and between motivational networks, future studies may explore the dynamics in functional-connectivity of the different systems’ key nodes using, for example, the network cohesion index (NCI; Raz et al., 2012), to reveal their ongoing interactions throughout performance in motivational tasks. Additionally, DTI studies may add the structural substrate to FC analyses in this effort. A causal role for different motivational circuits may also be demonstrated using interventional approaches. Recent developments in neurofeedback-based Brain Computer Interface (NF-BCI) using EEG and real-time fMRI methods aimed at modulating the activity in major nodes of different motivational systems may offer unique opportunities to track and validate the role of brain abnormalities in BD (Keedwell and Linden, 2013). Assessing the clinical efficacy of modulating a single vs. multiple motivation systems would further help to elucidate the underlying pathophysiology, and thus, may provide evidence regarding the suggested integrated model of motivational processes in the healthy brain as well.
Statements
Acknowledgments
We thank Eyal Soreq for his substantial help with the graphical artwork in this paper.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AlloyL. B.AbramsonL. Y.WalshawP. D.CogswellA.GrandinL. D.HughesM. E.et al. (2008). Behavioral approach system and behavioral inhibition system sensitivities and bipolar spectrum disorders: prospective prediction of bipolar mood episodes. Bipolar Disorder.10, 310–322. 10.1111/j.1399-5618.2007.00547.x
2
AlloyL. B.AbramsonL. Y.WalshawP. D.CogswellA.SmithJ. M.NeerenA. M.et al. (2006). Behavioral approach system (BAS) sensitivity and bipolar spectrum disorders: a retrospective and concurrent behavioral high-risk design. Motiv. Emot.30, 143–155. 10.1007/s11031-006-9003-3
3
AltshulerL.BartzokisG.GriederT.CurranJ.MintzJ. (1998). Amygdala enlargement in bipolar disorder and hippocampal reduction in schizophrenia: an MRI study demonstrating neuroanatomic specificity. Arch. Gen. Psychiatry55, 663–664.
4
AltshulerL.BookheimerS.ProenzaM. A.TownsendJ.SabbF.FirestineA.et al. (2005). Increased amygdala activation during mania: a functional magnetic resonance imaging study. Am. J. Psychiatry162, 1211–1213. 10.1176/appi.ajp.162.6.1211
5
AvilaC.ParcetM. A.Barrós-LoscertalesA. (2008). A cognitive neuroscience approach to individual differences in sensitivity to reward. Neurotox. Res.14, 191–203. 10.1007/bf03033810
6
Barrós-LoscertalesA.Ventura-CamposN.Sanjuán-TomásA.BellochV.ParcetM.-A.ÁvilaC. (2010). Behavioral activation system modulation on brain activation during appetitive and aversive stimulus processing. Soc. Cogn. Affect. Neurosci.5, 18–28. 10.1093/scan/nsq012
7
BassettD. S.BullmoreE. T. (2009). Human brain networks in health and disease. Curr. Opin. Neurol.22, 340–347. 10.1097/wco.0b013e32832d93dd
8
BauerM.LondonE. D.RasgonN.BermanS. M.FryeM. A.AltshulerL. L.et al. (2005). Supraphysiological doses of levothyroxine alter regional cerebral metabolism and improve mood in bipolar depression. Mol. Psychiatry10, 456–469. 10.1038/sj.mp.4001647
9
BermpohlF.KahntT.DalanayU.HägeleC.SajonzB.WegnerT.et al. (2010). Altered representation of expected value in the orbitofrontal cortex in mania. Hum. Brain Mapp.31, 958–969. 10.1002/hbm.20909
10
BerridgeK. C.KringelbachM. L. (2013). Neuroscience of affect: brain mechanisms of pleasure and displeasure. Curr. Opin. Neurobiol.23, 294–303. 10.1016/j.conb.2013.01.017
11
BeyerJ. L.TaylorW. D.MacfallJ. R.KuchibhatlaM.PayneM. E.ProvenzaleJ. M.et al. (2005). Cortical white matter microstructural abnormalities in bipolar disorder. Neuropsychopharmacology30, 2225–2229. 10.1038/sj.npp.1300802
12
BlumbergH.LeungH. C.SkudlarskiP.LacadieC. M.FredericksC. A.HarrisB. C.et al. (2003). A functional magnetic resonance imaging study of bipolar disorder: state—and trait—related dysfunction in ventral prefrontal cortices. Arch. Gen. Psychiatry60, 601–609. 10.1001/archpsyc.60.6.601
13
BresslerS. L.MenonV. (2010). Large-scale brain networks in cognition: emerging methods and principles. Trends Cogn. Sci.14, 277–290. 10.1016/j.tics.2010.04.004
14
ChenP. S.McquoidD. R.PayneM. E.SteffensD. C. (2006). White matter and subcortical gray matter lesion volume changes and late-life depression outcome: a 4-year magnetic resonance imaging study. Int. Psychogeriatr.18, 445–456. 10.1017/s1041610205002796
15
CorrP. J.PerkinsA. M. (2006). The role of theory in the psychophysiology of personality: from Ivan Pavlov to Jeffrey Gray. Int. J. Psychophysiol.62, 367–376. 10.1016/j.ijpsycho.2006.01.005
16
CostumeroV.Barrós-LoscertalesA.BustamanteJ. C.Ventura-CamposN.FuentesP.ÁvilaC. (2013). Reward sensitivity modulates connectivity among reward brain areas during processing of anticipatory reward cues. Eur. J. Neurosci.38, 2399–2407. 10.1111/ejn.12234
17
CuellarA.JohnsonS. L.WintersR. (2005). Distinctions between bipolar and unipolar depression. Clin. Psychol. Rev.25, 307–339. 10.1016/j.cpr.2004.12.002
18
DayanP.BerridgeK. C. (2014). Model-based and model-free Pavlovian reward learning: revaluation, revision and revelation. Cogn. Affect. Behav. Neurosci.14, 473–492. 10.3758/s13415-014-0277-8
19
DeckersbachT.RauchS. L.BuhlmannU.OstacherM. J.BeuckeJ. C.NierenbergA. A.et al. (2008). An fMRI investigation of working memory and sadness in females with bipolar disorder: a brief report. Bipolar Disord.10, 928–942. 10.1111/j.1399-5618.2008.00633.x
20
DepueR. A.CollinsP. F. (1999). Neurobiology of the structure of personality: dopamine, facilitation of incentive motivation and extraversion. Behav. Brain Sci.22, 491–517. 10.1017/s0140525x99002046
21
DepueR. A.IaconoW. G. (1989). Neurobehavioral aspects of affective disorders. Annu. Rev. Psychol.40, 457–492. 10.1146/annurev.psych.40.1.457
22
DiekhofE. K.FalkaiP.GruberO. (2008). Functional neuroimaging of reward processing and decision-making: a review of aberrant motivational and affective processing in addiction and mood disorders. Brain Res. Rev.59, 164–184. 10.1016/j.brainresrev.2008.07.004
23
DorisA.BeltonE.EbmeierK. P.GlabusM. F.MarshallI. (2004). Reduction of cingulate gray matter density in poor outcome bipolar illness. Psychiatry Res.130, 153–159. 10.1016/j.pscychresns.2003.09.002
24
DowdE. C.BarchD. M. (2012). Pavlovian reward prediction and receipt in schizophrenia: relationship to anhedonia. Plos One7:e35622. 10.1371/journal.pone.0035622
25
DrevetsW. C. (2001). Neuroimaging and neuropathological studies of depression: implications for the cognitive-emotional features of mood disorders. Curr. Opin. Neurobiol.11, 240–249. 10.1016/s0959-4388(00)00203-8
26
ElliottR.OgilvieA.RubinszteinJ. S.CalderonG.DolanR. J.SahakianB. J. (2004). Abnormal ventral frontal response during performance of an affective go/no go task in patients with mania. Biol. Psychiatry55, 1163–1170. 10.1016/j.biopsych.2004.03.007
27
EshelN.RoiserJ. P. (2010). Reward and punishment processing in depression. Biol. Psychiatry68, 118–124. 10.1016/j.biopsych.2010.01.027
28
FountoulakisK. (2008). Assessing the role of cingulate cortex in bipolar disorder: neuropathological, structural and functional imaging data. Brain Res. Rev.59, 9–21. 10.1016/j.brainresrev.2008.04.005
29
GonenT.AdmonR.PodlipskyI.HendlerT. (2012). From animal model to human brain networking: dynamic causal modeling of motivational systems. J. Neurosci.32, 7218–7224. 10.1523/jneurosci.6188-11.2012
30
GrayJ. (1982). The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septo—Hippocampal.Oxford: Oxford University Press.
31
GrayJ. A.McNaughtonN. (2000). The Neuropsychology of Anxiety: An Enquiry in to the Functions of the Septo-hippocampal System.Oxford: Oxford University Press.
32
HaasB.CanliT. (2008). Emotional memory function, personality structure and psychopathology: a neural system approach to the identification of vulnerability markers. Brain Res. Rev.58, 71–84. 10.1016/j.brainresrev.2007.10.014
33
HaberS. N.KnutsonB. (2009). The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology35, 4–26. 10.1038/npp.2009.129
34
HayesD. J.NorthoffG. (2011). Identifying a network of brain regions involved in aversion-related processing: a cross-species translational investigation. Front. Integr. Neurosci.5:49. 10.3389/fnint.2011.00049
35
HaznedarM. M.RoversiF.PallantiS.Baldini-RossiN.SchnurD. B.LicalziE. M.et al. (2005). Fronto-thalamo-striatal gray and white matter volumes and anisotropy of their connections in bipolar spectrum illnesses. Biol. Psychiatry57, 733–742. 10.1016/j.biopsych.2005.01.002
36
HendlerT.GonenT.HarelE. V.SharonH. (2014). From circuit activity to network connectivity and back: the case of obsessive-compulsive disorder. Biol. Psychiatry75, 590–592. 10.1016/j.biopsych.2014.02.017
37
JohnsonS. L.EdgeM. D.HolmesM. K.CarverC. S. (2012). The behavioral activation system and mania. Annu. Rev. Clin. Psychol.8, 243–267. 10.1146/annurev-clinpsy-032511-143148
38
KaschK.RottenbergJ.ArnowB.GotlibI. (2002). Behavioral activation and inhibition systems and the severity and course of depression. J. Abnorm. Psychol.111, 589–597. 10.1037//0021-843x.111.4.589
39
KeedwellP. A.LindenD. E. (2013). Integrative neuroimaging in mood disorders. Curr. Opin. Psychiatry26, 27–32. 10.1097/yco.0b013e32835a0b63
40
KillgoreW. D. S.GruberS. A.Yurgelun-ToddD. A. (2008). Abnormal corticostriatal activity during fear perception in bipolar disorder. Neuroreport19, 1523–1527. 10.1097/wnr.0b013e328310af58
41
KircanskiK.MazurH.GotlibI. H. (2013). Behavioral activation system moderates self-referent processing following recovery from depression. Psychol. Med.43, 1909–1919. 10.1017/s0033291712002851
42
KnutsonB.BhanjiJ. P.CooneyR. E.AtlasL. Y.GotlibI. H. (2008). Neural responses to monetary incentives in major depression. Biol. Psychiatry63, 686–692. 10.1016/j.biopsych.2007.07.023
43
KnutsonB.GibbsS. E. B. (2007). Linking nucleus accumbens dopamine and blood oxygenation. Psychopharmacology (Berl)191, 813–822. 10.1007/s00213-006-0686-7
44
LawrenceN. S.WilliamsA. M.SurguladzeS.GiampietroV.BrammerM. J.AndrewC.et al. (2004). Subcortical and ventral prefrontal cortical neural responses to facial expressions distinguish patients with bipolar disorder and major depression. Biol. Psychiatry55, 578–587. 10.1016/j.biopsych.2003.11.017
45
LeppänenJ. (2006). Emotional information processing in mood disorders: a review of behavioral and neuroimaging findings. Curr. Opin. Psychiatry19, 34–39. 10.1097/01.yco.0000191500.46411.00
46
LockeH. S.BraverT. S. (2008). Motivational influences on cognitive control: behavior, brain activation and individual differences. Cogn. Affect. Behav. Neurosci.8, 99–112. 10.3758/cabn.8.1.99
47
LyooI. K.KimM. J.StollA. L.DemopulosC. M.ParowA. M.DagerS. R.et al. (2004). Frontal lobe gray matter density decreases in bipolar I disorder. Biol. Psychiatry55, 648–651. 10.1016/j.biopsych.2003.10.017
48
LyooI. K.SungY. H.DagerS. R.FriedmanS. D.LeeJ. Y.KimS. J.et al. (2006). Regional cerebral cortical thinning in bipolar disorder. Bipolar Disord.8, 65–74. 10.1111/j.1399-5618.2006.00284.x
49
MahL.ZarateC. A.Jr.SinghJ.DuanY. F.LuckenbaughD. A.ManjiH. K.et al. (2007). Regional cerebral glucose metabolic abnormalities in bipolar II depression. Biol. Psychiatry61, 765–775. 10.1016/j.biopsych.2006.06.009
50
MalhiG. S.LagopoulosJ.SachdevP.MitchellP. B.IvanovskiB.ParkerG. B. (2004a). Cognitive generation of affect in hypomania: an fMRI study. Bipolar Disorder.6, 271–285. 10.1111/j.1399-5618.2004.00123.x
51
MalhiG. S.LagopoulosJ.WardP. B.KumariV.MitchellP. B.ParkerG. B.et al. (2004b). Cognitive generation of affect in bipolar depression: an fMRI study. Eur. J. Neurosci.19, 741–754. 10.1111/j.0953-816x.2003.03159.x
52
McNaughtonN.CorrP. J. (2008). “The neuropsychology of fear and anxiety: a foundation for reinforcement sensitivity theory,” in The Reinforcement Sensitivity Theory of Personality, ed CorrP. J. (Cambridge: Cambridge University Press), 44–94.
53
MeyerB.BeeversC. G.JohnsonS. L.SimmonsE. (2007). Unique association of approach motivation and mania vulnerability. Cogn. Emot.21, 1647–1668. 10.1080/02699930701252686
54
MeyerB.JohnsonS. L.WintersR. (2001). Responsiveness to threat and incentive in bipolar disorder: relations of the BIS/BAS scales with symptoms. J. Psychopathol. Behav. Assess.23, 133–143. 10.1023/A:1010929402770
55
MillerE. M.ShankarM. U.KnutsonB.McClureS. M. (2013). Dissociating motivation from reward in human striatal activity. J. Cogn. Neurosci.26, 1075–1084. 10.1162/jocn_a_00535
56
NunesE. J.RandallP. A.PodurgielS.CorreaM.SalamoneJ. D. (2013). Nucleus accumbens neurotransmission and effort-related choice behavior in food motivation: effects of drugs acting on dopamine, adenosine and muscarinic acetylcholine receptors. Neurosci. Biobehav. Rev.37, 2015–2025. 10.1016/j.neubiorev.2013.04.002
57
PavlickovaH.VareseF.TurnbullO.ScottJ.MorrissR.KindermanP.et al. (2013). Symptom-specific self-referential cognitive processes in bipolar disorder: a longitudinal analysis. Psychol. Med.43, 1895–1907. 10.1017/s0033291712002711
58
PavlovI. P. (1927). Conditioned reflexes: An Investigation of the Physiological Activity of the Cerebral Cortex.London: Oxford University Press.
59
PearlsonG. D. (1999). Structural and functional brain changes in bipolar disorder: a selective review. Schizophr. Res.39, 133–140. 10.1016/s0920-9964(99)00112-7
60
PearlsonG. D.BartaP. E.PowersR. E.MenonR. R.RichardsS. S.AylwardE. H.et al. (1997). Medial and superior temporal gyral volumes and cerebral asymmetry in schizophrenia versus bipolar disorder. Biol. Psychiatry41, 1–14. 10.1016/s0006-3223(96)00373-3
61
PhillipsM. L.SwartzH. A. (2014). A critical appraisal of neuroimaging studies of bipolar disorder: toward a new conceptualization of underlying neural circuitry and a road map for future research. Am. J. Psychiatry171, 829–843. 10.1176/appi.ajp.2014.13081008
62
PhillipsM. L.VietaE. (2007). Identifying functional neuroimaging biomarkers of bipolar disorder: toward DSM-V. Schizophr. Bull.33, 893–904. 10.1093/schbul/sbm060
63
PhillipsP. E.WaltonM. E.JhouT. C. (2007). Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology (Berl)191, 483–495. 10.1007/s00213-006-0626-6
64
PizzagalliD. A.GoetzE.OstacherM.IosifescuD. V.PerlisR. H. (2008). Euthymic patients with bipolar disorder show decreased reward learning in a probabilistic reward task. Biol. Psychiatry64, 162–168. 10.1016/j.biopsych.2007.12.001
65
RazG.WinetraubY.JacobY.KinreichS.Maron-KatzA.ShahamG.et al. (2012). Portraying emotions at their unfolding: a multilayered approach for probing dynamics of neural networks. Neuroimage60, 1448–1461. 10.1016/j.neuroimage.2011.12.084
66
SalamoneJ. D.CorreaM. (2012). The mysterious motivational functions of mesolimbic dopamine. Neuron76, 470–485. 10.1016/j.neuron.2012.10.021
67
SalavertJ.CaserasX.TorrubiaR.FurestS.ArranzB.DueñasR.et al. (2007). The functioning of the behavioral activation and inhibition systems in bipolar I euthymic patients and its influence in subsequent episodes over an eighteen-month period. Pers. Individ. Dif.42, 1323–1331. 10.1016/j.paid.2006.10.010
68
SanchesM.KeshavanM. S.BrambillaP.SoaresJ. C. (2008). Neurodevelopmental basis of bipolar disorder: a critical appraisal. Prog. Neuropsychopharmacol. Biol. Psychiatry32, 1617–1627. 10.1016/j.pnpbp.2008.04.017
69
SanislowC. A.PineD. S.QuinnK. J.KozakM. J.GarveyM. A.HeinssenR. K.et al. (2010). Developing constructs for psychopathology research: research domain criteria. J. Abnorm. Psychol.119, 631–639. 10.1037/a0020909
70
SavitzJ.DrevetsW. C. (2009). Bipolar and major depressive disorder: neuroimaging the develop mental-degenerative divide. Neurosci. Biobehav. Rev.33, 699–771. 10.1016/j.neubiorev.2009.01.004
71
SchweimerJ.SaftS.HauberW. (2005). Involvement of catecholamine neurotransmission in the rat anterior cingulate in effort-related decision making. Behav. Neurosci. 119, 1687–1692. 10.1037/0735-7044.119.6.1687
72
SmillieL. D. (2008). What is reinforcement sensitivity? Neuroscience paradigms for approach-avoidance process theories of personality. Eur. J. Pers.22, 359–384. 10.1002/per.674
73
StrakowskiS. M.AdlerC. M.AlmeidaJ.AltshulerL. L.BlumbergH. P.ChangK. D.et al. (2012). The functional neuroanatomy of bipolar disorder: a consensus model. Bipolar Disorder.14, 313–325. 10.1111/j.1399-5618.2012.01022.x
74
SwannA. C.DoughertyD. M.PazzagliaP. J.PhamM.MoellerF. G. (2004). Impulsivity: a link between bipolar disorder and substance abuse. Bipolar Disorder.6, 204–212. 10.1111/j.1399-5618.2004.00110.x
75
TreadwayM. T.BossallerN. A.SheltonR. C.ZaldD. H. (2012). Effort-based decision-making in major depressive disorder: a translational model of motivational anhedonia. J. Abnorm. Psychol.121, 553–558. 10.1037/a0028813
76
TreadwayM. T.ZaldD. H. (2011). Reconsidering anhedonia in depression: lessons from translational neuroscience. Neurosci. Biobehav. Rev.35, 537–555. 10.1016/j.neubiorev.2010.06.006
77
WessaM.HouenouJ.Paillère-MartinotM. L.BerthozS.ArtigesE.LeboyerM.et al. (2007). Fronto-striatal overactivation in euthymic bipolar patients during an emotional go/nogo task. Am. J. Psychiatry164, 638–646. 10.1176/appi.ajp.164.4.638
78
Yurgelun-ToddD. A.GruberS. A.KanayamaG.KillgoreW. D.BairdA. A.YoungA. D. (2000). fMRI during affect discrimination in bipolar affective disorder. Bipolar Disord.2, 237–248. 10.1034/j.1399-5618.2000.20304.x
79
ZinbargR.YoonL. (2008). “Reinforcement sensitivity theory and clinical disorders: anxiety and depression,” in The Reinforcement Sensitivity Theory of Personality, ed CorrP. J. (Cambridge: Cambridge University Press), 360–397.
Summary
Keywords
functional neuroimaging, motivation and affectives process, bipolar disorder, depression, system neuroscience
Citation
Gonen T, Sharon H, Pearlson G and Hendler T (2014) Moods as ups and downs of the motivation pendulum: revisiting reinforcement sensitivity theory (RST) in bipolar disorder. Front. Behav. Neurosci. 8:378. doi: 10.3389/fnbeh.2014.00378
Received
30 March 2014
Accepted
13 October 2014
Published
03 November 2014
Volume
8 - 2014
Edited by
John D. Salamone, University of Connecticut, USA
Reviewed by
Therese A. Kosten, Baylor College of Medicine, USA; SheriL Johnson, University of California, Berkeley, USA
Copyright
© 2014 Gonen, Sharon, Pearlson and Hendler.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Talma Hendler, Functional Brain Center, Wohl Institute for Advanced Imaging, Tel Aviv Medical Center, Weizmann 6, Tel Aviv, Israel e-mail: talma@tlvmc.gov.il
This article was submitted to the journal Frontiers in Behavioral Neuroscience.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.