Abstract
One barrier to interpreting past studies of cognition and major depressive disorder (MDD) has been the failure in many studies to adequately dissociate the effects of MDD from the potential cognitive side effects of selective serotonin reuptake inhibitors (SSRIs) use. To better understand how remediation of depressive symptoms affects cognitive function in MDD, we evaluated three groups of subjects: medication-naïve patients with MDD, medicated patients with MDD receiving the SSRI paroxetine, and healthy control (HC) subjects. All were administered a category-learning task that allows for dissociation between learning from positive feedback (reward) vs. learning from negative feedback (punishment). Healthy subjects learned significantly better from positive feedback than medication-naïve and medicated MDD groups, whose learning accuracy did not differ significantly. In contrast, medicated patients with MDD learned significantly less from negative feedback than medication-naïve patients with MDD and healthy subjects, whose learning accuracy was comparable. A comparison of subject’s relative sensitivity to positive vs. negative feedback showed that both the medicated MDD and HC groups conform to Prospect Theory, which expects losses (negative feedback) to loom psychologically slightly larger than gains (positive feedback). However, medicated MDD and HC profiles are not similar, which indicates that the state of medicated MDD is not “normal” when compared to HC, but rather balanced with less learning from both positive and negative feedback. On the other hand, medication-naïve patients with MDD violate Prospect Theory by having significantly exaggerated learning from negative feedback. This suggests that SSRI antidepressants impair learning from negative feedback, while having negligible effect on learning from positive feedback. Overall, these findings shed light on the importance of dissociating the cognitive consequences of MDD from those of SSRI treatment, and from cognitive evaluation of MDD subjects in a medication-naïve state before the administration of antidepressants. Future research is needed to correlate the mood-elevating effects and the cognitive balance between reward- and punishment-based learning related to SSRIs.
INTRODUCTION
Major depressive disorder (MDD) is debilitating psychiatric disease, characterized by persistent low mood and significant loss of pleasure (). MDD has been associated with various cognitive deficits, including alterations to learning from positive feedback (reward) and negative feedback (punishment; ). Behavioral studies suggest that patients with MDD show hypersensitive responses to punishment (; , ), while being hyposensitive to reward (; ; ). These findings fit with psychological theories of MDD, which argue that patients with MDD manifest abnormally negative attitudes and thoughts (), while being unable to modulate their behavioral responses when presented with positive reinforcement, which results in misconception of environmental information to confirm these biases (; ). Such cognitive biases relate to the underlying neural circuits that are affected by MDD, namely the basal ganglia and the limbic system (; ; ). Accordingly, we can draw two major conclusions from the literature on MDD patients’ ability to process information in the context of positive and negative feedback. The first is that patients with MDD show exaggerated responses to negative feedback (; , ), while the second is that MDD patients show hyposensitive responses to positive feedback (; ; ).
In addition to being implicated in the pathophysiology of MDD, the monoamines serotonin and dopamine have also been shown to be play major roles in reinforcement learning (; ; ). Serotonin has been prominently associated with aversive processing as well as behavioral inhibition, where serotonin levels positively correlate with punishment-induced inhibition and aversive processing but not overall inhibition of motor responses to aversive outcomes (; ). Studies have shown that acute tryptophan depletion (a dietary technique used to reduce central serotonin concentrations) enhances reversal learning of aversive cues in healthy subjects (), which mimics the feedback sensitivity bias in patients with MDD (; ). Aside from being key for learning from positive feedback (), it has been suggested that dopaminergic dysregulation plays a central role in the cognitive correlates of MDD (; ; ). Imaging studies have shown that patients with MDD exhibit hyposensitive responses to reward alongside attenuated striatal response to presentation of reward (; ; ). These reports highlight the low serotonergic and low dopaminergic state in MDD, which could represent the neurochemical basis for the observed cognitive biases in MDD ().
A substantial proportion of patients with MDD respond to pharmacological treatment with antidepressants, including selective serotonin reuptake inhibitors (SSRIs; ), which are thought to achieve their therapeutic effect, primarily, by modifying synaptic availability of monoamines, namely serotonin, dopamine, and norepinephrine (). Recent studies argue that SSRI administration in MDD results in normalization of activity in the prefrontal cortex (PFC) and amygdala (; ), normalization of the functional connectivity between PFC and both hippocampus and amygdala (), and enhancement of reward learning and striatal activity (). On the other hand, reports suggest that the administration of SSRIs diminishes the processing of both reward and punishment stimuli in healthy subjects (), but diminishes learning from punishment stimuli and enhances learning from reward stimuli in rats (). Accordingly, there is evidence that SSRI administration normalizes brain activity in key regions for learning from positive and negative feedback, and enhances learning from positive feedback. Unfortunately, relatively little is known about how the remediation of psychiatric symptoms by SSRIs impacts the balance between learning from reward and punishment in MDD.
In this study, our main aim was to investigate the effect of remediation of depressive symptoms by SSRI administration on the balance between learning from positive and negative feedback in MDD. We tested medication-naïve patients with MDD, SSRI-responder patients with MDD and matched healthy control (HC) subjects, on a computer-based learning task that uses a mix of positive-feedback and negative feedback (). To our knowledge, no previous studies attempted to dissociate the effects of MDD and SSRI on reward and punishment learning in the same study.
MATERIALS AND METHODS
PARTICIPANTS
We recruited and tested 13 medication-naïve patients with MDD, 18 SSRI-responding patients with MDD (MDD-T), and 22 HC subjects, from various psychiatric clinics, mental health care centers and primary health care centers throughout the West Bank, Palestinian Territories. All subjects were White, ranging from 20 to 60 years of age. Participants were group matched for age, gender, and years of education, as shown in Table 1. All subjects underwent screening evaluations that included a medical history and a physical examination. Psychiatric assessment was conducted using an unstructured interview with a psychiatrist using the DSM-IV-TR criteria for the diagnosis of MDD (melancholic subtype), and the Mini International Neuropsychiatric Interview (MINI; ). We recruited medication-naïve patients with MDD after meeting the DSM-IV-TR criteria for MDD and completing the MINI structured clinical interview to confirm the diagnosis and absence of comorbidities. We tested medication-naïve patients with MDD immediately prior to their initiating treatment with SSRIs. All SSRI-treated patients with MDD received 10–30 mg of paroxetine per day (mean = 18.333, SD = 5.941) as part of their normal ongoing treatment. Inclusion criteria for HC subjects were absence of any psychiatric, neurological, or other disorders that might affect cognition. MDD-T patients’ average exposure to SSRIs was 12.833 (SD = 18.912) months. MDD-T patients’ response to SSRIs was assessed using subjective reports and scores on the Beck Depression Inventory II (BDI-II). Exclusion criteria for all subjects included psychotropic drug exposure, except for the SSRI paroxetine in the SSRI-treated MDD group; major medical or neurological illness; illicit drug use or alcohol abuse within the past year; lifetime history of alcohol or drug dependence; psychiatric disorders other than major depression (excepting comorbid anxiety symptoms); current pregnancy or breastfeeding. After receiving a complete description of the study, participants provided written informed consent as approved by both the Al-Quds University Ethics Committee and the Rutgers Institutional Review Board.
Table 1
| Age | Education | MMSE | BDI-II | BAI | NS | HA | RD | ||
|---|---|---|---|---|---|---|---|---|---|
| HC | Mean | 28.50 | 15.09 | 29.91 | 5.5 | 6.36 | 14.63 | 10.54 | 17.91 |
| SD | 11.84 | 1.57 | 0.29 | 4.09 | 5.60 | 3.95 | 4.51 | 2.69 | |
| MDD | Mean | 27.23 | 14.31 | 28.53 | 33.77 | 28.84 | 16.38 | 20.77 | 14.69 |
| SD | 6.24 | 2.29 | 1.33 | 10.02 | 9.01 | 3.47 | 6.24 | 4.23 | |
| MDD-T | Mean | 32.11 | 13.56 | 27.83 | 9.72 | 9.27 | 14.78 | 15.83 | 18.50 |
| SD | 9.14 | 2.17 | 2.71 | 6.41 | 5.43 | 3.21 | 5.36 | 3.07 |
Summary of demographic and neuropsychological results.
HC, healthy controls; MDD, medication-naïve patients with MDD; MDD-T, SSRI-treated patients with MDD; MMSE, Mini-Mental Status Exam; BDI-II, Beck Depression Inventory II; BAI, Beck Anxiety Inventory; TPQ dimensions, Tridimensional Personality Questionnaire; HA, harm avoidance; RD, reward dependence, NS, novelty seeking.
PSYCHOMETRIC AND PSYCHOPATHOLOGY TEST BATTERY
All subjects completed the validated Arabic version (, ) of a battery of psychometric and psychopathology test questionnaires: Mini-Mental Status Examination (MMSE; ), BDI-II (), and Beck Anxiety Inventory (BAI; ). Further, all subject completed the Tridimensional Personality Questionnaire (TPQ; ). All results are summarized in Table 1.
COMPUTER-BASED COGNITIVE TASK
Reward and punishment learning
Participants were administered a computer-based classification task (). On each trial, participants viewed one of eight images (Figure 1), and were asked to guess whether that stimulus predicts rainy weather (Rain, Figure 1) or sunny weather (Sun, Figure 1). For each participant, the eight images were randomly assigned to be stimuli S1–S8. On any given trial, stimuli S1, S3, S5, and S7 predicted Rain, while stimuli S2, S4, S6, and S8 predicted Sun. Stimuli S1–S4 were used in the reward-learning task. Four stimuli per valence were employed in order to balance category outcome frequencies, so that one stimulus in each task would be associated with each outcome. Thus, if the participant correctly guessed category membership on a trial with either of these stimuli, a reward of +25 points was received; if the participant guessed incorrectly, no feedback appeared. Stimuli S5–S8 were used in the punishment-learning task. Thus, if the participant guessed incorrectly on a trial with either of these stimuli, a punishment of –25 was received; correct guesses received no feedback.
FIGURE 1
The experiment was conducted on a Macintosh MacBook, programed in the SuperCard language. The participant was seated in a quiet testing room at a comfortable viewing distance from the screen. The keyboard was masked except for two keys, labeled “Sun” and “Rain” which the participant could use to enter responses. At the start of the experiment, the participant read the following instructions: “Welcome to the Fortuneteller School! You will be trained as a fortune teller to predict the weather. You learn to do this by using cards that either predict rain or sun. Your goal is to learn which cards predict rain and which cards predict sun.” The practice phase then walked the participant through an example of a correct and an incorrect response to a sample trial in the reward-learning task and an example of a correct and response to a sample trial in the punishment-learning task. These examples used images other than those assigned to S1–S8. The participant saw a practice image, with a prompt to choose “Sun” or “Rain,” and a running tally of points at the lower right corner of the screen. The tally was initialized to 500 points at the start of practice. The participant was first instructed to press the “Sun” key, which resulted in a reward of +25 and updated point tally and then the “Rain” key, which resulted in no feedback. The participant then saw a second practice figure and was instructed first to press the “Rain” key, which resulted in a reward of –25 and updated point tally and then the “Sun” key, which resulted in no feedback. After these two practice trials, a summary of instructions appeared: “So... for some pictures, if you guess CORRECTLY, you WIN points (but, if you guess incorrectly, you win nothing). For other pictures, if you guess INCORRECTLY, you LOSE points (but, if you guess correctly, you lose nothing). Your job is to win all the points you can and lose as few as you can. Press the mouse button to begin the experiment”. From here, the experiment began. In each trial, the participant saw one of the eight stimuli (S1–S8) and was prompted to guess whether it was a “Sun” or a “Rain.” On trials in the reward-learning task (with stimuli S1–S4), correct answers were rewarded with positive feedback and a gain of 25 points; incorrect answers received no feedback. On trials in the punishment-learning task (with stimuli S5–S8), incorrect answers were punished with negative feedback and a loss of 25 points; correct answers received no feedback. The task contained 160 trials, distributed over four blocks of 40 trials. Within a block, trial order was randomized. Trials were separated by a 1 s interval, during which time the screen was blank. Within each block, each stimulus appeared five times. Thus, training on the reward-learning task (S1–S4) and punishment-learning task (S5–S8) were intermixed. The no-feedback outcome, when it arrived, was ambiguous, as it could signal lack of reward (if received during a trial with S1–S4) or lack of punishment (if received during a trial with S5–S8).
STATISTICAL ANALYSIS
The normality of data distribution was checked using Kolmogorov–Smirnov tests. All data were normally distributed (p > 0.1). We used mixed-design three-way ANCOVA followed by mixed-design two-way ANOVA and one-way ANOVA post hoc tests, Tukey’s honestly significant difference (HSD) post hoc tests and Bonferroni post hoc tests. The level of significance was set at α = 0.05.
RESULTS
BEHAVIORAL RESULTS
We used one-sample t-test on the percentage of correct responses in the fourth block of learning in both reward and punishment to ensure that subjects learned significantly better than chance in different groups. In reward learning, MDD-T and HC learned significantly better than chance, with Bonferroni correction adjusted α = 0.017 to protect the level of significance [MDD-T: t(17) = 3.264, p = 0.005; HC: t(21) = 9.997, p < 0.001], while MDD did not [t(12) = 0.925, p = 0.373]. In punishment learning, all groups learned significantly better than chance, with Bonferroni correction adjusted α = 0.017 to protect the level of significance [MDD: t(12) = 7.704, p < 0.001; MDD-T: t(17) = 3.394, p = 0.003; HC: t(11) = 13.231, p < 0.001].
Using mixed-design three-way ANCOVA, we analyzed the data obtained from the cognitive task with group as the between-subject variable, learning block, and feedback type as within-subject variables, BDI-II scores as a covariate, and the percentage of correct responses on reward and punishment as the dependent variables. There was a significant effect of group [F(2,51) = 9.433, p < 0.001, η2 = 0.270] and block [F(3,153) = 11.880, p < 0.001, η2 = 0.189] as illustrated in Figure 2. However, there was no significant effect of feedback type [F(1,51) = 1.337, p = 0.253]. We conducted two post hoc mixed-design two-way ANOVAs, with group as the between-subject variable, learning block as within-subject variable, the percentage of correct responses on reward as the dependent variable in one of the ANOVAs and the percentage of correct responses on punishment in the other, and Bonferroni correction adjusted α = 0.025 to protect the level of significance. The reward post hoc revealed a significant effect of group [F(2,50) = 5.094, p = 0.010, η2 = 0.169] and block [F(3,150) = 6.000, p = 0.001, η2 = 0.107] along with an interaction between group and block [F(6,150) = 3.098, p = 0.007, η2 = 0.110]. We used four post hoc one-way ANOVAs to explore the significant interaction between group and block, with group as the between-subject variable, and the percentage of correct responses on a each one of the four reward learning block was the within-subject variable, with a Bonferroni correction adjusted α = 0.0125 to protect the level of significance. One-way ANOVA and Tukey’s HSD results are summarized in Table 2. The punishment post hoc two-way ANOVA showed a significant effect of group [F(2,50) = 4.512, p = 0.016, η2 = 0.153] and block [F(3,150) = 45.644, p < 0.001, η2 = 0.477], but no interaction between group and block [F(6,150) = 2.426, p = 0.029]. Tukey’s HSD post hoc test revealed a significant difference between MDD-T and both MDD and HC (p < 0.05), but not between MDD and HC.
FIGURE 2
Table 2
| Statistical test | Within-subject variable | Between-subject variable | df-1 | df-2 | F | p | η2 |
|---|---|---|---|---|---|---|---|
| One-way ANOVA | Block 1 reward | Group (MDD, MDD-T, HC) | 2 | 50 | 1.571 | 0.218 | – |
| One-way ANOVA | Block 2 reward | Group (MDD, MDD-T, HC) | 2 | 50 | 3.862 | 0.28 | – |
| One-way ANOVA | Block 3 reward | Group (MDD, MDD-T, HC) | 2 | 50 | 4.973 | 0.011* | 0.166 |
| Tukey’s HSD | HC vs. MDD-T | – | – | – | 0.04* | – | |
| HC vs. MDD | – | – | – | 0.097 | – | ||
| MDD vs. MDD-T | – | – | – | 0.827 | – | ||
| One-way ANOVA | Block 4 reward | Group (MDD, MDD-T, HC) | 2 | 50 | 6.038 | 0.004* | 0.194 |
| Tukey’s HSD | HC vs. MDD | – | – | – | 0.006* | – | |
| HC vs. MDD-T | – | – | – | 0.049* | – | ||
| MDD vs. MDD-T | – | – | – | 0.572 | – |
Summary of the post hoc one-way ANOVA and Tukey’s HSD post hoc results to explore the significant interaction between group and block in reward learning, with group as the between-subject variable, and the percentage of correct responses on a each one of the four reward learning block was the within-subject variable, with a Bonferroni correction adjusted α = 0.0125 to protect the level of significance.
HC, healthy controls; MDD, medication-naïve patients with MDD; MDD-T, SSRI-treated patients with MDD. The symbol “*” marks significant results.
To investigate the balance between reward and punishment learning, we subtracted punishment learning accuracy in a particular block from that of reward in the same block. Two-way ANOVA, with group as the between-subject variable, block of learning as the within subject variable, and the mean difference between percentage correct responses in reward and punishment trials as the dependent variable, revealed a significant effect of block [F(3,150) = 11.147, p < 0.001, η2 = 0.182] and an interaction between block and group [F(6,150) = 3.145, p = 0.006, η2 = 0.112], but no significant effect of group [F(2,50) = 2.486, p = 0.094], as illustrated in Figure 3. We used four post hoc one-way ANOVA and Tukey’s HSD post hoc analyses on each block of mean difference between percentage correct responses in reward and punishment trials to investigate the interaction between block and group, with group as the between subject variable and the mean difference between percentage correct responses in reward and punishment trials as the dependent variable. ANOVA and Tukey’s HSD results are reported in Table 3.
FIGURE 3
Table 3
| Statistical test | Within-subject variable | Between-subject variable | df-1 | df-2 | F | p | η2 |
|---|---|---|---|---|---|---|---|
| One-way ANOVA | Block 1 difference | Group (MDD, MDD-T, HC) | 2 | 50 | 0.358 | 0.701 | – |
| One-way ANOVA | Block 2 difference | Group (MDD, MDD-T, HC) | 2 | 50 | 2.121 | 0.131 | – |
| One-way ANOVA | Block 3 difference | Group (MDD, MDD-T, HC) | 2 | 50 | 1.035 | 0.363 | – |
| One-way ANOVA | Block 4 difference | Group (MDD, MDD-T, HC) | 2 | 50 | 5.251 | 0.009* | 0.173 |
| Tukey’s HSD | HC vs. MDD | – | – | – | 0.017* | – | |
| HC vs. MDD-T | – | – | – | 0.963 | – | ||
| MDD vs. MDD-T | – | – | – | 0.013* | – |
Summary of the post hoc one-way ANOVA and Tukey’s HSD post hoc analyses on each block of mean difference between percentage correct responses in reward and punishment trials to investigate the interaction between block and group, with group as the between subject variable and the mean difference between percentage correct responses in reward and punishment trials as the dependent variable.
HC, healthy controls; MDD, medication-naïve patients with MDD; MDD-T, SSRI-treated patients with MDD. The symbol “*” marks significant results.
PSYCHOMETRIC RESULTS
There was no significant effect of group on age, education, MMSE score, or the novelty seeking subsection of the TPQ, with Bonferroni correction adjusted α = 0.006 to protect the level of significance (p > 0.006). However, there was a significant difference between groups in BDI-II scores [F(2,50) = 77.576, p < 0.001, η2 = 0.756, Tukey’s HSD post hoc: significant difference between MDD and both MDD-T and HCs], BAI scores [F(2,50) = 52.444, p < 0.001, η2 = 0.677, Tukey’s HSD post hoc: significant difference between MDD and both MDD-T and HCs], harm avoidance subsection of the TPQ [F(2,50) = 15.903, p < 0.001, η2 = 0.389, Tukey’s HSD post hoc: significant difference between HC and both MDD and MDD-T, and between MDD-T and HC], and reward dependence subsection of the TPQ [F(2,50) = 5.808, p = 0.005, η2 = 0.189, Tukey’s HSD post hoc: significant difference between HC and both MDD and MDD-T].
DISCUSSION
We have three main findings. First, SSRI-treated patients with MDD were less sensitive to negative feedback (punishment) than either medication-naïve patients with MDD or HC subjects, based on their accuracy in the cognitive task. Second, both medication-naïve and SSRI-treated patients with MDD were less sensitive to positive-feedback than HC subjects. Third, a comparison of subjects’ learning from positive vs. negative feedback, showed that both the HC and MDD groups conform to ) Prospect Theory, which expects losses (negative feedback) to loom psychologically larger than gains (positive feedback; ). In contrast the MDD patients violate Prospect Theory by being significantly more biased toward negative.
BEHAVIORAL AND NEURAL CORRELATES OF MDD
Abnormal exaggerated reactions to negative events and overlooking positive events are considered central features of MDD (; ). These abnormal responses to positive and negative feedback represent an important link between emotional and cognitive disturbances in MDD (; ), showing an increased elaboration of negative information (), while ignoring positive information. As explained by the cognitive theory of depression (); depressed people tend to demonstrate selective attention to negative information; magnifying the importance and meaning placed on negative events (; ). Our results show that medication-naïve patients with MDD learn from punishment as efficiently as HC subjects, but fail to learn from reward feedback. However, the task design we use in the current study is not the most ideal approach to delineate higher-than-normal learning from punishment learning in MDD due to a possible ceiling effect (Figure 2B). Further research is needed in this domain to further investigate the differential sensitivity to negative feedback in MDD as compared to healthy subjects, and properly correlate cognitive measures with symptom distribution and severity in patients with MDD.
Patients with MDD’s strong biases toward negative stimuli and away from positive ones highlights the role of serotonin in the processing of affective stimuli and inhibitory control of behavior and adaptation of the animals to aversive events (), and underpin the attentional bias in MDD toward negative feedback (; ). Lowering brain serotonin level by acute tryptophan depletion (serotonin precursor) in healthy volunteers results in increased sensitivity to punishment and negative feedback without affecting reward (; ). These alterations in the reward and punishment processing implicate a neural circuit that is composed of brain regions strongly innervated by serotonin, namely, the medial PFC and the ventral striatum ().
Recent imaging studies argue that patients with MDD manifest cognitive and neurochemical dysfunction directly related to the nigrostriatal dopaminergic system (; ; ). On the other hand, previous research has shown that the basal ganglia dopaminergic system is vital for learning to predict rewarding outcomes (; ). In a previous study using a reward-punishment learning task (similar to the task we used in this paper), we demonstrated that medication-naïve patients with Parkinson’s disease learned very well from punishment but were impaired on reward learning (). Our findings indicate that medication-naïve patients with MDD show similar cognitive profile to de novo patients with Parkinson’s (). Both disorders were shown to suppress learning from reward (; ; ; ), without altering learning from punishment (; , ; ). This observation might be attributed to the effect of both disorders on the striatal dopamine (; ). Further, there is a very high level of comorbidity between MDD and Parkinson’s disease (; ; ; ). However, it is not clear whether this overlap between the two disorders is a consequence of dopaminergic dysfunction alone, or it is a mixture monaminergic effects (; ). In addition, our findings suggest that SSRI-treated patients with MDD learn significantly less than HC subjects from positive-feedback, similar to medication-naïve patients with MDD. Future studies ought to compare the cognitive correlates of SSRI administration in MDD and depression in Parkinson’s disease.
Increasing the central level of serotonin by administration of SSRIs counteracts MDD-related negative biases in aversive learning paradigms in animals () as well as emotional learning paradigms in humans (; ). Various studies show that the administration of SSRIs normalizes the BOLD response in the dorsomedial PFC and across the functional connection between PFC and both hippocampus and amygdala (). Hence, it has been proposed that SSRIs may ameliorate MDD symptoms by inhibiting processing of negative feedback (; ). In agreement with these results, we found here that SSRI-treated patients with MDD are less sensitive to negative feedback as compared to both medication-naïve patients with MDD as well as HC subjects.
In , daily administration of SSRIs caused normal rats to slowly begin to lose selectivity in their box-checking behavior for food reward; they soon began to check more unbaited boxes. If SSRI administration reduces salience of punishment, it may be that the behavioral outcome is not due to lack of consolidation or reconsolidation of which boxes were baited or unbaited, as the authors chose to interpret their findings, but rather resulted from a lack of motivation to discriminate the rewarded vs. unrewarded boxes since the slight negative drawback (waste of time and effort) of checking an unbaited box was no longer worth the cognitive effort of discrimination. This could support either a learning deficit with MDD treatment or a loss of the power of negative motivation, or both. However, it also remains possible that change in the MDD-T performance in our study is due to an a priori learning impairment caused by the MDD treatment, or the effects of recovery from MDD. All groups did seem to learn the positive reward stimuli, but none of them learned it well, whereas the MDD and HC groups learned from punishment quite well indeed while the MDD-T group poor learning from punishment compares to their poor learning from reward.
Driven by the SSRI-related suppression of punishment learning, we found that SSRI-treated patients with MDD expressed balanced reward-punishment learning bias similar to HC subjects. This balance can be the underlying mechanism for SSRI-induced restoration of mood in patients with MDD. It is worth noting, however, that SSRI-treated MDD and HC profiles are not similar, which indicates that the state of SSRI-treated MDD is not “normal” (when compared to HC), but rather balanced with less learning from both positive and negative feedback. The negative values in this difference computation for the HC and MDD-T groups indicated a biased sensitivity to learn slightly more quickly from negative feedback (punishment) than positive feedback (reward) as expected by Prospect Theory, which expects that losses from negative feedback should loom larger than gains from positive feedback. Only the MDD group failed to conform to the Prospect Theory with significantly exaggerated bias toward negative feedback.
LIMITATIONS AND FUTURE DIRECTIONS
An important limitation of the current study is that the different severity of depressive symptoms in SSRI-treated vs. medication-naïve patients might have contributed to the difference between the groups. We did not have access to SSRI-treated patients’ BDI-II scores before they were placed on the SSRI regimen. Therefore, it is impossible to conclude that the observed behavioral effects originate from the medication alone. However, we added BDI-II scores as a covariate in our main analysis, and matched the different groups on a number of psychometric measures.
Another major limitation to our study is the between-subject design, where the medication-naïve and the SSRI-treated patients with MDD are different individuals. Given the heterogeneity of MDD, and how various subtypes of MDD differ with regards to cognitive function, the current result might be confounded by between-subject variability originating from factors other than MDD and SSRI administration. Further, given that we recruited SSRI-responders, it is not expected that the selected medication-naïve patients with MDD will turn out to be responders once they started SSRI monotherapy, which limits the comparability of the groups and represents a major limitation of the current study. We did, of course, try to control for that in the current study by recruiting melancholic patients with MDD only, and by matching the two groups on various psychometric and demographic measures as described earlier. However, future work ought to address this issue by examining the same patients with MDD on and off medication. Another limitation of the current study is the low number of recruited subjects. However, given that the focus of the current study is cognitive function assessment, all a priori power analyses indicated the need for 14 subjects per group to achieve power levels higher than 90%, which confirms the sufficiency of the number of subjects in the analysis of our primary cognitive results. Future studies, however, should address these limitations and better control for possible confounding variables.
Statements
Acknowledgments
We would like to thank Al-Quds Cognitive Neuroscience Lab students: Omar Danoun, Dana Deeb, Aya Imam, Issa Isaac, Hussain Khdour, and Jeries Kort for their excellent technical assistance. Research reported in this publication was supported by National Institutes of Health Award R21MH095656 from the Fogarty International Center and the National Institute of Mental Health to Mark A. Gluck, the Palestinian American Research Center (PARC), as well as generous donations from Saad N. Mouasher, Dr. Samih Darwazah (Hikma Pharmaceuticals LLC.), Dr. Fouad Rasheed, and Mahmud Atallah.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
REFERENCES
1
AmorimP.LecrubierY.WeillerE.HerguetaT.SheehanD. (1998). DSM-IH-R Psychotic disorders: procedural validity of the Mini International Neuropsychiatric Interview (MINI). Concordance and causes for discordance with the CIDI.Eur. Psychiatry1326–34.10.1016/S0924-9338(97)86748-X
2
BariA.TheobaldD. E.CaprioliD.MarA. C.Aidoo-MicahA.DalleyJ. W.et al (2010). Serotonin modulates sensitivity to reward and negative feedback in a probabilistic reversal learning task in rats.Neuropsychopharmacology351290–1301.10.1038/npp.2009.233
3
BeatsB. C.SahakianB. J.LevyR. (1996). Cognitive performance in tests sensitive to frontal lobe dysfunction in the elderly depressed.Psychol. Med.26591–603.10.1017/S0033291700035662
4
BeckA. (1979). Cognitive Theory of Depression.New York: John Wiley & Sons.
5
BeckA. T.EpsteinN.BrownG.SteerR. A. (1988). An inventory for measuring clinical anxiety: psychometric properties.J. Consult. Clin. Psychol.56893–897.10.1037/0022-006X.56.6.893
6
BeckA. T.SteerR. A.BallR.RanieriW. (1996). Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients.J. Pers. Assess.67588–597.10.1207/s15327752jpa6703_13
7
BelmakerR. H.AgamG. (2008). Major depressive disorder.N. Engl. J. Med.35855–68.10.1056/NEJMra073096
8
BodiN.KeriS.NagyH.MoustafaA.MyersC. E.DawN.et al (2009). Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson’s patients.Brain1322385–2395.10.1093/brain/awp094
9
BoureauY. L.DayanP. (2011). Opponency revisited: competition and cooperation between dopamine and serotonin.Neuropsychopharmacology3674–97.10.1038/npp.2010.151
10
BowerG. H. (1981). Mood and memory.Am. Psychol.36129–148.10.1037/0003-066X.36.2.129
11
CarvalhoA. F.CavalcanteJ. L.CasteloM. S.LimaM. C. (2007). Augmentation strategies for treatment-resistant depression: a literature review.J. Clin. Pharm. Ther.32415–428.10.1111/j.1365-2710.2007.00846.x
12
ClarkD. A.BeckA. T. (2010). Cognitive theory and therapy of anxiety and depression: convergence with neurobiological findings.Trends Cogn. Sci.14418–424.10.1016/j.tics.2010.06.007
13
ClarkL.ChamberlainS. R.SahakianB. J. (2009). Neurocognitive mechanisms in depression: implications for treatment.Annu. Rev. Neurosci.3257–74.10.1146/annurev.neuro.31.060407.125618
14
CloningerC. R.PrzybeckT. R.SvrakicD. M. (1991). The Tridimensional Personality Questionnaire: U.S. normative data.Psychol. Rep.691047–1057. 10.2466/PR0.69.7.1047-1057
15
CoolsR.NakamuraK.DawN. D. (2011). Serotonin and dopamine: unifying affective, activational, and decision functions.Neuropsychopharmacology3698–113.10.1038/npp.2010.121
16
CoolsR.RobinsonO. J.SahakianB. (2008). Acute tryptophan depletion in healthy volunteers enhances punishment prediction but does not affect reward prediction.Neuropsychopharmacology332291–2299.10.1038/sj.npp.1301598
17
CrockettM. J.ClarkL.RobbinsT. W. (2009). Reconciling the role of serotonin in behavioral inhibition and aversion: acute tryptophan depletion abolishes punishment-induced inhibition in humans.J. Neurosci.2911993–11999.10.1523/JNEUROSCI.2513-09.2009
18
CummingsJ. L. (1992). Depression and Parkinson’s disease: a review.Am. J. Psychiatry149443–454.
19
DeakinJ. F. (1991). Depression and 5HT.Int. Clin. Psychopharmacol. 6(Suppl.3)23–28; discussion 29–31.10.1097/00004850-199112003-00002
20
DeakinJ. F.GraeffF. G. (1991). 5-HT and mechanisms of defence.J. Psychopharmacol.5305–315.10.1177/026988119100500414
21
DelavilleC.NavaillesS.BenazzouzA. (2012). Effects of noradrenaline and serotonin depletions on the neuronal activity of globus pallidus and substantia nigra pars reticulata in experimental parkinsonism.Neuroscience202424–433.10.1016/j.neuroscience.2011.11.024
22
Di SimplicioM.NorburyR.HarmerC. J. (2012). Short-term antidepressant administration reduces negative self-referential processing in the medial prefrontal cortex in subjects at risk for depression.Mol. Psychiatry17503–510.10.1038/mp.2011.16
23
DunlopB. W.NemeroffC. B. (2007). The role of dopamine in the pathophysiology of depression.Arch. Gen. Psychiatry64327–337.10.1001/archpsyc.64.3.327
24
ElliottR.SahakianB. J.HerrodJ. J.RobbinsT. W.PaykelE. S. (1997). Abnormal response to negative feedback in unipolar depression: evidence for a diagnosis specific impairment.J. Neurol. Neurosurg. Psychiatry6374–82.10.1136/jnnp.63.1.74
25
ElliottR.SahakianB. J.MckayA. P.HerrodJ. J.RobbinsT. W.PaykelE. S. (1996). Neuropsychological impairments in unipolar depression: the influence of perceived failure on subsequent performance.Psychol. Med.26975–989.10.1017/S0033291700035303
26
EshelN.RoiserJ. P. (2010). Reward and punishment processing in depression.Biol. Psychiatry68118–124.10.1016/j.biopsych.2010.01.027
27
FolsteinM. F.FolsteinS. E.MchughP. R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician.J. Psychiatr. Res.12189–198.10.1016/0022-3956(75)90026-6
28
GodlewskaB. R.NorburyR.SelvarajS.CowenP. J.HarmerC. J. (2012). Short-term SSRI treatment normalises amygdala hyperactivity in depressed patients.Psychol. Med.422609–2617.10.1017/S0033291712000591
29
GotlibI. H.JoormannJ. (2010). Cognition and depression: current status and future directions.Annu. Rev. Clin. Psychol.6285–312.10.1146/annurev.clinpsy.121208.131305
30
GraeffF. G.GuimaraesF. S.De AndradeT. G.DeakinJ. F. (1996). Role of 5-HT in stress, anxiety, and depression.Pharmacol. Biochem. Behav.54129–141.10.1016/0091-3057(95)02135-3
31
HaberS. N.KnutsonB. (2010). The reward circuit: linking primate anatomy and human imaging.Neuropsychopharmacology354–26.10.1038/npp.2009.129
32
HarmerC. J.GoodwinG. M.CowenP. J. (2009). Why do antidepressants take so long to work? A cognitive neuropsychological model of antidepressant drug action.Br. J. Psychiatry195102–108. 10.1192/bjp.bp.108.051193
33
HenriquesJ. B.GlowackiJ. M.DavidsonR. J. (1994). Reward fails to alter response bias in depression.J. Abnorm. Psychol.103460–466.10.1037/0021-843X.103.3.460
34
HerzallahM. M.MoustafaA. A.MiskA. J.Al-DweibL. H.AbdelrazeqS. A.MyersC. E.et al (2010). Depression impairs learning whereas anticholinergics impair transfer generalization in Parkinson patients tested on dopaminergic medications.Cogn. Behav. Neurol.2398–105.10.1097/WNN.0b013e3181df3048
35
HerzallahM. M.MoustafaA. A.NatshehJ. Y.DanounO. A.SimonJ. R.TayemY. I.et al (2013). Depression impairs learning, whereas the selective serotonin reuptake inhibitor, paroxetine, impairs generalization in patients with major depressive disorder.J. Affect. Disord.10.1016/j.jad.2013.06.030[Epub ahead of print].
36
KahnemanD.TverskyA. (1979). Prospect theory: an analysis of decision under risk.Econometrica47263–289.10.2307/1914185
37
KishS. J.ShannakK.HornykiewiczO. (1988). Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson’s disease.Pathophysiologic and clinical implications. N. Engl. J. Med.318876–880.10.1056/NEJM198804073181402
38
KitaichiY.InoueT.NakagawaS.BokuS.KakutaA.IzumiT.et al (2010). Sertraline increases extracellular levels not only of serotonin, but also of dopamine in the nucleus accumbens and striatum of rats.Eur. J. Pharmacol.64790–96.10.1016/j.ejphar.2010.08.026
39
LeentjensA. F.Van Den AkkerM.MetsemakersJ. F.LousbergR.VerheyF. R. (2003). Higher incidence of depression preceding the onset of Parkinson’s disease: a register study.Mov. Disord.18414–418.10.1002/mds.10387
40
MalbergJ. E.SchechterL. E. (2005). Increasing hippocampal neurogenesis: a novel mechanism for antidepressant drugs.Curr. Pharm. Des.11145–155.10.2174/1381612053382223
41
McCabeC.MishorZ.CowenP. J.HarmerC. J. (2010). Diminished neural processing of aversive and rewarding stimuli during selective serotonin reuptake inhibitor treatment.Biol. Psychiatry67439–445.10.1016/j.biopsych.2009.11.001
42
McCabeC.MishorZ.FilippiniN.CowenP. J.TaylorM. J.HarmerC. J. (2011). SSRI administration reduces resting state functional connectivity in dorso-medial prefrontal cortex.Mol. Psychiatry16592–594.10.1038/mp.2010.138
43
McFarlandB. R.KleinD. N. (2009). Emotional reactivity in depression: diminished responsiveness to anticipated reward but not to anticipated punishment or to nonreward or avoidance.Depress. Anxiety26117–122.10.1002/da.20513
44
MoggK.BradleyB. P.WilliamsR. (1995). Attentional bias in anxiety and depression: the role of awareness.Br. J. Clin. Psychol. 34 (Pt1)17–36.10.1111/j.2044-8260.1995.tb01434.x
45
NuttD.DemyttenaereK.JankaZ.AarreT.BourinM.CanonicoP. L.et al (2007). The other face of depression, reduced positive affect: the role of catecholamines in causation and cure.J. Psychopharmacol.21461–471.10.1177/0269881106069938
46
NuttD. J. (2006). The role of dopamine and norepinephrine in depression and antidepressant treatment.J. Clin. Psychiatry 67(Suppl.6)3–8.
47
RobinsonO. J.CoolsR.CarlisiC. O.SahakianB. J.DrevetsW. C. (2012a). Ventral striatum response during reward and punishment reversal learning in unmedicated major depressive disorder.Am. J. Psychiatry169152–159.10.1176/appi.ajp.2011.11010137
48
RobinsonO. J.CoolsR.SahakianB. J. (2012b). Tryptophan depletion disinhibits punishment but not reward prediction: implications for resilience.Psychopharmacology (Berl.)219599–605.10.1007/s00213-011-2410-5
49
RoiserJ. P.SahakianB. J. (2013). Hot and cold cognition in depression.CNS Spectr.18139–149.10.1017/S1092852913000072
50
SchultzW.DayanP.MontagueP. R. (1997). A neural substrate of prediction and reward.Science2751593–1599.10.1126/science.275.5306.1593
51
SchuurmanA. G.Van Den AkkerM.EnsinckK. T.MetsemakersJ. F.KnottnerusJ. A.LeentjensA. F.et al (2002). Increased risk of Parkinson’s disease after depression: a retrospective cohort study.Neurology581501–1504.10.1212/WNL.58.10.1501
52
ShelineY. I.BarchD. M.DonnellyJ. M.OllingerJ. M.SnyderA. Z.MintunM. A. (2001). Increased amygdala response to masked emotional faces in depressed subjects resolves with antidepressant treatment: an fMRI study.Biol. Psychiatry50651–658.10.1016/S0006-3223(01)01263-X
53
StoyM.SchlagenhaufF.SterzerP.BermpohlF.HageleC.SuchotzkiK.et al (2011). Hyporeactivity of ventral striatum towards incentive stimuli in unmedicated depressed patients normalizes after treatment with escitalopram.J. Psychopharmacol.26677–688.10.1177/0269881111416686
54
VeigaB. A.BorgesV.SilvaS. M.Goulart FdeO.CendorogloM. S.FerrazH. B. (2009). Depression in Parkinson’s disease: clinical–epidemiological correlates and comparison with a controlled group of non-parkinsonian geriatric patients.Rev. Bras. Psiquiatr.3139–42.10.1590/S1516-44462009000100010
55
WalterU.HoeppnerJ.Prudente-MorrisseyL.HorowskiS.HerpertzS. C.BeneckeR. (2007). Parkinson’s disease-like midbrain sonography abnormalities are frequent in depressive disorders.Brain1301799–1807.10.1093/brain/awm017
56
WattsA.GrittonH. J.SweigartJ.PoeG. R. (2012). Antidepressant suppression of non-REM sleep spindles and REM sleep impairs hippocampus-dependent learning while augmenting striatum-dependent learning.J. Neurosci.3213411–13420.10.1523/JNEUROSCI.0170-12.2012
57
WrightJ. H.BeckA. T. (1983). Cognitive therapy of depression: theory and practice.Hosp. Community Psychiatry341119–1127.
Summary
Keywords
major depressive disorder, selective serotonin reuptake inhibitor, basal ganglia, reward, punishment
Citation
Herzallah MM, Moustafa AA, Natsheh JY, Abdellatif SM, Taha MB, Tayem YI, Sehwail MA, Amleh I, Petrides G, Myers CE and Gluck MA (2013) Learning from negative feedback in patients with major depressive disorder is attenuated by SSRI antidepressants. Front. Integr. Neurosci. 7:67. doi: 10.3389/fnint.2013.00067
Received
10 April 2013
Accepted
26 August 2013
Published
23 September 2013
Volume
7 - 2013
Edited by
Kae Nakamura, Kansai Medical University, Japan
Reviewed by
Albino J. Oliveira-Maia, Champalimaud Foundation, Portugal; Gina R. Poe, University of Michigan, USA
Copyright
© Herzallah, Moustafa, Natsheh, Abdellatif, Taha, Tayem, Sehwail, Amleh, Petrides, Myers and Gluck.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Mohammad M. Herzallah, Al-Quds Cognitive Neuroscience Lab, Faculty of Medicine, Al-Quds University, P.O. Box 20002, Abu Dis, Palestinian Territories; Center for Molecular and Behavioral Neuroscience, Rutgers University, 197 University Avenue, Room 209, Newark, NJ 07102, USA e-mail: mohammad.m.herzallah@gmail.com
This article was submitted to the journal Frontiers in Integrative Neuroscience.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.