A Predictive Coding Framework for Understanding Major Depression
Jessica R. Gilbert
Christina Wusinich
Carlos A. Zarate Jr.- Experimental Therapeutics and Pathophysiology Branch, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, United States
Predictive coding models of brain processing propose that top-down cortical signals promote efficient neural signaling by carrying predictions about incoming sensory information. These “priors” serve to constrain bottom-up signal propagation where prediction errors are carried via feedforward mechanisms. Depression, traditionally viewed as a disorder characterized by negative cognitive biases, is associated with disrupted reward prediction error encoding and signaling. Accumulating evidence also suggests that depression is characterized by impaired local and long-range prediction signaling across multiple sensory domains. This review highlights the electrophysiological and neuroimaging evidence for disrupted predictive processing in depression. The discussion is framed around the manner in which disrupted generative predictions about the sensorium could lead to depressive symptomatology, including anhedonia and negative bias. In particular, the review focuses on studies of sensory deviance detection and reward processing, highlighting research evidence for both disrupted generative predictions and prediction error signaling in depression. The role of the monoaminergic and glutamatergic systems in predictive coding processes is also discussed. This review provides a novel framework for understanding depression using predictive coding principles and establishes a foundational roadmap for potential future research.
Introduction
The predictive coding framework suggests that the brain functions to minimize surprise and uncertainty by actively generating explanations for encountered stimuli (Friston, 2009). The framework is rooted in Bayesian probability theory and the so-called Bayesian brain hypothesis (Knill and Pouget, 2004) that conceptualizes perception as a constructive process that uses internal or generative models to encode prior beliefs about sensory inputs and their causes. Generative models help an individual formulate predictions about incoming sensory information that are tested against incoming sensory inputs and produce prediction errors. Prediction errors, in turn, are used by the brain to revise its model of the world by updating predictions in order to minimize prediction errors (Friston, 2010). Recent work has extended these ideas to cognitive phenomena related to interoception (Seth, 2013), including the shaping of emotions (Seth and Friston, 2016; Clark et al., 2018) and the development of depression (Barrett et al., 2016; Kube et al., 2020).
Interoception, broadly defined as the sense of the physiological condition of the body (Craig, 2002), is proposed to be the sensory consequence of allostasis, the regulation of metabolism and bodily states (Barrett et al., 2016). Several recent reviews have focused on the role of predictive processes related to interoception in the etiology and pathophysiology of depression (Barrett and Simmons, 2015; Barrett et al., 2016; Stephan et al., 2016; Eggart et al., 2019). Rather than focusing on interoceptive processes, this review examines the electrophysiological and neuroimaging evidence regarding predictive coding deficits in exteroception in depression, focusing on sensory deviance detection and reward processing deficits that accompany major depressive disorder (MDD).
Bayesian models can be used to inform our understanding of neural and circuit-level dysfunction concomitant with psychiatric conditions such as MDD because they relate formal information-processing algorithms to underlying neural signals (O’Reilly et al., 2012). In current models of Bayesian brain updating, for example, predictions are thought to be carried by descending feedback from deep pyramidal cortical layers and to interact with ascending, feedforward prediction error signals from superficial cortical layers (Rao and Ballard, 1999; Friston and Kiebel, 2009; Bastos et al., 2012; Shipp et al., 2013). These prediction error signals serve to update an individual’s expectations, with the precision or confidence placed in prediction errors associated with the synaptic gain or efficacy of superficial pyramidal cell signaling. From a theoretical standpoint, a model such as this can help elucidate cardinal differences between individuals with MDD and healthy participants because the fitting of experimental data to such a model can provide a mechanistic understanding of differences between groups. For example, such models could help an investigator test whether deficits in MDD are related to faulty internal generative models and resultant prediction error signaling associated with incoming sensory information. These models could also be used to make inferences about where prediction error signals originate in the cortex, and these regions can be probed to determine whether activity in a given region is associated with specific features of depressive symptomatology.
This review will highlight the electrophysiological and neuroimaging evidence for disrupted predictive processing in MDD, conceptually framing the discussion around Bayesian models of uncertainty and how disrupted generative predictions about the sensorium might lead to depressive symptomatology, including anhedonia and negative bias. This review will highlight studies of sensory deviance detection and reward processing in particular, describing research evidence for both disrupted predictions and prediction error signaling in MDD. Gaps in the literature where further research is warranted will also be discussed. Finally, the role of the monoaminergic and glutamatergic systems in generating these signals will be examined. This review provides a novel framework for understanding MDD using predictive coding principles and establishes a foundational roadmap for potential future research.
Disrupted Sensory Deviance Detection in Major Depressive Disorder
Sensory deviance detection—broadly defined as the ability to detect deviant stimuli while attending to a stream of incoming sensory information—is thought to reflect pre-attentive sensory processing (Schröger, 1998; Restuccia et al., 2006; Czigler, 2007). One technique for studying pre-attentive change detection involves using an oddball paradigm where a series of frequent stimuli (e.g., tones of a specific pitch “standard”) are occasionally interrupted by less-frequent stimuli (e.g., tones of a higher pitch “deviant”). These kinds of paradigms have traditionally been collected using electrophysiological techniques such as electroencephalography (EEG) and magnetoencephalography (MEG) because the temporal components of event-related potentials (ERPs) generated in response to these stimuli have consistent response characteristics and well-documented neural generators (Garrido et al., 2009). In particular, a negative component in the event-related waveform is elicited by deviant relative to standard stimuli, which has been termed the mismatch negativity (MMN) response. The MMN response is considered an index of change detection processes (Näätänen et al., 2012) and, within a prediction coding framework, is thought to represent prediction error signaling (Friston, 2005). Generators of MMN electrophysiological signatures have been localized to primary and secondary auditory, visual, somatosensory, and olfactory cortices, and they have also been localized to higher-order regions, including the frontal cortex (Garrido et al., 2009).
Studies of the MMN response in MDD patients have reported mixed findings regarding waveform topographical changes accompanying MDD (see Table 1). The amplitude and latency of the characteristic MMN response—which occurs at approximately 100–250 ms after stimulus onset—has been measured in individuals with MDD relative to healthy participants. While some studies have reported that the MMN amplitude is attenuated in currently medicated and unmedicated MDD patients relative to healthy participants (Takei et al., 2009; Qiu et al., 2011; Qiao et al., 2013; Chen et al., 2015; Tseng et al., 2021), other studies have reported that the MMN amplitude is increased in unmedicated MDD patients (Kähkönen et al., 2007; He et al., 2010). Other studies found hemispheric asymmetries in the MMN response in MDD patients, with reduced MMN amplitudes in the right but not the left hemisphere in medicated MDD patients compared to healthy participants (Hirakawa et al., 2017). Furthermore, other studies reported MMN latency differences in MDD, with patients demonstrating slower peak MMN latencies than healthy participants (Qiao et al., 2013; Tseng et al., 2021). Finally, a small number of studies reported MMN amplitude changes for specific sensory features of oddball stimuli (e.g., timbre and tone duration), but not others (e.g., pitch, intensity, or location) in MDD patients (Mu et al., 2016; Tseng et al., 2021). Taken together, these findings provide preliminary evidence that MDD is accompanied by an inability to accurately predict forthcoming sensory information, though significant inconsistencies exist with regard to whether the MMN amplitude is larger or smaller and whether it is shifted in time compared to healthy participants.
Table 1. Sensory deviance detection disruptions in MDD.
In addition to examining differences in MMN amplitudes and latencies, an important clinical question is whether differences in pre-attentive change detection are associated with depressive symptomatology in MDD. Several studies have examined whether changes in components elicited during an oddball task are associated with severity of depressive symptoms or other clinical measures of functional outcomes. For example, a recent study comparing both medicated and unmedicated MDD patients to healthy participants found that clinical measures of functional outcomes for MDD patients were associated with MMN source activity in regions including the anterior cingulate and the inferior and middle frontal gyri, though no significant differences in MMN amplitudes were noted in MDD patients compared to healthy participants (Kim et al., 2020). Other studies that did not source-localize MMN generators found no significant associations between severity of depressive symptoms and MMN amplitudes or latencies (He et al., 2010; Mu et al., 2016; Tseng et al., 2021), though earlier and later waveform components, such as the attenuation of the P1 (Kähkönen et al., 2007) and the amplitude of the P3a (Chen et al., 2015), have been associated with clinical characteristics such as severity of depressive symptoms and the number of depressive episodes reported by patients. The P1 is a positive ERP waveform component occurring approximately 100 ms after stimulus presentation and thought to reflect initial sensory attentional processing, while the P3a is a positive component occurring approximately 250–280 ms after stimulus presentation that localizes to fronto-central electrode sites and reflects attentional orienting and novelty detection processes. Taken together, the evidence suggests that gross changes in MMN response characteristics such as amplitude and latency are indeed associated with clinical measures reflecting the severity of depressive symptoms. Further research should continue to explore the relationship between source-localized generators of the MMN signal and depressive symptomatology, given that source-localized MMN response estimates in regions such as the anterior cingulate and inferior frontal gyrus could provide a stronger index of the severity of depressive symptoms compared to waveform characteristics alone.
Inconsistencies in MMN response findings in MDD may be due to several factors, including differences in the sensory modality under study, manipulations regarding what constitutes standard and deviant stimuli, sample sizes, and recruitment criteria for MDD samples. For example, some studies recruited drug-free patients only, while others included a mixture of medicated and unmedicated patients. Special caution should be exercised in interpreting studies where the samples include medicated patients, particularly those in which patients are taking selective serotonin reuptake inhibitors (SSRIs), the most widely prescribed antidepressants. This is because serotonin (5-hydroxytryptamine, 5-HT) is thought to play an important role in salience detection (see “Antidepressant Drugs and Predictive Processes,” below). The heterogeneity of findings regarding deficits in the MMN response in MDD across studies may also be explained by the underlying heterogeneity of MDD symptomatology. For example, the MMN response has been hypothesized to index cognitive decline across different psychiatric disorders (Näätänen et al., 2012), suggesting that dysregulated sensory change detection, as indexed by the MMN response, might have prognostic importance in MDD.
As research expands our understanding of the sensory deviance detection deficits that accompany MDD, it is important to keep in mind the potential applications of this work. For example, a better understanding of the brain circuitry supporting prediction errors in sensory processing and their connectivity would improve our understanding of how feedforward and feedback signaling interact as well as illuminate the ways that these might be dysregulated in MDD. In addition, understanding the relationship between MMN signaling deficits and depression symptomatology could lead to the development of a simple, robust biomarker of symptom severity. Such work also fits within the larger Research Domain Criteria (RDoC) framework examing the relationship between neural circuitry disruption and dimensional symptomatology associated with mental disorders.
Disrupted Reward Prediction and Prediction Error Signaling in Major Depressive Disorder
Reinforcement learning, the process by which behavior is modified through experiences with reward and punishment, offers a theoretical framework for studying the neural circuity supporting decision making under conditions of uncertainty (Schultz, 2006). Several lines of evidence now suggest that dysfunctional reinforcement learning processes and dysregulated reward circuity might underlie some symptoms of MDD (Pizzagalli, 2014). Anhedonia, or hyposensitivity to rewards, is a cardinal symptom of MDD and is associated with worse outcomes, including poor treatment response and greater prevalence of suicidal thoughts and behaviors (Eshel and Roiser, 2010; Spijker et al., 2010; Pizzagalli, 2014; Vrieze et al., 2014; Winer et al., 2016; Yaseen et al., 2016; Loas et al., 2018). Negative bias—a hypersensitivity to punishment and a bias in expectation of negative events—is another common feature of MDD (Gotlib, 1983; Eshel and Roiser, 2010; Rouhani and Niv, 2019). It is worth noting that, though conceptualized distinctly, neural correlates of anhedonia and negative bias may overlap and mutually influence depressive symptoms and differences in reward processing.
Reinforcement learning paradigms using monetary incentives provide an avenue for modeling brain circuitry disruptions in reward processing associated with anhedonia and negative bias. During such tasks, discrepancies between an expected reward and a given reward produce reward prediction errors (RPEs). The neural correlates underlying belief updating, during which a participant alters their framework to make more accurate predictions to subsequent trials, can be examined. Growing evidence suggests that key neural regions mediating RPE signaling include the lateral habenula, the ventral tegmental area (VTA), and the substantia nigra (Matsumoto and Hikosaka, 2007). The lateral habenula occupy a set of nuclei within the posterior-dorsal-medial region of the thalamus that are thought to have an important role in reward learning behavior [for a recent review of the circuity and functions of the lateral habenula, see Hu et al. (2020)]. The lateral habenula acts as a relay station by connecting the limbic forebrain with monoaminergic centers implicated in the pathophysiology of depression and has been proposed to participate in processing negatively valenced information (Yang et al., 2018b). Animal studies have demonstrated that lateral habenula neurons transmit RPEs in an inverted fashion (Matsumoto and Hikosaka, 2007, 2009a) and can suppress both activity in dopamine neurons (Christoph et al., 1986; Ji and Shepard, 2007) and motivated behaviors (Shumake et al., 2010; Friedman et al., 2011). While many lateral habenula neurons transmit information related to motivational salience (Matsumoto and Hikosaka, 2009b; Bromberg-Martin and Hikosaka, 2011), a subset of these neurons transmit information related to motivational value and exert control over selective positive RPE (i.e., signaling more reward than anticipated) and negative RPE (i.e., signaling less reward than anticipated) dopamine neurons (Matsumoto and Hikosaka, 2009b). Reward-related dopamine signals from the midbrain are broadcast to various regions of the cortex, including the striatum (particularly the nucleus accumbens), the prefrontal cortex, and the amygdala (Schultz, 2007; Niv and Montague, 2009).
Reward processing involves several distinct stages, and many studies have focused on the neural circuitry supporting the reward anticipation and feedback periods. Reward-related learning in particular is thought to occur through RPEs encoded by striatal dopamine signals (Schultz, 2016b). Several lines of evidence suggest that, compared to healthy participants, both medicated and unmedicated MDD patients have blunted RPE signaling within the ventral striatum during reward feedback (see Table 2; Zhang et al., 2013; Keren et al., 2018; Kumar et al., 2018), and EEG studies have consistently reported significant reductions in the feedback-related negativity (FRN) ERP component in medicated and unmedicated MDD patients compared to healthy participants (Keren et al., 2018). In addition, some studies have suggested that VTA-striatal connectivity is blunted in response to reward feedback in unmedicated MDD patients compared to healthy participants (Kumar et al., 2018). However, other researchers have found seemingly contradictory results regarding RPE signaling in the striatum. For example, Rutledge and colleagues (2017) found that ventral striatum RPE signaling did not significantly differ between medicated MDD patients and healthy participants, while a recent review identified discrepancies in blunting or lack of blunting of ventral striatum signals during RPEs in MDD patients (Yaple et al., 2021). Taken together, a growing consensus suggests that MDD is accompanied by changes in dopaminergic signaling that affect reward-related outcomes in the striatum, though significant inconsistencies remain regarding whether the striatal activation is blunted or increased in MDD.
Table 2. Reward prediction and prediction error disruptions in MDD.
As with MMN response changes accompanying depression, an important clinical question is whether differences in striatal activity or other aspects of reward processing are associated with depressive symptomatology. Recent research suggests that blunting of striatal RPE signaling is associated with the number of depressive episodes reported by patients, indicating that MDD has an increasing impact on reward learning processes over time (Kumar et al., 2018). Similarly, signals in the habenula have also been correlated with the number of depressive episodes experienced by MDD patients (Kumar et al., 2018). A recent meta-analysis of studies using reward tasks in depression found that blunting of both striatal activation and the FRN response were associated with depressive symptomatology, though changes in the metrics that accompanied symptom severity did not reach levels that would be useful for clinical prediction (Nielson et al., 2021). Taken together, these findings suggest that RPE signaling deficits, as indexed by reductions in striatal activation and the FRN component of the M/EEG, are potentially useful biomarkers of MDD; nevertheless, more research is warranted to determine whether these brain circuitry changes may play a causal role in the development of depression (Nielson et al., 2021).
As previously noted in relation to the MMN response, inconsistencies in neurophysiological RPE findings in MDD may be due to a number of factors, including sample size and recruitment criteria, medication status, and differences in reward tasks and incentives and punishments. In addition, the heterogeneity of findings on RPEs in MDD may also be explained by underlying heterogeneity in MDD symptomatology. The severity of anhedonia, in particular, might be a useful construct for analyzing RPE signals in this context. One study that included anhedonia in its framework found that, for MDD patients, higher levels of anhedonia were associated with reduced RPE signals in the ventral striatum and medial orbitofrontal cortex (Rothkirch et al., 2017). Another study found that among those with and without an MDD diagnosis, severity of anhedonia moderated the relationship between reward expectancy and RPE signaling in ventral striatum; this suggests that those with worse symptoms of anhedonia may experience deficits in related aspects of reward learning regardless of diagnosis (Greenberg et al., 2015). Such subtyping work has also demonstrated that resting-state hyperconnectivity between thalamic and frontostriatal networks, including the reward-related circuitry discussed here, is associated with a depressive biotype characterized by increased anhedonia and psychomotor retardation (Drysdale et al., 2017).
As research in this area expands and our neuroscientific understanding of predictive coding deficits in depression is refined, it is important to consider the real-world applications of this work. For example, a better understanding of RPE signaling in reward tasks might increase our understanding of the neural processes that mediate anhedonia and negative bias, allowing the development of more refined and better targeted pharmaceutical and psychotherapeutic interventions. Given the connection between altered reward learning and decision making processes, this research also has implications for suicide-related interventions (Dombrovski et al., 2013).
Antidepressant Drugs and Predictive Processes
Presently, most approved antidepressant drugs target the monoaminergic system and regulate the reuptake, metabolism, or receptor pharmacodynamics of the neurotransmitters 5-HT and norepinephrine (also called noradrenaline). The typical onset of beneficial drug effects for these antidepressants takes several weeks (Quitkin et al., 1984; Gelenberg and Chesen, 2000), though mounting evidence suggests that earlier clinical and cognitive processing changes may help predict treatment outcomes (Katz et al., 1996; Harmer et al., 2009). More recently, the glutamatergic modulator ketamine has gained attention as a novel therapeutic that produces rapid-acting antidepressant effects in individuals with treatment-resistant MDD that manifest within hours of administration and last days (Zarate et al., 2006; Kishimoto et al., 2016). Concomitantly, in 2019 the FDA approved esketamine (the intranasally-administered S-enantiomer of ketamine) as an adjunctive treatment option for depression. This section explores the current state of the literature regarding the role of monoaminergic and glutamatergic [particularly via the N-methyl-D-aspartate (NMDA) receptor] signaling in predictive coding processes. Where appropriate, research evidence that highlights the effects of monoaminergic and glutamatergic antidepressant therapeutics on these processes in both MDD patients and healthy participants is also presented.
Monoaminergic Drugs
5-HT, norepinephrine, and dopamine are monoamines involved in a wide range of physiological and homeostatic processes. 5-HT, for example, has been implicated in a range of behaviors, including regulating the sleep-wake cycle and hormonal levels as well as influencing cognition, sensorimotor behaviors, and emotions (Jacobs and Azmitia, 1992). Norepinephrine has been implicated in regulating arousal and adapting network activity by influencing neuromodulatory neurons and peripheral arousal levels to support adaptive, flexible behavioral responses (Sara and Bouret, 2012).
Pre-attentive sensory processing research suggests that 5-HT is important for salience detection and potentially regulates the speed of change detection during sensory tasks (Kähkönen et al., 2005). In the primary visual cortex, for instance, the distribution of 5-HT-ergic axons appears to be highest in input layer IV of the cortex (Kosofsky et al., 1984; Morrison and Foote, 1986). In contrast, while 5-HT-ergic axons are consistently found in layer IV in primary auditory and somatosensory cortices, the distribution does not appear to be preferential (Wilson and Molliver, 1991a,b). Despite variability in the distribution of 5-HT-ergic axons across sensory modalities, studies have consistently shown that 5-HT modulates the salience of sensory inputs across modalities (Jacob and Nienborg, 2018). While the role of 5-HT in salience detection has been well documented, its role in the MMN response is less clear. In healthy participants, studies using acute tryptophan depletion (ATD)—which rapidly reduces the amino acid precursor of 5-HT and 5-HT metabolite concentrations in cerebrospinal fluid—have produced mixed findings. While some studies reported that ATD increased MMN amplitudes and reduced latencies (Kähkönen et al., 2005), other studies found either reduced MMN amplitudes (Ahveninen et al., 2002) or no differences in MMN responses following ATD (Leung et al., 2009). These discrepancies might be due to methodological differences in preprocessing approaches and other analytical techniques, including choices related to M/EEG source localization techniques (Fusar-Poli et al., 2006). In addition, while ATD is thought to reduce 5-HT release and subsequently blunt neurotransmission, there is no direct evidence that it decreases extracellular 5-HT concentrations. Caution is thus needed when interpreting its selective 5-HT effects (van Donkelaar et al., 2011).
The role of 5-HT in reward processing is less clear than for sensory deviance detection, and our current understanding derives from the observation that 5-HT has an opponent relationship with dopamine (Kapur and Remington, 1996; Daw et al., 2002). Phasic levels of dopaminergic activity are known to signal positive and negative RPEs related to how different the current reward is from ongoing predictions of long-running rewards (Schultz et al., 1997; Schultz, 2016b). Given the opponent relationship between dopamine and 5-HT, one theory regarding 5-HT’s role in reward signaling is that phasic levels of 5-HT signal punishment prediction errors related to how different the current punishment is from ongoing predictions of future punishment (Daw et al., 2002). An extension of this model also accounts for how tonic 5-HT levels may represent the opportunity costs of waiting to avoid punishments (Cools et al., 2011). Studies using ATD and reward learning tasks in healthy participants have produced mixed findings, echoing studies that used MMN response tasks. One review of 36 studies that used ATD during reward learning tasks reported that lower 5-HT levels resulted in reduced sensitivity to punishments in nine of the 36 studies, with the authors noting that further research was warranted to clarify the role of 5-HT in reward tasks (Faulkner and Deakin, 2014). Similar caution should be used when interpreting results regarding 5-HT’s role in reward processing, as previously discussed in relation to sensory deviance detection.
Research examining the role of norepinephrine in sensory processing indicates that it plays a complex modulatory role in sensory signaling (Jacob and Nienborg, 2018). Norepinephrine innervation in the somatosensory cortex is both uniform and dense across cortical layers (Morrison et al., 1982; Lewis et al., 1987). Unlike 5-HT, however, norepinephrine innervation in primary auditory and visual cortices is sparse across layers and virtually absent in layer IV (Foote and Pineda, 1993). Given the sparse distribution of norepinephrine receptors in auditory and visual cortices, norepinephrine’s primary role in sensory processing appears to be in modulating NMDA receptor-mediated glutamate responses (Devilbiss and Waterhouse, 2000), gating long-term plasticity (LTP) of glutamatergic synapses, and increasing the gain of local inhibitory synapses (Salgado et al., 2016). Because norepinephrine plays only an indirect role in sensory cortex signaling via modulation of glutamatergic mechanisms, little research has examined its specific role in sensory deviance detection.
While norepinephrine’s role in sensory processing is understudied, recent work has begun to examine its role in reward-related tasks. In particular, recent evidence suggests that norepinephrine plays a role in modulating glutamatergic synapses in the nucleus accumbens, and that it might tune feedforward inhibition and impact reward-related circuitry as well as motivational states (Manz et al., 2021). Animal studies have also suggested that norepinephrine is associated with the amount of effort required to perform a reward task (here, force exerted on a grip in order to receive a reward) and that this effort is distinct from reward sensitivity (Varazzani et al., 2015; Borderies et al., 2020). While norepinephrine’s role in reward-related tasks is also understudied, current findings suggest that it plays an important role in modulating motivation and effort levels. One particularly relevant area for future research regarding where motivation and effort influence reward-related behavior would be determining the opportunity costs associated with seeking or avoiding rewards and punishments. Perhaps norepinephrine and 5-HT operate synergistically in this regard to support motivated behaviors to continue to seek rewards or avoid punishments.
Given the proposed role of 5-HT and norepinephrine in predictive coding processes, it is useful to consider the effect of antidepressant drugs that target the monoaminergic system on sensory deviance detection and reward processing. While many previously reviewed studies of the MMN response and reward processing included medicated patients, the heterogeneity of medications and the inclusion of both medicated and unmedicated samples makes it difficult to tease apart the role that specific neurotransmitters may have played in predictive processing. Another way to approach this experimentally is to give antidepressant drugs to healthy participants. Such studies found that drugs such as escitalopram, the therapeutically-active S-enantiomer of citalopram [a highly selective serotonin reuptake inhibitor (SSRI)], increase MMN amplitudes in healthy participants (Oranje et al., 2008; Wienberg et al., 2010). In addition, research with citalopram using appetizing and aversive food picture stimuli found reduced ventral striatum and ventral medial/orbitofrontal cortex activation in healthy participants to appetizing foods such as chocolate (McCabe et al., 2010). Research with reboxetine, a norepinephrine reuptake inhibitor, found increased neural responses in the medial orbitofrontal cortex to the same appetizing foods (McCabe et al., 2010). One difficulty with using such dosing studies to inform our understanding of how predictive coding might be altered in MDD is that these antidepressants have a delayed onset of action of several weeks. Research on antidepressant drugs that selectively downregulate the 5-HT or norepinephrine transporter found that they produced a marked loss of binding sites for the targeted neurotransmitter over an overlapping 2–3 week time window corresponding with antidepressant efficacy (Frazer and Benmansour, 2002). Some drug studies have tried to account for this delay by having healthy participants take such drugs over several days (e.g., 7 days) (McCabe et al., 2010), while other studies have examined drug effects after only a single dose (Oranje et al., 2008; Wienberg et al., 2010). One study of the serotonin-norepinephrine reuptake inhibitor (SNRI) duloxetine in healthy participants used a 2-week daily dosing regimen and found increased ventral striatum responses during a reward task (Ossewaarde et al., 2011). Further work is needed using this longer-term dosing approach that overlaps with antidepressant response to the drug in order to better characterize the roles of 5-HT and norepinephrine in predictive coding processes. As a final point, recent research has begun to explore the antidepressant efficacy of “classic” 5-HT-ergic psychedelics including psilocybin and lysergic acid diethylamide-25 in MDD patients. Examining how such drugs impact both the MMN response and reward processing are promising directions for future research.
Finally, a new class of antidepressant drugs target dopamine, in addition to 5-HT and norepinephrine. Therefore, it is useful to consider the role of dopamine in predictive processes related to the MMN response and reward-related signaling. The role of dopamine in sensory signaling is understudied, though it is thought to play an important role in modulating human attention and arousal (Coull, 1998). Limited research examining the effects of haloperidol, a partially selective dopamine D2 receptor antagonist, demonstrated that drug administration did not affect the source location or amplitude of the MMN response in healthy participants, suggesting that dopamine does not have a role in sensory deviance detection processes per se (Kähkönen et al., 2002). However, the drug was found to influence the amplitude of the MMN response in healthy participants during a condition where participants selectively attended to one of two simultaneously presented auditory streams, suggesting that dopamine plays a specific role in the involuntary detection of task-irrelevant deviants (Kähkönen et al., 2001). Studies examining the MMN response in healthy participants following acute tyrosine/phenylalanine depletion also suggest that reducing dopamine neurotransmission has no effect on the MMN response (Leung et al., 2009). Taken together, these findings suggest that dopamine is not directly involved in predictive coding processes at the level of sensory inputs.
Much more is known about dopamine’s role in reward processing and RPE signaling, as has been previously discussed (Matsumoto and Hikosaka, 2007; Schultz, 2007; Matsumoto and Hikosaka, 2009b; Schultz, 2016b). However, while animal models consistently demonstrate that dopamine signals code RPEs (Schultz, 2016a), research examining pharmacological manipulations of dopamine in healthy participants offer mixed findings. While dopamine antagonism has been demonstrated to consistently decrease reward learning, dopamine antagonism and dietary manipulations of dopamine offer mixed results (Webber et al., 2021). These discrepancies could be due to a number of factors including drug manipulations, dosing regimens, or the possibility that there is an optimal level of dopamine for reward-related learning, with increases beyond this level impairing reward-related functioning (Vaillancourt et al., 2013). Further research is needed in this area to elucidate how changes in dopamine signaling concomitant with depression are associated with RPE signals.
Glutamatergic Drugs
Glutamate is the primary excitatory neurotransmitter in the brain and is important for regulating cortical excitability and experience-dependent synaptic plasticity and LTP. Glutamatergic signaling deficits have been widely reported in mood disorders including MDD (Choudary et al., 2005; Yüksel and Öngür, 2010; Bernard et al., 2011), and subanesthetic doses of the non-competitive NMDA receptor antagonist ketamine have been shown to rapidly reduce depressive symptoms (Zarate et al., 2006; Kishimoto et al., 2016). Antidepressant response to ketamine appears to rely on both high affinity antagonistic binding properties at the NMDA receptor and alpha-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) throughput modulation (Maeng et al., 2008; Zanos et al., 2016). In the context of predictive coding signaling, this is particularly relevant because AMPA and NMDA receptors may support distinct contributions to feedforward and feedback signaling. For example, in the visual system, AMPA receptors are primarily thought to propagate visual activity from lower to higher-order visual areas, while NMDA receptors modulate recurrent connections (Lumer et al., 1997; Dehaene et al., 2003; Self et al., 2012). Much of what is known about the NMDA receptor’s role in the MMN response and reward processing comes from pharmacological ketamine studies.
Subanesthetic-dose ketamine has been used to model schizophrenia-like effects in healthy participants, and findings from these studies can inform our understanding of the NMDA receptor’s role in sensory deviance detection. In healthy participants, ketamine administration consistently diminished auditory ERP amplitudes during drug infusion (Rosburg and Kreitschmann-Andermahr, 2016; Harms et al., 2021). Electrophysiological findings have also demonstrated that ketamine increases the latency of MMN responses in healthy participants (Umbricht et al., 2000; Kreitschmann-Andermahr et al., 2001), though its effect on amplitude is stronger than its effect on latency (Rosburg and Kreitschmann-Andermahr, 2016). In the context of the MMN response, ketamine administration was found to reduce frontal MMN amplitudes immediately post-infusion and again at 2 h post-infusion in MDD patients; furthermore, immediate change in MMN amplitude predicted antidepressant response (de la Salle, 2022). In contrast, other studies that used a roving auditory oddball task collected 3–4 h post-ketamine infusion in MDD patients found that ketamine administration increased MMN response, but only when all repetitions of the post-deviant tone were analyzed (Sumner et al., 2020). The same study found that feedforward connectivity from the primary auditory cortex to the inferior temporal cortex for the deviant tones was associated with antidepressant response. Taken together, the evidence suggests that ketamine administration consistently and acutely attenuates MMN amplitude and increases its latency in healthy participants, but that findings regarding how ketamine influences MMN response in MDD patients are mixed. Some of this discrepancy could be related to differences in the oddball task design or could be related to differences in the timing of MMN response measurements relative to ketamine administration. Additional work is needed to examine both acute and delayed ketamine effects on MMN response, particularly in unmedicated patients, in order to tease apart transient effects that result from NMDA receptor blockade from more delayed antidepressant effects that result from changes in synaptic efficacy.
Ketamine has also been administered to healthy participants during reward learning tasks. Results indicated that acute subanesthetic ketamine administration attenuated ventral striatum activation during reward anticipation (Francois et al., 2016). Additional research focused on ketamine’s effects on reward processing in MDD patients, in part spurred by recent findings that ketamine blockade of NMDA receptor-dependent bursting activity in the lateral habenula mediated antidepressant response in animal models, with subsequent disinhibitory effects in downstream reward centers (Yang et al., 2018a; Cui et al., 2019). A recent study of unmedicated MDD patients currently in remission found that ketamine increased activation in the nucleus accumbens, putamen, insula, and caudate 2 h post-administration, during the reward feedback period (Kotoula et al., 2021). Another study of medicated MDD patients found that ketamine administration resulted in increased ventral striatum and orbitofrontal cortex activation during both the reward anticipation and feedback periods of a reward task administered 1 day post-infusion (Sterpenich et al., 2019). Taken together, these findings suggest that ketamine improves sensitivity to rewards as indexed by increased activation in the striatum and other reward-related circuitry, and that these effects might be mediated by changes in NMDA receptor-mediated bursting within the lateral habenula. Additional work is needed to examine how changes in activity within these reward-related regions post-ketamine may be associated with antidepressant response in MDD.
Conclusion
The predictive coding framework conceptualizes perception as a constructive process where internal generative models are used to predict incoming sensory inputs and their causes. MDD has traditionally been viewed as a disorder characterized by negative cognitive biases, and these biases could result in disrupted prediction error signaling within this framework. This paper reviewed the evidence for disrupted predictions in MDD in relation to both sensory deviance detection and reward processing and examined the role of 5-HT, norepinephrine, and NMDA receptor-mediated glutamate signaling in these predictive processes. While the evidence suggests that MDD is accompanied by changes in both sensory deviance detection and reward processing, much additional work is needed. Future studies should pay particular attention to medication status in MDD in order to control for the influence of antidepressant drugs on effects of interest. More work is also needed to understand how cardinal symptoms of MDD such as anhedonia and negative bias are associated with reward-related neural processing in particular. Finally, additional studies are needed to understand how 5-HT, norepinephrine, and NMDA receptor-mediated glutamate signaling might synergistically support predictive signaling in both healthy participants and MDD patients.
Author Contributions
All authors listed have made a substantial, direct, and intellectual contribution to the work, and approved it for publication.
Funding
Funding for this work was supported by the Intramural Research Program at the National Institute of Mental Health, National Institutes of Health (IRP-NIMH-NIH; ZIAMH002857). The NIH had no further role in study design; in the collection, analysis, or interpretation of data; in the writing of the report; or in the decision to submit the paper for publication.
Conflict of Interest
CZ was listed as a co-inventor on a patent for the use of ketamine in major depression and suicidal ideation; as a co-inventor on a patent for the use of (2R,6R)-hydroxynorketamine, (S)-dehydronorketamine, and other stereoisomeric dehydroxylated and hydroxylated metabolites of (R,S)-ketamine metabolites in the treatment of depression and neuropathic pain; and as a co-inventor on a patent application for the use of (2R,6R)-hydroxynorketamine and (2S,6S)-hydroxynorketamine in the treatment of depression, anxiety, anhedonia, suicidal ideation, and post-traumatic stress disorders. He has assigned his patent rights to the U.S. Government but will share a percentage of any royalties that may be received by the government.
The remaining author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We thank the 7SE research unit and staff for their support. Ioline Henter (NIMH) provided invaluable editorial assistance.
References
Ahveninen, J., Kähkönen, S., Pennanen, S., Liesivuori, J., Ilmoniemi, R. J., and Jääskeläinen, I. P. (2002). Tryptophan depletion effects on EEG and MEG responses suggest serotonergic modulation of auditory involuntary attention in humans. Neuroimage 16, 1052–1061. doi: 10.1006/nimg.2002.1142
Barrett, L. F., Quigley, K. S., and Hamilton, P. (2016). An active inference theory of allostasis and interoception in depression. Philos. Trans. R. Soc. Lond. B Biol. Sci. 371:20160011. doi: 10.1098/rstb.2016.0011
Barrett, L. F., and Simmons, W. K. (2015). Interoceptive predictions in the brain. Nat. Rev. Neurosci. 16, 419–429. doi: 10.1038/nrn3950
Bastos, A. M., Usrey, W. M., Adams, R. A., Mangun, G. R., Fries, P., and Friston, K. J. (2012). Canonical Microcircuits for Predictive Coding. Neuron 76, 695–711. doi: 10.1016/j.neuron.2012.10.038
Bernard, R., Kerman, I. A., Thompson, R. C., Jones, E. G., Bunney, W. E., Barchas, J. D., et al. (2011). Altered expression of glutamate signaling, growth factor, and glia genes in the locus coeruleus of patients with major depression. Mol. Psychiatry 16, 634–646. doi: 10.1038/mp.2010.44
Borderies, N., Bornert, P., Gilardeau, S., and Bouret, S. (2020). Pharmacological evidence for the implication of noradrenaline in effort. PLoS Biol. 18:e3000793. doi: 10.1371/journal.pbio.3000793
Bromberg-Martin, E. S., and Hikosaka, O. (2011). Lateral habenula neurons signal errors in the prediction of reward information. Nat. Neurosci. 14, 1209–1216. doi: 10.1038/nn.2902
Chen, J., Zhang, Y., Wei, D., Wu, X., Fu, Q., Xu, F., et al. (2015). Neurophysiological handover from MMN to P3a in first-episode and recurrent major depression. J. Affect. Disord. 174, 173–179. doi: 10.1016/j.jad.2014.11.049
Choudary, P. V., Molnar, M., Evans, S. J., Tomita, H., Li, J. Z., Vawter, M. P., et al. (2005). Altered cortical glutamatergic and GABAergic signal transmission with glial involvement in depression. Proc. Natl. Acad. Sci. U.S.A. 102, 15653–15658. doi: 10.1073/pnas.0507901102
Christoph, G., Leonzio, R., and Wilcox, K. (1986). Stimulation of the lateral habenula inhibits dopamine-containing neurons in the substantia nigra and ventral tegmental area of the rat. J. Neurosci. 6, 613–619. doi: 10.1523/JNEUROSCI.06-03-00613.1986
Clark, J. E., Watson, S., and Friston, K. J. (2018). What is mood? A computational perspective. Psychol. Med. 48, 2277–2284.
Cools, R., Nakamura, K., and Daw, N. D. (2011). Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology 36, 98–113. doi: 10.1038/npp.2010.121
Coull, J. T. (1998). Neural correlates of attention and arousal: insights from electrophysiology, functional neuroimaging and psychopharmacology. Prog. Neurobiol. 55, 343–361. doi: 10.1016/s0301-0082(98)00011-2
Craig, A. D. (2002). How do you feel? Interoception: the sense of the physiological condition of the body. Nat. Rev. Neurosci. 3, 655–666.
Cui, Y., Hu, S., and Hu, H. (2019). Lateral habenular burst firing as a target of the rapid antidepressant effects of ketamine. Trends Neurosci. 42, 179–191. doi: 10.1016/j.tins.2018.12.002
Daw, N. D., Kakade, S., and Dayan, P. (2002). Opponent interactions between serotonin and dopamine. Neural Netw. 15, 603–616. doi: 10.1016/s0893-6080(02)00052-7
de la Salle, S. (2022). Electrophysiological correlates and predictors of the antidepressant response to repeated ketamine infusions in treatment-resistant depression. Prog. Neuropsychopharmacol. Biol. Psychiatry 115:110507. doi: 10.1016/j.pnpbp.2021.110507
Dehaene, S., Sergent, C., and Changeux, J.-P. (2003). A neuronal network model linking subjective reports and objective physiological data during conscious perception. Proc. Natl. Acad. Sci. U.S.A. 100, 8520–8525. doi: 10.1073/pnas.1332574100
Devilbiss, D. M., and Waterhouse, B. D. (2000). Norepinephrine exhibits two distinct profiles of action on sensory cortical neuron responses to excitatory synaptic stimuli. Synapse 37, 273–282. doi: 10.1002/1098-2396(20000915)37:4<273::AID-SYN4>3.0.CO;2-#
Dombrovski, A. Y., Szanto, K., Clark, L., Reynolds, C. F., and Siegle, G. J. (2013). Reward signals, attempted suicide, and impulsivity in late-life depression. JAMA Psychiatry 70, 1020–1030. doi: 10.1001/jamapsychiatry.2013.75
Drysdale, A. T., Grosenick, L., Downar, J., Dunlop, K., Mansouri, F., Meng, Y., et al. (2017). Resting-state connectivity biomarkers define neurophysiological subtypes of depression. Nat. Med. 23, 28–38.
Eggart, M., Lange, A., Binser, M. J., Queri, S., and Müller-Oerlinghausen, B. (2019). Major depressive disorder is associated with impaired interoceptive accuracy: a systematic review. Brain Sci. 9:131. doi: 10.3390/brainsci9060131
Eshel, N., and Roiser, J. P. (2010). Reward and punishment processing in depression. Biol. Psychiatry 68, 118–124.
Faulkner, P., and Deakin, J. F. W. (2014). The role of serotonin in reward, punishment and behavioural inhibition in humans: insights from studies with acute tryptophan depletion. Neurosci. Biobehav. Rev. 46, 365–378. doi: 10.1016/j.neubiorev.2014.07.024
Foote, S. L., and Pineda, J. A. (1993). Extrathalamic modulation of cortical function. Annu. Rev. Neurosci. 10, 67–95. doi: 10.1146/annurev.ne.10.030187.000435
Francois, J., Grimm, O., Schwarz, A. J., Schweiger, J., Haller, L., Risterucci, C., et al. (2016). Ketamine suppresses the ventral striatal response to reward anticipation: a cross-species translational neuroimaging study. Neuropsychopharmacology 41, 1386–1394. doi: 10.1038/npp.2015.291
Frazer, A., and Benmansour, S. (2002). Delayed pharmacological effects of antidepressants. Mol. Psychiatry 7, S23–S28. doi: 10.1038/sj.mp.4001015
Friedman, A., Lax, E., Dikshtein, Y., Abraham, L., Flaumenhaft, Y., Sudai, E., et al. (2011). Electrical stimulation of the lateral habenula produces an inhibitory effect on sucrose self-administration. Neuropharmacology 60, 381–387. doi: 10.1016/j.neuropharm.2010.10.006
Friston, K. (2005). A theory of cortical responses. Philos. Trans. R. Soc. Lond. B Biol. Sci. 360, 815–836.
Friston, K. (2009). The free-energy principle: a rough guide to the brain? Trends Cogn. Sci. 13, 293–301. doi: 10.1016/j.tics.2009.04.005
Friston, K. (2010). The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11, 127–138. doi: 10.1038/nrn2787
Friston, K., and Kiebel, S. (2009). Predictive coding under the free-energy principle. Philos. Trans. R. Soc. Lond. B Biol. Sci. 364, 1211–1221. doi: 10.1098/rstb.2008.0300
Fusar-Poli, P., Allen, P., Mcguire, P., Placentino, A., Cortesi, M., and Perez, J. (2006). Neuroimaging and electrophysiological studies of the effects of acute tryptophan depletion: a systematic review of the literature. Psychopharmacology 188, 131–143. doi: 10.1007/s00213-006-0493-1
Garrido, M. I., Kilner, J. M., Stephan, K. E., and Friston, K. J. (2009). The mismatch negativity: a review of underlying mechanisms. Clin. Neurophysiol. 120, 453–463. doi: 10.1016/j.clinph.2008.11.029
Gelenberg, A. J., and Chesen, C. L. (2000). How fast are antidepressants? J. Clin. Psychiatry 61, 712–721. doi: 10.4088/jcp.v61n1002
Gotlib, I. H. (1983). Perception and recall of interpersonal feedback: Negative bias in depression. Cogn. Ther. Res. 7, 399–412. doi: 10.1016/j.jbtep.2009.03.001
Greenberg, T., Chase, H. W., Almeida, J. R., Stiffler, R., Zevallos, C. R., Aslam, H. A., et al. (2015). Moderation of the relationship between reward expectancy and prediction error-related ventral striatal reactivity by anhedonia in unmedicated major depressive disorder: findings from the EMBARC study. Am. J. Psychiatry 172, 881–891. doi: 10.1176/appi.ajp.2015.14050594
Harmer, C. J., Goodwin, G. M., and Cowen, P. J. (2009). Why do antidepressants take so long to work? A cognitive neuropsychological model of antidepressant drug action. Br. J. Psychiatry 195, 102–108. doi: 10.1192/bjp.bp.108.051193
Harms, L., Parras, G. G., Michie, P. T., and Malmierca, M. S. (2021). The Role of Glutamate Neurotransmission in Mismatch Negativity (MMN), a measure of auditory synaptic plasticity and change-detection. Neuroscience 456, 106–113. doi: 10.1016/j.neuroscience.2020.01.046
He, W., Chai, H., Zheng, L., Yu, W., Chen, W., Li, J., et al. (2010). Mismatch negativity in treatment-resistant depression and borderline personality disorder. Prog. Neuropsychopharmacol. Biol. Psychiatry 34, 366–371. doi: 10.1016/j.pnpbp.2009.12.021
Hirakawa, N., Hirano, Y., Nakamura, I., Hirano, S., Sato, J., Oribe, N., et al. (2017). Right hemisphere pitch-mismatch negativity reduction in patients with major depression: an MEG study. J. Affect. Disord. 215, 225–229. doi: 10.1016/j.jad.2017.03.046
Hu, H., Cui, Y., and Yang, Y. (2020). Circuits and functions of the lateral habenula in health and in disease. Nat. Rev. Neurosci. 21, 277–295. doi: 10.1038/s41583-020-0292-4
Jacob, S. N., and Nienborg, H. (2018). Monoaminergic neuromodulation of sensory processing. Front. Neural Circuits 12:51. doi: 10.3389/fncir.2018.00051
Jacobs, B. L., and Azmitia, E. C. (1992). Structure and function of the brain serotonin system. Physiol. Rev. 72, 165–229.
Ji, H., and Shepard, P. D. (2007). Lateral habenula stimulation inhibits rat midbrain dopamine neurons through a GABAA receptor-mediated mechanism. J. Neurosci. 27, 6923–6930. doi: 10.1523/JNEUROSCI.0958-07.2007
Kähkönen, S., Ahveninen, J., Jääskeläinen, I. P., Kaakkola, S., Näätänen, R., Huttunen, J., et al. (2001). Effects of haloperidol on selective attention: a combined whole-head MEG and high-resolution EEG study. Neuropsychopharmacology 25, 498–504. doi: 10.1016/S0893-133X(01)00255-X
Kähkönen, S., Ahveninen, J., Pekkonen, E., Kaakkola, S., Huttunen, J., Ilmoniemi, R. J., et al. (2002). Dopamine modulates involuntary attention shifting and reorienting: an electromagnetic study. Clin. Neurophysiol. 113, 1894–1902. doi: 10.1016/s1388-2457(02)00305-x
Kähkönen, S., Mäkinen, V., Jääskeläinen, I. P., Pennanen, S., Liesivuori, J., and Ahveninen, J. (2005). Serotonergic modulation of mismatch negativity. Psychiatry Res. 138, 61–74. doi: 10.1016/j.pscychresns.2004.09.006
Kähkönen, S., Yamashita, H., Rytsälä, H., Suominen, K., Ahveninen, J., and Isometsä, E. (2007). Dysfunction in early auditory processing in major depressive disorder revealed by combined MEG and EEG. J. Psychiatry Neurosci. 32, 316–322.
Kapur, S., and Remington, G. (1996). Serotonin-dopamine interaction and its relevance to schizophrenia. Am. J. Psychiatry 153, 466–476. doi: 10.1176/ajp.153.4.466
Katz, M. M., Koslow, S. H., and Frazer, A. (1996). Onset of antidepressant activity: reexamining the structure of depression and multiple actions of drugs. Depress. Anxiety 4, 257–267. doi: 10.1002/(SICI)1520-6394(1996)4:6<257::AID-DA1>3.0.CO;2-9
Keren, H., O’callaghan, G., Vidal-Ribas, P., Buzzell, G. A., Brotman, M. A., Leibenluft, E., et al. (2018). Reward processing in depression: a conceptual and meta-analytic review across fMRI and EEG studies. Am. J. Psychiatry 175, 1111–1120. doi: 10.1176/appi.ajp.2018.17101124
Kim, S., Baek, J. H., Shim, S.-H., Kwon, Y. J., Lee, H. Y., Yoo, J. H., et al. (2020). Mismatch negativity indices and functional outcomes in unipolar and bipolar depression. Sci. Rep. 10:12831. doi: 10.1038/s41598-020-69776-4
Kishimoto, T., Chawla, J. M., Hagi, K., Zarate, C. A., Kane, J. M., Bauer, M., et al. (2016). Single-dose infusion ketamine and non-ketamine N-methyl-d-aspartate receptor antagonists for unipolar and bipolar depression: a meta-analysis of efficacy, safety and time trajectories. Psychol. Med. 46, 1459–1472. doi: 10.1017/S0033291716000064
Knill, D. C., and Pouget, A. (2004). The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27, 712–719. doi: 10.1016/j.tins.2004.10.007
Kosofsky, B. E., Molliver, M. E., Morrison, J. H., and Foote, S. L. (1984). The serotonin and norepinephrine innervation of primary visual cortex in the cynomolgus monkey (Macaca fascicularis). J. Comp. Neurol. 230, 168–178. doi: 10.1002/cne.902300203
Kotoula, V., Stringaris, A., Mackes, N., Mazibuko, N., Hawkins, P. C. T., Furey, M., et al. (2021). Ketamine modulates the neural Ccorrelates of reward processing in unmedicated patients in remission from depression. Biol. Psychiatry Cogn. Neurosci. Neuroimaging. [Epub online ahead of print],. doi: 10.1016/j.bpsc.2021.05.009
Kreitschmann-Andermahr, I., Rosburg, T., Demme, U., Gaser, E., Nowak, H., and Sauer, H. (2001). Effect of ketamine on the neuromagnetic mismatch field in healthy humans. Cogn. Brain Res. 12, 109–116. doi: 10.1016/s0926-6410(01)00043-x
Kube, T., Schwarting, R., Rozenkrantz, L., Glombiewski, J. A., and Rief, W. (2020). Distorted cognitive processes in major depression: a predictive processing perspective. Biol. Psychiatry 87, 388–398. doi: 10.1016/j.biopsych.2019.07.017
Kumar, P., Goer, F., Murray, L., Dillon, D. G., Beltzer, M. L., Cohen, A. L., et al. (2018). Impaired reward prediction error encoding and striatal-midbrain connectivity in depression. Neuropsychopharmacology 43, 1581–1588. doi: 10.1038/s41386-018-0032-x
Leung, S., Croft, R. J., Guille, V., Scholes, K., O’neill, B. V., Phan, K. L., et al. (2009). Acute dopamine and/or serotonin depletion does not modulate mismatch negativity (MMN) in healthy human participants. Psychopharmacology 208, 233–244. doi: 10.1007/s00213-009-1723-0
Lewis, D., Campbell, M., Foote, S., Goldstein, M., and Morrison, J. (1987). The distribution of tyrosine hydroxylase-immunoreactive fibers in primate neocortex is widespread but regionally specific. J. Neurosci. 7, 279–290. doi: 10.1523/JNEUROSCI.07-01-00279.1987
Loas, G., Lefebvre, G., Rotsaert, M., and Englert, Y. (2018). Relationships between anhedonia, suicidal ideation and suicide attempts in a large sample of physicians. PLoS One 13:e0193619. doi: 10.1371/journal.pone.0193619
Lumer, E. D., Edelman, G. M., and Tononi, G. (1997). Neural dynamics in a model of the thalamocortical system. I. Layers, loops and the emergence of fast synchronous rhythms. Cereb. Cortex 7, 207–227. doi: 10.1093/cercor/7.3.207
Maeng, S., Zarate, C. A., Du, J., Schloesser, R. J., Mccammon, J., Chen, G., et al. (2008). Cellular mechanisms underlying the antidepressant effects of ketamine: role of α-amino-3-hydroxy-5-methylisoxazole-4-propionic acid receptors. Biol. Psychiatry 63, 349–352. doi: 10.1016/j.biopsych.2007.05.028
Manz, K. M., Coleman, B. C., Grueter, C. A., Shields, B. C., Tadross, M. R., and Grueter, B. A. (2021). Noradrenergic signaling disengages feedforward transmission in the nucleus accumbens shell. J. Neurosci. 41, 3752–3763. doi: 10.1523/JNEUROSCI.2420-20.2021
Matsumoto, M., and Hikosaka, O. (2007). Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447, 1111–1115. doi: 10.1038/nature05860
Matsumoto, M., and Hikosaka, O. (2009a). Representation of negative motivational value in the primate lateral habenula. Nat. Neurosci. 12, 77–84. doi: 10.1038/nn.2233
Matsumoto, M., and Hikosaka, O. (2009b). Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837–841. doi: 10.1038/nature08028
McCabe, C., Mishor, Z., Cowen, P. J., and Harmer, C. J. (2010). Diminished neural processing of aversive and rewarding stimuli during selective serotonin reuptake inhibitor treatment. Biol. Psychiatry 67, 439–445. doi: 10.1016/j.biopsych.2009.11.001
Morrison, J. H., and Foote, S. L. (1986). Noradrenergic and serotoninergic innervation of cortical, thalamic, and tectal visual structures in old and new world monkeys. J. Comp. Neurol. 243, 117–138. doi: 10.1002/cne.902430110
Morrison, J. H., Foote, S. L., O’connor, D., and Bloom, F. E. (1982). Laminar, tangential and regional organization of the noradrenergic innervation of monkey cortex: dopamine-β-hydroxylase immunohistochemistry. Brain Res. Bull. 9, 309–319. doi: 10.1016/0361-9230(82)90144-7
Mu, Z., Chang, Y., Xu, J., Pang, X., Zhang, H., Liu, X., et al. (2016). Pre-attentive dysfunction of musical processing in major depressive disorder: a mismatch negativity study. J. Affect. Disord. 194, 50–56. doi: 10.1016/j.jad.2016.01.028
Näätänen, R., Kujala, T., Escera, C., Baldeweg, T., Kreegipuu, K., Carlson, S., et al. (2012). The mismatch negativity (MMN) – A unique window to disturbed central auditory processing in ageing and different clinical conditions. Clin. Neurophysiol. 123, 424–458. doi: 10.1016/j.clinph.2011.09.020
Nielson, D. M., Keren, H., O’callaghan, G., Jackson, S. M., Douka, I., Vidal-Ribas, P., et al. (2021). Great expectations: a critical review of and suggestions for the study of reward processing as a cause and predictor of depression. Biol. Psychiatry 89, 134–143. doi: 10.1016/j.biopsych.2020.06.012
Niv, Y., and Montague, P. R. (2009). “Chapter 22 - Theoretical and empirical studies of learning,” in Neuroeconomics, eds P. W. Glimcher, C. F. Camerer, E. Fehr, and R. A. Poldrack (London: Academic Press), 331–351.
Oranje, B., Jensen, K., Wienberg, M., and Glenthøj, B. Y. (2008). Divergent effects of increased serotonergic activity on psychophysiological parameters of human attention. Int. J. Neuropsychopharmacol. 11, 453–463. doi: 10.1017/S1461145707008176
O’Reilly, J. X., Jbabdi, S., and Behrens, T. E. J. (2012). How can a Bayesian approach inform neuroscience? Eur J. Neurosci. 35, 1169–1179. doi: 10.1111/j.1460-9568.2012.08010.x
Ossewaarde, L., Verkes, R. J., Hermans, E. J., Kooijman, S. C., Urner, M., Tendolkar, I., et al. (2011). Two-Week administration of the combined serotonin-noradrenaline reuptake inhibitor duloxetine augments functioning of mesolimbic incentive processing circuits. Biol. Psychiatry 70, 568–574. doi: 10.1016/j.biopsych.2011.03.041
Pizzagalli, D. A. (2014). Depression, stress, and anhedonia: toward a synthesis and integrated model. Annu. Rev. Clin. Psychol. 10, 393–423. doi: 10.1146/annurev-clinpsy-050212-185606
Qiao, Z., Yu, Y., Wang, L., Yang, X., Qiu, X., Zhang, C., et al. (2013). Impaired pre-attentive change detection in major depressive disorder patients revealed by auditory mismatch negativity. Psychiatry Res. 211, 78–84. doi: 10.1016/j.pscychresns.2012.07.006
Qiu, X., Yang, X., Qiao, Z., Wang, L., Ning, N., Shi, J., et al. (2011). Impairment in processing visual information at the pre-attentive stage in patients with a major depressive disorder: a visual mismatch negativity study. Neurosci. Lett. 491, 53–57. doi: 10.1016/j.neulet.2011.01.006
Quitkin, F. M., Rabkin, J. G., Ross, D., and Stewart, J. W. (1984). Identification of true drug response to antidepressants: use of pattern analysis. Arch. Gen. Psychiatry 41, 782–786. doi: 10.1001/archpsyc.1984.01790190056007
Rao, R. P. N., and Ballard, D. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat. Neurosci. 2, 79–87. doi: 10.1038/4580
Restuccia, D., Marca, G. D., Valeriani, M., Leggio, M. G., and Molinari, M. (2006). Cerebellar damage impairs detection of somatosensory input changes. A somatosensory mismatch-negativity study. Brain 130, 276–287. doi: 10.1093/brain/awl236
Rosburg, T., and Kreitschmann-Andermahr, I. (2016). The effects of ketamine on the mismatch negativity (MMN) in humans – A meta-analysis. Clin. Neurophysiol. 127, 1387–1394. doi: 10.1016/j.clinph.2015.10.062
Rothkirch, M., Tonn, J., Köhler, S., and Sterzer, P. (2017). Neural mechanisms of reinforcement learning in unmedicated patients with major depressive disorder. Brain 140, 1147–1157. doi: 10.1093/brain/awx025
Rouhani, N., and Niv, Y. (2019). Depressive symptoms bias the prediction-error enhancement of memory towards negative events in reinforcement learning. Psychopharmacology 236, 2425–2435. doi: 10.1007/s00213-019-05322-z
Rutledge, R. B., Moutoussis, M., Smittenaar, P., Zeidman, P., Taylor, T., Hrynkiewicz, L., et al. (2017). Association of neural and emotional impacts of reward prediction errors with major depression. JAMA Psychiatry 74, 790–797. doi: 10.1001/jamapsychiatry.2017.1713
Salgado, H., Treviño, M., and Atzori, M. (2016). Layer- and area-specific actions of norepinephrine on cortical synaptic transmission. Brain Res 1641, 163–176. doi: 10.1016/j.brainres.2016.01.033
Sara, S. J., and Bouret, S. (2012). Orienting and reorienting: the locus Coeruleus mediates cognition through arousal. Neuron 76, 130–141. doi: 10.1016/j.neuron.2012.09.011
Schröger, E. (1998). Measurement and interpretation of the mismatch negativity. Behav. Res. Methods Instrum. Comput. 30, 131–145.
Schultz, W. (2006). Behavioral theories and the neurophysiology of reward. Annu. Rev. Psychol. 57, 87–115. doi: 10.1146/annurev.psych.56.091103.070229
Schultz, W. (2007). Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 30, 259–288. doi: 10.1146/annurev.neuro.28.061604.135722
Schultz, W. (2016b). Dopamine reward prediction-error signalling: a two-component response. Nat. Rev. Neurosci. 17, 183–195. doi: 10.1038/nrn.2015.26
Schultz, W. (2016a). Dopamine reward prediction error coding. Dialogues Clin. Neurosci. 18, 23–32. doi: 10.31887/DCNS.2016.18.1/wschultz
Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593–1599. doi: 10.1126/science.275.5306.1593
Self, M. W., Kooijmans, R. N., Supèr, H., Lamme, V. A., and Roelfsema, P. R. (2012). Different glutamate receptors convey feedforward and recurrent processing in macaque V1. Proc. Natl. Acad. Sci. U.S.A. 109, 11031–11036. doi: 10.1073/pnas.1119527109
Seth, A. K. (2013). Interoceptive inference, emotion, and the embodied self. Trends Cogn. Sci. 17, 565–573. doi: 10.1016/j.tics.2013.09.007
Seth, A. K., and Friston, K. J. (2016). Active interoceptive inference and the emotional brain. Philos. Trans. R. Soc. Lond. B Biol. Sci. 371:20160007. doi: 10.1098/rstb.2016.0007
Shipp, S., Adams, R. A., and Friston, K. J. (2013). Reflections on agranular architecture: predictive coding in the motor cortex. Trends Neurosci. 36, 706–716. doi: 10.1016/j.tins.2013.09.004
Shumake, J., Ilango, A., Scheich, H., Wetzel, W., and Ohl, F. W. (2010). Differential neuromodulation of acquisition and retrieval of avoidance learning by the lateral habenula and ventral tegmental area. J. Neurosci. 30, 5876–5883. doi: 10.1523/JNEUROSCI.3604-09.2010
Spijker, J., De Graaf, R., Ten Have, M., Nolen, W. A., and Speckens, A. (2010). Predictors of suicidality in depressive spectrum disorders in the general population: results of the Netherlands Mental Health Survey and Incidence Study. Soc. Psychiatry Psychiatr. Epidemiol. 45, 513–521. doi: 10.1007/s00127-009-0093-6
Stephan, K. E., Manjaly, Z. M., Mathys, C. D., Weber, L. A. E., Paliwal, S., Gard, T., et al. (2016). Allostatic self-efficacy: a metacognitive theory of dyshomeostasis-induced fatigue and depression. Front. Hum. Neurosci. 10:550. doi: 10.3389/fnhum.2016.00550
Sterpenich, V., Vidal, S., Hofmeister, J., Michalopoulos, G., Bancila, V., Warrot, D., et al. (2019). Increased reactivity of the mesolimbic reward system after ketamine injection in patients with treatment-resistant major depressive disorder. Anesthesiology 130, 923–935. doi: 10.1097/ALN.0000000000002667
Sumner, R. L., Mcmillan, R., Spriggs, M. J., Campbell, D., Malpas, G., Maxwell, E., et al. (2020). Ketamine improves short-term plasticity in depression by enhancing sensitivity to prediction errors. Eur. Neuropsychopharmacol. 38, 73–85. doi: 10.1016/j.euroneuro.2020.07.009
Takei, Y., Kumano, S., Hattori, S., Uehara, T., Kawakubo, Y., Kasai, K., et al. (2009). Preattentive dysfunction in major depression: a magnetoencephalography study using auditory mismatch negativity. Psychophysiology 46, 52–61. doi: 10.1111/j.1469-8986.2008.00748.x
Tseng, Y.-J., Nouchi, R., and Cheng, C.-H. (2021). Mismatch negativity in patients with major depressive disorder: a meta-analysis. Clin. Neurophysiol. 132, 2654–2665. doi: 10.1016/j.clinph.2021.06.019
Umbricht, D., Schmid, L., Koller, R., Vollenweider, F. X., Hell, D., and Javitt, D. C. (2000). Ketamine-induced deficits in auditory and visual context-cependent processing in healthy volunteers: implications for models of cognitive deficits in schizophrenia. Arch. Gen. Psychiatry 57, 1139–1147. doi: 10.1001/archpsyc.57.12.1139
Vaillancourt, D. E., Schonfeld, D., Kwak, Y., Bohnen, N. I., and Seidler, R. (2013). Dopamine overdose hypothesis: evidence and clinical implications. Mov. Disord. 28, 1920–1929. doi: 10.1002/mds.25687
van Donkelaar, E. L., Blokland, A., Ferrington, L., Kelly, P. A. T., Steinbusch, H. W. M., and Prickaerts, J. (2011). Mechanism of acute tryptophan depletion: is it only serotonin? Mol. Psychiatry 16, 695–713. doi: 10.1038/mp.2011.9
Varazzani, C., San-Galli, A., Gilardeau, S., and Bouret, S. (2015). Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys. J. Neurosci. 35, 7866–7877.
Vrieze, E., Demyttenaere, K., Bruffaerts, R., Hermans, D., Pizzagalli, D. A., Sienaert, P., et al. (2014). Dimensions in major depressive disorder and their relevance for treatment outcome. J. Affect. Disord. 155, 35–41. doi: 10.1016/j.jad.2013.10.020
Webber, H. E., Lopez-Gamundi, P., Stamatovich, S. N., De Wit, H., and Wardle, M. C. (2021). Using pharmacological manipulations to study the role of dopamine in human reward functioning: a review of studies in healthy adults. Neurosci. Biobehav. Rev. 120, 123–158. doi: 10.1016/j.neubiorev.2020.11.004
Wienberg, M., Glenthoj, B., Jensen, K., and Oranje, B. (2010). A single high dose of escitalopram increases mismatch negativity without affecting processing negativity or P300 amplitude in healthy volunteers. J. Psychopharmacol. 24, 1183–1192. doi: 10.1177/0269881109102606
Wilson, M. A., and Molliver, M. E. (1991a). The organization of serotonergic projections to cerebral cortex in primates: regional distribution of axon terminals. Neuroscience 44, 537–553. doi: 10.1016/0306-4522(91)90076-z
Wilson, M. A., and Molliver, M. E. (1991b). The organization of serotonergic projections to cerebral cortex in primates: retrograde transport studies. Neuroscience 44, 555–570. doi: 10.1016/0306-4522(91)90077-2
Winer, E. S., Drapeau, C. W., Veilleux, J. C., and Nadorff, M. R. (2016). The association between anhedonia, suicidal ideation, and suicide attempts in a large student sample. Arch. Suicide Res. 20, 265–272. doi: 10.1080/13811118.2015.1025119
Yang, Y., Wang, H., Hu, J., and Hu, H. (2018b). Lateral habenula in the pathophysiology of depression. Curr. Opin. Neurobiol. 48, 90–96. doi: 10.1016/j.conb.2017.10.024
Yang, Y., Cui, Y., Sang, K., Dong, Y., Ni, Z., Ma, S., et al. (2018a). Ketamine blocks bursting in the lateral habenula to rapidly relieve depression. Nature 554, 317–322. doi: 10.1038/nature25509
Yaple, Z. A., Tolomeo, S., and Yu, R. (2021). Abnormal prediction error processing in schizophrenia and depression. Hum. Brain Mapp. 42, 3547–3560. doi: 10.1002/hbm.25453
Yaseen, Z. S., Galynker, I. I., Briggs, J., Freed, R. D., and Gabbay, V. (2016). Functional domains as correlates of suicidality among psychiatric inpatients. J. Affect. Disord. 203, 77–83. doi: 10.1016/j.jad.2016.05.066
Yüksel, C., and Öngür, D. (2010). Magnetic resonance spectroscopy studies of glutamate-related abnormalities in mood disorders. Biol. Psychiatry 68, 785–794. doi: 10.1016/j.biopsych.2010.06.016
Zanos, P., Moaddel, R., Morris, P. J., Georgiou, P., Fischell, J., Elmer, G. I., et al. (2016). NMDAR inhibition-independent antidepressant actions of ketamine metabolites. Nature 533, 481–486. doi: 10.1038/nature17998
Zarate, C. A. Jr., Singh, J. B., Carlson, P. J., Brutsche, N. E., Ameli, R., Luckenbaugh, D. A., et al. (2006). A randomized trial of an N-methyl-D-aspartate antagonist in treatment-resistant major depression. Arch. Gen. Psychiatry 63, 856–864. doi: 10.1001/archpsyc.63.8.856
Keywords: major depression, predictive coding, mismatch negativity, reward processing, prediction errors, ventral striatum
Citation: Gilbert JR, Wusinich C and Zarate CA Jr (2022) A Predictive Coding Framework for Understanding Major Depression. Front. Hum. Neurosci. 16:787495. doi: 10.3389/fnhum.2022.787495
Received: 30 September 2021; Accepted: 14 February 2022;
Published: 03 March 2022.
Edited by:
Juanita Todd, The University of Newcastle, AustraliaReviewed by:
Hideki Ohira, Nagoya University, JapanBenjamin Ely, Albert Einstein College of Medicine, United States
Copyright © 2022 Gilbert, Wusinich and Zarate. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jessica R. Gilbert, jessica.gilbert@nih.gov