ORIGINAL RESEARCH article

Front. Psychiatry, 23 November 2016

Sec. Neuroimaging

Volume 7 - 2016 | https://doi.org/10.3389/fpsyt.2016.00189

Altered Insular Function during Aberrant Salience Processing in Relation to the Severity of Psychotic Symptoms

    AW

    Anna Walter *

    CS

    Claudia Suenderhauf

    RS

    Renata Smieskova

    CL

    Claudia Lenz

    FH

    Fabienne Harrisberger

    AS

    André Schmidt

    TV

    Tobias Vogel

    UE

    Undine E. Lang

    AR

    Anita Riecher-Rössler

    AE

    Anne Eckert

    SB

    Stefan Borgwardt

  • Department of Psychiatry (UPK), University of Basel, Basel, Switzerland

Article metrics

View details

24

Citations

4,6k

Views

1,4k

Downloads

Abstract

There is strong evidence for abnormal salience processing in patients with psychotic experiences. In particular, there are indications that the degree of aberrant salience processing increases with the severity of positive symptoms. The aim of the present study was to elucidate this relationship by means of brain imaging. Functional magnetic resonance imaging was acquired to assess hemodynamic responses during the Salience Attribution Test, a paradigm for reaction time that measures aberrant salience to irrelevant stimulus features. We included 42 patients who were diagnosed as having a psychotic disorder and divided them into two groups according to the severity of their positive symptoms. Whole brain analysis was performed using Statistical Parametric Mapping. We found no significant behavioral differences with respect to task performance. Patients with more positive symptoms showed increased hemodynamic responses in the left insula corresponding to aberrant salience than in patients with less positive symptoms. In addition, left insula activation correlated negatively with cumulative antipsychotic medication. Aberrant salience processing in the insula may be increased in psychosis, depending on the severity of positive symptoms. This study indicates that clinically similar psychosis manifestations share the same functional characteristics. In addition, our results suggest that antipsychotic medication can modulate insular function.

Introduction

Disrupted salience processing has been found to be a principle feature in psychosis (1). Salience is defined as the effectiveness of a stimulus to stand out from its neighbors. A stimulus might be considered to be salient by feature contrast, novelty, emotional, or motivational association (2). The integration of stimuli requires specific brain networks, which associate external stimuli with internal context, thus marking objects that require further consideration (3, 4).

Abnormal salience processing in patients with schizophrenic psychoses seems to arise from inappropriate evaluation of stimuli that would naturally be considered irrelevant (5). Hence, subthreshold stimuli become inappropriately attention-grabbing (6), which is then called aberrant salience. Adaptive motivational salience, by contrast, refers to stimuli with a reliable association with reinforcement and which can therefore influence behavior and attract attention (7). Roiser et al. provided evidence of increases in behavioral aberrant salience in patients with schizophrenia, depending on the severity of their symptoms, primarily with respect to delusions (7).

The neurobiological foundation of the salience network appears to lie in the insula, the anterior cingulate cortex (8, 9), subcortical regions such as the ventral striatum, amygdala, ventral tegmental area, and midbrain (10). The salience network serves as the “dynamic switch,” biasing activation of other task-positive or task-negative networks when a salient external event is detected (3). Of the salience network regions, the most prominent structures are the insula and anterior cingulate cortex, which consistently show coactivation in response to both internal and external salience (11).

While the posterior insula plays a key role in integrating sensory and motor information to mediate behavioral responses to interoceptive and external cues (12, 13), the anterior portion of the insula functions to integrate this sensory and interoceptive feedback from the posterior insula with cognitive and emotional responses to the same stimuli, to create a conscious evaluation of affective experience (11, 14). Lesions incorporating the insula may reduce an individual’s capacity for integrating external stimuli and thus weaken motivated or appropriate emotional responses. Clinically, insular dysfunction can plausibly account for several characteristic signs of psychoses such as deficits in social cognition, decision-making (13, 15), information processing difficulties (16), and psychotic symptoms (17, 18). Reduced insula–anterior cingulate cortex connectivity has been demonstrated in untreated patients with first-episode psychosis (19), suggesting a normalization of this functional coupling via dopamine D2 receptor antagonism together with serotonin 2A receptor antagonism (20). A recent resting-state fMRI study showed that antipsychotic-induced improvement of psychotic symptoms was accompanied by increased functional connectivity among striatal regions, the anterior cingulate cortex, and the insula (21). Structural imaging studies have repeatedly and consistently detected gray matter abnormalities in these areas in different stages of schizophrenia (2224). In addition, the cortex of the right insula becomes significantly thinner in patients with schizophrenia (25).

Chronic schizophrenia patients exhibited increased responses of aberrant salience in the striatum, hippocampus, and prefrontal regions compared with healthy controls (26) and lower responses of adaptive salience in the striatum (27, 28), amygdala, hippocampus, and midbrain (27). Adaptive salience refers to a significantly more rapid response in trials with high probability reinforcement relative to trials with low probability reinforcement (7). Moreover, functional connectivity analysis revealed abnormal functional integration within the salience network in early-stage schizophrenia (24).

Abnormal dopamine transmission is a mainstay of theories that aim to explain the neurobiological correlates of positive symptoms in psychosis. Kapur (5) proposed that a hyperdopaminergic state, which had been described in psychosis (29, 30), leads to aberrant assignment of salience (31). A recent multimodal study demonstrated a relationship between presynaptic capacity for dopamine synthesis and aberrant salience-related neural responses, even in individuals at risk for psychosis (32). As antipsychotics tend to block D2 receptors in the dopamine pathways of the brain, antipsychotic medication may reduce positive symptoms, by attenuating dopamine-mediated aberrant motivational salience (5). Accordingly, it can be hypothesized that treatment with antipsychotics would dampen adaptive motivational salience. In fact, it has been shown that medicated patients with schizophrenia exhibited reduced adaptive salience compared to healthy controls at a behavioral level (7).

Although the aberrant salience hypothesis of positive symptoms is appealing, it does not explain treatment resistance, as one-third of patients do not respond to non-clozapine antipsychotics (33), despite high levels of D2 occupancy (34). The implication is that, for a significant number of patients, the pathophysiological basis of their symptoms involves more than dopaminergic excess. Overall, this suggests that there may be a “non-dopaminergic” subtype of schizophrenia (35). The involvement of glutamatergic mechanisms in schizophrenia has been hypothesized for many years, and the prevailing hypothesis is that there is primary involvement of NMDA receptor dysfunction (36). However, at present there are some inconsistencies, and this has not led to significant advances in treatment. There are two possible explanations for the involvement of both dopamine and glutamate in schizophrenia. One is that they underlie different subtypes of the disorder, in line with the recent findings in treatment resistance (37). The other is an integrated hypothesis, which could explain positive symptoms in terms of presynaptic dopamine, and negative and cognitive symptoms in terms of glutamate.

We have found reduced adaptive salience activation in the right insula in antipsychotic-medicated first-episode patients (FEP) compared to healthy controls. In addition, antipsychotic-free FEP exhibited a negative correlation between adaptive salience activation in the right insula and hallucination score (38). Unfortunately, we have not found any significant differences in terms of aberrant salience in our previous work (38). This could be related to the fact that positive psychotic symptoms in our included groups were not so strong pronounced (38). With this study, we aimed to include psychotic patients with stronger positive psychotic symptoms and to additionally emphasize clinical symptomatology instead of different stages of psychosis. In a cohort of patients with positive psychotic symptoms of different severity, we hypothesized that more severe psychotic symptoms would be related to stronger aberrant salience at a behavioral level. We expected to find higher blood oxygenation level-dependent (BOLD) signals in the insula during aberrant salience in the patients with more pronounced psychotic symptoms than in those with less pronounced psychotic symptoms.

We further focused on evaluating any interaction between cumulative antipsychotic medication taken during the previous year and aberrant salience processing. We hypothesized that there would be a negative correlation between aberrant salience processing and antipsychotic medication.

Materials and Methods

Study Population

Male FEP (n = 28) were included who fulfilled the operational criteria for “first-episode psychosis” (39) and were recruited at the Psychiatric Outpatient Department, within an Early Detection of Psychosis (FePsy) clinic (40). Nineteen of the 28 FEP were overlapping with Smieskova et al. (41). FEP fulfilled the transition criteria for a psychotic episode, as described by Yung et al., i.e., hallucination ≥4 or unusual thought content, suspiciousness, or conceptual disorganization ≥5 on the Brief Psychiatric Rating Scale (BPRS) (42). Eleven of the FEP were receiving antipsychotic medication. Additionally, we included 14 individuals with chronic psychotic disorders, who had committed a violent criminal offense related to their severe mental disorder and are therefore being treated with stringent drug monitoring in the Department of Forensic Psychiatry at the Psychiatric Clinic of the University of Basel. These patients fulfilled DSM-IV criteria or the Operational Criteria OPCRIT checklist for psychotic and affective illness (43). At the time of scanning, all patients with chronic psychotic disorders were receiving antipsychotic medication.

Cumulative antipsychotic doses during the previous year were recorded at assessment. Doses of antipsychotics were converted into chlorpromazine-equivalent doses (CPZ), as in previous studies (44, 45).

Furthermore, we collected the drug history of antidepressant medication, alcohol, nicotine, and illegal drugs in a semi-structured interview.

We applied the following exclusion criteria to our groups: history of previous psychotic disorder (only for FEP); psychotic symptomatology caused by an “organic” disorder; recent substance abuse according to ICD-10 research criteria; psychotic symptomatology associated with an affective psychosis or a borderline personality disorder; age under 18 years; inadequate knowledge of German; and IQ less than 70.

Ethical approval was obtained from the local ethics committee, Ethikkommission Nordwest- und Zentralschweiz (EKNZ). All participants provided written informed consent and received compensation for participating.

As we were interested in the associations between the severity of positive symptoms and aberrant salience processing, we separated our cohort (n = 42) according to positive symptom scores (i.e., a median split of the sum of BPRS items for suspiciousness, hallucinations, and unusual thought content, and conceptual disorganization). The final subgroups consisted of 21 psychotic patients (10 FEP and 11 individuals with chronic psychotic disorders) with less positive symptoms (mean score = 6) and 21 psychotic patients (18 FEP and 3 individuals with chronic psychotic disorders) with more positive symptoms (mean score = 14). The groups were created prior to assessment, but not to scanning. The staff of the MRI scanner was thus blind to group status.

Salience Attribution Test

Hemodynamic and behavioral responses during aberrant salience processing were assessed with the Salience Attribution Test (SAT), as previously described (7, 32). During the task, the participants responded to a probe after seeing one of four categories of cues (blue animals, red animals, blue household objects, and red household objects), which varied along two dimensions (color and form). Participants received monetary reward in 50% of trials and earned more money for more rapid responses. The probability of reward varied along the cue dimensions (task-relevant dimension, e.g., color – blue stimuli: 87.5% rewarded; red stimuli: 12.5% rewarded), but not for other dimensions (task-irrelevant dimensions, e.g., form – animal and household stimuli: both 50% rewarded). Two experimental sessions (64 trials each) were performed during fMRI. Participants were not informed about the contingencies, which remained the same over blocks, and had to learn them during the task. They were also asked to estimate reward probabilities for each of the 4 stimulus categories after each session (i.e., after 64 trials), using visual analog scales (VAS) ranging from 0 to 100%.

Aberrant salience was defined as the absolute difference in reaction time (implicit) or VAS (explicit) between the two levels of the task-irrelevant stimulus (collapsing across the dimension of task-relevant stimulus). Since aberrant salience is defined as any such deviation, it is always positive.

Participants had to respond rapidly to the presentation of a square. Money was available in 50% of trials, with the likelihood of reward in a given trial being signaled by one of four categories of cues. The cues varied in two different visual dimensions, with one of these cue dimensions being task-relevant. Participants estimated reward probabilities for each cue category, using VAS in percentage.

Clinical Scales and Cognitive Measures

Subjects were assessed by experienced psychiatrists or psychologists with the BPRS (46, 47) and the Scale for the Assessment of Negative Symptoms (SANS) (44). Current level of functioning was rated with the Global Assessment of Functioning Scale (DSM-III-R 1987). Intelligence quotient was assessed using the Mehrfachwahl-Wortschatz-Test (MWT-B) (48). The number of years spent in full-time education was obtained at interview.

Behavioral and Clinical Data Analysis

All analyzes were performed using the Statistical Package for Social Science (SPSS) version 19. Clinical, demographic, and behavioral differences between groups were examined with two sample t-tests and χ2 tests. Brain activation from the significant between-group differences were obtained from the first eigenvariate of a sphere of 5 mm radius around the peak of activation. To examine the association between brain activation in the region with between-group differences and dose of antipsychotic medication, we performed two-tailed Pearson’s correlation analysis. For all tests, p < 0.05 was considered significant and 0.05 < p < 0.1, a trend toward significance. The Bonferroni correction (at p = 0.05) was applied for all post hoc tests.

Magnetic Resonance Imaging Acquisition

Participants were scanned using a whole body 3 T MRI system (Magnetom Verio, Siemens Healthcare, Erlangen, Germany) and a 12-channel phased-array radio-frequency head coil. During the SAT, we acquired T2*-weighted echo-planar images (EPIs) with the following parameters: interleaved acquisition mode, 38 axial slices of 3 mm thickness, 0.5 mm interslice gap, field of view 228 mm × 228 mm, and an in-plane resolution of 3 mm × 3 mm. The repetition time was 2.5 s, the echo time 28 ms, and bandwidth was set to 2350 Hz/pixel. The total scan time for both SAT sessions was 20:50 min (with a practice session to adjust speed of appearance of items of 1:45), thereby yielding a total of 2 × 248 volumes. In addition, structural sequences (MPRAGE) were obtained to register functional images. Structural MRI images were additionally screened for gross radiological abnormalities.

fMRI Procedure

Echo-planar images were analyzed using Statistical Parametric Mapping (SPM8, www.fil.ion.ucl.ac.uk/spm). The first four images in each series were discarded to allow for signal stabilization. During preprocessing, images were realigned and unwarped, spatially normalized to the Montreal Neurological Institute (MNI) space template (including reslicing to 2 mm × 2 mm × 2 mm voxels), and smoothed with a Gaussian kernel at 8 mm × 8 mm × 8 mm full half-width maximum. We first checked the realignment parameters of each individual to identify scans on which sharp movements [bigger than half of the voxel size (1.5 mm) and/or more than 1.5°] had occurred and inspected those scans manually. Corrupted images were excluded and replaced with the average of the neighbor images using ImCalc in SPM8. No subject had more than 10% corrupted images due to movement. Maximum likelihood parameter estimates were calculated at the first level at each voxel, using the general linear model. Our design matrix included an autoregressive AR(1) model of serial correlations and a high-pass filter with a cutoff of 128 s. The onsets of each event were convolved with the SPM synthetic hemodynamic response function and its temporal and dispersion derivatives. The first level design matrix included four cue regressors, an outcome regressor, and its parametric modulation by magnitude of reward (in Swiss Francs); for more details see Roiser et al. (49). Only aberrant contrasts of reward prediction entered the second level analyses to identify the main effect of motivational salience and between-group differences, using the summary statistics approach to random-effects analysis.

A two sample t-test at the whole brain level was used to test for group differences on the aberrant contrasts of reward prediction. For between-group differences, significance was assessed at a cluster-level threshold of p < 0.001 FWE corrected across the whole brain, using a cluster-forming threshold of p < 0.001 (uncorrected) (50). In tables and results, we report cluster-level p values.

Effects were visualized in the FMRIB Software Library Viewer and labeled using the incorporated atlas tools (i.e., MNI Structural Atlas and the Juelich Histological Atlas).

The primary goal of this study was to assess the relation between symptom severity and functional brain imaging correlates of aberrant salience processing. However, as we also included criminal offenders into our study, we also decided to investigate the impact of forensic background on aberrant salience processing by comparing forensic and FEP.

Results

Demographic and Clinical Data and Behavioral Data

Patients with more positive symptoms were compared to those with less positive symptoms; there were no significant differences in age, verbal intelligence, global functioning, or behavioral data (i.e., explicit or implicit aberrant salience). Patients with less positive symptoms had been treated with higher doses of antipsychotics (p = 0.032) in the last year before scanning (Table 1). For a description of the sociodemographics and clinical characteristics of the groups, see (forensic and first episode patients) Table S1 in Supplementary Material.

Table 1

Psychotic patients withLess positive symptoms (10 FEP and 11 forensic)More positive symptoms (18 FEP and 3 forensic)p
Positive psychotic symptomsa6 ± 114 ± 1<0.0001
Age31.57 ± 7.6929.33 ± 7.800.355
MWT107.65 ± 13.76106.11 ± 14.290.748
CPZ162,973.29 ± 163,944.4660,926 ± 131,687.290.032
GAF54.76 ± 16.5549.10 ± 13.570.239
SAT: behavioral data
Mean reaction time (ms)262.10 ± 46.44260.73 ± 52.420.929
Total omissions0.57 ± 1.362.48 ± 6.570.201
Premature responses5.86 ± 8.774.33 ± 4.290.479
Implicit aberrant salience (ms)15.79 ± 10.7615.10 ± 8.520.819
Explicit aberrant salience (VAS%)12.08 ± 11.4610.89 ± 8.310.702

Description of sociodemographic and clinical samples: median split by positive psychotic symptoms.

Data are presented as mean ± SD.

aSum of BPRS items (suspiciousness, hallucinations, unusual thought content, and conceptual disorganization).

CPZ, cumulative chlorpromazine equivalents during the previous year; GAF, global assessment of functioning; MWT, intelligence quotient test (Mehrfachwahl-Wortschatz-Intelligenz-Test); SAT, Salience Attribution Test.

fMRI Data

Compared to the patients with less positive symptoms, patients with more positive symptoms showed a cluster of significantly increased BOLD signals in the left posterior insula (according to the Juelich Histological Atlas) (51) [peak voxel (x = −38, y = −16, z = −2), voxel size 272, p = 0.038] (Table 2; Figure 1). Including explicit (p = 0.05) and implicit (p = 0.049) aberrant salience as a covariate did not alter this result. There were no significant differences between forensic patients and first episode patients without a history of direct violence.

Table 2

ContrastCluster level
Voxel level
Z
PFWE-correctedkEPFWE-correctedMNI
LowPos < HighPos0.0382720.342−38 −16 −24.10Left posterior insula
0.491−50 −5 43.96Left frontal lobe
0.961−46 2 23.44Left frontal lobe
LowPos > HighPosn.s.

Regional brain activations identified by aberrant salience.

LowPos, patients with less positive symptoms; MorePos, patients with more positive symptoms.

The upper part of the table presents significant brain regions; patients with less positive symptoms had less activation than patients with more positive symptoms, at a cluster-level threshold of p < 0.001 FWE corrected across the whole brain, using a cluster-forming threshold of p < 0.001 (uncorrected), and a minimal cluster size of 20 voxel; MNI, coordinates x y z according to the Montreal Neurological Institute.

Figure 1

Figure 1

Brain activation during aberrant salience associated with positive symptoms. Patients with more positive symptoms compared to those with less positive symptoms showed higher activation in the left posterior insula (p = 0.038), The image is displayed at a cluster-level threshold of p < 0.001 FWE corrected across the whole brain, using a cluster-forming threshold of p < 0.001 (uncorrected), and the right side of the brain is displayed on the right side of the figure.

Correlations

Aberrant reward prediction signals in the left posterior insula (time-series extraction at peak voxel from the above analysis in all included subjects in VOI with radius 5 mm) correlated negatively with the CPZ during the previous year (r = −0.307, p = 0.048) (Figure 2); this correlation did not remain significant after removal of the 17 patients with CPZ = 0 (r = −0.308, p = 0.134). There was no significant correlation between positive symptoms and implicit (r = 0.11, p = 0.49) and explicit aberrant salience (r = 0.07, p = 0.67).

Figure 2

Figure 2

Relationship between blood oxygenation level-dependent (BOLD) signal in the left posterior insula and chlorpromazine equivalents in milligram during the previous year in psychotic patients.

Discussion

Patients with more positive symptoms showed increased hemodynamic responses in the left insula corresponding to aberrant salience, compared to those with less positive symptoms. In addition, left insula activation correlated negatively with cumulative antipsychotic medication; this effect might be driven by the patients without antipsychotic medication.

In the present study, we focused on psychopathology as a clinical measure, rather than diagnostic group differences. Currently available diagnostic systems (52, 53) seem not to be optimal for classifying the severity of positive symptoms. In addition, it is being increasingly recognized that there is great heterogeneity within psychotic disorders (54, 55).

In contradiction to our first hypothesis, we found no significant behavioral differences with respect to task performance. On the basis of the existing literature, one would expect the patient groups to differ at a behavioral level according to positive symptom severity. However, our results stand in contrast to results from medicated delusional schizophrenia patients [with delusion score 3.2 (SD = 1.0) out of a maximum score of 5], who exhibited significantly greater aberrant salience than those without delusions (7) and to results from clinical high-risk patients who were more likely to attribute motivational salience to irrelevant stimulus features related to the severity of their delusion-like symptoms (32). Our two groups showed almost equal explicit aberrant salience [12.1 (SD = 11.5) and 10.9 (SD = 8.3)], with values similar to those in the high-risk population [12 in Roiser et al. (32)]. The average measure of explicit aberrant salience in HC was 11.2 (SD = 9.1) (49).

This contradiction could be related to the antipsychotic medication: group with less positive symptoms had taken significantly higher doses of antipsychotics during the previous year. Thus, the antipsychotics could have already improved positive psychotic symptoms as well as the measure of aberrant salience, so that there is no behavioral difference between our groups. Another explanation might be that some of our patients with severe delusions belong to the “non-dopaminergic” sub type of psychosis (35), with normal salience but psychotic symptoms due to NMDA receptor dysfunction (36). Another explanation might be that differences in salience are too subtle to be detected in behavior and can only be seen at the functional level.

In partial agreement with our second hypothesis that functional neuroimaging results of aberrant salience relate to positive symptom severity, we found different hemodynamic responses in the left insula. This area is known to have a key role in the salience network (8, 56), as the insula has been shown to be involved in the subjective awareness of internal stimuli (e.g., disgust, anger, sexual arousal) and external stimuli (e.g., pain, taste, temperature) (14, 24). Insular dysfunction in schizophrenia has also been reported to be present during working memory tasks (57), and structural alterations in the right insula seemed to be associated with a higher risk for transition to psychosis in patients with a clinical high-risk state for psychosis (41). Since the salience network has been demonstrated to be critical for integrating internal and external stimuli (3, 58), dysfunction of this circuit in patients with schizophrenia may give rise to the misattribution of experiences, which finally result in hallucinations (59). In psychotic patients, auditory verbal hallucinations evoked increased BOLD signals in the right homolog of Broca’s area, bilateral insula, bilateral supramarginal gyri, and right superior temporal gyrus (60). Another study found that insula activation preceded hallucination onset (61).

In conclusion, our observations are consistent with Kapur’s hypothesis (5), which postulated that inappropriate and excessive salience was responsible for delusions and hallucinations in psychoses.

As the salience network comprises the insula and the anterior cingulate cortex (3, 10, 24, 25, 6264), we would have expected functional alterations in the latter structure. The absence of alterations in cingular activity is in line with previously published results comparing FEP and healthy controls (38). Our observation might be explained by the normalization of brain function by antipsychotic medication, as the majority of the presented patients were under drug treatment.

As regards the complexity of impairments in psychosis, it is unlikely that clinical manifestations are caused by malfunction of a single brain system (65). It has been discussed whether other brain networks, such as the default mode network including regions in the medial frontal and posterior cingulate cortex, reduce their activity during cognitive demands and may be involved in attention processing (66). Recently, Palaniyappan et al. (9) examined the interactions between the salience system and the central executive network (CEN) and observed a significant failure of both the feedforward and reciprocal influence between the insula and the DLPFC in schizophrenia. These findings provide compelling evidence for a breakdown of the salience–execution loop in the clinical expression of psychosis (9). Reduced cognitive control could lead to reduced attention to salient stimuli, which in turn would then lead to reduced adaptive salience. This reasoning has been supported by studies demonstrating that the severity of cognitive dysfunction in psychosis seems to be influenced by deficits in the CEN (67).

In structural MRI, the association between reality distortion and salience network deficits is based mainly on findings of insular deficits with hallucinations (6874). A study in monozygotic twins where one sibling suffered from schizophrenia suggested that schizophrenia leads to gray matter loss in the bilateral insular cortex (75). Similar results have been found in populations at high risk for developing schizophrenia (76, 77). In patients with schizophrenia, an inverse relationship has been described between volumes of the right insula and delusions, but not with hallucinations (78).

Previous studies in patients with schizophrenia have found a relationship between left insular volume and positive symptoms (17, 79). Specifically, reductions in left insular volume (74) and activation of this brain area (80, 81) have been associated with auditory hallucinations. Other studies have also reported reductions in the insular cortex specifically associated with paranoid symptoms, as opposed to hallucinations; however, these studies are inconsistent with regard to bilateral versus left insular cortex reductions (82, 83). A multimodal investigation in patients with schizophrenia provided evidence that gray matter reduction in the salience network had functional consequences (25). In particular, the structural defect of the insula was associated with inefficient brain circuit recruitment for information processing.

In addition to structural deficits in salience network, reduced functional connectivity between the midbrain and the insula was found in patients with schizophrenia. The loss in connectivity correlated with increased psychotic symptoms (27). Furthermore, altered between-network interactions during psychotic remission have been demonstrated, which is related to the severity of negative symptoms (56). Altered salience network connectivity with other cortical networks seemed to be a stable characteristic of the pathophysiology of schizophrenia (16, 84), even during the resting state (56, 85).

The relationship between schizophrenia and violence is complex. Among patients with schizophrenia, the risk for violence has been associated with several factors, such as personality traits, substance abuse, intelligence, presence of psychotic symptoms, and demographic background (86). To the best of our knowledge, there is only one study assessing salience in forensic patients: greater impairment in affect recognition performance combined with higher salience and arousal may contribute to the occurrence of violent acts in schizophrenic patients (87). Additionally, it has been demonstrated that positive symptoms in schizophrenic patients can be associated with a criminal history even before diagnosis of a first episode (88). In the present data, there was no difference in BOLD signals between forensic and non-forensic patients, which indicates that the history of a violent criminal offense does not have an important impact on salience processing.

Some limitations of our study merit comment. The sample sizes were modest, and the fact that the majority of our patients were receiving medication may have confounded our findings. Thus, studies exploring antipsychotic-naïve patients are warranted. As antipsychotic medication was very heterogeneous, studies in patients with uniform medication are needed, especially given that atypical and typical antipsychotics may differentially affect brain functioning.

Furthermore, the SAT has been designed to measure abnormal motivational salience processing and its relation to dopamine dysregulation in the VS. However, motivation is not the only form of salience (1), and it would be important to test striatal activation in psychosis during other forms of salience processing that are not measured using speeded response tasks. Further studies should include a healthy control group. As a similar insular activation in the healthy control group and the group with lower scores of positive symptoms would strengthen the evidence for insular dysfunction associated with positive symptoms. Finally, one might argue that the correlation between insular activation and CPZ might simply reflect group differences as CPZ values differ between the two groups.

We conclude that insular salience processing may be altered in psychoses, depending on the severity of positive symptoms. In addition, our results suggest that antipsychotic medication has a negatively modulating effect on insular functioning.

Statements

Author contributions

SB, AR-R, AE, and RS designed the study and wrote the protocol. CS, RS, AS, and AW managed the literature searches, fMRI analyses, and statistical analysis. AW, RS, FH, CL, and TV helped collecting the data. AW wrote the manuscript. CS helped preparing the manuscript. SB, UL, and AR-R critically revised the manuscript and provided infrastructural support. All the authors contributed to and have approved the final manuscript.

Funding

This work was supported by the University of Basel and the “Forschungsförderungsfonds” (Research Support Fund), the Swiss National Science Foundation (No. 119382 and 127323 to RS, AE and SB) of the UPK Basel.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary Material for this article can be found online at http://journal.frontiersin.org/article/10.3389/fpsyt.2016.00189/full#supplementary-material.

References

  • 1

    Winton-BrownTTFusar-PoliPUnglessMAHowesOD. Dopaminergic basis of salience dysregulation in psychosis. Trends Neurosci (2014) 37:8594.10.1016/j.tins.2013.11.003

  • 2

    BerridgeKCRobinsonTE. What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?Brain Res Rev (1998) 28:30969.10.1016/S0165-0173(98)00019-8

  • 3

    MenonVUddinLQ. Saliency, switching, attention and control: a network model of insula function. Brain Struct Funct (2010) 214(5–6):65567.10.1007/s00429-010-0262-0

  • 4

    SethAKSuzukiKCritchleyHD. An interoceptive predictive coding model of conscious presence. Front Psychol (2012) 2:395.10.3389/fpsyg.2011.00395

  • 5

    KapurS. Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia. Am J Psychiatry (2003) 160:1323.10.1176/appi.ajp.160.1.13

  • 6

    JensenJKapurS. Salience and psychosis: moving from theory to practise. Psychol Med (2009) 39:1978.10.1017/S0033291708003899

  • 7

    RoiserJPStephanKEden OudenHEMBarnesTREFristonKJJoyceEM. Do patients with schizophrenia exhibit aberrant salience?Psychol Med (2009) 39:199209.10.1017/S0033291708003863

  • 8

    BarchDM. Brain network interactions in health and disease. Trends Cogn Sci (2013) 17:6035.10.1016/j.tics.2013.09.004

  • 9

    PalaniyappanLSimmoniteMWhiteTLiddleELiddleP. Neural primacy of the salience processing system in schizophrenia. Neuron (2013) 79:81428.10.1016/j.neuron.2013.06.027

  • 10

    SeeleyWWMenonVSchatzbergAFKellerJGloverGHKennaHet alDissociable intrinsic connectivity networks for salience processing and executive control. J Neurosci (2007) 27:234956.10.1523/JNEUROSCI.5587-06.2007

  • 11

    CraigAD. How do you feel – now? The anterior insula and human awareness. Nat Rev Neurosci (2009) 10:5970.10.1038/nrn2555

  • 12

    DeenBPitskelNBPelphreyKA. Three systems of insular functional connectivity identified with cluster analysis. Cereb Cortex (2011) 21:1498506.10.1093/cercor/bhq186

  • 13

    JonesCLWardJCritchleyHD. The neuropsychological impact of insular cortex lesions. J Neurol Neurosurg Psychiatry (2010) 81:6118.10.1136/jnnp.2009.193672

  • 14

    CraigAD. How do you feel? Interoception: the sense of the physiological condition of the body. Nat Rev Neurosci (2002) 3:65566.10.1038/nrn894

  • 15

    Bar-OnRTranelDDenburgNLBecharaA. Exploring the neurological substrate of emotional and social intelligence. Brain (2003) 126:1790800.10.1093/brain/awg177

  • 16

    WhiteTPJosephVFrancisSTLiddlePF. Aberrant salience network (bilateral insula and anterior cingulate cortex) connectivity during information processing in schizophrenia. Schizophr Res (2010) 123:10515.10.1016/j.schres.2010.07.020

  • 17

    Crespo-FacorroBKimJJAndreasenNCO’learyDSBockholtHJMagnottaV. Insular cortex abnormalities in schizophrenia: a structural magnetic resonance imaging study of first-episode patients. Schizophr Res (2000) 46:3543.10.1016/S0920-9964(00)00028-1

  • 18

    JardriRPouchetAPinsDThomasP. Cortical activations during auditory verbal hallucinations in schizophrenia: a coordinate-based meta-analysis. Am J Psychiatry (2011) 168:7381.10.1176/appi.ajp.2010.09101522

  • 19

    SchmidtAPalaniyappanLSmieskovaRSimonARiecher-RösslerALangUEet alDysfunctional insular connectivity during reward prediction in patients with first-episode psychosis. J Psychiatry Neurosci (2016) 41:150234.10.1503/jpn.150234

  • 20

    MeltzerHYLiZKanedaYIchikawaJ. Serotonin receptors: their key role in drugs to treat schizophrenia. Prog Neuropsychopharmacol Biol Psychiatry (2003) 27:115972.10.1016/j.pnpbp.2003.09.010

  • 21

    SarpalDKRobinsonDGLenczTArgyelanMIkutaTKarlsgodtKet alAntipsychotic treatment and functional connectivity of the striatum in first-episode schizophrenia. JAMA psychiatry (2015) 72:513.10.1001/jamapsychiatry.2014.1734

  • 22

    Ellison-WrightIGlahnDCLairdARThelenSMBullmoreE. The anatomy of first-episode and chronic schizophrenia: an anatomical likelihood estimation meta-analysis. Am J Psychiatry (2008) 165:101523.10.1176/appi.ajp.2008.07101562

  • 23

    GlahnDCLairdAREllison-WrightIThelenSMRobinsonJLLancasterJLet alMeta-Analysis of gray matter anomalies in schizophrenia: application of anatomic likelihood estimation and network analysis. Biol Psychiatry (2008) 64:77481.10.1016/j.biopsych.2008.03.031

  • 24

    PuWLiLZhangHOuyangXLiuHZhaoJet alMorphological and functional abnormalities of salience network in the early-stage of paranoid schizophrenia. Schizophr Res (2012) 141:1521.10.1016/j.schres.2012.07.017

  • 25

    PalaniyappanLDoegeKMallikarjunPLiddleE. Cortical thickness and oscillatory phase resetting: a proposed mechanism of salience network dysfunction in schizophrenia. Psychiatriki (2012) 23:11729.

  • 26

    DiaconescuAOJensenJWangHWilleitMMenonMKapurSet alAberrant effective connectivity in schizophrenia patients during appetitive conditioning. Front Hum Neurosci (2011) 4:239.10.3389/fnhum.2010.00239

  • 27

    GradinVBWaiterGO’ConnorARomaniukLStickleCMatthewsKet alSalience network-midbrain dysconnectivity and blunted reward signals in schizophrenia. Psychiatry Res (2013) 211:10411.10.1016/j.pscychresns.2012.06.003

  • 28

    GrimmOVollstädt-KleinSKrebsLZinkMSmolkaMN. Reduced striatal activation during reward anticipation due to appetite-provoking cues in chronic schizophrenia: a fMRI study. Schizophr Res (2012) 134:1517.10.1016/j.schres.2011.11.027

  • 29

    McGowanSLawrenceADSalesTQuestedDGrasbyP. Presynaptic dopaminergic dysfunction in schizophrenia: a positron emission tomographic [18F]fluorodopa study. Arch Gen Psychiatry (2004) 61:13442.10.1001/archpsyc.61.2.134

  • 30

    SnyderSH. The dopamine hypothesis of schizophrenia: focus on the dopamine receptor. Am J Psychiatry (1976) 133:197202.10.1176/ajp.133.2.197

  • 31

    HeinzASchlagenhaufF. Dopaminergic dysfunction in schizophrenia: salience attribution revisited. Schizophr Bull (2010) 36:47285.10.1093/schbul/sbq031

  • 32

    RoiserJPHowesODChaddockCAJoyceEMMcGuireP. Neural and behavioral correlates of aberrant salience in individuals at risk for psychosis. Schizophr Bull (2012) 39:132836.10.1093/schbul/sbs147

  • 33

    MortimerAMSinghPShepherdCJPuthiryackalJ. Clozapine for treatment-resistant schizophrenia: National Institute of Clinical Excellence (NICE) guidance in the real world. Clin. Schizophr. Relat. Psychoses (2010) 4:4955.10.3371/CSRP.4.1.4

  • 34

    KapurSZipurskyRJonesCRemingtonGHouleS. Relationship between dopamine d 2 occupancy, clinical response, and side effects: a double-blind PET study of first-episode schizophrenia. Am J Psychiatry (2000) 157:51420.10.1176/appi.ajp.157.4.514

  • 35

    HowesODKapurS. A neurobiological hypothesis for the classification of schizophrenia: type a (hyperdopaminergic) and type b (normodopaminergic). Br J Psychiatry (2014) 205:13.10.1192/bjp.bp.113.138578

  • 36

    StoneJMMorrisonPDPilowskyLS. Glutamate and dopamine dysregulation in schizophrenia – a synthesis and selective review. J Psychopharmacol (2007) 21:44052.10.1177/0269881106073126

  • 37

    HowesOMcCutcheonRStoneJ. Glutamate and dopamine in schizophrenia: an update for the 21st century. J Psychopharmacol (2015) 29:97115.10.1177/0269881114563634

  • 38

    SmieskovaRRoiserJPChaddockCASchmidtAHarrisbergerFBendfeldtKet alModulation of motivational salience processing during the early stages of psychosis. Schizophr Res (2014) 166:1723.10.1016/j.schres.2015.04.036

  • 39

    BreitbordeNJKSrihariVHWoodsSW. Review of the operational definition for first-episode psychosis. Early Interv Psychiatry (2009) 3:25965.10.1111/j.1751-7893.2009.00148.x

  • 40

    Riecher-RösslerAGschwandtnerUBorgwardtSAstonJPflügerMRösslerW. Early detection and treatment of schizophrenia: how early?Acta Psychiatr Scand Suppl (2006) 113:7380.10.1111/j.1600-0447.2005.00722.x

  • 41

    SmieskovaRFusar-PoliPAstonJSimonABendfeldtKLenzCet alInsular volume abnormalities associated with different transition probabilities to psychosis. Psychol Med (2012) 42:161325.10.1017/S0033291711002716

  • 42

    YungARPhillipsLJMcGorryPDMcFarlaneCAFranceySHarriganSet alPrediction of psychosis: a step towards indicated prevention of schizophrenia. Br J Psychiatry (1998) 172:1420.

  • 43

    McGuffinPFarmerAHarveyI. A polydiagnostic application of operational criteria in studies of psychotic illness: development and reliability of the OPCRIT system. Arch Gen Psychiatry (1991) 48:76470.10.1001/archpsyc.1991.01810320088015

  • 44

    AndreasenNC. Scale for the Assessment of Negative Symptoms (SANS). Br J Psychiatry (1989) 155:538.

  • 45

    WoodsSW. Chlorpromazine equivalent doses for the newer atypical antipsychotics. J Clin Psychiatry (2003) 64:6637.10.4088/JCP.v64n0607

  • 46

    LukoffDLibermanRPNuechterleinKH. Symptom monitoring in the rehabilitation of schizophrenic patients. Schizophr Bull (1986) 12:578602.10.1093/schbul/12.4.578

  • 47

    VenturaJGreenMFShanerALibermanRP. Training and quality assurance with the Brief Psychiatric Rating Scale: “the drift busters”. Int J Methods Psychiatr Res (1993) 3:22144.

  • 48

    LehrlS. Manual zum MWT. Bahlingen: Perimed (1991).

  • 49

    RoiserJPStephanKEden OudenHEMFristonKJJoyceEM. Adaptive and aberrant reward prediction signals in the human brain. Neuroimage (2010) 50:65764.10.1016/j.neuroimage.2009.11.075

  • 50

    PeterssonKMNicholsTEPolineJBHolmesAP. Statistical limitations in functional neuroimaging. I. Non-inferential methods and statistical models. Philos Trans R Soc Lond B Biol Sci (1999) 354:123960.10.1098/rstb.1999.0477

  • 51

    KurthFEickhoffSBSchleicherAHoemkeLZillesKAmuntsK. Cytoarchitecture and probabilistic maps of the human posterior insular cortex. Cereb Cortex (2010) 20:144861.10.1093/cercor/bhp208

  • 52

    American Psychiatric Association. DSM-V. Arlington: American Psychiatric Association Publishing (2013).

  • 53

    World Health Organisation. The ICD-10 Classification of Mental and Behavioural Disorders: Clinical Descriptions and Diagnostic Guidelines. Geneva: World Health Organization (1992).

  • 54

    ClementzBASweeneyJAHammJPIvlevaEIEthridgeLEPearlsonGDet alIdentification of distinct psychosis biotypes using brain-based biomarkers. Am J Psychiatry (2016) 173:37384.10.1176/appi.ajp.2015.14091200

  • 55

    GreenIWGlausierJR. Different paths to core pathology: the equifinal model of the schizophrenia syndrome. Schizophr Bull (2015) 42:5429.10.1093/schbul/sbv136

  • 56

    ManoliuARiedlVZherdinAMühlauMSchwerthöfferDScherrMet alAberrant dependence of default mode/central executive network interactions on anterior insular salience network activity in schizophrenia. Schizophr Bull (2014) 40:42837.10.1093/schbul/sbt037

  • 57

    PujolNPenadésRRamettiGCatalánRVidal-PiñeiroDPalaciosEet alInferior frontal and insular cortical thinning is related to dysfunctional brain activation/deactivation during working memory task in schizophrenic patients. Psychiatry Res (2013) 214:94101.10.1016/j.pscychresns.2013.06.008

  • 58

    BresslerSLMenonV. Large-scale brain networks in cognition: emerging methods and principles. Trends Cogn Sci (2010) 14:27790.10.1016/j.tics.2010.04.004

  • 59

    WylieKPTregellasJR. The role of the insula in schizophrenia. Schizophr Res (2010) 123:93104.10.1016/j.schres.2010.08.027

  • 60

    SommerIECDiederenKMJBlomJDWillemsAKushanLSlotemaKet alAuditory verbal hallucinations predominantly activate the right inferior frontal area. Brain (2008) 131:316977.10.1093/brain/awn251

  • 61

    HoffmanREAndersonAWVarankoMGoreJCHampsonM. Time course of regional brain activation associated with onset of auditory/verbal hallucinations. Br J Psychiatry (2008) 193:4245.10.1192/bjp.bp.107.040501

  • 62

    BonnelleVHamTELeechRKinnunenKMMehtaMAGreenwoodRJet alSalience network integrity predicts default mode network function after traumatic brain injury. Proc Natl Acad Sci U S A (2012) 109:46905.10.1073/pnas.1113455109

  • 63

    McFaddenKLTregellasJRShottMEFrankGKW. Reduced salience and default mode network activity in women with anorexia nervosa. J Psychiatry Neurosci (2013) 38:130046.10.1503/jpn.130046

  • 64

    PalaniyappanLWhiteTPLiddlePF. The concept of salience network dysfunction in schizophrenia: from neuroimaging observations to therapeutic opportunities. Curr Top Med Chem (2012) 12:232438.10.2174/156802612805289881

  • 65

    LooijestijnJBlomJDAlemanAHoekHWGoekoopR. An integrated network model of psychotic symptoms. Neurosci Biobehav Rev (2015) 59:23850.10.1016/j.neubiorev.2015.09.016

  • 66

    PowerJDCohenALNelsonSMWigGSBarnesKAChurchJAet alFunctional network organization of the human brain. Neuron (2011) 72:66578.10.1016/j.neuron.2011.09.006

  • 67

    RepovsGCsernanskyJGBarchDM. Brain network connectivity in individuals with schizophrenia and their siblings. Biol Psychiatry (2011) 69:96773.10.1016/j.biopsych.2010.11.009

  • 68

    García-MartíGAguilarEJLullJJMartí-BonmatíLEscartíMJManjónJVet alSchizophrenia with auditory hallucinations: a voxel-based morphometry study. Prog Neuropsychopharmacol Biol Psychiatry (2008) 32:7280.10.1016/j.pnpbp.2007.07.014

  • 69

    GaserCNenadicIBuchsbaumBRHazlettEABuchsbaumMS. Ventricular enlargement in schizophrenia related to volume reduction of the thalamus, striatum, and superior temporal cortex. Am J Psychiatry (2004) 161:1546.10.1176/appi.ajp.161.1.154

  • 70

    ModinosGVercammenAMechelliAKnegteringHMcGuirePKAlemanA. Structural covariance in the hallucinating brain: a voxel-based morphometry study. J Psychiatry Neurosci (2009) 34:4659.

  • 71

    NeckelmannGSpechtKLundAErslandLSmievollAINeckelmannDet alMr morphometry analysis of grey matter volume reduction in schizophrenia: association with hallucinations. Int J Neurosci (2006) 116:923.10.1080/00207450690962244

  • 72

    NenadicISmesnySSchlösserRGMSauerHGaserC. Auditory hallucinations and brain structure in schizophrenia: voxel-based morphometric study. Br J Psychiatry (2010) 196:4123.10.1192/bjp.bp.109.070441

  • 73

    O’DalyOGFrangouSChitnisXShergillSS. Brain structural changes in schizophrenia patients with persistent hallucinations. Psychiatry Res (2007) 156:1521.10.1016/j.pscychresns.2007.03.001

  • 74

    ShapleskeJRossellSLChitnisXASucklingJSimmonsABullmoreETet alA computational morphometric MRI study of schizophrenia: effects of hallucinations. Cereb Cortex (2002) 12:133141.10.1093/cercor/12.12.1331

  • 75

    BorgwardtSJPicchioniMMEttingerUToulopoulouTMurrayRMcGuirePK. Regional gray matter volume in monozygotic twins concordant and discordant for schizophrenia. Biol Psychiatry (2010) 67:95664.10.1016/j.biopsych.2009.10.026

  • 76

    ChanRCKDiXMcAlonanGMGongQY. Brain anatomical abnormalities in high-risk individuals, first-episode, and chronic schizophrenia: an activation likelihood estimation meta-analysis of illness progression. Schizophr Bull (2011) 37:17788.10.1093/schbul/sbp073

  • 77

    TakahashiTWoodSJSoulsbyBMcGorryPDTaninoRSuzukiMet alFollow-up MRI study of the insular cortex in first-episode psychosis and chronic schizophrenia. Schizophr Res (2009) 108:4956.10.1016/j.schres.2008.12.029

  • 78

    CascellaNGGernerGJFieldstoneSCSawaASchretlenDJ. The insula-claustrum region and delusions in schizophrenia. Schizophr Res (2011) 133:7781.10.1016/j.schres.2011.08.004

  • 79

    GoldsteinJMGoodmanJMSeidmanLJKennedyDNMakrisNLeeHet alCortical abnormalities in schizophrenia identified by structural magnetic resonance imaging. Arch Gen Psychiatry (1999) 56:53747.10.1001/archpsyc.56.6.537

  • 80

    DierksTLindenDEJandlMFormisanoEGoebelRLanfermannHet alActivation of Heschl’s gyrus during auditory hallucinations. Neuron (1999) 22:61521.10.1016/S0896-6273(00)80715-1

  • 81

    WoodruffPWWrightICBullmoreETBrammerMHowardRJWilliamsSCet alAuditory hallucinations and the temporal cortical response to speech in schizophrenia: a functional magnetic resonance imaging study. Am J Psychiatry (1997) 154:167682.10.1176/ajp.154.12.1676

  • 82

    HaTHYounTHaKSRhoKSLeeJMKimIYet alGray matter abnormalities in paranoid schizophrenia and their clinical correlations. Psychiatry Res (2004) 132:25160.10.1016/j.pscychresns.2004.05.001

  • 83

    Hulshoff PolHESchnackHGMandlRCvan HarenNEKoningHCollinsDLet alFocal gray matter density changes in schizophrenia. Arch Gen Psychiatry (2001) 58:111825.10.1001/archpsyc.58.12.1118

  • 84

    TuPBucknerRLZolleiLDyckmanKAGoffDCManoachDS. Reduced functional connectivity in a right-hemisphere network for volitional ocular motor control in schizophrenia. Brain (2010) 133:62537.10.1093/brain/awp317

  • 85

    OrliacFNaveauMJoliotMDelcroixNRazafimandimbyABrazoPet alLinks among resting-state default-mode network, salience network, and symptomatology in schizophrenia. Schizophr Res (2013) 148:7480.10.1016/j.schres.2013.05.007

  • 86

    BoSAbu-AkelAKongerslevMHaahrUHSimonsenE. Risk factors for violence among patients with schizophrenia. Clin Psychol Rev (2011) 31:71126.10.1016/j.cpr.2011.03.002

  • 87

    FrommannNStrothSBrinkmeyerJWölwerWLuckhausC. Facial affect recognition performance and event-related potentials in violent and non-violent schizophrenia patients. Neuropsychobiology (2013) 68:13945.10.1159/000353252

  • 88

    MunknerRHaastrupSJoergensenTKrampP. The association between psychopathology of first-episode psychosis patients within the schizophrenia spectrum and previous offending. Nord J Psychiatry (2009) 63:12431.10.1080/08039480802421109

Summary

Keywords

brain imaging, psychosis, salience network, antipsychotic medication, psychopathology, schizophrenia, insula

Citation

Walter A, Suenderhauf C, Smieskova R, Lenz C, Harrisberger F, Schmidt A, Vogel T, Lang UE, Riecher-Rössler A, Eckert A and Borgwardt S (2016) Altered Insular Function during Aberrant Salience Processing in Relation to the Severity of Psychotic Symptoms. Front. Psychiatry 7:189. doi: 10.3389/fpsyt.2016.00189

Received

19 July 2016

Accepted

09 November 2016

Published

23 November 2016

Volume

7 - 2016

Edited by

Christoph Mulert, University Medical Center Hamburg-Eppendorf, Germany

Reviewed by

Mitul Ashok Mehta, King’s College London, UK; Marc Seal, Murdoch Childrens Research Institute, Australia

Updates

Copyright

*Correspondence: Anna Walter,

Specialty section: This article was submitted to Neuroimaging and Stimulation, a section of the journal Frontiers in Psychiatry

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics