Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 07 November 2023
Sec. Schizophrenia

Dysregulated noradrenergic response is associated with symptom severity in individuals with schizophrenia

  • 1Instituto de Psiquiatria, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
  • 2Instituto de Ciências Biomédicas, Universidade Federal do Rio de Janeiro, Rio de Janeiro, Brazil
  • 3Université Paris Cité, Institut de Psychiatrie et Neurosciences de Paris, Inserm, Paris, France

Introduction: The locus coeruleus-noradrenaline (LC-NA) system is involved in a wide range of cognitive functions and may be altered in schizophrenia. A non-invasive method to indirectly measure LC activity is task-evoked pupillary response. Individuals with schizophrenia present reduced pupil dilation compared to healthy subjects, particularly when task demand increases. However, the extent to which alteration in LC activity contributes to schizophrenia symptomatology remains largely unexplored. We aimed to investigate the association between symptomatology, cognition, and noradrenergic response in individuals with schizophrenia.

Methods: We assessed task-evoked pupil dilation during a pro- and antisaccade task in 23 individuals with schizophrenia and 28 healthy subjects.

Results: Both groups showed similar preparatory pupil dilation during prosaccade trials, but individuals with schizophrenia showed significantly lower pupil dilation compared to healthy subjects in antisaccade trials. Importantly, reduced preparatory pupil dilation for antisaccade trials was associated with worse general symptomatology in individuals with schizophrenia.

Discussion: Our findings suggest that changes in LC-NA activity – measured by task-evoked pupil dilation – when task demand increases is associated with schizophrenia symptoms. Interventions targeting the modulation of noradrenergic responses may be suitable candidates to reduce schizophrenia symptomatology.

1. Introduction

Schizophrenia symptoms may arise from dysregulation in neuromodulatory systems. Evidence suggests that the locus coeruleus-noradrenergic (LC-NA) system might be involved in the development of schizophrenia pathophysiology (1, 2), although the prevailing hypothesis involves the dopaminergic and glutamatergic systems (3, 4). Cognitive deficits, for example, have long been recognized as a core feature of schizophrenia and are associated with poor functional outcomes (57). There has been a growing interest in studying cognitive deficits in schizophrenia as they predict functional outcomes, resist antipsychotic treatment, and often persist throughout life (711).

The LC-NA system plays a pivotal role in regulating cognitive functions, such as working memory, learning and attention, and memory consolidation (1217), which are largely impaired in schizophrenia. In individuals with schizophrenia, noradrenaline (NA) is elevated in both the blood and the cerebrospinal fluid (CSF) (18), especially in those with positive symptoms (e.g., delusions, hallucinations, thought disorders) (19). Postmortem studies have also reported increased markers for NA in the brains of schizophrenia individuals (20, 21). In general, studies associated positive symptoms with hyperactivity of the NA system, while negative symptoms (e.g., affective blunting, inattention, abulia) were related to hypoactivity of the NA system (1). For instance, diminished frontocentral P300 amplitudes observed in individuals with schizophrenia during oddball and inhibition tasks may be an indicator of LC hypoactivity (22). Additionally, drugs increasing the central NA concentration (e.g., modafinil) lead to better performance in some cognitive abilities (23, 24).

Task-evoked pupil dilation is a non-invasive, well-established indirect measure of LC-NA activity (12, 2527) and has been used as an effective indicator of cognitive processing (2832). For example, pupil dilation scales with levels of difficulty across a variety of cognitive tasks (e.g., N-back, Digit Span, Stroop tasks), and it is associated with task difficulty in different cognitive domains (28, 3340). Among healthy subjects, changes in pupil size during the preparatory period to exert an antisaccade, which requires a saccade to the opposite side of the target, are larger than for prosaccades (41).

In cognitive tasks, individuals with schizophrenia tend to exhibit reduced pupil dilation compared to healthy subjects, especially as task demands increase (39, 4245). For instance, reduced task-evoked pupil response in preparation for antisaccades might contribute to deficits in executive cognitive control in individuals across the psychosis spectrum (46). Interestingly, changes in pupil size for pro-and anti-saccades were reported as similar (47), which may suggest a deficit in LC activity regulation in response to higher task demands in schizophrenia. Moreover, reduced pupil dilation has been related to the severity of negative symptoms of schizophrenia (44, 48). For example, greater pupil dilation was associated with worse motivational negative symptoms, which include lack of motivation, anhedonia, and asociality (49). Additionally, in the digit span task, a measure of working memory capacity, individuals with schizophrenia who had severe defeatist attitudes showed significantly less pupil dilation when processing demands increased compared to individuals with mild defeatist attitudes (43). Despite the groundwork in this area, the relationship between LC-NA system dysregulation and schizophrenia symptomatology is still not fully comprehended.

In the present study, we evaluated whether impairments in the LC-NA system, measured using task-evoked pupil dilation, were associated with impairments in the performance of cognitive tasks and clinical symptoms in individuals with schizophrenia compared with matched healthy subjects. First, we examined participants’ task-evoked pupillary response using an oculomotor task that required lower cognitive effort (i.e., prosaccade) and higher cognitive effort (i.e., antisaccade). Considering previous findings, we expected that individuals with schizophrenia would exhibit reduced pupil dilation in the antisaccade task compared to healthy subjects. Second, we examined the relationship between task-evoked pupil dilation, cognition and clinical symptoms. We expected that abnormal pupillary response would be associated with cognitive deficits and increased general symptomatology.

2. Methods

2.1. Participants

The sample included 23 subjects with chronic schizophrenia or schizoaffective disorder recruited from the day-hospital and outpatient clinic of the Institute of Psychiatry (IPUB) at the Federal University of Rio de Janeiro, from September 2013 to December 2019.

The diagnosis was established by a board-certified psychiatrist using a best estimate approach, combining information from medical records and the results of the Structured Clinical Interview for DSM-IV in a validated Brazilian Portuguese version. Chlorpromazine (CPZ, antipsychotic medication) (50) and Benztropine (anticholinergic medication) (51) equivalents (mg) were calculated (Table 1). All patients were stable in the same medication during the period of the experiment and had not suffered a psychotic relapse in the 2 months before study entry. IQ was estimated from the WAIS-III Brazilian version and the severity of symptoms from the Positive and Negative Syndrome Scale (PANSS). Participants were included if they (1) were between the ages of 18 and 65 years of age, (2) had a diagnosis of schizophrenia or schizoaffective disorder, (3) were clinically stable, and had an outpatient status for at least 2 months before starting the study, and (4) had Portuguese as the primary language. Participants were excluded if they (1) had any history of another psychiatric diagnosis, (2) history of psychotic episodes in the previous 2 months, (3) had intellectual disability (IQ < 80), (4) diagnosis of substance dependence, and (5) uncorrected visual or hearing problems.

TABLE 1
www.frontiersin.org

Table 1. Participants’ characteristics.

For the control group, a board-certified psychiatrist recruited 28 volunteers via personal approach. They were free from current or past history of major psychiatric illness and denied a family history of psychotic disorders in first-degree relatives. Recruitment of healthy controls was managed to match the schizophrenia group by sex, age, education, and ethnicity.

All participants signed a written consent form after being informed about the study procedures. The study was approved by the Brazilian National Committee of Ethics in Research (12990013.0.0000.5263) and pre-registered at ClinicalTrials.gov (1R03TW009002–01).

2.2. Assessments

2.2.1. Cognition

We measured the performance of participants in seven cognitive domains that have been defined as impaired in schizophrenia by the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS). We used the following tests: the Cambridge Neuropsychological Test Automated Battery (CANTAB) Reaction Time (RT) and Cogstate Detection to assess speed of processing; the CANTAB Rapid Visual Processing (RVP) and the Cogstate Identification to evaluate attention; the CANTAB Spatial Working Memory (SWM) and Cogstate Two Back for working memory; the MATRICS Consensus Cognitive Battery recommended tests (MCCB) Hopkins Verbal Learning Task (HVLT) for verbal learning; the MCCB Brief Visuospatial Memory Test for visual learning; the CANTAB Stocking Of Cambridge (SOC) and Cogstate Groton Maze Learning for reasoning and problem-solving; and the MCCB Mayer-Salovey-Caruso Emotional Intelligence Test for social cognition. Raw scores were converted to z-scores using developer normative data. Further details regarding cognitive assessments are available in our previous work (9).

2.2.2. Symptoms

The PANSS was administered to assess participants’ clinical status (52).

2.3. Recording and apparatus

Eye position and pupil size were measured with a video-based eye tracker (Eyelink-1000 plus; SR Research Ltd., Ontario, Canada) at a rate of 1,000 Hz with a monocular recording (the right eye and pupil were used). After a 9-point calibration, stimuli were presented on a 23-inch LCD monitor (Philips 144 Hz refresh rate and 1920×1080 pixels resolution). The distance from the eyes, with the head on a chin rest, to the monitor was 56 cm. The pupil diameter provided by EyeLink gives pupil area or diameter in arbitrary units. Therefore, we converted the arbitrary units into absolute units, that is, millimeters (see Supplementary material). All participants were tested under the same lighting conditions.

2.4. Oculomotor task

Participants performed the prosaccade and antisaccade tasks. Each trial began with the appearance of a green (prosaccade condition) or red (antisaccade condition) fixation point (FP) (diameter, 0.5°; 42 cd/m2) on a black background (0.1 cd/m2). In prosaccade trials, participants were instructed to look toward the peripheral stimulus and in the opposite direction in antisaccade trials. After 1,000 ms of central fixation, the FP disappeared for 200 ms before the peripheral stimulus appeared for 1,000 ms (diameter, 0.5°; white dot with luminance 42 cd/m2) to the left or right of the FP (10° eccentricity on the horizontal axis) (Figure 1). Each trial had an inter-trial period of 1,000 ms which provided enough time for the pupil to return to baseline. The experiment consisted of 60 trials of pro-and 60 trials of antisaccade. Trial conditions (prosaccade and antisaccade) and stimulus location (left and right) were randomly interleaved.

FIGURE 1
www.frontiersin.org

Figure 1. Change in pupil size (baseline-corrected to 150-300 ms of fixation point onset) for correct prosaccade and antisaccade trials in 23 individuals with schizophrenia and 28 healthy subjects. The shaded colored regions around the pupillary response represent +/− standard error range (between participants) for the different conditions. The gray area represents the selected epochs for pupil analyses. The magnitude of pupil dilation during task preparation was calculated by averaging the pupil size during the Pre-saccade epoch (50 ms before peripheral stimulus onset) minus the average pupil size over 50 ms at the time of maximum constriction (Max constriction) during fixation.

Reaction time (RT) was defined as the time from response cueing to saccade onset, determined when eye velocity exceeded 30°/s. Trials were correct if the first saccade after the FP was in the correct direction. Directional errors were identified as the first saccade after FP that was executed in the wrong direction (e.g., toward stimulus on antisaccade trials). The error rate was calculated as the ratio of the number of incorrect antisaccades to the total number of antisaccades. Trials with RT less than 90 ms were excluded from the data analysis (53).

For pupil data, trials with an eye position deviation of more than 2° from the FP during the period of central fixation were excluded from the analysis. If the eye is in a blink, the EyeLink will report the specific field as missing values. Therefore, when blinks were detected, following the literature, pre-, and post-blink pupil values were used to do linear interpolation to replace values during the blink period (47). Importantly, there was no significant difference between groups for the number of detected blinks (prosaccade: t = 1.30, p = 0.20; antisaccade: t = 0.21, p = 0.82). Only correct trials were used for the analyses.

Approximately 30% of trials were excluded from the analysis. At least 53% of trials were included for statistical analysis. At least 22 trials remained for each condition from each participant. Importantly, there was no significant difference between groups for the total trials excluded (t = 0.83, p = 0.40).

We evaluated relative pupil size using baseline correction (41, 54). The baseline pupil diameter value was determined by averaging pupil size from the first 150-350 ms after fixation onset, and for each trial, original pupil diameter values were subtracted from this baseline pupil diameter value. As video-based tracking systems can distort pupil size following variations in eye gaze (55), we examined pupil size prior to saccade initiation. Following previous work (41), pupil size was determined in three epochs prior to saccade initiation (i.e., when the gaze was located at the center of the screen): the start of the fixation point epoch (150-300 ms after fixation onset), the maximal pupil constriction, and the pre-saccade epoch (50 ms before peripheral stimulus onset) (Figure 1).

The change in pupil size prior to saccade initiation was defined as the averaged pupil size during the pre-saccade epoch minus the averaged pupil size across 50 ms at the time of greatest constriction during fixation.

2.5. Statistics

The distributions of demographic, cognitive, clinical, and pupil size data were tested for normality using the Shapiro–Wilk Test. Independent Samples t-tests (two-tailed) or Chi-squared tested for group differences in demographic variables between healthy subjects and individuals with schizophrenia. We performed a mixed ANOVA (2×2 ANOVA: between-subjects factor: individuals with schizophrenia/healthy subjects x within-subjects factor: (prosaccade/antisaccade)) for statistical analysis. We further included the results from the dependent and independent t-tests as a post-hoc analysis to specifically test our hypothesis that the modulation of pupil size (prosaccade x antisaccade) was impaired in the schizophrenia group, but intact in the healthy control group. First, within-group post-hoc comparisons between changes in pupil size for prosaccades and antisaccades were calculated using Paired samples t-tests (2-tailed). Second, between-groups post-hoc comparisons were calculated using Independent samples t-tests (2-tailed). Pearson or Spearman correlations were used to examine associations between the change in pupil size in prosaccades and antisaccades, cognition, clinical symptoms, performance, and medication in the schizophrenia and control group.

We used participants’ neuropsychological tests z-scores and the raw data of the clinical scales. Data were analyzed using IBM SPSS (28.0 version) with a statistical significance level set at p < 0.05.

3. Results

3.1. Participants

Participants’ characteristics are presented in Table 1. The two groups did not differ in any demographic characteristics.

3.2. Performance in prosaccade and antisaccade trials

Participants’ performance was evaluated using antisaccade reaction time (RT) and error rate. As expected, individuals with schizophrenia and healthy subjects had significantly longer RTs for antisaccade than for prosaccade trials (t = 5.74, p < 0.0001; t = 6.62, p < 0.0001 respectively). Given previous findings of longer RTs and higher direction errors in schizophrenia in the antisaccade task (56), antisaccade RTs and antisaccade error rates were compared between groups. We found a trend toward significance for individuals with schizophrenia to make more errors than controls (healthy subjects: mean = 0.30, SD = 0.20; individuals with schizophrenia: mean = 0.38, SD = 0.13; t = 1.78, p = 0.08). No significant differences between groups were observed for antisaccade RT (healthy subjects: mean = 240.3 ms, SD = 63.78 ms; individuals with schizophrenia: mean = 242.5 ms, SD = 57.70 ms; t = 0.12, p = 0.90). Interestingly, individuals with schizophrenia showed significantly longer prosaccade RT than healthy subjects (mean = 203.6 ms, SD = 41.46 ms; mean = 170 ms, SD = 36.05 ms, respectively; t = 3.01, p = 0.003).

3.3. Pupillary responses for correct prosaccade and antisaccade trials

Figure 1 shows relative pupil diameter corrected by the diameter at fixation onset (see methods), revealing two components of the pupil response: an initial constriction that began shortly after fixation point appearance followed by pupil dilation. The initial constriction is mainly driven by the changes in luminance level following the presentation of a luminant fixation point, while the dilation is related to task preparation (41).

Baseline pupil size was similar between schizophrenia and healthy subjects (prosaccade (t = 0.60; p = 0.55)), antisaccade trials (t = 0.50; p = 0.61). There was also no significant difference in pupil size at baseline between trial conditions in individuals with schizophrenia (t = 0.1.36; p = 0.18) and healthy subjects (t = 0.18; p = 0.85).

3.4. Pupil dilation in task preparation

Figure 2 outlines pupil dilation prior to saccade initiation in prosaccade and antisaccade trials in healthy subjects and individuals with schizophrenia. The effect of trial (prosaccade/antisaccade) and group on pupil dilation was assessed using a mixed model ANOVA. There was a significant main effect of trial condition (F (1, 49) = 9.90, p = 0.003, η (2)= 0.16), trial-by-group interaction (F (1, 49) = 8.16, p = 0.006, η (2)= 0.14) and a trend towards significance for group (F (1, 49) = 3.27, p = 0.07, η (2)= 0.06). Within-group post-hoc comparisons revealed larger pupil dilation in antisaccade preparation compared to prosaccade preparation in healthy subjects (prosaccade mean = 0.018 mm, SD = 0.019; antisaccade mean = 0.037 mm, SD = 0.031; t = 3.82, p < 0.0007; Hedges’s g = 0.68), but not in individuals with schizophrenia (prosaccade mean = 0.017 mm, SD = 0.018; antisaccade mean = 0.018 mm, SD = 0.015; t = 0.26, p = 0.26). Between-group post-hoc comparisons revealed reduced pupil dilation in individuals with schizophrenia compared to healthy subjects (t = 2.62, p = 0.01; Hedges’ g = 0.72). In contrast, pupil dilation during prosaccade preparation was similar between schizophrenia and healthy controls (t = 0.23, p = 0.81). Importantly, all statistics were maintained even when blinks were removed from the analysis (Supplementary material).

FIGURE 2
www.frontiersin.org

Figure 2. Change in pupil size in preparation for correct prosaccade and antisaccade in 23 individuals with schizophrenia and 28 healthy subjects. Pupil dilation in antisaccade preparation was reduced in individuals with schizophrenia compared to healthy subjects. Values are presented as mean and standard deviation.

Next, we examined if the pupil size increase during antisaccade preparation would be associated with cognition, symptoms, or medications. We found no significant associations between pupil dilation in antisaccade preparation and cognition (data not shown). In regards to symptomatology, lower pupil dilation was negatively correlated with PANSS total (r = −0.61; p = 0.01) score (Figure 3; Table 2) and, at a trend level, with PANSS general (r = −0,39, p = 0.06) and negative (r = −0.36, p = 0.08) scores (Table 2); this result indicates that, for individuals with schizophrenia, the higher the symptomatology scores, the lower the pupil size will increase in preparation for antisaccade trials.

FIGURE 3
www.frontiersin.org

Figure 3. Associations between change in pupil size in antisaccade preparation and PANSS total in 23 individuals with schizophrenia. Smaller pupil dilation in antisaccade preparation was associated with higher PANSS total scores. Inserts show r and p values of the Spearman correlation (2-tailed). PANSS, Positive and Negative Syndrome Scale.

TABLE 2
www.frontiersin.org

Table 2. Associations between change in pupil size in antisaccade preparation, cognition, clinical symptoms, performance, and medication in individuals with schizophrenia.

We also examined the relationship between pupil dilation and task performance across subjects, as indexed by error rate and RTs. We found a negative correlation between pupil dilation in antisaccade preparation and antisaccade error rate in individuals with schizophrenia (r = −0.55, p = 0.005), but not in healthy subjects (Table 2). No significant correlation between pupil dilation in the preparation of antisaccades and RT was found in both groups (Table 2).

We further asked whether changes in pupil size in the preparation of prosaccades would be associated with cognitive performance, symptom severity, and medication in individuals with schizophrenia. We did not observe any significant associations between pupil dilation in prosaccade preparation and cognitive performance, symptom severity, performance, and medication in individuals with schizophrenia. Furthermore, for both groups, we found no significant correlations between pupil dilation in prosaccade preparation and task performance measures (Supplementary Table S2).

4. Discussion

In this study, we investigated the relationship between changes in noradrenergic response, as measured by task-evoked pupil dilation, and cognition and symptomatology severity in individuals with schizophrenia. We found that preparatory pupil dilation in antisaccade trials was significantly reduced in schizophrenia outpatients as compared to healthy subjects, which was found to be associated with the severity of clinical symptoms (PANSS total score).

First, we Start date of the program for which the scholarship is requested (year/month)confirmed the hypothesis that individuals with schizophrenia have reduced task-evoked pupil dilation with increasing task demands compared to healthy subjects, which is consistent with the literature (32, 4244, 48). In our study, individuals with schizophrenia were not able to increase their noradrenergic response to correctly perform a task that requires higher cognitive effort (i.e., antisaccade task), as demonstrated by reduced pupil dilation in task preparation. Surprisingly, the allocation of cognitive effort in antisaccade trials was not associated with better cognitive performance in any of the MATRICS domains, as opposed to the literature. For example, studies using a cognitive effort-based decision-making task observed that in individuals with schizophrenia, greater pupillary change on the hard versus easy conditions was correlated with better cognitive ability. However, these two studies did not include a healthy comparison group and the schizophrenia group was composed of participants with moderate to serious negative symptoms, reducing the generalizability of the findings (49, 57).

Additionally, reduced task-evoked pupil dilation in antisaccade preparations was significantly associated with higher PANSS total and, at a trend level, with higher PANSS negative scores. As cognitive deficits, negative symptoms correlate strongly with functional outcomes and respond insufficiently to conventional treatments (58). Previous studies reported that higher negative symptoms were associated with smaller pupil dilation (48, 49). Individuals with schizophrenia, particularly those with more severe negative symptoms, are less willing to exert appropriate effort, suggesting that they may overestimate the cost of difficult actions, which leads to avolition. Consequently, it may reflect reduced pupil dilation in tasks that require greater cognitive effort (e.g., antisaccade task).

The LC projects to various cortical regions, including the prefrontal cortex (PFC). Disruptions in LC-NA projections to the PFC and other brain regions have been linked to cognitive abnormalities (2, 5961). In their study, Devilbiss et al. identified two distinct modes of LC activation: Phasic activation, driven by top-down attentional processing, and Tonic activation, associated with the maintenance of overall arousal and preparedness to respond to stimuli (62). Changes in pupil diameter serve as a reflection of LC activity and task-related cognitive demands, with increased pupil size indicating higher cognitive effort allocation and vice versa (26). Our study revealed that individuals with schizophrenia allocated significantly fewer cognitive resources during antisaccade trials, as evident from reduced pupil dilation, indicating insufficient effort allocation, which aligns with previous research (44, 49, 57). We propose that the observed reduction in pupil dilation among individuals with schizophrenia during the antisaccade task may be linked to dysregulated phasic LC activation.

What mechanisms might account for the relationship between dysregulated noradrenergic responses and schizophrenia symptom severity? Dysregulated noradrenergic pathways underlie schizophrenia symptoms, including both positive and negative manifestations (2). For instance, positive symptoms may result from hyper-vigilant states of consciousness, while negative symptoms could be linked to hypo-vigilant states (1). Positron emission tomography studies identified hyper-activation of the temporal cortex and limbic areas in positive symptomatology, along with hypo-activation of prefrontal areas in negative symptomatology (63, 64). Furthermore, chronic paranoid individuals exhibited elevated NA levels in the forebrain, particularly in the limbic region, as confirmed by postmortem investigations (21, 65, 66). These findings align with studies detecting increased NA and its metabolites in the CSF and plasma of individuals with schizophrenia, with a pronounced impact on paranoid subgroups (18, 41). Moreover, van Kammen et al. rigorously confirmed the link between noradrenergic activity and the exacerbation of both positive and negative schizophrenia symptoms through CSF measurements (67). In summary, these findings strongly support the close association between noradrenergic function and the manifestation of schizophrenia symptoms.

The present study includes some limitations. First, pupillary responses are an indirect measure of LC activity; and other neuromodulators (e.g., acetylcholine) along with NA may contribute to changes in pupil size (68). Second, all patients were using antipsychotic medications, which have anticholinergic properties that can influence pupil size (69, 70), although we did not observe any association between reduced pupil dilation and chlorpromazine and benztropine equivalents. Third, pupil dilation involves a circuitry of both top-down and bottom-up control, potentially implicating other brain regions associated with arousal and attention, such as the superior colliculus and frontal/prefrontal cortex (68, 71). For instance, microstimulation of the intermediate layer of the superior colliculus induces temporary pupil dilation in non-human primates (54). Nevertheless, the LC is considered pivotal for pupil dilation in response to cognitive effort, and dysregulation of the LC-NA system may contribute to schizophrenia symptom severity. Lastly, this study comprises a relatively small sample size. Future studies should investigate changes in pupillary responses in a population of unmedicated individuals and with a larger sample size. Moreover, studies focused on the role of each neuromodulatory circuit in the modulation of pupil size are still needed.

In conclusion, our findings suggest that the modulation of LC activity when cognitive demand increases is associated with overall symptom severity in individuals with schizophrenia. These findings shed further light on the mechanisms underlying schizophrenia pathophysiology. More importantly, the modulation of noradrenergic responses may provide a strategy to improve clinical symptoms in schizophrenia.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

The studies involving humans were approved by Brazilian National Committee of Ethics in Research (12990013.0.0000.5263) and pre-registered at ClinicalTrials.gov (1R03TW009002–01). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

AP and RP conceptualized the study. AP was responsible for manuscript writing and conducted all the statistical analyses. AP and AG were responsible for subsequent revisions. RP oversaw project development and provided data interpretation. AP, AG, WS, NE, and LS collected data and provided data interpretation. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by the National Institutes of Health – Fogarty International Center (Grant R03TW009002 to RP); Fundação de Amparo à Pesquisa do Estado do Rio de Janeiro (FAPERJ) (Grant E-26/110.305/2014 to RP) and Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) (Grant 400455/2012-9 to RP). RP is an Atlantic Fellow of the Global Brain Health Institute. AP, NE, WS, LS and AG, were supported by fellowships from FAPERJ and CNPq.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2023.1190329/full#supplementary-material

References

1. Yamamoto, K, and Hornykiewicz, O. Proposal for a noradrenaline hypothesis of schizophrenia. Prog Neuro-Psychopharmacol Biol Psychiatry. (2004) 28:913–22. doi: 10.1016/J.PNPBP.2004.05.033

CrossRef Full Text | Google Scholar

2. Mäki-Marttunen, V, Andreassen, OA, and Espeseth, T. The role of norepinephrine in the pathophysiology of schizophrenia. Neurosci Biobehav Rev. (2020) 118:298–314. doi: 10.1016/j.neubiorev.2020.07.038

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Howes, OD, and Shatalina, E. Integrating the neurodevelopmental and dopamine hypotheses of schizophrenia and the role of cortical excitation-inhibition balance. Biol Psychiatry. (2022) 92:501–13. doi: 10.1016/j.biopsych.2022.06.017

PubMed Abstract | CrossRef Full Text | Google Scholar

4. McCutcheon, RA, Keefe, RSE, and McGuire, PK. Cognitive impairment in schizophrenia: aetiology, pathophysiology, and treatment. Mol Psychiatry. (2023) 28:1902–18. doi: 10.1038/s41380-023-01949-9

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Bowie, CR, and Harvey, PD. Cognitive deficits and functional outcome in schizophrenia. Neuropsychiatr Dis Treat. (2006) 2:531–6. doi: 10.2147/nedt.2006.2.4.531

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Evensen, S, Wisløff, T, Lystad, JU, Bull, H, Ueland, T, and Falkum, E. Prevalence, employment rate, and cost of schizophrenia in a high-income welfare society: a population-based study using comprehensive health and welfare registers. Schizophr Bull. (2016) 42:476–83. doi: 10.1093/SCHBUL/SBV141

PubMed Abstract | CrossRef Full Text | Google Scholar

7. McGurk, SR, and Meltzer, HY. The role of cognition in vocational functioning in schizophrenia. Schizophr Res. (2000) 45:175–84. doi: 10.1016/S0920-9964(99)00198-X

CrossRef Full Text | Google Scholar

8. Guercio, GD, Thomas, ME, Cisneros-Franco, JM, Voss, P, Panizzutti, R, and de Villers-Sidani, E. Improving cognitive training for schizophrenia using neuroplasticity enhancers: lessons from decades of basic and clinical research. Schizophr Res. (2019) 207:80–92. doi: 10.1016/j.schres.2018.04.028

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Scoriels, L, Genaro, LT, Mororó, LGC, Keffer, S, Guimarães, ALDV, Ribeiro, PVS, et al. Auditory versus visual neuroscience-informed cognitive training in schizophrenia: effects on cognition, symptoms and quality of life. Schizophr Res. (2020) 222:319–26. doi: 10.1016/j.schres.2020.05.017

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Nuechterlein, KH, Subotnik, KL, Ventura, J, Green, MF, Gretchen-Doorly, D, and Asarnow, RF. The puzzle of schizophrenia: tracking the core role of cognitive deficits. Dev Psychopathol. (2012) 24:529–36. doi: 10.1017/S0954579412000132

CrossRef Full Text | Google Scholar

11. Mascio, A, Stewart, R, Botelle, R, Williams, M, Mirza, L, Patel, R, et al. Cognitive impairments in schizophrenia: a study in a large clinical sample using natural language processing. Front Digit Health. (2021) 3:711941. doi: 10.3389/fdgth.2021.711941

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Aston-Jones, G, and Cohen, JD. An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. Annu Rev Neurosci. (2005) 28:403–50. doi: 10.1146/annurev.neuro.28.061604.135709

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Berridge, CW, and Waterhouse, BD. The locus coeruleus-noradrenergic system: modulation of behavioral state and state-dependent cognitive processes. Brain Res Rev. (2003) 42:33–84. doi: 10.1016/S0165-0173(03)00143-7

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Borodovitsyna, O, Flamini, M, and Chandler, D. Noradrenergic modulation of cognition in health and disease. Neural Plast. (2017) 2017:1–14. doi: 10.1155/2017/6031478

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Grueschow, M, Kleim, B, and Ruff, CC. Role of the locus coeruleus arousal system in cognitive control. J Neuroendocrinol. (2020) 32:e12890. doi: 10.1111/jne.12890

PubMed Abstract | CrossRef Full Text | Google Scholar

16. James, T, Kula, B, Choi, S, Khan, SS, Bekar, LK, and Smith, NA. Locus coeruleus in memory formation and Alzheimer’s disease. Eur J Neurosci. (2021) 54:6948–59. doi: 10.1111/ejn.15045

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Sara, SJ. The locus coeruleus and noradrenergic modulation of cognition. Nat Rev Neurosci. (2009) 10:211–23. doi: 10.1038/nrn2573

CrossRef Full Text | Google Scholar

18. Kemali, D, Del Vecchio, M, and Maj, M. Increased noradrenaline levels in CSF and plasma of schizophrenic patients. Biol Psychiatry. (1982) 17:711–7.

PubMed Abstract | Google Scholar

19. Kemali, D, Maj, M, Galderisi, S, Ariano, MG, and Starace, F. Factors associated with increased noradrenaline levels in schizophrenic patients. Prog Neuro-Psychopharmacol Biol Psychiatry. (1990) 14:49–59. doi: 10.1016/0278-5846(90)90063-M

CrossRef Full Text | Google Scholar

20. Bird, ED, Spokes, EGS, and Iversen, LL. Dopamine and noradrenaline in post-mortem brain in Huntington’s disease and schizophrenic illness. Acta Psychiatr Scand. (1980) 61:63–73. doi: 10.1111/acps.1980.61.s280.63

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Farley, IJ, Price, KS, Mccullough, E, Deck, JHN, Hordynski, W, and Hornykiewicz, O. Norepinephrine in chronic paranoid schizophrenia: above-normal levels in limbic forebrain. Science. (1978) 200:456–8. doi: 10.1126/science.644310

CrossRef Full Text | Google Scholar

22. Howells, FM, Stein, DJ, and Russell, VA. Synergistic tonic and phasic activity of the locus coeruleus norepinephrine (LC-NE) arousal system is required for optimal attentional performance. Metab Brain Dis. (2012) 27:267–74. doi: 10.1007/s11011-012-9287-9

CrossRef Full Text | Google Scholar

23. Chamberlain, SR, and Robbins, TW. Noradrenergic modulation of cognition: therapeutic implications. J Psychopharmacol (Oxf). (2013) 27:694–718. doi: 10.1177/0269881113480988

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Scoriels, L, Barnett, JH, Soma, PK, Sahakian, BJ, and Jones, PB. Effects of modafinil on cognitive functions in first episode psychosis. Psychopharmacology. (2012) 220:249–58. doi: 10.1007/s00213-011-2472-4

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Adam, KCS, Mance, I, Fukuda, K, and Vogel, EK. The contribution of attentional lapses to individual differences in visual working memory capacity. J Cogn Neurosci. (2015) 27:1601–16. doi: 10.1162/jocn_a_00811

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Joshi, S, Li, Y, Kalwani, RM, and Gold, JI. Relationships between pupil diameter and neuronal activity in the locus Coeruleus, colliculi, and cingulate cortex. Neuron. (2016) 89:221–34. doi: 10.1016/j.neuron.2015.11.028

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Varazzani, C, San-Galli, A, Gilardeau, S, and Bouret, S. Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys. J Neurosci. (2015) 35:7866–77. doi: 10.1523/JNEUROSCI.0454-15.2015

CrossRef Full Text | Google Scholar

28. Goldinger, SD, and Papesh, MH. Pupil dilation reflects the creation and retrieval of memories. Curr Dir Psychol Sci. (2012) 21:90–5. doi: 10.1177/0963721412436811

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Hess, EH, and Polt, JM. Pupil size in relation to mental activity during simple problem-solving. Science. (1964) 143:1190–2. doi: 10.1126/science.143.3611.1190

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Alnæs, D, Sneve, MH, Espeseth, T, Endestad, T, van de Pavert, SHP, and Laeng, B. Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus. J Vis. (2014) 14:1. doi: 10.1167/14.4.1

CrossRef Full Text | Google Scholar

31. Beatty, J. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychol Bull. (1982) 91:276–92. doi: 10.1037/0033-2909.91.2.276

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Granholm, E, and Steinhauer, SR. Pupillometric measures of cognitive and emotional processes. In: international journal of psychophysiology. Int J Psychophysiol. (2004) 52:1–6. doi: 10.1016/j.ijpsycho.2003.12.001

CrossRef Full Text | Google Scholar

33. Beatty, J, and Kahneman, D. Pupillary changes in two memory tasks. Psychon Sci. (1966) 5:371–2. doi: 10.3758/BF03328444

CrossRef Full Text | Google Scholar

34. Bergt, A, Urai, AE, Donner, TH, and Schwabe, L. Reading memory formation from the eyes. Eur J Neurosci. (2018) 47:1525–33. doi: 10.1111/ejn.13984

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Klingner, J, Tversky, B, and Hanrahan, P. Effects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks. Psychophysiology. (2011) 48:323–32. doi: 10.1111/j.1469-8986.2010.01069.x

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Kucewicz, MT, Dolezal, J, Kremen, V, Berry, BM, Miller, LR, Magee, AL, et al. Pupil size reflects successful encoding and recall of memory in humans. Sci Rep. (2018) 8:4949. doi: 10.1038/s41598-018-23197-6

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Porter, G, Troscianko, T, and Gilchrist, ID. Effort during visual search and counting: insights from pupillometry. Q J Exp Psychol. (2007) 60:211–29. doi: 10.1080/17470210600673818

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Rondeel, EWM, Steenbergen, H, Holland, RW, and Van, KA. A closer look at cognitive control: differences in resource allocation during updating, inhibition and switching as revealed by pupillometry. Front Hum Neurosci. (2015) 9:9(September). doi: 10.3389/fnhum.2015.00494

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Minassian, A, Granholm, E, Verney, S, and Perry, W. Pupillary dilation to simple vs. complex tasks and its relationship to thought disturbance in schizophrenia patients. Int J Psychophysiol. (2004) 52:53–62. doi: 10.1016/j.ijpsycho.2003.12.008

CrossRef Full Text | Google Scholar

40. Van Der, WP, and Van, SH. Pupil dilation as an index of effort in cognitive control tasks: a review. Psychon Bull Rev. (2018) 25:2005–15. doi: 10.3758/s13423-018-1432-y

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Wang, CA, Brien, DC, and Munoz, DP. Pupil size reveals preparatory processes in the generation of pro-saccades and anti-saccades. Eur J Neurosci. (2015) 41:1102–10. doi: 10.1111/ejn.12883

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Fish, SC, and Granholm, E. Easier tasks can have higher processing loads: task difficulty and cognitive resource limitations in schizophrenia. J Abnorm Psychol. (2008) 117:355–63. doi: 10.1037/0021-843X.117.2.355

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Granholm, E, Ruiz, I, Gallegos-Rodriguez, Y, Holden, J, and Link, PC. Pupillary responses as a biomarker of diminished effort associated with defeatist attitudes and negative symptoms in schizophrenia. Biol Psychiatry. (2016) 80:581–8. doi: 10.1016/j.biopsych.2015.08.037

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Granholm, E, Verney, SP, Perivoliotis, D, and Miura, T. Effortful cognitive resource allocation and negative symptom severity in chronic schizophrenia. Schizophr Bull. (2007) 33:831–42. doi: 10.1093/schbul/sbl040

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Granholm, E, Fish, SC, and Verney, SP. Pupillometric measures of attentional allocation to target and mask processing on the backward masking task in schizophrenia. Psychophysiology. (2009) 46:510–20. doi: 10.1111/j.1469-8986.2009.00805.x

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Karpouzian-Rogers, T, Sweeney, JA, Rubin, LH, McDowell, J, Clementz, BA, Gershon, E, et al. Reduced task-evoked pupillary response in preparation for an executive cognitive control response among individuals across the psychosis spectrum. Schizophr Res. (2022) 248:79–88. doi: 10.1016/j.schres.2022.07.018

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Karatekin, C, Bingham, C, and White, T. Oculomotor and pupillometric indices of pro-and antisaccade performance in youth-onset psychosis and attention deficit/hyperactivity disorder. Schizophr Bull. (2010) 36:1167–86. doi: 10.1093/schbul/sbp035

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Thakkar, KN, Brascamp, JW, Ghermezi, L, Fifer, K, Schall, JD, and Park, S. Reduced pupil dilation during action preparation in schizophrenia. Int J Psychophysiol. (2018) 128:111–8. doi: 10.1016/j.ijpsycho.2018.03.012

PubMed Abstract | CrossRef Full Text | Google Scholar

49. McGovern, JE, Reddy, LF, Reavis, EA, and Green, MF. Pupillary change on a cognitive effort task in schizophrenia: associations with cognition and motivation. Int J Psychophysiol. (2020) 155:1–7. doi: 10.1016/j.ijpsycho.2020.05.003

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Andreasen, NC, Pressler, M, Nopoulos, P, Miller, D, and Ho, BC. Antipsychotic dose equivalents and dose-years: a standardized method for comparing exposure to different drugs. Biol Psychiatry. (2010) 67:255–62. doi: 10.1016/j.biopsych.2009.08.040

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Minzenberg, MJ, Poole, JH, Benton, C, and Vinogradov, S. Association of anticholinergic load with impairment of complex attention and memory in schizophrenia. Am J Psychiatry. (2004) 161:116–24. doi: 10.1176/appi.ajp.161.1.116

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Higuchi, CH, Ortiz, B, Berberian, AA, Noto, C, Cordeiro, Q, Belangero, SI, et al. Factor structure of the positive and negative syndrome scale (PANSS) in Brazil: convergent validation of the Brazilian version. Bras J Psychiatry 1999. (2014) 36:336–9. doi: 10.1590/1516-4446-2013-1330

CrossRef Full Text | Google Scholar

53. Munoz, DP, Broughton, JR, Goldring, JE, and Armstrong, IT. Age-related performance of human subjects on saccadic eye movement tasks. Exp Brain Res. (1998) 121:391–400. doi: 10.1007/s002210050473

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Wang, CA, Boehnke, SE, White, BJ, and Munoz, DP. Microstimulation of the monkey superior colliculus induces pupil dilation without evoking saccades. J Neurosci. (2012) 32:3629–36. doi: 10.1523/JNEUROSCI.5512-11.2012

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Ayala, N, and Heath, M. Pupillometry reveals the role of arousal in a Postexercise benefit to executive function. Brain Sci. (2021) 11:1048. doi: 10.3390/brainsci11081048

CrossRef Full Text | Google Scholar

56. Cutsuridis, V, Kumari, V, and Ettinger, U. Antisaccade performance in schizophrenia: a neural model of decision making in the superior colliculus. Front Neurosci. (2014) 8:13. doi: 10.3389/fnins.2014.00013

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Reddy, LF, Reavis, EA, Wynn, JK, and Green, MF. Pupillary responses to a cognitive effort task in schizophrenia. Schizophr Res. (2018) 199:53–7. doi: 10.1016/j.schres.2018.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Chan, RC, Wang, LL, and Lui, SS. Theories and models of negative symptoms in schizophrenia and clinical implications. Nat Rev Psychol. (2022) 1:454–67. doi: 10.1038/s44159-022-00065-9

CrossRef Full Text | Google Scholar

59. Arnsten, AFT, Wang, MJ, and Paspalas, CD. Neuromodulation of thought: flexibilities and vulnerabilities in prefrontal cortical network synapses. Neuron. (2012) 76:223–39. doi: 10.1016/j.neuron.2012.08.038

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Unsworth, N, and Robison, MK. A locus coeruleus-norepinephrine account of individual differences in working memory capacity and attention control. Psychon Bull Rev. (2017) 24:1282–311. doi: 10.3758/s13423-016-1220-5

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Jansma, JM, Ramsey, NF, van der Wee, NJA, and Kahn, RS. Working memory capacity in schizophrenia: a parametric fMRI study. Schizophr Res. (2004) 68:159–71. doi: 10.1016/S0920-9964(03)00127-0

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Devilbiss, DM, and Waterhouse, BD. Phasic and tonic patterns of locus coeruleus output differentially modulate sensory network function in the awake rat. J Neurophysiol. (2011) 105:69–87. doi: 10.1152/jn.00445.2010

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Silbersweig, DA, Stern, E, Frith, C, Cahill, C, Holmes, A, Grootoonk, S, et al. A functional neuroanatomy of hallucinations in schizophrenia. Nature. (1995) 378:176–9. doi: 10.1038/378176a0

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Andreasen, NC, Rezai, K, Alliger, R, Swayze, VW, Flaum, M, Kirchner, P, et al. Hypofrontality in neuroleptic-naive patients and in patients with chronic schizophrenia. Assessment with xenon 133 single-photon emission computed tomography and the tower of London. Arch Gen Psychiatry. (1992) 49:943–58. doi: 10.1001/archpsyc.1992.01820120031006

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Carlsson, A. Antipsychotic drugs, neurotransmitters, and schizophrenia. Am J Psychiatry. (1978) 135:164–73. doi: 10.1176/ajp.135.2.164

CrossRef Full Text | Google Scholar

66. Wyatt, RJ, Potkin, SG, Kleinman, JE, Weinberger, DR, Luchins, DJ, and Jeste, DV. The schizophrenia syndrome: examples of biological tools for subclassification. J Nerv Ment Dis. (1981) 169:100–12. doi: 10.1097/00005053-198102000-00005

CrossRef Full Text | Google Scholar

67. van Kammen, DP, Peters, J, Yao, J, van Kammen, W, Neylan, T, Shaw, D, et al. Norepinephrine in acute exacerbations of chronic schizophrenia. Negative symptoms revisited. Arch Gen Psychiatry. (1990) 47:161–8. doi: 10.1001/archpsyc.1990.01810140061009

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Larsen, RS, and Waters, J. Neuromodulatory correlates of pupil dilation. Front Neural Circuits. (2018) 12:1–9. doi: 10.3389/fncir.2018.00021

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Koller, D, Belmonte, C, Lubomirov, R, Saiz-Rodríguez, M, Zubiaur, P, Román, M, et al. Effects of aripiprazole on pupillometric parameters related to pharmacokinetics and pharmacogenetics after single oral administration to healthy subjects. J Psychopharmacol (Oxf). (2018) 32:1212–22. doi: 10.1177/0269881118798605

CrossRef Full Text | Google Scholar

70. Smolen, VF, Hr, M, Wp, S, Jw, C, Lw, C, and Ej, W. Pharmacological response data for comparative bioavailability studies of chlorpromazine Oral dosage forms in humans: I. Pupilometry. J Clin Pharmacol. (1975) 15:734–51. doi: 10.1002/j.1552-4604.1975.tb02338.x

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Peinkhofer, C, Knudsen, GM, Moretti, R, and Kondziella, D. Cortical modulation of pupillary function: systematic review. PeerJ. (2019) 7:e6882. doi: 10.7717/peerj.6882

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: schizophrenia, cognition, symptom severity, locus coeruleus, noradrenergic response, pupil dilation

Citation: Pelegrino A, Guimaraes AL, Sena W, Emele N, Scoriels L and Panizzutti R (2023) Dysregulated noradrenergic response is associated with symptom severity in individuals with schizophrenia. Front. Psychiatry. 14:1190329. doi: 10.3389/fpsyt.2023.1190329

Received: 20 March 2023; Accepted: 23 October 2023;
Published: 07 November 2023.

Edited by:

Vaibhav A. Diwadkar, Wayne State University, United States

Reviewed by:

Tatiana Karpouzian-Rogers, Northwestern University, United States
Katharine Thakkar, Michigan State University, United States

Copyright © 2023 Pelegrino, Guimaraes, Sena, Emele, Scoriels and Panizzutti. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Rogerio Panizzutti, rogerio.panizzutti@ipub.ufrj.br

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.