ORIGINAL RESEARCH article

Front. Psychiatry, 15 November 2021

Sec. Mood Disorders

Volume 12 - 2021 | https://doi.org/10.3389/fpsyt.2021.727992

Comparing the Self- and External Assessment Versions of the HCL-33 as Screening Instruments for Bipolar Disorder in Older Depressed Patients

  • 1. The National Clinical Research Center for Mental Disorders and Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital and the Advanced Innovation Center for Human Brain Protection, School of Mental Health, Capital Medical University, Beijing, China

  • 2. Shanghai Key Laboratory of Forensic Medicine, Key Laboratory of Forensic Science, Shanghai Forensic Service Platform, Academy of Forensic Science, Ministry of Justice, Shanghai, China

  • 3. Unit of Psychiatry, Department of Public Health and Medicinal Administration, Institute of Translational Medicine, Faculty of Health Sciences, University of Macau, Taipa, Macao SAR, China

  • 4. Centre for Cognitive and Brain Sciences, University of Macau, Macao, Macao SAR, China

  • 5. Institute of Advanced Studies in Humanities and Social Sciences, University of Macau, Taipa, Macao SAR, China

  • 6. College of Education for the Future, Beijing Normal University, Beijing, China

  • 7. School of Nursing, Hong Kong Polytechnic University, Hung Hom, Hong Kong SAR, China

  • 8. Division of Psychiatry, School of Medicine, University of Western Australia/Graylands Hospital, Perth, WA, Australia

  • 9. University of Notre Dame Australia, Fremantle, WA, Australia

  • 10. Department of Business Administration, Hong Kong Shue Yan University, North Point, Hong Kong SAR, China

  • 11. Zurich University Psychiatric Hospital, Zurich, Switzerland

Abstract

Objectives: The misdiagnosis of bipolar disorder (BD) as major depressive disorder (MDD) is common in depressed older adults. The self-rated HCL-33 and its external assessment version (HCL-33-EA) have been developed to screen for hypomanic symptoms. This study compared the screening ability of these two instruments to discriminate BD from MDD.

Methods: A total of 215 patients (107 with BD and 108 with MDD) and their carers were recruited. Patients and their carers completed the HCL-33 and HCL-33-EA, respectively. The consistency of the total score and the positive response to each item between the two scales was calculated with the intraclass correlation coefficient (ICC) and Cohen's kappa coefficient separately. Receiver operating characteristics (ROC) curves were drawn for both instruments. The optimal cut-off points were determined according to the maximum Youden's Index. The areas under the ROC curve (AUC) of the HCL-33 and HCL-33-EA were calculated separately and compared. The sensitivity and specificity at the optimal cut-off values were also calculated separately for the HCL-33 and HCL-33-EA.

Results: The intraclass correlation coefficient (ICC) between the total scores of the HCL-33 and HCL-33-EA was 0.823 (95% CI = 0.774–0.862). The positive response rate on all items showed high agreement between the two instruments. ROC curve analysis demonstrated that the total scores of both HCL-33 and HCL-33-EA differentiated well between MDD and BD, while there was no significant difference in the AUCs between the two scales (Z = 0.422, P = 0.673). The optimal cutoff values for the HCL-33 and HCL-33-EA were 14 and 12, respectively. With the optimal cutoff value, the sensitivities of the HCL-33 and HCL-33-EA were 88.8% and 93.5%, and their specificities were 82.4% and 79.6%.

Conclusion: Both the HCL-33 and HCL-33-EA had good screening ability for discriminating BD from MDD in depressed older adults.

Introduction

With the improvement of healthcare services in the past decades, many patients with bipolar disorder (BD) live on into older adulthood. The diagnosis of BD is associated with increased health service use and premature mortality in older adults (). The prevalence of BD in this population varied greatly between different studies, ranging from 0.1% in the community to 8–10% in psychiatric hospitals ().

Patients with BD are frequently misdiagnosed in clinical practice, in a range of 48% () to 69% of cases (). The misdiagnosis of BD is also common in older adults, although the rate seems to decrease with age (). Older BD patients, particularly those with BD-type II (BD-II) and BD-not otherwise specified (BD-NOS), were most often misdiagnosed as having major depressive disorder (MDD) (). The misdiagnosis of BD as MDD could be partly attributable to the unawareness and underreporting of hypomanic symptoms, since patients with BD tend to seek medical help during their depressive but rarely during their hypomanic episodes, when they often enjoy the elevated mood (). In addition, the course of BD often starts with a depressive episode and may even be followed by predominantly depressive episodes for a considerable period of time (). The time gap between the first depressive episode and the subsequent first manic/hypomanic episode is longer in older than in younger patients: for example, this gap was 17 years in BD patients aged 60 years and above, while the corresponding figure was only 3.5 years in those aged 40 and below (). The late appearance of a manic/hypomanic episode in older BD patients increases the likelihood of their BD being misdiagnosed as MDD. Late recognition of BD results in delayed, inadequate, and inappropriate treatment (, ).

Regular screening for hypomania facilitates the timely diagnosis of BD. In the past decades, both clinician-administered and self-rated screening instruments have been developed to screen for hypomania. Structured clinical interviews, such as the Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders, 5th Edition (SCID-5) () and the Composite International Diagnostic Interview (CIDI) (), represent the most reliable and valid approach for diagnosing BD, but they are time-consuming and need to be administered by skilled clinicians (, ). Several self-report measures have therefore been developed to screen for BD, including the 33-item Hypomania Checklist (HCL-33) (). The HCL-33, a modified version of the 32-item Hypomania Checklist (HCL-32) (), a widely-used self-report instrument to screen for hypomania, has been validated in depressed Chinese adults (). Recently, a parallel external-assessment version of the HCL-33 (HCL-33-EA) has been constructed for patients' carers, family members and friends (). Carers are familiar with patients' mood swings and daily lives. Moreover, cognitive, hearing, and visual problems, that are common in older patients, may hinder the use of self-report scales.

The clinical features of BD in older patients are different from those in their younger counterparts (), making it important to validate the HCL-33 and the HCL-33-EA in an older sample. Our study examined the screening ability of the HCL-33 and HCL-33-EA to differentiate BD from MDD and evaluated the consistency of the screening ability of the two instruments.

Methods

Participants

The study was conducted in the geriatric psychiatry department of Beijing Anding Hospital, a major tertiary psychiatric hospital in China, between July 2017 and November 2019. Patients attending the geriatric psychiatry department were consecutively invited to participate in the study if they were (1) aged 60 years old and above; (2) experiencing a depressive episode; (3) diagnosed with MDD or BD according to the 10th Revision of the International Statistical Classification of Diseases and Related Health Problems (ICD-10); (4) accompanied by at least one caregiver. The depressive episode and diagnoses of BD and MDD were initially established by the patients' treating psychiatrists and confirmed by a research psychiatrist using the Chinese version of the Mini International Neuropsychiatric Interview (MINI), Version 5.0, based on the Diagnostic and Statistical Manual of Mental Disorders, 4th Edition (DSM-IV) (, ). The exclusion criteria were comorbid psychiatric disorders and severe medical or neurological conditions. Carers of each patient were also invited to participate in the survey without any exclusion criteria. The study protocol was approved by the Clinical Research Ethics Committee of Beijing Anding Hospital. All participants provided written informed consent.

Instruments

The demographic characteristics of patients and carers and patients' clinical features were collected. The HCL-33, Chinese version, is a self-administered and validated questionnaire (). The HCL-33-EA is based on the original version of the HCL-33 and was administered to patients' carers (family members and close friends) to assess hypomanic symptoms. Both scales consist of 33 items with dichotomous responses of “yes/no,” comprehensively covering various aspects of hypomania. The total score on each scale is obtained by adding up all positive responses and ranges from 0 to 33, with a higher total score representing more severe hypomanic symptoms. In this study, all patients were asked to complete the HCL-33 and their carers the HCL-33-EA.

Statistical Analysis

All the analyses were performed using the Statistical Package for Social Sciences (SPSS), Version 20.0 and the Mecalc software. The normality of continuous variables was examined with the P–P plot. The paired sample t tests and Wilcoxon Signed Rank tests were used to compare the total scores of the HCL-33 and HCL-33-EA, as appropriate. The frequency of positive responses for items of the two scales was compared between BD and MDD patients using chi-square tests. The intraclass correlation coefficient (ICC) was employed to assess the consistency between the total scores of the two scales, while the Cohen's kappa coefficient was used to assess the consistency between the positive response to each item of the two scales with a Cohen's kappa coefficient value of “0–0.20” considered as slight, “0.21–0.40” as fair, “0.41–0.60” as moderate, “0.61–0.80” as substantial, and “0.81–1.00” as almost perfect agreement ().

A previous study () found a two-factor structure for the HCL-33, comprising “active/elated” (items 2–6, 8, 10–15, 17–19 and 21–27) and “substance use/indulging” (items 28, 29 and 30) factors. Principal components analysis (PCA) was used to examine the factor structure of the HCL-33-EA. As recommended previously (), items were allocated to a specific factor when their loading value was > 0.4.

The sensitivity and specificity at each possible cutoff value of the HCL-33 and HCL-33-EA for discriminating BD from MDD were calculated using the receiver operating-characteristics (ROC) curve analysis with the MINI diagnosis as the gold standard. The discriminating ability was examined with the area under the ROC curve (AUC) where the AUC of >0.6 indicated acceptable discrimination (). The optimal cut-off value was determined according to the Youden's Index, which was the maximum of summation of sensitivity and specificity at each cut-off value (). The pairwise comparison of the ROC curves of the HCL-33 and HCL-33-EA was conducted using the DeLong method (). The consistency between the HCL-33 and the HCL-33-EA was tested using Cohen's kappa with <0.40 signaling poor agreement, 0.40–0.75 fair to good agreement, and >0.75 excellent agreement (). Significance level was set at P < 0.05 (two-side) in all analyses.

Results

Demographic Characteristics of the Total Sample

In total, 232 patients were screened and invited to participate in our study; 17 (7.3%) refused or failed to complete the interview. Eventually, 215 patients were included, with 108 diagnosed with MDD and 107 with BD [71 with type I BD (BD-I) and 36 with BD-II]. The mean age of the patients was 67.3 [standard deviation (SD) = 5.5] years. All patient carers completed the assessment (n = 215); their mean age was 49.1 (SD = 14.4) years. Most patient carers were offspring (59.1%, n = 127), followed by spouses (34.9%, n = 75), siblings (2.8%, n = 6), and other relations (2.8%, n = 7). The mean length of cohabitation with the patients was 30.3 (SD = 10.2) years.

Total Scores of the HCL-33 and the HCL-33-EA

The mean total score on the HCL-33 was 12.6 (SD = 7.2) in the whole sample, and 7.5 (SD = 5.9), 17.7 (SD = 4.0), 18.2 (SD = 3.9), and 16.8 (SD = 4.0) in patients with MDD, BD, BD-I, and BD-II, respectively. The mean total score on the HCL-33-EA was 12.5 (SD = 7.3) in the whole sample, and 7.4 (SD = 5.7), 17.7 (SD = 4.6), 18.4 (SD = 4.1), and 16.3 (SD = 5.1) in patients with MDD, BD, BD-I, and BD-II, respectively. There were no significant differences between the total scores on HCL-33 and HCL-33-EA in the whole sample (P = 0.759), or in patients with MDD (P = 0.920), BD (P = 0.557), BD-I (P = 0.587), or BD-II (P = 0.724) (Table 1).

Table 1

Sub-groupSample size (n)HCL-33HCL-33-EAStatisticsa
MeanSDMeanSDZP
MDD1087.55.97.45.7−0.1010.920
BD10717.74.017.74.6−0.5870.557
BD-I7118.23.918.44.1−0.5430.587
BD-II3616.84.016.35.1−0.3530.724
Total sample21512.67.212.57.3−0.3070.759

Comparison between the total score of the HCL-33 and HCL-33-EA.

a

Wilcoxon Signed Rank tests.

BD, bipolar disorder; BD-I, type I bipolar disorder; BD-II, type II bipolar disorder; HCL-33, the 33-item Hypomania Checklist; HCL-33-EA, the 33-item Hypomania Checklist-external assessment; MDD, major depressive disorder; SD, standard deviation.

Positive Responses to the Individual Items of the HCL-33 and the HCL-33-EA

Positive responses to the HCL-33 items in patients with BD were significantly more frequent than in patients with MDD except for items 7, 16, and 28–32 (Figure 1A). The same was true for the HCL-33-EA except for items 6, 7, 16, 29, 30, and 32 (Figure 1B).

Figure 1

Consistency Between the HCL-33 and the HCL-33-EA

The ICC between the total scores of the HCL-33 and the HCL-33-EA was 0.823 [95% confidence interval (CI) = 0.774–0.862] in the whole sample and was 0.846 (95% CI = 0.766–0.900), 0.815 (95% CI = 0.747–0.866), and 0.672 (95% CI = 0.217–0.887) in patients cared for by their spouses, offspring, and others, respectively.

The percentages of the consistent screening results of the HCL-33 and HCL-33-EA items measured by the kappa coefficient were higher than 70%. The consistency of the positive response was substantial between the items 11, 17, and 18 of the two scales (κ = 0.61–0.80, P < 0.01), was fair (κ = 0.21–0.40, P < 0.01) between the items 7, 16, 31, 32, and 33, was slight (κ = 0.16, P < 0.01) between items 28, and was moderate (κ = 0.41–0.60, P < 0.01) between the remaining items (Table 2).

Table 2

ItemPercentage of agreement (%)Cohen's kappa
Item 1He/She needs less sleep79.070.55**
Item 2He/She is more energetic and more active82.790.54**
Item 3He/She is more self-confident78.600.47**
Item 4He/She enjoys his/her work more77.670.53**
Item 5He/She is more sociable (makes more phone calls, goes out more)76.740.54**
Item 6He/She wants to travel and/or does travel more75.810.46**
Item 7He/She tends to drive faster or take more risks when driving91.630.32**
Item 8He/She spends more money/too much money85.120.66**
Item 9He/She takes more risks in daily life (in his/her work and/or other activities)84.650.43**
Item 10He/She is physically more active (sport, etc.)79.070.55**
Item 11He/She plans more activities or projects85.120.70**
Item 12He/She has more ideas, is more creative74.420.47**
Item 13He/She is less shy or inhibited69.770.38**
Item 14He/She wears more colorful and more extravagant clothes/make-up77.210.49**
Item 15He/She wants to meet or actually does meet more people78.600.57**
Item 16He/She is more interested in sex and/or is more sexually active89.770.22**
Item 17He/She talks more83.720.65**
Item 18He/She thinks faster81.860.63**
Item 19He/She makes more jokes or puns when talking76.280.53**
Item 20He/She is more easily distracted74.420.43**
Item 21He/She engages in lots of new things74.880.46**
Item 22His/Her thoughts jump from topic to topic77.210.53**
Item 23He/She is more impatient and/or gets irritable more easily80.000.58**
Item 24He/She is more impatient and/or gets irritable more easily77.210.54**
Item 25He/She can be exhausting or irritating for others80.470.58**
Item 26He/She gets into more quarrels80.930.57**
Item 27His/Her mood is higher, more optimistic80.000.57**
Item 28He/She drinks more coffee92.090.16**
Item 29He/She smokes more cigarettes93.020.58**
Item 30He/She drinks more alcohol93.490.43**
Item 31He/She takes more drugs (sedatives, anxiolytics, stimulants…)90.700.24**
Item 32He/She games or gambles more93.950.29**
Item 33He/She eats more or binges more80.470.33**

Consistency between the rating results of each item of the HCL-33 and HCL-33-EA.

**

P < 0.01.

Factor Analysis of the HCL-33-EA

To explore the factor structure of HCL-33-EA, the Kaiser-Meyer-Olkin (KMO) Measure of Sampling Adequacy and the Bartlett's test of sphericity were performed (, ), giving a KMO of 0.869 and χ2 of 2,452.828 (P < 0.01), which indicates that the study sample was adequate and suitable for PCA. Nine factors with an eigenvalue greater than 1 emerged and cumulatively explained 60.4% of the total variance (Supplementary Figure 1). The first three factors had eigenvalues of 8.7, 2.1, and 1.9, respectively, and explained 38.2% of the total variance. Factor I consisted of 20 items (items 2–5, 8–15, 17–19, 21–24, and 27) and could be characterized as “active/elated”, Factor II consisted of 2 items (items 25 and 26) and could be characterized as “irritable”, and Factor III consisted of 6 items (items 7, 28-30, 32, and 33) and could be characterized as “substance use/indulging” (Table 3). Few items loaded on other factors with eigenvalues > 1, making them difficult to characterize. A three-factor structure was ultimately established.

Table 3

ItemsHCL-33-EA
Factor IFactor IIFactor III
Item 10.3880.2350.042
Item 20.713−0.212−0.072
Item 30.610−0.322−0.200
Item 40.579−0.287−0.137
Item 50.587−0.311−0.042
Item 60.261−0.3210.153
Item 70.1900.0950.415
Item 80.6010.2530.076
Item 90.4780.2180.193
Item 100.671−0.127−0.076
Item 110.712−0.144−0.021
Item 120.612−0.1300.108
Item 130.495−0.0420.222
Item 140.425−0.1620.213
Item 150.676−0.194−0.027
Item 160.2450.2780.164
Item 170.6980.001−0.191
Item 180.758−0.103−0.176
Item 190.450−0.2690.009
Item 200.3830.351−0.048
Item 210.543−0.0880.132
Item 220.5650.263−0.079
Item 230.682−0.059−0.106
Item 240.5290.473−0.206
Item 250.4650.614−0.230
Item 260.4410.475−0.339
Item 270.701−0.010−0.025
Item 280.2330.0390.427
Item 290.2700.2400.479
Item 300.0800.2700.512
Item 31−0.0520.0490.172
Item 320.156−0.1820.492
Item 330.3790.0970.402

Factor loadings of the HCL-33-EA.

Bolded values: factor loading >0.4.

ROC Curves Analyses for the HCL-33 and HCL-33-EA

ROC curve analysis demonstrated that the HCL-33 total score could differentiate well between MDD and BD, with the AUC of 0.91 (95% CI=0.87–0.95). The optimal cut-off point was 14, with a Youden index of 0.71, and the corresponding sensitivity and specificity figures were 88.8 and 82.4%, respectively (Figure 2A).

Figure 2

ROC curve analysis also demonstrated that the HCL-33-EA total score could differentiate well between MDD and BD, with the AUC of 0.90 (95% CI = 0.86–0.94). The optimal cutoff value was 12, with a Youden index of 0.73, and the corresponding sensitivity and specificity figures were 93.5 and 79.6%, respectively (Figure 2B). There was no significant difference between the AUC of the HCL-33 and the HCL-33-EA (Z = 0.422, P = 0.673).

Kappa Coefficients of the HCL-33 and HCL-33-EA

Using the optimal cutoffs of 14 for the HCL-33 and 12 for the HCL-33-EA in the sample, the consistency of the HCL-33 and the HCL-33-EA was fairly good (kappa coefficient = 0.737, P < 0.001).

Discussion

To the best of our knowledge, this is the first study to compare the screening consistency between the self-rated and external assessment versions of the HCL-33 in depressed older adults. The ICC between the HCL-33 and HCL-33-EA total scores was 0.823, which is similar to the finding in depressed younger adults (Spearman's r = 0.46) (). The consistency of the total scores on the two instruments was higher in patients cared for by their spouses (ICC = 0.846, 95% CI = 0.766–0.900), followed by those cared for by offspring (ICC = 0.815, 95% CI = 0.747–0.866), and others (ICC = 0.672, 95% CI = 0.217–0.887), probably because spouses were more familiar with the patients' mood swings than other carers.

The positive responses to all the 33 items showed sufficient agreement between the two HCL scales, with most of the items achieving moderate agreement (κ > 0.4). This is slightly different from the findings of a study conducted in adult patients (), which found insufficient agreement between the HCL-33 and HCL-33-EA in 6 of the 33 items. The present findings indicate high consistency between the items of the HCL-33 and HCL-33-EA in older depressed Chinese patients. In addition, the three-factor structure of the HCL-33-EA differed from the two-factor structure as reported previously for the HCL-33 (). More specifically, although the same 19 items (items 2–5, 8, 10–15, 17–19, 21–24, and 27) loaded on Factor I of both scales, items 25 and 26 loaded on Factor I of the HCL-33 but on Factor II of the HCL-33-EA. Moreover, three items (28–30) that loaded on Factor II of the HCL-33 loaded on Factor III of the HCL-33-EA together with three further items (7, 32 and 33). Inconsistencies were also found between previous studies on the HCL-32 and HCL-33, including two-factor (, , ), three-factor () and four-factor structures (, ). The discrepancy between studies could be partly due to different study characteristics (e.g., age, gender and severity of illness) and types of rater (e.g., patients for the HCL-33 vs. patients' carers for the HCL-33-EA).

The ROC curve analysis revealed that both the HCL-33 and HCL-33-EA total scores differentiated well between MDD and BD in older adults. The optimal cutoff value for the HCL-33 was 14 in this study, which is similar to the cutoff value of 15 found in Chinese adult patients (). The sensitivity and specificity at the optimal cutoff value in our study were higher than those reported in adult patients (sensitivity: 88.8 vs. 62%; specificity 82.4 vs. 74%) (). The optimal cutoff value for the HCL-33-EA total score was 12, with a higher sensitivity (93.5%) and a lower specificity (79.6%) than for the HCL-33, suggesting that carers could be more sensitive in recognizing hypomanic symptoms than the patients themselves. Since this was the first study examining the screening efficacy of the HCL-33-EA, direct comparisons with previous studies could not be made.

This study did not find any significant difference between the AUC of the two instruments (Z = 0.422, P = 0.673), which suggests that the HCL-33 and HCL-33-EA have similar ability to discriminate BD from MDD in depressed older patients. In addition, the kappa coefficients between the two instruments showed that the consistency was fairly good. A similar finding was reported in a Chinese adult sample, in which the total scores of HCL-33 and HCL-33-EA were significantly and positively correlated (). The two instruments could therefore be interchangeable in clinical practice to discriminate BD from MDD in older Chinese patients.

The study has several limitations that need to be acknowledged. First, the sample size was relatively small, which may have decreased the statistical power of the findings. Second, due to the single study site, the sample could not represent depressed older adults from other regions in China. Third, patients with comorbid psychiatric disorders, severe medical or neurological conditions were excluded from the study, which further limits the generalizability of the findings.

In conclusion, both the HCL-33 and the HCL-33-EA showed satisfactory psychometric properties in discriminating BD from MDD in depressed older adults, while the consistency of the discriminative ability of the two scales was also comparable.

Funding

This study was supported by the National Science and Technology Major Project for investigating new drugs (2018ZX09201-014), the Beijing Municipal Science and Technology Commission (No. Z181100001518005), and the University of Macau (MYRG2019-00066-FHS).

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Statements

Data availability statement

The datasets presented in this article are not readily available because the Clinical Research Ethics Committee of Beijing Anding Hospital that approved the study prohibits the authors from making publicly available the research dataset of clinical studies. Readers and all interested researchers may contact Y-TX (Email address: ) for details. Y-TX could apply to the Clinical Research Ethics Committee of Beijing Anding Hospital for the release of the data. Requests to access the datasets should be directed to .

Ethics statement

All participants provided written informed consent. The study protocol was reviewed and approved by the Clinical Research Ethics Committee of Beijing Anding Hospital.

Author contributions

Y-TX and GW: study design. XZ, WL, NZ, and YJ: data collection, analysis, and interpretation. XZ, WL, TC, GW, and Y-TX: drafting of the manuscript. GU, X-LC, and JA: critical revision of the manuscript. All authors contributed to the article and approved the submitted version.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2021.727992/full#supplementary-material

References

Summary

Keywords

bipolar disorder, HCL-33, older adults, major depressive disorder, psychometric property

Citation

Zhang X, Li W, Zhao N, Jin Y, Cheung T, Ungvari GS, Cui X-L, Wang G, Xiang Y-T and Angst J (2021) Comparing the Self- and External Assessment Versions of the HCL-33 as Screening Instruments for Bipolar Disorder in Older Depressed Patients. Front. Psychiatry 12:727992. doi: 10.3389/fpsyt.2021.727992

Received

01 July 2021

Accepted

08 October 2021

Published

15 November 2021

Volume

12 - 2021

Edited by

Marcin Siwek, Jagiellonian University Medical College, Poland

Reviewed by

Janusz K. Rybakowski, Poznan University of Medical Sciences, Poland; Mariusz Stanisław Wiglusz, Medical University of Gdansk, Poland

Updates

Copyright

*Correspondence: Yu-Tao Xiang Gang Wang

†These authors have contributed equally to this work

This article was submitted to Mood Disorders, a section of the journal Frontiers in Psychiatry

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics