ORIGINAL RESEARCH article

Front. Public Health, 22 June 2023

Sec. Public Mental Health

Volume 11 - 2023 | https://doi.org/10.3389/fpubh.2023.1071954

Stigmatizing attitudes toward mental illness among caregivers of patients with mental disorders in China

  • 1. National Clinical Research Center on Mental Disorders, Department of Psychiatry, The Second Xiangya Hospital, Central South University, Changsha, China

  • 2. Department of Psychiatry, Hunan Brain Hospital (Hunan Second People’s Hospital), Changsha, China

Article metrics

View details

11

Citations

9,1k

Views

1,5k

Downloads

Abstract

Objective:

This study aimed to investigate stigmatizing attitudes toward depression, schizophrenia, and general anxiety disorder (GAD) among caregivers of patients with mental disorders in China.

Methods:

A cross-sectional study was conducted among 607 caregivers in China, using vignettes that described three mental illnesses. Data on the caregivers’ attitudes and other people’s attitudes toward individuals with mental disorders and their willingness to come in contact with people with mental disorders were collected.

Results:

In the three vignettes, caregivers agreed that positive outcomes outnumbered negative outcomes. The top two statements endorsing the stigma were “the person could snap out of the problem” and “people with this problem are dangerous.” In the section for perceived stigma, caregivers in the GAD vignette agreed that most people believed this problem is not a real medical illness, compared to schizophrenia. The rates of the statement endorsing unpredictability were significantly different in the schizophrenia (57.2%) and depression (45.5%) vignette, in comparison to the GAD (45.6%) vignette. For personal stigma, the caregivers tended to avoid people described in the depression vignette more often than in the GAD vignette. The caregivers were most unwilling to let the person described in the vignettes marry into their family, especially in the schizophrenia vignette.

Conclusion:

Despite the stigma and desire for social distance associated with schizophrenia, depression, and GAD, caregivers often expect positive outcomes. Actions should be taken to improve caregivers’ knowledge about mental health and reduce the stigma.

1. Background

Stigma is defined as a deeply discrediting attribute under certain conditions directed towards those considered as having a lower social standing (1). According to Griffiths et al., stigma can be divided into two dimensions: personal stigma (the individual’s own attitudes toward the stigmatized group) and perceived stigma (the individual’s perception of other people’s attitudes toward the stigmatized group) (2). Stereotypes, prejudice, and discrimination also consist of three vital dimensions of stigma (3). Stereotypes refer to negative attitudes rooted in social life; accepted stereotypes could become prejudices and are frequently accompanied by negative emotional reactions (4). This inevitably leads to avoidance and social distancing, resulting in discrimination (3). Stigma always represents the consequences of a series of processes: people’s conceptualizations of the meaning of suffering from a mental illness, labeling people suffering from a mental illness as “different” with characteristics that are undesired by others and considering them as lacking in intelligence and competence (5). These lead to stigmatized people being devalued and discriminated against (5).

Stigmatizing attitudes toward mental disorders are widespread and evident across all cultures and societies. Individuals with different kinds of mental disorders reported experiencing discrimination (68), which is always linked to serious consequences such as a delay in seeking treatment and poor adherence to psychosocial (9, 10) and pharmacological (11, 12) treatment, which may further lead to a poor prognosis. Last but not least, stigma can reduce one’s sense of hope and self-esteem, which may lead to a series of undesirable consequences related to recovery, including social avoidance, depressive symptoms, a preference for using avoidant coping strategies (13), and poorer quality of life (5).

Mental illnesses are common around the world and constitute a burden on people and society. In China, the lifetime prevalence of mental disorders is 16.6% (14). This has created an enormous economic burden, including the high cost of treatment and return to society (15). Though mental illnesses have created a heavy burden on families, not every patient has received timely and effective treatment. A growing number of research in many countries has shown that stigma is a crucial treatment barrier that leads to a delay in seeking treatment (1620). Those who are afraid of being stigmatized because of their mental problems may not seek professional help in time (21), which may worsen their mental problems. A community-based study conducted in China confirmed that a huge proportion of the general population perceived that the public held strongly negative attitudes toward people with mental illness (22). These attitudes may lead to intense perceived stigma and further result in a delay in seeking treatment. Early intervention seems to ensure a more favorable prognosis for people with mental illness (23). Summarizing the above facts, stigma toward mental disorders may have serious effects on the disease itself, patients’ life, their family, and the whole of society. Such problems need urgent attention and action.

There is a scarcity of research on mental health-related stigma in the Chinese context. Several studies among different populations such as the general public, psychiatrists, non-mental health professionals, and caregivers of patients with mental disorders in China have shown poor mental health literacy (2428), which may be one of the reasons linked to mental health-related stigma. Surveys among the general public in China have found that many participants believed that most individuals reported personal and perceived stigma and had a strong desire to keep social distance from people with mental disorders (19, 22). Stigma related-studies conducted in China usually focused on schizophrenia and depression but neglected another common mental disorder—anxiety disorder. The high prevalence, chronicity, and burden of anxiety disorders (29), particularly generalized anxiety disorder (GAD), necessitates research into the anxiety-related stigma. Besides, before evaluating participants’ stigma level, most of these studies used only one word instead of a vignette describing the disease, which inevitably leads to certain deviations.

In China, previous studies explored the perceived stigma of caregivers who spend much time and effort taking care of the patients, but few studies investigated caregivers’ stigma of mental illness. The disease itself, the challenges of caring, as well as the cultural and social negative connotations tend to bring many difficulties to caregivers (30). Caregivers of people with mental illness play a key role in family resilience [the capability to adapt to adverse situations (31)], and the stigmatizing attitudes that they may have is one of the barriers to family resilience (32).

Given that caregivers’ stigmatizing attitudes occupy an important role not only in the treatment of patients but also in the prognosis, we conducted the present study to deepen our understanding of their stigma and social distance toward people with depression, schizophrenia, and GAD, and to further compare the stigma levels between these three mental disorders. We hypothesized that caregivers’ stigmatizing attitude (including social distance) toward schizophrenia would be the highest, and the stigmatizing attitude toward GAD would be the lowest.

2. Methods

2.1. Sample and design

This was a cross-sectional and vignette-based study that followed a cluster convenience sampling method. The survey was conducted from January to December 2014. The rates of correct identification of mental health among caregivers were taken into consideration for sample size calculation. We estimated the range of 15% for our sample size calculation, with a precision of 5%; we set a 5% marginal error and took into consideration a 10% non-response rate. Therefore, the calculated sample size is 215 for each vignette and 645 for three vignettes. We delivered 645 questionnaires, and 607 caregivers completed the questionnaires. The response rate was 94.1%.

All participants were recruited from the Department of Psychiatry in a general hospital located in Changsha, China, which is the capital city of the Hunan province. The data for this article was drawn from part of our previous research. Inclusion criteria were that participants had to be at least 18 years old and living with and taking care of people diagnosed with any mental disorders. If there was more than one caregiver of a patient, we chose the main one who volunteered to complete the questionnaire. We excluded those who were diagnosed with mental disorders themselves and those who refused to participate in the study.

Signed informed consent was obtained from each participant before completing the questionnaires. All participants completed the questionnaire independently, and it took them 20–30 min to complete. If the participants had difficulty reading the questionnaire due to poor sight or low literacy, investigators who were graduate students read the items verbally and recorded the response.

2.2. Survey questionnaires

In our study, the questionnaires and vignettes were adapted from the questionnaire developed by Jorm et al. (33). After providing the consent form, each participant was asked to provide demographic information including gender, age, marital status, education level, occupation, and relationship with the patients. Then, they were randomly assigned one of the three vignettes describing schizophrenia, depression, or GAD. The symptoms in each vignette were designed to meet the diagnostic criteria for schizophrenia, depression, or GAD in accordance with the Diagnostic and Statistical Manual of Mental Disorders (4th edition, DSM-4) and the International Statistical Classification of Diseases and Related Health Problems (10th revision, ICD-10).

Participants were asked to answer a series of mental health literacy-related questions after they were presented with the vignette, including the most likely diagnosis, likely effective and harmless interventions and medications, and likely causes and risk factors of the disease. The data associated with these questions was reported in our previous article (26). Following the questions mentioned above, participants’ attitudes toward the likely outcome of the person described in the vignette after receiving helpful interventions, participants’ stigmatizing attitudes, participants’ desire for social distance, and the ways that participants obtained information about mental health were also asked about. This paper mainly focuses on participants’ stigmatizing attitudes and desire for social distance toward individuals with mental disorders.

2.2.1. Personal and perceived stigma

Participants’ stigmatizing attitudes were assessed using an 18-item scale adapted from the Depression Stigma Scale which includes two subscales (34). One of the subscales asks about participants’ attitudes toward the person described in the vignettes, which reflects participants’ personal stigma. The other subscale asks participants’ beliefs about other people’s attitudes toward the person described in the vignettes, which reflects participants’ perceived stigma. The contents of both scales are similar; the difference is that one aims at personal attitudes and the other aims at the perceived attitudes of others. Each subscale includes nine items using a 5-point Likert scale, which ranges from four points (strongly agree) to zero points (strongly disagree). Higher points represent greater personal or perceived stigma. The two choices (“strongly agree” or “agree”) for each item are usually combined to represent the presence of stigma or perceived stigma (2). The versions used in our study have shown great reliability and validity in China (35). The internal consistency was corroborated by a Cronbach’s alpha of 0.785 for the schizophrenia vignette, 0.740 for the depression vignette, and 0.754 for the GAD vignette.

2.2.2. The desire for social distance

A 5-item scale developed by Link to evaluate the willingness to make contact with the person described in the vignette was used to access participants’ desire for social distance (36). Each item was rated on a 4-point scale ranging from “definitely willing” to “definitely unwilling.” The versions used in our study have shown great reliability and validity in China (35). The Cronbach’s alpha of this scale in this study was 0.886 for the schizophrenia vignette, 0.896 for the depression vignette, and 0.763 for the GAD vignette, which showed high reliability. Higher scores indicate a greater desire for social distance, otherwise known as less social acceptance.

2.3. Statistical analysis

All data were entered by double-entry strategy in EpiData version 3.1 (EpiData Association, Odense, Funen, Denmark). All data analyses were conducted in R 3.6.1 within R studio 1.2.5001 (37). Descriptive analyses using median (interquartile range) for skewed variables and frequency (percentage) for categorical variables were used for demographic data. Then, we computed the percentage and 95% confidence interval (CI) for each endorsed statement. Chi-square tests and Kruskal-Wallis tests were performed to investigate whether there were any demographic differences among the vignettes. The answers for “agree” and “strongly agree” of the stigma items, and “definitely unwilling” and “probably unwilling” categories of the social distance items were combined separately for further analyses. For social distance, we also calculated the mean and 95% CI of social distance scores to further understand the whole level. For each item in all scales, including mean scores of social distances, we used Pearson’s Chi-square test to investigate whether any significant difference exists among the three vignettes and calculated the odd rate (OR) and 95% CI.

3. Results

A total of 607 questionnaires were collected and included in the final sample, with 201 for the schizophrenia vignette, 202 for the depression vignette, and 204 for the GAD vignette, respectively. As shown in Table 1, of all caregivers, 56.3% were female, 88.1% were married, and the median age was 42 years old. No significant difference was observed among participants’ gender, age, educational level, and occupations in the three vignettes (p > 0.05). There were significant differences in marital status and relationship with the patients between the GAD and schizophrenia vignettes (p < 0.05).

Table 1

Caregivers’ characteristicsTotalGAD vignette (n = 204)Schizophrenia vignette (n = 201)Depression vignette (n = 202)p-value
n%n%n%n%
GenderMale26543.79848.08240.88542.10.291
Female34256.310652.011959.211757.9
Age (year)*42.033.0–48.041.033.0–48.041.536.0–48.040.531.3–48.00.695
Marital statusMarried53588.118188.717687.617888.10.034**
Single6410.62311.3188.92311.4
Other status81.30073.510.5
Education levelPrimary school education and below345.683.9136.4136.40.207
Junior high school education19732.46230.47537.36029.7
Senior high school education15725.94823.55326.45627.7
Bachelor’s degree19632.38039.25326.46331.2
Master’s degree and above233.863.073.5105.0
OccupationsWorkers8213.52813.72612.92813.90.362
Farmers18530.55426.57235.85929.2
Cadres6310.42210.82512.4167.9
Intellectuals6911.32311.3199.52713.4
Other occupations20834.37727.75929.47235.6
Relationship with the patientsFather10517.32713.23919.43919.30.047**
Mother16026.44421.66532.35125.2
Siblings7913.03115.22311.52512.4
Other relationship26343.410250.07436.88743.1

Demographic characteristics of the caregivers.

*Data descriptive with median (interquartile range). **p < 0.05, and post hoc multiple comparisons found a significant difference between the GAD and schizophrenia vignette (p < 0.05).

3.1. Beliefs about likely outcomes

We asked all caregivers to select a likely outcome for the person described in the vignette after receiving helpful interventions. As described in Table 2, the caregivers thought “being in a bad relationship” would be the most likely negative result for the person described in the three vignettes (46.8% for the schizophrenia vignette, 37.1% for the depression vignette, and 42.2% for the GAD vignette). The rate of caregivers who thought “a propensity for violence” was the most likely scenario was higher in the schizophrenia vignette than in the depression vignette (p = 0.005, OR:1.99, [1.22, 3.67]). Caregivers in all three vignettes endorsed the statement that “being better and understanding the feelings of others” would be the best positive result for the person described in the vignettes after receiving treatment (57.2% for the schizophrenia vignette, 67.8% for the depression vignette, and 62.3% for the GAD vignette). The endorsement rate between schizophrenia and depression vignettes was significantly different (p < 0.05, OR:1.99, [1.22, 3.67]). Caregivers’ endorsement rate of positive results was slightly higher than negative results in all vignettes. In the schizophrenia vignette, the rates of all items with negative results were the highest; the rates of items except for “being an artistic person” in the positive results were the lowest in the schizophrenia vignette.

Table 2

GAD vignette (n = 204)Schizophrenia vignette (n = 201)Depression vignette (n = 202)p-value
n%n%n%
Negative results
A propensity for violence4723.0 (17.6, 29.5)6230.8 (24.6, 37.8)3718.3 (13.4,24.5)0.012A
A propensity for alcoholism3115.2 (10.7, 21.0)3919.4 (14.3, 25.7)3718.3 (13.4,24.5)0.514
A propensity for using drugs2311.3 (7.4, 16.6)3215.9 (11.3, 21.9)2612.9 (8.7,18.5)0.378
Being in a bad relationship8642.2 (35.4, 49.3)9446.8 (39.6, 53.9)7537.1 (30.5,44.2)0.146
Suicidal tendency5828.4 (22.5, 35.2)7135.3 (28.8, 42.4)5828.7 (22.7,35.6)0.237
Positive results
Being better and understanding the feelings of others12762.3 (55.2, 68.9)11557.2 (50.1, 64.1)13767.8 (60.8,74.1)0.089B
Being in a happy marriage11556.4 (49.3, 63.2)9748.3 (41.2, 55.4)11757.9 (50.8,64.8)0.112
Being a caring father or mother11857.8 (50.7, 64.6)11054.7 (47.6, 61.7)12561.9 (54.8,68.5)0.900
Being an efficient employee8240.2 (33.5, 47.3)7738.3 (31.6, 45.4)9245.5 (38.6,52.7)0.310
Being a creative person6632.6 (26.1, 39.3)6733.3 (27.0, 40.4)8039.6 (32.9,46.7)0.253
Being an artistic person4924.0 (18.5, 30.6)5527.4 (21.4, 34.2)5929.2 (23.1,30.1)0.490

Percentage (and 95% CI) of the caregivers selecting each outcome as a most likely scenario toward the person in the vignette after receiving the helpful intervention.

A

Schizophrenia: depression, p = 0.005, OR: 1.99, [1.22, 3.67].

B

Schizophrenia: depression, p = 0.012, OR: 1.61, [1.22, 2.34].

3.2. Personal and perceived stigma

Table 3 revealed to us the percentage (and 95% CI) of caregivers who “agree” or “strongly agree” with statements about their personal stigma and perceived stigma toward the person described in the vignettes. In the GAD vignette, the highest three endorsements were for the statements “the person could snap out of the problem,” “people with this problem are dangerous,” and “this kind of problem is a sign of personal weakness” for personal and perceived stigma. For perceived stigma, the caregivers agreed that most other people believed “this kind of problem is not a real medical illness” compared to schizophrenia (GAD: schizophrenia, p < 0.05, OR:1.71, [1.06, and 2.79]). In the schizophrenia vignette, “people with this problem are dangerous,” “the person could snap out of the problem,” and “people with this problem are unpredictable” were the three statements with the highest endorsements. The rates of agreement with the statement “people with this problem are dangerous” were the highest for the schizophrenia vignette compared to the other two vignettes. For perceived stigma, the rates of the statement “people with this problem are unpredictable” were significantly different from the schizophrenia and depression vignette [(schizophrenia: depression, p < 0.05, OR:1.60, [1.06, 2.42]), GAD and schizophrenia vignette (GAD: schizophrenia, p < 0.05, OR: 0.63, [0.42, 0.96])]. The statements with the top three highest endorsements for the depression vignette for personal and perceived stigma were “the person could snap out of the problem,” “people with this problem are dangerous,” and “I would not vote for a politician with this problem.” For personal stigma, the caregivers were more likely to believe the statement “avoid people with this problem” in the depression vignette than in the GAD vignette (GAD: depression, p = 0.010, OR:0.47, [0.25, 0.87]).

Table 3

GAD vignette (n = 204)Schizophrenia vignette (n = 201)Depression vignette (n = 202)p value
Personal stigman%n%n%
1. The person could snap out of the problem15576.0 (69.4, 81.5)14371.1 (64.3, 77.2)16179.7 (73.4, 84.9)0.134
2. This kind of problem is a sign of personal weakness9446.1 (39.1, 53.2)8039.8 (33.0, 46.9)8240.6 (33.8, 47.7)0.378
3. This kind of problem is not a real medical illness4622.5 (17.1, 29.0)3215.9 (11.3, 21.9)3416.8 (12.1, 22.9)0.175
4. People with this problem are dangerous13164.2 (57.1, 70.7)15979.1 (72.6, 84.3)13968.8 (61.9, 75.0)0.003C
5. Avoid people with this problem209.8 (6.2, 14.9)3115.4 (10.8, 21.3)3818.8 (13.8, 25.0)0.035D
6. People with this problem are unpredictable8541.7 (34.9, 48.8)9848.7 (41.6, 55.9)9044.6 (37.6, 51.7)0.354
7. If I had this problem, I would not tell anyone4622.5 (17.1, 29.0)5024.8 (19.2, 31.5)3718.3 (13.3, 24.5)0.272
8. I would not employ someone with this problem7235.3 (28.8, 42.3)8944.3 (37.3, 51.4)7939.1 (32.4, 46.2)0.179
9. I would not vote for a politician with this problem9245.1 (38.2, 52.2)9145.3 (38.3, 52.4)9145.0 (38.1, 52.2)0.999
Perceived stigma
1. The person could snap out of the problem15777.0 (70.5, 82.4)14170.1 (63.2, 76.3)15978.7 (72.3, 84.0)0.092
2. This kind of problem is a sign of personal weakness8441.1 (34.4, 48.3)9748.3 (41.2, 55.4)8240.6 (33.8, 47.7)0.224
3. This kind of problem is not a real medical illness6129.9 (23.8, 36.8)4019.9 (14.7, 26.2)4823.8 (18.2, 30.4)0.062E
4. People with this problem are dangerous11857.8 (50.7, 64.6)14371.1 (64.3, 77.2)10652.5 (45.4, 59.5)0.000F
5. Avoid people with this problem4723.0 (17.6, 29.5)5225.9 (20.1, 32.6)3517.3 (12.5, 23.4)0.109
6. People with this problem are unpredictable9345.6 (38.7, 52.7)11557.2 (50.1, 64.1)9245.5 (38.6, 52.7)0.026G
7. If I had this problem, I would not tell anyone6129.9 (23.8, 36.8)4622.9 (17.4, 29.4)4522.3 (16.9, 28.8)0.143
8. I would not employ someone with this problem9144.6 (37.7, 51.7)7235.8 (29.3, 42.9)8542.1 (35.2, 49.2)0.181
9. I would not vote for a politician with this problem9848.0 (41.0, 55.1)9245.8 (38.8, 52.9)9748.0 (41.0, 55.1)0.872

Personal and perceived stigma of the caregivers.

C

Schizophrenia: depression, p = 0.025, OR: 1.71, [1.07, 2.77]. GAD: schizophrenia, p = 0.001, OR: 0.47, [0.29, 0.76].

D

GAD: depression, p = 0.010, OR: 0.47, [0.25, 0.87].

E

GAD: schizophrenia, p = 0.027, OR: 1.71, [1.06, 2.79].

F

GAD: schizophrenia, p = 0.007, OR: 0.56, [0.36, 0.86]. Schizophrenia: depression, p = 0.000, OR: 2.23, [1.45, 3.44].

G

Schizophrenia: depression, p = 0.024, OR: 1.60, [1.06, 2.42]. GAD: schizophrenia, p = 0.025, OR: 0.63, [0.42, 0.96].

3.3. Social distance

The caregivers’ endorsements of probably or definitely unwilling to have contact with the person (social distance) described in the vignette are shown in Table 4. Among all items, a majority of the caregivers were mostly unwilling to let the person described in the vignette marry into their families (>65%), especially in the schizophrenia vignette (77.1%). The desire for social distance was the least likely for the item “spending the evening socializing.” We also calculated the mean social distance scores of the three vignettes. The mean social distance score in the depression vignette was 10.84 (95%CI: [10.33, 11.34]). A desire for social distance was highest for the schizophrenia vignette (mean: 11.67, 95%CI: [11.15, 12.18]) and lowest for the GAD vignette (mean: 9.64, 95%CI: [9.25, 10.03]), and the difference between the three vignettes was not significant (p > 0.05).

Table 4

Social interactionsGAD vignette (n = 204)Schizophrenia vignette (n = 201)Depression vignette (n = 202)p-value
n%n%n%
1. Live next door6330.9 (24.7, 37.8)6934.3 (27.9, 41.4)6130.2 (24.1, 37.1)0.634
2. Spend the evening socializing4220.6 (15.4, 26.9)5527.4 (21.4, 34.2)4120.3 (15.2, 26.6)0.160
3. Make friends5125.0 (19.3, 31.6)6029.9 (23.7, 36.8)4723.3 (17.8, 29.8)0.296
4. Work closely8240.2 (33.5, 47.3)9044.8 (37.8, 51.9)7235.6 (29.1, 42.7)0.174
5. Marry into the family14269.6 (62.7, 75.7)15577.1 (70.6, 82.6)13365.8 (58.8, 72.3)0.040H

The desire for a social distance of the caregivers.

H

Schizophrenia: depression, p = 0.016, OR: 1.75, [1.10, 2.78].

3.4. The caregivers’ usual sources to get mental health knowledge

As a whole, the caregivers reported that the most common way to learn about mental health was through websites (44%), followed by other people’s explanations (37.4%). The least common way was through newspapers (14.8%). Detailed information can be found in Supplementary Table S1.

4. Discussion

This survey was conducted among caregivers of patients with mental illness in China to investigate their beliefs about likely outcomes, stigmatizing attitudes, and social distance toward individuals diagnosed with depression, schizophrenia, and GAD. Broadly speaking, the survey showed that the caregivers’ beliefs about positive outcomes were relatively high in all vignettes. Consistent with our hypothesis, individuals described in the schizophrenia vignette were thought to have more negative outcomes and less positive outcomes, and individuals described in the depression vignette were believed to have positive outcomes. For personal and perceived stigma, caregivers tended to agree or strongly agree with the statements, “the person could snap out of the problem” and “people with this problem are dangerous” in all vignettes. Beliefs about dangerousness and the description of unpredictability were highest in the schizophrenia vignette. GAD was the least to be thought of as a real medical illness compared to other disorders. The caregivers tended to avoid the person described as depressed. The desire for social distance was universally higher for schizophrenia than for other diseases. More people were reluctant to let a person with schizophrenia marry into their family than those with depression. The most common source of information caregivers used to obtain information on mental health was websites.

We found that agreements on positive results were higher than negative results in all vignettes. On account of their relatives’ mental illness, the caregivers may be more active to look into this kind of disease and tend to believe in a positive future. This was in accordance with the results of the stigma that, though the caregivers think the individual described in the vignette was dangerous, they still believe the individual could snap out of the problem. The caregivers of individuals with mental illness always experienced stigma themselves, which even led to the occurrence of psychological morbidity (38, 39). Hence, the positive future of the patients with mental illness may represent their hope for a bright future for themselves. As for GAD, the reason for positive outcomes may be that they did not regard GAD as a real medical disease, which can also be found in our published study (40). However, the latest epidemiological survey data in China found that the prevalence of anxiety disorder over the past 12 months and lifetime prevalence were higher than for depression and schizophrenia (14). These data point to the need to improve the public’s knowledge about GAD, given that anxiety disorder is a much more common mental disorder that severely affects an individual’s work and life. Our research found that participants thought patients with depression could better understand others’ feelings than patients with schizophrenia. This could be, in most people’s opinion, because patients with depression may experience more emotional pain, hence they are more sensitive to others’ feelings.

For the negative results, for personal and perceived stigma, the caregivers had displayed the same opinion that the dangerousness and the description of the unpredictability of schizophrenia were higher than the other two diseases. These stereotypes of patients with schizophrenia frequently led to fear and uncertainty (41), which were common negative attitudes held by the general public toward patients internationally (42). One possible interpretation was that the caregivers had witnessed or experienced the episode of the patient at the height of a psychotic episode. They are afraid of the same episode or a worse one. Another reason for the belief in dangerousness may stem from biased reports by the media. Media reports of violence committed by people with mental illnesses have been suggested as a potent contributor to aggravating public stigma (43), in which the portrayal is always stereotypical and prejudiced. Our study demonstrated that the most common source of mental health knowledge was through websites—a new style and common media in modern society. It revealed the significance of media in guiding the public correctly. To avoid increased public stigma and discrimination of people with mental illness, the standardization and confidentiality of correlative media reporting should be given more attention.

Current findings are also in accord with those of other studies that report a higher level of stigma toward schizophrenia than other mental illnesses (2, 20, 42, 4446), and the results indicated that the item “people with this problem are unpredictable” for perceived stigma was agreed or strongly agreed by more caregivers in the schizophrenia vignette than in others. Like the belief of the dangerousness of these patients, this could bring fear and uncertainty. As a result, this may lead to a high rate of unemployment. This study also verified a high proportion of unwillingness to employ people with mental illness. A study conducted in China shows that people with schizophrenia are either unemployed or work in agriculture or fishing (47). In these kinds of agrarian jobs, stigma may be mitigated by the more informal hiring practices based on kinship networks and fewer formal requirements for employment (48). For personal stigma, participants deemed that people should avoid patients with depression more than patients diagnosed with GAD. In most people’s opinion, patients with depression have more tendency to hurt themselves than patients with GAD. Research found that suicidal behaviors were very common in patients with depression in China (49). In China, most people would choose to avoid these patients to stay away from those patients, don’t get into trouble and be on peace.

In line with previous studies on stigmatizing attitudes, most questionnaire items assessing perceived stigma received a much higher endorsement than those assessing personal stigma except for beliefs in dangerousness. A more likely explanation is the consequence of social desirability. People tend to give socially desired answers to questions about controversial issues to maintain harmony (50, 51). Some people in China influenced by traditional Chinese culture, such as Confucianism and Taoism, are conservative about making self-statements, and they prefer to endorse the stigmatizing beliefs of others than to admit their own. Maintaining social harmony is believed to be so important that it may take precedence over expressing one’s opinions and values. People tend to accept public stigma toward mental illness, and the role of acceptance of fate and destiny promotes public stigma. Another reason for a higher perceived stigma may be that public stigma was likely to extend to family members (1). Caregivers of the patients may be thought to have a family history of the mental illness and may likewise have the possibility of having the mental illness.

Similar to personal and perceived stigma, the desire for social distance by caregivers was higher in the schizophrenia vignette than in the GAD and depression vignette, which may also be a reflection of participants’ belief in the dangerousness and unpredictability of schizophrenia. In line with previous research, people were most reluctant to allow patients with mental illness to marry into their families. Compared with other behaviors, marrying into the family was the most intimate one and may have a significant impact on their family members. Beliefs in the neurochemical and general biogenetic causation of mental illness may cause people to worry that the illness may be passed on to subsequent generations (52). Meta-analysis showed that these beliefs were associated with a desire for social distance from patients with schizophrenia; they are also associated with an increased belief in dangerousness for all mental disorders (53).

Exposure to people with mental illnesses has previously been found to be associated with lower personal stigma (54, 55) and higher perceived stigma (54) toward people with mental illnesses because diagnosis leads to a greater understanding of the disorders and less stigmatizing viewpoints about people with these disorders. However, our study found there was still a high level of stigma among caregivers of patients with mental illness. In a study in Hanoi, Vietnam, the authors believed that there was a higher level of stigma among the public than among people who had contact with patients with mental illness (56). Our study among non-mental health professionals also supported this inference (20), but a study in Hong Kong found that there was a comparable stigma among family members and community residents, and they attribute this to the non-significant difference in knowledge and contact quality (57). Meanwhile, caregivers could be harmed by stigma themselves (58). Stigma is one of the significant factors of distress among family caregivers of persons living with schizophrenia (59).

Therefore, given the high level of stigma and desire for social distance and the adverse impact brought by stigma, more interventions need to be done to decrease the stigma. There are some anti-stigma campaigns conducted in many countries to eradicate the public’s stigma toward patients with mental disorders, thus further improving patients’ treatment compliance and recovery prognosis (16, 60, 61). Programs that support people with mental illness to cope with stigma could improve suicide prevention (62). A systematic review has proven the positive effect of the anti-stigma intervention on stigma and social distance (63). Our study found that people often get mental health-related knowledge from websites and television, thus relevant anti-stigma campaigns should be carried out through these channels. More niche targeting suitable for the Chinese population and widespread projects are yet to be carried out. Lack of awareness and knowledge about mental illness is frequently identified as a cause of mental illness stigma (64).

5. Conclusion

In conclusion, the current findings suggest that in China, there is a high level of stigma and desire for social distance among caregivers of patients with mental illnesses like schizophrenia, depression, and GAD, especially in schizophrenia. Though the caregivers thought patients with these conditions were dangerous, their beliefs about the likely outcomes were positive. Perceived discrimination prevents individuals with mental illness from seeking help and accessing available resources. Our study provides valuable implications for further effective targeted interventions to reduce the stigma toward patients with mental illness. Actions should be taken by the government to provide publicity campaigns among caregivers to improve knowledge about mental health, awareness of how to seek help and treatment, and reduce the stigma to promote the development of social support.

6. Limitation

The result of the current study should be considered in light of the following limitations. Firstly, this study was limited by cross-sectional data collection, and we were not able to evaluate how the caregivers’ stigma influences the patients’ rehabilitation. A longitudinal study should be carried out to better understand the influence of stigma. Moreover, individuals who completed the study have subtle differences in marital status and relationship with the patients. This may have limited the representativeness of the sample and the generalizability of the study findings. Note that participants from this study were recruited from only one general hospital. The selected and small sample may not represent all caregivers of mental health patients in China. Future research needs to determine how these findings play out in other geographic areas of China, as well as internationally.

Funding

This study was supported by the Provincial Natural Science Foundation of Hunan (grant no. 2020JJ4795 to TL) and the Provincial Young Natural Science Foundation of Hunan (grant no. 2022JJ40677 to SC).

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Statements

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

Ethical approval was obtained from the Ethics Committee of the Second Xiangya Hospital, Central South University. All participants were informed of the purpose of the study and provided written informed consent for the study.

Author contributions

TL and SC were responsible for the study design, manuscript preparation, and revision. YH undertook the statistical analysis and wrote the first draft of the manuscript. QiuW and XuW were responsible for writing the protocol and revising manuscript drafts. YM, YW, PP, XiW, QY, YL, ML, LH, QiaW, and YZ were responsible for data collection. All authors contributed to the article and approved the submitted version.

Acknowledgments

We gratefully thank all those who have contributed to this article. Also, we would like to thank the caregivers of patients who volunteered their time to participate in the survey.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2023.1071954/full#supplementary-material

References

  • 1.

    GoffmanE.Stigma: Notes on the Management of Spoiled Identity. New Jersey: Prentice-Hall. (1963).

  • 2.

    GriffithsKMNakaneYChristensenHYoshiokaKNakaneH. Stigma in response to mental disorders: a comparison of Australia and Japan. BMC Psychiatry. (2006) 6:112. doi: 10.1186/1471-244X-6-21

  • 3.

    CorriganPW. On the stigma of mental illness: practical strategies for research and social change. Child Fam Behav Ther. (2015) 57:1048. doi: 10.1037/10887-000

  • 4.

    KaushikAKostakiEKyriakopoulosM. The stigma of mental illness in children and adolescents: a systematic review. Psychiatry Res. (2016) 243:46994. doi: 10.1016/j.psychres.2016.04.042

  • 5.

    LinkBGPhelanJC. Stigma and its public health implications. Lancet. (2006) 367:5289. doi: 10.1016/S0140-6736(06)68184-1

  • 6.

    LasalviaAZoppeiSvan BortelTBonettoCCristofaloDWahlbeckKet al. Global pattern of experienced and anticipated discrimination reported by people with major depressive disorder: a cross-sectional survey. Lancet. (2013) 381:5562. doi: 10.1016/S0140-6736(12)61379-8

  • 7.

    HarangozoJRenesesBBrohanESebesJCsuklyGLópez-IborJJet al. Stigma and discrimination against people with schizophrenia related to medical services. Int J Soc Psychiatry. (2013) 60:35966. doi: 10.1177/0020764013490263

  • 8.

    PiccoLPangSLauYWJeyagurunathanASatgharePAbdinEet al. Internalized stigma among psychiatric outpatients: associations with quality of life, functioning, hope and self-esteem. Psychiatry Res. (2016) 246:5006. doi: 10.1016/j.psychres.2016.10.041

  • 9.

    FungKMTsangHWChanF. Self-stigma, stages of change and psychosocial treatment adherence among Chinese people with schizophrenia: a path analysis. Soc Psychiatry Psychiatr Epidemiol. (2010) 45:5618. doi: 10.1007/s00127-009-0098-1

  • 10.

    FungKTsangHCorriganPW. Self-stigma of people with schizophrenia as predictor of their adherence to psychosocial treatment. Psychiatr Rehabil J. (2008) 32:95104. doi: 10.2975/32.2.2008.95.104

  • 11.

    AdewuyaAOOwoeyeOAErinfolamiARCokerAOOgunOCOkewoleAOet al. Prevalence and correlates of poor medication adherence amongst psychiatric outpatients in southwestern Nigeria. Gen Hosp Psychiatry. (2009) 31:16774. doi: 10.1016/j.genhosppsych.2008.12.005

  • 12.

    SireyJABruceMLAlexopoulosGSPerlickDAFriedmanSJMeyersBS. Perceived stigma and patient-related illness severity as predictors of adherence to antidepressant drug treatment. Psychiatr Serv. (2001) 52:161520. doi: 10.1176/appi.ps.52.12.1615

  • 13.

    YanosPTRoeDMarkusKLysakerPH. Pathways between internalized stigma and outcomes related to recovery in schizophrenia Spectrum disorders. Psychiatr Serv. (2008) 59:143742. doi: 10.1176/appi.ps.59.12.1437

  • 14.

    HuangYWangYWangHLiuZYuXYanJet al. Prevalence of mental disorders in China: a cross-sectional epidemiological study. Lancet Psychiatry. (2019) 6:21124. doi: 10.1016/S2215-0366(18)30511-X

  • 15.

    XuJWangJWimoAQiuC. The economic burden of mental disorders in China, 2005–2013: implications for health policy. BMC Psychiatry. (2016) 16:137. doi: 10.1186/s12888-016-0839-0

  • 16.

    AngermeyerMCSandraVCartaMGSchomerusG. Public attitudes towards psychiatry and psychiatric treatment at the beginning of the 21st century: a systematic review and meta-analysis of population surveys. World Psychiatry. (2017) 16:5061. doi: 10.1002/wps.20383

  • 17.

    BoeremaAMKleiboerABeekmanAvan ZoonenKDijkshoornHCuijpersP. Determinants of help-seeking behavior in depression: a cross-sectional study. BMC Psychiatry. (2016) 16:78. doi: 10.1186/s12888-016-0790-0

  • 18.

    ChenJAShaperoBGTrinhNChangTEYeungAS. Association between stigma and depression outcomes among Chinese immigrants in a primary care setting. J Clin Psychiatry. (2016) 77:e128792. doi: 10.4088/JCP.15m10225

  • 19.

    YangFYangBXStoneTEWangXQZhouYZhangJet al. Stigma towards depression in a community-based sample in China. Compr Psychiatry. (2020) 97:152152. doi: 10.1016/j.comppsych.2019.152152

  • 20.

    WuQLuoXChenSQiCYangWFZLiaoYet al. Stigmatizing attitudes towards mental disorders among non-mental health professionals in six general hospitals in Hunan Province. Front Psych. (2019) 10:946. doi: 10.3389/fpsyt.2019.00946

  • 21.

    CorriganP. How stigma interferes with mental health care. Am Psychol. (2004) 59:61425. doi: 10.1037/0003-066X.59.7.614

  • 22.

    LiuJYanFMaXGuoHLXuQY. Perceptions of public attitudes towards persons with mental illness in Beijing, China: results from a representative survey. Soc Psychiatry Psychiatr Epidemiol. (2016) 51:44353. doi: 10.1007/s00127-015-1125-z

  • 23.

    MurruACarpinielloB. Duration of untreated illness as a key to early intervention in schizophrenia: a review. Neurosci Lett. (2018) 669:5967. doi: 10.1016/j.neulet.2016.10.003

  • 24.

    HaoYWuQLuoXChenSQiCLongJet al. Mental health literacy of non-mental health nurses: a mental health survey in four general hospitals in Hunan Province, China. Front Psychiatry. (2020) 11:507969. doi: 10.3389/fpsyt.2020.507969

  • 25.

    LiuWGerdtzMFLiuTQ. A survey of psychiatrists' and registered nurses' levels of mental health literacy in a Chinese general hospital. Int Nurs Rev. (2011) 58:3619. doi: 10.1111/j.1466-7657.2011.00883.x

  • 26.

    ChenSWuQQiCDengHWangXHeHet al. Mental health literacy about schizophrenia and depression: a survey among Chinese caregivers of patients with mental disorder. BMC Psychiatry. (2017) 17:89. doi: 10.1186/s12888-017-1245-y

  • 27.

    HuangDYangLHPescosolidoBA. Understanding the public's profile of mental health literacy in China: a nationwide study. BMC Psychiatry. (2019) 19:20. doi: 10.1186/s12888-018-1980-8

  • 28.

    WuQLuoXChenSQiCLongJXiongYet al. Mental health literacy survey of non-mental health professionals in six general hospitals in Hunan Province of China. PLoS One. (2017) 12:e0180327. doi: 10.1371/journal.pone.0180327

  • 29.

    SagduyuK. Neuropsychopharmacology: the fifth generation of progress. Am J Psychiatr. (2002) 159:12512. doi: 10.1176/appi.ajp.159.7.1251-a

  • 30.

    Caqueo-UrízarARus-CalafellMUrzúaAEscuderoJGutiérrez-MaldonadoJ. The role of family therapy in the management of schizophrenia: challenges and solutions. Neuropsychiatr Dis Treat. (2015) 11:14551. doi: 10.2147/NDT.S51331

  • 31.

    RuttenBHammelsCGeschwindNMenne-LothmannCPishvaESchruersKet al. Resilience in mental health: linking psychological and neurobiological perspectives. Acta Psychiatr Scand. (2013) 128:320. doi: 10.1111/acps.12095

  • 32.

    FernandesJBFernandesSBAlmeidaASCunninghamRC. Barriers to family resilience in caregivers of people who have schizophrenia. J Nurs Scholarsh. (2021) 53:3939. doi: 10.1111/jnu.12651

  • 33.

    JormAFKortenAEJacombPAChristensenHRodgersBPollittP. "mental health literacy": a survey of the public's ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med J Aust. (1997) 166:1826. doi: 10.5694/j.1326-5377.1997.tb140071.x

  • 34.

    GriffithsKMChristensenHJormAFEvansKGrovesC. Effect of web-based depression literacy and cognitive-behavioural therapy interventions on stigmatising attitudes to depression: randomised controlled trial. Br J Psychiatry. (2004) 185:3429. doi: 10.1192/bjp.185.4.342

  • 35.

    ChenSMaYCaiWMorettaTWangXLiuTet al. Factorial validity of a substance-use stigma scale in methamphetamine-using adults in China. Drug Alcohol Depend. (2020) 206:107677. doi: 10.1016/j.drugalcdep.2019.107677

  • 36.

    LinkBGPhelanJCBresnahanMStueveAPescosolidoBA. Public conceptions of mental illness: labels, causes, dangerousness, and social distance. Am J Public Health. (1999) 89:132833. doi: 10.2105/ajph.89.9.1328

  • 37.

    R: The R Project for Statistical Computing. (2021). Available at:https://www.r-project.org/. (Accessed December 16, 2021).

  • 38.

    ZhangYSubramaniamMLeeSPAbdinESagayadevanVJeyagurunathanAet al. Affiliate stigma and its association with quality of life among caregivers of relatives with mental illness in Singapore. Psychiatry Res. (2018) 265:5561. doi: 10.1016/j.psychres.2018.04.044

  • 39.

    GroverSAvasthiASinghADanANeogiRKaurDet al. Stigma experienced by caregivers of patients with severe mental disorders: a nationwide multicentric study. Int J Soc Psychiatry. (2017) 63:40717. doi: 10.1177/0020764017709484

  • 40.

    ChenSWuQQiCDengHWangXHeHet al. Mental health literacy about depression and generalized anxiety disorder in caregivers of patients with mental disorder. Chin Ment Health J. (2018) 17:9235. doi: 10.1186/s12888-017-1245-y

  • 41.

    CorriganPW ed. On the Stigma of Mental Illness: Practical Strategies for Research and Social Change. Washington: American Psychological Association (2005).

  • 42.

    AngermeyerMCDietrichS. Public beliefs about and attitudes towards people with mental illness: a review of population studies. Acta Psychiatr Scand. (2006) 113:16379. doi: 10.1111/j.1600-0447.2005.00699.x

  • 43.

    LinkBGStuartH. “On revisiting some origins of the stigma concept as it applies to mental illnesses,” in The Stigma of Mental Illness - End of the Story? eds. GaebelW.RösslerW.SartoriusN. (Heidelberg: Springer) (2015).

  • 44.

    JormAFOhE. Desire for social distance from people with mental disorders. Aust N Z J Psychiatry. (2009) 43:183200. doi: 10.1080/00048670802653349

  • 45.

    ReavleyNJJormAF. Stigmatizing attitudes towards people with mental disorders: findings from an Australian National Survey of mental health literacy and stigma. Aust N Z J Psychiatry. (2011) 45:108693. doi: 10.3109/00048674.2011.621061

  • 46.

    ReavleyNJMackinnonAJMorganAJ. Stigmatising attitudes towards people with mental disorders: a comparison of Australian health professionals with the general community. Aust N Z J Psychiatry. (2014) 48:43341. doi: 10.1177/0004867413500351

  • 47.

    YangLHPhillipsMRLiXYuGZhangJShiQet al. Employment outcome for people with schizophrenia in rural v. urban China: population-based study. Br J Psychiatry J Ment Sci. (2013) 203:2729. doi: 10.1192/bjp.bp.112.118927

  • 48.

    RaoDAngellBLamCCorriganP. Stigma in the workplace: employer attitudes about people with HIV in Beijing, Hong Kong, and Chicago. Soc Sci Med. (2008) 67:15419. doi: 10.1016/j.socscimed.2008.07.024

  • 49.

    DongMWangS-BLiYXuDDUngvariGSNgCHet al. Prevalence of suicidal behaviors in patients with major depressive disorder in China: a comprehensive meta-analysis. J Affect Disord. (2018) 225:329. doi: 10.1016/j.jad.2017.07.043

  • 50.

    CalearALGriffithsKMChristensenH. Personal and perceived depression stigma in Australian adolescents: magnitude and predictors. J Affect Disord. (2011) 129:1048. doi: 10.1016/j.jad.2010.08.019

  • 51.

    PelusoRicaDePizaToledoBlaySL.Public stigma in relation to individuals with depression. J Affect Disord (2009); 115: 201206. doi: 10.1016/j.jad.2008.08.013

  • 52.

    ReavleyNJJormAF. Associations between beliefs about the causes of mental disorders and stigmatising attitudes: results of a national survey of the Australian public. Aust N Z J Psychiatry. (2014) 48:76471. doi: 10.1177/0004867414528054

  • 53.

    KvaaleEPGottdienerWHHaslamN. Biogenetic explanations and stigma: a meta-analytic review of associations among laypeople. Soc Sci Med. (2013) 96:95103. doi: 10.1016/j.socscimed.2013.07.017

  • 54.

    GriffithsKMChristensenHJormAF. Predictors of depression stigma. BMC Psychiatry. (2008) 8:112. doi: 10.1186/1471-244X-8-25

  • 55.

    LauberCNordtCFalcatoLRsslerW. Factors influencing social distance toward people with mental illness. Community Ment Health J. (2004) 40:26574. doi: 10.1023/b

  • 56.

    MartensenLKHahnEDucCTSchomerusGBögeKDettlingMet al. Impact and differences of illness course perception on the desire for social distance towards people with symptoms of depression or schizophrenia in Hanoi, Vietnam. Asian J Psychiatr. (2020) 50:101973. doi: 10.1016/j.ajp.2020.101973

  • 57.

    RanM-SPengM-MYauYYZhangTMLiXHWongIYLet al. Knowledge, contact and stigma of mental illness: comparing three stakeholder groups in Hong Kong. Int J Soc Psychiatry. (2022) 68:36575. doi: 10.1177/0020764021997479

  • 58.

    MdSCorriganPWReedSOhanJL. Vicarious stigma and self-stigma experienced by parents of children with mental health and/or neurodevelopmental disorders. Community Ment Health J. (2021) 57:153746. doi: 10.1007/s10597-021-00774-0

  • 59.

    GuanZWangYLamLCrossWWileyJAHuangCet al. Severity of illness and distress in caregivers of patients with schizophrenia: do internalized stigma and caregiving burden mediate the relationship?J Adv Nurs. (2021) 77:125870. doi: 10.1111/jan.14648

  • 60.

    ThornicroftCWyllieAThornicroftGMehtaN. Impact of the \"like minds, like mine\" anti-stigma and discrimination campaign in New Zealand on anticipated and experienced discrimination. Aust N Z J Psychiatry. (2014) 48:36070. doi: 10.1177/0004867413512687

  • 61.

    RuschNAbbruzzeseEHagedornEHartenhauerDKaufmannICurschellasJet al. Efficacy of coming out proud to reduce stigma's impact among people with mental illness: pilot randomised controlled trial. Br J Psychiatry J Ment Sci. (2014) 204:3917. doi: 10.1192/bjp.bp.113.135772

  • 62.

    OexleNWaldmannTStaigerTXuZ. Mental illness stigma and suicidality: the role of public and individual stigma. Epidemiol Psychiatr Sci. (2016) 27:16975. doi: 10.1017/S2045796016000949

  • 63.

    WaqasAMalikSFidaAAbbasNNaveedS. Interventions to reduce stigma related to mental illnesses in educational institutes: a systematic review. Psychiatry Q. (2020) 91:887903. doi: 10.1007/s11126-020-09751-4

  • 64.

    ShrivastavaAJohnstonMBureauY. Stigma of mental Illness-1: clinical reflections. Mens Sana Monogr. (2012) 10:7084. doi: 10.4103/0973-1229.90181

Summary

Keywords

stigma, caregivers, depression, schizophrenia, GAD

Citation

Hao Y, Wu Q, Wang X, Ma Y, Wang Y, Peng P, Wang X, Yang Q, Liu Y, Li M, He L, Wang Q, Zhou Y, Liu T and Chen S (2023) Stigmatizing attitudes toward mental illness among caregivers of patients with mental disorders in China. Front. Public Health 11:1071954. doi: 10.3389/fpubh.2023.1071954

Received

17 October 2022

Accepted

22 March 2023

Published

22 June 2023

Volume

11 - 2023

Edited by

Ana I. Guillén, Complutense University of Madrid, Spain

Reviewed by

Raheleh Bahrami, Kurdistan University of Medical Sciences, Iran; Anitha Jeyagurunathan, Institute of Mental Health, Singapore

Updates

Copyright

*Correspondence: Tieqiao Liu, Shubao Chen,

†These authors have contributed equally to this work and share last authorship

This article was submitted to Public Mental Health, a section of the journal Frontiers in Public Health

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics