Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 12 August 2021
Sec. Health Psychology
This article is part of the Research Topic COVID-19: Risk Communication and Blame View all 23 articles

Mental Health of Nursing Students amid Coronavirus Disease 2019 Pandemic

  • 1School of Nursing, Henan Technical Institute, Zhengzhou, China
  • 2Department of Cardiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China

The coronavirus disease 2019 (COVID-19) pandemic is a global disaster, and recent studies have shown its association with increasing mental health problems such as post-traumatic stress disorder (PTSD), depression, anxiety, and stress. Nursing students, especially nursing interns, may be shunned, harassed, and even blamed as potential COVID-19 spreaders, though they were an important reserve force against COVID-19 and other diseases. Of note, the psychological influences of COVID-19 on nursing students remained unclear. The aim of this study was to evaluate the mental health of nursing students during the COVID-19 pandemic. A cross-sectional online survey was conducted on nursing students in a vocational college from April 12 to 23, 2020. The Impact of Event Scale–Revised, 21-item Depression, Anxiety and Stress Scale, and Pittsburgh Sleep Quality Index were used to assess the degree of symptoms of PTSD, depression, anxiety, stress, and insomnia, respectively. Multivariable logistic regression analysis was performed to determine the potential risk factors for the psychological symptoms. A total of 1,780 college nursing students were asked to participate in this online survey, with 1,532 complete responses. In total, 682 (44.5%) college nursing students reported having PTSD, 358 (22.8%) students reported insomnia, and few students reported depression (n = 45, 2.9%), anxiety (n = 44, 2.9%), and stress (n = 17, 1.1%) symptoms. As compared with junior, female, and rural nursing students, the senior, male, and urban nursing students had higher rates of PTSD, depression, anxiety, stress, respectively, whereas male nursing students had a higher insomnia rate. Multivariable analysis showed that senior nursing students had higher risks of PTSD, depression, anxiety; being male was associated with higher risks of PTSD, depression, anxiety, stress, and insomnia; and urban nursing students had higher risks of PTSD, depression, anxiety, and stress. In summary, a considerable number of nursing students reported mental symptoms of PTSD and insomnia, though few reported mental symptoms of depression, anxiety, and stress. Furthermore, senior, male, and urban nursing students are at risk for developing mental symptoms. Appropriate psychological interventions should be implemented to assure the mental health of nursing students.

Introduction

The coronavirus disease 2019 (COVID-19) was first identified in Wuhan, China on December 8, 2019, and it has rapidly spread all over the world (Pan et al., 2020). This pandemic has been a global disaster, greatly influencing social lives, economics, mental conditions, and health security, and it seemed that there was no end to this disaster (Firth et al., 2020; Pfefferbaum and North, 2020). As of June 4, 2021 (the moment of writing), WHO reported 171,782,908 confirmed cases of COVID-19 globally, with 3,698,621 deaths (World Health Organization, 2021).

To limit the spread of this outbreak, a series of important and effective public-health measures were implemented in China and in many other countries, such as mass vaccination, lockdowns, maintaining social distancing, wearing masks, hand hygiene, population surveillance, abundant COVID-19 tests, rigorous contacts tracing, mandatory quarantine for confirmed or suspected cases with COVID-19 infection and their close contacts, and the building of makeshift hospitals (Budd et al., 2020; Firth et al., 2020; Pan et al., 2020; Ruktanonchai et al., 2020). Despite the initiation of these public-health measures, cases continued to rise. Many infected patients had returned to China from other countries, and imported infections as well as asymptomatic cases were the main challenges in China (Chen et al., 2020). In order to curb the spread of COVID-19, Chinese students had experienced prolonged school suspensions and subsequent online education at home.

During the initial stage of the COVID-19 epidemic, the results of a survey conducted among the general population in China had shown that more than half of the respondents (53.8%) rated the psychological impact of the COVID-19 epidemic as moderate to severe (Wang X. et al., 2020). With the increasing mental health burden amid the COVID-19 pandemic, it became crucial and necessary to enhance mental health assessments and support so as to maintain public mental health, and the Chinese National Health Commission has issued guidelines for emergency psychological crisis intervention and established psychological assistance hotlines (Lai et al., 2020; Wang Y. et al., 2020). Many mental healthcare workers have been bravely and voluntarily involved in providing frontline or online psychological care (e.g., WeChat, TikTok, Weibo, and hotlines) to patients with COVID-19 as well as to the general population (Wang Y. et al., 2020). These mental health services might improve the mental resilience and reduce the incidence of psychological diseases. However, several people have not requested for mental health assistance due to the fear of discrimination and stigmatization, despite having severe psychological symptoms (Lyndon et al., 2019; Javed et al., 2021).

Healthcare workers, including nurses, played very important roles in fighting the COVID-19 pandemic and have made invaluable contributions. Many nurses were brave and heroic, working at the frontlines to treat patients with COVID-19 pneumonia despite the very high risk of infection (Hartmann et al., 2020; Hughes et al., 2020). Recent studies have shown that healthcare workers such as frontline nurses, especially women, experienced a large psychological burden which manifested as symptoms of post-traumatic stress disorder (PTSD), depression, anxiety, and insomnia (Lai et al., 2020).

Some studies had shown that the psychological consequences of the COVID-19 epidemic on college students could be serious. Chinese college students suffered from symptoms of PTSD, stress, anxiety, and depression in the early stage of the COVID-19 pandemic (Li H. Y. et al., 2020; Tang et al., 2020; Zhang et al., 2020). In addition, medical students may suffer from more stress than non-medical students following the COVID-19 outbreak (Ye et al., 2020).

Nursing students are a new and important reserve force against COVID-19 and other diseases. In China, nursing students in general are required to receive 3–5 years of a college education. They also need to undergo clinical training as interns in the hospital during their previous year. Later, some nursing students continue further studies, whereas most nursing students begin working as formal clinical nurses after graduation.

At the early beginning of the COVID-19 epidemic, though WHO was informed of a cluster of pneumonia of unknown cause in Wuhan city on December 31, 2019 (World Health Organization, 2020), much remained unknown except for patients with COVID-19 were infected by direct exposure at the seafood market (The Lancet, 2020b), and Chinese nursing students were still learning at schools or hospitals during this period. On January 20, 2020, the eminent SARS specialist Zhong Nanshan announced that 14 medical workers had been infected by one virus carrier and confirmed that COVID-19 could spread from human to human (Nature, 2020). Also on January 20, the Chinese president and government announced the COVID-19 outbreak and it should be resolutely contained (Nature, 2020). At this time, most junior nursing students had been back home to celebrate Chinese New Year, but nursing seniors (interns) still remained in their clinical training in the hospital. Massive actions including all sectors from business to factories and to schools were taken the next day to curb the COVID-19 epidemic (Chen and Yu, 2020). As of January 23, 2020, a total of 835 confirmed cases (549 from Hubei Province and 286 in 32 provinces, municipalities, and special administrative regions in China) were detected; in order to contain the COVID-19 spread, Wuhan City was locked down, and soon followed by many other areas in China (The Lancet, 2020b; Wang et al., 2020a,b). Of note, as cases increased, medical workers were recognized as a high-risk group to acquire the COVID-19 infection. As of February 11, 2020, a total of 72,314 COVID-19 cases were reported in mainland China, with 3,019 medical workers (1,716 were confirmed) (Epidemiology Working Group for NCIP Epidemic Response Chinese Center for Disease Control Prevention, 2020). Since senior nursing students needed to work as interns in the hospital before Spring Festival, they were considered as medical workers by the general population. The public, including friends and relatives, had a fear of getting COVID-19 infection, so as to the medical workers such as nurses even nursing students were shunned, harassed, and even blamed as potential COVID-19 spreaders by some people (Bagcchi, 2020; Koh, 2020; Abdulah et al., 2021). Besides, the nursing students who worked in the hospital were also anxious about the chance of getting the COVID-19 infection and passing the infection to their families (The Lancet, 2020a). Nursing students experienced extreme psychological stress and a range of feelings such as excitement, doubt, and helplessness after the COVID-19 outbreak (Huang et al., 2020).

To date, it is still unclear whether the COVID-19 pandemic and the subsequent quarantine and online education could give rise to mental health symptoms among college nursing students. According to the official website, from April 12 to 23, 2020, there were 1,273 COVID-19-confirmed patients in the Henan Province (with no new increases), and confirmed cases in China increased from 83,597 to 84,303 (moving into mitigation stage), whereas confirmed cases all over the world rapidly increased from 1,713,517 to 2,548,755 (World Health Organization, 2021). During this period, we conducted a survey that focused on the mental health (including symptoms of PTSD, depression, anxiety, stress, and insomnia) among nursing students studying in Henan Technical Institute, a comprehensive vocational college with a 3-year nursing college education with almost 2,200 nursing students located in Zhengzhou, Henan Province, China, in order to provide evidence for the formation of specific and effective mental health interventions for nursing students.

Materials and Methods

Study Design and Participants

A cross-sectional online survey regarding the mental health of college nursing students was conducted from April 12 to 23, 2020 according to the principles of the Declaration of Helsinki. Most nursing students (n = 1,780) in Henan Technical Institute were asked to voluntarily participate in this study by their teachers via QQ groups (a widely used instant messaging and social platform, Tencent Inc., Shenzhen, China), and all the participants were informed that they had the right to terminate their participation in the study anytime they desired. All these students received online education at home in order to avoid infection with COVID-19, hence the survey was completed via an online platform (SurveyStar, a professional online survey, examination, and voting platform, Changsha Ranxing Information Technology Co., LTD, Shanghai, China), especially WeChat/Weixin (a widely used communication and social platform in China, Tencent Inc., Shenzhen, China), using a cellphone or computer. The questions of this survey could be revisited and answered using the same WeChat account, but they could not be corrected or answered again once these were submitted. Students who responded were divided into two groups according to their year level: 1,135 were junior nursing students (grades 1 and 2) and 397 were senior nursing interns (grade 3).

Participation in this study was anonymous and the personal information of participants was kept confidential. This study protocol was approved by the Ethics Committee of Henan Technical Institute.

Measurements

The mental health conditions of nursing students amid the COVID-19 pandemic were evaluated through an online structured questionnaire. The 22-item Impact of Event Scale–Revised (IES-R) (Christianson and Marren, 2012), 21-item Depression, Anxiety, and Stress Scale (DASS-21) (Lovibond and Lovibond, 1995; Henry and Crawford, 2005), and Pittsburgh Sleep Quality Index (PSQI) (Buysse et al., 1989) were used to assess the symptoms of PTSD, depression, anxiety, stress, and insomnia among college nursing students, respectively. IES-R included intrusion (items of IES-R 1, 2, 3, 6, 9, 14, 16, 20), avoidance (items 5, 7, 8, 11, 12, 13, 17, 22), and hyperarousal (items 4, 10, 15, 18, 19, 21) subscales, with five choices including not at all (score 0), a little bit (score 1), moderately (score 2), quite a bit (score 3), and extremely (score 4). The severity of PTSD symptoms was evaluated by the sum of the intrusion and avoidance subscales (Christianson and Marren, 2012). The DASS-21 included depression (items of DASS 3, 5, 10, 13, 16, 17, 21), anxiety (items 2, 4, 7, 9, 15, 19, 20), and stress (items 6, 8, 11, 12, 14, 18) subscales, with four responses including do not apply to me at all (score 0), apply to me to some degree or some of the time (score 1), apply to me a considerable degree or a good part of the time (score 2), and apply to me very much or most of the time (score 3). The final score of each subscale was equal to the sum of its items and then multiplied by two, as the DASS-21 was a short form version of the 42-item DASS (Lovibond and Lovibond, 1995; Henry and Crawford, 2005). The PSQI evaluated seven components of sleep quality, sleep latency, sleep duration, sleep efficiency, sleep disturbance, use of sleeping medication, and daytime dysfunction. The score ranged from 0 to 3 for each component, and the PSQI score was equal to the sum of the seven component scores (Buysse et al., 1989). The detailed questions and scoring methods are shown in Supplementary Material. The scales above have been shown to have excellent reliability and validity in previous studies (Yohannes et al., 2019; Chew et al., 2020; Lai et al., 2020; Xiao et al., 2020).

The scores of the above scales were graded as follows: scores on the IES-R (sum of intrusion and avoidance subscale scores) were classified as normal (0–8), mild (9–25), moderate (26–43), and severe (44–64) PTSD (Christianson and Marren, 2012; Lai et al., 2020). For the DASS-21 depression subscales, participants were classified as being normal (0–9) or having mild (10–13), moderate (14–20), severe (21–27), or extremely severe (28–42) depression. For the DASS-21 anxiety subscale, classifications included normal (0–7), mild (8–9), moderate (10–14), severe (15–19), and extremely severe (20–42) anxiety. For the DASS-21 stress subscale, classifications included normal (0–14), mild (15–18), moderate (19–25), severe (26–33), and extremely severe (34–42) stress (Lovibond and Lovibond, 1995; Henry and Crawford, 2005; Yohannes et al., 2019; Chew et al., 2020). Finally, the PSQI included categories such as normal (0–5), mild (6–10), moderate (11–15), and severe (16–21) insomnia (Buysse et al., 1989; Xiao et al., 2020).

In addition, the educational and living conditions of nursing students during the COVID-19 pandemic were also inquired about in this survey. There were three questions related to their education: (1) attitude toward online education, with four responses including very satisfactory, satisfactory, average, or unsatisfactory; (2) mental states during online learning, with three responses including better, as usual, or worse; and (3) attitude toward going back to school, with two responses including expected and not expected. There were five questions related to their living conditions: (1) family economic income (higher, as usual, or lower); (2) body weight (increased, unchanged, or decreased); (3) quality of life (good, average, or bad); (4) attention to COVID-19 (always, usually, sometimes, or almost never); and (5) attitude toward being a frontline nurse (sure, maybe, maybe not, or impossible).

Covariates

Demographic data such as gender (male or female), educational status (junior or senior), and place of residence (urban or rural) were collected in the survey. The COVID-19 status of the nursing students and their families was also investigated.

Statistical Methods

All statistical tests were performed using SPSS software (version 22.0, SPSS, IBM Corporation, Armonk, New York). Scores of measurement scales had a skewed distribution, and these were presented as medians and interquartile ranges (IQR). A non-parametric Mann–Whitney U-test was used to compare the differences between the two groups. Categorical variables, such as the severity classifications of PTSD, depression, anxiety, stress, and insomnia symptoms, were presented as numbers and percentages, and group differences were assessed using the Mann–Whitney U-test of ranked data.

Multivariable logistic regression analysis was applied to evaluate the influences of educational status, gender, and location on PTSD, depression, anxiety, stress, and insomnia symptoms, and their associations were demonstrated as OR with a 95% CI.

A P < 0.05 was considered significant, and all tests were two-tailed.

Results

Demographic Characteristics

In this study, a total of 1,780 college nursing students were asked to fulfill the online survey (the count included QQ groups of teachers who asked their students and sent the link to the survey), and we received 1,532 complete responses, with a response rate of 86.1%. Among these 1,532 nursing students, the average age was 19.95 (SD, 1.24) years, 397 (25.9%) were senior interns, 1,135 (74.1%) were juniors, 666 (43.5%) came from an urban area, 866 (56.5%) came from a rural area, and 1,400 (91.4%) lived in the Henan Province. The majority of respondents were females (n = 1,351, 88.2%), with 181 (11.8%) males. There were no confirmed or suspected COVID-19 infected cases in this research according to self-reports and official data from the school.

The Educational and Living Conditions Influenced by COVID-19

Table 1 presents the educational and living conditions of respondents. As for educational condition, many college nursing students were satisfied with their current online education (satisfactory, n = 1,036, 67.6%; very satisfactory, n = 234, 15.3%). However, only 164 (10.7%) respondents reported having better mental states during online learning, whereas many students (n = 883, 57.6%) reported worsening mental states and 1,359 (88.7%) students expected to go back to school. As for their living condition, 1,261 (82.3%) suffered a loss in their family income, 265 (17.3%) reported the same economic income as usual, and only 6 (0.4%) reported a higher economic income. Surprisingly, only 52 (3.4%) students thought they had a poor quality of life. Furthermore, 675 (44.1%) students had gained weight. Of the 1,532 respondents, 696 (45.4%) reported that they usually paid attention to the COVID-19 pandemic, and 633 (41.3%) reported always paying close attention to COVID-19. Finally, an overwhelming majority of students had a positive attitude (n = 1,504, 98.2%) toward becoming frontline nurses against COVID-19 in the future.

TABLE 1
www.frontiersin.org

Table 1. Educational and living conditions of all and subgroup participants.

On comparing junior and senior nursing students, senior nursing students (interns) reported having better mental states during the online learning period (worse, 51.9 vs. 59.6%, P < 0.01) but worse family economic incomes (lower, 86.6 vs. 80.8%, P < 0.01). They also paid more attention to COVID-19 (always and usually, 90.4 vs. 85.5%, P < 0.01) and were more willing to become frontline nurses against COVID-19 (sure, 73.8 vs. 66.1%, P < 0.01). When compared with female nursing students, male nursing students also reported paying more attention to COVID-19 (always and usually, 89.5 vs. 86.3%, P < 0.01) and being more willing toward becoming frontline nurses against COVID-19 (sure, 78.5 vs. 66.7%, P < 0.01). However, they reported worse mental states during the online learning period (worse, 65.2 vs. 56.6%, P < 0.05). There were no significant differences in changes in family economic income according to sex. With respect to the rate of nursing students who expected to go back to school, this was higher among males than females (95 vs. 87.9%, P < 0.01), but there was no significant difference between senior and junior nursing students. There were no significant differences between junior and senior nursing students in terms of their degree of satisfaction with online education, changes in body weight, and quality of life.

With regard to rural and urban nursing students, urban nursing students reported better family economic incomes (lower, 79.1 vs. 84.8%, P < 0.01) and they paid more attention to COVID-19 (always and usually, 88.6 vs. 85.3%, P < 0.05) as compared with rural nursing students; however, there were no significant differences in all other educational and living indexes.

Mental Health Outcomes

As shown in Table 2, the median (IQR) score of IES-R for PTSD was 7 (3–14), the median (IQR) scores of DASS-21 for depression, anxiety, and stress were 0 (0–2), 0 (0–2), and 1 (0–3), respectively, and the median (IQR) score of PSQI for insomnia was 3 (2–5). As shown in Table 3 and Figure 1, a considerable number of college nursing students (n = 682, 44.5%) reported having symptoms of PTSD, few students reported symptoms of depression (n = 45, 2.9%), anxiety, (n = 44, 2.9%), and stress (n = 17, 1.1%), whereas the number of students with insomnia (n = 358, 22.8%) was also considerable. Among these students, only a few experienced symptoms of severe PTSD (n = 5, 0.3%), depression (n = 2, 0.1%), anxiety (n = 3, 0.2%), stress (n = 1, 0.1%), and insomnia (n = 2, 0.1%).

TABLE 2
www.frontiersin.org

Table 2. Scores of PTSD, depression, anxiety, stress, and insomnia.

TABLE 3
www.frontiersin.org

Table 3. Severity Classifications of PTSD, depression, anxiety, stress, and insomnia symptoms.

FIGURE 1
www.frontiersin.org

Figure 1. Severity classifications of post-traumatic stress disorder, depression, anxiety, stress, and insomnia in nursing students.

Moreover, the results of subgroup analysis indicated that as compared with juniors and female nursing students, senior interns and male nursing students reported higher scores of PTSD [senior 9 (3–15) vs. junior 7 (3–14), P < 0.01; male 11 (3–16) vs. female 7 (3–14), P < 0.01], depression [senior 1 (0–4) vs. junior 0 (0–2), P < 0.01; male 1 (0–5) vs. female 0 (0–2), P < 0.01], anxiety [senior 0 (0–3) vs. junior 0 (0–1), P < 0.05; male 0 (0–3) vs. female 0 (0–2), P < 0.01], and stress [senior 1 (0–5) vs. junior 0 (0–3), P < 0.01; male 1 (0–5) vs. female 0 (0–3), P < 0.01]. As compared with rural nursing students, urban nursing students also reported higher scores of PTSD [8 (3–15) vs. 7 (3–13), P < 0.05], anxiety [0 (0–2) vs. 0 (0–1), P < 0.05], stress [1 (0–4) vs. 0 (0–3), P < 0.05], and depression [0 (0–3) vs. rural 0 (0–2), P = 0.072]. Accordingly, as compared with junior, female, and rural nursing students, these senior, male, and urban nursing students had higher incidences of symptoms of PTSD (senior 50.9% vs. junior 42.3%, P < 0.01; male 54.7% vs. female 43.2%, P < 0.01; urban 48.9% vs. rural 41.1%, P < 0.01), depression (senior 5.5% vs. junior 2.0%, P < 0.01; male 6.1% vs. female 2.5%, P < 0.01; urban 4.2% vs. rural 2.0%, P < 0.05), anxiety (senior 5.5% vs. junior 1.9%, P < 0.01; male 6.6% vs. female 2.4%, P < 0.01; urban 4.1% vs. rural 2.0%, P < 0.05), and stress (senior 2.0% vs. junior 0.8%, P < 0.05; male 2.8% vs. female 0.9%, P < 0.05; urban 1.8% vs. rural 0.6%, P < 0.05). Furthermore, male nursing students had higher PSQI scores [3 (2–6) vs. 3 (2–5), P < 0.05] and rates of insomnia (31.5 vs. 23.3%, P < 0.05) when compared with female nursing students. The detailed mental health outcomes are also shown in Tables 2, 3.

Risk Factors for Mental Health of Nursing Students

The results of multivariable logistic regression analysis are presented in Table 4. As compared with junior nursing students, senior nursing students (interns) had a higher risk of PTSD (OR = 1.406; 95% CI, 1.116–1.771; P = 0.004), depression (OR = 2.790; 95% CI, 1.529–5.093; P = 0.001), and anxiety (OR = 2.950; 95% CI, 1.604–5.425; P < 0.001). As compared with female nursing students, male nursing students had higher risks of PTSD (OR = 1.631; 95% CI, 1.192–2.233; P = 0.002), depression (OR = 2.676; 95% CI, 1.318–5.431; P = 0.006), anxiety (OR = 3.144; 95% CI, 1.572–6.286; P = 0.001), stress (OR = 3.352; 95% CI, 1.158–9.702; P = 0.026), and insomnia (OR = 1.478; 95% CI, 1.048–2.084; P = 0.026). As compared with rural nursing students, urban nursing students had higher risks of PTSD (OR = 1.362; 95% CI, 1.110–1.672; P = 0.003), depression (OR = 2.091; 95% CI, 1.129–3.874; P = 0.019), anxiety (OR = 2.010; 95% CI, 1.079–3.743; P = 0.028), and stress (OR = 3.031; 95% CI, 1.057–8.693; P = 0.039).

TABLE 4
www.frontiersin.org

Table 4. Logistic regression analysis for PTSD, depression, anxiety, stress, and insomnia risk factors.

Discussion

In this study, we conducted a survey to evaluate the mental health condition of college nursing students amid the COVID-19 pandemic. Measurement scales including IES-R, DASS-21, and PSQI were used to assess the symptoms of PTSD, depression, anxiety and stress, and insomnia, respectively. We found that among the college nursing students, 44.5% presented with symptoms of PTSD, 2.9% with depression, 2.9% with anxiety, 1.1% with stress, and 22.8% presented with symptoms of insomnia. Fortunately, few nursing students experienced severe symptoms of PTSD (0.3%), depression (0.1%), anxiety (0.2%), stress (0.1%), and insomnia (0.1%). Additionally, as compared with junior, female, and rural nursing students, senior (interns), male, and urban nursing students had higher occurrence rates of PTSD, depression, anxiety, and stress, and male nursing students had a higher rate of insomnia. Surprisingly, the results showed that an overwhelming majority of students had a positive attitude (98.2%) about becoming frontline nurses against COVID-19 despite the high risk of contagion.

At present, there is still no definitive treatment for COVID-19, we do not know how long this will last, and the future remains unpredictable. The psychological impact of the COVID-19 pandemic is extensive and profound, as it has led to psychological symptoms such as fear, irritability, uncertainty, PTSD, depression, anxiety, stress, and insomnia among people all over the world. Lockdowns, economic losses, and the lack of masks and alcohol-based disinfectants further aggravated feelings of social isolation, loneliness, and the above negative psychological symptoms and even gave rise to delirium, self-harm, and suicide (Ettman et al., 2020; Twenge and Joiner, 2020). A large-scale online survey showed that the rates of mental health symptoms among the general Chinese population from February 28 to March 11, 2020 showed that 27.9% had symptoms of depression, 31.6% had symptoms of anxiety, 29.2% had symptoms of insomnia, and 24.4% experienced acute stress (Shi et al., 2020). Another large web-based survey conducted in the United States from June 24 to 30, 2020 indicated that 26.3, 24.3, and 25.5% of the adult respondents presented with symptoms of PTSD, depression, and anxiety, respectively, and 10.7% respondents (8.9% females and 12.6% males) had seriously considered suicide in the previous 30 days (Czeisler et al., 2020).

Previous studies have indicated that healthcare workers had high levels of stress, depression, and anxiety. Furthermore, healthcare workers, especially nurses who were directly exposed to COVID-19 due to circumstances such as serving in isolation wards or emergency departments had higher levels of adverse psychiatric outcomes (Azoulay et al., 2020; Lai et al., 2020; Si et al., 2020). For instance, a survey regarding the mental health of healthcare workers in China revealed that the rates of PTSD, depression, anxiety, and insomnia were 71.5, 50.4, 44.6, and 34.0%, respectively, among all the participants, whereas these values were 74.5, 53.5, 47.1, and 38.2% among nurses, respectively (Lai et al., 2020). These findings were more severe than the results of this study.

Some recent studies revealed that students also experienced adverse mental symptoms after the COVID-19 outbreak, and the mental effects of COVID-19 may differ among countries and areas due to discrepancies in the COVID-19 infection and anti-epidemic conditions. First, a cross-sectional study regarding the psychological effects of the COVID-19 outbreak and lockdown among students (76.8%) and workers (23.2%) in a university in Spain which was severely affected by the COVID-19 pandemic showed that 87.5, 48.1, 35.2, and 40.3% of the respondents presented with symptoms of PTSD, depression, anxiety, and stress, respectively, with students having higher scores of depression, anxiety, and stress (Odriozola-Gonzalez et al., 2020). Next, a survey conducted in Texas A&M University, USA which was also severely affected by the COVID-19 pandemic showed that 80.6 and 71.8% of respondents reported symptoms of depression and anxiety, respectively (Wang X. et al., 2020). Furthermore, a survey about the impact of the COVID-19 pandemic on the mental health of home-quarantined students in Bangladesh showed that 69.3, 46.9, 33.3, and 28.5% of respondents reported having symptoms of PTSD, depression, anxiety, and stress, respectively (Khan et al., 2020). Finally, a large cross-sectional survey conducted among college students in Guangdong Province, China which aimed to assess the psychological impact of the COVID-19 outbreak showed that 50.9% respondents had abnormal IES scores, 0.5% reported poor mental health, and 3.2% reported poor sleep quality (Li X. et al., 2020).

As for nursing students, a recently published survey conducted from March 8 to 24, 2020 in China showed that the prevalence of anxiety, depression, and PTSD were 34.97, 40.22, and 14.97%, respectively (Li et al., 2021). Additionally, a multicenter cross-sectional study conducted from April 30 to May 14, 2020 in three European countries (Spain, Greece, and Albania) indicated that 67.5% nursing students experienced mild to severe depression, and the rates of depression differed among countries (Spain, 86%; Greece, 59.5% and Albania, 58.9%) (Patelarou et al., 2021). In this study, although the incidence rates of anxiety and depression were lower than that of the above studies, about half (44.5%) of the respondents reported symptoms of PTSD, whereas about a quarter (22.8%) reported symptoms of insomnia. Therefore, the psychological impact of the COVID-19 pandemic on nursing students is considerable, and special psychological guidance, support, and interventions should be implemented to assure their mental health.

Based on the above studies, we could conclude that the incidences of mental symptoms might be greater in areas with a high risk of COVID-19 or during high-risk periods. However, these results may be influenced by the use of different scales to evaluate the same symptoms. For example, depression was assessed using the Patient Health Questionnaire 9 (PHQ-9) in the above two studies; however, we used the DASS-21 to assess depression in this study.

In this study, senior and urban nursing students indicated higher levels of mental symptoms. Senior nursing students (interns) had started working under their clinical practice which required them to come into contact with all kinds of patients. As they would become clinical staff nurses soon, their feelings about the COVID-19 contagion might be more intuitive and deeper than junior nursing students which may have caused them to experience more symptoms of PTSD, depression, anxiety, and stress, even though all of them were required by the education department to study at home. In addition, their worries regarding their clinical skills and further education or employment may contribute to their higher levels of mental symptoms. Due to the dense population and convenient transportation in urban areas (about 2 h from Wuhan city to Zhengzhou city by high-speed train), the spread of COVID-19 was more severe in urban areas compared with rural areas, which may have resulted in the higher incidence of mental symptoms among urban nursing students.

Unexpectedly, compared with female nursing students, male nursing students reported higher incidences of symptoms of PTSD, depression, anxiety, and stress in this study, which was different from previous studies about healthcare workers (Lai et al., 2020). Possible reasons for this inconsistency are listed as follows. First, the respondents in this study were far from the areas with a high-risk of COVID-19 and were relatively safe at home. Second, male nursing students paid more attention to the COVID-19 outbreak (always, 50.8 vs. 40.0% among females). Finally, male nursing students had higher rates of insomnia (31.5 vs. 23.3%).

As more severe mental symptoms of PTSD, depression, anxiety, and stress were found in senior, urban, and male nursing students, governments, schools, and teachers should pay more attention to students with these risk factors. More frontline or online mental health counseling and support should be provided for these students to promote their mental health. First, senior nursing students should be educated more regarding COVID-19 prevention and treatment, and governments and schools should guarantee their chances of clinical practice and employment. Second, as for junior nursing students, it is important to educate them regarding COVID-19, and strengthening their professional identity, ideals, and faith may help prevent them from experiencing more severe psychological symptoms. Third, there are fewer male nursing students in China, and even though it is easier for them to get jobs compared with female nursing students, they had poor professional feelings of self-identity, responsibility, honor, and pride; thus, they may require special attention and more relevant education. Furthermore, nursing students from urban cities which had a higher risk of COVID-19 infection require more education regarding the prevention and control of COVID-19 infection, such as maintaining social distancing, wearing masks, and hand hygiene, and the government should provide them with timely, updated, and accurate official information regarding COVID-19.

Conclusion

In this study, a considerable number of nursing students reported having symptoms of PTSD and insomnia, whereas few nursing students reported mental symptoms of depression, anxiety, and stress. Furthermore, senior, male, and urban nursing students may be at risk for more severe mental symptoms. As nursing students are an important reserve force against the COVID-19 pandemic, special psychological interventions should be implemented to assure their mental health.

Limitations

There were several limitations in our study. First, this study had an online cross-sectional design. Second, we only investigated the nursing students from one college in Henan Province, China, so the findings may differ among other colleges, areas, or populations such as students belonging to other disciplines. Furthermore, as fewer respondents reported symptoms of depression, anxiety, and stress, the sample may have been insufficient for the subgroup analysis. Finally, we did not assess the effects of psychiatric and physical disorders of respondents, which might affect the results. Based on the above limitations, further studies regarding the mental health of nursing students should be conducted in the future.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author Contributions

FH, JG, and FW conceived and designed the experiments. JG wrote the original draft. JG, FW, and SG performed data collection, analysis, and interpretation. FH reviewed and edited the manuscript. All authors contributed to this study and approved the final version of the manuscript.

Funding

This study was supported by Henan Provincial Science and Technology Research Projects (Grant Nos. 182102310476 and 212102310799), Youth Foundation of The First Affiliated Hospital of Zhengzhou University (Grant No. YNQN2017109), and Medical Education Research Project of Health Commission of Henan Province (Grant No. Wjlx2020234).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We would like to thank the teachers of Weihong Li, Tingting Qu, Xing Meng, and nursing students who participated in this study. We would also like to thank the reviewers for their insightful comments, and Editage (www.editage.cn) for English language editing.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.699558/full#supplementary-material

References

Abdulah, D. M., Mohammedsadiq, H. A., and Liamputtong, P. (2021). Experiences of nurses amidst giving care to COVID-19 patients in clinical settings in Iraqi Kurdistan: a qualitative descriptive study. J. Clin. Nurs. doi: 10.1111/jocn.15909. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

Azoulay, E., Cariou, A., Bruneel, F., Demoule, A., Kouatchet, A., Reuter, D., et al. (2020). Symptoms of anxiety, depression and peritraumatic dissociation in critical care clinicians managing COVID-19 patients: a cross-sectional Study. Am. J. Respir. Crit. Care Med. 202, 1388–1398. doi: 10.1164/rccm.202006-2568OC

CrossRef Full Text | Google Scholar

Bagcchi, S. (2020). Stigma during the COVID-19 pandemic. Lancet Infect. Dis. 20:782. doi: 10.1016/S1473-3099(20)30498-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Budd, J., Miller, B., Manning, E., Lampos, V., Zhuang, M., Edelstein, M., et al. (2020). Digital technologies in the public-health response to COVID-19. Nat. Med. 26, 1183–1192. doi: 10.1038/s41591-020-1011-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Buysse, D. J., Reynolds, C. F. III., Monk, T. H., Berman, S. R., and Kupfer, D. J. (1989). The pittsburgh sleep quality index: a new instrument for psychiatric practice and research. Psychiatry. Res. 28, 193–213. doi: 10.1016/0165-1781(89)90047-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, L., Cai, J., Lin, Q., Xiang, B., and Ren, T. (2020). Imported COVID-19 cases pose new challenges for China. J. Infect. 80:e43–e44. doi: 10.1016/j.jinf.2020.03.048

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, X., and Yu, B. (2020). First two months of the 2019 Coronavirus Disease (COVID-19) epidemic in China: real-time surveillance and evaluation with a second derivative model. Glob. Health Res. Policy 5:7. doi: 10.1186/s41256-020-00137-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Chew, N., Lee, G., Tan, B., Jing, M., Goh, Y., Ngiam, N., et al. (2020). A multinational, multicentre study on the psychological outcomes and associated physical symptoms amongst healthcare workers during COVID-19 outbreak. Brain Behav. Immun. 88, 559–565. doi: 10.1016/j.bbi.2020.04.049

PubMed Abstract | CrossRef Full Text | Google Scholar

Christianson, S., and Marren, J. (2012). The Impact of Event Scale - Revised (IES-R). Medsurg. Nurs. 21, 321–322. doi: 10.1007/s11800-008-0132-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Czeisler, M., Lane, R., Petrosky, E., Wiley, J., Christensen, A., Njai, R., et al. (2020). Mental health, substance use, and suicidal ideation during the COVID-19 pandemic–United States, June 24-30, 2020. MMWR. Morb. Mortal. Wkly. Rep. 69, 1049–1057. doi: 10.15585/mmwr.mm6932a1

PubMed Abstract | CrossRef Full Text | Google Scholar

Epidemiology Working Group for NCIP Epidemic Response and Chinese Center for Disease Control and Prevention (2020). The epidemiological characteristics of an outbreak of 2019 novel coronavirus diseases (COVID-19) in China. Chin. J. Epidemiol. 41, 145–151. doi: 10.3760/cma.j.issn.0254-6450.2020.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Ettman, C., Abdalla, S., Cohen, G., Sampson, L., Vivier, P., and Galea, S. (2020). Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic. JAMA Netw. Open 3:e2019686. doi: 10.1001/jamanetworkopen.2020.19686

CrossRef Full Text | Google Scholar

Firth, J., Hellewell, J., Klepac, P., Kissler, S., Kucharski, A., and Spurgin, L. (2020). Using a real-world network to model localized COVID-19 control strategies. Nat. Med. 26, 1616–1622. doi: 10.1038/s41591-020-1036-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Hartmann, S., Rubin, Z., Sato, H., OYong, K., Terashita, D., and Balter, S. (2020). Coronavirus 2019 (COVID-19) Infections among healthcare workers, Los Angeles County, February–May 2020. Clin. Infect. Dis. ciaa1200. doi: 10.1093/cid/ciaa1200. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

Henry, J. D., and Crawford, J. R. (2005). The short-form version of the depression anxiety stress scales (DASS-21): construct validity and normative data in a large non-clinical sample. Br. J. Clin. Psychol. 44, 227–239. doi: 10.1348/014466505X29657

CrossRef Full Text | Google Scholar

Huang, L., Lei, W., Xu, F., Liu, H., and Yu, L. (2020). Emotional responses and coping strategies in nurses and nursing students during Covid-19 outbreak: a comparative study. PLoS. ONE 15:e0237303. doi: 10.1371/journal.pone.0237303

PubMed Abstract | CrossRef Full Text | Google Scholar

Hughes, M., Groenewold, M., Lessem, S., Xu, K., Ussery, E., Wiegand, R., et al. (2020). Update: characteristics of health care personnel with COVID-19 - United States, February 12-July 16, 2020. MMWR Morb. Mortal. Wkly. Rep. 69, 1364–1368. doi: 10.15585/mmwr.mm6938a3

PubMed Abstract | CrossRef Full Text | Google Scholar

Javed, A., Lee, C., Zakaria, H., Buenaventura, R. D., Cetkovich-Bakmas, M., Duailibi, K., et al. (2021). Reducing the stigma of mental health disorders with a focus on low- and middle-income countries. Asian J. Psychiatry 58:102601. doi: 10.1016/j.ajp.2021.102601

PubMed Abstract | CrossRef Full Text | Google Scholar

Khan, A., Sultana, M., Hossain, S., Hasan, M., Ahmed, H., and Sikder, M. (2020). The impact of COVID-19 pandemic on mental health & wellbeing among home-quarantined Bangladeshi students: a cross-sectional pilot study. J. Affect. Disord. 277, 121–128. doi: 10.1016/j.jad.2020.07.135

CrossRef Full Text | Google Scholar

Koh, D. (2020). Occupational risks for COVID-19 infection. Occup. Med. 70, 3–5. doi: 10.1093/occmed/kqaa036

PubMed Abstract | CrossRef Full Text | Google Scholar

Lai, J., Ma, S., Wang, Y., Cai, Z., Hu, J., Wei, N., et al. (2020). Factors associated with mental health outcomes among health care workers exposed to coronavirus disease 2019. JAMA Netw. Open 3:e203976. doi: 10.1001/jamanetworkopen.2020.3976

CrossRef Full Text | Google Scholar

Li, D., Zou, L., Zhang, Z., Zhang, P., Zhang, J., Fu, W., et al. (2021). The psychological effect of COVID-19 on home-quarantined nursing students in China. Front. Psychiatry 12:652296. doi: 10.3389/fpsyt.2021.652296

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, H. Y., Cao, H., Leung, D. Y. P., and Mak, Y. W. (2020). The Psychological impacts of a COVID-19 outbreak on college students in China: a longitudinal study. Int. J. Environ. Res. Public Health 17:3933. doi: 10.3390/ijerph17113933

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, X., Lv, S., Liu, L., Chen, R., Chen, J., Liang, S., et al. (2020). COVID-19 in Guangdong: immediate perceptions and psychological impact on 304,167 college students. Front. Psychol. 11:2024. doi: 10.3389/fpsyg.2020.02024

CrossRef Full Text | Google Scholar

Lovibond, P. F., and Lovibond, S. H. (1995). The structure of negative emotional states: comparison of the depression anxiety stress scales (DASS) with the beck depression and anxiety inventories. Behav. Res. Ther. 33, 335–343. doi: 10.1016/0005-7967(94)00075-u

PubMed Abstract | CrossRef Full Text | Google Scholar

Lyndon, A. E., Crowe, A., Wuensch, K. L., McCammon, S. L., and Davis, K. B. (2019). College students' stigmatization of people with mental illness: familiarity, implicit person theory, and attribution. J. Ment. Health 28, 255–259. doi: 10.1080/09638237.2016.1244722

PubMed Abstract | CrossRef Full Text | Google Scholar

Nature (2020). Stop the Wuhan virus. Nature 577:450. doi: 10.1038/d41586-020-00153-x

PubMed Abstract | CrossRef Full Text

Odriozola-Gonzalez, P., Planchuelo-Gomez, A., Irurtia, M. J., and Luis-Garcia, R. D. (2020). Psychological effects of the COVID-19 outbreak and lockdown among students and workers of a Spanish University. Psychiatry Res. 290:113108. doi: 10.1016/j.psychres.2020.113108

PubMed Abstract | CrossRef Full Text | Google Scholar

Pan, A., Liu, L., Wang, C., Guo, H., Hao, X., Wang, Q., et al. (2020). Association of public health interventions with the epidemiology of the COVID-19 outbreak in Wuhan, China. JAMA 323, 1915–1923. doi: 10.1001/jama.2020.6130

PubMed Abstract | CrossRef Full Text | Google Scholar

Patelarou, A., Mechili, E. A., Galanis, P., Zografakis-Sfakianakis, M., Konstantinidis, T., Saliaj, A., et al. (2021). Nursing students, mental health status during COVID-19 quarantine: evidence from three European countries. J. Ment. Health 30, 164–169. doi: 10.1080/09638237.2021.1875420

PubMed Abstract | CrossRef Full Text | Google Scholar

Pfefferbaum, B., and North, C. (2020). Mental health and the Covid-19 pandemic. N. Engl. J. Med. 383, 510–512. doi: 10.1056/NEJMp2008017

PubMed Abstract | CrossRef Full Text | Google Scholar

Ruktanonchai, N., Floyd, J., Lai, S., Ruktanonchai, C., Sadilek, A., Rente-Lourenco, P., et al. (2020). Assessing the impact of coordinated COVID-19 exit strategies across Europe. Science 369, 1465–1470. doi: 10.1126/science.abc5096

PubMed Abstract | CrossRef Full Text | Google Scholar

Shi, L., Lu, Z., Que, J., Huang, X., Liu, L., Ran, M., et al. (2020). Prevalence of and risk factors associated with mental health symptoms among the general population in China during the coronavirus disease 2019 pandemic. JAMA. Netw. Open 3:e2014053. doi: 10.1001/jamanetworkopen.2020.14053

PubMed Abstract | CrossRef Full Text | Google Scholar

Si, M., Su, X., Jiang, Y., Wang, W., Gu, X., Ma, L., et al. (2020). Psychological impact of COVID-19 on medical care workers in China. Infect. Dis. Poverty 9:113. doi: 10.1186/s40249-020-00724-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Tang, W., Hu, T., Hu, B., Jin, C., Wang, G., Xie, C., et al. (2020). Prevalence and correlates of PTSD and depressive symptoms one month after the outbreak of the COVID-19 epidemic in a sample of home-quarantined Chinese university students. J. Affect. Disord. 274, 1–7. doi: 10.1016/j.jad.2020.05.009

PubMed Abstract | CrossRef Full Text | Google Scholar

The Lancet (2020a). COVID-19: protecting health-care workers. Lancet 395:922. doi: 10.1016/S0140-6736(20)30644-9

PubMed Abstract | CrossRef Full Text | Google Scholar

The Lancet (2020b). Emerging understandings of 2019-nCoV. Lancet 395:311. doi: 10.1016/S0140-6736(20)30186-0

CrossRef Full Text | Google Scholar

Twenge, J., and Joiner, T. U. S. (2020). Census Bureau-assessed prevalence of anxiety and depressive symptoms in 2019 and during the 2020 COVID-19 pandemic. Depress. Anxiety 37, 954–956. doi: 10.1002/da.23077

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, C., Horby, P. W., Hayden, F. G., and Gao, G. F. (2020a). A novel coronavirus outbreak of global health concern. Lancet 395, 470–473. doi: 10.1016/S0140-6736(20)30185-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, C., Pan, R., Wan, X., Tan, Y., Xu, L., Ho, C. S., et al. (2020b). Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (COVID-19) epidemic among the general population in China. Int. J. Environ. Res. Public Health 17:1729. doi: 10.3390/ijerph17051729

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, X., Hegde, S., Son, C., Keller, B., Smith, A., and Sasangohar, F. (2020). Investigating mental health of US college students during the COVID-19 pandemic: cross-sectional survey study. J. Med. Internet Res. 22:e22817. doi: 10.2196/22817

CrossRef Full Text | Google Scholar

Wang, Y., Zhao, X., Feng, Q., Liu, L., Yao, Y., and Shi, J. (2020). Psychological assistance during the coronavirus disease 2019 outbreak in China. J. Health Psychol. 25, 733–737. doi: 10.1177/1359105320919177

PubMed Abstract | CrossRef Full Text | Google Scholar

World Health Organization (2020). Pneumonia of Unknown Cause – China. World Health Organization. Available online at: https://www.who.int/emergencies/disease-outbreak-news/item/2020-DON229

PubMed Abstract

World Health Organization (2021). Novel Coronavirus (COVID-19) Situation. Available online at: https://covid19.who.int/ (accessed June 4, 2021).

Xiao, H., Zhang, Y., Kong, D., Li, S., and Yang, N. (2020). The effects of social support on sleep quality of medical staff treating patients with coronavirus disease 2019 (COVID-19) in January and February 2020 in China. Med. Sci. Monit. 26:e923549. doi: 10.12659/MSM.923549

CrossRef Full Text | Google Scholar

Ye, W., Ye, X., Liu, Y., Liu, Q., Vafaei, S., Gao, Y., et al. (2020). Effect of the novel coronavirus pneumonia pandemic on medical students' psychological stress and its influencing factors. Front. Psychol. 11:548506. doi: 10.3389/fpsyg.2020.548506

PubMed Abstract | CrossRef Full Text | Google Scholar

Yohannes, A., Dryden, S., and Hanania, N. (2019). Validity and responsiveness of the depression anxiety stress scales-21 (DASS-21) in COPD. Chest 155, 1166–1177. doi: 10.1016/j.chest.2018.12.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, Y., Zhang, H., Ma, X., and Di, Q. (2020). Mental health problems during the COVID-19 pandemics and the mitigation effects of exercise: a longitudinal study of college students in China. Int. J. Environ. Res. Public Health 17:3722. doi: 10.3390/ijerph17103722

CrossRef Full Text | Google Scholar

Keywords: mental health, PTSD, depression, anxiety, stress, nursing students, COVID-19

Citation: Gao J, Wang F, Guo S and Hu F (2021) Mental Health of Nursing Students amid Coronavirus Disease 2019 Pandemic. Front. Psychol. 12:699558. doi: 10.3389/fpsyg.2021.699558

Received: 23 April 2021; Accepted: 12 July 2021;
Published: 12 August 2021.

Edited by:

Victoria Team, Monash University, Australia

Reviewed by:

Samson Femi Agberotimi, North-West University, South Africa
Carlo Antonio Bertelloni, University of Pisa, Italy
Benedetta Demartini, University of Milan, Italy
Veronica Nisticò, University of Milan, Italy, in collaboration with reviewer BD

Copyright © 2021 Gao, Wang, Guo and Hu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Fudong Hu, hufudong2005@126.com

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.