ORIGINAL RESEARCH article
Sec. Mood Disorders
Volume 13 - 2022 | https://doi.org/10.3389/fpsyt.2022.749236
Prevalence of Anxiety Symptoms and Associated Clinical and Sociodemographic Factors in Mexican Adults Seeking Psychological Support for Grief During the COVID-19 Pandemic: A Cross-Sectional Study
- 1Health Sciences Area, Valencian International University, Valencia, Spain
- 2School of Psychology, Universidad Internacional del Ecuador, Quito, Ecuador
- 3Departamento de Clínicas de Salud Mental, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara, Mexico
- 4Facultad de Estudios Superiores Iztacala, Universidad Nacional Autónoma de México, Mexico City, Mexico
- 5Facultad de Psicología, Universidad de Buenos Aires, Buenos Aires, Argentina
- 6Departamento de Ciencias Sociales, Universidad Autónoma de Ciudad Juárez, Juarez City, Mexico
- 7Rectoría, Universidad Autónoma de Ciudad Juárez, Juarez City, Mexico
- 8Departamento de Ciencias de la Salud, Universidad Autónoma de Ciudad Juárez, Juarez City, Mexico
- 9Coordinación Académica de Profesional, Universidad Tec Milenio, Juarez City, Mexico
- 10Facultad de Psicología, Universidad Nacional Autónoma de México, Mexico City, Mexico
The COVID-19 pandemic is one of the greatest challenges in modern history, with more than four million confirmed deaths worldwide. To date, evidence regarding the psychological impact of the COVID-19 pandemic on grievers is scarce for developing countries such as Mexico. This study aimed to assess the levels of anxiety and associated concerns in a sample of Mexican adults bereaved during the COVID-19 outbreak. A cross-sectional study was conducted through the Duelo COVID (COVID Grief) platform, which is a self-guided online treatment. A total of 5,224 participants reported their anxiety, depression, sleep quality, avoidance, and arousal, prolonged grief symptoms, and medication consumption. Independent sample Mann-Whitney U-tests, chi-square tests, and Kruskal-Wallis tests, as well as multinomial logistic regression, were conducted. Results indicated that 90.4% of the participants reported clinical levels of anxiety, depression, and sleep affectations. The people who lost someone during the last 5 months scored higher in normal grief symptoms compared to the people whose loss was 6 months ago or more, and 9.8% of individuals reported the use of prescription medication, with anxiolytics and antidepressants being the most common. Females, younger respondents, unemployed people with a lower educational level, and participants who disclosed a recent suicide attempt were among those who reported medication consumption. Sleep problems were more frequent in older participants.
The 2019 coronavirus disease (COVID-19) has wreaked major havoc on people's mental health worldwide (1). Recent findings showed a significant increase in clinical disorders like anxiety, depression, post-traumatic stress disorder (PTSD), and insomnia (2). Shah et al. (3) reported that 50.9% of their adult sample suffered from anxiety, 57.4% from stress, and 58.6% from depression. Wang et al. (4) systematically reviewed 68 studies comprising 288,830 participants from 19 countries and found that 33% of adults reported symptoms of anxiety or depression. Likewise, Xiong et al. (5) conducted a systematic review in which they observed that the prevalence of anxiety symptoms ranged from 6.33 to 50.9%, and was often comorbid with depression at rates from 14.6 to 48.3%. Before the pandemic, Medina-Mora et al. (6) reported that in 2018, among 5,826 Mexican adults, the rate of anxiety disorder was 14.3%, followed by mood disorders at 9.2%.
During the pandemic, Pérez-Cano et al. (7) found that in a sample of 613 Mexican adults, 48% reported mild to severe anxiety, and 18% reported depression or moderate-to-severe stress. González-Ramírez et al. (8) examined the psychological impacts of COVID-19 prevention measures in a sample of 3,932 participants from the Mexican population, and observed that 943 participants showed intrusive thoughts, 933 avoidance, and 515 hyperarousal symptoms. The researchers also found that 1,160 participants showed symptoms of clinically significant post-traumatic stress. Avoidance responses included denial of the event's significance and consequences, blunted sensation, and awareness of emotional numbness (9). On the other hand, arousal included anger, irritability, hypervigilance, and difficulty concentrating (10).
Within these studies, predictors of anxiety, depression, stress, and PTSD included being under the age of 40, being of female gender, being divorced or widowed, having a lower education level, suffering from poorer health, feeling alone, living in urban areas (5), and having poor sleep quality (11). Wang et al. (4) identified that higher odds of anxiety and depression were related to COVID-19 infection risk that included suspected or confirmed cases, suffering from pre-existing physical or mental conditions, and longer media exposure. Likewise, it has been found that the population who contracted COVID-19 along with those with pre-existing diseases, particularly chronic/degenerative pathologies, or other psychiatric disorders were related to higher levels of anxiety and depression (12). Anxiety has also been associated with poor sleep quality in the context of the COVID-19 pandemic (13), as well as potentially increased rates of abuse of psychotropic medication and illegal drugs (14), as means to cope with suffering.
A section of the population that may be particularly impacted during the pandemic are those who have experienced a bereavement (15). According to the World Health Organization (WHO), as of July 12, 2021, there were 5,570,163 deaths due to COVID-19 since the beginning of the pandemic (1).
Mexico is the fourth highest place in terms of deaths due to COVID-19. This means there are now millions of families that are currently grieving a person who has died from COVID-19, not to mention other causes on death (16).
Experiencing a sudden loss, such as those brought on by COVID-19, may have a significant impact on those left to grieve (13). Kokou-Kpolou et al. (16) indicated that death circumstances during the pandemic due to the viral contagion of COVID-19 deprive families of assisting the dying person and partaking in associated rituals or ceremonies, provoking an increase in emotional pain and raising the likelihood of pathological grief outcomes. Other factors that might complicate the grieving process include feelings of guilt, the restrictions imposed on funerals to share emotional pain with others, and the isolation prior to the loss (17, 18), as well as anticipatory grief that could lead to mental health complications in both the surviving family and the medical staff (18).
Given these risk factors and psychological needs, the online intervention Duelo COVID, a self-guided treatment that provides psychological intervention aimed at preventing the development of complicated grief in the Mexican population during the COVID-19 pandemic, was created (19). This online platform was designed for those who have experienced a bereavement during the pandemic, regardless if it was due to COVID-19 or another cause during the pandemic. It consists of 12 sessions with the aim to assist participants in resolving conflicts associated with a higher risk of grief complications and to improve wellbeing in different areas of the affected people's lives. This study was carried out as a result of the data obtained from Duelo COVID to further our understanding of the impact of bereavement during COVID-19 on levels of psychological distress in Mexico. Specifically, the study explored levels of anxiety, depression, sleep quality, avoidance, arousal, prolonged grief symptoms (also known as complicated grief), and medication consumption with the aim of better understanding the needs of this vulnerable population.
Study Design and Participants
The first step in the analysis was the selection of participants who met the inclusion criteria. Using non-probability sampling and a cross-sectional design, 12,798 participants were recruited from those who had accessed Duelo COVID from mid-December 2020 to mid-March 2021. After excluding 3,683 individuals who had not signed the informed consent form, the included participants were those who had completed the pre-evaluation questionnaires, were aged 18 years or older, and had accessed the platform from Mexico (N = 5,224). Figure 1 shows the sample filtering flow chart. Sociodemographic characteristics of the final sample are presented in Table 1.
Table 1. Sociodemographic characteristics of support-seeking bereaved adults during the COVID-19 pandemic.
Generalized Anxiety Disorder 7-Item
The GAD-7 is a 7-item scale designed to measure the severity of symptoms of generalized anxiety disorder (20). Items range from 0 (not at all) to 3 (nearly every day), with a possible score ranging from 0 to 21. A cut-off point of 5 or above is an indicator of probable anxiety symptoms. Additional cut-off criteria were used to explore the severity of those symptoms: GAD7 ≥10 and GAD7 ≥15 for moderate and severe presentations, respectively (20, 21). In the current study, Cronbach's alpha = 0.90.
Center for Epidemiologic Studies Depression Scale
The CESD-R is a self-report scale that enquires about symptoms of depression during the past 2 weeks. It consists of 20 questions with answers ranging from rarely or never (<1 day) to most of the time (5–7 days). Scores of 16 or above indicate probable depression diagnosis (22). This measure has been commonly used in health research, and its psychometric properties have shown it to be a valid scale in the Mexican population (Cronbach's alpha >0.90) (23). In this study, Cronbach's alpha was 0.93.
Pittsburgh Sleep Quality Index
The PSQI assesses sleep quality patterns. Seven areas are evaluated including subjective sleep quality, sleep latency, sleep duration, habitual sleep efficiency, sleep disturbances, daytime dysfunction, and use of sleeping medication. A total score ranging from 0 to 21 is provided by the sum of the seven mentioned factors. A score of five or above indicates poor sleep quality (24). In the present study, we will report this total score. The measure has demonstrated reliability in the Mexican population (α = 0.78) (25). In the current study, Cronbach's alpha = 0.70.
Post-traumatic Stress Disorder Symptom Scale Self-Report
The PSS-SR is a 17-item semi-structured self-report measure that can be administered to examine post-traumatic symptoms. Each item is answered using a four-point scale ranging from 0 (not at all) to 3 (very much). The instrument presents adequate reliability values (α = 0.85) (26, 27). In the present study, two of the three dimensions of this scale were considered (due to their link with anxiety): avoidance (α = 0.82) and increased arousal/ activation (α = 0.76) of physical, cognitive, or behavioral symptoms derived from post-traumatic stress. Both will be considered for the data analysis.
Inventory of Complicated Grief
The ICG (28) is a self-report measure composed of 19 items that assess emotional, cognitive, or behavioral symptoms of complicated grief (CG). For this study, the Spanish version of Limonero et al. (29) was applied. Items range from 0 (never) to 4 (always), with a total score ranging from 0 to 76. A cut-off point over 30 in the total ICG score was used to explore potentially maladaptive grief symptoms. The validation of the scale in the Mexican population was performed by the authors of the present study and the preprint version is available at Dominguez-Rodriguez et al. (30) In the current study Cronbach's alpha = 0.93.
Participants were asked to report their gender and, in a binary yes/no format, their employment status, if they were currently receiving psychological treatment, and if in the last 3 months they had attempted to take their own life. They were also asked to inform about any medications they were taking at the time of the study.
Three other socio-demographic variables were re-coded as follows: age ( ≤ 30 years old; ≥31 years old), educational level ( ≤ 12 years; ≥13 years), and time since loss (<6 months; ≥6 months). These cut-off scores were decided upon for the following reasons: the age of 30 is commonly used for separating young adults from adults. Twelve years represent the average time spent in mandatory education in the countries where the participants of this study reside. The time frame of 6 months or more, elapsed since the loss, is used to assess the presence of persistent and potentially problematic symptoms of grief, as proposed by the ICD-11 (31). Initially, these last three variables were, respectively, continuous (for age) and eight-point ordinal variables (for educational level and time since loss).
From December 22, 2020, to March 16, 2021, participants accessed the online platform and completed the informed consent form followed by the questionnaires. At the end of the survey, the participants were notified about available online psychological counseling services, if the users were identified as being at risk after answering the questionnaires (e.g., recent attempts of suicide, moderate to high results on the suicide scale, diagnosis of posttraumatic stress disorder), and if the participants did not have access to the intervention, they were informed about other available free psychological services. Also, one excluded participant requested their data to be removed from the data analysis.
The study design and procedures were approved by the Research Ethics Committee of the Autonomous University of Ciudad Juárez, México (Approval ID: CEI-2020-2-226) and is registered in Clinical trials (NCT04638842).
Data analyses were performed using SPSS statistical software version 23.0. The prevalence of anxiety, depression, sleep problems, and grief symptoms was expressed as raw scores and percentages of cases and was calculated using the following cut-off scores: for anxiety, GAD-7 ≥5; for depression, CESD-R ≥16; for sleep problems, PSQI >5, and for potentially problematic grief, ICG >30. The prevalence rates of the two post-traumatic stress factors (avoidance and activation) were not calculated, because we used only two factors (and not the full scale), and we do not have a cut-off point that allows this threshold to be established. The normality and homoscedasticity were calculated for all the dependent variables by the Kolmogorov-Smirnov and the Levene tests, respectively. Independent sample Mann-Whitney U-tests were used to explore the sociodemographic characteristics of the participants, including gender, age, working status, educational level, medication intake, psychological treatment, suicide attempt in the last 3 months, and time since loss of the loved one, as well as the total scores of anxiety, depression, sleep problems, avoidance and activation (arousal), and grief symptoms. Rosenthal's r was computed to assess the magnitude of the effect for the statistically significant differences obtained from the comparative analyses (32).
Pearson's correlations were used to explore the bivariate correlations among the continuous variables of this study (depression, sleep problems, avoidance, and increased arousal), as a first step to test multicollinearity.
A Chi-square test was performed to compare two independent groups when categorical variables were used, whereas the Kruskal Wallis test was used for comparing more than two groups in a quantitative variable. Chi-Square and Kruskal-Wallis tests, with Cramer's V and Epsilon Squared, respectively, were also performed to compare sociodemographic characteristics and clinical correlates among different groups of participants regarding anxiety severity: individuals who did not present significant anxiety symptoms (GAD-7 = 1–4), and those with mild (GAD-7 = 5–9), moderate (GAD-7 = 10–14), and severe (GAD-7 = 15–21) levels. Multinomial logistic regression was used to quantify the effects of sociodemographic variables on symptoms of anxiety. Significant associated variables identified from the chi-square tests were entered into logistic regression. The Nagelkerke-R2 was used to examine the percentage of variance associated with anxiety that was explained by the categorical predictors. Adjusted odds ratio with 95% confidence intervals were also reported to measure the strength of association. To identify the relationship between anxiety level and medication use, chi-square and Cramer's V were calculated.
Clinical Symptoms and Sociodemographic Characteristics
There were 4,895 (93.7%) respondents who reported symptoms of anxiety that were rated as mild or above (GAD ≥5); 4,972 (95.2%) had clinically relevant sleep problems (PSQI >5), 4,526 (86.6%) presented mild or greater depression symptoms (CESDR ≥16). Of those, 4,724 (90.4%) were high across the three areas. Potentially problematic grief symptoms were displayed by 3,538 (67.7%) (ICG >30).
As presented in Tables 1, 2, female gender, under 30 years old, unemployed, lower educational level, taking medication, and made a recent suicide attempt were associated with higher levels of anxiety, depression, posttraumatic stress symptoms (avoidance and activation), and grief symptoms. The results were similar for sleep difficulties; however, older rather than younger age was associated with having difficulties.
Regarding the impact of time since the loss of the loved one, participants whose loss was more recent (<6 months) showed higher levels of depression (p < 0.001), sleep difficulties (p < 0.01), and problematic grief symptoms (p < 0.001), compared to respondents whose loss occurred 6 months ago or more. On the contrary, individuals whose loss occurred more recently (<6 months prior) reported lower levels of arousal than participants with a loss that occurred 6 months ago or more. No significant differences were found for anxiety and avoidance when comparing the participants considering time since the loss (Supplementary Tables 1–5).
Correlates of Anxiety Severity
Table 3 summarizes the comparisons between anxiety levels (none, mild, moderate, and severe anxiety) and their correlates. Chi-square analyses were significant for all binary variables, except for psychological support and for time since loss. That is, gender, age, working status, educational level, use of medication, and recent suicide attempt were associated with anxiety.
Kruskal-Wallis tests showed that the more severe the anxiety, the higher the levels of depression, sleep difficulties, avoidance, arousal, and grief symptoms. H values were statistically significant (all p < 0.001).
Regarding age, a different trend was observed: the more severe the anxiety, the lower the mean age of the participants. The H value was statistically significant (p < 0.001).
Categorical variables with significant p- values were included in the multinomial logistic regression.
Next, a multinomial logistic regression was undertaken to examine the extent to which individual variables remained significant predictors of anxiety accounting for shared variance among predictors. Age was considered a binary variable for a more comprehensive interpretation. The reference category was the non-anxiety group. Each level (mild, moderate, severe) was compared with this reference category. The multinomial logistic regressions and adjusted odd ratios were calculated and are shown in Table 4.
The final model had a−2 Log Likelihood value of 499.560, χ2 (18, N = 5,056) =249.952, p < 0.001. The Nagelkerke Pseudo R-Square was 0.053, which suggested that ~5.3% of the variance associated with anxiety levels was explained by the predictors.
Moderate and severe anxiety groups exhibited significant associations with gender, age, and substance intake. The influence of these variables was strong. Regarding gender, women were 1.6–2.2 times more likely than men to exhibit problematic anxiety symptoms, adjusting for the rest of the variables. Younger participants were 1.7–1.9 times more likely to be in these anxiety groups (vs. the reference group) than older ones, when controlling for the other predictors. Comparatively, participants who used medication had a risk of 3.3–5.6 times greater of being in the moderate anxiety and severe anxiety groups (vs. the reference group) compared to those who did not use substances, even when controlling for other independent variables. In addition, the severe anxiety group also showed an association with recent suicide attempts: participants had almost 15 times more risk of exhibiting these manifestations of anxiety than people without a recent suicide attempt. On the other hand, working status and level of education were not significant predictors of anxiety severity.
As mentioned in previous paragraphs, we reported the associations between anxiety and medication use, the latter presented in a dichotomous variable format (yes/no). Next, the type of medication and the connection with anxiety levels are explored and shown in Table 5 (Supplementary Table 6 presented international non-proprietary names for the substances, also the number and percentage of users for each of them).
From the total sample (N = 5,224), 513 (9.80%) individuals informed the use of medication. A total of 354 (6.8%) of the respondents reported consuming more than one substance. Antidepressants were the most frequently reported medication. In this category, selective serotonin reuptake inhibitors (SSRIs) were the most frequently used, with 233 (4.5%) participants using one of them and 6 (0.1%) subjects taking two of these substances. Anxiolytics were the second group of medicines most frequently mentioned; within this type, benzodiazepines (BZDs) were the most common with 209 (4.0%) participants reporting the use of one kind of this medication, and 3 (0.1%) respondents who acknowledged taking two different kinds of them.
Chi-square tests presented a significant association between anxiety and BZD (p < 0.001). Cramer's V was 0.191 (p < 0.001), which suggested that the two variables shared about 3.6% of their variance. The adjusted residual for participants with more severe anxiety presentation was 4.0 (>1.96 in absolute value), indicating that for respondents of this group who were taking BZD, and observed frequencies (n = 150) were higher than expected (n = 128). None of the other types of drugs showed significant relationships with anxiety.
The main objective of this study was to examine the prevalence of anxiety symptoms and associated clinical and sociodemographic factors in Mexican adults seeking psychological support for grief during the COVID-19 pandemic. The results showed that 93.7% of participants exhibited significant anxiety symptoms, 95.2% had sleep problems, 86.6% presented symptoms of depression, and 67.7% showed potentially problematic grief symptoms.
The literature currently available regarding the mental health impact caused by COVID-19 is accumulating, and information from low-income and developing countries is starting to appear, but at a considerably lower rate than in developed countries. A part of the population that is potentially suffering more severely than the general population due to the ongoing pandemic is represented by the people that have been bereaved during the COVID-19 pandemic, where funerals and other important rituals were not allowed to take place. Regarding this group, Eisma et al. (33) warned that prolonged grief disorder will be a public health problem once the COVID-19 pandemic ends. Circumstances of death during the pandemic are likely to increase the prevalence of a prolonged grief disorder, such as multiple and indirect traumatic characteristics, such as possible multiple deaths for families that could lead to bereavement overload, due to limitations caused by COVID-19 that restrict families from spending the last days together with the person they lost and from performing on-site funerals (16). Other authors suggest that further research is necessary on the impact of COVID-19 on grievers.
The results showed that being younger was associated with greater symptomatology in anxiety, depression, grief, avoidance, and arousal. Individuals younger than 30 had more severe symptoms than those older than 30. In previous research, it has been observed that young adults may engage in negative thinking as a coping strategy, which would bring about maladaptive outcomes (34). Importantly, older adults tend to have more stable jobs with better salaries (35), which could act as a protective factor.
In addition, the present study shows a high prevalence of posttraumatic stress related symptoms. These symptoms were higher for females than for males. Also, unemployed people presented more avoidance and arousal symptoms than employed ones, highlighting this group as one of the most affected by the pandemic. This supports prior research showing that unemployment is directly linked to insecurity about work and finances and worse mental health in terms of anxiety and depression (35). It has also been observed that during the COVID-19 pandemic, women were 24% more likely to permanently lose their jobs than men. In addition, women expected their labor income to fall 50% more than men (36). Also, considering the available literature and the results of the present study, there is evidence that during the COVID-19 pandemic, women are more affected than men in terms of mental health. The reasons could be several, such as domestic violence, parenting, miscarriage, pregnancy, job loss, or postpartum depression (37, 38).
Furthermore, attempt of suicide in the last 3 months had significantly greater symptomatology or impact in all the areas measured in this study (anxiety, depression, sleep quality, grief, avoidance, arousal, and medications consumed), compared to the participants that had not recently attempted suicide. These results are in accordance with previous studies. A study conducted with middle-aged and older adults with depressive symptoms in five low- and middle-income countries, concluded that the participants with poor or very poor sleep quality had a greater likelihood of suicidal ideation, and those with moderate and severe or extreme insomnia had a greater likelihood of suicidal ideation and suicidal attempt (39). Other studies identified that anxiety is a statistically yet weak predictor of suicide ideation and attempts but not deaths (40). Another study has observed that suicide attempters and completers were similar in terms of depression, but suicide completers were more likely to use alcohol or medication (41). The results of our study add to the growing literature on mental health outcomes following bereavement during the pandemic. Future studies will assist in establishing the generalizability of our findings. On the other hand, time since loss was also relevant, indicating that people with a more recent loss were more affected in grief areas than those who reported more time since their loss. Additionally, the participants whose loss was <6 months prior to the assessment showed higher levels of depression and of sleep difficulties compared to those whose loss occurred 6 months or more prior to their access to the platform. However, individuals whose loss occurred <6 months ago reported lower levels of arousal compared to participants with a loss that occurred 6 months or more before their first access to the platform. This result reflects the need for future longitudinal studies to understand the trajectory of normal grieving and its relationships with post-traumatic stress symptoms over time. Whereas, studies with participants diagnosed with prolonged grief disorder have shown associations between this disorder and post-traumatic symptoms, including hyperarousal (42), the link between normal grieving and arousal trajectory, considering time since loss, is still scarce. More evidence is required considering the causes of death (natural vs. unnatural causes), the presence of a traumatic vs. a non-traumatic loss (43), and the closeness with the deceased person.
No significant differences were found for anxiety and avoidance when comparing the participants on time since loss. These results may suggest that, concerning the time elapsed since the loss, even after 6 months, people continue to display indicators of emotional distress, specifically posttraumatic stress symptoms (avoidance and arousal) that, in turn, are associated with high levels of anxiety. This is consistent with the presence of depressive and post-traumatic symptoms that have been reported as frequent among people who have experienced a recent loss (44).
Furthermore, researchers worldwide are concerned about the impact of the circumstances of the COVID-19 pandemic and the possible rise in the prevalence of prolonged grief disorder (45). In this sense, a recent study (46) compared the grief symptomatology in participants that had lost someone due to COVID-19 with those who lost someone due to natural causes, such as other illnesses or old age, and unnatural causes, such as accidents, suicide, or homicide. The researchers observed that, as a result of COVID-19, grievers reported more severe symptoms of prolonged grief disorder and persistent complex bereavement disorder compared to natural bereavement, but not to unnatural bereavement. Likewise, the study of Eisma and Tamminga (47) compared the results of individuals who lost someone before and during the pandemic, observing that in general, grief severity was not significantly different; nevertheless, the people that experienced a recent loss (according to the authors 5 months ago and less) during the pandemic had higher grief levels compared to a similar experience not during the pandemic. These results could suggest that a more recent loss in terms of time is related to higher symptomatology during the COVID-19 pandemic. Another study with recently bereaved spouses observed considerable somatic symptoms during the earliest months of the loss but there were no major health declines over the first year and a half due to the grief symptoms (48). Similarly, Tang and Xiang (49) reported that in a sample of 422 participants who had lost someone due to COVID-19, the prevalence of prolonged grief disorder was between 29.3 and 37.8%, depending on the screening tool.
It is relevant to notice that the vast majority of the participants in this study indicated reduced sleep quality. The sleep quality was significantly lower for older adult participants. Also, analyzing the relationship between the time since loss and sleep quality, significant differences were found (difficulties were greater for those whose loss was more recent). This is in line with the data of other developing countries like Mexico, such as India, where it has been observed that the lockdown was associated with poor sleep quality and shifts in sleep cycles (50). Data from other countries, such as Portugal, indicated that from 365 participants, two-thirds reported at least one sleep difficulty and frequent awakenings (51). To the best of our knowledge, this is the first study that presents data related to sleep quality of bereaved individuals during the COVID-19 pandemic. The research related to sleep disturbances of people suffering from complicated grief is still scarce. It has been observed that in community-dwelling middle-aged and older adults, persons with normal and complicated grief had both a shorter sleep duration and a lower sleep quality, mainly explained by depressive symptoms (52). In the study of Szuhany et al. (53) with 395 patients with complicated grief, greater complicated grief was associated with poorer sleep quality. More research is needed in this line and it is expected that this manuscript provides more data in this line.
Regarding medication consumption, the main medications used were SSRIs, followed by BZDs. A total of 513 individuals reported having consumed medication, and of those, more than half acknowledged taking more than one. This is a considerable proportion, and further studies should be conducted to gain a better understanding of using medication as a coping strategy related to the COVID-19 pandemic. Furthermore, it has been widely observed that alcohol consumption has increased during the COVID-19 pandemic (54), although the WHO discourages the use of substances with the potential to create addiction to manage the burden of social isolation (55), BZDs are often the first-line pharmacological treatment for various anxiety disorders such as General Anxiety Disorder and Social Anxiety Disorder, among others (56). Although there is no confirmed diagnosis of the participants of this study, it was found that severe anxiety symptoms are present in a large part of the sample, symptoms that, due to the significant association found with BZD, are probably being addressed through these medications. These findings give way to a reflection on possible difficulties derived from its use, especially in the medium or long term. This is an aspect that should be included in future studies.
Despite the limitation of the cross-sectional design used in this study, the results presented are relevant because they reveal the high rate of symptoms in bereaved people during the pandemic, specifically the levels of anxiety, depression, affected sleep quality, avoidance and arousal, complicated grief symptoms, and medication consumption. The present results are in line with other studies that have used a cross-sectional design during the COVID-19 pandemic (57, 58). It is recommended that future studies focus on evaluating the trajectory of the grief symptoms of people that lost someone during the COVID-19 pandemic.
Another limitation to the current study was the lack of a comparison group to evaluate the difference in clinical indicators between those who were bereaved and those who were not bereaved during the pandemic. Therefore, the results should be received with caution.
A further limitation is that this study had a considerably a greater sample of women, compared to men. This is in accordance with many other studies where women are less reluctant to search for psychological support than men (59). Also, it has been observed that the prominent obstacles for men to search for psychological help are disinclination to express emotions or concerns about health, embarrassment, anxiety, fear, and poor communication with health professionals, which applies not only to psychological support but also to physical health (60). Another reason could be that men's ideas regarding masculinity are a considerable barrier to seek psychological support (59). It is of interest to researchers that these stereotypes persist even in such a stressful time for humankind, such as this global pandemic. Future studies should make more efforts to include more men in the samples by creating advertisements indicating that it is positive and acceptable for men to ask for psychological support.
Moreover, it must be mentioned that there was no data collected on the cause of death. This information could have been useful in teasing out the differences in anxiety (and associated factors) based on loss due to COVID-19 vs. other causes. Other relevant variables could be added, such as socioeconomic status (61) or social connections (62) of the responder, among other variables, which could influence the psychological impact of the loss. In addition, the sample included only those who sought psychological help. Regarding the strengths of the study, several can be mentioned. This is one of the first studies that has presented the symptomatology of anxiety, depression, sleep quality, avoidance, arousal, grief, and medication consumption in a sample of people that are in a grieving process and actively seeking psychological support due to the loss of someone during the COVID-19 pandemic. Part of this strength is that the sample size was considerably large, with 5,224 participants. Other studies in similar developing countries could be considered in order to further explore the impact of the pandemic on grief.
In conclusion, with these results, it has been observed that the most affected sector of the Mexican population with symptoms of anxiety, depression, avoidance, arousal, and grief are unemployed young women that consume medication and have attempted suicide in the last 3 months.
A more recent loss (<6 months prior to participating in the study) was significantly associated with higher levels of depression, sleep difficulties, and grief symptoms, and with lower levels of post-traumatic arousal symptoms, when compared to a loss that occurred 6 months ago or more.
These results indicate the need to provide mental health treatment to the population that suffered the death of a loved one during the COVID-19 pandemic to reduce the impact in terms of mental health, even when the pandemic is under control. In addition, the results of the efficacy of the intervention Duelo COVID will be presented in upcoming manuscripts.
Data Availability Statement
Original datasets are available in a publicly accessible repository: The original contributions presented in the study are publicly available. This data can be found here: https://www.datafirst.uct.ac.za/dataportal/index.php/catalog/865.
The study design and procedures were approved by the Research Ethics Committee of the Autonomous University of Ciudad Juárez, México (Approval ID: CEI-2020-2-226) and are registered in Clinical trials (NCT04638842). The patients/participants provided their written informed consent to participate in this study.
AD-R, PH-A, JM, EE, and LF accessed and verified the underlying data and take responsibility for the integrity of the data and accuracy of the corresponding analysis. AD-R, AR-G, MH, EB, RC, CA-S, PA-L, and SM-L conceptualized the study. PH-A and LF maintained data over time and linked data across data collection waves over time. PH-A, JM, EE, and LF did the formal analyses. AD-R and FR-M acquired the funding for this study. AD-R was the project administrator and supervisor. RM, EB, and JM conducted the literature review and organization of the manuscript. All authors wrote the original manuscript draft, contributed to reviewing, editing the manuscript, had full access to all the data, and had ultimate responsibility for the decision to submit the manuscript for publication.
This research was funded by the Universidad Autónoma de Ciudad Juárez (UACJ). The University had no role in any steps of the research: study design, collection, analysis, and interpretation of data, the writing of the manuscript, or the decision to submit the paper for publication. Financial aid for the publication was granted by the Universidad Internacional del Ecuador (UIDE).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
The authors want to thank the graphic designers and animators Javier Velazquez, Edgar Arenas, Karine Tovanche, Alexia Apodaca, Cinthia Holguín, Mariana Martínez, and Mitzi Valencia, who created the videos and made the contents more attractive for the Duelo COVID intervention. The authors would also like to thank Dr. Geert van Boxtel from the Tilburg University, along with Janine Matts, Eder Ruíz Rodríguez, and Idalí Rodríguez Yañez for their critical review of this manuscript and for editing the English grammar.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2022.749236/full#supplementary-material
1. World Health Organization. WHO Coronavirus (COVID-19). Dashboard. Available online at: https://covid19.who.int (accessed January 21, 2022).
2. Sun Q, Qin Q, Basta M, Chen B, Li Y. Psychological reactions and insomnia in adults with mental health disorders during the COVID-19 outbreak. BMC Psychiatry. (2021) 21:19. doi: 10.1186/s12888-020-03036-7
3. Shah SMA, Mohammad D, Qureshi MFH, Abbas MZ, Aleem S. Prevalence, psychological responses and associated correlates of depression, anxiety and stress in a global population, during the coronavirus disease (COVID-19) pandemic. Community Ment Health J. (2021) 57:101–10. doi: 10.1007/s10597-020-00728-y
4. Wang Y, Kala MP, Jafar TH. Factors associated with psychological distress during the coronavirus disease 2019 (COVID-19) pandemic on the predominantly general population: a systematic review and meta-analysis. PLoS ONE. (2020) 15:e0244630. doi: 10.1371/journal.pone.0244630
5. Xiong J, Lipsitz O, Nasri F, Lui LM, Gill H, Phan L, et al. Impact of COVID-19 pandemic on mental health in the general population: a systematic review. J Affect Disord. (2020) 277:55–64. doi: 10.1016/j.jad.2020.08.001
6. Medina-Mora M, Borges G, Benjet C, Lara C, Berglund P. Psychiatric disorders in Mexico: lifetime prevalence in a nationally representative sample. Br J Psychiatry. (2007) 190:521–8. doi: 10.1192/bjp.bp.106.025841
7. Pérez-Cano HJ, Moreno-Murguía MB, Morales-López O, Crow-Buchanan O, English JA, Lozano-Alcázar J, et al. Anxiety, depression, and stress in response to the coronavirus disease-19 pandemic. Cir Cir. (2020) 88:562–8. doi: 10.24875/CIRU.20000561
8. González-Ramírez LP, Martínez-Arriaga RJ, Hernández-González MA, De la Roca-Chiapas JM. Psychological distress and signs of post-traumatic stress in response to the COVID-19 health emergency in a Mexican sample. Psychol Res Behav Manag. (2020) 13:589–97. doi: 10.2147/PRBM.S259563
9. Horowitz M, Wilner N, Alvarez W. Impact of event scale: a measure of subjective stress. Psychosom Med. (1979) 41:209–18. doi: 10.1097/00006842-197905000-00004
10. Weiss DS, Marmar CR. The impact of event scale – revised. In: Wilson JP, Keane TM, editors. Assessing Psychological Trauma PTSD. New York, NY: Guilford Press: (1997). pp. 399–411.
11. Vindegaard N, Benros ME. COVID-19 pandemic and mental health consequences: systematic review of the current evidence. Brain Behav Immun. (2020) 89:531–42. doi: 10.1016/j.bbi.2020.05.048
12. Luo M, Guo L, Yu M, Jiang W, Wang H. The psychological and mental impact of coronavirus disease 2019 (COVID-19) on medical staff and general public - a systematic review and meta-analysis. Psychiatry Res. (2020) 291:113190. doi: 10.1016/j.psychres.2020.113190
13. Xiao H, Zhang Y, Kong D, Li S, Yang N. Social capital and sleep quality in individuals who self-isolated for 14 days during the coronavirus disease 2019 (COVID-19) outbreak in January 2020 in China. Med Sci Monit. (2020) 26:e923921–1. doi: 10.12659/MSM.923921
14. Satre DD, Hirschtritt ME, Silverberg MJ, Sterling SA. Addressing problems with alcohol and other substances among older adults during the COVID-19 pandemic. Am J Geriatr Psychiatry. (2020) 28:780–3. doi: 10.1016/j.jagp.2020.04.012
15. Walsh F. Loss and resilience in the time of COVID-19: meaning making, hope, and transcendence. Fam Process. (2020) 59:898–911. doi: 10.1111/famp.12588
16. Kokou-Kpolou CK, Fernández-Alcántara M, Cénat JM. Prolonged grief related to COVID-19 deaths: do we have to fear a steep rise in traumatic and disenfranchised griefs? Psychol Trauma Theory Res Pract Policy. (2020) 12:S94–5. doi: 10.1037/tra0000798
17. Yahya AS, Khawaja S. Bereavement and grief during the COVID-19 pandemic. Prim Care Companion CNS Disord. (2020) 22:20com02661. doi: 10.4088/PCC.20com02661
18. Wallace CL, Wladkowski SP, Gibson A, White P. Grief during the COVID-19 pandemic: considerations for palliative care providers. J Pain Symptom Manage. (2020) 60:70–76. doi: 10.1016/j.jpainsymman.2020.04.012
19. Domínguez-Rodríguez A, Martínez-Luna SF, Hernández-Jiménez MJ, De la Rosa-Gómez A, Arenas-Landgrave P, Esquivel Santoveña E, et al. A self-applied multi-component psychological online intervention based on UX, for the prevention of complicated grief disorder in the mexican population during the COVID-19 outbreak: protocol of a randomized clinical trial. Front Psychol. (2021) 12:644782. doi: 10.3389/fpsyg.2021.644782
20. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. (2006) 166:1092–7. doi: 10.1001/archinte.166.10.1092
21. García-Campayo J, Zamorano E, Ruiz M, Pardo A, Pérez-Páramo M, López-Gómez V, et al. Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health Qual Life Outcomes. (2010) 8:8. doi: 10.1186/1477-7525-8-8
22. Eaton WW, Muntaner C, Smith C, Tien A, Ybarra M. Center for epidemiologic studies depression scale: review and revision (CESD and CESD-R). In: Maruish ME, editor. The Use of Psychological Testing for Treatment Planning and Outcomes Assessment. 3rd ed. Mahwah, NJ: Lawrence Erlbaum. (2004) p. 363–77.
23. González-Forteza C, Torres CS, Tapia AJ, Fernández IH, González-González A, García FJ, et al. Reliability and validity of CES-D depression scale in a census of students in high school and college students from Mexico City: Results from a census./[Confiabilidad y validez de la escala de depresión CES-D en un censo de estudiantes de nivel medio superior y superior, en la Ciudad de México]. Salud Mental. (2011) 34:53–9.
24. Buysse DJ, Reynolds III CF, Monk TH, Berman SR, Kupfer DJ. The pittsburgh sleep quality index: a new instrument for psychiatric practice and research. Psychiatry Res. (1989) 28:193–213. doi: 10.1016/0165-1781(89)90047-4
25. Jiménez-Genchi A, Monteverde-Maldonado E, Nenclares-Portocarrero A, Esquivel-Adame G, de la Vega-Pacheco A. Reliability and factor analysis of the spanish version index of pittsburgh sleep quality in patients psychiatric. [Confiabilidad y análisis factorial de la versión en español del índice de calidad de sueño de Pittsburgh en pacientes psiquiátricos]. Gac Med Mex. (2008) 144:491–6.
26. Foa EB, Riggs DS, Dancu CV, Rothbaum BO. Reliability and validity of a brief instrument for assessing post-traumatic stress disorder. J Trauma Stress. (1993) 6:459–73. doi: 10.1002/jts.2490060405
27. Novy DM, Stanley MA, Averill P, Daza P. Psychometric comparability of English- and Spanish-language measures of anxiety and related affective symptoms. Psychol Assess. (2001) 13:347–55. doi: 10.1037/1040-3522.214.171.1247
28. Prigerson HG, Maciejewski PK, Reynolds III CF, Bierhals AJ, Newsom JT, Fasiczka A, et al. Inventory of complicated grief: a scale to measure maladaptive symptoms of loss. Psychiatry Res. (1995) 59:65–79. doi: 10.1016/0165-1781(95)02757-2
29. Limonero J, Lacasta M, Maté J, Prigerson H. Adaptation to spanish of the inventory of complicated grief (Adaptación al castellano del inventario de duelo complicado). Medicina Paliativa. (2009) 16:291–7.
30. Dominguez-Rodríguez A, Santoveña EEE, Chavez-Valdez SM, Arriaga RJM, Jiménez MJH, Valerio EB, et al. Psychometric properties of the inventory of complicated grief in Mexican community sample during COVID-19 pandemic. PsyArXiv [Preprint]. (2021). doi: 10.31234/osf.io/fh6wd.
31. World Health Organization. ICD-11 Beta Draft (Mortality and Morbidity Statistics). (2018). Available online at: https://icd.who.int/browse11/l-m/en (accessed January 16, 2022).
32. Rosnow RL, Rosenthal R. Effect sizes for experimenting psychologists. Can J Exp Psychol. (2003) 57:221–37. doi: 10.1037/h0087427
33. Eisma MC, Boelen PA, Lenferink L. Prolonged grief disorder following the Coronavirus (COVID-19) pandemic. Psychiatry Res. (2020) 288:113031. doi: 10.1016/j.psychres.2020.113031
34. Volk AA, Brazil KJ, Franklin-Luther P, Dane AV, Vaillancourt T. The influence of demographics and personality on COVID-19 coping in young adults. Pers Individ Dif. (2021) 168:110398. doi: 10.1016/j.paid.2020.110398
35. Wilson JM, Lee J, Fitzgerald HN, Oosterhoff B, Sevi B, Shook NJ. Job insecurity and financial concern during the COVID-19 pandemic are associated with worse mental health. J Occup Environ Med. (2020) 62:686–91. doi: 10.1097/JOM.0000000000001962
36. Dang H-H, Viet Nguyen C. Gender inequality during the COVID-19 pandemic: income, expenditure, savings, and job loss. World Dev. (2021) 140:105296. doi: 10.1016/j.worlddev.2020.105296
37. Almeida M, Shrestha AD, Stojanac D, Miller LJ. The impact of the COVID-19 pandemic on women's mental health. Arch Womens Ment Health. (2020) 23:741–8. doi: 10.1007/s00737-020-01092-2
38. Sediri S, Zgueb Y, Ouanes S, Ouali U, Bourgou S, Jomli R, et al. Women's mental health: acute impact of COVID-19 pandemic on domestic violence. Arch Womens Ment Health. (2020) 23:749–56. doi: 10.1007/s00737-020-01082-4
39. Owusu JT, Doty SB, Adjaye-Gbewonyo D, Bass JK, Wilcox HC, Gallo JJ, et al. Association of sleep characteristics with suicidal ideation and suicide attempt among adults aged 50 and older with depressive symptoms in low- and middle-income countries. Sleep Health. (2020) 6:92–9. doi: 10.1016/j.sleh.2019.08.009
40. Bentley KH, Franklin JC, Ribeiro JD, Kleiman EM, Fox KR, Nock MK. Anxiety and its disorders as risk factors for suicidal thoughts and behaviors: a meta-analytic review. Clin Psychol Rev. (2016) 43:30–46. doi: 10.1016/j.cpr.2015.11.008
41. DeJong TM, Overholser JC, Stockmeier CA. Apples to oranges?: a direct comparison between suicide attempters and suicide completers. J Affective Disord. (2010) 124:90–7. doi: 10.1016/j.jad.2009.10.020
42. Smith KV, Ehlers A. Prolonged grief and posttraumatic stress disorder following the loss of a significant other: an investigation of cognitive and behavioural differences. PLoS ONE. (2021) 16:e0248852. doi: 10.1371/journal.pone.0248852
43. Lundorff M, Holmgren H, Zachariae R, Farver-Vestergaard I, O'Connor M. Prevalence of prolonged grief disorder in adult bereavement: a systematic review and meta-analysis. J Affective Disord. (2017) 212:138–49. doi: 10.1016/j.jad.2017.01.030
44. Jordan AH., Litz BT. Prolonged grief disorder: diagnostic, assessment, and treatment considerations. Profess Psychol. (2014) 45:180–7. doi: 10.1037/a0036836
45. Shear M .K., Skritskaya N.A. Bereavement and anxiety. Curr Psychiatry Rep. (2012) 14:169–75. doi: 10.1007/s11920-012-0270-2
46. Eisma MC, Tamminga A, Smid GE, Boelen PA. Acute grief after deaths due to COVID-19, natural causes and unnatural causes: an empirical comparison. J Affective Disord. (2021) 278:54–6. doi: 10.1016/j.jad.2020.09.049
47. Eisma MC, Tamminga A. Grief before and during the COVID-19 pandemic: multiple group comparisons. J Pain Symptom Manage. (2020) 60:e1–4. doi: 10.1016/j.jpainsymman.2020.10.004
48. Utz RL, Caserta M, Lund D. Grief, depressive symptoms, and physical health among recently bereaved spouses. Gerontologist. (2012) 52:460–71. doi: 10.1093/geront/gnr110
49. Tang S, Xiang Z. Who suffered most after deaths due to COVID-19? Prevalence and correlates of prolonged grief disorder in COVID-19 related bereaved adults. Global Health. (2021) 17:19. doi: 10.1186/s12992-021-00669-5
50. Gupta R, Grover S, Basu A, Krishnan V, Tripathi A, Subramanyam A, et al. Changes in sleep pattern and sleep quality during COVID-19 lockdown. Indian J Psychiatry. (2020) 62:370–8. doi: 10.4103/psychiatry.IndianJPsychiatry_523_20
51. Pinto J, van Zeller M, Amorim P, Pimentel A, Dantas P, Eusébio E, et al. Sleep quality in times of Covid-19 pandemic. Sleep Med. (2020) 74:81–5. doi: 10.1016/j.sleep.2020.07.012
52. Milic J, Saavedra Perez H, Zuurbier LA, Boelen PA, Rietjens JA, Hofman A, et al. The longitudinal and cross-sectional associations of grief and complicated grief with sleep quality in older adults. Behav Sleep Med. (2019) 17:31–40. doi: 10.1080/15402002.2016.1276016
53. Szuhany KL, Young A, Mauro C, Garcia de la Garza A, Spandorfer J, Lubin R, et al. Impact of sleep on complicated grief severity and outcomes. Dep Anxiety. (2020) 37:73–80. doi: 10.1002/da.22929
54. Chodkiewicz J, Talarowska M, Miniszewska J, Nawrocka N, Bilinski P. Alcohol consumption reported during the COVID-19 pandemic: the initial stage. Int J Environ Res Public Health. (2020) 17:1–11. doi: 10.3390/ijerph17134677
55. Calina D, Hartung T, Mardare I, Mitroi M, Poulas K, Tsatsakis A, et al. COVID-19 pandemic and alcohol consumption: impacts and interconnections. Toxicol Rep. (2021) 8:529–35. doi: 10.1016/j.toxrep.2021.03.005
56. Garakani A, Murrough JW, Freire RC, Thom RP, Larkin K, Buono FD Iosifescu DV. Pharmacotherapy of anxiety disorders: current and emerging treatment options. Front Psychiatry. (2020) 11:595584. doi: 10.3389/fpsyt.2020.595584
57. Kecojevic A, Basch CH, Sullivan M, Davi NK. The impact of the COVID-19 epidemic on mental health of undergraduate students in New Jersey, cross-sectional study. PLoS ONE. (2020) 15:e0239696. doi: 10.1371/journal.pone.0239696
58. Weilenmann S, Ernst J, Petry H, Pfaltz MC, Sazpinar O, Gehrke S, et al. Health care workers' mental health during the first weeks of the SARS-CoV-2 pandemic in Switzerland—a cross-sectional study. Front Psychiatry. (2021) 12:594340. doi: 10.3389/fpsyt.2021.594340
59. Yousaf O, Popat A, Hunter MS. An investigation of masculinity attitudes, gender, and attitudes toward psychological help-seeking. Psychol Men Masc. (2015) 16:234–7. doi: 10.1037/a0036241
60. Yousaf O, Grunfeld EA, Hunter MS. A systematic review of the factors associated with delays in medical and psychological help-seeking among men. Health Psychol Rev. (2015) 9:264–76. doi: 10.1080/17437199.2013.840954
61. Tong ACY, Tsoi EWS, Mak WWS. Socioeconomic status, mental health, and workplace determinants among working adults in Hong Kong: a latent class analysis. Int J Environ Res Public Health. (2021) 18:7894. doi: 10.3390/ijerph18157894
62. Bryant RA, Gallagher HC, Gibbs L, Pattison P, MacDougall C, Harms L, et al. Mental health and social networks after disaster. Am J Psychiatry. (2017) 174:277–85. doi: 10.1176/appi.ajp.2016.15111403
Keywords: COVID-19, grief, anxiety, depression, sleep quality, post-traumatic stress, drugs, Mexico
Citation: Dominguez-Rodriguez A, Herdoiza-Arroyo PE, Martínez Arriaga RJ, Bautista Valerio E, Mateu Mollá J, de la Rosa-Gómez A, Farfallini L, Hernández Jiménez MJ, Esquivel Santoveña EE, Ramírez-Martínez FR, Castellanos Vargas RO, Arzola-Sánchez CA, Arenas-Landgrave P and Martínez-Luna SC (2022) Prevalence of Anxiety Symptoms and Associated Clinical and Sociodemographic Factors in Mexican Adults Seeking Psychological Support for Grief During the COVID-19 Pandemic: A Cross-Sectional Study. Front. Psychiatry 13:749236. doi: 10.3389/fpsyt.2022.749236
Received: 29 July 2021; Accepted: 31 January 2022;
Published: 14 March 2022.
Edited by:Fiona Maccallum, The University of Queensland, Australia
Reviewed by:Maria Picó-Pérez, University of Minho, Portugal
Kim Glickman, City University of New York, United States
Copyright © 2022 Dominguez-Rodriguez, Herdoiza-Arroyo, Martínez Arriaga, Bautista Valerio, Mateu Mollá, de la Rosa-Gómez, Farfallini, Hernández Jiménez, Esquivel Santoveña, Ramírez-Martínez, Castellanos Vargas, Arzola-Sánchez, Arenas-Landgrave and Martínez-Luna. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Paulina Erika Herdoiza-Arroyo, email@example.com