Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 17 April 2023
Sec. Health Psychology
This article is part of the Research Topic The Changed Life: How COVID-19 Affected People's Psychological Well-Being, Feelings, Thoughts, Behavior, Relations, Language and Communication View all 43 articles

When COVID-19 strikes mental health: a measurement analysis of reassurance seeking behavior scale in Peruvian population

  • 1Carrera de Psicología, Universidad Científica del Sur, Lima, Peru
  • 2Instituto Peruano de Orientación Psicológica, Lima, Peru
  • 3Universidad del Pacífico, Lima, Peru
  • 4Facultad de Medicina, Universidad Nacional de San Agustín Arequipa, Arequipa, Peru
  • 5Facultad de Ingeniería y Arquitectura, Universidad César Vallejo, Lima, Peru
  • 6Universidad San Pedro, Huacho, Peru
  • 7South American Center for Education and Research in Public Health, Universidad Privada Norbert Wiener, Lima, Peru

Background: The long-lasting impact of the COVID-19 pandemic cannot be overstated. To combat its dire consequences, some screening measures have been hastily developed and require robust verification to explore their adequacy across different groups. The present research study aimed to analyze measurement invariance by sociodemographic characteristics of the Coronavirus Reassurance Seeking Behavior Scale (CRSB) in Peruvian adults.

Methods: A total of 661 participants completed The Coronavirus Reassurance Seeking Behavior Scale (CRSB), the Coronavirus Anxiety Scale (CAS), and sociodemographic information a subgroup filled in the Patient Health Questionnaire (PHQ-9). Reliability and measurement invariance across sociodemographic characteristics were analyzed. Likewise, associations with depression and dysfunctional coronavirus anxiety were examined.

Results: Results showed that the single factor structure of the CRSB with correlated errors fitted the data adequately and the instrument was invariant across gender, age, and loss of a significant relative to COVID-19. In addition, significant associations with depressive symptoms and dysfunctional anxiety were found.

Conclusion: The findings of the present study suggest that the Coronavirus Reassurance Seeking Behaviors Scale is invariant across different sociodemographic characteristics.

1. Introduction

Since the beginning of the coronavirus disease (COVID-19) outbreak, more than 3.5 million lives have been claimed, and the number of those infected has surpassed the 168 million mark worldwide (Center for Systems Science and Engineering, 2020), reaching almost every country in the globe.

Latin America is one of the regions hit the hardest by the COVID-19 pandemic, according to estimates by international organizations such as the Economic Commission for Latin America (ECLA), the World Bank and the World Health Organization (WHO). It has resulted in the worst economic, social and productive crisis in the region of the last 120 years, in which unemployment, poverty, and inequality have increased (Economic Commission for Latin America [ECLA], 2021).

Although Latin America had sufficient time to prepare and face the pandemic, its structural conditions in the economy, housing, and health ended up making the continent a propitious place for the spread of COVID-19 (Peñafiel-Chang et al., 2020). A health system that was not prepared for such crisis, with high hospital occupancy that in some cases has reached the limit of emergency (Agencia EFE, 2020), and a difficult economic situation in the most unequal region in the world (Martí i Puig and Alcántara Sáez, 2020), are part of an explosive cocktail.

In this context, Peru made world news. In August 2020, the southern country reached its maximum peak of deaths per day from COVID-19, becoming the one with the highest mortality rate in the entire planet, according to the ranking prepared by the Coronavirus Resource Center of the Johns Hopkins University (CNN Español, 2020). With the arrival of 2021, and despite the devastating second wave in Europe, it still continues among the top ten places on that fatality podium and second in Latin America after Mexico (Alayo Orbegozo, 2021).

Among the restraint measures that some governments have adopted in order to stop or prevent the spread of the virus are: social distancing, isolation, quarantine, lockdown (Alfano and Ercolano, 2020; Lau et al., 2020; Sánchez-Villena and de La Fuente-Figuerola, 2020), banning of social, productive and economic activities, as well as the closure of borders. Some countries have even implemented a strict nationwide curfew. These measures have a detrimental impact on mental health (Yao et al., 2020; Msherghi et al., 2021; López Steinmetz et al., 2022), increasing levels of stress, depression symptomatology and anxiety (Elmer et al., 2020; Galea et al., 2020; Lima et al., 2020; Zhang and Ma, 2020; Mendoza-Ruvalcaba et al., 2022).

1.1. Impact of the pandemic on mental health

Quarantine and isolation increase the occurrence of psychological and mental problems, mainly originating from the absence of interpersonal communication. Depressive and anxiety disorders are more likely to develop or aggravate (Xiao, 2020; Zandifar and Badrfam, 2020). This propensity to display difficulties ranges from isolated symptoms to the development of a mental ailment such as insomnia, anxiety, depression, and post-traumatic stress disorder (Huremović, 2019). Likewise, in the social withdrawal in which people have been forced to restrict their mobility and reduce their social contacts to a minimum, the availability of timely psychosocial interventions and routine psychotherapeutic counseling have been drastically cutdown (Xiao, 2020).

In the context of a pandemic, it is important to consider the loss of function that can accompany the acquired disease. This in turn represents demoralization and helplessness, reaching a state of mourning (Huremović, 2019). Likewise, people subjected to the stress of the outbreak may present marked anguish and a significant deterioration in social or occupational functioning, and if they persist with a sad mood, a major depressive disorder may arise. It has been postulated that the combined effect of loss and threat may explain the frequent occurrence of depression (Styra et al., 2008).

The paralyzing fear that this disease triggers could be explained by its novelty and the uncertainty it generates (Asmundson and Taylor, 2020). The substantial number of patients and suspected infected cases raised public concern about becoming infected. This situation preconditions, to some extent, people to seek reassurance by excessive searching for news and information on COVID-19.

1.2. Reassurance seeking behavior as a vulnerable emotional distress factor

Excessive reassurance seeking is a relevant mechanism associated with the management of psychological distress. Empirical research studies have linked it to the prolongation of anxiety including generalized anxiety disorders (Beesdo-Baum et al., 2012), obsessive-compulsive disorder (Salkovskis, 1996; Salkovskis et al., 1998) and health anxiety or hypochondriasis (Taylor and Asmundson, 2004; Halldorsson and Salkovskis, 2017). It has been conceptualized as the “repeated solicitation of safety-related information from others about a threatening object, situation or interpersonal characteristic despite having already received this information” (Parrish and Radomsky, 2010).

Reassurance seeking behavior has been appointed as a vulnerability factor that enhances emotional distress during a pandemic (Lee and Crunk, 2020). Recurrent verification and reassurance seeking can ensue as a reaction to an infection risk (Taylor and Asmundson, 2004).

People with an overly excessive concern over their health are characterized by frequent medical redundant checking and reassurance seeking (Asmundson and Taylor, 2020).

One possible explanation of why people engage in excessive reassurance seeking is their lack of tolerance toward uncertainty (Taylor, 2019). In fact, some disorders are associated to high intolerance of uncertainty (Fergus et al., 2015). Those with high levels of intolerance address their uncertainty through reassurance seeking and behaviors checking (Dugas and Robichaud, 2007). One of the ways in which they do this is by searching for medical information online or asking a professional.

Continual reassurance can also be explained under the lens of maladaptive coping (Taylor, 2019). Although the pandemic has mobilized everyone to use different ways of coping to deal with this stressful situation (Voronin et al., 2020), some people may resort to use maladaptive safety behaviors (i.e., excessive hand washing, repeatedly and unnecessarily seeking reassurance in social media or from health professionals) in an attempt to relieve their stress in the short term, but failing to resolve the underlying fears and concerns, which allows the anxiety to prevail in the long term (Wheaton et al., 2012).

1.3. CRSB and associated variables

In order to understand the causes of excessive distress, reassurance seeking behaviors play an important role as a vulnerable factor to emotional distress (Taylor, 2019). As a response to the pandemic, Lee et al. (2020) have developed the Coronavirus Reassurance-Seeking Behavior Scale (CRSB) which aims to measure the recurrence of engagement in coronavirus-related reassurance seeking behaviors. The CRSB is a short 5 item scale with good psychometric properties. It has good internal consistency (α = 0.90) and a solid single factorial structure (Lee et al., 2020). Although it has been translated into some other languages like Turkish, Persian, Greek and Italian, there is no formal evaluation of its equivalence across different groups.

Its original version had a high correlation with dysfunctional coronavirus anxiety, depression, among others (Lee et al., 2020). Previous research studies have mentioned that excessive reassurance-seeking is a hallmark feature in developing and perpetuating anxiety and specifically been associated to corona phobia and health anxiety (Lee et al., 2020).

Likewise, people that are prone to have a high intolerance to uncertainty and use excessive reassurance safety behaviors are likely to have high levels of depression (Thompson et al., 2010; Taylor, 2019).

1.4. The present study

Based on the aforementioned and in response to the pandemic situation, the aim of the present study was to evaluate whether the CRSB is equivalent across some sociodemographic variables in a sample of Peruvian adults. In addition, reliability indices were inspected, and it was hypothesized that CRSB had a positive and direct relationship with depression by means of the Patient Health Questionnaire (PHQ-9) and with dysfunctional anxiety measured by the Coronavirus Anxiety Scale (CAS).

2. Materials and methods

2.1. Participants

The sample comprised 661 Peruvian adults for which cross-sectional data was collected using a snowball sampling technique mainly in urban zones of the capital, Metropolitan Lima. Participants that did not meet the inclusion criteria were filtered out. The final sample consisted of 661 participants (59% women), their age ranged from 18 to 45 (Mage = 23.5, SD = 6.2). Table 1 includes the complete sociodemographic characteristics of the participants. Some variables were re-categorized for the sake of simplicity. Additionally, some categories had very few cases. In the case of age, and following some developmental theorists (Arnett, 2000, 2015; Mehta et al., 2020) two very well distinguished groups were formed, emerging adults, which ages ranged from 18 to 29 years (Arnett, 2000) and established adults, which ages ranged from 30 to 45 years (Mehta et al., 2020). Likewise, original educational level categories were collapsed to basic education (primary and secondary) and higher education (university studies onward) supported by the Peruvian educational structure and the Peruvian General Education Law (2003).

TABLE 1
www.frontiersin.org

Table 1. Sociodemographic characteristics of the Peruvian sample (n = 661).

2.2. Measures

2.2.1. Sociodemographic information

Participants were requested to state a number of background variables among the most important: gender, age, number of children, educational level, whether the participant have or have had the diagnosis of COVID-19 and whether they have lost a significant relative due to COVID-19.

2.2.2. Coronavirus reassurance-seeking behavior scale

The CRBS (Lee et al., 2020) is a self-reported scale that looks to evaluate reassurance-seeking behaviors related to preoccupations over coronavirus infection. It consists of 5 items through which participants indicate how often they got engaged in reassurance-seeking behaviors (e.g., “I spoke with a medical professional about my symptoms to see if I was infected with the coronavirus disease”) in the last 2 weeks. Items are rated on a five-point Likert scale, ranging from “not at all” (0 scores) to nearly every day over the last 2 weeks (4 scores). The total score of the CRBS can range from 0 to 20. In the present study, internal consistency coefficients were adequate (α = 0.89, ω = 0.9).

2.2.3. Patient health questionnaire

The PHQ-9 (Spitzer, 1999) is a brief self-administered questionnaire and consists of nine items assessing depressive symptoms (e.g., “Thought that you would be better off dead, or of hurting yourself”). Participants rated the frequency of their answers in the last 2 weeks on a 4-point Likert scale ranging from “not at all” (0 scores) to “nearly every day” (3 scores). The adapted Peruvian version of the PHQ-9 (Calderón et al., 2012) was used, and has good evidence of validity supporting one dimension factor structure (Villarreal-Zegarra et al., 2019). The total score of the PHQ-9 can range from 0 to 27. Cut-off points of 0–4 (none), 5–9 (mild), 10–14 (moderate), 15–19 (moderately severe), and 20 to more (severe depression) (Kroenke et al., 2001). In the present study, internal consistency Cronbach’s alpha coefficient was excellent (α = 0.92).

2.2.4. Coronavirus anxiety scale

The CAS (Lee, 2020) is a self-rated instrument and consists of five items evaluating dysfunctional anxiety over the coronavirus. Participants indicated how frequently they experience each activity over the last 2 weeks on a five-point Likert scale, ranging from “not at all” (0) to “nearly every day over the last 2 weeks” (4). Previous empirical studies have demonstrated good psychometric properties of this brief tool in different languages: Korean (Choi et al., 2020), Turkish (Evren et al., 2020), Bangla (Ahmed et al., 2020). The validated Peruvian version of the CAS was used with satisfactory evidence of validity (Caycho-Rodríguez et al., 2020). In the present study, the internal consistency Cronbach’s alpha coefficient was adequate (α = 0.85).

2.3. Procedure

An institutional review board (i.e., The Research Committee of San Pedro University), provided ethical approval for conducting the research study. Participants gave their consent virtually before starting the evaluation. The evaluation was anonymous, voluntary and confidential, so the study did not represent any ethical risk to the participants. Moreover, contact information from the research team was provided in case of questions, doubts, or any additional information the participants required, during or at the end of the study.

For some instruments, the validated local versions were used and for foreign tools a translation from English to Spanish was made, followed by a back translation to assure linguistic equivalence of the instruments.

A set of self-rated questionnaires and socio-demographic information was completed by Peruvians from the general population. Participants completed the survey remotely (i.e., through an online platform) in which a link was enabled and disseminated on different social media sites. Informed consent was required. Participants were told about the anonymous nature of the research, that they could withdraw from the survey at any time without further explanation and that the information would be treated as confidential as possible for research purposes.

2.4. Data analysis

Evidence of internal structure validity was evaluated using confirmatory factor analysis. Maximum Likelihood with Robust standard errors (MLR) method was used, which is suitable when the number of response categories for each item is equal to or greater than five (Rigdon, 1998; Raykov, 2012). Accordingly, a set of goodness-of-fit indices were used: Comparative Fit Index (CFI) and Tucker-Lewis Index (TLI), which define adequate values as those > 0.90; the Standardized Root Mean-Square (SRMR); and the Root Mean Square Error of Approximation (RMSEA), where values <0.080 are considered adequate (Keith, 2014). Likewise, goodness-of-fit indices of the model with correlated errors were evaluated.

Additionally, a stepwise Multi-Group Confirmatory Factor Analysis (MGCFA) was used to assess nested models with progressive restrictions in the gender group. Initially, we set a base or configural model. Based on this, we added restrictions at the level of factor loadings (weak model). A non-substantial discrepancy between the two models indicates weak invariance (configural model vs. weak model). We then evaluate the strong model with restrictions at the level of factor loadings and intercepts. We then, compare both models (weak model vs. strong model). We considered a non-substantial variation in each of the previous steps described if the difference was ΔCFI < 0.010 and ΔRMSEA < 0.015 or ΔSRMR < 0.005 (Chen, 2007; Putnick and Bornstein, 2016). Associations between the CRBS and the PHQ-9 and CAS were conducted by means of Pearson’s correlation analysis. We expected a positive correlation of the CRBS with the two variables. Finally, omega (ω) internal consistency coefficients were calculated. Values greater than 0.80 were considered optimal (McDonald, 1999).

All analyses were performed using Lavaan package, Version 0.6-12 (Rosseel, 2012) in R program (Version 4.2.1). The R script is attached as Supplementary material.

3. Results

3.1. Factor structure

A confirmatory factor analysis was conducted to assess the original single factor structure in a sample of Peruvian adults. The original factor structure (model 1) yielded a poor fit. Modification indices suggested adding covariance error variance for item 2 and item 3. Therefore, model 2 was run following an adjusted model that considered these correlated errors. Optimal values for the fit indices were identified, and an adequate fit for the RMSEA index value were found (see Table 2). Theoretically, items 2 and 3 are closely related to each other and both refer to the search for information on COVID-19. Subsequent analyses were performed using this model. The standardized factor loadings of model 2 are presented in Table 3.

TABLE 2
www.frontiersin.org

Table 2. Goodness-of-fit indices for the models evaluated of CRSB.

TABLE 3
www.frontiersin.org

Table 3. Standardized factor loadings of the confirmatory factor analysis for the final model.

3.2. Measurement invariance

We conducted a multi-group factor analysis, imposing progressive restrictions on structure (configural), factor loadings (weak), intercepts (strong), and residuals (strict) for all models. We found good fit indices in all cases, except in the educational level group for the configural model, which presented RMSEA somewhat above the cutoff. Measurement invariance was analyzed by gender (women and men), age (emerging adults, established adults), educational level (basic education, higher education) and loss of a significant relative (yes, no) (see Table 4). Our study found that the difference in CFI between models (configural vs weak, and weak vs strong) for all groups tested was small, ΔCFI < 0.010, and at least ΔRMSEA or ΔSRMR satisfying the cutoff for measurement invariance, with the exception of educational level. In the case of the male and female groups, the difference between strong and strict invariance was significant. On account of no straightforward interpretation for strict invariance, it was considered that there was a satisfying level of invariance to allow comparisons between males and females. So, measurement invariance was found by gender at the strong level. Similarly, results show measurement invariance by age and loss of significant relative to COVID-19 groups at the strict level.

TABLE 4
www.frontiersin.org

Table 4. Measurement invariance of the Coronavirus Reassurance Seeking Behavior Scale across groups.

3.3. Relationship with other variables

Correlation analyses was conducted with latent variables in the model. Results showed that the Coronavirus Reassurance-Seeking Behaviors latent factor correlated directly and significantly with the Coronavirus Anxiety latent factor, r = 0.66, p < 0.001. Furthermore, the CRSB correlated directly and significantly with the Depression symptoms latent factor, r = 0.23, p = 0.019.

3.4. Reliability

Internal consistency by means of omega coefficient were calculated for the best fitting model (model 2). Thus, coefficient presented optimal levels of internal consistency, ω = 0.86.

4. Discussion

We have increasing evidence that the COVID-19 pandemic eroded the mental health of millions of individuals. Different stressors associated to the outbreak such as lockdown, isolation, financial anguish, physical and social distancing, fear of contagion, concern for family and friends, and uncertainty increase the levels of maladaptive behaviors, as well as the onset of mental disorders such as anxiety, post-traumatic stress, or depression (Huremović, 2019; Taylor, 2019). The main objective of the present research study was to evaluate the measurement invariance of the Coronavirus Reassurance Seeking Behavior Scale (CRSB) across different sociodemographic variables in a sample of Peruvian adults. First, we tested the internal structure of the CRSB. Results shed light on a single factor structure of the CRSB from the original English version developed by Lee et al. (2020) in which it was necessary to add an item error covariance. Thus, two models were evaluated to better understand the factorial structure of the CRSB. The complete 5 item- scale model, and the model with correlated errors in items 2 and 3. Reliability was calculated by means of omega’s coefficient guaranteeing adequate levels of internal consistency.

In evaluating the model fit, the modification indices suggest establishing the covariance between the errors of item 2 (“I read information on the internet to see if I had coronavirus symptoms”) and item 3 (“I read or watched videos to see if was infected with the coronavirus”). The content analysis of these two items represents for the individual the emphasis on evaluating their information seeking activity on the coronavirus issue. The first item analyses the individual’s exploration on the Internet, while the second item inspects the action of reading or watching videos. In the foregoing, it is important to realize that currently the reading and watching at audiovisual material is carried out primarily through the Internet. This would result in a redundancy of these two indicators. Consequently, in this study we also present and explore the error covariance model, which in future studies or replications could motivate an adjustment in the content of any of these items.

Secondly, although previous research studies have examined the importance of the psychometric properties of the scale, it has not yet been investigated whether the scale might vary in different groups. In this sense, measurement invariance across gender was supported. This shows the first evidence of the absence of measurement bias of the CRSB, as being equally accurate for both men and women (Dimitrov, 2010). The study confirmed, through configural, weak and strong invariance, that the one-dimensional structure in both subsamples shows acceptable fit values, concluding that it provided the bare minimum necessary for a meaningful interpretation of group mean contrasts.

Moreover, results suggest the equivalence of measurement of the scale across age groups. The models (emerging adults and established adults) are equivalent in their factorial loads and intercepts. Thus, the evidence indicates that the one-dimensional model with correlated errors has attributes that make it solid and robust to differences between young and established adults, showing that the reassurance seeking behavior construct is understood in the same way across groups. Similar results were obtained regarding the group that had lost someone important through COVID-19 and those who had not. In general, our results lead to establish that population-based norms are applicable to various subgroups (i.e., gender, age, loss of significant other, etc.).

Third, regarding associations with other variables, reassurance seeking behavior was positively related to anxiety. According to previous research studies (Taylor, 2019), many people are susceptible to develop anxiety and responses such as compulsive checking and reassurance-seeking regarding potential threats.

Excessive reassurance seeking behavior has been characterized as a mechanism that plays a core role in managing psychological distress. It has been associated to anxiety and perceived general threats. In this scenario, reassurance seeking behaviors sought to immediately reduce anxiety and avoid hazardous perceived situations, episodes, or stimuli. However, it is paradoxically followed by a compulsive checking seeking response over time, perpetuating anxiety (Abramowitz et al., 2002). The study of Lee et al. (2020) revealed that reassurance seeking was highly associated to anxiety related to the COVID-19 pandemic. People that have an excessive triggered response of fear of becoming infected with the virus are prone to look for reassurance that they are not afflicted.

People with anxiety indulge in reassurance seeking behavior, hoping to minimize their feelings of uncertainty. Reassurance seeking behavior is recognized as a form of intolerance toward uncertainty, leading to higher levels of worry. This behavior is associated with pathological anxiety and has contributed to the field of generalized anxiety disorders (Dugas et al., 2001).

Concerning the depression variable, it was significantly related to reassurance seeking behavior. Although reassurance-seeking alleviates worry and uncertainty in the short term, it also prolongs depression in the long term (Joiner et al., 1999). It has been reported that if highly reassurance-seeking people perceive a negative valuation of themselves, they will begin to show depressive symptomatology.

Reassurance seeking behavior has been coined as a vulnerable factor for psychopathology, with anxiety and depression as its most common manifestations (Taylor, 2019).

Contradictory to the previous literature and foregoing research studies, Lee and Cruck (Lee and Crunk, 2020) could not find significant results of reassurance seeking as a predictor of depression. It is more likely that the PHQ-4 used with only two items measuring depression may not be sensitive enough to find significant results. However, in the present study, we can confirm a significant relationship between reassurance seeking behavior and depression, albeit with a small effect. It is important to address this issue because the prevalence of depression has increased sevenfold since the COVID-19 outbreak (Bueno-Notivol et al., 2021; Villarreal-Zegarra et al., 2023).

National, as well as international Public Health institutions are advised to address the state of general public mental health, in order to improve the wellbeing of citizens.

5. Limitations and conclusion

Although these findings are promising, there are some limitations worth mentioning. First, the sampling method was chosen by convenience in an effort to deal with time constraints and limited resources. In this sense, as the sample selection is not random, it is not possible to reach generalizations of the results. Future studies should use a probabilistic sample involving different regions of the country to have more accurate and categorical conclusions. Second, the study was based on self-report measures which might have some bias associated to social desirability or memory- related effects. It is recommended that studies also use other methodological strategies such as a qualitative approach (i.e., in depth interviews). Third, for the depression variable, we obtained a smaller sample size since not all participants chose to respond to this scale, possibly because it was located at the end of the survey and the answer option was left free due to the length of the entire survey. Although results yielded a significant relationship with reassurance seeking behavior, a small effect size was found.

Regardless of the shortcomings of the present study, the Coronavirus Reassurance Seeking Behaviors Scale has good psychometric properties. It can be used as a potential screening tool to identify people vulnerable to experience anxiety related to the novel coronavirus disease.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by the Research Committee of San Pedro University. The participants provided their written informed consent to participate in this study.

Author contributions

DM-M conceptualized the study, did the project administration, and study design. DM-M, DV-Z, RC-B, and JG-S prepared the methodology and formal analysis. DM-M, NF-R, DL-A, and GP-Q collected the data. DV-Z and JG-S did data curation. DM-M wrote the first draft of the manuscript. All authors contributed to the article and approved the submitted version.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1132804/full#supplementary-material

References

Abramowitz, J. S., Franklin, M. E., Zoellner, L. A., and Dibernardo, C. L. (2002). Treatment compliance and outcome in obsessive-compulsive disorder. Behav. Modif. 26, 447–463. doi: 10.1177/0145445502026004001

PubMed Abstract | CrossRef Full Text | Google Scholar

Agencia EFE (2020). Latin America, the region most affected by COVID-19 and far from controlling it. Gestión. Burgos: Agencia EFE.

Google Scholar

Ahmed, O., Faisal, R. A., Sharker, T., Lee, S. A., and Jobe, M. C. (2020). Adaptation of the Bangla version of the COVID-19 anxiety scale. Int. J. Ment. Health Addict. 20, 284–295. doi: 10.1007/s11469-020-00357-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Alayo Orbegozo, F. (2021). Peru continues among the 10 countries with the highest mortality from coronavirus worldwide. Lima: El Comercio.

Google Scholar

Alfano, V., and Ercolano, S. (2020). The efficacy of lockdown against COVID-19: A cross-country panel analysis. Appl. Health Econ. Health Policy 18, 509–517. doi: 10.1007/s40258-020-00596-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Arnett, J. J. (2000). Emerging adulthood: A theory of development from the late teens through the twenties. Am. Psychol. 55, 469–480. doi: 10.1037/0003-066x.55.5.469

CrossRef Full Text | Google Scholar

Arnett, J. J. (2015). Emerging adulthood: The winding road from the late teens through the twenties, 2nd Edn. Oxford: Oxford University Press. doi: 10.1093/oxfordhb/9780199795574.013.9

CrossRef Full Text | Google Scholar

Asmundson, G. J. G., and Taylor, S. (2020). Coronaphobia: Fear and the 2019-nCoV outbreak. J. Anxiety Disord. 70:102196. doi: 10.1016/j.janxdis.2020.102196

PubMed Abstract | CrossRef Full Text | Google Scholar

Beesdo-Baum, K., Jenjahn, E., Höfler, M., Lueken, U., Becker, E. S., and Hoyer, J. (2012). Avoidance, safety behavior, and reassurance seeking in generalized anxiety disorder. Depress. Anxiety 29, 948–957. doi: 10.1002/da.21955

PubMed Abstract | CrossRef Full Text | Google Scholar

Bueno-Notivol, J., Gracia-García, P., Olaya, B., Lasheras, I., López-Antón, R., and Santabárbara, J. (2021). Prevalence of depression during the COVID-19 outbreak: A meta-analysis of community-based studies. Int. J. Clin. Health Psychol. 21:100196. doi: 10.1016/j.ijchp.2020.07.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Calderón, M., Gálvez-Buccollini, J. A., Cueva, G., Ordoñez, C., Bromley, C., and Fiestas, F. (2012). Validación de la versión peruana del PHQ-9 para el diagnóstico de depresión. Rev. Peruana Med. Exp. Salud Pública 29, 578–579. doi: 10.1590/S1726-46342012000400027

PubMed Abstract | CrossRef Full Text | Google Scholar

Caycho-Rodríguez, T., Barboza-Palomino, M., Ventura-León, J., Carbajal-León, C., Noé-Grijalva, M., Gallegos, M., et al. (2020). Traducción al español y validación de una medida breve de ansiedad por la COVID-19 en estudiantes de ciencias de la salud. Ansiedad Estrés 26, 174–180. doi: 10.1016/j.anyes.2020.08.001

CrossRef Full Text | Google Scholar

Center for Systems Science and Engineering (2020). Coronavirus COVID-19 global cases at Johns Hopkins university. Baltimore, MD: Johns Hopkins University.

Google Scholar

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Model. 14, 464–504. doi: 10.1080/10705510701301834

CrossRef Full Text | Google Scholar

Choi, E., Lee, J., and Lee, S. A. (2020). Validation of the Korean version of the obsession with COVID-19 scale and the coronavirus anxiety scale. Death Stud. 46, 608–614. doi: 10.1080/07481187.2020.1833383

PubMed Abstract | CrossRef Full Text | Google Scholar

CNN Español (2020). These are the countries with the most deaths from Covid-19 per 100,000 inhabitants. Available online at: https://cnnespanol.cnn.com/ 2020/09/07/estos-son-los-paises-con-mas-muertes-por-covid-19-por-cada-100-000-habitantes/#0 (accessed September 7, 2020).

Google Scholar

Dimitrov, D. M. (2010). Testing for factorial invariance in the context of construct validation. Meas. Eval. Couns. Dev. 43, 121–149. doi: 10.1177/0748175610373459

CrossRef Full Text | Google Scholar

Dugas, M. J., and Robichaud, M. (2007). Cognitive-behavioral treatment for generalized anxiety disorder: From science to practice. Milton Park: Routledge.

Google Scholar

Dugas, M. J., Gosselin, P., and Ladouceur, R. (2001). Intolerance of uncertainty and worry: Investigating specificity in a nonclinical sample. Cogn. Ther. Res. 25, 551–558. doi: 10.1023/A:1005553414688

CrossRef Full Text | Google Scholar

Economic Commission for Latin America [ECLA] (2021). Balance preliminar de las economías de américa Latina y el caribe, 2020. New York, NY: United Nations. doi: 10.18356/9789210047494

CrossRef Full Text | Google Scholar

Elmer, T., Mepham, K., and Stadtfeld, C. (2020). Students under lockdown: Comparisons of students’ social networks and mental health before and during the COVID-19 crisis in Switzerland. PLoS One 15:e0236337. doi: 10.1371/journal.pone.0236337

PubMed Abstract | CrossRef Full Text | Google Scholar

Evren, C., Evren, B., Dalbudak, E., Topcu, M., and Kutlu, N. (2020). Measuring anxiety related to COVID-19: A Turkish validation study of the coronavirus anxiety scale. Death Stud. 46, 1052–1058. doi: 10.1080/07481187.2020.1774969

PubMed Abstract | CrossRef Full Text | Google Scholar

Fergus, T. A., Bardeen, J. R., and Orcutt, H. K. (2015). Examining the specific facets of distress tolerance that are relevant to health anxiety. J. Cogn. Psychother. 29, 32–44. doi: 10.1891/0889-8391.29.1.32

PubMed Abstract | CrossRef Full Text | Google Scholar

Galea, S., Merchant, R. M., and Lurie, N. (2020). The mental health consequences of COVID-19 and physical distancing. JAMA Intern. Med. 180:817. doi: 10.1001/jamainternmed.2020.1562

PubMed Abstract | CrossRef Full Text | Google Scholar

General Education Law, (2003). Ley general de educación ley N° 28044. Lima: Congreso de la República.

Google Scholar

Halldorsson, B., and Salkovskis, P. M. (2017). Why do people with OCD and health anxiety seek reassurance excessively? An investigation of differences and similarities in function. Cogn. Ther. Res. 41, 619–631. doi: 10.1007/s10608-016-9826-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Huremović, D. (2019). Psychiatry of pandemics: A mental health response to infection outbreak. Berlin: Springer Nature. doi: 10.1007/978-3-030-15346-5

CrossRef Full Text | Google Scholar

Joiner, T. E., Metalsky, G. I., Katz, J., and Beach, S. R. H. (1999). Depression and excessive reassurance-seeking. Psychol. Inq. 10, 269–278. doi: 10.1207/S15327965PLI1004_1

CrossRef Full Text | Google Scholar

Keith, T. Z. (2014). Multiple regression and beyond: An introduction to multiple regression and structural equation modeling, 2nd Edn. Milton Park: Routledge. doi: 10.4324/9781315749099

PubMed Abstract | CrossRef Full Text | Google Scholar

Kroenke, K., Spitzer, R. L., and Williams, J. B. W. (2001). The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 16, 606–613. doi: 10.1046/j.1525-1497.2001.016009606.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Lau, H., Khosrawipour, V., Kocbach, P., Mikolajczyk, A., Schubert, J., Bania, J., et al. (2020). The positive impact of lockdown in Wuhan on containing the COVID-19 outbreak in China. J. Travel Med. 27:taaa037. doi: 10.1093/jtm/taaa037

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, S. A. (2020). Coronavirus anxiety scale: A brief mental health screener for COVID-19 related anxiety. Death Stud. 44, 393–401. doi: 10.1080/07481187.2020.1748481

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, S. A., and Crunk, E. A. (2020). Fear and psychopathology during the COVID-19 crisis: Neuroticism, hypochondriasis, reassurance-seeking, and coronaphobia as fear factors. Omega 85, 483–496. doi: 10.1177/0030222820949350

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, S. A., Jobe, M. C., Mathis, A. A., and Gibbons, J. A. (2020). Incremental validity of coronaphobia: Coronavirus anxiety explains depression, generalized anxiety, and death anxiety. J. Anxiety Disord. 74:102268. doi: 10.1016/j.janxdis.2020.102268

PubMed Abstract | CrossRef Full Text | Google Scholar

Lima, C. K. T., Carvalho, P. M., de, M., Lima, I., de, A. A. S., Nunes, J. V. A., et al. (2020). The emotional impact of coronavirus 2019-nCoV (new coronavirus disease). Psychiatry Res. 287:112915. doi: 10.1016/j.psychres.2020.112915

PubMed Abstract | CrossRef Full Text | Google Scholar

López Steinmetz, L. C., Dutto Florio, M. A., Leyes, C. A., Fong, S. B., Rigalli, A., and Godoy, J. C. (2022). Levels and predictors of depression, anxiety, and suicidal risk during COVID-19 pandemic in Argentina: The impacts of quarantine extensions on mental health state. Psychol. Health Med. 27, 13–29. doi: 10.1080/13548506.2020.1867318

PubMed Abstract | CrossRef Full Text | Google Scholar

Martí i Puig, S., and Alcántara Sáez, M. (2020). Política y crisis en América Latina reacción e impacto frente a la Covid-19. Cátedra de cultural jurídica marcial pons. Madrid: Marcial Pons, Ediciones Jurídicas y Sociales.

Google Scholar

McDonald, R. P. (1999). Test theory: A unified treatment. Milton Park: Taylor & Francis Group.

Google Scholar

Mehta, C. M., Arnett, J. J., Palmer, C. G., and Nelson, L. J. (2020). Established adulthood: A new conception of ages 30 to 45. Am. Psychol. 75, 431–444. doi: 10.1037/amp0000600

PubMed Abstract | CrossRef Full Text | Google Scholar

Mendoza-Ruvalcaba, N. M., Gutiérrez-Herrera, R., López, C., Hesse, H., Soto-Añari, M., Ramos-Henderson, M., et al. (2022). Impact of quarantine due to COVID-19 pandemic on health and lifestyle conditions in older adults from Centro American countries. PLoS One 17:e0264087. doi: 10.1371/journal.pone.0264087

PubMed Abstract | CrossRef Full Text | Google Scholar

Msherghi, A., Alsuyihili, A., Alsoufi, A., Ashini, A., Alkshik, Z., Alshareea, E., et al. (2021). Mental health consequences of lockdown during the COVID-19 pandemic: A cross-sectional study. Front. Psychol. 12:605279. doi: 10.3389/fpsyg.2021.605279

PubMed Abstract | CrossRef Full Text | Google Scholar

Parrish, C. L., and Radomsky, A. S. (2010). Why do people seek reassurance and check repeatedly? An investigation of factors involved in compulsive behavior in OCD and depression. J. Anxiety Disord. 24, 211–222. doi: 10.1016/j.janxdis.2009.10.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Peñafiel-Chang, L., Camelli, G., and Peñafiel-Chang, P. (2020). Pandemia Pandemia COVID-19: Situación política - económica y consecuencias sanitarias en América Latina. Ciencia Unemi 13, 120–128. doi: 10.29076/issn.2528-7737vol13iss33.2020pp120-128p

CrossRef Full Text | Google Scholar

Putnick, D. L., and Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Dev. Rev. 41, 71–90. doi: 10.1016/j.dr.2016.06.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Raykov, T. (2012). “Scale construction and development using structural equation modeling,” in Handbook of structural equation modeling, ed. R. H. Hoyle (New York, NY: Guildford Press), 472–492.

Google Scholar

Rigdon, E. E. (1998). “Structural equation modeling,” in Modern methods for business research, ed. G. A. Marcoulides (Mahwah, NJ: Erlbaum), 251–294.

Google Scholar

Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. J. Stat. Softw. 48, 1–93. doi: 10.18637/jss.v048.i02

CrossRef Full Text | Google Scholar

Salkovskis, P. M. (Ed.) (1996). “Avoidance behaviour is motivated by threat beliefs: A possible resolution of the cognition-behaviour debate,” in Trends in cognitive and behavioural therapies, (Hoboken, NJ: John Wiley and Sons), 25–42.

Google Scholar

Salkovskis, P. M., Forrester, E., Richards, H. C., and Morrison, N. (1998). in Treating complex cases: The CBT approach, eds G. Tarrier, N. Wells, and A. Haddock (Hoboken, NJ: Wiley and Sons).

Google Scholar

Sánchez-Villena, A. R., and de La Fuente-Figuerola, V. (2020). COVID-19: Cuarentena, aislamiento, distanciamiento social y confinamiento, >son lo mismo? An. Pediatr. 93, 73–74. doi: 10.1016/j.anpedi.2020.05.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Spitzer, R. L. (1999). Validation and utility of a self-report version of PRIME-MD:The PHQ primary care study. JAMA 282:1737. doi: 10.1001/jama.282.18.1737

PubMed Abstract | CrossRef Full Text | Google Scholar

Styra, R., Hawryluck, L., Robinson, S., Kasapinovic, S., Fones, C., and Gold, W. L. (2008). Impact on health care workers employed in high-risk areas during the Toronto SARS outbreak. J. Psychosom. Res. 64, 177–183. doi: 10.1016/j.jpsychores.2007.07.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Taylor, S. (2019). The psychology of pandemics. Newcastle upon Tyne: Cambridge Scholars Publishing.

Google Scholar

Taylor, S., and Asmundson, G. S. (2004). Treating health anxiety: A cognitive-behavioral approach. New York, NY: The Guilford Press.

Google Scholar

Thompson, R. J., Mata, J., Jaeggi, S. M., Buschkuehl, M., Jonides, J., and Gotlib, I. H. (2010). Maladaptive coping, adaptive coping, and depressive symptoms: Variations across age and depressive state. Behav. Res. Ther. 48, 459–466. doi: 10.1016/j.brat.2010.01.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Villarreal-Zegarra, D., Copez-Lonzoy, A., Bernabé-Ortiz, A., Melendez-Torres, G. J., and Bazo-Alvarez, J. C. (2019). Valid group comparisons can be made with the patient health questionnaire (PHQ-9): A measurement invariance study across groups by demographic characteristics. PLoS One 14:e0221717. doi: 10.1371/journal.pone.0221717

PubMed Abstract | CrossRef Full Text | Google Scholar

Villarreal-Zegarra, D., Reátegui-Rivera, C. M., Otazú-Alfaro, S., Yantas-Alcantara, G., Soto-Becerra, P., and Melendez-Torres, G. J. (2023). Estimated impact of the COVID-19 pandemic on the prevalence and treatment of depressive symptoms in Peru: An interrupted time series analysis in 2014-2021. Soc. Psychiatry Psychiatr. Epidemiol. 1–11. doi: 10.1007/s00127-023-02446-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Voronin, I. A., Manrique-Millones, D., Vasin, G. M., Millones-Rivalles, R. B., Manrique-Pino, O., Fernandez-Rios, N., et al. (2020). Coping responses during the COVID-19 pandemic: A cross-cultural comparison of Russia, Kyrgyzstan, and Peru. Psychol. Russia 13, 55–74. doi: 10.11621/PIR.2020.0404

CrossRef Full Text | Google Scholar

Wheaton, M. G., Abramowitz, J. S., Berman, N. C., Fabricant, L. E., and Olatunji, B. O. (2012). Psychological predictors of anxiety in response to the H1N1 (Swine Flu) pandemic. Cogn. Ther. Res. 36, 210–218. doi: 10.1007/s10608-011-9353-3

CrossRef Full Text | Google Scholar

Xiao, C. (2020). A novel approach of consultation on 2019 novel coronavirus (COVID-19)-related psychological and mental problems: Structured letter therapy. Psychiatry Invest. 17, 175–176. doi: 10.30773/pi.2020.0047

PubMed Abstract | CrossRef Full Text | Google Scholar

Yao, H., Chen, J.-H., and Xu, Y.-F. (2020). Patients with mental health disorders in the COVID-19 epidemic. Lancet Psychiatry 7:e21. doi: 10.1016/S2215-0366(20)30090-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Zandifar, A., and Badrfam, R. (2020). Iranian mental health during the COVID-19 epidemic. Asian J. Psychiatry 51:101990. doi: 10.1016/j.ajp.2020.101990

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, Y., and Ma, Z. F. (2020). Impact of the COVID-19 pandemic on mental health and quality of life among local residents in Liaoning province, China: A cross-sectional study. Int. J. Environ. Res. Public Health 17:2381. doi: 10.3390/ijerph17072381

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: measurement invariance, Peru, COVID-19, anxiety, depression, reassurance seeking behavior

Citation: Manrique-Millones D, García-Serna J, Castillo-Blanco R, Fernández-Ríos N, Lizarzaburu-Aguinaga DA, Parihuamán-Quinde GR and Villarreal-Zegarra D (2023) When COVID-19 strikes mental health: a measurement analysis of reassurance seeking behavior scale in Peruvian population. Front. Psychol. 14:1132804. doi: 10.3389/fpsyg.2023.1132804

Received: 27 December 2022; Accepted: 30 March 2023;
Published: 17 April 2023.

Edited by:

Morena Muzi, University of Macerata, Italy

Reviewed by:

Delia Stefenel, Lucian Blaga University of Sibiu, Romania
Alejandra Dominguez Espinosa, Ibero American University, Mexico

Copyright © 2023 Manrique-Millones, García-Serna, Castillo-Blanco, Fernández-Ríos, Lizarzaburu-Aguinaga, Parihuamán-Quinde and Villarreal-Zegarra. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Denisse Manrique-Millones, dmanrique@cientifica.edu.pe

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.