- 1Department of Psychology, Health and Technology, University of Twente, Enschede, Netherlands
- 2Faculty of Medicine, Health and Life Sciences, School of Psychology, Universidad Internacional del Ecuador, Quito, Ecuador
- 3School of Medicine and Health Sciences, Tecnologico de Monterrey, Guadalajara, Mexico
- 4Departamento de Clínicas de Salud Mental, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara, Mexico
- 5Instituto Peruano de Orientación Psicológica, Lima, Peru
- 6Escuela de Psicología, Universidad Continental, Lima, Peru
- 7Federal University of Bahia, Salvador, Brazil
- 8Departamento de Ciencias del Comportamiento, Centro Universitario de los Valles, Universidad de Guadalajara, Ameca, Mexico
- 9Departamento de Psicología Social, Universitat de València, Valencia, Spain
- 10Independent researcher, São Paulo, Brazil
- 11Health Sciences Area, Valencian International University, Valencia, Spain
- 12Rectory, Autonomous University of Ciudad Juarez, Juarez, Mexico
- 13Plan estratégico de Juarez, Juarez, Mexico
- 14Department of Psychology, European University of Valencia, Valencia, Spain
- 15Department of Nursing and Physiotherapy, University of Lleida, Lleida, Spain
- 16Faculty of Psychology and Humanities, University San Sebastián, Valdivia, Chile
- 17Millennium Nucleus to Improve the Mental Health of Adolescents and Youths, Imhay, Santiago, Chile
- 18School of Psychology, University Adolfo Ibañez, Santiago, Chile
- 19Health Sciences Department, Autonomous University of Ciudad Juarez, Juarez, Mexico
Background: Online psychological interventions have emerged as a treatment alternative because they are accessible, flexible, personalized, and available to large populations. The number of Internet interventions in Latin America is limited, as are Randomized Controlled Trials (RCTs) of their effectiveness and a few studies comparing their effectiveness in multiple countries at the same time. We have developed an online intervention, Well-being Online, which will be available to the public free of charge in 7 countries: Mexico, Ecuador, Peru, Chile, Brazil, Spain, and the Netherlands. We expect a reduction in depression and anxiety symptoms and an increase in well-being of the participants.
Methods: A multi-country, randomized controlled trial will be conducted. The intervention is multicomponent (Cognitive Behavioral Therapy, Behavioral Activation Therapy, Mindfulness, Acceptance and Commitment Therapy, and Positive Psychology), with 10 sessions. In each country, eligible participants will be randomized to one of three groups: Enriched Intervention (interactive web design with videos, infographics, text, audio, and forum), Text Intervention (text on the website), and Wait List (control group). Repeated measures will be obtained at 5-time points. Our primary outcomes will be anxiety symptomatology, depressive symptomatology, and mental well-being. MANOVA analysis will be used for our main analysis.
Discussion: This protocol describes the design of a randomized trial to evaluate the efficacy of a web-based intervention to reduce anxiety and depression symptomatology and increase subjective well-being. The intervention will be made available in four languages (Spanish, Portuguese, Dutch, and English). Its results will contribute to the evidence of effectiveness in terms of randomized trials and Internet interventions, mainly in Latin America and Europe.
1 Introduction
The World Health Organization (WHO) estimated that the worldwide proportion of people with depression and anxiety disorders was 4.4% and 3.6%, respectively (WHO, 2017). Anxiety and depression are as prevalent in Latin America as in other countries in the world, but access to mental health care is very limited (Pan American Health Organization, 2018). Table 1 provides an impression of how the prevalence of depression and anxiety disorders is distributed in Latin America compared to some European countries. These data suggest that depression and anxiety are as prevalent in Latin America as in European countries such as Spain and the Netherlands. In addition, due to the recent COVID-19 pandemic, these problems may have worsened (Vindegaard and Benros, 2020). Furthermore, despite previous studies reported online interventions focused mainly on developed countries, it is observed that the psychological symptoms, regardless of the country, are similar. For example, the study of Hernández-Posadas et al. (2024), which included a sample of Dutch and Mexican participants, observed similar results regarding the relationship between intolerance of uncertainty, emotional dysregulation, rumination, depression, and post-traumatic stress symptoms. However, studies like this are scarce, and more are needed.
Table 1. Prevalence of depression and anxiety in several Latin American and European countries (WHO, 2017).
By contrast, the availability of mental health care across the world shows a different pattern. The WHO Mental Health Atlas (WHO, 2021) estimated that the median number of healthcare workers per 100,000 population is 3.4, but large differences exist across the world. Europe has a median of 12.5 workers per 100,000 inhabitants, and the Americas (including the USA) of 8.6. Likewise, the number of mental hospital facilities, beds, and admissions per 100,000 population are all about 5 times as high in Europe compared to the Americas (WHO, 2021). Recent estimations suggest that the treatment gap in Latin America is big, with almost 80% of people with depressive symptoms not receiving help at all (Pan American Health Organization, 2018). In sum, it seems that the prevalence of depression and anxiety in Latin America and Europe is roughly the same, but unfortunately, this is not matched by the availability and hence accessibility to mental health care. Anxiety and depression symptomatology are often comorbid. The Netherlands Study of Depression and Anxiety showed that 67% of patients with a primary depression diagnosis had a comorbid anxiety disorder. Otherwise 63% of patients with a primary anxiety disorder also had a depressive disorder (Lamers et al., 2011). Moreover, anxiety and depression symptomatology cause a significant loss of quality of life in different areas and daily activities (Khansa et al., 2020).
Several interventions have been shown to be effective in reducing depression and anxiety symptomatology, such as Acceptance and Commitment Therapy (Bai et al., 2020; Gloster et al., 2020), Cognitive Behavioral Therapy (Butler et al., 2006), Mindfulness (Hofmann et al., 2010), Behavioral Activation for Depression (Cuijpers et al., 2007), and Positive Psychology interventions (Chakhssi et al., 2018). Such interventions are available through mental health care providers. If, as argued above, this type of care is less available or less accessible in Latin America compared to European countries, then the Latin American population is at a disadvantage. It is estimated that in Mexico, only one in 10 people who need psychological treatment have access to a mental health professional (Flores-Plata et al., 2014). This indicates the need to implement alternatives to prevent the development of these disorders and facilitate access to quality mental health services that address highly prevalent mental disorders such as depression and anxiety.
Online psychological interventions have emerged as a treatment alternative as they can be accessible, flexible, personalized, and available for large populations (Saddichha et al., 2014; Dominguez-Rodriguez and De La Rosa-Gómez, 2022). Furthermore, meta-analyses have revealed that self-applied internet interventions are effective at reducing both depression and anxiety symptomatology and increasing well-being (Pang et al., 2021; Ye et al., 2022). Specifically, the treatment components shown to be effective when applied online are Acceptance and Commitment Therapy (Thompson et al., 2021), Cognitive Behavioral Therapy (Morgan et al., 2017), Mindfulness (Spijkerman et al., 2016), and Behavioral Activation (Huguet et al., 2018), also, multicomponent proposals (Marcelle et al., 2019; Wijnen et al., 2023). Other approaches from ITLAS group have demonstrated the effectiveness of multimodal interventions in the Latino population for grief treatment (Dominguez-Rodriguez et al., 2023). However, the results of these meta-analyses are mainly based on internet interventions designed and applied in high-income countries. The number of internet interventions in Latin America is limited, as well as Randomized Controlled Trials (RCTs) about their effectiveness (Jiménez-Molina et al., 2019). The scarcity of free, scientifically based treatments in Latin America drastically impacts the quality of life of thousands of people who experience symptoms of anxiety and depression but do not yet receive treatment. Implementing a free, self-guided, online intervention would address the inequality in access to mental health support and ensure applicability in cases of a lack of trained personnel.
Adherence and dropouts are among the most discussed issues related to self-guided interventions (Cavanagh, 2010; Melville et al., 2010). It has been proposed that an enriched platform environment with more interactive elements (e.g., videos, forums, audio) will increase user engagement, adherence and reduce dropouts. Hurling et al. (2006) tested this hypothesis and found that a more interactive version of the same internet intervention to promote health behaviors (exercise) was more engaging, with fewer dropouts and better user retention indexes. A more recent study by Granet et al. (2023) obtained similar results with an interactive vs. a non-interactive group, and they also found a considerable difference in dropout rates (16% vs. 46%, respectively). Although the literature on the interactivity of internet interventions is scarce, these findings suggest that increasing the interactive elements in self-guided internet interventions may increase adherence and decrease dropouts by increasing user engagement.
The protocol proposed here has been developed by researchers from different countries on different continents for different populations, thus trying to minimize inequalities in mental health care accessibility and maximize the support and efficiency of evidence-based research. At the same time, this approach also enabled us to consider the cultural differences between the involved countries, through an adaptation of the online intervention guided by cultural sensitivity. When there is little to no therapist engagement, the cultural adaptation of mental health treatment approaches is essential (Harper Shehadeh et al., 2016). To culturally adapt our intervention, we followed the taxonomy proposed by Spanhel et al. (2021). This taxonomy includes 17 contents (e.g., characters’ appearance), methodological (e.g., design and esthetics), and procedural components (e.g., methods used to obtain information).
As we mentioned, the treatment of mental health in the world presents a disparity that needs to be solved with the application of psychological interventions in diverse cultural environments (Heim and Kohrt, 2019). For this purpose, cross-cultural studies are needed because cultural adaptation of psychological interventions is associated with greater effectiveness compared to those that are not culturally adapted (Bernal et al., 2009).
To summarize, we developed an online intervention, Well-being Online (equivalent names in different languages Bienestar Online, Bem-estar Online and Welzijn Online), which will be available to the public free of charge. It is aimed at people with mild symptoms of depression and/or anxiety and is therefore intended as a preventive tool for developing severe mental health issues. It is a co-creation of researchers from seven countries (Mexico, Ecuador, Chile, Brazil, Peru, the Netherlands, and Spain), intended to reduce the differences between those countries in the availability of interventions for depression and anxiety. The decision to focus on those seven countries is based on the previously established consortia of researchers and the scarcity of studies that compare Latin American and European samples in internet interventions. In this article, the protocol is presented. Overall, we expect (i) a decrease in depression and anxiety symptomatology and (ii) an increase in well-being. Furthermore, we will explore whether an enriched web design, with more presentation tools (videos, texts, audio) and interaction (forums), affects the intervention’s effectiveness and user engagement. We expect that an enriched web design will provoke (iii) more engagement, adherence, satisfaction, and fewer dropouts. Finally, we expect (iv) similar effectiveness between countries due to the process followed to culturally adapt the intervention.
Considering that it is a prevention program and as reported in a systematic review of programs for the prevention of depression, anxiety, and stress it was identified that the mean effect size of the programs was moderate (overall g = 0.65; Rith-Najarian et al., 2019), it is expected that the effect size of the intervention on the different study variables will be moderate.
2 Methods and analysis
2.1 Design and procedure
A multi-country (Mexico, Ecuador, Peru, Chile, Brazil, Spain, and the Netherlands), randomized controlled trial will be conducted. Our trial will be a parallel, three-arm, superiority analysis trial with two blinding levels (at the level of those delivering the intervention and those analyzing the data). In each country, eligible participants will be randomly assigned to one of three groups: (i) Enriched Intervention (EI): participants will receive the intervention with an interactive web design (videos, infographics, text, audios, forum), (ii) Text Intervention (TI): participants will receive the intervention only via text on the webpage, and (iii) Waiting List (WL): control group. Repeated measurements will be obtained for the EI and TI groups at 5-time points: M0: pre-intervention, M1: halfway intervention, M2: post-intervention, M3: 3 months follow-up, and M4: 6 months follow-up. Participants in the WL will be evaluated again once they conclude a waiting period of 30 days. If, at that assessment, the participants in the WL group still do not fulfill any exclusion criteria, then they will be assigned randomly to the EI or TI. Participants in this group will be evaluated at 6-time points: M0: pre-waiting list period, M1: After waiting list period, M2: halfway intervention, M3: post-intervention, M4: 3 months follow-up, and M5: 6 months follow-up.
2.2 Randomization and blinding
Participants who consent to participate, meet all the inclusion criteria, and do not fulfill any exclusion criteria will be randomly assigned to one of the three groups (Enriched Intervention, Text Intervention, and Waiting List control group) with a 1:1:1 allocation ratio stratified by country. After completing the 30 days on the waitlist, participants in the control group will be granted access to the intervention and randomly assigned to any of the two treatment arms in a 1:1 ratio. An independent researcher will perform a permuted block algorithm with random block sizes from 6, 9, or 12 allocations, using the Study Randomizer Software (2017) for all the randomization processes; with this, we ensure not to influence the order allocation and pre-randomization allocation concealment (Bogosian et al., 2015). Following these random blocks, the platform developer will give the participants access to the respective arm.
Participants will not be blinded to the intervention they receive, which is frequent among web-based interventions due to the nature of these studies (Sikorski et al., 2021; Moreno-Peral et al., 2023). Nevertheless, the researchers analyzing the data and results will remain blind to the group allocation since all analyses have been completed. The study design is shown in Figure 1.
2.3 Participants
2.3.1 Recruitment
Digital advertising strategies will be used to invite participants. We will use digital media and social networks, particularly directed to groups or pages of health institutions on Facebook, Instagram, Twitter, and LinkedIn. In addition, the support of the traditional media will be requested to disseminate the project. Participants will be informed that the intervention is free of charge and aimed at people with mild symptoms of depression and/or anxiety.
2.3.2 Selection criteria
The inclusion criteria for participation are:
• 18 years or older
• Full completion of the pre-intervention evaluation
• Residence in one of the countries participating in the study: Mexico, Peru, Chile, Brazil, Ecuador, Spain, and The Netherlands
• Fluency/proficiency in one of the intervention languages (Spanish for Mexico, Peru, Ecuador, Spain, and Chile, Brazilian-Portuguese for Brazil, English or Dutch for the Netherlands)
This intervention addresses individuals with mild depressive and/or anxiety symptomatology and includes strategies to improve resilience, adaptive coping styles and well-being. Therefore, volunteers that will be excluded are those reporting:
• Severe symptoms of depression measured by the questionnaire CES-D-R (score of 16 or higher)
• Severe symptoms of PTSD measured by the questionnaire Posttraumatic Stress Disorder Checklist for DSM-5 (score of 33 or higher)
• Severe suicidal ideation measured by the questionnaire Frequency of Suicidal Ideation Inventory (score of 11 or higher)
• To have been recently diagnosed with a depressive and/or anxiety disorder
• Currently taking medication for depressive and/or anxiety symptoms
• To have been diagnosed with another psychiatric comorbidity: personality disorder, psychotic disorder, bipolar disorder, Attention-Deficit/Hyperactivity Disorder
2.3.3 Sample size
Sample size was estimated using a two-step procedure (initial estimate and simulation). We used the program Gpower 3.1 as an initial estimate for the sample size. For detecting a small effect size (0.20) with a significance level of 0.05 and a desired power of 0.80, a total number of 161 participants are required for a repeated-measures MANOVA within-between interaction for 7 countries and 5 measurements.
We then tried to confirm and extend these findings using simulations based on real data from a similar previous study conducted by Dominguez-Rodriguez et al. (2021, 2023). The data included the results of 114 participants, 45 on the treatment condition and 69 on the control condition, which after finishing a waiting period of 36 days, were assigned to the treatment condition. The participants answered the CESD-R and the GAD7 in 3 moments: (1) pre-treatment, (2) post-treatment, and (3) three-month follow-up (the 6-month follow-up was not available at the time of the calculation). The simulation was based on multilevel statistics instead of MANOVA, with two groups (fixed between-subjects factor GROUP; control vs. treatment) and three-time points (fixed within-subjects factor TIME; pre-intervention, post-intervention, and follow-up after 3 months).
We used the R statistical package v4.2.1 and the packages lme4 and simr to perform the simulations. First, the number of observations was artificially inflated from 114 to 5,000 to have enough data available for simulating a large enough range of sample sizes. Then, we performed 100 simulations each for all sample sizes between 1 and 5,000. The results confirmed the results from Gpower in that, in order to obtain a statistically significant combined GROUP and TIME effect, both on the GAD and the CESDR scores, at a significance level of 0.05 and a power of 0.80, about 160 observations would suffice. The sample sizes for the main effects of GROUP and TIME would be much lower (60 vs. 10, respectively). To be on the safe side, considering the dropout rates in previous studies of digital interventions (Moshe et al., 2022) and mental health interventions in low- and middle-income countries (Fernández et al., 2021), we estimated a 45% dropout. Thus, we aim to achieve a sample size of 232 participants for a pooled analysis of 7 countries.
2.4 Study groups
Participants will be randomly assigned to one of the following groups:
2.4.1 Enriched intervention
The participants will have access to an enriched web platform, which will include:
• Three different information presentation types. The participants can choose to receive the information via animated videos, text, or only audio. Graphic designers created the animated videos and have an avatar—“therapist”—who explains both the intervention and exercises. We will record which medium they choose.
• A forum. The aims of the forum are: (i) increase interaction, (ii) provide peer support, and (iii) provide expert support. The participants can share their reflections, thoughts, experiences, and questions. Participants’ entries will be anonymous and filtered by a trained expert team before being made public. In the event of concerning entries (e.g., suicidal ideation-intention, adverse effects of the intervention), the participants will be contacted to provide further specialized support.
2.4.2 Text intervention
The participants will have access to a web platform, including the same intervention modules as the EI group, but explained only in text form. Furthermore, they will not have access to the forum. Therefore, the EI and TI intervention groups will differ in the availability of presentation modes (EI: video, audio and/or text vs. TI: only text) and the possibility to interact (EI: forum available vs. TI: no forum available). At the end of the study, the participants in the TI group will also have access to the enriched web design.
2.4.3 Waiting list control group
Participants assigned to this group will wait 30 days to be randomly assigned to either group EI or TI. During this time, they will complete the questionnaires at 2 assessment moments: M0: pre-assessment, M1: End 30 days. The 30-day period was set to consider the time that participants in the EI or TI groups would take to complete the intervention.
2.5 The Well-being Online intervention
Well-being Online intervention aims to reduce depressive and anxious symptoms and increase well-being. It has 10 virtual modules (or sessions) delivered online using a platform created for this purpose. This multicomponent intervention was developed based on previous studies and evidence-based psychological approaches for preventing and treating depression and anxiety disorders (Weisel et al., 2019; Coto-Lesmes et al., 2020) and for increasing well-being (Rubel et al., 2024). Psychological frameworks such as Cognitive Behavioral Therapy (CBT; Hao et al., 2023; Rubel et al., 2024), Behavioral Activation Therapy (BAT; Alirahmi et al., 2023; Hao et al., 2023), Acceptance and Commitment Therapy (ACT; Alirahmi et al., 2023; Coto-Lesmes et al., 2020), Mindfulness (Rubel et al., 2024), and Positive Psychology (Görges et al., 2018) have provided effective tools to address these therapeutic aims in previous studies and were, therefore, used in the development of the intervention contents. Table 2 presents the contents in detail.
Once the participants have access to the intervention, Module 1 will be open (see Figure 2). Every time they finish a module, they must answer a quiz with 5 multiple-choice questions to evaluate their understanding of the information presented in the module. The module will be considered finished only when they correctly answer at least 3 of the 5 questions. When they finish a module, they must wait 3 days for the next module to unlock. This time between modules is intended to promote self-reflection and apply the contents of the modules to their daily life.
2.6 Technical guarantee of website construction
Regarding the technical solution for the Web Platform where the intervention is based, we decided to use Microsoft’s robust. NET framework, employing an object-oriented programming approach to ensure a strong and modular structure. A Structured Query Language (SQL) relational database engine was chosen to efficiently manage participants’ information, allowing accurate and secure management of internal data, statistical records and other vital information for the comprehensive operation of the platform.
Using a three-layer Model-View-Controller (MVC) structure offers several benefits in developing computational systems, especially in our platform. First, the clear separation of responsibilities between the Model (the business logic and data access), the View (the user interface) and the Controller (the management of events and requests) makes it easier to organize and maintain the code, which leads to a more orderly and scalable development. This also allows changes to be made to one layer without directly affecting the others, improving flexibility and ease of testing and debugging. Additionally, in the context of private and secure internal data contained in the platform, this architecture contributes to data security and integrity by more efficiently controlling access to and manipulation of sensitive participant information.
2.7 Potential adverse effects and dropout
To mitigate possible adverse effects of the intervention, participants who, at the time of the initial evaluation, will obtain high scores in clinical variables (considering the cut-off points of the instruments used) will not be able to enter the online intervention, given its preventive nature. On the contrary, those participants will be redirected through the platform to contact information for local institutions to obtain more specific and specialized help for their emotional needs.
Additionally, on the web platform on which the intervention is offered, contact information will be available to participants so they can write to team members anytime. This communication channel will be open to resolving technical issues and other concerns during the study.
Furthermore, participants will have access to the interactive forum, which content will be analyzed daily by trained personnel to detect a potential worsening of symptoms or the occurrence of adverse effects of the intervention; in this case, a member of the team will contact the person via email to do closer monitoring of the eventual deterioration of targeted symptoms and explore other potential repercussions. Monitoring adverse effects is an effective strategy for preventing them and reducing dropout rates in web-based interventions (Fenski et al., 2021). Furthermore, attrition will also be handled by notification emails sent to the participants in different intervention periods (i.e., after each completed module, when a new module is released 3 days after the completion of the previous one, and as assessment reminders).
2.8 Measures
Participants will be assessed through the web platform in an automated way. They will be able to answer the questionnaires at any time of the day on any day of the week. The evaluation instruments and assessment moments are presented in Table 3. We selected them using two criteria: (i) instruments most used in similar protocols and (ii) instruments validated in most countries participating in this study.
2.8.1 Primary outcomes
2.8.1.1 Anxiety symptomatology
The General Anxiety Disorder Scale-7 (GAD-7) will be applied (Spitzer et al., 2006). This 7-item scale measures the severity of generalized anxiety disorder symptoms. Items are rated on a 4-point scale ranging from 0 (not at all) to 3 (nearly every day). The maximum total score is 21. The GAD-7 provides an assessment of anxiety for people with no symptoms (0 to 4 points), mild (5 to 9 points), moderate (10 to 14 points), and severe symptoms (15 points or more). GAD-7 has good reliability and validity in its versions in English (Spitzer et al., 2006), Spanish (Garcia-Campayo et al., 2010), Brazilian-Portuguese (Moreno et al., 2016), and Dutch (Donker et al., 2011).
2.8.1.2 Depressive symptomatology
The Center for Epidemiologic Studies Depression Scale will be applied in its revised version (CESD-R; Eaton et al., 2004). This 20-item scale measures symptoms of depression, covering the criteria of temporality established in the DSM-IV. Items are rated on a 5-point scale ranging from 0 (not at all or less than 1 day) to 4 (nearly every day for 2 weeks). The total score is calculated as a sum of the 20 questions, transforming the values for the top two response options (i.e., responses rated as 3 and 4) each with a score of 3. Total scores range from 0 to 60. A cutoff score of 16 points or more suggests symptoms of depression. CESD-R has good reliability and validity in its versions in English (Eaton et al., 2004), Spanish (González-Forteza et al., 2011), Brazilian-Portuguese (Faro et al., 2020), and Dutch (Beekman et al., 1997).
2.8.1.3 Mental well-being
The Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) will be applied (Tennant et al., 2007). This 14-item scale measures mental well-being and includes hedonic (i.e., affects, life satisfaction) and eudemonic (i.e., positive relationships, psychological functioning) items. Items are rated on a 5-point scale ranging from 1 (not at all) to 5 (all the time). The total score ranges from 14 to 70. The higher the score, the higher the mental well-being (Tennant et al., 2007). WEMWBS has good reliability and validity in its versions in English (Tennant et al., 2007), Spanish (Carvajal et al., 2015), Brazilian Portuguese (Santos et al., 2015), and Dutch (Ikink et al., 2012).
2.8.2 Secondary outcomes
2.8.2.1 Perceived stress
The Perceived Stress Scale (PSS-10) will be applied (Cohen et al., 1983). This 10-item scale measures the level of stress perceived in the last month. Items are rated on a 5-point scale ranging from 0 (never) to 4 (very often). The higher the score, the higher the stress level. PSS-10 has good reliability and validity in its versions in English (Denovan et al., 2019), Spanish (González-Ramírez et al., 2013), Brazilian Portuguese (Siqueira Reis et al., 2010), and Dutch (van Eck et al., 1996).
2.8.2.2 Sleep quality
The Pittsburgh Sleep Quality Index (PSQI) will be applied (Buysse et al., 1991). This 19-item scale measures a wide variety of factors relating to sleep quality. Items combine to form 7 components: sleep duration, sleep disturbance, sleep latency, daytime dysfunction, sleep efficiency, overall quality of sleep, and use of sleep medication (Buysse et al., 1989), which are rated considering the frequency or severity of sleep disturbance using scores ranging from 0 (not during the past month) to 3 (three or more times a week). The total score of the instrument is obtained by the sum of the component scores ranging from 0 to 21, with higher scores representing lower sleep quality PSQI has good reliability and validity in its versions in English (Buysse et al., 1991), Spanish (Jiménez-Genchi et al., 2008), Brazilian Portuguese (Bertolazi et al., 2011) and following Zwart et al. (2018), the Dutch version provided by eProvide® will be used.
2.8.2.3 Avoidance and inflexibility
The Action Acceptance Questionnaire II (AAQ-II) will be applied (Bond et al., 2011). This 7-item scale measures experiential avoidance and psychological inflexibility. Items are rated on a 7-point scale ranging from 1 (never true) to 7 (always true). It is one of the most widely used scales in evaluating acceptance and commitment-based web therapies (Thompson et al., 2021). AAQ-II has good reliability and validity in its versions in English (Bond et al., 2011), Spanish (Ruiz et al., 2013), Brazilian Portuguese (Barbosa and Murta, 2015), and Dutch (Jacobs et al., 2008).
2.8.2.4 Life satisfaction
The Satisfaction with Life Scale (SWLS) will be applied (Diener et al., 1985). This is a short scale of 5 items answered with a Likert format (1: strongly disagree to 7: strongly agree). The scores range from 5 to 35, with higher scores indicating greater life satisfaction. SWLS has good reliability and validity in its versions in English (Diener et al., 1985), Spanish (López-Ortega et al., 2016), Brazilian Portuguese (Zanon et al., 2014), and Dutch (Arrindell et al., 1999).
2.8.2.5 Affect
The Positive and Negative Affect Schedule (PANAS) will be applied (Watson et al., 1988). This 20-item scale measures emotional states with two outcomes: strength of negative affect and strength of positive affect. Items are rated on a 5-point scale ranging from 0 (not at all) to 4 (extremely). PANAS has good reliability and validity in its versions in English (Watson et al., 1988), Spanish (Ortuño-Sierra et al., 2015), Brazilian Portuguese (De Carvalho et al., 2013), and Dutch (De Engelen et al., 2006).
2.8.2.6 Perceived cognitive deficits
The Perceived Deficits Questionnaire (PDQ-5) will be applied (Sullivan et al., 1990). This 5-item scale measures perceived cognitive deficits associated with depressive-type disorders. Items are rated on a 5-point scale ranging from 1 (rarely) to 5 (always). PDQ-5 has good reliability and validity in its versions in English (Sullivan et al., 1990). Unfortunately, the instrument is not available in Spanish, Brazilian Portuguese, nor Dutch. Therefore, the researchers will translate it, and the instruments will be validated in the remaining countries.
2.8.3 Other outcomes
2.8.3.1 Satisfaction with the intervention
Two instruments will be used to assess satisfaction with the intervention. The Opinion Treatment is a 6-item scale measuring (i) satisfaction with the treatment, (ii) whether they would recommend the treatment to a friend or family member, (iii) whether the user considers the treatment useful, and (iv) whether they believe the treatment was difficult to manage or aversive. This scale is explained in more detail in Botella et al. (2009). The second instrument is the Client Satisfaction Questionnaire (CSQ-8; Larsen et al., 1979). This 8-item scale measures the level of satisfaction with the treatment and has been used to evaluate self-administered treatments before and showed a high degree of internal consistency (De Brey, 1983; Roberts and Attkisson, 1983).
2.8.3.2 System usability
Two instruments will be used to assess system usability, and the System Usability Scale will be applied (see Brooke, 1996). It is composed of 10 items, rated on a 5-point scale ranging from 0 (disagree) to 4 (completely agree) and is an instrument designed to validate the usability of a system. The Telehealth Usability Questionnaire will be used to assess the usability of telehealth systems through two dimensions: 1) effectiveness and 2) ease of use. TUQ has 12 items rated on a 7-point scale ranging from 1 (disagree) to 7 (agree) (TUQ, see Parmanto et al., 2016).
2.8.4 Covariates
2.8.4.1 Sociodemographic data
Patient confidentiality will be the priority, and data such as name, address, and telephone number will not be requested at any time. However, other relevant data will be collected (such as education, employment status, marital status, age, gender, city of residence, substance use, presence of mental disorders or being in psychological treatment), to comply with the points stipulated by the inclusion and exclusion criteria. Other data will be asked, such as whether the person lives alone or with someone.
2.8.4.2 Self-assessment per module
At the end of each module, a self-assessment composed of 5 items with multiple options formats will be conducted, in which self-exploration questions related to the information reviewed throughout the module sessions will be asked. These questions will serve as a self-assessment of the knowledge acquired, introducing the possibility of reviewing the module (videos, infographics) in case the number of correct answers is insufficient. The participants must answer at least 3 of 5 questions correctly to proceed to the further module.
2.9 Exclusion outcomes
Two instruments will be used to assess two exclusion criteria in this study. Severe PTSD symptomatology will be assessed with the Posttraumatic Stress Disorder Checklist for DSM-5 (PCL-5, Weathers et al., 2013), and severe suicidal ideation will be assessed with the Frequency of Suicidal Ideation Inventory (FSII, Chang and Chang, 2016). Both instruments are described elsewhere (see Weathers et al., 2013 and Chang and Chang, 2016) and show adequate reliability and validity indicators in the countries involved in this study.
2.10 Data analysis
2.10.1 Description of participants
We will perform a descriptive analysis of proportions for the categorical variables and an analysis of central tendency and dispersion for the continuous variables and outcomes. Also, we will perform the analysis for each measurement (pre-test, intervention, post-test, follow-up-3, follow-up-6) and each of the three groups. Following a conservative approach, we will use only valid data from participants who completed the intervention or at least arrived at half of the intervention since an assessment was also implemented there. However, only participants that completed the 10 sessions will be considered as completers.
2.10.2 Assessment of immediate treatment effects (main analysis)
The investigators will conduct a -blind data analysis. All analyses will use two-tailed hypothesis testing. A between-subjects MANOVA will be used to test for between-group differences in the degree of change between outcomes. Unlike some ANOVAs, MANCOVA takes into account multivariate relationships between anxiety symptoms, depressive symptoms, and other outcomes. We will use Levine’s test of equal error variance to test the assumption of homogeneity of variance, which indicates the robustness of the multivariate analysis. MANOVA analysis will be used, considering the seven country groups and using three measures (pre-test, middle of the intervention, and post-test) for the participants initially assigned to one of the two intervention groups. For the participants in the control group, the same analysis will be conducted, however, with four measures (pre-test, post-waiting list period, middle of the intervention, and post-test). The analysis is conducted on an intention-to-treat basis to avoid overestimation of clinical effectiveness and to control for dropout bias. Missing responses will be imputed using multiple imputations (Sterne et al., 2009). The models will be adjusted based on the three measures and the variables gender and age. The adjusted partial eta squared (adj η2) will be used to evaluate the effect size, knowing that the values 0.02 indicate a small effect size, 0.15 medium, and 0.30 large (Mordkoff, 2019). Data from this study will be analyzed using SPSS v.26 and STATA 17.
2.10.3 Assessment of treatment sustainability
A Mixed Model ANOVA will be conducted by the seven country groups and by time (pre-test, intervention, post-test, follow-up-3, and follow-up-6) to assess the effect of the three intervention groups. In addition, the adjusted partial eta squared (adj η2) will be used as the effect size, and an intention-to-treat analysis will be used.
3 Discussion
The present research protocol has three main goals. First, to assess the effectiveness of a free self-guided internet intervention (Well-being Online) designed to reduce depression and anxiety symptomatology and increase well-being. Second, considering that the intervention has been culturally adapted for its application in different countries in Latin America and Europe, this study will compare access, adherence, user experience, and effectiveness between these countries. And third, the study aims to examine the effect of interactive elements, such as forums, presentation forms, videos, audios, and text, on the intervention’s adherence, dropout, and effectiveness. It is expected that Well-being Online will significantly reduce levels of depression and anxiety and that users will report high levels of usability and satisfaction with the intervention.
For ethical considerations, the project ensured the participation of all subjects in any intervention modalities. Within the comparison groups, the presentation modality, interactivity levels, and waiting time were systematically manipulated. This design enabled the observation of the anxiety and depression symptoms among participants devoid of any intervention. The findings of the study could demonstrate whether a more interactive version of online intervention contributes to enhanced efficacy.
Well-being Online, is a multi-component intervention, with strategies based on five therapy components: cognitive behavioral therapy, behavioral activation therapy, mindfulness, acceptance and commitment therapy, and positive psychology. Therefore, it is an evidence-based intervention, as all of these components have shown high effectiveness in treating anxiety and depression previously (Carr and Finnegan, 2015; Bai et al., 2020).
Similar Internet-based self-guided interventions to reduce depressive and anxious symptomatology have shown promising results (Taylor et al., 2021; Kurniawan et al., 2022). However, Well-being Online will be provided at no cost across seven distinct countries to improve the availability and accessibility of mental health therapies in regions with limited access to mental health care and where the cost of services is prohibitively high, so it can be beneficial for people who cannot afford traditional psychological treatment (Bretón-López et al., 2017). This is especially pertinent in Latin American countries, where mental health care is often scarce and difficult to afford (Jiménez-Molina et al., 2019). Therefore, the design of preventive interventions is also useful in reducing psychological and psychiatric disorders.
One of the primary benefits of a self-guided intervention is the convenience it offers. Individuals can access the intervention from the comfort of their homes, at a time that works best for them, without needing to schedule and attend appointments with a mental health professional (Andersson and Titov, 2014).
By integrating mindfulness and positive psychology, the intervention addresses negative symptoms and promotes positive emotions and behaviors, so it takes a holistic approach to mental health (Shafran and Bennett, 2017). For example, a previous study showed a negative association between one’s difficulty in identifying feelings and his experience of feelings of compassion and concern toward others (Diotaiuti et al., 2021). Another strength of Well-being Online is its self-guided nature because there is evidence of the efficacy of this type of interventions, which aim to empower individuals in their recovery by providing them with the skills and confidence they need to recognize and manage their health problems (Lean et al., 2019).
The participation of the seven countries has led to cultural adaptations in language and materials, following the recommendations of the literature on this topic (Spanhel et al., 2021). Well-being Online will be available in four languages (Spanish, Portuguese, Dutch, and English) and seven countries (Mexico, Ecuador, Peru, Chile, Brazil, Spain, and the Netherlands), so a relatively unlimited number of people can access it. The decision to make the contents available in English for the population in the Netherlands is because many people live in that country for studies or work in Dutch but speak fluent English. Some studies indicate that 90% of the population claim to converse in English (Eurobarometer, 2006; Yao and van Ours, 2015). Also, according to the organization Education First English Proficiency Index, for the fifth year in a row, the population in the Netherlands has been recognized as the best country with a proficiency of very in the ranking of 2.2 million of adults in 113 countries and regions (Education First English Proficiency Index, 2023). On the other hand, although Spain and Netherlands are classified as developed countries, free accessible online interventions are still not widespread, and many people cannot access them.
Additionally, although technology is successfully used in psychology research (Mancone et al., 2023), few studies evaluate the acceptability and feasibility of the online treatment (Tur et al., 2021), which would allow making the necessary adjustments to ensure the intervention’s effectiveness. These two elements represent strengths in the design of Well-being Online. Furthermore, if the study results are positive, this intervention could be extended to other Latin American and European countries.
Well-being Online will compare the EI vs. TI, and WL. In addition to this, animated videos, an online forum, and exercises embedded on the web page will offer users an interactive and enjoyable platform that not only allows them to obtain information but also to put intervention techniques into practice and interact with peers and professionals to receive feedback and promote treatment adherence. Beyond, adherence monitoring will be done through the web page, identifying through usage statistics, the number of times the participants access to the platform, the days they log in, and whether they access the intervention sessions; this will allow sending reminders via email to those users in which there is a delay with the intervention, to invite them to resume the sessions.
The multiple evaluations carried out during the intervention will also provide estimated data on anxiety, depression, stress, sleep quality, experiential avoidance and psychological inflexibility, satisfaction with life, mental psychological well-being, perceived deficits, post-traumatic stress and suicidal ideation, on users in different countries, which can also be compared by the sociodemographic variables collected. Furthermore, although the number of questionnaires implemented in different parts of the study could be perceived as a high number, we ensured to select questionnaires that are short and widely validated, furthermore previous studies conducted by the team members (Dominguez-Rodriguez et al., 2023; Martínez-Arriaga et al., 2023) have found that participants do answer all the assessments, and this helps to analyze the impact of the intervention.
This protocol should be considered under the following limitations. First, the intervention relies on individuals self-selecting to participate; this means that those who are more motivated to seek help may be more likely to participate, potentially skewing the results toward more positive outcomes. Higher motivation and different characteristics of voluntary participants have already been discussed in other studies (Amarnath et al., 2023). Second, it will have limited generalizability, due to the study may not be representative of the wider population. It may only include individuals who have access to and are comfortable using internet-based interventions. According to data from the World Bank, in Latin America, approximately 74% of the population has Internet access (The World Bank, 2023). However, this does not reflect people with limitations in technological skills that could restrict online intervention use. Third, the assessment tools used may not capture the full range of mental health outcomes or may not be sensitive enough to detect changes in symptom severity. However, the use of standardized tests has been prioritized as the main variables of this study. Fourth, there exists a lack of personalization, meaning that the intervention may not be tailored to individual needs and preferences, which could limit its effectiveness for certain individuals (McAllister-Williams et al., 2020). Fifth, the effectiveness of the intervention may depend on the individual’s ability to adhere to the protocol, and it is unclear how many participants will complete the program as designed. It has been noted in other studies that there are often difficulties in engaging and retaining participants long enough or in adhering to established protocols (Jiménez-Molina et al., 2019). Non-adherence may reduce the overall effectiveness of the intervention. Sixth, technical issues, such as internet connectivity problems or issues with the platform, may affect the ability of participants to access and use the intervention. Seventh, the intervention does not involve direct interaction with a therapist, which may limit its effectiveness compared to interventions that include therapist support (Jiménez-Molina et al., 2019). Finally, one additional limitation of this study is that the intervention platform does not offer an option to identify users who already entered the intervention but were dissatisfied with the treatment modality randomly assigned and, after abandoning it, reenter the intervention. Future studies should address this issue, for example, by incorporating an IP identifier for participants who sign in multiple times with different email accounts to automatically assign them every time to the same study arm (Sikorski et al., 2021).
4 Conclusion
Well-being Online pretends to decrease anxiety and depression symptomatology and increase subjective well-being. It will be available in four languages (Spanish, Portuguese, Dutch, and English) and seven countries (Mexico, Ecuador, Peru, Chile, Brazil, Spain, and the Netherlands). By conducting a multi-country, randomized controlled trial, this protocol aims to contribute valuable insights into the effectiveness of such interventions across diverse cultural contexts. The inclusion of seven countries in this study, in addition to the potential to replicate this study in other countries, highlight the commitment to making mental health resources accessible on a global scale. Besides, the development and implementation of the Well-being Online intervention represent a significant step forward in addressing the limited availability of online psychological interventions, mainly in Latin America and Europe.
Its methodological approach and rigorous measures through repeated assessments at multiple time points, enhances the robustness of its potential findings. Anticipating positive outcomes, including a reduction in depression and anxiety symptoms and an improvement in overall well-being among participants, we envision that the Well-being Online intervention could serve as a model for future online mental health initiatives. The results of this study hold the potential to inform and shape the landscape of accessible and effective mental health interventions, not only in the participating countries but also beyond. The commitment to providing free access to the intervention would help to democratizing mental health support and fostering well-being across diverse populations.
Ethics statement
The study counts currently with the approval of the Ethics Committee of the Universidad Autónoma de Ciudad Juárez, Mexico (CEI-2022-2-761), the Universidad Europea de Valencia, Spain (CIPI/23.084), the Fundação de Ensino e Pesquisa em Ciências da Saúde, Brazil (CAAE: 65631922.3.0000.5553) and the Universidad César Vallejo, Peru (001-CEI-EPM-UCV-2024). At the moment of this publication, the rest of the countries are pending to receive the ethics committee approval. The trial was registered with the ClinicalTrials.gov (NCT05443139).
Author contributions
AD-R: Writing – review & editing, Writing – original draft, Validation, Supervision, Resources, Project administration, Methodology, Investigation, Funding acquisition, Conceptualization. PH-A: Writing – review & editing, Writing – original draft, Validation, Supervision, Methodology, Investigation, Funding acquisition, Data curation, Conceptualization. LG-R: Writing – review & editing, Writing – original draft, Supervision, Resources, Project administration, Investigation, Funding acquisition, Conceptualization. RM-A: Writing – review & editing, Writing – original draft, Supervision, Project administration, Investigation, Funding acquisition, Conceptualization. DV-Z: Writing – review & editing, Writing – original draft, Supervision, Resources, Methodology, Investigation, Funding acquisition, Formal Analysis, Data curation. AS: Writing – review & editing, Supervision, Resources, Project administration, Methodology, Investigation, Funding acquisition. JG-C: Writing – review & editing, Writing – original draft, Supervision, Resources, Project administration, Methodology, Investigation, Funding acquisition, Conceptualization. VV: Writing – review & editing, Resources, Project administration, Investigation, Funding acquisition, Conceptualization. MM: Writing – original draft, Supervision, Resources, Project administration, Investigation, Funding acquisition, Conceptualization. ACH: Writing – original draft, Supervision, Resources, Project administration, Methodology, Investigation, Funding acquisition, Conceptualization. RL: Writing – review & editing, Supervision, Resources, Project administration, Funding acquisition, Conceptualization. EN: Writing – review & editing, Writing – original draft, Resources, Project administration, Investigation. MA-T: Writing – review & editing, Writing – original draft, Resources, Project administration, Investigation. JM-M: Resources, Methodology, Investigation, Formal Analysis, Conceptualization, Writing – original draft. FR-M: Writing – review & editing, Supervision, Resources, Project administration, Investigation, Funding acquisition. ACG: Conceptualization, Writing – review & editing, Supervision, Resources, Project administration, Investigation, Funding acquisition. DM-R: Writing – review & editing, Supervision, Resources, Project administration, Investigation, Funding acquisition. ÁL: Writing – review & editing, Supervision, Resources, Project administration, Investigation, Funding acquisition. CA: Writing – review & editing, Supervision, Resources, Project administration, Investigation, Funding acquisition. RC-V: Writing – original draft, Methodology, Conceptualization, Project administration, Investigation, Funding acquisition.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. The Autonomous University of Ciudad Juárez provided the funds to develop the Well-being Online Intervention. The funding body had no role in the study design, writing of the manuscript, or the decision to submit the paper to a specific journal.
Acknowledgments
The authors want to thank Mercedes Almela, Geert van Boxtel, and Lars de Vroege from Tilburg University, the Netherlands, for all their support since the beginning of the project and the help to implement the intervention in the Netherlands. The authors thank Tecnológico de Monterrey for supporting the manuscript fees.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Alirahmi, M., Aibod, S., Azizifar, A., and Kikhavani, S. (2023). Effectiveness of behavioral activation therapy and acceptance and commitment therapy on depression and rumination as a tool for health promotion on mothers with cerebral palsy children. J. Educ. Health Promot. 12:290. doi: 10.4103/jehp.jehp_1552_22
Amarnath, A., Ozmen, S., Struijs, S. Y., de Wit, L., and Cuijpers, P. (2023). Effectiveness of a guided internet-based intervention for procrastination among university students—A randomized controlled trial study protocol. Internet Interv. 32:100612. doi: 10.1016/j.invent.2023.100612
Andersson, G., and Titov, N. (2014). Advantages and limitations of internet-based interventions for common mental disorders. World Psychiatry 13, 4–11. doi: 10.1002/wps.20083
Arrindell, W. A., Heesink, J., and Feij, J. A. (1999). The satisfaction with life scale (SWLS): appraisal with 1700 healthy young adults in the Netherlands. Personal. Individ. Differ. 26, 815–826. doi: 10.1016/S0191-8869(98)00180-9
Bai, Z., Luo, S., Zhang, L., Wu, S., and Chi, I. (2020). Acceptance and commitment therapy (ACT) to reduce depression: A systematic review and meta-analysis. J. Affect. Disord. 260, 728–737. doi: 10.1016/j.jad.2019.09.040
Barbosa, L. M., and Murta, S. G. (2015). Initial psychometric properties of the acceptance and action questionnaire—II—Brazilian version [Propriedades psicométricas iniciais do acceptance and action questionnaire—II—versão Brasileira]. Psico-USF 20, 75–85. doi: 10.1590/1413-82712015200107
Beekman, A. T. F., Deeg, D. J. H., Van Limbeek, J., Braam, A. W., De Vries, M. Z., and Van Tilburg, W. (1997). Brief communication. Psychol. Med. 27, 231–235. doi: 10.1017/S0033291796003510
Bernal, G., Jiménez-Chafey, M. I., and Domenech Rodríguez, M. M. (2009). Cultural adaptation of treatments: A resource for considering culture in evidence-based practice. Prof. Psychol. Res. Pract. 40, 361–368. doi: 10.1037/a0016401
Bertolazi, A. N., Fagondes, S. C., Hoff, L. S., Dartora, E. G., da Silva Miozzo, I. C., de Barba, M. E. F., et al. (2011). Validation of the Brazilian Portuguese version of the Pittsburgh sleep quality index. Sleep Med. 12, 70–75. doi: 10.1016/j.sleep.2010.04.020
Bogosian, A., Chadwick, P., Windgassen, S., Norton, S., McCrone, P., Mosweu, I., et al. (2015). Distress improves after mindfulness training for progressive MS: A pilot randomised trial. Mult. Scler. 21, 1184–1194. doi: 10.1177/1352458515576261
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., et al. (2011). Preliminary psychometric properties of the acceptance and action questionnaire–II: A revised measure of psychological inflexibility and experiential avoidance. Behav. Ther. 42, 676–688. doi: 10.1016/j.beth.2011.03.007
Botella, C., Quero, S., Serrano, B., Baños, R. M., and García-Palacios, A. (2009). Advances in psychological treatments: the use of new information and communication technologies [Avances en los tratamientos psicológicos: la utilización de las nuevas tecnologías de la información y la comunicación]. UB J Psychol 40, 155–170. Available at: http://www.redalyc.org/articulo.oa?id=97017660002.
Bretón-López, J., Mira, A., Castilla, D., García-Palacios, A., and Botella, C. (2017). Review of applications of information and communication technologies in clinical and health psychology in childhood and adolescence [Revisión de aplicaciones de las tecnologías de la información y la comunicación en psicología clínica y de la salud en infancia y adolescencia]. Revista de Psicología Clínica con Niños y Adolescentes 4, 11–16. Available at: http://www.redalyc.org/articulo.oa?id=477152557002
Brooke, J. (1996). “SUS: a quick and dirty usability scale” in Usability evaluation in industry, CRC press. eds. J. W. Jordan, B. Thomas, B. A. Weerdmeester, and I. L. McClelland (London: Taylor and Francis), 189–194.
Butler, A., Chapman, J., Forman, E., and Beck, A. (2006). The empirical status of cognitive-behavioral therapy: A review of meta-analyses. Clin. Psychol. Rev. 26, 17–31. doi: 10.1016/j.cpr.2005.07.003
Buysse, D. J., Reynolds, C. F. III, Monk, T. H., Hoch, C. C., Yeager, A. L., and Kupfer, D. J. (1991). Quantification of subjective sleep quality in healthy elderly men and women using the Pittsburgh sleep quality index (PSQI). Sleep 14, 331–338. doi: 10.1093/sleep/14.4.331
Buysse, D. J., Reynolds, C. F. III, Monk, T. H., Berman, S. R., and Kupfer, D. J. (1989). The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry research 28, 193–213. doi: 10.1016/0165-1781(89)90047-4
Carr, A., and Finnegan, L. (2015). The say ‘yes’ to life (SYTL) program: A positive psychology group intervention for depression. J. Contemp. Psychother. 45, 109–118. doi: 10.1007/s10879-014-9269-9
Carvajal, D., Aboaja, A., and Alvarado, R. (2015). Validation of the Warwick-Edinburgh mental well-being scale, in Chile [Validación de la Escala de bienestar mental de Wareick-Edinburgo, en Chile]. Revista De Salud Pública 19, 13–21. doi: 10.31052/1853.1180.v19.n1.11822
Cavanagh, K. (2010). “Turn on, tune in and (don’t) drop out: engagement, adherence, attrition, and alliance with internet-based interventions” in Eds. Bennett-Levy, J., Richards, D., Farrand, P., Christensen, H., Griffiths, K., Kavanagh, D. Oxford guide to low intensity CBT interventions (Oxford, England: Oxford University Press), 227–234.
Chakhssi, F., Kraiss, J. T., Sommers-Spijkerman, M., and Bohlmeijer, E. T. (2018). The effect of positive psychology interventions on well-being and distress in clinical samples with psychiatric or somatic disorders: a systematic review and meta-analysis. BMC Psychiatry 18:211. doi: 10.1186/s12888-018-1739-2
Chang, E. C., and Chang, O. D. (2016). Development of the frequency of suicidal ideation inventory: evidence for the validity and reliability of a brief measure of suicidal ideation frequency in a college student population. Cognit Ther Res 40, 549–556. doi: 10.1007/s10608-016-9758-0
Cohen, S., Kamarck, T., and Mermelstein, R. (1983). A global measure of perceived stress. J. Health Soc. Behav. 24:385. doi: 10.2307/2136404
Coto-Lesmes, R., Fernández-Rodríguez, C., and González-Fernández, S. (2020). Acceptance and commitment therapy in group format for anxiety and depression. A systematic review. J. Affect. Disord. 263, 107–120. doi: 10.1016/j.jad.2019.11.154
Cuijpers, P., van Straten, A., and Warmerdam, L. (2007). Behavioral activation treatments of depression: A meta-analysis. Clin. Psychol. Rev. 27, 318–326. doi: 10.1016/j.cpr.2006.11.001
De Brey, H. (1983). A cross-national validation of the client satisfaction questionnaire: the Dutch experience. Eval. Program Plann. 6, 395–400. doi: 10.1016/0149-7189(83)90018-6
Carvalho, H. W.De, Andreoli, S. B., Lara, D. R., Patrick, C. J., Quintana, M. I., Bressan, R. A., et al. (2013). Structural validity and reliability of the positive and negative affect schedule (PANAS): evidence from a large Brazilian community sample. Rev. Bras. Psiquiatr. 35, 169–172. doi: 10.1590/1516-4446-2012-0957
Denovan, A., Dagnall, N., Dhingra, K., and Grogan, S. (2019). Evaluating the perceived stress scale among UK university students: implications for stress measurement and management. Stud. High. Educ. 44, 120–133. doi: 10.1080/03075079.2017.1340445
Diener, E., Emmons, R. A., Larsen, R. J., and Griffin, S. (1985). The satisfaction with life scale. J. Pers. Assess. 49, 71–75. doi: 10.1207/s15327752jpa4901_13
Diotaiuti, P., Valente, G., Mancone, S., Grambone, A., and Chirico, A. (2021). Metric goodness and measurement invariance of the Italian brief version of interpersonal reactivity index: A study with young adults. Front. Psychol. 12:773363. doi: 10.3389/fpsyg.2021.773363
Dominguez-Rodriguez, A., and De La Rosa-Gómez, A. (2022). A perspective on how user-centered design could improve the impact of self-applied psychological interventions in low- or middle-income countries in Latin America. Front Digit Health 4:155. doi: 10.3389/fdgth.2022.866155
Dominguez-Rodriguez, A., Martínez-Luna, S. C., Hernández Jiménez, M. J., De La Rosa-Gómez, A., Arenas-Landgrave, P., Esquivel Santoveña, E. E., et al. (2021). A self-applied multi-component psychological online intervention based on UX, for the prevention of complicated grief disorder in the Mexican population during the COVID-19 outbreak: protocol of a randomized clinical trial. Front. Psychol. 12:782. doi: 10.3389/fpsyg.2021.644782
Dominguez-Rodriguez, A., Sanz-Gomez, S., González Ramírez, L. P., Herdoiza-Arroyo, P. E., Trevino Garcia, L. E., de la Rosa-Gómez, A., et al. (2023). The efficacy and usability of an unguided web-based grief intervention for adults who lost a loved one during the COVID-19 pandemic: randomized controlled trial. J. Med. Internet Res. 25:e43839. doi: 10.2196/43839
Donker, T., van Straten, A., Marks, I., and Cuijpers, P. (2011). Quick and easy self-rating of generalized anxiety disorder: validity of the Dutch web-based GAD-7, GAD-2 and GAD-SI. Psychiatry Res. 188, 58–64. doi: 10.1016/j.psychres.2011.01.016
Eaton, W., Smith, C., Ybarra, M., Muntaner, C., and Tien, A. (2004). “Center for Epidemiologic Studies Depression Scale: review and revision (CESD and CESD-R)” in Ed. Maruish, ME. The use of psychological testing for treatment planning and outcomes assessment: instruments for adults, vol. 3 (New York, United States of America: Lawrence Erlbaum Associates Publishers), 363–377.
Education First English Proficiency Index (2023). The world’s largest ranking of countries and regions by English skills. Available at: https://www.ef.com/wwen/epi/
Engelen, U.De, Peuter, S., Victoir, A., Van Diest, I., and Van den Bergh, O. (2006). Further validation of the positive and negative affect schedule (PANAS) and comparison of two Dutch versions [Verdere validering van de positive and negative affect schedule (PANAS) en vergelijking van twee Nederlandstalige versies]. Gedrag Gezondheid, 34, pp. 89–102. doi: 10.1007/BF03087979
Eurobarometer, S. (2006). Europeans and their languages : European Commission. Available at: https://europa.eu/eurobarometer/surveys/detail/518.
Faro, A., Nunes dos Santos, D., and Eaton, W. W. (2020). Factor structure and invariance analysis of the Center for Epidemiologic Studies Depression Scale—revised (CESD-R) in a Brazilian population. Suma Psicológica 28, 10–16. doi: 10.14349/sumapsi.2021.v28.n1.2
Fenski, F., Rozental, A., Heinrich, M., Knaevelsrud, C., Zagorscak, P., and Boettcher, J. (2021). Negative effects in internet-based interventions for depression: A qualitative content analysis. Internet Interv. 26:100469. doi: 10.1016/j.invent.2021.100469
Fernández, D., Vigo, D., Sampson, N. A., Hwang, I., Aguilar-Gaxiola, S., Al-Hamzawi, A. O., et al. (2021). Patterns of care and dropout rates from outpatient mental healthcare in low-, middle- and high-income countries from the World Health Organization's world mental health survey initiative. Psychol. Med. 51, 2104–2116. doi: 10.1017/S0033291720000884
Flores-Plata, L. A. F., López, G. C., Baca, X. D., and de la Rosa Gómez, A. (2014). Internet psychotherapy: application of a cognitive-behavioral intervention program for patients with depression [Psicoterapia vía internet: aplicación de un programa de intervención cognitivo-conductual para pacientes con depresión]. Psicología Iberoamericana 22, 7–15. doi: 10.48102/pi.v22i1.139
Garcia-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Perez-Paramo, M., Lopez-Gomez, V., et al. (2010). Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health Qual. Life Outcomes 8:8. doi: 10.1186/1477-7525-8-8
Gloster, A. T., Walder, N., Levin, M. E., Twohig, M. P., and Karekla, M. (2020). The empirical status of acceptance and commitment therapy: A review of meta-analyses. J. Contextual Behav. Sci. 18, 181–192. doi: 10.1016/j.jcbs.2020.09.009
González-Forteza, C., Torres, C. S., Tapia, A. J., Fernández, I. H., González-González, A., Garcia, F. J., et al. (2011). Reliability and validity of the depression scale CES-D in high school and college students from Mexico City: Results from a census [Confiabilidad y validez de la escala de depresión CES-D en un censo de estudiantes de nivel medio superior y superior, en la Ciudad de México]. Salud Mental 34, 53–59. Available at: https://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S0185-33252011000100007
González-Ramírez, M. T., Rodríguez-Ayán, M. N., and Hernández, R. L. (2013). The perceived stress scale (PSS): normative data and factor structure for a large-scale sample in Mexico. Span. J. Psychol. 16:E47. doi: 10.1017/sjp.2013.35
Görges, F., Oehler, C., von Hirschhausen, E., Hegerl, U., and Rummel-Kluge, C. (2018). GET.HAPPY—acceptance of an internet-based self-management positive psychology intervention for adult primary care patients with mild and moderate depression or dysthymia: A pilot study. Internet Interv. 12, 26–35. doi: 10.1016/j.invent.2018.03.001
Granet, J., Peyrusqué, E., Ruiz, F., Buckinx, F., Abdelkader, L. B., Dang-Vu, T. T., et al. (2023). Web-based physical activity interventions are feasible and beneficial solutions to prevent physical and mental health declines in community-dwelling older adults during isolation periods. J Gerontol Series A 78, 535–544. doi: 10.1093/gerona/glac127
Hao, X., Jia, Y., Chen, J., Zou, C., and Jiang, C. (2023). Subthreshold depression: A systematic review and network Meta-analysis of non-pharmacological interventions. Neuropsychiatr. Dis. Treat. 19, 2149–2169. doi: 10.2147/NDT.S425509
Harper Shehadeh, M., Heim, E., Chowdhary, N., Maercker, A., and Albanese, E. (2016). Cultural adaptation of minimally guided interventions for common mental disorders: A systematic review and Meta-analysis. JMIR Ment Health 3:e44. doi: 10.2196/mental.5776
Heim, E., and Kohrt, B. A. (2019). Cultural adaptation of scalable psychological interventions: A new conceptual framework. Clin Psychol Europe 1, 1–22. doi: 10.32872/cpe.v1i4.37679
Hernández-Posadas, A., De la Rosa-Gómez, A., Bouman, T. K., Mancilla-Díaz, J. M., Del Palacio-González, A., and Lommen, M. J. (2024). Transdiagnostic factors in depression and post-traumatic stress in a Mexican and Dutch sample. Pers. Individ. Differ. 218:112476. doi: 10.1016/j.paid.2023.112476
Hofmann, S. G., Sawyer, A. T., Witt, A. A., and Oh, D. (2010). The effect of mindfulness-based therapy on anxiety and depression: A meta-analytic review. J. Consult. Clin. Psychol. 78, 169–183. doi: 10.1037/a0018555
Huguet, A., Miller, A., Kisely, S., Rao, S., Saadat, N., and McGrath, P. J. (2018). A systematic review and meta-analysis on the efficacy of internet-delivered behavioral activation. J. Affect. Disord. 235, 27–38. doi: 10.1016/j.jad.2018.02.073
Hurling, R., Fairley, B. W., and Dias, M. B. (2006). Internet-based exercise intervention systems: are more interactive designs better? Psychol. Health 21, 757–772. doi: 10.1080/14768320600603257
Ikink, J. G., Lamers, S. M., and Bolier, J. M. (2012). The Warwick-Edinburgh mental well-being scale (WEMWBS) as measuring instrument for mental well-being in the Netherlands [De Warwick-Edinburgh mental well-being scale (WEMWBS) als meetinstrument voor mentaal welbevinden in Nederland]. Universiteit Twente: Enschede, The Netherlands. Available at: https://warwick.ac.uk/fac/sci/med/research/platform/wemwbs/using/translations/wemwbs_dutch_validation.pdf (Accessed 3 July 2023).
Jacobs, N., Kleen, M., De Groot, F., and A-Tjak, J., (2008). Measuring experiential avoidance. Dutch translation of the acceptance and action questionnaire-II (AAQ-II). Gedragstherapie 41, 349–361. Available at: https://www.researchgate.net/publication/285119774_Measuring_experiential_avoidance_The_Dutch_version_of_the_Acceptance_and_Action_Questionnaire-II_AAQ-II
Jiménez-Genchi, A., Monteverde-Maldonado, E., Nenclares-Portocarrero, A., Esquivel-Adame, G., and de la Vega-Pacheco, A. (2008). Reliability and factorial analysis of the Spanish version of the Pittsburg sleep quality index among psychiatric patients [Confiabilidad y análisis factorial de la versión en español del Indice de Calidad De Sueño de Pittsburgh en pacientes psiquiátricos]. Gac. Med. Mex. 144, 491–496. Available at: https://www.medigraphic.com/cgi-bin/new/resumen.cgi?IDARTICULO=21491
Jiménez-Molina, Á., Franco, P., Martínez, V., Martínez, P., Rojas, G., and Araya, R. (2019). Internet-based interventions for the prevention and treatment of mental disorders in Latin America: A scoping review. Front. Psych. 10:664. doi: 10.3389/fpsyt.2019.00664
Khansa, W., Haddad, C., Hallit, R., Akel, M., Obeid, S., Haddad, G., et al. (2020). Interaction between anxiety and depression on suicidal ideation, quality of life, and work productivity impairment: results from a representative sample of the Lebanese population. Perspect. Psychiatr. Care 56, 270–279. doi: 10.1111/ppc.12423
Kurniawan, K., Yosep, I., Maulana, S., Mulyana, A. M., Amirah, S., Abdurrahman, M. F., et al. (2022). Efficacy of online-based intervention for anxiety during COVID-19: A systematic review and Meta-analysis of randomized controlled trials. Sustain. For. 14:866. doi: 10.3390/su141912866
Lamers, F., van Oppen, P., Comijs, H. C., Smit, J. H., Spinhoven, P., van Balkom, A. J. L. M., et al. (2011). Comorbidity patterns of anxiety and depressive disorders in a large cohort study. J. Clin. Psychiatry 72, 341–348. doi: 10.4088/JCP.10m06176blu
Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., and Nguyen, T. D. (1979). Assessment of client/patient satisfaction: development of a general scale. Eval. Program Plann. 2, 197–207. doi: 10.1016/0149-7189(79)90094-6
Lean, M., Fornells-Ambrojo, M., Milton, A., Lloyd-Evans, B., Harrison-Stewart, B., Yesufu-Udechuku, A., et al. (2019). Self-management interventions for people with severe mental illness: systematic review and meta-analysis. Br. J. Psychiatry 214, 260–268. doi: 10.1192/bjp.2019.54
López-Ortega, M., Torres-Castro, S., and Rosas-Carrasco, O. (2016). Psychometric properties of the satisfaction with life scale (SWLS): secondary analysis of the Mexican health and aging study. Health Qual. Life Outcomes 14:170. doi: 10.1186/s12955-016-0573-9
Mancone, S., Diotaiuti, P., Valente, G., Corrado, S., Bellizzi, F., Vilarino, G. T., et al. (2023). The use of voice assistant for psychological assessment elicits empathy and engagement while maintaining good psychometric properties. Behav. Sci. 13:550. doi: 10.3390/bs13070550
Marcelle, E. T., Nolting, L., Hinshaw, S. P., and Aguilera, A. (2019). Effectiveness of a multimodal digital psychotherapy platform for adult depression: a naturalistic feasibility study. JMIR Mhealth Uhealth 7:e10948. doi: 10.2196/10948
Martínez-Arriaga, R. J., Dominguez-Rodriguez, A., Herdoiza-Arroyo, P. E., Robles-Garcia, R., de la Rosa-Gómez, A., Figueroa González, J. A., et al. (2023). Suicide risk and associated factors in healthcare workers seeking psychological support during COVID-19: a cross-sectional study. Psychol. Health Med. 28, 3076–3090. doi: 10.1080/13548506.2023.2216469
McAllister-Williams, R. H., Arango, C., Blier, P., Demyttenaere, K., Falkai, P., Gorwood, P., et al. (2020). The identification, assessment and management of difficult-to-treat depression: an international consensus statement. J. Affect. Disord. 267, 264–282. doi: 10.1016/j.jad.2020.02.023
Melville, K. M., Casey, L. M., and Kavanagh, D. J. (2010). Dropout from internet-based treatment for psychological disorders. Br. J. Clin. Psychol. 49, 455–471. doi: 10.1348/014466509X472138
Moreno, A. L., DeSousa, D. A., Souza, A. M. F. L. P., Manfro, G. G., Salum, G. A., Koller, S. H., et al. (2016). Factor structure, reliability, and item parameters of the Brazilian-Portuguese version of the GAD-7 questionnaire. Temas em Psicologia 24, 367–376. doi: 10.9788/TP2016.1-25
Mordkoff, J. (2019). A Simple Method for Removing Bias From a Popular Measure of Standardized Effect Size: Adjusted Partial Eta Squared Adv. Methods Pract. Psychol. Sci., 2. doi: 10.1177/2515245919855053
Moreno-Peral, P., Rodríguez-Morejón, A., Bellón, J. A., García-Huércano, C., and Martínez-Vispo, C., (2023). Effectiveness of a universal personalized intervention for the prevention of anxiety disorders: Protocol of a randomized controlled trial (the prevANS project). Internet Interv. 34:100640. doi: 10.1016/j.invent.2023.100640
Morgan, C., Mason, E., Newby, J. M., Mahoney, A. E. J., Hobbs, M. J., McAloon, J., et al. (2017). The effectiveness of unguided internet cognitive behavioural therapy for mixed anxiety and depression. Internet Interv. 10, 47–53. doi: 10.1016/j.invent.2017.10.003
Moshe, I., Terhorst, Y., Paganini, S., Schlicker, S., Pulkki-Råback, L., Baumeister, H., et al. (2022). Predictors of dropout in a digital intervention for the prevention and treatment of depression in patients with chronic Back pain: secondary analysis of two randomized controlled trials. J. Med. Internet Res. 24:e38261. doi: 10.2196/38261
Ortuño-Sierra, J., Santarén-Rosell, M., de Albéniz, A. P., and Fonseca-Pedrero, E. (2015). Dimensional structure of the Spanish version of the positive and negative affect schedule (PANAS) in adolescents and young adults. Psychol. Assess. 27, e1–e9. doi: 10.1037/pas0000107
Pan American Health Organization (2018). The burden of mental disorders in the region of the Americas. Washington, D.C.: PAHO.
Pang, Y., Zhang, X., Gao, R., Xu, L., Shen, M., Shi, H., et al. (2021). Efficacy of web-based self-management interventions for depressive symptoms: a meta-analysis of randomized controlled trials. BMC Psychiatry 21, 398–313. doi: 10.1186/s12888-021-03396-8
Parmanto, B., Lewis, A. N. Jr., Graham, K. M., and Bertolet, M. H. (2016). Development of the telehealth usability questionnaire (TUQ). Int J Telerehabil 8, 3–10. doi: 10.5195/ijt.2016.6196
Rith-Najarian, L. R., Boustani, M. M., and Chorpita, B. F. (2019). A systematic review of prevention programs targeting depression, anxiety, and stress in university students. J. Affect. Disord. 257, 568–584. doi: 10.1016/j.jad.2019.06.035
Roberts, R. E., and Attkisson, C. C. (1983). Assessing client satisfaction among hispanics. Eval. Program Plann. 6, 401–413. doi: 10.1016/0149-7189(83)90019-8
Rubel, J., Väth, T., Hanraths, S., Pruessner, L., Timm, C., Hartmann, S., et al. (2024). Evaluation of an online-based self-help program for patients with generalized anxiety disorder A randomized controlled trial. Internet Interv. 35:100716. doi: 10.1016/j.invent.2024.100716
Ruiz, F. J., Langer Herrera, Á. I., Luciano, C., Cangas, A. J., and Beltrán, I. (2013). Measuring experiential avoidance and psychological inflexibility: the Spanish version of the acceptance and action questionnaire-II. Psicothema 25, 123–129. doi: 10.7334/psicothema2011.239
Saddichha, S., Al-Desouki, M., Lamia, A., Linden, I. A., and Krausz, M. (2014). Online interventions for depression and anxiety – a systematic review. Health Psychol. Behav. Med. 2, 841–881. doi: 10.1080/21642850.2014.945934
Santos, J. J. A., Costa, T. A., Guilherme, J. H., Silva, W. C., Abentroth, L. R. L., Krebs, J. A., et al. (2015). Adaptation and cross-cultural validation of the Brazilian version of the Warwick-Edinburgh mental well-being scale. Rev. Assoc. Med. Bras. 61, 209–214. doi: 10.1590/1806-9282.61.03.209
Shafran, R., and Bennett, S. (2017). Interventions to support integrated psychological care and holistic health outcomes in Paediatrics. Healthcare 5:44. doi: 10.3390/healthcare5030044
Sikorski, F., König, H. H., Wegscheider, K., Zapf, A., Löwe, B., and Kohlmann, S. (2021). The efficacy of automated feedback after internet-based depression screening: study protocol of the German, three-armed, randomised controlled trial DISCOVER. Internet Interv. 25:100435. doi: 10.1016/j.invent.2021.100435
Siqueira Reis, R., Ferreira Hino, A. A., Añez, R. R., and C., (2010). Perceived stress scale: reliability and validity study in Brazil. J. Health Psychol. 15, 107–114. doi: 10.1177/1359105309346343
Spanhel, K., Balci, S., Feldhahn, F., Bengel, J., Baumeister, H., and Sander, L. B. (2021). Cultural adaptation of internet- and mobile-based interventions for mental disorders: a systematic review. NPJ Digit Med 4:128. doi: 10.1038/s41746-021-00498-1
Spijkerman, M. P. J., Pots, W. T. M., and Bohlmeijer, E. T. (2016). Effectiveness of online mindfulness-based interventions in improving mental health: A review and meta-analysis of randomised controlled trials. Clin. Psychol. Rev. 45, 102–114. doi: 10.1016/j.cpr.2016.03.009
Spitzer, R. L., Kroenke, K., Williams, J. B. W., and Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder. Arch. Intern. Med. 166, 1092–1097. doi: 10.1001/archinte.166.10.1092
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., et al. (2009). Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ 338:b2393. doi: 10.1136/bmj.b2393
Study Randomizer Software. (2017) Available at: https://www.studyrandomizer.com. (Accessed 13 December 2023)
Sullivan, M. J., Edgley, K., and Dehoux, E. (1990). A survey of multiple sclerosis: I. Perceived cognitive problems and compensatory strategy use. Can J Rehabil 4, 99–105.
Taylor, C. B., Graham, A. K., Flatt, R. E., Waldherr, K., and Fitzsimmons-Craft, E. E. (2021). Current state of scientific evidence on internet-based interventions for the treatment of depression, anxiety, eating disorders and substance abuse: an overview of systematic reviews and meta-analyses. Eur. J. Public Health 31, i3–i10. doi: 10.1093/eurpub/ckz208
Tennant, R., Hiller, L., Fishwick, R., Platt, S., Joseph, S., Weich, S., et al. (2007). The Warwick-Edinburgh mental well-being scale (WEMWBS): development and UK validation. Health Qual. Life Outcomes 5, 1–13. doi: 10.1186/1477-7525-5-63
The World Bank. (2023). Individuals using the internet (% of population)—Latin America & Caribbean. Available at: https://data.worldbank.org/indicator/IT.NET.USER.ZS?locations=ZJ
Thompson, E. M., Destree, L., Albertella, L., and Fontenelle, L. F. (2021). Internet-based acceptance and commitment therapy: A Transdiagnostic systematic review and Meta-analysis for mental health outcomes. Behav. Ther. 52, 492–507. doi: 10.1016/j.beth.2020.07.002
Tur, C., Campos, D., Herrero, R., Mor, S., López-Montoyo, A., Castilla, D., et al. (2021). Internet-delivered cognitive-behavioral therapy (iCBT) for adults with prolonged grief disorder (PGD): A study protocol for a randomized feasibility trial. BMJ Open 11, e046477. doi: 10.1136/bmjopen-2020-046477
van Eck, M., Berkhof, H., Nicolson, N., and Sulon, J. (1996). The effects of perceived stress, traits, mood states, and stressful daily events on salivary cortisol. Psychosom. Med. 58, 447–458. doi: 10.1097/00006842-199609000-00007
Vindegaard, N., and Benros, M. E. (2020). COVID-19 pandemic and mental health consequences: systematic review of the current evidence. Brain Behav. Immun. 89, 531–542. doi: 10.1016/j.bbi.2020.05.048
Watson, D., Clark, L. A., and Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS scales. J. Pers. Soc. Psychol. 54, 1063–1070. doi: 10.1037/0022-3514.54.6.1063
Weathers, F., Litz, B., Herman, D., Huska, J., and Keane, T. (2013). The PTSD checklist for DSM-5 (PCL-5). Scale available from the National Center for PTSD. Available at: https://www.ptsd.va.gov/professional/assessment/adult-sr/ptsd-checklist.asp
Weisel, K. K., Zarski, A.-C., Berger, T., Krieger, T., Schaub, M. P., Moser, C. T., et al. (2019). Efficacy and cost-effectiveness of guided and unguided internet- and mobile-based indicated transdiagnostic prevention of depression and anxiety (ICare prevent): A three-armed randomized controlled trial in four European countries. Internet Interv. 16, 52–64. doi: 10.1016/j.invent.2018.04.002
Wijnen, J., Gordon, N. L., van 't Hullenaar, G., Pont, M. L., Geijselaers, M. W. H., van Oosterwijck, J., et al. (2023). An interdisciplinary multimodal integrative healthcare program for depressive and anxiety disorders. Front. Psych. 14:1113356. doi: 10.3389/fpsyt.2023.1113356
World Health Organization. (2017). Depression and other common mental disorders: global health estimates. Available at: https://apps.who.int/iris/handle/10665/254610
World Health Organization. (2021). Mental health atlas 2020. Available at: https://www.who.int/publications/i/item/9789240036703
Yao, Y., and van Ours, J. C. (2015). Language skills and labor market performance of immigrants in the Netherlands. Labour Econ. 34, 76–85. doi: 10.1016/j.labeco.2015.03.005
Ye, Z., Li, W., and Zhu, R. (2022). Online psychosocial interventions for improving mental health in people during the COVID-19 pandemic: A systematic review and meta-analysis. J. Affect. Disord. 316, 120–131. doi: 10.1016/j.jad.2022.08.023
Zanon, C., Bardagi, M. P., Layous, K., and Hutz, C. S. (2014). Validation of the satisfaction with life scale to Brazilians: evidences of measurement noninvariance across Brazil and US. Soc. Indic. Res. 119, 443–453. doi: 10.1007/s11205-013-0478-5
Zwart, T., Smits, M., Egberts, T., Rademaker, C., and van Geijlswijk, I. (2018). Long-term melatonin therapy for adolescents and Young adults with chronic sleep onset insomnia and late melatonin onset: evaluation of sleep quality, Chronotype, and lifestyle factors compared to age-related randomly selected population cohorts. Healthcare 6:23. doi: 10.3390/healthcare6010023
Keywords: randomized controlled trial, anxiety, depression, internet-based intervention, self-guided, well-being
Citation: Dominguez-Rodriguez A, Herdoiza-Arroyo PE, González-Ramírez LP, Martínez-Arriaga RJ, Villarreal-Zegarra D, Silva ACS, González-Cantero JO, Vargas Salinas VS, Mensorio MS, Cisneros Hernández AA, Lourenço dos Santos R, Nieto Ramos EG, Albán-Terán MG, Mateu-Mollá J, Ramírez-Martínez FR, Colmenero Guadián AM, Martínez-Rubio D, Langer ÁI, Araya C and Castellanos-Vargas RO (2024) Internet-based self-administered intervention to reduce anxiety and depression symptomatology and improve well-being in 7 countries: protocol of a randomized control trial. Front. Psychol. 15:1279847. doi: 10.3389/fpsyg.2024.1279847
Edited by:
Mojtaba Vaismoradi, Nord University, NorwayReviewed by:
Fei Zhao, Northwest University for Nationalities, ChinaPierluigi Diotaiuti, University of Cassino, Italy
Abbas Mardani, Zanjan University of Medical Sciences, Iran
Copyright © 2024 Dominguez-Rodriguez, Herdoiza-Arroyo, González-Ramírez, Martínez-Arriaga, Villarreal-Zegarra, Silva, González-Cantero, Vargas Salinas, Mensorio, Cisneros Hernández, Lourenço dos Santos, Nieto Ramos, Albán-Terán, Mateu-Mollá, Ramírez-Martínez, Colmenero Guadián, Martínez-Rubio, Langer, Araya and Castellanos-Vargas. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alejandro Dominguez-Rodriguez, a.dominguezrodriguez@utwente.nl