Skip to main content

ORIGINAL RESEARCH article

Front. Digit. Health, 06 December 2022
Sec. Digital Mental Health
This article is part of the Research Topic Using digital solutions for Brief Interventions in Alcohol, Tobacco, other drugs use and gambling View all 6 articles

The effectiveness of a mobile intervention to reduce young adults’ alcohol consumption to not exceed low-risk drinking guidelines

  • 1Department of Clinical, Neuro and Developmental Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit, Amsterdam, Netherlands
  • 2Foundation Centrum ‘45, partner in Arq Psychotrauma Expert Group, Diemen, Netherlands
  • 3Arq Psychotrauma Expert Group, Diemen, Netherlands
  • 4Department of Psychiatry, Amsterdam University Medical Centers Location AMC, Amsterdam Public Health, Amsterdam, Netherlands
  • 5Department of Psychiatry, Amsterdam UMC-VUmc, Vrije Universiteit, Amsterdam, Netherlands

Background: Young adults’ drinking habits often exceed low-risk drinking guidelines. As young adults show increased access, use, and interest in personalized content related to physical and mental well-being, mobile applications might be a suitable tool to reach this target group. This study investigates the effectiveness of “Boozebuster”, a self-guided mobile application incorporating various therapeutic principles to reduce young adults’ alcohol consumption to not exceeding low-risk drinking guideline levels, compared to an educational website condition.

Method: Young adults aged 18–30 wanting to reduce their alcohol consumption entered a two-arm, parallel-group RCT. There were no minimum drinking severity inclusion criteria. Primary outcomes included alcohol consumption quantity and frequency. Secondary outcomes included binge drinking frequency and alcohol-related problem severity. Baseline, 6-week postbaseline, and 3-month post-baseline assessments were analyzed using linear mixed model analyses. Sex, treatment adherence, experienced engagement and motivation to change alcohol use behavior were investigated as moderators. Sub-group analyses contained problem drinkers and binge drinkers.

Results: 503 participants were randomized to the intervention or control condition. Results showed no intervention effects on primary or secondary outcomes compared to the control group. Both groups showed within-group reductions on all outcomes. Sub-group analyses in problem drinkers or binge drinkers showed similar results. Motivation to change drinking behavior and experienced engagement with the application significantly moderated the intervention effect regarding the quantity or frequency of alcohol consumption, respectively. Exploratory analyses showed that participants who indicated they wanted to change their drinking patterns during the initial PNF/MI module showed a significantly greater reduction in drinking quantity compared to those who indicated not wanting to change their drinking patterns.

Conclusion: The intervention group did not show a greater reduction in alcohol-related outcomes compared to the control group, but both groups showed a similar decrease. Potential explanations include similar effectiveness of both condition due to using a minimal active control in participants predominantly in the action stage of motivation to change. Future research should further explore the effectiveness of using mobile application to reduce young adults’ drinking behavior to not exceed low-risk drinking guideline levels and identify factors that motivate participants to engage with such an intervention.

Introduction

Alcohol consumption in young adults is widespread and a major health issue associated with physical, psychological, and social harm (1). Low-risk drinking guidelines have been developed in various countries and are aimed at moderating alcohol consumption and limiting alcohol-related harm (2, 3). For example, recent Dutch drinking guidelines (4) recommend not drinking at all or at least not more than one alcoholic drink per day for young and older adults. However, a substantial proportion of young and older adults commonly exceed low-risk drinking guidelines (5). About 8.9% of young adults are considered problem drinkers (6), defined as individuals who drink more than 14 or 21 standard glasses containing 10 g of ethanol per week for females or males, respectively. In addition, binge drinking (consuming at least 5 drinks during one occasion) occurs in about 11.4%–19.4% of young adults (7). Brief interventions such as personalized normative feedback (PNF) (8) have been found to be effective in reducing problematic alcohol use in young and older adults (9). To effectively reduce risky drinking behavior in young adults, ways to deliver these interventions to this target population need to be developed.

Exceeding low-risk drinking levels causes serious health problems (10) and a heavy social burden (11). Besides short-term and long-term morbidity and mortality (12), the consequences include accidents, sexual and physical assault, vandalism, and poor academic or work performance (1). Therefore, early identification and brief interventions have been increasingly reported to be cost-effective strategies to reduce problem drinking (9, 11, 13, 14). Evidence is most robust for brief interventions delivered in primary and secondary care (1517). However, effectiveness has also been shown in the general population (18, 19) and university students (20, 21). Unfortunately, the implementation of brief interventions is hampered due to the limited availability of trained professionals, the difficulty of reaching problem drinkers, and the high costs of implementation and delivery (22, 23). Consequently, as many as 80% of problem drinkers are not receiving support (24, 25).

Digital interventions focusing on health and mental well-being are commonly used by young adults and have seen an increased uptake during the COVID-19 pandemic (2628). Various digital interventions aimed at reducing drinking levels in young adults, mostly in university settings, have been evaluated. The majority of these interventions consist of internet-based single-session interventions based on PNF (8), general alcohol education programs (29), or brief interventions (30) that produce small but significant effect sizes ranging from g = 0.18 to g = 0.29 (3136). Most of the above-described digital interventions are delivered via a computer or web browser. It has been claimed that mobile applications might be more suitable for young adults given their flexibility, interactivity, and spontaneous nature (37). Although many mobile applications claiming to effectively reduce alcohol consumption are currently available in commercial app stores, the number of evidence-based mobile applications is limited and show mixed findings (38). More specifically, Colbert et al. (38) reviewed 12 studies on smartphone applications designed for adults from the general population or with an alcohol use disorder. Of these studies, 5 were RCTs of which 2 studies reported significant reductions in alcohol consumption outcomes compared with active or inactive control groups and 3 studies reported no differences in alcohol consumption outcomes compared with control groups.

Despite the potential benefits of using a mobile application, young adults show limited interest in receiving solely alcohol-related information as an intervention to reduce alcohol consumption (39). This could negatively affect their interest in such an intervention and consequently lead to reduced recruitment and engagement rates. To the best of our knowledge, this is the first smartphone application that has been developed in the Netherlands to reduce alcohol consumption to not exceed the low-risk guidelines in young adults. Given that young adults show increased access, use, and interest in healthy lifestyle related content delivered through mobile applications (40, 41), we have chosen a health promotion approach in developing the mobile application in order to make the application more appealing.

This study aimed to investigate the effectiveness of a mobile application (“Boozebuster”) in reducing young adults’ alcohol consumption to not exceed low-risk drinking guidelines. It is hypothesized that the intervention group will show a greater reduction in the alcohol-related outcome measures than the minimal active control group. In addition, potential factors that could moderate the effectiveness of digital interventions have been investigated such as motivation (42), adherence (43), and engagement (44) of the users. Moreover, research on treatment for problem drinking has predominantly focused on men, resulting in suboptimal interventions for women. Therefore, it is important to investigate if there are sex-dependent differences in the effectiveness of digital interventions in reducing alcohol consumption.

Materials and methods

Study design

We conducted a two-arm, parallel-group, randomized controlled trial (RCT) comparing a 6-week self-guided mobile application (“Boozebuster”) and compared it with an educational website condition containing information on the effects and health consequences of alcohol use. Due to the nature of the study design, blinding of group allocation was not possible. Detailed information about the study design is provided in the study protocol (45).

Randomization

Participants were randomized to receive either the intervention condition or the minimal active control condition. The allocation sequence was automatically generated via the computerized Castor EDC system using a 1:1 allocation ratio with random block sizes of 4 and 6. Stratification was based on sex and adherence to the Dutch drinking guidelines (drinking more or less than seven drinks per week and/or having at least one binge-drinking session in the past 30 days or not).

Sample size and power

Based on the individual patient data meta-analysis of Riper et al. (46) assessing brief interventions to reduce alcohol consumption in young adults compared to minimal-intervention controls, an effect size of g = 0.25 was deemed appropriate. With an α = .05 and 1−β = .80, these estimations resulted in a sample size of 253 per study arm (i.e., N = 506).

Participants

Recruitment took place between January 2021 and May 2021 via Facebook advertisements or an online recruitment website (i.e., Link2Trials.com). Inclusion criteria were: aged between 18 and 30 years, willingness to reduce drinking behavior as part of a healthy lifestyle, proficiency in reading and writing in Dutch, access to an Android or iOS device with a connection to the internet, and possession of an email address. A minimum drinking severity inclusion criterion was not applied as we chose a health promotion approach in which everyone interested in improving their health, including reducing their alcohol consumption, could participate. No exclusion criteria were applied.

Study procedure

The Scientific and Ethical Review Committee of the Faculty of Behavioral and Movement Sciences of the Vrije Universiteit Amsterdam approved the study protocol (VCWE-2018-045). The study was registered at the Netherlands Trial Register (NL8828). Individuals, who visited our study information website and were interested in participating, were screened on inclusion criteria on the website. Online informed consent was obtained from all participants after a complete description of the study. Those who met the criteria were entered into the computerized Castor Electronic Data Capturing (EDC) system (47) and received a link to fill out the baseline (T0) questionnaires. Participants were randomized to receive the intervention or the educational website. When allocated to the intervention condition, a link was sent to download the mobile application with a short description on how to use the app during the next 6 weeks. When allocated to the educational website condition, participants received a link directing them to the educational website. All participants were offered an incentive of €10 to complete the post-intervention assessment (T1) assessment and an additional €10 to complete the 3-month follow-up (T2) assessment.

Boozebuster intervention

Boozebuster contains seven modules focusing on alcohol use and multiple behavioral change techniques that could help to alter drinking patterns. The core components of the intervention focus on reducing drinking habits and incorporate therapeutic principles including personalized normative feedback (PNF) (8), motivational interviewing (MI) (48) and protective behavioral strategies (PBS) (49). Additional components that could facilitate low-risk drinking habits were focused on for example improving sleep and relieving stress.

The developmental process included several steps involving the potential end-users, which included interviews, brainstorm sessions and focus groups. First, students were interviewed on the need and desirability of a smartphone application to reduced alcohol consumption in young adults. Next, we brainstormed with several e-health experts on how to incorporate interactive components to the app and how to make it more attractive. Based on the acquired input, a conceptual framework for the application and feasible recruitment strategies were developed by the research team. The prototype was further evaluated in a focus group of potential end-users (i.e., representatives from the age-group ranging from 18 to 30 years old), after which the application was further adjusted to meet their preferences as expressed in the focus group. As a last step, a technical pilot was conducted (n = 15) to spot possible bugs and errors.

All participants started with the mandatory module containing PNF (36) and MI (48). In this module, drinking patterns were assessed and compared with peer norms and official Dutch drinking guidelines to create awareness about participants’ alcohol consumption compared to their peers and the guidelines. Participants were asked if they wanted to alter their drinking habits during the PNF module. If they responded positively, MI components followed with the intent to intrinsically motivate participants to change their drinking habits. On the other hand, if participants responded negatively, the module ended while thanking the participants for their time.

Subsequently, participants could choose which module they would like to follow and were able to revisit each module as desired. In the module focusing on goals, participants could select a goal they wished to achieve related to alcohol consumption, such as saving money, living healthier, or coping with peer pressure. Each goal was accompanied by a set of recommendations to achieve that goal. The mindfulness module presented participants with four guided meditations to relieve stress: a body scan, sleep meditation, urge surfing, and muscle relaxation. The sleeping module gave participants advice on improving their sleep quality. In the diary module, participants received daily notifications randomly between 9 AM and 9 PM to indicate the number of drinks consumed yesterday and rate their mood and sleep on a scale from 0 to 10. Responses were displayed as visual feedback enabling participants to monitor their progress. In addition, participants could report what they were grateful for in the gratitude diary. The final module contained an emergency button, providing recommendations based on protective behavioral strategies for acute cravings (49). In addition, these strategies could be modified by the participants by adding or removing strategies suitable for their individual needs.

Educational website condition

Participants allocated to the educational website condition received a link redirecting them to an educational website containing information on the effects and health consequences of alcohol use, without the additional components that were added in the app. The included information is commonly used for psychoeducation purposes and was slightly more extensive compared to the consequences of excessive alcohol consumption that were provided in the app. Participants in the control condition could revisit the website whenever they wanted.

Assessments

Participants of both groups were invited to fill out questionnaires at baseline (T0), 6-week post-intervention (T1), and 3-month follow-up (T2). Sociodemographic variables were assessed at baseline, including age, sex, education level, employment, and marital status. The key outcomes of this study are based on the recommendation of the Outcome Reporting in Brief Intervention Trials on Alcohol (ORBITAL) framework (50). An overview of the assessments at each time point is presented in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Overview of measurements, timepoints and instruments.

Primary outcomes

As the intervention could affect the quantity as well as the frequency of alcohol consumption, the primary outcomes of this study are the frequency and quantity of alcohol consumption, as measured in standard units containing 10 g of ethanol. The frequency and quantity of alcohol consumption were measured using the TimeLine Follow-Back questionnaire (TLFB) (51) by asking to report the number of standard units consumed per day for the past 30 days.

Secondary outcomes

Binge drinking frequency was assessed by asking participants the number of days they consumed 4 (for females) or 5 (for males) standard units on one occasion during the past 30 days. Alcohol-related problem severity was assessed using the Rutgers Alcohol Problem Index (RAPI) (52).

Moderators

Several potential moderators were assessed that could affect the effect size regarding the primary outcomes, including sex, motivation to change alcohol use behavior, engagement with the intervention (44), and treatment adherence (43). Baseline motivation to change alcohol use behavior was assessed using the Readiness to Change Questionnaire (RCQ) (53). Since only the intervention group received the mobile application, engagement with the intervention and intervention adherence could only be assessed in the intervention group. Experienced engagement with the intervention was assessed using the Twente Engagement with EHealth Technologies Scale (TWEETS) (54). Intervention adherence was calculated descriptively based on the percentage of participants who completed the main PNF/MI module.

Statistical analyses

Data analyses were performed using IBM SPSS version 27. Baseline between-group differences of continuous data were analyzed using independent-samples t-tests. Categorical data were analyzed using chi-square tests.

To analyze the effects on the primary and secondary outcomes, time (T0 vs. T1 vs. T2) by group (Boozebuster vs. educational website condition) Linear Mixed Model (LMM) analyses were conducted. LMM analysis takes the dependence between observations due to clustering of data by participants into account and allows for the number of observations between participants to be different (55). For all LMM analyses, a random intercept was used to correct the dependency of repeated measures. In addition, a random slope was included when the likelihood ratio test indicated that this was an improvement on the model. In all LMM analyses, the residuals were checked for normal distribution. Data were analyzed using the intention to treat (ITT) principle, as well as by using sensitivity analyses by the per-protocol (i.e., completed the first PNF/MI module) and the study completers analysis principle. Exploratory analyses were performed to investigate if the intervention might have been more effective for participants presenting with a particular drinking pattern, including problem drinkers (drinking more than 14/21 units per week for women/men), and binge drinkers (drinking more than 4/5 units per occasion for women/men in the last 30 days).

To investigate their moderating effect on the primary outcome measures, sex, motivation to change alcohol use behavior, engagement with the intervention, and treatment adherence were added as a factor in the LMM analyses. As engagement with the intervention and treatment adherence could only be assessed in the intervention group, moderation analyses regarding these measures were only performed in the intervention group.

Results

Participants

A total of 936 individuals met the inclusion criteria and were entered into the electronic data capturing system. Of these 936, 503 participants provided informed consent, completed the baseline questionnaires, and were randomized to the intervention condition (n = 252) or control condition (n = 251). Due to clerical errors, three participants were entered in the system twice, resulting in the randomization of 503 participants instead of 506. Of the 503 participants, 356 (70.8%) completed the T1 assessment, whereas 346 (68.8%) completed the T2 assessment. It must be noted that not all participants who completed the T2 assessment also completed the T1 assessment, and vice versa. More specifically, 104 (20.7%) participants did not complete any post-baseline assessments, 96 participants (19.1%) completed one assessment (T1 or T2), and 303 (60.2%) completed both assessments. Of the participants who completed only one assessment, 53 (55.2%) completed only the T1 assessment, whereas 43 participants (44.8%) completed only the T2 assessment. See Figure 1 for the CONSORT FLOW chart.

FIGURE 1
www.frontiersin.org

Figure 1. CONSORT flow diagram. Participants who did not complete post-treatment assessment were still allowed to complete the follow-up assessment.

Baseline characteristics are summarized in Table 2. At baseline, there were no between-group differences in demographic characteristics, including age, sex, education, and occupation. However, there was a between-group difference in marital status, with more participants being in a relationship than being single in the control condition (58.2% vs. 41.8%) compared to the intervention condition (51.2% vs. 48.8%). In addition, there were no between-group differences in alcohol use characteristics.

TABLE 2
www.frontiersin.org

Table 2. Baseline characteristics of participants who were randomized after completing the baseline assessment.

Primary outcomes

There was no main effect of group nor an interaction effect of group X time on either the quantity or the frequency of alcohol consumption. However, there was a significant effect of time on both the quantity and frequency of alcohol consumption in both groups. Regarding alcohol consumption quantity, both groups showed a decrease of around 17 units/month at T1 that slightly increased towards T2. Similar for alcohol consumption frequency, both groups showed a decrease of around 2 days per month at T1, but only the control group showed a slight increase towards T2 (see Table 3). Sensitivity analyses (i.e., per protocol and study completers analyses) resulted in similar results regarding the primary outcome variables as the ITT analyses (see Table 4).

TABLE 3
www.frontiersin.org

Table 3. Effect of Boozebuster app on primary and secondary outcome measures.

TABLE 4
www.frontiersin.org

Table 4. Sub-group analyses on the effect of Boozebuster app on primary outcome measures.

Secondary outcomes

There was no main effect of group nor an interaction effect of group X time on binge drinking frequency and RAPI scores. However, there was a significant main effect of time on both binge drinking frequency and RAPI scores. Regarding binge drinking frequency, both groups showed a decrease of around 1 binge drinking day in the last 30 days at T1, that slightly increased towards T2. In addition, both groups showed a decrease of around 3 points on the RAPI at T1, that continued towards a decrease of around 4.50 points at T2 (see Table 3).

Sub-group analyses

For both sub-group analyses (i.e., problem drinkers and binge drinkers), the results were identical to the ITT analyses with no between-group differences regarding the primary and secondary outcomes. More specifically, there was no main effect of group nor an interaction effect of group and time on the quantity or the frequency of alcohol consumption. However, both groups showed a decrease in the quantity and frequency of alcohol consumption over time (see Table 4). In the sub-group of problem drinkers, both groups showed a decrease in the quantity of alcohol consumption of around 20 units at T1, that slightly increased towards T2. In addition, both groups showed a decrease in alcohol consumption frequency of around 2.5 days per month at T1, that slightly increased towards T2. In the sub-group of binge drinkers, both groups showed a decrease in the quantity of alcohol consumption of around 20 units at T1, that slightly increased towards T2. In addition, both groups showed a decrease in alcohol consumption frequency of around 2 days per month at T1, that slightly increased towards T2. The results regarding all sub-group analyses are displayed in Table 4.

Moderation analyses

There were no moderating effects of sex regarding alcohol consumption quantity [F(1, 760.46) = 1.935, p = 0.17, d = 0.12] or frequency [F(1, 777.03) = 0.784, p = 0.38, d = 0.08].

Intervention adherence did not moderate the intervention effect on alcohol consumption quantity [F(1, 388.34)= 2.339, p = 0.13, d = 0.14] or frequency [F(1, 384.79) = 1.263, p = 0.26, d = 0.13]. In addition, there was no moderating effect of the number of times the app was opened on alcohol consumption quantity [F(66, 200.99) = 1.172, p = 0.20, d = 1,24] or frequency [F(66, 204.14) = 1.003, p = 0.48, d = 1.14].

Baseline motivation to change alcohol use behavior did not moderate the intervention effect on the frequency of alcohol consumption [F(33, 317.79) = 1.402, p = 0.08, d = 0.76]. However, there was a three-way interaction between group, time, and baseline RCQ scores regarding the quantity of alcohol consumption [F(33, 698.01) = 1.539, p = 0.03, d = 0.54]. The intervention effect was compared between participants with low and high baseline RCQ scores based on a median split. It seemed that, in participants with higher RCQ scores, there was a greater reduction in the quantity of alcohol consumption in the intervention group compared to the control group. This effect was not present in participants with lower RCQ scores.

Engagement with the intervention did not moderate the intervention effect on alcohol consumption quantity [F(34, 336.52) = 1.015, p = 0.45, d = 0.64]. However, engagement did moderate the intervention effect on alcohol consumption frequency [F(34, 331.223) = 1.657, p = 0.01, d = 0.82]. The intervention effect was compared between participants with low and high T1 TWEETS scores based on a median split. Both groups seemed to show a similar reduction in alcohol consumption frequency at T1, but the group with lower engagement showed a greater increase at the 3-month follow-up compared to the group with higher engagement.

Exploring the extent of app use

As the extent to which the app was used could substantially influence its effect on the outcome measures, additional exploratory analyses were performed to investigate if this was the case in this study. To this end, intervention effects were investigated in sub-groups that showed increasingly more extensive use of the app. The intervention effect was investigated for these sub-groups compared to the complete control group. Of the 252 participants, who were allocated to the intervention condition, 231 participants logged in to the app, and of those 161 opened the app at least once. Compared to the control group, there was no intervention effect in this group on the quantity of alcohol consumption [F(1, 347.36) = 0.527, p = 0.47, d = 0.07] or the frequency of alcohol consumption (F1, 349.51) = 0.009, p = 0.92, d = 0.01). Of these 161 participants, 128 participants completed the initial PNF/MI module. In this group there was no intervention effect on the quantity of alcohol consumption [F(1, 318.06) = 1.592, p = 0.21, d = 0.14] or the frequency of alcohol consumption [F(1, 318.64) = 0.821, p = 0.37, d = 0.10] compared to the control group. In the initial PNF/MI module, participants were asked if they wanted to alter their drinking patterns. Of the 128 participants who finished the module, 80 participants responded positively. Compared to the control group, there was an intervention effect on the quantity of alcohol consumption [F(1, 281.80) = 8.05, p < 0.01, d = 0.37], but not on the frequency of alcohol consumption [F(1, 280.141) = 3.43, p = 0.07, d = 0.24]. The participants who responded positively showed an average decrease in past 30-day consumption of 31.64 units from T0 to T2. In contrast, the control group showed an average decrease in past 30-day consumption of 15.08 units from T0 to T2. When comparing the participants who responded positively to the participants who responded negatively (n = 48), there also was an intervention effect on the quantity of alcohol consumption [F(1, 106.22) = 6.599, p = 0.01, d = 0.56], but not on the frequency of alcohol consumption [F(1, 218.24) = 3.726, p = 0.06, d = 0.42]. The participants who responded negatively showed an average decrease of 4.15 units from T0 to T2.

Discussion

This study aimed to investigate the effectiveness of a mobile application (“Boozebuster”) in reducing young adults’ alcohol consumption to not exceeding low-risk drinking guideline levels. Compared to the minimal active control group, there was no significant effect of the Boozebuster application on the primary outcomes, i.e., the quantity and frequency of alcohol consumption, nor on the secondary outcomes, i.e., binge drinking frequency or alcohol-related problem severity. However, both groups showed a significant reduction over time regarding these alcohol-related outcome measures. Furthermore, Boozebuster was not more effective compared to the minimal active control group in sub-groups of problem drinkers or binge drinkers. In addition, there was no moderating effect of sex and adherence concerning the primary outcomes. However, baseline motivation to change alcohol use behavior significantly moderated the treatment effect regarding the quantity of alcohol consumption in that the intervention group showed a greater reduction compared to the control group when motivation was higher, but that this difference was absent when motivation was lower. Experienced engagement with the intervention significantly moderated the frequency of alcohol consumption in that, after showing a similar alcohol consumption frequency at the post-intervention assessment, the group with higher engagement showed a lower drinking frequency at the 3-month follow-up compared to the group with lower engagement. Exploratory analysis on the extent to which the app was used indicated that participants who responded positively towards altering their drinking patterns in the initial PNF/MI module of the app showed a greater decrease in alcohol consumption quantity, but not frequency, compared to control group or participants who responded negatively.

Although positive effects of mobile applications on alcohol consumption have been reported in previous RCTs (56, 57), the current findings showed no differential effects of the mobile application compared to the educational website condition on alcohol-related outcomes (58, 59). As sensitivity analyses provided identical results, the current findings appear robust. One explanation for our groups’ similar decrease in alcohol consumption might be the participants’ motivation to develop a healthier lifestyle, including reducing their alcohol consumption to not exceeding low-risk drinking guideline levels. As in both groups almost 50% of the participants were in the action stage of their readiness to change, participating in this study might have been enough to activate them to develop this healthier lifestyle regardless of which group they were allocated to. Moreover, although solely alcohol-related information is of limited interest to young adults (39), the educational website can be seen as a minimal intervention and therefore could have been equally effective in reducing drinking behavior compared to the intervention.

Several moderators were investigated in the current study, including sex, motivation to change alcohol use behavior, experienced engagement with the intervention, and adherence. Only motivation to change alcohol use behavior and experienced engagement appeared to moderate the treatment effect on the quantity or frequency of alcohol consumption, respectively, which is in line with a previous study that only found an effect of a mobile application on alcohol consumption in participants engaged with the mobile application (60). Interestingly, an intervention effect on alcohol consumption quantity, but not frequency, was found in participants who indicated they wanted to change their drinking patterns during the PNF/MI module compared to the control group or participants who indicated not to be willing to change. Similar findings of a decrease in alcohol quantity, while the frequency remains stable, have been reported for the general population and university students that received brief alcohol interventions (61, 62). One potential explanation could be that young adults experience it to be easier to decrease the amount of alcohol consumption rather than maintaining complete abstinence, for example due to social desirability.

Strengths of this study include the large sample size, the open recruitment strategy, and being the first smartphone application that has been developed in the Netherlands to reduce young adults’ alcohol consumption to not exceed low-risk drinking guideline levels. Limitations of this study include using incentives for completing the follow-up assessments. This could have resulted in the inclusion of participants unwilling to change their drinking behavior, as indicated in the initial PNF/MI module. Another limitation is applying self-report measures to assess changes over time. Nevertheless, self-report measures have been found to be reliable for actual drinking levels in our target population (63). In addition, as a result of the health promotion approach, not all participants were frequent drinkers. Consequently, not all participants were able to reduce their alcohol consumption as it was already minimal, resulting in a potential floor effect. Lastly, the education website could be seen as a minimal intervention, in which participants received information about the effects and consequences of alcohol consumption. This could have resulted in similar effects compared to the intervention.

As the health promotion approach appeared to be a successful recruitment strategy, future research could benefit from identifying the factors that motivate people to engage with an intervention such as the Boozebuster app. Moreover, including a qualitative assessment of participants’ experience regarding the use of the application could result in improved participants’ engagement to future interventions. Furthermore, it should be investigated if this mobile application could be useful as a preventative strategy in people who already show more severe alcohol consumption levels such as problem drinking. Furthermore, the timeline of our study happened to take place during the COVID-19 pandemic, which may have affected our target group’s drinking and social patterns, resulting in reductions in alcohol consumption that were not a result of participating in the study. In addition, our study sample consisted mainly of women (87.7%). Sex is an important health determinant and the over-representation of women in our sample might have led to sampling bias limiting the generalizability of our findings. Future studies should further investigate moderating variables, such as motivation to alter drinking habits, engagement with the intervention and their impact on the intervention effectiveness. A more comprehensive understanding of these variables could ultimately contribute to the development of more effective interventions.

This study did not find a differential effect of the Boozebuster application on alcohol-related outcomes compared to a minimal active educational website condition, but similar reductions in both groups. This could potentially be due to high motivation to develop a healthier lifestyle in both groups, leading to equal effectiveness of application and the educational website. Moreover, choosing a health promotion approach in which everyone interested in improving their health, including reducing their alcohol consumption could participate appeared to be a successful recruitment strategy. Making alcohol-related information available and appealing to young adults might be an important contribution to tackling alcohol-related harms and improving this target group’s well-being. Future efforts to examine interventions delivered via mobile applications will be critical to establishing the added value of such approaches in reducing young adults’ drinking behavior to not exceed low-risk drinking guideline levels.

Data availability statement

The meta-data is available and raw data will be shared upon reasonable request from the authors if in line with GDPR.

Ethics statement

The study was reviewed and approved by The Scientific and Ethical Review Committee of the Faculty of Behavioral and Movement Sciences of the Vrije Universiteit Amsterdam (VCWE-2018-045). The patients/participants provided their written informed consent to participate in this study.

Author contributions

MHJS, NB, AK, ACH and HR designed the study and wrote the protocol. MHJS acquired the data and performed statistical analyses. MHJS and NB wrote the first version of the manuscript. All authors contributed to the article and approved the submitted version.

Funding

Anja Huizink received a grant from the European Foundation for Alcohol Research (ERAB) (grant: EA172). ERAB had no influence over the design, the evaluation, or the publication of the results.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Griswold MG, Fullman N, Hawley C, Arian N, Zimsen SRM, Tymeson HD, et al. Alcohol use and burden for 195 countries and territories, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet. (2018) 392(10152):1015–35. doi: 10.1016/S0140-6736(18)31310-2

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Bagnardi V, Rota M, Botteri E, Tramacere I, Islami F, Fedirko V, et al. Alcohol consumption and site-specific cancer risk: a comprehensive dose–response meta-analysis. Br J Cancer. (2015) 112(3):580–93. doi: 10.1038/bjc.2014.579

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Wiseman M. The second world cancer research fund/American institute for cancer research expert report. Food, nutrition, physical activity, and the prevention of cancer: a global perspective: nutrition society and BAPEN medical symposium on ‘nutrition support in cancer therapy’. Proc Nutr Soc. (2008) 67(3):253–56. doi: 10.1017/S002966510800712X

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Bartoli F, Carretta D, Crocamo C, Schivalocchi A, Brambilla G, Clerici M, et al. Prevalence and correlates of binge drinking among young adults using alcohol: a cross-sectional survey. Biomed Res Int. (2014) 2014:930795. doi: 10.1155/2014/930795

PubMed Abstract | CrossRef Full Text | Google Scholar

6. RIVM, Trimbos-instituut. Gezondheidsenquête/Leefstijlmonitor. (2020). Available from: https://www.trimbos.nl/kennis/cijfers/cijfers-alcohol

7. Quigley LA, Marlatt GA. Drinking among young adults: prevalence, patterns, and consequences. Alcohol Health Res World. (1996) 20(3):185–91.

PubMed Abstract | Google Scholar

8. Moreira MT, Oskrochi R, Foxcroft DR. Personalised normative feedback for preventing alcohol misuse in university students: solomon three-group randomised controlled trial. PLoS One. (2012) 7(9):e44120.22984466

PubMed Abstract | Google Scholar

9. Riper H, van Straten A, Keuken M, Smit F, Schippers G, Cuijpers P. Curbing problem drinking with personalized-feedback interventions: a meta-analysis. Am J Prev Med. (2009) 36(3):247–55. doi: 10.1016/j.amepre.2008.10.016

PubMed Abstract | CrossRef Full Text | Google Scholar

10. White H, Jackson K. Social and psychological influences on emerging adult drinking behavior. Alcohol Res Health. (2004) 28(4):182–90.

Google Scholar

11. Anderson P, Baumberg B. Alcohol in Europe – public health perspective: report summary. Drugs Educ Prev Policy. (2009) 13(6):483–88. doi: 10.1080/09687630600902477

CrossRef Full Text | Google Scholar

12. Song T, Qian S, Yu P. Mobile health interventions for self-control of unhealthy alcohol use: systematic review. JMIR Mhealth uhealth. (2019) 7(1):e10899. doi: 10.2196/10899

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Freemantle N, Gill P, Godfrey C, Long A, Richards C, Sheldon TA, et al. Brief interventions and alcohol use. Qual Health Care. (1993) 2(4):267. doi: 10.1136/qshc.2.4.267

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Office of the Surgeon General (US); National Institute on Alcohol Abuse and Alcoholism (US); Substance Abuse and Mental Health Services Administration (US). The Surgeon General’s Call to Action To Prevent and Reduce Underage Drinking. Surg Gen Call to Action To Prev Reduce Underage Drink. (2007) [cited 2022 Jul 5]; Available from: https://www.ncbi.nlm.nih.gov/books/NBK44360/

15. Kaner EFS, Beyer F, Dickinson HO, Pienaar E, Campbell F, Schlesinger C, et al. Effectiveness of brief alcohol interventions in primary care populations. Cochrane Database Syst Rev. (2007) 2(2):CD004148. doi: 10.1002/14651858.CD004148.pub4 [cited 2022 Jul 5]; Available from: https://pubmed.ncbi.nlm.nih.gov/17443541/

CrossRef Full Text | Google Scholar

16. Ballesteros J, Duffy JC, Querejeta I, Ariño J, González-Pinto A. Efficacy of brief interventions for hazardous drinkers in primary care: systematic review and meta-analyses. Alcohol Clin Exp Res. (2004) 28(4):608–18. doi: 10.1097/01.ALC.0000122106.84718.67

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Cuijpers P, Riper H, Lemmers L. The effects on mortality of brief interventions for problem drinking: a meta-analysis. Addiction. (2004) 99(7):839–45. doi: 10.1111/j.1360-0443.2004.00778.x

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Moyer A, Finney JW, Swearingen CE, Vergun P. Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment-seeking and non-treatment-seeking populations. Addiction. (2002) 97(3):279–92. doi: 10.1046/j.1360-0443.2002.00018.x

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Apodaca TR, Miller WR. A meta-analysis of the effectiveness of bibliotherapy for alcohol problems. J Clin Psychol. (2003) 59(3):289–304. doi: 10.1002/jclp.10130

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Carey KB, Scott-Sheldon LAJ, Carey MP, DeMartini KS. Individual-level interventions to reduce college student drinking: a meta-analytic review. Addict Behav. (2007) 32(11):2469–94. doi: 10.1016/j.addbeh.2007.05.004

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Prosser T, Gee KA, Jones F. A meta-analysis of effectiveness of E-interventions to reduce alcohol consumption in college and university students. J Am Coll Health. (2018) 66(4):292–01. doi: 10.1080/07448481.2018.1440579

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Moyer A, Finney JW. Brief interventions for alcohol problems: factors that facilitate implementation. Alcohol Res Health. (2004) 28(1):44.19006991

PubMed Abstract | Google Scholar

23. Kaner EF, Lock CA, McAvoy BR, Heather N, Gilvarry E. A RCT of three training and support strategies to encourage implementation of screening and brief alcohol intervention by general practitioners. Br J Gen Pract. (1999) 49(446):699–703.10756610

PubMed Abstract | Google Scholar

24. Cunningham JA, Breslin FC. Only one in three people with alcohol abuse or dependence ever seek treatment. Addict Behav. (2004) 29(1):221–3. doi: 10.1016/S0306-4603(03)00077-7

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Andrews G, Issakidis C, Sanderson K, Corry J, Lapsley H. Utilising survey data to inform public policy: comparison of the cost-effectiveness of treatment of ten mental disorders. Br J Psychiatry. (2004) 184:526–33. doi: 10.1192/bjp.184.6.526

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Waselewski ME, Waselewski EA, Wasvary M, Wood G, Pratt K, Chang T, et al. Perspectives on telemedicine from a national study of youth in the United States. Telemed J E Health. (2021) 28(4):575–82. doi: 10.1089/tmj.2021.0153

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Kemp J, Chorney J, Kassam I, MacDonald J, MacDonald T, Wozney L, et al. Learning about the current state of digital mental health interventions for Canadian youth to inform future decision-making: mixed methods study. J Med Internet Res. (2021) 23(10):e30491. doi: 10.2196/30491

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Lupton D. Young people’s use of digital health technologies in the global north: narrative review. J Med Internet Res. (2021) 23(1):e18286. doi: 10.2196/18286

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Reiss E. Evaluation of an Online Alcohol Education Program for First-time-in-College Students. Electron Theses Diss 2004–2019. (2010). [cited 2021 Apr 13]. Available from: https://stars.library.ucf.edu/etd/4195

30. Saitz R, Helmuth ED, Aromaa SE, Guard A, Belanger M, Rosenbloom DL. Web-based screening and brief intervention for the spectrum of alcohol problems. Prev Med (Baltim). (2004) 39(5):969–75. doi: 10.1016/j.ypmed.2004.04.011

CrossRef Full Text | Google Scholar

31. Carey KB, Scott-Sheldon LAJ, Elliott JC, Garey L, Carey MP. Face-to-face versus computer-delivered alcohol interventions for college drinkers: a meta-analytic review, 1998 to 2010. Clin Psychol Rev. (2012) 32(8):690–03. doi: 10.1016/j.cpr.2012.08.001

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Carey KB, Scott-Sheldon LAJ, Elliott JC, Bolles JR, Carey MP. Computer-delivered interventions to reduce college student drinking: a meta-analysis. Addiction. (2009) 104(11):1807–19. doi: 10.1111/j.1360-0443.2009.02691.x

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Foxcroft DR, Moreira MT, Almeida Santimano NML, Smith LA. Social norms information for alcohol misuse in university and college students. Cochrane Database Syst Rev. (2015) 1:CD006748. doi: 10.1002/14651858.CD006748.pub3

PubMed Abstract | CrossRef Full Text | Google Scholar

34. White A, Kavanagh D, Stallman H, Klein B, Kay-Lambkin F, Proudfoot J, et al. Online alcohol interventions: a systematic review. J Med Internet Res. (2010) 12(5):e62. doi: 10.2196/jmir.1479

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Samson JE, Tanner-Smith EE. Single-session alcohol interventions for heavy drinking college students: a systematic review and meta-analysis. J Stud Alcohol Drugs. (2015) 76(4):530–43. doi: 10.15288/jsad.2015.76.530

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Dotson KB, Dunn ME, Bowers CA. Stand-alone personalized normative feedback for college student drinkers: a meta-analytic review, 2004 to 2014. PLoS One. (2015) 10(10):e0139518. doi: 10.1371/journal.pone.0139518

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Seko Y, Kidd S, Wiljer D, McKenzie K. Youth mental health interventions via mobile phones: a scoping review. Cyberpsychol Behav Soc Netw. (2014) 17:591–02. doi: 10.1089/cyber.2014.0078

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Colbert S, Thornton L, Richmond R. Smartphone apps for managing alcohol consumption: a literature review. Addict Sci Clin Pract. (2020) 15:17. doi: 10.1186/s13722-020-00190-x

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Gaume J, Grazioli VS, Paroz S, Fortini C, Bertholet N, Daeppen JB. Developing a brief motivational intervention for young adults admitted with alcohol intoxication in the emergency department – results from an iterative qualitative design. PLoS One. (2021) 16(2):e0246652. doi: 10.1371/journal.pone.0246652

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Naslund JA, Aschbrenner KA. Technology use and interest in digital apps for mental health promotion and lifestyle intervention among young adults with serious mental illness. J Affect Disord Reports. (2021) 6:100227. doi: 10.1016/j.jadr.2021.100227

CrossRef Full Text | Google Scholar

41. Dallinga JM, Mennes M, Alpay L, Bijwaard H, De La Faille-Deutekom MB. App use, physical activity and healthy lifestyle: a cross sectional study. BMC Public Health. (2015) 15(1):1–9. doi: 10.1186/s12889-015-2165-8

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Diclemente CC, Bellino LE, Neavins TM. Motivation for change and alcoholism treatment. Alcohol Res Health. (1999) 23(2):86.10890801

PubMed Abstract | Google Scholar

43. Gonçalves MF, Bedendo A, Andrade ALM, Noto AR. Factors associated with adherence to a web-based alcohol intervention among college students. Estud Psicol. (2020) 38:1–12. doi: 10.1590/1982-0275202138e190134

CrossRef Full Text | Google Scholar

44. Luderer HF, Campbell ANC, Nunes EV, Enman NM, Xiong X, Gerwien R, et al. Engagement patterns with a digital therapeutic for substance use disorders: correlations with abstinence outcomes. J Subst Abuse Treat. (2022) 132:108585. doi: 10.1016/j.jsat.2021.108585

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Boumparis N, Schulte MH, Kleiboer A, Huizink A, Riper H. A mobile intervention to promote low-risk drinking habits in young adults: protocol for a randomized controlled trial. JMIR Res Protoc. (2021) 10(6):e29750. doi: 10.2196/29750

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Riper H, Hoogendoorn A, Cuijpers P, Karyotaki E, Boumparis N, Mira A, et al. Effectiveness and treatment moderators of internet interventions for adult problem drinking: an individual patient data meta-analysis of 19 randomised controlled trials. Degenhardt L, editor. PLoS Med. (2018) 15(12):e1002714. doi: 10.1371/journal.pmed.1002714

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Castor EDC. Castor Electronic Data Capture. (2019). Available from: https://castoredc.com

48. Rollnick S, Miller WR. What is motivational interviewing? Behav Cogn Psychother. (1995) 23(04):325. doi: 10.1017/S135246580001643X

CrossRef Full Text | Google Scholar

49. Martens MP, Taylor KK, Damann KM, Page JC, Mowry ES, Cimini MD. Protective behavioral strategies when drinking alcohol and their relationship to negative alcohol-related consequences in college students. Psychol Addict Behav. (2004) 18(4):390–93. doi: 10.1037/0893-164X.18.4.390

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Shorter G. Outcome Reporting in Brief Intervention Trials on Alcohol (ORBITAL). (2020). Available from: https://osf.io/m57nv

51. Sobell LC, Brown J, Leo GI, Sobell MB. The reliability of the Alcohol Timeline Followback when administered by telephone and by computer. Drug Alcohol Depend. (1996) 42(1):49–54. doi: 10.1016/0376-8716(96)01263-X

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Dick DM, Aliev F, Viken R, Kaprio J, Rose RJ. Rutgers Alcohol problem index scores at age 18 predict alcohol dependence diagnoses 7 years later. Alcohol Clin Exp Res. (2011) 35(5):1011–4. doi: 10.1111/j.1530-0277.2010.01432.x

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Heather N, Rollnick S, Bell A. Predictive validity of the readiness to change questionnaire. Addiction. (1993) 88(12):1667–77. doi: 10.1111/j.1360-0443.1993.tb02042.x

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Kelders SM, Kip H. Development and initial validation of a scale to measure engagement with eHealth technologies. Conference on human factors in computing systems - proceedings. New York, NY, United States: Association for Computing Machinery (2019). p. 1–6. [cited 2020 Apr 20] Available from: https://dl.acm.org/doi/10.1145/3290607.3312917

55. Pinheiro JC. Linear Mixed Effects Models for Longitudinal Data. Wiley StatsRef Stat Ref Online. (2014).

56. Crane D, Garnett C, Michie S, West R, Brown J. A smartphone app to reduce excessive alcohol consumption: identifying the effectiveness of intervention components in a factorial randomised control trial. Sci Rep. (2018) 8(1). doi: 10.1038/s41598-018-22420-8

CrossRef Full Text | Google Scholar

57. Gustafson DH, McTavish FM, Chih MY, Atwood AK, Johnson RA, Boyle MG, et al. A smartphone application to support recovery from alcoholism: a randomized clinical trial. JAMA Psychiatry. (2014) 71(5):566–72. doi: 10.1001/jamapsychiatry.2013.4642

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Mellentin AI, Nielsen B, Nielsen AS, Yu F, Mejldal A, Nielsen DG, et al. A mobile phone app featuring cue exposure therapy as aftercare for alcohol use disorders: an investigator-blinded randomized controlled trial. JMIR Mhealth Uhealth. (2019) 7(8):e13793. doi: 10.2196/13793

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Aharonovich E, Stohl M, Cannizzaro D, Hasin D. Healthcall delivered via smartphone to reduce co-occurring drug and alcohol use in HIV-infected adults: a randomized pilot trial. J Subst Abuse Treat. (2017) 83:15–26. doi: 10.1016/j.jsat.2017.09.013

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Attwood S, Parke H, Larsen J, Morton KL. Using a mobile health application to reduce alcohol consumption: a mixed-methods evaluation of the drinkaware track & calculate units application. BMC Public Health. (2017) 17(1):394. doi: 10.1186/s12889-017-4358-9

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Baer JS, Kivlahan DR, Blume AW, McKnight P, Marlatt GA. Brief intervention for heavy-drinking college students: 4-year follow-up and natural history. Am J Public Health. (2011) 91(8):1310–6. doi: 10.2105/AJPH.91.8.1310

CrossRef Full Text | Google Scholar

62. Platt L, Melendez-Torres GJ, O’Donnell A, Bradley J, Newbury-Birch D, Kaner E, et al. How effective are brief interventions in reducing alcohol consumption: do the setting, practitioner group and content matter? Findings from a systematic review and metaregression analysis. BMJ Open. (2016) 6(8):e011473. doi: 10.1136/bmjopen-2016-011473

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Northcote J, Livingston M. Accuracy of self-reported drinking: observational verification of ‘last occasion’ drink estimates of young adults. Alcohol Alcohol. (2011) 46(6):709–13. doi: 10.1093/alcalc/agr138

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: young adults (18–29 years), alcohol, e-health, smartphone, RCT - randomized controlled trial, low-risk drinking guidelines

Citation: Schulte MH, Boumparis N, Kleiboer A, Wind TR, Olff M, Huizink AC and Riper H (2022) The effectiveness of a mobile intervention to reduce young adults’ alcohol consumption to not exceed low-risk drinking guidelines. Front. Digit. Health 4:1016714. doi: 10.3389/fdgth.2022.1016714

Received: 11 August 2022; Accepted: 8 November 2022;
Published: 6 December 2022.

Edited by:

Uffe Kock Wiil, University of Southern Denmark, Denmark

Reviewed by:

Gerard Anmella, Hospital Clinic of Barcelona, Spain
Lou Farrer, Australian National University, Australia

© 2022 Schulte, Boumparis, Kleiboer, Wind, Olff, Huizink and Riper. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Mieke H.J. Schulte miekehjschulte@gmail.com

These authors have contributed equally to this work

Specialty Section: This article was submitted to Digital Mental Health, a section of the journal Frontiers in Digital Health

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.