Skip to main content

ORIGINAL RESEARCH article

Front. Public Health, 23 December 2022
Sec. Public Health and Nutrition
This article is part of the Research Topic Healthy Eating and Parenting Messages to Prevent Obesity View all 11 articles

Process and effect evaluation of the app-based parenting program Samen Happie! on infant zBMI: A randomized controlled trial

  • 1Behavioural Science Institute, Radboud University, Nijmegen, Netherlands
  • 2NUTRIM School of Nutrition and Translational Research in Metabolism, Maastricht University Medical Center, Maastricht, Netherlands
  • 3Academic Collaborative Centre AMPHI, Primary and Community Care, Radboud University Medical Centre, Nijmegen, Netherlands
  • 4Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen, Netherlands

Background: Although energy balance-related parenting practices are regarded critical components in the prevention of childhood obesity, most programs targeting parenting practices with respect to a wide range of energy balance-related behaviors were not aimed at high-risk families with a lower socioeconomic position (SEP).

Objective: The Samen Happie! app-based program aimed to stimulate healthy child weight development especially among families with a lower SEP, by encouraging healthy energy balance-related parenting practices.

Methods: A two-armed randomized controlled trial examined the process and effectiveness of the Samen Happie! program on child zBMI outcomes at 6- and 12-months follow-up. In total, 357 Dutch parents with infants aged 5–15 months old at baseline participated. Parents in the app condition (n = 179) received access to the Samen Happie! app and were compared to a waitlist-control condition (n = 178). Changes in zBMI were examined through linear mixed-effects models based on intention-to-treat and exploratory per-protocol principles.

Results: Process data showed low levels of sustained app use and moderate app acceptability. A general increase in child zBMI was observed in both conditions after 6 and 12 months. Intention-to-treat analyses using multiple imputations showed several statistically significant differences between conditions and high-risk subgroups. Specifically, at 6-months follow-up, zBMI increase was least pronounced in the app condition among children of parents with lower educational level. These findings were supported by exploratory per-protocol analyses including only frequent app users. In addition, per-protocol analyses showed benefits of app use at 6-months follow-up for children of parents with higher BMI. However, these effects were reversed at 12-months follow-up in both intention-to-treat and per-protocol analyses, where children of parents in the app condition in general increased the most in zBMI.

Conclusions: This study suggests that the Samen Happie! program might prevent zBMI increases after 6 months among children of parents with lower educational level, and children of parents with higher BMI who more frequently use the app. However, the app did not prevent increases in zBMI after 12 months. Future research should investigate strategies to increase sustained app use and engagement in mHealth parenting programs for childhood obesity as well as options to combine app-based programs with additional support strategies aimed at high-risk families.

Trial registration: Netherlands trial register (ID: NTR6938), https://trialsearch.who.int/Trial2.aspx?TrialID=NTR6938.

1. Introduction

Childhood overweight and obesity remain urgent medical and societal problems that disproportionally affect children coming from families with a lower socioeconomic position (SEP). On average, 8% of Dutch children around the age of 2 had overweight or obesity in 2018 (1), but the prevalence varies based on parental educational level [i.e., a common indicator of SEP showing consistent inverse associations with child adiposity; (2, 3)]. Compared to children of higher-educated parents, Dutch children of parents with middle and lower educational level have 1.96- and 2.76-times higher risks of developing overweight and obesity in childhood, respectively (4). This SEP-gradient in adiposity, as well as the various obesity-related physical and psychosocial health consequences (5), the difficulty to treat the condition (6), the link between rapid weight gain in infancy and childhood overweight (7, 8), and the likelihood of obesity tracking into childhood and adulthood (9, 10) all emphasize the need for early obesity prevention tailored at families of parents with lower educational levels. As such, it is imperative that healthy energy balance-related behaviors [EBRBs: i.e., dietary intake, sleep, and physical (in)activity] underlying weight changes are established as soon as possible, during the first years of life (11). In these early years, children's EBRBs and subsequent weight status are predominantly managed and supported by their parents. This makes the stimulation of healthy energy balance-related parenting practices [i.e., specific, discrete, and observable acts of parenting related to child EBRB; (12)] a key component in early preventive interventions for childhood obesity (13). The goal of the present study is to test an innovative app-based preventive program for early childhood obesity addressing healthy energy balance-related parenting practices.

Of note, previous prevention programs have already shown potential positive effects on healthy weight outcomes by promoting parenting practices with respect to child dietary intake [e.g., responsive feeding (1416), structure and rule setting (14)], and sleep [e.g., bedtime routines; (17)]. Moreover, reviews on parenting practices related to child physical activity suggest the importance of parental role modeling (18, 19). However, most early childhood prevention programs (i.e., < 5 years) targeting energy balance-related parenting have been limited in one of two ways. They either targeted some (but not all) EBRBs [i.e., most focused on dietary intake and/or physical activity; (16)] or they were universal (i.e., population-based) in nature, thereby not specifically directed at families that need it the most, including those with a lower SEP (16, 20, 21). As patterns of energy balance-related behaviors tend to cluster and unhealthier clusters are more frequently observed in families with a lower SEP [e.g., (22, 23)], targeting multiple EBRBs in families with lower SEP seems imperative. Our preventive parenting program aimed to overcome these limitations of previous studies by preventing childhood obesity through the stimulation of healthy parenting practices with respect to three important child EBRBs [i.e., child dietary intake, sleep, and physical (in)activity], while simultaneously applying selective prevention to a subgroup of parents with a lower SEP.

Our preventive parenting program was delivered via an app to facilitate the reach of deprived populations (24) and included relevant and engaging content and techniques through continuous co-creation with the target group. As such, our app-based program may specifically benefit families with a lower SEP that need the most help in terms of improving parenting practices and the home food environment (2528). Moreover, two other risk groups that might also benefit more from the program are children of parents who have overweight and those of parents who experience mental health problems. To date, reviews have shown that children of parents with overweight or obesity have increased chances of developing overweight in childhood (29, 30). Although the exact mechanisms underlying this association are complex, it is presumed that a generally unhealthier home environment and more obesity-promoting parenting practices [e.g., parents with overweight apply less modeling of healthy food intake; (31)] can exacerbate the child's genetic predisposition for adiposity [e.g., (30, 32)]. Moreover, parental mental health problems can affect child development through various mechanisms [e.g., epigenetic processes during pregnancy (33), changes in breast milk (34)], including unhealthy parenting mechanisms in which mental problems impact parents' own EBRBs and reduce parents' responsiveness to their children's needs (35). Specifically, mothers who experience depressive symptoms more often apply unhealthy parenting practices such as parental modeling of unhealthy food intake, using food as a reward, and providing less structured sleep and activity-time (3539). Notably, as our program targets particularly those parenting practices that are often less optimal among parents with obesity and depressive symptoms, children of these parents might also benefit more from the program. In addition, the app also targeted parents' own wellbeing by offering strategies to reduce stress and enjoy parenting (e.g., mindful parenting), and children of parents with depressive symptoms might experience benefits because of this as well. As the program aims to facilitate both child health and parental wellbeing and focuses for a large part on child dietary intake, we gave the program a Dutch title with a double meaning: Samen Happie!. Literal translations are “Happy Together” or “Eating Together,” but neither of these titles reflect the play on words in the Dutch language. We will therefore use the Dutch title throughout the paper.

1.1. The present study

The present study examined the effectiveness of the Samen Happie! app-based program in terms of reach, use, acceptability, and child zBMI among Dutch parents and infants (aged 5–15 months at the start of the program). We hypothesized that children of parents who used the Samen Happie! app would have a lower zBMI at 6 and 12 months after the start of the program than children of parents who did not use the app. Furthermore, we expected that these effects on child zBMI after 6 and 12 months would be particularly strong for children of parents who had a lower educational level, higher BMI, and more depressive symptoms.

2. Materials and methods

This randomized controlled intervention study employed a between-participants design with two parallel conditions: an app-based intervention condition and a waitlist-control condition. This study is part of a larger preventive intervention program being evaluated in two separate trials (i.e., Trial 1 included parents of infants and Trial 2 included parents of toddlers), both of which have been published together as study protocol (40). The present study focused on the process and effectiveness of the program in Trial 1. Key elements of the protocol pertaining to this trial are described below. The methods, materials, and analyses for this study were pre-registered (https://osf.io/hfvda).

2.1. Study participants and procedures

Trial 1 of the Samen Happie! program was conducted in the Netherlands between January 2018 and November 2019. Parents were eligible for participation in this trial if their child was between 5 and 15 months old at baseline and did not suffer from chronic disease or disability that severely affected normal development (e.g., chromosomal disorders, diabetes, cystic fibrosis), as indicated by parents in a web-based screening. We asked the primary caregiver of a child to participate in the trial. We further strived to include a minimum of 300 parents, of whom at least 50% had a middle or lower educational level [see study protocol (40) for power calculations]. Participants were recruited both offline (e.g., through child day care centers and preventive child health clinics for young children) and online (e.g., through Facebook groups). A diversity of locations and websites were used to ensure recruitment took place among parents of all educational levels. Eligible parents who completed the screening were forwarded to a consent form and subsequent baseline questionnaire. Parents were enrolled in the trial when they completed the web-based screening, the consent form, and the baseline questionnaire. Parents in both conditions were told that the aim of the trial was to investigate ways to assist families in healthy parenting, and that half of the study participants would receive an app that could help with healthy parenting. Parents that were allocated to the waitlist-control condition knew that they would receive access to the app at the end of the trial. The procedures of the trial were approved by the Ethics Committee Social Sciences, Radboud University, the Netherlands (ECSS-2017-013).

Randomization of the enrolled parents took place in September 2018. A simple randomization procedure (i.e., a computer-generated list of random numbers) to randomly allocate participants to the app or control condition (allocation ratio 1:1) was performed by an independent researcher using SPSS version 24. Among research with larger sample sizes (N > 200), this procedure can be trusted to produce equal samples in terms of numbers and covariates (41, 42). Parents who were allocated to the app condition received a personal invitation code for the Samen Happie! app and instructions on how to download and use the app. There were no instructions regarding the timing and frequency of the use of the app to stay as close as possible to app usage patterns in everyday life. A visual representation of the trial flow and its timing is presented in Figure 1.

FIGURE 1
www.frontiersin.org

Figure 1. Flow chart of the Samen Happie! trial including information on its design, timing, and number of participants.

2.2. The Samen Happie! program

The Samen Happie! program was developed using the Intervention Mapping Protocol (43), which included the integration of theory and empirical evidence as well as data from and continued co-creation with the target population. The program specifically addressed the needs of parents with a lower SEP through tailored program content and theory-based behavior change techniques, which were selected from behavior change taxonomies by Kok et al. (44) and Michie et al. (45). The program was delivered via a stand-alone, easy-to-use app consisting of five age-based modules: 7–12, 12–15, 15–18, 18–24, and 24–28 months. All parents in Trial 1 started in one of the first three modules at baseline. When the child reached the minimum age of the subsequent module, the new module became unlocked. Each age-based module provided parents with information (i.e., lessons) and exercises (i.e., challenges) about healthy parenting practices with respect to child EBRBs, as well as parental wellbeing and child temper (only lessons). Information in the lessons was presented in an engaging and easy-to-comprehend way, for instance through facts (“Did you know…?”), practical examples, tips, and quizzes, and was supported by icons and pictures. The challenges consisted of exercises that prompted parents to apply the information from the lessons in their day-to-day life. By employing techniques that tackle (unhealthy) automatic behaviors, parents were encouraged to implement (newly learned) parenting skills as habits. A more detailed description of the development, design, and content of the program can be found in the study protocol (40).

2.3. Data collection

Data were collected via web-based questionnaires at three timepoints: before the start of the program (T0), and after ~6 (T1) and 12 months (T2; see Figure 1 for the timing of the questionnaires). Non-responders were sent reminders via e-mail every 2 weeks during the measurement periods, with a maximum of 10 reminders at T2. Participants were compensated for their time and effort with a €10 gift card or a pack of diapers upon completing each questionnaire. Mean ages of the children at each questionnaire were 9.85 (SD = 2.24), 15.37 (SD = 2.54), and 22.87 (SD = 2.47) months at T0–T2, respectively.

2.3.1. Assessment of child and parent characteristics

2.3.1.1. Sociodemographic characteristics

Sociodemographic characteristics of the child that were collected at baseline (T0) included age, sex, and whether the child was first-born. Regarding breastfeeding, parents reported whether the child was ever breast-fed and the duration of breastfeeding (in months) at each measurement (T0-T2). For the parent, the following sociodemographic characteristics were collected at T0: age, relationship to child (i.e., biological father, biological mother, or other: foster, adoptive or other non-biological father/mother, partner of the biological father/mother, grandfather/grandmother, or guardian), educational level (i.e., primary school, preparatory vocational education, vocational education, pre-university, university), country of birth, parental relationship status, employment status, and financial difficulty (i.e., having difficulty paying bills over the past year). Parental educational level was dichotomized as lower (i.e., primary school, preparatory vocational education, vocational education) and higher educational level (i.e., pre-university and university).

2.3.1.2. Parental depressive symptoms

Parental depressive symptoms were assessed using the Edinburg Postnatal Depression Scale [EPDS; (46)], which is a brief and highly acceptable self-report scale that can be reliably be used in non-postnatal women with older children (47). We used the Dutch translation validated by Pop et al. (48). The questionnaire consists of 10 Likert-scale items (response categories: 0–3) in which parents report how they felt in the past 7 days (e.g., “I have felt sad or miserable”). A total score for depressive symptoms at T0 was calculated by summing the responses on all EPDS items (possible range: 0–30), with higher scores indicating more depressive symptoms. The scale showed good internal consistency (Cronbach's alpha = 0.83).

2.3.2. Assessment of app use

App use was assessed in two ways. First, through self-reports in the two follow-up questionnaires (T1 and T2), including questions about whether parents had downloaded the app (and if not, why), whether they still had the app installed on their phone (and if not, why), and how many times they had used the app. Second, objective characteristics of parents' app use were collected in an online database (e.g., the number and type of lessons and challenges started and/or completed).

2.3.3. Assessment of app acceptability

At T1 and T2, we asked parents about their experiences with the app, including several indicators of functionality (e.g., ease of use), design, and content (e.g., usefulness) on a scale from 1 (bad experience) to 7 (good experience). These questions were adapted from the Mobile App Rating Scale (49). Parents also rated the app as a whole and indicated whether they would recommend the app to family or friends on a scale from 1 to 10, with higher scores indicating higher appreciation and a higher likelihood of recommendation. Finally, we asked open-ended questions about the ways in which parents thought the app could be improved.

2.3.4. Assessment of parent and child anthropometry

Parents reported their height and weight at T0, from which we calculated parental BMI by dividing weight in kilograms by the squared height in meters. To assess child BMI, parents were asked to report the height and weight of the child as measured and reported by the youth health professional at their last visit to the preventive child health clinic (when available) at all three assessments. Parents were asked: “When was your child's height and weight measured at the preventive child health clinic for the last time?”, “What was the weight of your child in grams on that day?”, and “What was the length of your child in centimeters on that day?”. These questions were administered at T0–T2. Additionally, at the second follow-up (T2), parents were asked to send a picture or screenshot of the (digital) measurement overview provided by the preventive child health clinic (containing height and weight measurements from the moment of birth up until T2).

Standardized BMI scores at T0–T2 were calculated based on child height (in cm) and weight (in kilograms) using the anthro_zscores function of the anthro package (50) in R (51). Standardization according to child sex and age was based on WHO Growth Standards (52). Child height and weight were derived from parent reports at T0–T2. When entries were missing, we consulted data from the (digital) measurement overviews (if available). Correlations between parent reports and data from the measurement overviews were high (r = 0.95 at T0, r = 0.74 at T1, r = 0.89 at T2 for height and r = 0.96 at T0, r = 0.97 at T1, r = 0.79 at T2 for weight). Because parents reported the height and weight data based on scheduled visits to the preventive child health clinic, zBMI measurements did not always line up with the timing of the questionnaires. To calculate zBMI, we only used height and weight data (both parent-reported and from the measurement overview) that were measured no more than 3 months prior to the moment parents completed the questionnaire. Mean ages of the children at the zBMI measurements were 8.98 (SD = 2.47), 14.18 (SD = 2.30), and 22.22 (SD = 2.91) months at T0–T2, respectively.

2.4. Statistical analysis

Our hypotheses were tested with linear mixed-effects models to account for the nesting of repeated measures within participants. Four mixed effects models were performed in R (51) using the lmer function of the lmerTest package (53), which calls the lmer function of the lme4 package (54). Each model included a random intercept varying over participants (i.e., modeling per-participant random adjustments to the fixed intercept). To test the shorter-term and longer-term effects of the intervention, two time contrasts were created using simple contrasts: a shorter-term predictor comparing baseline vs. follow-up 1 (T0 coded as −1/3, T1 as +2/3, and T2 as −1/3) and a longer-term predictor comparing baseline vs. follow-up 2 (T0 coded as −1/3, T1 as −1/3, and T2 as +2/3). Contrast coding was also used for the categorical predictors condition (control condition coded as −1/2 and app condition as +1/2) and parental educational level (lower educational level coded as −1/2 and higher as +1/2). The model testing the first hypothesis (i.e., the overall intervention effect) included a fixed intercept, a fixed slope for the factor condition, a fixed slope for the factor shorter-term follow-up, a fixed slope for the factor longer-term follow-up, and two fixed slopes for the interactions between both time contrasts and condition. The model testing the moderating effect of parental educational level included all predictors of the first model plus the three-way interactions between both time contrasts, condition, and parental educational level, as well as the main effect of parental educational level and its lower-order interactions. The model testing the moderating effect of parental BMI included all predictors of the first model plus the three-way interactions between both time contrasts, condition, and parental BMI, as well as the main effect of parental BMI and its lower-order interactions. Lastly, the model testing the moderating effect of parental depressive symptoms included all predictors of the first model plus the three-way interactions between both time contrasts, condition, and parental depressive symptoms, as well as the main effect of parental depressive symptoms and its lower-order interactions. The continuous predictors parental BMI and parental depressive symptoms were centered.

Following the CONSORT guidelines for reporting RCTs (55), the analyses were performed according to the intention-to-treat (ITT) principle (i.e., including all randomized participants adhering to the inclusion criteria). To assess the robustness of the findings, two types of sensitivity analyses were performed for all four models: (1) analyses excluding multivariate outliers identified using Mahalanobis distance [where observations > 3 SDs from the mean were considered outliers; (56)], and (2) per-protocol (PP) analyses including only participants in the app condition who completed at least one lesson or challenge (vs. the control condition). Statistical significance of parameter estimates was determined based on p-values provided by lmerTest. Coefficients were considered statistically significant if p < 0.05. Confidence intervals were determined using lme4's confint function using bootstrapping with 1,000 simulations. Statistically significant interaction effects were interpreted by extracting and comparing estimated means using the emmeans function from the emmeans package (57).

During the analysis process, we observed that the outcome variable child zBMI contained a considerable amount of missingness (see Study Participants in the Results section for details). We therefore imputed missing data via multivariate imputations by chained equations using the mice function of the mice package (58). Twenty imputations were performed within the app and control condition separately and the results of the individual imputations were pooled using mice's pool function. Both the results of the analyses in the non-imputed and in the imputed data are presented in the paper.

2.4.1. Deviations from pre-registration

We deviated from the pre-registration in two ways. First, p-values for the parameter estimates were derived via the lmerTest function instead of the mixed function from the afex package (59) for reasons of consistency across imputed and non-imputed analyses. This means that degrees of freedom were calculated via the Sattherwaite method, instead of the Kenward-Roger approach [which have shown to produce similar results; (60)]. Second, we unintentionally failed to specify the two-way interactions between each of the moderators and time and condition (e.g., parental educational level * time, parental educational level * condition) in the pre-registration, and included all possible lower-order interactions in the final analyses.

2.4.2. Exploratory analyses

Based on observed differences in participants' program use (see App Use for details) we performed exploratory, more stringent PP analyses to explore intervention effects among participants with higher program use (vs. the control condition) in addition to our pre-registered (less stringent) per-protocol analyses. The initially planned PP analyses included participants in the app condition who completed at least 1 lesson or challenge during the program period (vs. participants in the control condition). On hindsight, this criterium for program use might have been too loosely specified. For the app to have an effect, parents should have been exposed to a substantial amount of app content and/or have engaged with the content frequently. Therefore, additional, more stringent PP analyses were explored including participants who (1) completed at least 50% of the available lessons at T2 (n = 19), or (2) completed at least 50% of the available challenges at T2 (n = 29), or (3) reported to use the app at least monthly at T1 (n = 27). Due to overlap in participants between the three criteria, a total of 47 participants with higher app use were included in the adjusted PP analyses and compared to the control condition (n = 177). These exploratory PP analyses were performed in both the non-imputed and imputed data.

3. Results

3.1. Study participants

A total of 485 parents were recruited; however, 128 parents were not enrolled in the trial for different reasons, for example because they did not complete the baseline questionnaire (see Figure 1). The final randomized sample included 357 primary caregivers (179 in the app condition and 178 in the control condition; see Figure 1). No parents were excluded based on their child's health condition, as the conditions that parents specified (e.g., cow's milk allergy and/or reflux, skin conditions such as eczema) did not severely impact the child's (weight) development. Three parents were excluded from the analyses because their child was younger than 5 months or older than 15 months at baseline, resulting in a final analytic sample of 354 participants (177 in the app condition and 177 in the control condition).

Retention in the study was high, with response rates of 94.1% (333/354) at T1 and 88.4% (313/354) at T2. A considerable amount of missingness was observed in the outcome variable child zBMI at T1 and T2 (42.6% (142/333) at T1 and 64.9% (203/313) at T2), which probably resulted from our request to report child length and height based on measures reported at the preventive child health clinic. These measurements are scheduled at specific ages (e.g., at 5, 9, 11, and 14 months) and become less frequent over time (i.e., after 18 months there are only yearly visits at 2, 3, and 4 years), therefore potentially resulting in missingness at specific ages. Independent samples t-test showed that children with missing data on zBMI at T2 were on average 22.20 months old (SD = 2.09), whereas those who did not have missing data on zBMI were significantly older [M = 23.55, SD = 2.63, t(303) = 4.95, p < 0.001] and closer in age to the standard visit to the preventive child health clinic at 2 years. Participants with and without missing values for child zBMI at T1 and T2 did not differ based on child sex, age of the parent, BMI of the parent, parental depressive symptoms, parental educational level, parental employment status, and parental financial difficulty (p's > 0.05).

3.2. Baseline characteristics

Descriptions of parent and child characteristics at baseline across the app and control conditions are provided in Table 1. Correlations between these variables at baseline are presented in Table 2. We found a positive but small association between child age and child zBMI (r = 0.13), indicating that being older was associated with higher zBMI scores. No other statistically significant associations between the outcome variable zBMI and parent or child characteristics at baseline were observed.

TABLE 1
www.frontiersin.org

Table 1. Baseline parent and child characteristics by intervention condition.

TABLE 2
www.frontiersin.org

Table 2. Pearson correlations between parent and child characteristics at baseline.

3.3. App use

3.3.1. Self-reported app use

After randomization, all 177 parents in the app condition received an invitation to download and use the app. At T1, 77.7% (122/157) of parents in the app condition reported they downloaded the Samen Happie! app. These numbers are comparable at T2 (75.3%, 113/150). The most frequently mentioned reasons for not downloading the app at T1 were that parents forgot to download it (51.4%, 18/35) or that they did not receive the e-mail with download instructions we sent them (31.4%, 11/35). At T1, 86.1% (105/122) of parents who downloaded the app reported that they still had the app installed on their phone, which decreased to 70.0% (70/113) at T2. Most parents who had the app installed on their phone at T1 and T2 reported that they used it several times after installing, but not anymore at T1 (70.5%, 74/105) or at T2 (78.6%, 55/70). Reasons for deleting the app (reported at T2) were (multiple answers allowed): the app did not work properly (2.3%, 1/43), the app was not interesting (41.9%; 18/43), I needed to free up phone storage (20.9%, 9/43), and I got a new phone (39.5%; 17/43). A smaller number of parents still used the app a couple of times per month [22.9% (24/105) at T1, 15.7% (11/70) at T2] or per week [2.9% (3/105) at T1, 2.9% (2/70) at T2].

3.3.2. App use from database

Results from the database that collected data on parents' app use showed that parents started a total of 1,575 lessons and 406 challenges, of which 1,498 lessons (95.1%) and 381 challenges (93.8%) were completed. The number of lessons and challenges completed per parent in the app condition varied between 0 and 51 (M = 10.46, SD = 13.56). The mean number of lessons and challenges completed did not differ for parents with higher and lower educational level, as indicated by independent samples t-tests (p's > 0.05). Most lessons and challenges were completed in module 1 (51.9%, 975/1,879) and the number of completed lessons and challenges decreased with each subsequent module: 21.8% (410/1,879) in module 2, 15.4% (290/1,879) in module 3, 10.2% (192/1,879) in module 4, and 0.6% (12/1,879) in module 5. Based on child age at baseline, the maximum number of lessons and challenges that could be completed at T2 was either 51 (67.8%, 120/177) or 70 (32.2%, 57/177). At T2, 30.5% (54/177) of parents completed at least 25% of the available lessons and challenges, 13.0% (23/177) completed at least 50% of the available lessons and challenges, and only 4.0% (7/177) completed at least 75% of the available lessons and challenges. Most lessons and challenges were completed within the theme food (36.8%, 691/1,879), followed by drinks (21.9%, 412/1,879), sleep (14.0%, 263/1,879) and parent wellbeing (14.0%, 263/1,879), screens or physical activity (PA; 7.4%, 139/1,879), summary (5.1%, 96/1,879), and temper (0.8%, 15/1,879). Supplementary Table 1 shows the number of available lessons and challenges per module and per theme, the mean number of completed lessons and challenges per module and per theme, and the number of parents with access to each module at T0, T1, and T2.

3.4. App acceptability

Means and standard deviations for the self-reported rating (scales ranging from 1 to 7) of different aspects of the app at T1 and T2 are presented in Table 3. Parents gave statistically significant higher scores for design of the app at T1 than at T2. No other differences were found for the app acceptability items at T1 and T2. Although scores on ease of use were high for all parents, parents with lower educational level rated the app somewhat lower (M = 5.02, SD = 1.77) than parents with higher educational level (M = 5.84, SD = 5.84) regarding ease of use at T1 (but not at T2), p = 0.003. The other acceptability ratings at T1 and T2 did not differ for parents with lower and higher educational level (p's > 0.05). Overall, parents rated the app on average with a 6.60 (on a scale from 1 to 10) at both T1 and T2 (T1: SD = 1.42, T2: SD = 1.50), indicating moderate levels of acceptability of the Samen Happie! app. The average response to the question whether parents would recommend the app to others (on a scale from 0 to 10) was 5.80 (SD = 2.30) at T1 and 5.64 (SD = 2.28) at T2. The scores for app rating and intention to recommend did not significantly differ between T1 and T2 and did not differ for parents with lower and higher educational level, both at T1 and T2 (p's > 0.05).

TABLE 3
www.frontiersin.org

Table 3. Parent ratings of different aspects of the app at T1 and T2.

3.5. Intervention effects on child zBMI

Tables 4, 5 present the results of the ITT analyses examining intervention effects on child zBMI using the non-imputed and imputed data. Table 4 shows that we found statistically significant and consistent main effects of time (both the shorter- and longer-term contrast) in all four analyses performed in the non-imputed and imputed data, indicating an increase in child zBMI over time and across conditions. Moreover, in the imputed data the two-way interactions between condition and both time contrasts (i.e., baseline vs. FU1 and baseline vs. FU2) were statistically significant. Table 5 presents the means and standard errors for child zBMI across conditions (i.e., overall intervention effect) and demonstrates that the increase in zBMI was greater in the control condition in the shorter-term, but greater in the app condition in the longer-term. These interactions did not emerge as statistically significant when using non-imputed data. Moreover, we found several statistically significant three-way interactions for subgroups based on parental educational level, BMI, and depressive symptoms in the imputed, but not the non-imputed data (see Table 4). First, we found interaction effects between parental educational level, condition, and both time contrasts. The estimated means in Table 5 show that in the shorter-term, zBMI increased the most among children of parents with lower educational level in the control condition and least among children of parents with lower educational level in the app condition. However, in the longer-term, the zBMI increases seemed more apparent in the app condition compared to the control condition, with the highest increases observed among children of parents with higher educational level. Second, there was an interaction between parental BMI, condition, and the longer-term time contrast. Table 5 shows that the longer-term increases in zBMI were highest in the app condition, particularly among children of parents with higher BMI. Third and finally, an interaction was observed between parental depressive symptoms, condition, and the longer-term time contrast. In the longer-term, zBMI increased in the app condition more than in the control condition, but children of parents with higher depressive symptoms in the control condition showed a similar increase in zBMI (see Table 5).

TABLE 4
www.frontiersin.org

Table 4. Linear mixed model ITT intervention effects on child zBMI for subgroups based on parental educational level, BMI, and depressive symptoms in the non-imputed and imputed data.

TABLE 5
www.frontiersin.org

Table 5. Estimated means (ITT) for child zBMI at baseline, follow-up 1, and follow-up 2 for the app and control condition, specified by the levels (i.e., lower vs. higher) of parental educational level, BMI, and depressive symptoms in the non-imputed and imputed data.

3.6. Sensitivity analyses

To assess the robustness of the findings, the four models were tested again twice using both the non-imputed and imputed data: first, without multivariate outliers; and second, including only parents in the app condition who completed at least 1 lesson or challenge. In the non-imputed dataset, 17 multivariate outliers (i.e., cases with a Mahalanobis distance >14; this cut-off was based on a chi-square distribution with df = 3 and p = 0.003) and 56 parents who did not complete any lesson or challenge were excluded for the sensitivity analyses. The pattern of statistically significant results of the models did not change compared to the primary analyses when the non-imputed data were analyzed without multivariate outliers and when only the parents who completed at least 1 lesson or challenge were included.

For the sensitivity analyses performed in the imputed data (i.e., containing 20 simulations of the original dataset), ~24 multivariate outliers per simulation (M = 24.35, SD = 3.50, range = 19–32) and a total of 56 parents who did not complete any lesson or challenge were excluded. In the analyses excluding multivariate outliers, the following two-way interactions were no longer significant: (1) the interaction between condition and the shorter-term time contrast in the model testing the overall intervention effect; (2) the interaction between condition and the shorter-term time contrast and the interaction between education and the shorter-term time contrast in the model testing the moderating effect of parental educational level; (3) the interaction between condition and the shorter-term time contrast in the model testing the moderating effect of parental BMI; and (4) the interaction between condition and the shorter-term time contrast in the model testing the moderating effect of parental depressive symptoms. The pattern of statistically significant three-way interactions (i.e., between condition, both time contrasts, and each of the moderators: parental educational level, BMI, and depressive symptoms) did not change compared to the primary analyses. Moreover, in the analyses including only parents who completed at least 1 lesson or challenge, no differences in the pattern of statistically significant effects were observed.

3.7. Exploratory analyses

To examine whether parents in the app condition (n = 177 in total) that were included in the adjusted PP analyses (n = 47) differed from parents who did not adhere to the criteria for higher app use (n = 130), a series of independent samples t-tests were performed in the non-imputed data. Parents who adhered to the criteria for higher app use were more likely to recommend the app to others (M = 6.45, SD = 1.97; on a scale from 1 to 10) than parents who did not adhere to these criteria (M = 5.14, SD = 2.31), t(109) = −3.03, p = 0.003. Parents who adhered to the criteria for higher app use did not differ from parents who did not adhere to these criteria based on other app use characteristics (i.e., app rating, general app use, general skills in using apps, and subjective importance of apps), nor did they differ on several parent (i.e., age, educational level, financial difficulty, BMI, and depressive symptoms) and child (i.e., age, sex, being first-born, zBMI) characteristics (all p's > 0.05).

Tables 6, 7 present the results of the adjusted PP analyses examining intervention effects in the non-imputed and imputed data. The results of the adjusted PP analyses were mostly in line with the findings of the main ITT analyses. With respect to the overall intervention effect, similar main effects of both time contrasts and two-way interaction effects between condition and both time contrasts were found, using both the non-imputed and imputed data (see Table 6). With respect to the subgroup analyses based on parental educational level, BMI, and depressive symptoms, two differences in effects (using the imputed data) were observed in the adjusted PP analyses. First, unlike in the ITT analyses, the three-way interaction between parental educational level, condition, and the longer-term time contrast was no longer statistically significant in the adjusted PP analyses. Second, we found a statistically significant three-way interaction between parental BMI, condition, and the shorter-term time contrast in the adjusted PP analyses, that had not emerged as statistically significant in the ITT analyses. The estimated means and standard errors in Table 7 show that when comparing parents in the control condition to those in the app condition with higher app use, the increases in zBMI were greatest among children of parents in the control condition who had higher BMI. All other three-way interaction effects that were statistically significant in the ITT analyses (i.e., between parental educational level, condition, and shorter-term time contrast; parental BMI, condition, and the longer-term time contrast; and parental depressive symptoms, condition, and the longer-term time contrast) were observed in the same direction in the adjusted PP analyses and showed identical patterns of mean-level differences (see Table 7).

TABLE 6
www.frontiersin.org

Table 6. Adjusted PP intervention effects on child zBMI for subgroups based on parental educational level, BMI, and depressive symptoms in the non-imputed and imputed data.

TABLE 7
www.frontiersin.org

Table 7. Estimated means (adjusted PP) for child zBMI at baseline, follow-up 1, and follow-up 2 for the app and control condition, specified by the levels (i.e., lower vs. higher) of parental educational level, BMI, and depressive symptoms in the non-imputed and imputed data.

4. Discussion

This study investigated the process and effectiveness of the app-based parenting program Samen Happie! on child zBMI at 6 and 12-months follow-up. Process data showed that app acceptability was moderate, but that sustained app use was low. ITT analyses with imputed data revealed that zBMI increased in both conditions, but that this increase in zBMI was least pronounced in the app condition at the 6-month follow-up, particularly among children of parents with lower educational level. These effects were further supported by exploratory PP analyses focusing on parents with higher app use. In addition, adjusted PP analyses suggested beneficial shorter-term effects of higher app use for children of parents with higher BMI when compared with children of parents with higher BMI in the control condition. Despite these positive effects at the shorter-term follow-up, greater increases in zBMI were observed in the app condition at the 12-month follow-up in general. Overall, our findings suggest that the Samen Happie! app might prevent increases in zBMI of young children in the shorter-term, particularly among children of parents with lower educational level and parents with higher BMI who used the app more frequently, but that (even higher) app use does not appear to prevent increases in zBMI on the longer-term.

Across conditions, we found a general trend of increased zBMI over time in our sample of Dutch 0-to-2-year-olds, with increases from −0.09 at 10 months of age to 0.31 at 15.5 months, and to 0.39 at 23 months. Similar zBMI trajectories in this age group were observed in a Dutch (61) and a Canadian (62) study that used the same reference population (63). As such, patterns of increasing zBMI in this age group seem to be a common characteristic unspecific to our study.

The shorter-term finding that particularly children of parents with lower educational level and higher BMI (who used the app more frequently) profited most from the Samen Happie! program after 6 months, was in line with our hypotheses. However, these effects seemed to diminish at the longer-term, with the overall app condition showing higher zBMI values after 12 months compared to the control condition. Particularly shorter-term effects have been found before in digital preventive interventions for obesity [including interventions targeting children/adolescents and parents; (64)] and early interventions for high-risk infants (65). When looking specifically at mHealth parenting programs (i.e., using mobile systems such as apps, websites, and text messaging) for the prevention or treatment of childhood obesity, a recent review found mostly no effects on child zBMI (also not at the shorter-term), however, these studies mainly included older children (66). One app-based program among preschoolers (MINISTOP) that was included in this review showed effects on a composite score including fat mass index and dietary and physical activity variables after 6 months [but not fat mass only at 6 months; (67)], but these effects were not retained at the 12-month follow-up (68). We identified only one other app-based parenting program for obesity prevention [Growing Healthy; not included in review (66)] that examined weight outcomes in infants, finding no effects on child zBMI, however, children in this study were somewhat younger at follow-up (69). Overall, our findings are in line with these previous findings suggesting that the effects of mHealth parenting programs on child weight status to date may be limited and fading over time.

We do not have an explanation for these longer-term fading effects, other than speculating about potential rebound effects when app use decreased over time. Of note, decreased app use probably forms the most important explanation for the finding that children of parents with lower educational level and higher BMI (that use the app more frequently) seem to have shortly profited from the app, but not on the longer-term. Importantly, process data indicated that most app use—even among parents who used the app more frequently—occurred at the shorter-term (i.e., between baseline and the 6-month follow-up), which supports the notion that active, sustained use of the app is probably needed for longer-term effects to establish. Additionally, our process data indicated that parents completed relatively more lessons than challenges, and that even among the more frequent app users, only two-thirds of parents completed at least half of the challenges. Whereas, the lessons focused primarily on enhancing knowledge and attitudes through behavior changes techniques like consciousness raising and framing, the challenges were designed to facilitate the transfer of this knowledge into regular daily habits [e.g., through implementation intentions; see (40)]. Hence, longer-term effects may depend on parents using the app, and particularly the challenges, more intensely.

Our findings suggest that engaging frequently with an app is important for the effectiveness of app-based programs [see also the review by Rossiter et al. (65)]. Although we deliberately gave no instructions regarding the timing and frequency of app use with the goal to mimic actual program adherence in real life, this might have resulted in the observed patterns of declining and generally low app use. A pattern of decreasing app use within the first weeks is frequently observed in app-based health interventions (70) and might be caused by a drop in engagement when the novelty of the app wears off (71). The moderate levels of app acceptability in combination with parents reporting to use the app mainly after installing it (but not frequently anymore after that), indicate that our results are in line with these previous findings. A recent review among a broad range of app-based health programs showed that the programs with the highest user engagement were primarily characterized by the option to receive (particularly personalized) push notifications, easy access to information, and the ability to communicate with health professionals (70). Although our participants were able to receive personalized push notifications for the challenges, this feature could have been made stronger if we had used it regularly (e.g., weekly) as a reminder for lessons and challenges that parents had not yet completed. Moreover, access to the information in our app was relatively easy through the age- and theme-based content, but our process data suggested that some parents would prefer a solely theme-based structure organized around child EBRBs (e.g., dietary intake, sleep) over the overarching age-based modules. From an engagement perspective, a potential downside of the age-based modules might have been that parents could not explore content for the next developmental stages of their child until their child reached the minimum age of that level. This might have impeded the eagerness of interested and motivated parents as well as potential positive anticipatory guidance [i.e., proactive advice effects (72, 73)]. Lastly, our app offered parents digital parenting support without the option for direct communication with health professionals, whereas additional support in the form of (offline) health-professional led support groups might have increased engagement (74, 75). Strategies combining easily accessible parenting apps with additional (offline) support might be particularly helpful to stimulate longer-term benefits of the Samen Happie! app among at-risk families that need more tailored parenting support. Future research should corroborate whether these strategies match parents' preferences for app-based parenting programs and whether they can stimulate parental engagement over longer periods of time.

4.1. Limitations and directions for future research

Several strengths of this study should be noted, including that it was pre-registered, conducted in a representative sample of Dutch adults (aged 25– 45 years) in terms of educational level (76), and had high retention rates (almost 90% at 12-month follow-up). Nevertheless, the study also has limitations. First, although the patterns of results in the imputed and non-imputed data were largely similar, we only found statistically significant effects in the imputed data. Even though the quality of the imputed values was good and most findings were corroborated in the exploratory PP analyses, the results need to be interpreted with caution and confirmed by future studies. That findings were not statistically significant when using the non-imputed data might be due to the loss of statistical power caused by the high number of missing values in child zBMI (64% at 12-month follow-up). To increase the validity of the data, we asked parents to report child height and weight as measured at the preventive child health clinic, but this resulted in a great deal of missingness because children were only measured at specific time points. Missingness in child zBMI did not depend on characteristics other than child age and the chances of bias are therefore low, but the high number of missingness could have posed power issues to detect effects. Future studies should line up the assessment of child height and weight with visits to the preventive child health clinic to ensure complete anthropometric outcome data.

Second, we examined child zBMI as primary and sole outcome. Although zBMI is a sex- and age-specific measure, the wide age range at baseline (5–15 months) might have potentially influenced our results, but we were unable to test this due to power restrictions. The use of zBMI to measure weight status in infancy is recommended by pediatric societies (77, 78) and this measure shows consistent links with adiposity in childhood (62), however, some have argued that BMI alone does not provide the best indication of adiposity [e.g., (79)]. Particularly in the first years of life, rapid changes in body composition (e.g., fluid balance) can result in changes in fat (free) mass, and these processes can vary greatly between children (80). Moreover, intervention-induced changes in healthy EBRBs might not always be visible through changes in BMI (79), particularly in interventions shorter than 12 months (81). Together with the complexity of infant weight development, this emphasizes the need to assess other outcomes related to children's energy balance, such as dietary intake, sleep, and physical (in)activity in addition to zBMI.

Third, although parental educational level is a frequently used indicator of family SEP in pediatric health research (82), it was the only indicator of SEP we used in this study. There might be other relevant socioeconomic factors that also play a role in child health outcomes, such as family income, parental employment, and the neighborhood a family lives (83, 84). As associations between indicators of SEP can be low (85, 86), each of those indicators individually as well as the interaction between indicators could importantly influence a family's SEP and is therefore interesting to investigate in future parenting research.

Fourth, although our sample was representative in terms of parental educational level, the sample was homogeneous in terms of ethnicity, with more than 95% of parents being born in the Netherlands. However, no other indicators of cultural background were assessed such as religion or language(s) spoken at home, whereas such factors might have affected program engagement and effectiveness (87). Future obesity prevention programs should recruit a diverse population of participants in terms of ethnic and cultural background. Additionally, programs should consider recruiting first-time parents in particular given that these parents might have a higher need for parenting support, as indicated by the higher levels of engagement of first-time parents in a healthy feeding intervention (88).

Fifth and finally, only primary caregivers participated in this study, which were primarily mothers (>95%). However, other caregivers might also be involved in energy balance-related parenting, such as fathers (89) and grandparents [who might even promote unhealthy dietary intake and weight status; (90)]. As one third of infants in a Dutch study was cared for by others (e.g., grandparents, daycare) for more than 20 h per week (61), it is important that future preventive interventions for childhood obesity also target other caregivers that are involved in energy balance-related parenting.

Conclusion

In conclusion, this study showed that the app-based parenting program Samen Happie! might be effective in preventing increases in infant zBMI after 6 months, particularly among children of parents with lower educational level and children of parents with higher BMI who use the app more frequently. Despite these promising effects at the shorter-term, however, greater increases in zBMI were observed among children of parents who used the app after 12 months. Future research should be directed at replicating the positive effects found after 6 months and at finding ways to extend these effects to the longer-term. To this end, it is imperative to determine what is needed to stimulate sustained app use and engagement in mHealth parenting programs for childhood obesity and how these programs can be complemented with additional (offline) support for high-risk families in particular.

Data availability statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found below: https://osf.io/wcsxg/ (Open Science Framework).

Ethics statement

The studies involving human participants were reviewed and approved by the Ethics Committee of the Faculty of Social Sciences, Radboud University, the Netherlands. Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.

Author contributions

JL, LK, JV, CW, RH, ER, and SK contributed to the conceptualization of the study and development of the Samen Happie! program. LK, JL, JV, and CW developed the questionnaires. LK managed data collection. LK with input from WB, performed data analyses. LK drafted the paper, on which all authors provided critical feedback. All authors contributed to the article and approved the submitted version.

Funding

The Samen Happie! trial was funded by a grant from Fonds NutsOhra awarded to JL (100.939). CW's work was supported by a Jacobs Foundation Advanced Research Fellowship and a grant from the Netherlands Organization for Scientific Research (016.Vici.185.038). The funding agencies were not involved in the design and execution of the trial, the statistical analysis, and interpretation of the results.

Acknowledgments

We are grateful for all parents who participated in the Samen Happie! trial. We further want to thank Dominique Maciejewski and Nina van den Broek for providing useful resources regarding the statistical analysis and the students that were involved in the project for their help with collecting and processing the child growth data.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2022.1012431/full#supplementary-material

References

1. Struijs J, de Vries E, Suijkerbuijk A, Molenaar J, Scheefhals Z, Baan C. Monitor Kansrijke Start 2019: Invoering van het actieprogramma en een meting van de uitgangssituatie. (2019). p. 1–27. Available online at: https://www.kansrijkestartnl.nl/actieprogramma-kansrijke-start/documenten/publicaties/2019/12/11/rivm-monitor-kansrijke-start-2019 (accessed June 5, 2022).

2. Wu S, Ding Y, Wu F, Li R, Hu Y, Hou J, et al. Socio-economic position as an intervention against overweight and obesity in children: a systematic review and meta-analysis. Sci Rep. (2015) 5:1–11. doi: 10.1038/srep11354

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Ruiz M, Goldblatt P, Morrison J, Porta D, Forastiere F, Hryhorczuk D, et al. Impact of low maternal education on early childhood overweight and obesity in Europe. Paediatr Perinat Epidemiol. (2016) 30:274–84. doi: 10.1111/ppe.12285

PubMed Abstract | CrossRef Full Text | Google Scholar

4. White PA, Awad YA, Gauvin L, Spencer NJ, McGrath JJ, Clifford SA, et al. Household income and maternal education in early childhood and risk of overweight and obesity in late childhood: findings from seven birth cohort studies in six high-income countries. Int J Obes. (2022) 46:1703–11. doi: 10.1038/s41366-022-01171-7

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Sahoo K, Sahoo B, Choudhury AK, Sofi NY, Kumar R, Bhadoria AS. Childhood obesity: causes and consequences. J Fam Med Prim Care. (2015) 4:187. doi: 10.4103/2249-4863.154628

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Pandita A, Sharma D, Pandita D, Pawar S, Tariq M, Kaul A. Childhood obesity: prevention is better than cure. Diabetes Metab Syndr Obes Targets Ther. (2016) 9:83. doi: 10.2147/DMSO.S90783

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Ong K, Loos R. Rapid infancy weight gain and subsequent obesity: systematic reviews and hopeful suggestions. Acta Paediatr. (2006) 95:904–8. doi: 10.1080/08035250600719754

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Druet C, Stettler N, Sharp S, Simmons RK, Cooper C, Davey Smith G, et al. Prediction of childhood obesity by infancy weight gain: an individual-level meta-analysis. Paediatr Perinat Epidemiol. (2012) 26:19–26. doi: 10.1111/j.1365-3016.2011.01213.x

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Monasta L, Batty GD, Cattaneo A, Lutje V, Ronfani L, Van Lenthe FJ, et al. Early-life determinants of overweight and obesity: a review of systematic reviews. Obes Rev. (2010) 11:695–708. doi: 10.1111/j.1467-789X.2010.00735.x

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Singh AS, Mulder C, Twisk JWR, Van Mechelen W, Chinapaw MJM. Tracking of childhood overweight into adulthood: a systematic review of the literature. Obes Rev. (2008) 9:474–88. doi: 10.1111/j.1467-789X.2008.00475.x

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Taveras EM, Gillman MW, Kleinman KP, Rich-Edwards JW, Rifas-Shiman SL. Reducing racial/ethnic disparities in childhood obesity the role of early life risk factors. JAMA Pediatr. (2013) 167:731–8. doi: 10.1001/jamapediatrics.2013.85

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Power TG, Sleddens EFC, Berge J, Connell L, Govig B, Hennessy E, et al. Contemporary research on parenting: conceptual, methodological, and translational issues. Child Obes. (2013) 9:S-87–94. doi: 10.1089/chi.2013.0038

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Ash T, Agaronov A, Young T, Aftosmes-Tobio A, Davison KK. Family-based childhood obesity prevention interventions: a systematic review and quantitative content analysis. Int J Behav Nutr Phys Act. (2017) 14:113. doi: 10.1186/s12966-017-0571-2

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Balantekin KN, Anzman-Frasca S, Francis LA, Ventura AK, Fisher JO, et al. Positive parenting approaches and their association with child eating and weight: a narrative review from infancy to adolescence. Pediatr Obes. (2020) 15:e12722. doi: 10.1111/ijpo.12722

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Spill MK, Callahan EH, Shapiro MJ, Spahn JM, Wong YP, Benjamin-Neelon SE, et al. Caregiver feeding practices and child weight outcomes: a systematic review. Am J Clin Nutr. (2019) 109:990S–1002. doi: 10.1093/ajcn/nqy276

PubMed Abstract | CrossRef Full Text | Google Scholar

16. St. George SM, Agosto Y, Rojas LM, Soares M, Bahamon M, Prado G, et al. A developmental cascade perspective of paediatric obesity: a systematic review of preventive interventions from infancy through late adolescence. Obes Rev. (2020) 21:e12939. doi: 10.1111/obr.12939

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Reuter A, Silfverdal S-A, Lindblom K, Hjern A. A systematic review of prevention and treatment of infant behavioural sleep problems. Acta Paediatr. (2020) 109:1717–32. doi: 10.1111/apa.15182

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Hutchens A, Lee RE. Parenting practices and children's physical activity: an integrative review. J Sch Nurs. (2018) 34:68–85. doi: 10.1177/1059840517714852

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Petersen TL, Møller LB, Brønd JC, Jepsen R, Grøntved A. Association between parent and child physical activity: a systematic review. Int J Behav Nutr Phys Act. (2020) 17:67. doi: 10.1186/s12966-020-00966-z

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Laws R, Campbell KJ, Van Der Pligt P, Russell G, Ball K, Lynch J, et al. The impact of interventions to prevent obesity or improve obesity related behaviours in children (0-5 years) from socioeconomically disadvantaged and/or indigenous families: a systematic review. BMC Public Health. (2014) 14:779. doi: 10.1186/1471-2458-14-779

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Seidler AL, Hunter KE, Johnson BJ, Ekambareshwar M, Taki S, Mauch CE, et al. Understanding, comparing and learning from the four EPOCH early childhood obesity prevention interventions: a multi-methods study. Pediatr Obes. (2020) 15:e12679. doi: 10.1111/ijpo.12679

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Fernández-Alvira JM, De Bourdeaudhuij I, Singh AS, Vik FN, Manios Y, Kovacs E, et al. Clustering of energy balance-related behaviors and parental education in European children: the ENERGY-project. Int J Behav Nutr Phys Act. (2013) 10:1–10. doi: 10.1186/1479-5868-10-80

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Miguel-Berges ML, Zachari K, Santaliestra-Pasias AM, Mouratidou T, Androutsos O, Iotova V, et al. Clustering of energy balance-related behaviours and parental education in European preschool children: the ToyBox study. Br J Nutr. (2017) 118:1089–96. doi: 10.1017/S0007114517003129

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Whittaker R, Merry S, Dorey E, Maddison R. A Development and Evaluation Process for mHealth Interventions: examples From New Zealand. J Health Commun. (2012) 17:11–21. doi: 10.1080/10810730.2011.649103

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Tandon PS, Zhou C, Sallis JF, Cain KL, Frank LD, Saelens BE. Home environment relationships with children's physical activity, sedentary time, and screen time by socioeconomic status. Int J Behav Nutr Phys Act. (2012) 9:88. doi: 10.1186/1479-5868-9-88

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Cardel M, Willig AL, Dulin-Keita A, Casazza K, Beasley TM, Fernández JR. Parental feeding practices and socioeconomic status are associated with child adiposity in a multi-ethnic sample of children. Appetite. (2012) 58:347–53. doi: 10.1016/j.appet.2011.11.005

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Zarnowiecki DM, Dollman J, Parletta N. Associations between predictors of children's dietary intake and socioeconomic position: a systematic review of the literature. Obes Rev. (2014) 15:375–91. doi: 10.1111/obr.12139

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Vereecken CA, Keukelier E, Maes L. Influence of mother's educational level on food parenting practices and food habits of young children. Appetite. (2004) 43:93–103. doi: 10.1016/j.appet.2004.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Wang Y, Min J, Khuri J, Li M. A Systematic Examination of the Association between Parental and Child Obesity across Countries. Adv Nutr. (2017) 8:436–48. doi: 10.3945/an.116.013235

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Weng SF, Redsell SA, Swift JA, Yang M, Glazebrook CP. Systematic review and meta-analyses of risk factors for childhood overweight identifiable during infancy. Arch Dis Child. (2012) 97:1019–26. doi: 10.1136/archdischild-2012-302263

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Patel C, Karasouli E, Shuttlewood E, Meyer C. Food parenting practices among parents with overweight and obesity: a systematic review. Nutrients. (2018) 10:1966. doi: 10.3390/nu10121966

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Bouchard C. Childhood obesity: are genetic differences involved? Am J Clin Nutr. (2009) 89:1494–501. doi: 10.3945/ajcn.2009.27113C

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Champagne FA, Curley JP. Epigenetic mechanisms mediating the long-term effects of maternal care on development. Neurosci Biobehav Rev. (2009) 33:593–600. doi: 10.1016/j.neubiorev.2007.10.009

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Di Benedetto MG, Bottanelli C, Cattaneo A, Pariante CM, Borsini A. Nutritional and immunological factors in breast milk: Aarole in the intergenerational transmission from maternal psychopathology to child development. Brain Behav Immun. (2020) 85:57–68. doi: 10.1016/j.bbi.2019.05.032

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Redsell SA, Slater V, Rose J, Olander EK, Matvienko-Sikar K. Barriers and enablers to caregivers' responsive feeding behaviour: a systematic review to inform childhood obesity prevention. Obes Rev. (2021) 22:e13228. doi: 10.1111/obr.13228

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Gross RS, Velazco NK, Briggs RD, Racine AD. Maternal depressive symptoms and child obesity in low-income urban families. Acad Pediatr. (2013) 13:356–63. doi: 10.1016/j.acap.2013.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Morrissey TW. Maternal depressive symptoms and weight-related parenting behaviors. Matern Child Health J. (2014) 18:1328–35. doi: 10.1007/s10995-013-1366-y

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Hurley KM, Black MM, Papas MA, Caufield LE. Maternal symptoms of stress, depression, and anxiety are related to nonresponsive feeding styles in a statewide sample of WIC participants. J Nutr. (2008) 138:799–805. doi: 10.1093/jn/138.4.799

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Goulding AN, Rosenblum KL, Miller AL, Peterson KE, Chen Y-P, Kaciroti N, et al. Associations between maternal depressive symptoms and child feeding practices in a cross-sectional study of low-income mothers and their young children. Int J Behav Nutr Phys Act. (2014) 11:75. doi: 10.1186/1479-5868-11-75

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Karssen LT, Vink JM, de Weerth C, Hermans RCJ, de Kort CPM, Kremers SP, et al. An app-based parenting program to promote healthy energy balance–related parenting practices to prevent childhood obesity: protocol using the intervention mapping framework. JMIR Form Res. (2021) 5:e24802. doi: 10.2196/24802

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Kang M, Ragan BG, Park J-H. Issues in outcomes research: an overview of randomization techniques for clinical trials. J Athl Train. (2008) 43:215–21. doi: 10.4085/1062-6050-43.2.215

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Suresh K. An overview of randomization techniques: an unbiased assessment of outcome in clinical research. J Hum Reprod Sci. (2011) 4:8–11. doi: 10.4103/0974-1208.82352

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Bartholomew LK, Markham CM, Ruiter RAC, Fernández ME, Kok G, Parcel GS. Planning Health Promotion Programs: An Intervention Mapping Approach. San Francisco, CA: John Wiley & Sons (2016).

PubMed Abstract | Google Scholar

44. Kok G, Gottlieb NH, Peters GJY, Mullen PD, Parcel GS, Ruiter RAC, et al. A taxonomy of behaviour change methods: an Intervention Mapping approach. Health Psychol Rev. (2016) 10:297–312. doi: 10.1080/17437199.2015.1077155

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. (2013) 46:81–95. doi: 10.1007/s12160-013-9486-6

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression: development of the 10-item edinburgh postnatal depression scale. Br J Psychiatry. (1987) 150:782–6. doi: 10.1192/bjp.150.6.782

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Cox JL, Chapman G, Murray D, Jones P. Validation of the Edinburgh postnatal depression scale (EPDS) in non-postnatal women. J Affect Disord. (1996) 39:185–9. doi: 10.1016/0165-0327(96)00008-0

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Pop VJ, Komproe IH, van Son MJ. Characteristics of the Edinburgh post natal depression scale in The Netherlands. J Affect Disord. (1992) 26:105–10. doi: 10.1016/0165-0327(92)90041-4

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth uHealth. (2015) 3:e27. doi: 10.2196/mhealth.3422

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Schumacher D, Borghi E, Polonsky J, WHO. Package Anthro: Computation of the WHO Child Growth Standards (2021). Available online at: https://cran.r-project.org/web/packages/anthro/index.html (accessed April 14, 2022).

Google Scholar

51. R Core Team. R: The R Project for Statistical Computing. (2022). Available online at: https://www.r-project.org/ (accessed April 14, 2022).

Google Scholar

52. WHO. WHO child growth standards: Length/height-for-age, weight-for-age, weight-for-length, weight-for-height and body mass index-for-age: Methods and development. (2006). Available online at: https://apps.who.int/iris/handle/10665/43413 (accessed April 14, 2022).

Google Scholar

53. Kuznetsova A, Brockhoff PB, Christensen RHB, Jensen SP. lmerTest: Tests in Linear Mixed Effects Models. (2020). Available online at: https://cran.r-project.org/package=lmerTest (accessed April 14, 2022).

Google Scholar

54. Bates D, Maechler M, Bolker M, Walker S, Christensen RHB, Singmann H, et al. Package lme4: Linear Mixed-Effects Models using “Eigen” S4. (2022). Available online at: https://cran.r-project.org/web/packages/lme4/index.html (accessed April 14, 2022).

Google Scholar

55. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med. (2010) 152:726–32. doi: 10.7326/0003-4819-152-11-201006010-00232

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Leys C, Delacre M, Mora YL, Lakens D, Ley C. How to classify, detect, and manage univariate and multivariate outliers, with emphasis on pre-registration. Int Rev Soc Psychol. (2019) 32:5. doi: 10.5334/irsp.289

CrossRef Full Text | Google Scholar

57. Lenth RV, Buerkner P, Herve M, Love J, Miguez F, Riebl H, et al. Package emmeans: Estimated Marginal Mean, aka Least-Square Means (2022). Available online at: https://cran.r-project.org/web/packages/emmeans/index.html (accessed April 14, 2022).

Google Scholar

58. van Buuren S, Groothuis-Oudshoorn K. mice: Multivariate imputation by chained equations in R. J Stat Softw. (2021) 45:1–67. doi: 10.18637/JSS.V045.I03

CrossRef Full Text | Google Scholar

59. Singmann H, Bolker B, Westfall J, Aust F, Ben-Shachar MS, Højsgaard S. Package afex: Analysis of Factorial Experiments (2022). Avaialble online at: https://cran.r-project.org/web/packages/afex/index.html (accessed April 14, 2022).

Google Scholar

60. Luke SG. Evaluating significance in linear mixed-effects models in R. Behav Res Methods. (2017) 49:1494–502. doi: 10.3758/s13428-016-0809-y

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Van Vliet MS, Schultink JM, Jager G, De Vries JHM, Mesman J, De Graaf C, et al. The baby's first bites RCT: evaluating a vegetable-exposure and a sensitive-feeding intervention in terms of child health outcomes and maternal feeding behavior during toddlerhood. J Nutr. (2022) 152:386–98. doi: 10.1093/jn/nxab387

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Roberge JB, Harnois-Leblanc S, McNealis V, van Hulst A, Barnett TA, Kakinami L, et al. Body mass index Z score vs weight-for-length Z score in infancy and cardiometabolic outcomes at age 8-10 years. J Pediatr. (2021) 238:208–14. doi: 10.1016/j.jpeds.2021.07.046

PubMed Abstract | CrossRef Full Text | Google Scholar

63. World Health Organization (WHO). Child growth Standards. (2006). Available online at: https://www.who.int/tools/child-growth-standards (accessed April 14, 2022).

Google Scholar

64. Fowler LA, Grammer AC, Staiano AE, Fitzsimmons-Craft EE, Chen L, Yaeger LH, et al. Harnessing technological solutions for childhood obesity prevention and treatment: a systematic review and meta-analysis of current applications. Int J Obes. (2021) 45:957–81. doi: 10.1038/s41366-021-00765-x

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Rossiter C, Cheng H, Appleton J, Campbell KJ, Denney-Wilson E. Addressing obesity in the first 1000 days in high risk infants: systematic review. Matern Child Nutr. (2021) 17:e13178. doi: 10.1111/mcn.13178

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Bonvicini L, Pingani I, Venturelli F, Patrignani N, Bassi MC, Broccoli S, et al. Effectiveness of mobile health interventions targeting parents to prevent and treat childhood obesity: systematic review. Prev Med Rep. (2022) 29:101940. doi: 10.1016/j.pmedr.2022.101940

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Nyström CD, Sandin S, Henriksson P, Henriksson H, Trolle-Lagerros Y, Larsson C, et al. Mobile-based intervention intended to stop obesity in preschool-aged children: the MINISTOP randomized controlled trial. Am J Clin Nutr. (2017) 105:1327–35. doi: 10.3945/ajcn.116.150995

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Delisle Nyström C, Sandin S, Henriksson P, Henriksson H, Maddison R, Löf M. A 12-month follow-up of a mobile-based (mHealth) obesity prevention intervention in pre-school children: the MINISTOP randomized controlled trial. BMC Public Health. (2018) 18:658. doi: 10.1186/s12889-018-5569-4

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Laws RA, Denney-Wilson EA, Taki S, Russell CG, Zheng M, Litterbach EK, et al. Key lessons and impact of the growing healthy mhealth program on milk feeding, timing of introduction of solids, and infant growth: quasi-experimental study. JMIR Mhealth Uhealth. (2018) 6:e9040. doi: 10.2196/mhealth.9040

PubMed Abstract | CrossRef Full Text | Google Scholar

70. Oakley-Girvan I, Yunis R, Longmire M, Ouillon JS. What works best to engage participants in mobile app interventions and e-health: a scoping review. Telemed e-Health. (2022) 28:768–80. doi: 10.1089/tmj.2021.0176

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Becker S, Miron-Shatz T, Schumacher N, Krocza J, Diamantidis C, Albrecht UV. mHealth 2.0: experiences, possibilities, and perspectives. JMIR Mhealth Uhealth. (2014) 2:e3328. doi: 10.2196/mhealth.3328

PubMed Abstract | CrossRef Full Text | Google Scholar

72. French GM, Nicholson L, Skybo T, Klein EG, Schwirian PM, Murray-Johnson L, et al. An evaluation of mother-centered anticipatory guidance to reduce obesogenic infant feeding behaviors. Pediatrics. (2012) 130:e507–17. doi: 10.1542/peds.2011-3027

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Daniels LA, Mallan KM, Battistutta D, Nicholson JM, Meedeniya JE, Bayer JK, et al. Child eating behavior outcomes of an early feeding intervention to reduce risk indicators for child obesity: the NOURISH RCT. Obesity. (2014) 22:E104–11. doi: 10.1002/oby.20693

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Miron-Shatz T, Hansen MM, Grajales FJ, Martin-Sanchez F, Bamidis PD. Social media for the promotion of holistic self-participatory care: an evidence based approach. Contribution of the IMIA social media working group. Yearb Med Inform. (2013) 8:162–8. doi: 10.1055/s-0038-1638849

PubMed Abstract | CrossRef Full Text | Google Scholar

75. Bektas G, Boelsma F, Wesdorp CL, Seidell JC, Baur VE, Dijkstra SC. Supporting parents and healthy behaviours through parent-child meetings: a qualitative study in the Netherlands. BMC Public Health. (2021) 21:1169. doi: 10.1186/s12889-021-11248-z

PubMed Abstract | CrossRef Full Text | Google Scholar

76. Central Bureau of Statistics (CBS). Hoogst behaald onderwijsniveau (CBS Enquete Beroepsbevolking). (2021). Avaialble online at: https://www.ocwincijfers.nl/sectoren/onderwijs-algemeen/hoogst-behaald-onderwijsniveau (accessed July 15, 2022).

Google Scholar

77. Grummer-Strawn L, Krebs NF, Reinold CM. Use of World Health Organization and CDC growth charts for children aged 0-59 months in the United States. MMWR Recomm Rep. (2009) 17:1184.

PubMed Abstract | Google Scholar

78. Dietitians Dietitians of Canada Canadian Paediatric Society The The College of Family Physicians of Canada and CHN of C. Promoting optimal monitoring of child growth in Canada: using the new WHO growth charts. Can J Diet Pract Res. (2010) 15:e1–3. doi: 10.3148/71.1.2010.54

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Kolotourou M, Radley D, Chadwick P, Smith L, Orfanos S, Kapetanakis V, et al. Is BMI alone a sufficient outcome to evaluate interventions for child obesity? Child Obes. (2013) 9:350–6. doi: 10.1089/chi.2013.0019

PubMed Abstract | CrossRef Full Text | Google Scholar

80. Gallagher D, Andres A, Fields DA, Evans WJ, Kuczmarski R, Lowe L, et al. Body composition measurements from birth through 5 years: challenges, gaps, and existing & emerging technologies-a national institutes of health workshop early childhood phenotyping, growth, nutritional assessment. Obes Rev. (2020) 21:e13033. doi: 10.1111/obr.13033

PubMed Abstract | CrossRef Full Text | Google Scholar

81. Tamayo MC, Dobbs PD, Pincu Y. Family-centered interventions for treatment and prevention of childhood obesity in hispanic families: a systematic review. J Community Health. (2020) 46:635–43. doi: 10.1007/s10900-020-00897-7

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Kachmar AG, Connolly CA, Wolf S, Curley MAQ. Socioeconomic status in pediatric health research: a scoping review. J Pediatr. (2019) 213:163–70. doi: 10.1016/j.jpeds.2019.06.005

PubMed Abstract | CrossRef Full Text | Google Scholar

83. Van Vuuren CL, Reijneveld SA, van der Wal MF, Verhoeff AP. Neighborhood socioeconomic deprivation characteristics in child (0–18 years) health studies: a review. Health Place. (2014) 29:34–42. doi: 10.1016/j.healthplace.2014.05.010

PubMed Abstract | CrossRef Full Text | Google Scholar

84. Carroll-Scott A, Gilstad-Hayden K, Rosenthal L, Peters SM, McCaslin C, Joyce R, et al. Disentangling neighborhood contextual associations with child body mass index, diet, and physical activity: the role of built, socioeconomic, and social environments. Soc Sci Med. (2013) 95:106–14. doi: 10.1016/j.socscimed.2013.04.003

PubMed Abstract | CrossRef Full Text | Google Scholar

85. Abramson JH, Gofin R, Habib J, Pridan H, Gofin J. Indicators of social class: a comparative appraisal of measures for use in epidemiological studies. Soc Sci Med. (1982) 16:1739–46. doi: 10.1016/0277-9536(82)90267-2

PubMed Abstract | CrossRef Full Text | Google Scholar

86. Geronimus AT, Bound J. Use of census-based aggregate variables to proxy for socioeconomic group: evidence from national samples. Am J Epidemiol. (1998) 148:475–86. doi: 10.1093/oxfordjournals.aje.a009673

PubMed Abstract | CrossRef Full Text | Google Scholar

87. Lobstein T, Neveux M, Brown T, Chai LK, Collins CE, Ells LJ, et al. Social disparities in obesity treatment for children age 3–10 years: a systematic review. Obes Rev. (2021) 22:e13153. doi: 10.1111/obr.13153

PubMed Abstract | CrossRef Full Text | Google Scholar

88. Taki S, Russell CG, Lymer S, Laws R, Campbell K, Appleton J, et al. A mixed methods study to explore the effects of program design elements and participant characteristics on parents' engagement with an mHealth program to promote healthy infant feeding: the growing healthy program. Front Endocrinol. (2019) 10:397. doi: 10.3389/fendo.2019.00397

PubMed Abstract | CrossRef Full Text | Google Scholar

89. Davison KK, Haines J, Garcia EA, Douglas S, McBride B. Fathers' food parenting: a scoping review of the literature from 1990 to 2019. Pediatr Obes. (2020) 15:e12654. doi: 10.1111/ijpo.12654

PubMed Abstract | CrossRef Full Text | Google Scholar

90. Young KG, Duncanson K, Burrows T. Influence of grandparents on the dietary intake of their 2–12-year-old grandchildren: a systematic review. Nutr Diet. (2018) 75:291–306. doi: 10.1111/1747-0080.12411

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: childhood obesity, preventive intervention, parenting practices, energy balance-related behavior, socioeconomic position (SEP), mHealth, behavior change

Citation: Karssen LT, Larsen JK, Burk WJ, Kremers SPJ, Hermans RCJ, Ruiter ELM, Vink JM and de Weerth C (2022) Process and effect evaluation of the app-based parenting program Samen Happie! on infant zBMI: A randomized controlled trial. Front. Public Health 10:1012431. doi: 10.3389/fpubh.2022.1012431

Received: 05 August 2022; Accepted: 06 December 2022;
Published: 23 December 2022.

Edited by:

Jennifer Savage, The Pennsylvania State University (PSU), United States

Reviewed by:

Andrea Paola Rojas Gil, University of Peloponnese, Greece
Rachel Laws, Deakin University, Australia

Copyright © 2022 Karssen, Larsen, Burk, Kremers, Hermans, Ruiter, Vink and de Weerth. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Levie T. Karssen, yes levie.karssen@ru.nl

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.