Skip to main content

ORIGINAL RESEARCH article

Front. Nutr., 28 February 2024
Sec. Nutritional Epidemiology
Volume 11 - 2024 | https://doi.org/10.3389/fnut.2024.1337873

Creating healthy eating and active environments in early learning settings: protocol of the CHEERS eHealth intervention study

  • CHEERS Lab, Department Health and Physical Education, Mount Royal University, Calgary, AB, Canada

Background: Early childhood educators through their daily interactions with children, play a central role in shaping young children’s health behaviors. Given their influential role, early childhood educators are often targeted in interventions aiming at enhancing their nutrition and physical activity practices.

Methods: This paper presents the design of the CHEERS eHealth program to improve nutrition and physical activity practices within Early Childhood Education and Care (ECEC) centers. The study has a longitudinal quasi-experimental design with recruitment of ECECs across Alberta Canada. ECEC intervention group educators complete 12 weekly online nutrition and physical activity modules and participate in weekly communities of practice sessions to discuss practical applications within their centers. Outcome assessments are scheduled at baseline (T1), mid-point at 5 months (T2), and end of program after 10 months (T3). Outcome measures include the Creating Healthy Eating and Active Environments survey (CHEERS), Mindful Eating Questionnaire (MEQ), Canadian Behavior, Attitude and Nutrition Knowledge Survey (C-BANKS 2.0), Physical Literacy Knowledge, Attitude, Self-Efficacy, and Behavior (PLKASB-ECE), the Environment and Policy Assessment and Observation (EPAO) derived variables, and an objective measure of children’s physical activity using ActiGraph GT3X accelerometers. Linear mixed model analyses will be used to evaluate the effectiveness of the intervention. Qualitative assessments comprise exit interviews and open-response questions embedded within the educational modules.

Results: Preliminary baseline data from the 2019 cohort indicate no statistically significant differences between the intervention and control groups for the primary outcome variables, except age. Educators’ personal nutrition-related knowledge, attitude and behaviors were positively associated with their self-assessments of the nutrition environment and practices in ECECs. A significant correlation was observed between educators’ self-reported physical activity practices and observed activity practices. The CHEERS survey Food Served subscale showed a positive correlation with the objective measures of EPAO-Foods Provided and Nutrition Policy subdomains.

Discussion: We propose that this eHealth intervention would be an effective scaling up approach to enhancing the nutrition and physical activity environments of ECECs by fostering improved nutrition and physical activity-related knowledge, attitudes, and adherence to best practices which will potentially lead to improved outcomes for children in their care.

1 Introduction

Early childhood experiences and the environment in which they occur, can shape and influence cognitive and behavioral outcomes in later life (1). Research supports the strong link between early childhood development and adult health (2). Lifestyle habits such as eating and physical activity habits are examples of behaviors that take root during early life stages and persist into adulthood (3, 4). Poor dietary patterns and sedentary behavior during childhood are associated with increased risk of adult obesity, type II diabetes, cardiovascular disease, dyslipidemia and hypertension (58). On the other hand, healthy behaviors have been shown to have protective effects (911). What is more, good health in early childhood positively impacts cognitive functioning and learning capacities, setting the stage for academic success and better future prospects (12, 13). The period of early childhood is thus a critical time to build foundations for healthy behaviors.

In Canada, research shows that the diet quality of children and youth is poor with suboptimal fruit and vegetable intake (14, 15). In addition, 13.8% of total energy consumption comes from free sugar including added sugars and sugars naturally present in honey, syrups, fruits juices and concentrates (16), exceeding the World Health Organization’s recommended limit of 10% (17). Children’s behaviors, including health behaviors, have been hypothesized to be influenced by layers of their environment (18). The microenvironment is the layer closest to the child and has the strongest and earliest influence on a child’s development and behaviors (18). Early learning settings are part of this microenvironment and are considered among the first and primary settings in which health behaviors are developed and nurtured (19). These settings play a significant role in shaping children’s lifelong habits related to eating and physical activity (20). Participation in early learning and childcare in Canada has witnessed a surge over the past two decades with approximately 60% of children enrolled in some form of early childhood education (21). Children attending full-time day care centers can spend up to 6 h or more per day in these facilities (22) and are consequently assumed to get a significant portion of their nutritional needs in those centers (23). Hence, early childhood settings are critical venues for fostering healthy eating and activity behaviors of young children in Canada.

Early childhood educators are an important part of early learning settings and play a major role in shaping children’s health behaviors (24). Early childhood educators can influence children’s eating and activity behaviors in many ways. They serve as role models, control access to food, provide opportunities for movement, and support children’s self-regulation skills (2427). Early childhood educators’ personal knowledge and beliefs with regards to nutrition has been found to impact their feeding practices within care settings (28). Misconceptions and inaccuracies in personal knowledge and a lack of training can negatively impact the child care nutrition environment (2830). On the other hand, research has shown that training opportunities for educators on evidence-based guidelines has the potential to enhance their practices leading to improved health outcomes for children (3133). Health interventions targeting nutrition and physical activity in early learning settings are increasingly acknowledged for their effectiveness in promoting healthy behaviors early in life (34) aligning with the objectives of Sustainable Development Goal 3 which aims to ensure health and wellbeing for all (35).

The high level of reach and availability of the internet has made it a promising channel to scale up and deliver behavioral change health interventions (3638). Online or eHealth interventions have gained traction as they enable participant engagement anytime-anywhere, provide repetitive access opportunities, and a wider reach at a lower cost (3941). Web-based interventions in Early Childhood Education and Care (ECEC) settings have been shown to be highly acceptable and effective in improving nutrition knowledge and practices (42, 43). Within the Canadian context, eHealth interventions in ECEC settings remain limited (44, 45), particularly those designed to support child care educators align with best practice nutrition and physical activity guidelines. Given the available evidence supporting the need of a comprehensive intervention within the ECEC setting along with the effectiveness and sustainability of online modalities, the purpose of this paper is to describe the design of a virtual eHealth nutrition and physical activity intervention aimed at improving the knowledge, beliefs and adherence to best practices of early childhood educators in Alberta, Canada.

2 Materials and methods

2.1 Study design

The “CHEERS HEAPful of FUN: raising healthy Albertans” (CHEERS program) is a health and wellness virtual educational support program that aims to improve the knowledge and skills of early childhood educators and support the implementation of evidence-informed best nutrition and physical activity practices within ECEC settings. The study follows a quasi-experimental design and uses the Social Cognitive Theory for behavior change as a foundation (46). The Social Cognitive Model posits the mutual influence and interplay between behaviors, personal factors and the environment, also known as “Reciprocal Determinism” (46, 47). Health behaviors are influenced by personal factors and the physical and social environment, and in turn, individuals can influence their environment through behavior (46). This study integrates key constructs of the Social Cognitive Theory and addresses within-person influences such as educators’ knowledge and beliefs to encourage the adoption of best nutrition and activity practices which in turn can promote healthier ECEC environments. The Social Cognitive Theory was used as a guiding model for the development of the CHEERS materials. The modules were designed to improve educators’ skills and knowledge, aligning with the Social Cognitive Theory constructs, and provide essential information, empowering educators to implement best practices. Another key application of the Social Cognitive Theory pertains to the construct of self-efficacy. Within the Communities of Practice sessions that follow the modules, educators engage in a social negotiation to interpret and integrate the knowledge gained from the modules within their work as early childhood educators to reshape their efficacy beliefs of implementing best practices.

2.2 Participants and recruitment

2.2.1 Childcare centers and educators

Participant recruitment was implemented in the province of Alberta, Canada between 2019 and 2022. Children’s Services, Early Childhood Development Branch from the Alberta government, provided the research team with the full list of ECEC programs. ECEC centers were randomly selected for recruitment using postal codes to stratify the selection of ECEC centers from large urban population centers (population >100,000), medium population centers (30,000–99,000), small population centers (1000–29,999), and rural areas (population <1000) throughout the province (48). Starting in 2019, center directors were invited to participate through phone correspondence and provided with general information on the study. Center directors had the option to be in the intervention or control group based on their assessment of both available time and capacity to participate. Centers that agree to participate receive an email package with instructions, a consent form, links to surveys, and contact information of a trained research associate to answer potential questions. Inclusion criteria include: (1) licensed facility-based centers (2) providing care for a minimum of 15 children aged 2–5 years, (3) access to a computer and internet connection and (4) not currently enrolled in any other intervention to improve nutrition and activity practices. Exclusion criteria include (1) unlicensed ECEC centers, and (2) family day home or after school care program. Each participating center was requested to identify a minimum of three staff members to be included in the study, with a preference to include two educators and the center director or manager.

2.2.2 Children

Children were recruited to objectively measure physical activity and sedentary levels from participating ECEC centers. Children were recruited from the classroom of participating educators consisting of children aged between 2 and 5 years. Inclusion criteria include: (1) prior written consent from a parent or guardian to participate; (2) be aged between 2 to 5 years; and (3) be enrolled full-time at the center. Center staff were asked to distribute informational flyers and consent forms to parents via center communication methods with parents. Flyers provided parents with information about the study, what children would be doing as part of the study, and phone numbers of research staff. Parents/guardians provided written consent and answered demographic questions related to birth date and sex when returning the consent forms. Completed consent forms were collected by research staff for child participation and children provided verbal assent during data collection.

2.3 Development of materials

The online educational modules were developed in 2019 by a team of content expert developers in nutrition (early childhood dietitians in provincial health authority), physical activity (Be Fit For Life Center), wellness (university faculty member wellness specialist) and early childhood (university faculty member in early childhood) and used evidence-informed best practices to ensure high-quality content. These modules were then sent for review by content expert reviewers, identified from each of the specialties, and revised as necessary prior to implementation. Modules were further reviewed by an Early Childhood Educator university faculty member to ensure the messaging was respectfully communicated.

2.4 Intervention procedure

The CHEERS program is a quasi-experimental study with repeated measures that started in 2019 and will continue until 2023. Each year the program is repeated and involves a new cohort with repeated measurements at baseline, 5 and 10 months from baseline. During this period, ECEC centers in the intervention group participate in a series of activities. Firstly, they complete a set of online surveys hosted on Qualtrics. In addition to the surveys, the participants in the intervention group complete a 12-week set of online professional development modules and attend virtual weekly Communities of Practice sessions. The 5-month measurement served as a mid-point assessment and timed after the completion of the online modules and online Communities of Practice sessions. The 10-month measurement, a post intervention follow-up, aimed to evaluate the sustained and long-term impact of the intervention.

2.4.1 Online modules

The modules cover topics on healthy eating patterns and the eating environment, physical activity and literacy, self-care for educators, parents as partners, and the importance of sleep for children. The full list of modules can be found in Table 1. The modules are hosted on Articulate 360 (Articulate Global Inc) with the content authoring tool Rise, which offers several embedding features and pre-built interactions such as card sorting, flashcards, knowledge checks, and click-through processes. The modules include clear learning objectives, instructional videos, links to useful resources and embedded reflection questions that can be accessed through computer or mobile devices. Participants in the intervention group are asked to complete one module per week, with each module taking 1 to 2 h to complete. An example module can be seen in the Supplementary material. Each module requires participants to submit their name and email address as an exit response, which is used to track module completion. This allows the research team to send a reminder email to only those participants who have not yet completed the material. This approach ensures participants have the opportunity to complete the modules before moving to the next phase of the program.

TABLE 1
www.frontiersin.org

Table 1. Module topics.

2.4.2 Communities of practice

Participants engage in two different Communities of Practice throughout the intervention. First while completing the weekly educational modules participants attend online Communities of Practice which provide opportunities to reflect on the practical applications of the module topics with other directors and educators participating in the program. Second, after completing the 12-week modules, participants attend online Communities of Practice meetings with the other participants located at their center. These meetings are facilitated by Health Promotion Leaders who are experts in nutrition, public health, or physical activity. During the post-educational Communities of Practice meetings participants: co-collaborate on strategies to integrate the learning into programming within their respective centers; share challenges they are facing and strategies to overcome them; and are provided with additional resources from the Health Promotion Leaders as needed to support change within their centers. These Communities of Practice meetings take place over a period of 5 months with a session scheduled each month.

2.4.3 CHEERS challenge

Finally, participants are invited to take part in the “CHEERS Challenge” where they are encouraged to utilize the resources gained through the program and mobilize the knowledge they learned to other staff in the center or with parents.

2.4.4 Incentives

Participants in the control group receive an honorarium of $25 for completing surveys at baseline and then again at 10 months. Intervention participants are compensated for their time in the program with a knowledge grant during the 12-week education modules ($300) and the after 5-month Health Promotion Leader communities of practice component ($300). Participants are invited to a wrap up session at the end of the program to share preliminary study findings and celebrate the community.

2.4.5 Control group

Participants in the control group are instructed to continue with their usual practice, with the control group only filling surveys at baseline and end of program with no access to the intervention components.

2.5 Data collection and outcome measures

This study follows a mixed-method approach to evaluate the impact of the program in changing practices at the level of ECEC centers. Questionnaires are administered online using Qualtrics platform that is compatible across mobiles and computers. Surveys are administered at three time points: baseline (T1), after 5 months (T2), and after 10 months at the end of the program (T3). Outcome measures are summarized in Table 2.

TABLE 2
www.frontiersin.org

Table 2. List of outcome measures.

2.5.1 Quantitative assessments

2.5.1.1 CHEERS

The CHEERS survey is a community-based educator-administered self-audit survey designed to offer ECEC centers an assessment of their center’s healthy eating and physical activity environment (49). Each of the center’s participating educators complete the CHEERS tool which includes 59 items and measures four constructs: Food Served- n = 23 items, (e.g., My childcare center serves vegetables and fruit prepared with little or no added fat, sugar or salt), Healthy Eating Environment- n = 18 items, (e.g., My childcare center provides children with an assigned area, with few distractions, to sit and eat), Healthy Eating Program Planning- n = 6 items, (e.g., My childcare staff members attend professional development on nutrition education), and Physical Activity Environment- n = 12 items, (e.g., My childcare center has indoor space available for physical activity). Items are measured using a seven-point scale with response options ranging from 1 = “never” to 7 = “always.” The four subscale scores are calculated using an average of the items in the grouping. The CHEERS score is calculated as the average of the four subscales with higher scores reflecting adherence with optimal practices in nutrition and physical activity. The CHEERS survey provides ECEC centers with an assessment of their eating and activity environments and provides a personalized report that identifies one area of strength and one area for improvement in each of the four measured domains. The development of the CHEERS tool followed a structured content validation process with a final Flesch–Kincaid readability grade 8.1 (50). It has also been assessed within the educator community and shows evidence of good internal consistency (Cronbach’s α = 0.91), intra-rater reliability (ICC = 0.81), inter-rater reliability (ICC = 0.59), and concurrent validity with direct observation (ICC = 0.65) (51) as well as online administration (ICC = 0.86) (52).

2.5.1.2 Mindful Eating Questionnaire (MEQ)

The Mindful Eating Questionnaire is a 28-item self-reported scale that measures mindful eating behaviors (53). Each of the center’s participating educators complete the MEQ measures which include five domains: disinhibition, awareness, external cues, emotional response and distraction. It uses a four-point Likert scale with responses ranging from 1 (never/rarely) to 4 (always/usually), where higher scores reflect greater mindful eating. Each subscale score is calculated as the means of items, excluding the “not-applicable” responses. The total score is calculated as the mean of the five subscales with a higher score reflecting more mindful eating.

2.5.1.3 Canadian Behavior, Attitude and Nutrition Knowledge Survey (C-BANKS 2.0)

The C-BANKS 2.0 is a survey designed to measure nutrition-related knowledge, attitude, and behavior in the Canadian population (54). Each of the center’s participating educators complete the C-BANKS 2.0 which is comprised of 60 items and measures three constructs: Knowledge (20 items), Attitude (5 items) and Behavior (35 items). The C-BANKS 2.0 has been assessed for reliability and validity in Canadian adults (54). Knowledge items are scored as correct (1) or incorrect (0) and summed to create a total score. Attitude items use a seven-point Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree) and a total attitude score is calculated as the mean of items where a higher score reflects more positive attitudes. Behavior items employ a seven-point Likert scale ranging from 1 (never) to 7 (always) and the total score is calculated using the average of the items. The total C-BANKS 2.0 score is calculated as the average of the three subscales.

2.5.1.4 Physical Literacy Knowledge, Attitude, Self-efficacy, and Behavior (PLKASB-ECE) questionnaire for early childhood educators

Physical literacy is the motivation, confidence, physical competence, and knowledge and understanding to enable all individuals to value and take responsibility to engage in physical activities for life (55). The PLKASB-ECE is a self-administered instrument that measures early childhood educators’ knowledge, attitude, self-efficacy, and behaviors related to physical literacy in childcare environments. Each of the center’s participating educators complete the PLKASB-ECE which consists of 6 subscales: Knowledge (n = 7) measuring educators’ physical literacy knowledge; Perception of Knowledge (n = 2) measuring educators’ perception of their understanding related to physical literacy concepts, Self-Efficacy (n = 3) measuring educator’s self-efficacy toward developing physical literacy skills in the early learning environment, Attitude (n = 3) measuring educators’ attitudes regarding physical literacy and health outcomes; Environment Behaviors (n = 3) measuring educators’ perception of their physical literacy promotion practices in the ECE environment; and Personal Behaviors (n = 3) measuring perception of personal physical activity behaviors. Knowledge items are scored correct (1) or incorrect (0) and summed to derive the total score with a higher score indicating higher knowledge of physical literacy concepts. All perception, self-efficacy, attitudinal, and behavior items are scored on a seven-point Likert scale from 1 (strongly disagree) to 7 (strongly agree) and averaged into a mean score for each subscale (56).

2.5.1.5 Environment and Policy Assessment and Observation- EPAO

The EPAO instrument is used to objectively assess the nutrition and physical activity environment of participating ECEC centers. A single EPAO assessment is completed per center which consists of a day-long observation of practices within childcare facilities and includes a document review of the centers’ policies by a member of the research team (57). Trained Health Promotion Leaders (HPLs) visit consenting centers twice per year (Fall and Spring of every year) to complete the EPAO on a day agreed upon between directors and the HPL conducting the observation. Observations of nutrition and physical activity (PA) practices typically take place in the participating educators’ classroom, consisting of children ages 2–5 years. The nutrition related sections of the EPAO assess the overall nutrition environment and compliance with best nutrition practices. This study utilized the following EPAO nutrition-derived variables: Foods Provided, Feeding Environment, Feeding Practices and Nutrition Policy. The physical activity portion of the EPAO measures the following subdomains: outdoor and indoor play, educator’s physical activity practices and professional development, screen time and physical activity policy. In this study, the EPAO-overall PA score was used and calculated by summing all subdomains.

2.5.1.6 Accelerometers

ActiGraph GT3X accelerometers are used to objectively measure physical activity and sedentary levels of a subset of children from the participating ECEC centers. ActiGraph accelerometers have consistently been shown to provide reliable and valid estimates of physical activity in preschool children (58, 59). Educators are trained how to correctly attach and remove accelerometers by research staff. Children wear the accelerometers on the right hip using an elastic waist belt. Prior to placing the accelerometers, children’s assent is also obtained. Children wear the accelerometers for 7 days while they are at the ECEC centers. Children are fitted when they arrived at the child care center and accelerometers are removed at the end of each day. In this study, activity counts are set to 15-s Epochs. A minimum wear-time of 250 min/day for 4 days is required for a valid day. ECEC educators are trained to take children’s weight and height and record all wear-time related information in a daily log. Height is measured to the nearest 0.1 cm using a portable stadiometer (Seca 213 stadiometer) and weight is measured to the nearest 0.1 kg using an electronic scale. Using Pate et al. (60) proposed cut-off points, PA intensity is categorized into: sedentary PA: <200 counts/15 s, light PA: 200-419 counts/15 s, moderate PA: ≥420 counts/15 s and vigorous PA: ≥842 counts/15 s.

2.5.2 Qualitative assessments

2.5.2.1 Exit interviews

Following the completion of the 10-month intervention, educators and directors from the intervention group are invited to have 30-min semi-structured interviews conducted by HPLs via Google Meet. The interviews aim to assess participants’ experiences with the online modules and community sessions, barriers encountered, potential areas for improvement, and changes that occurred in their centers since joining the CHEERS program. The interviews are digitally recorded and subsequently transcribed into written form for further analysis.

2.5.2.2 Modules reflective questions

The 12 online modules contain open-response questions at the end of each educational module. The questions are completed within the SurveyMonkey platform and are intended to stimulate participants’ reflective practice and enhance their overall learning experience.

2.6 Statistical analysis

2.6.1 Intervention evaluation

We hypothesize that the CHEERS program will be effective in promoting positive changes in educator’s knowledge, beliefs, and practices leading to significant improvements in ECEC center nutrition and physical activity environments. Linear mixed model (LMM) analyses will be used to analyze the intervention effects on educator’s outcome measures. A three-level model with repeated measurements as first level, educators as second level and ECECs as third level will be used.

A qualitative thematic analysis using the NVivo 10 program will be conducted to explore participants’ perspective, satisfaction and evaluation of the CHEERS intervention, their use of online modules, their experiences, changes in knowledge, attitude, food provision and practices and barriers and enablers influencing adherence to best nutrition and physical activity practices.

2.6.2 Baseline descriptive characteristic and associations

In the current paper, we present baseline characteristics for the intervention and control groups. Additionally, we explore correlations between the CHEERS self-assessment survey and corresponding EPAO subdomains at baseline. We also assess the association between early childhood educator’s baseline personal nutrition knowledge, beliefs, and behavior with the corresponding CHEERS nutrition composite. All analyses are done using SPSS, version 28 (SPSS Inc., Chicago, Illinois) and statistical significance was set at a p-value < 0.05. A descriptive analysis was performed using means and standard deviations for continuous variables, whereas numbers and percentages were used for categorical variables. T-tests or chi-square tests were conducted to compare baseline demographic characteristics between the intervention and control groups. Fisher’s exact test was also used when the expected frequency was less than 5. Bivariate analyses examining the association between CHEERS and the C-BANKS 2.0 and EPAO subdomains were carried out using Pearson or Spearman correlation tests for non-normal data.

3 Results

3.1 Demographic profile by group

In 2019, 144 centers were invited to participate, of those 83 center directors (58%) agreed to allow recruitment of educators in their centers. Once the intervention started, five centers withdrew from the study due to three main reasons, change in center director, closure of center, and center staff left the profession resulting in 78 centers total. The intervention group comprised 138 participants (50 centers) and the control group 70 (28 centers). The baseline assessments of the first year (2019) revealed a study population 96.2% female with an average age of 40.05 ± 11.67 years. The majority were educators making up 62% of participants followed by directors accounting for 30.3% of the sample, 1.4% were cooks and 6.3% owners. Most participants were Level 3 which represents an educational completion of a 2-year diploma or university degree (44.4%) while 15.9% were Level 1 which represents the completion of the minimum requirement of the Child Care orientation program. The majority of the ECEC programs were private (70.7%) and provided food (91.4%). At baseline, with the exception of participant age, there were no significant differences in demographic characteristics between intervention and control groups (Table 3).

TABLE 3
www.frontiersin.org

Table 3. Characteristics of ECECs and ECEC educators.

3.2 Association of educators’ personal nutrition-related knowledge, attitude, and behavior (C-BANKS 2.0 scores) with CHEERS nutrition subdomains

As shown in Table 4, C-BANKS 2.0 and CHEERS total scores were significantly correlated, r = 0.156, p = 0.049. Specifically, the dietary behavior subscale of the C-BANKS 2.0 was significantly correlated with all of CHEERS nutrition subdomains (Food Served, Healthy Eating Environment and Healthy Program Planning) (p < 0.005). In other words, educators’ personal dietary behavior was significantly correlated with the nutrition environment and practices in the centers. Additionally, educators’ nutrition knowledge and attitudes were significantly positively correlated with their dietary behaviors. Educators with greater knowledge and a more positive attitude had significantly healthier dietary behaviors (p < 0.005).

TABLE 4
www.frontiersin.org

Table 4. Spearman Correlations between CHEERS and C-BANKS 2.0 for the total sample (N = 160) [Adapted from Lafave et al. (54)].

3.3 Association of CHEERS components with corresponding EPAO subdomains

The Physical Activity Environment (PAE) subscale of CHEERS was significantly correlated with the overall EPAO-PA score, r = 0.462, p = 0.035 (Table 5). This means, educators’ self-assessment of their center’s physical activity as measured by the CHEERS survey was significantly correlated with the physical activity environment and practices as objectively observed using the EPAO. The Food Served (FS) subscale of CHEERS was significantly correlated with the EPAO-Foods Provided subdomain, r = 0.549, p = 0.010, and with the EPAO-Nutrition Policy subdomain, r = 0.438, p = 0.047. In other words, the EPAO’s objective measurements of the food provided and the centers’ nutrition policy were significantly correlated with educators’ self-reported scores on food served. No significant associations were found between the self-reported Healthy Eating Environment scores from the CHEERS survey and the EPAO’s objective assessments of feeding environment and practices (p > 0.005).

TABLE 5
www.frontiersin.org

Table 5. Correlations between CHEERS and EPAO subdomains (N = 21).

4 Discussion

This article describes the protocol of the CHEERS eHealth intervention program which aims to encourage environmental changes of early learning settings at a wide geographical scale (provincial scope). We propose that the intervention would be an effective scaling up public health innovation due to its unique approach of utilizing eHealth strategies to improve the nutrition and physical activity environments of ECECs through staff education and community building to increase knowledge, attitudes, and adherence to best practices. This paper also provides baseline characteristics of the participants who took part in the CHEERS program in the first year and compares self-reported and observed eating and activity practices. In addition, the relation of educators’ own nutrition knowledge, attitudes and behaviors with self-reported evaluations of nutrition environments is examined.

Findings of the current study add to the existing research demonstrating the influence of educators’ own nutrition behaviors on food practices at the ECEC level (61). Our results indicate that educators with higher nutrition knowledge and positive attitudes toward healthy eating were more likely to engage in personal healthy dietary behaviors. Furthermore, the healthy dietary behavior of educators was positively correlated with better nutrition practices at the ECEC level. Educators who adopt healthier eating habits were more likely to provide supportive food environments and feeding practices to children in their care. Our finding that educators’ own dietary behaviors are associated with better mealtime practices and environment is supported by several theories including the Social Cognitive Theory (46) and the Ecological Model (18). Those theories underline the influence of important caregivers’ behaviors on promoting a child’s healthy habits through mechanisms such as normative practices, social support and role modeling. We did not find direct significant correlations between nutrition knowledge and attitudes with the feeding environment. However, our results suggest that educators’ knowledge and nutrition beliefs may influence personal dietary practices which can in turn contribute to the creation of better food environments and feeding practices at the daycare level. Future research should explore the indirect association between early childhood educator’s own nutrition knowledge and attitudes with feeding practices by investigating the potential mediating effect of personal dietary behaviors.

Objective measurement of the physical activity environment as measured by the EPAO-PA subscale was significantly associated with self-reports of physical activity environment and practices. The Physical Activity Environment subscale of the CHEERS survey measures a similar concept to the EPAO, in that they both evaluate daily physical activity opportunities, play equipment use, staff practices, professional development, and physical activity policy. The strong positive correlation between the CHEERS Physical Activity Environment subscale with the EPAO-PA subdomain suggests that the CHEERS self-report measure is closely aligned with the observational measure and provides further evidence of concurrent validity for the CHEERS survey assessing physical activity practices in child care centers (62, 63).

Similarly, the results of our study reveal a strong positive correlation between the Food Served subscale of the CHEERS and the objectively measured EPAO-Foods Provided and Nutrition Policy subdomains. The latter can be explained by the two tools measuring similar constructs. For instance, the Food Served subscale of the CHEERS asks about fruit and vegetable provision, dark leafy greens, high fiber food, and fatty foods which are also captured in the EPAO-Foods Provided subdomain. Additionally, the document review of the nutrition policy in the EPAO includes an evaluation section that assesses the menu and foods and beverages served at the daycare center corresponding closely with the constructs measured in the Food Served subscale of CHEERS. The alignment between the self-report data and observational measurements provides further evidence of concurrent validity for the CHEERS audit tool.

We anticipated significant correlations between the Healthy Eating Environment Subscale of CHEERS and the EPAO-Feeding Environment and Feeding Practices, as they measure similar aspects such as “using food as reward/bribe,” “encouraging children to try new foods,” “engaging in pleasant conversations during meal time,” “allowing children to decide what and how much to eat.” However, no significant associations were observed. The lack of correlation could be attributed to various factors. One explanation may be that CHEERS serves as an audit tool for educators to self-assess their practices and create action plans accordingly. As in all self-assessment tools, educators may have a tendency to overreport favorable behaviors (64). It is also plausible that educators initially perceive their feeding practices as optimal based on their subjective evaluation. However, as they engage in the intervention and complete the different trainings to gain a deeper understanding of what really constitutes optimal nutrition practices and recommended guidelines, it is possible that educators may reassess and evaluate their practices differently by the end of the intervention. Overall, the observed discrepancies highlight the need for the intervention to address best nutrition practices and to examine changes in the scores of both assessment tools before and after the intervention.

4.1 Strengths and limitations

The quasi-experimental design of our study can be viewed as a limitation. However, including centers based on their willingness and capacity to implement the intervention provides a more realistic insight into how such programs might be embraced in real-world day care settings. Additionally, no significant baseline differences were observed between intervention and control group, except for age, which is controlled for in all analyses. Another limitation of this study is that most data were self-reported and the possibility of educators reporting a more favorable picture of their practices cannot be ruled out. However, to balance this we also used an objective observational measure (EPAO). Furthermore, although ECEC centers were randomly selected, the study’s scope was limited to ECEC centers in the province of Alberta which limits the generalizability of the findings. Additionally, the majority of participants (94.6%) were women which brings into question the representativeness of the study sample. However, this aligns with the gender distribution in the ECEC workforce as per the latest statistics (96%) (65).

One of the strengths of this intervention is the use of both quantitative and qualitative research methods for the implementation of the intervention and analysis of results. This triangulation of data will contribute to a more comprehensive evaluation of the intervention, its impact and future maintenance.

5 Conclusion

To our knowledge the CHEERS program is the first eHealth intervention tool in Canada that comprehensively addresses both the nutrition and physical activity social and physical environment in ECECs. The development of the CHEERS program was based on evidence and theory-driven methodology and shows great potential of being a practical and sustainable scaling up approach to promoting healthier early childhood education and care settings.

Data availability statement

The datasets presented in this article are not readily available because the datasets generated during and/or analyzed during the current study are not publicly available due to participants’ privacy under the REB approval. Requests to access the datasets should be directed to LL, llafave@mtroyal.ca.

Ethics statement

The studies involving humans were approved by the Human Research Ethics Board at Mount Royal University (no. 101768). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

LL: Conceptualization, Data curation, Formal Analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review and editing. JH: Data curation, Formal Analysis, Investigation, Methodology, Supervision, Validation, Writing – original draft, Writing – review and editing. AW: Conceptualization, Data curation, Investigation, Methodology, Resources, Validation, Writing – review and editing. CM: Conceptualization, Data curation, Investigation, Methodology, Resources, Validation, Writing – review and editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This research was funded by Government of Alberta, Children Services (#ACS565189). The funder had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Acknowledgments

We thank the early childhood educators who took part in this study. Their dedication and passion to support young children inspires us.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnut.2024.1337873/full#supplementary-material

References

1. Lee H, Schafer M. Are positive childhood experiences linked to better cognitive functioning in later life?: Examining the role of life course pathways. J Aging Health. (2021) 33:217–26. doi: 10.1177/0898264320972547

PubMed Abstract | Crossref Full Text | Google Scholar

2. Braveman P, Sadegh-Nobari T, Egerter S. Early childhood experiences and health. Exploring the social determinants of health. Princeton, NJ: Robert Wood Johnson Foundation (2011).

Google Scholar

3. Birch L, Savage J, Ventura A. Influences on the development of children’s eating behaviours: From infancy to adolescence. Can J Diet Pract Res. (2007) 68:s1–56.

Google Scholar

4. Lioret S, Campbell K, McNaughton S, Cameron A, Salmon J, Abbott G, et al. Lifestyle patterns begin in early childhood, persist and are socioeconomically patterned, confirming the importance of early life interventions. Nutrients. (2020) 12:724. doi: 10.3390/nu12030724

PubMed Abstract | Crossref Full Text | Google Scholar

5. Park M, Falconer C, Viner R, Kinra S. The impact of childhood obesity on morbidity and mortality in adulthood: A systematic review. Obes Rev. (2012) 13:985–1000.

Google Scholar

6. Kelsey M, Zaepfel A, Bjornstad P, Nadeau K. Age-related consequences of childhood obesity. Gerontology. (2014) 60:222–8.

Google Scholar

7. Lichtenstein A, Appel L, Vadiveloo M, Hu F, Kris-Etherton P, Rebholz C, et al. 2021 dietary guidance to improve cardiovascular health: A scientific statement from the American heart association. Circulation. (2021) 144:e472–87. doi: 10.1161/CIR.0000000000001031

PubMed Abstract | Crossref Full Text | Google Scholar

8. Liang Z, Zhang M, Wang C, Yuan Y, Liang J. Association between sedentary behavior, physical activity, and cardiovascular disease-related outcomes in adults–a meta-analysis and systematic review. Front Public Health. (2022) 10:1018460. doi: 10.3389/fpubh.2022.1018460

PubMed Abstract | Crossref Full Text | Google Scholar

9. Swinburn B, Caterson I, Seidell J, James W. Diet, nutrition and the prevention of excess weight gain and obesity. Public Health Nutr. (2004) 7:123–46.

Google Scholar

10. Pate R, Hillman C, Janz K, Katzmarzyk P, Powell K, Torres A, et al. Physical activity and health in children under 6 years of age: A systematic review. Med Sci Sports Exerc. (2019) 51:1282–91.

Google Scholar

11. Carson V, Lee E, Hewitt L, Jennings C, Hunter S, Kuzik N, et al. Systematic review of the relationships between physical activity and health indicators in the early years (0-4 years). BMC Public Health. (2017) 17:854. doi: 10.1186/s12889-017-4860-0

PubMed Abstract | Crossref Full Text | Google Scholar

12. Glewwe P, Jacoby H, King E. Early childhood nutrition and academic achievement: A longitudinal analysis. J Public Econ. (2001) 81:345–68.

Google Scholar

13. Roberts M, Tolar-Peterson T, Reynolds A, Wall C, Reeder N, Rico Mendez G. The effects of nutritional interventions on the cognitive development of preschool-age children: A systematic review. Nutrients. (2022) 14:532.

Google Scholar

14. Jessri M, Nishi S, L’Abbe M. Assessing the nutritional quality of diets of Canadian children and adolescents using the 2014 health Canada surveillance tool tier system. BMC Public Health. (2016) 16:381. doi: 10.1186/s12889-016-3038-5

PubMed Abstract | Crossref Full Text | Google Scholar

15. Tugault-Lafleur C, Barr S, Black J. Examining differences in school hour and school day dietary quality among Canadian children between 2004 and 2015. Public Health Nutr. (2019) 22:3051–62. doi: 10.1017/S1368980019000788

PubMed Abstract | Crossref Full Text | Google Scholar

16. Rana H, Mallet M, Gonzalez A, Verreault M, St-Pierre S. Free sugars consumption in Canada. Nutrients. (2021) 13:1471.

Google Scholar

17. World Health Organization. Guideline: Sugars intake for adults and children. Geneva: World Health Organization (2015).

Google Scholar

18. Bronfenbrenner U. The ecology of human development: Experiments by nature and design. Cambridge, MA: Harvard University Press (1996). p. 330.

Google Scholar

19. Allen L, Kelly B, Committee on the Science of Children Birth to Age 8: Deepening and Broadening the Foundation for Success. Child development and early learning. Washington, DC: National Academies Press (2015).

Google Scholar

20. Larson N, Ward D, Neelon S, Story M. What role can child-care settings play in obesity prevention? A review of the evidence and call for research efforts. J Am Diet Assoc. (2011) 111:1343–62. doi: 10.1016/j.jada.2011.06.007

PubMed Abstract | Crossref Full Text | Google Scholar

21. Statistics Canada. Early learning and child care for children aged 0 to 5 years: A provincial/territorial portrait. Ottawa, ON: Statistics Canada (2019).

Google Scholar

22. Statistics Canada. Characteristics of child care centres serving children aged 0 to 5 years in Canada, 2021 to 2022. Ottawa, ON: Statistics Canada (2023).

Google Scholar

23. Robson S, Khoury J, Kalkwarf H, Copeland K. Dietary intake of children attending full-time child care: What are they eating away from the child-care center? J Acad Nutr Diet. (2015) 115:1472–8. doi: 10.1016/j.jand.2015.02.029

PubMed Abstract | Crossref Full Text | Google Scholar

24. Gubbels J, Gerards S, Kremers S. Use of food practices by childcare staff and the association with dietary intake of children at childcare. Nutrients. (2015) 7:2161–75.

Google Scholar

25. Robinson L, Wadsworth D, Peoples C. Correlates of school-day physical activity in preschool students. Res Q Exerc Sport. (2012) 83:20–6. doi: 10.1080/02701367.2012.10599821

PubMed Abstract | Crossref Full Text | Google Scholar

26. Anundson K, Sisson S, Anderson M, Horm D, Soto J, Hoffman L. Staff food-related behaviors and children’s tastes of food groups during lunch at child care in Oklahoma. J Acad Nutr Diet. (2018) 118:1399–407. doi: 10.1016/j.jand.2017.07.023

PubMed Abstract | Crossref Full Text | Google Scholar

27. Ward S, Bélanger M, Donovan D, Horsman A, Carrier N. Correlates, determinants, and effectiveness of childcare educators’ practices and behaviours on preschoolers’ physical activity and eating behaviours: A systematic review protocol. Syst Rev. (2015) 4:18. doi: 10.1186/s13643-015-0011-9

PubMed Abstract | Crossref Full Text | Google Scholar

28. Loth K, Shanafelt A, Davey C, Anfinson A, Zauner M, Looby A, et al. Provider adherence to nutrition and physical activity best practices within early care and education settings in Minnesota, helping to reduce early childhood health disparities. Health Educ Behav. (2019) 46:213–23. doi: 10.1177/1090198118780458

PubMed Abstract | Crossref Full Text | Google Scholar

29. Cole A, Vidgen H, Cleland P. Food provision in early childhood education and care services: Exploring how staff determine nutritional adequacy. Nutr Diet. (2017) 74:105–10. doi: 10.1111/1747-0080.12310

PubMed Abstract | Crossref Full Text | Google Scholar

30. Lanigan J. The relationship between practices and child care providers’ beliefs related to child feeding and obesity prevention. J Nutr Educ Behav. (2012) 44:521–9.

Google Scholar

31. Hollar T, Cook N, Natale R, Quinn D, Phillips T, DeLucca M. Training early childcare providers in evidence-based nutrition strategies can help improve nutrition policies and practices of early childcare centres serving racially and ethnically diverse children from low-income families. Public Health Nutr. (2018) 21:1212–21. doi: 10.1017/S1368980017003573

PubMed Abstract | Crossref Full Text | Google Scholar

32. Sigman-Grant M, Christiansen E, Fernandez G, Fletcher J, Branen L, Price B, et al. Child care provider training and a supportive feeding environment in child care settings in 4 states, 2003. Prev Chron Dis. (2011) 8:A113.

PubMed Abstract | Google Scholar

33. Bruijns B, Johnson A, Irwin J, Burke S, Driediger M, Vanderloo L, et al. Training may enhance early childhood educators’ self-efficacy to lead physical activity in childcare. BMC Public Health. (2021) 21:386. doi: 10.1186/s12889-021-10400-z

PubMed Abstract | Crossref Full Text | Google Scholar

34. Oberklaid F, Baird G, Blair M, Melhuish E, Hall D. Children’s health and development: Approaches to early identification and intervention. Arch Dis Child. (2013) 98:1008–11.

Google Scholar

35. United Nations. THE 17 GOALS | sustainable development. New York, NY: United Nations (2023).

Google Scholar

36. Leung L. Internet embeddedness: Links with online health information seeking, expectancy value/quality of health information websites, and Internet usage patterns. Cyberpsychol Behav. (2008) 11:565–9. doi: 10.1089/cpb.2007.0189

PubMed Abstract | Crossref Full Text | Google Scholar

37. Oenema A, Brug J, Lechner L. Web-based tailored nutrition education: Results of a randomized controlled trial. Health Educ Res. (2001) 16:647–60.

Google Scholar

38. Indig D, Lee K, Grunseit A, Milat A, Bauman A. Pathways for scaling up public health interventions. BMC Public Health. (2017) 18:68. doi: 10.1186/s12889-017-4572-5

PubMed Abstract | Crossref Full Text | Google Scholar

39. Vandelanotte C, Müller A, Short C, Hingle M, Nathan N, Williams S, et al. Past, present, and future of eHealth and mHealth research to improve physical activity and dietary behaviors. J Nutr Educ Behav. (2016) 48:219-228.e1. doi: 10.1016/j.jneb.2015.12.006

PubMed Abstract | Crossref Full Text | Google Scholar

40. Wantland D, Portillo C, Holzemer W, Slaughter R, McGhee E. The effectiveness of web-based vs. non-web-based interventions: A meta-analysis of behavioral change outcomes. J Med Internet Res. (2004) 6:e40. doi: 10.2196/jmir.6.4.e40

PubMed Abstract | Crossref Full Text | Google Scholar

41. Bennett G, Glasgow R. The delivery of public health interventions via the internet: Actualizing their potential. Annu Rev Public Health. (2009) 30:273–92.

Google Scholar

42. Reeves P, Edmunds K, Szewczyk Z, Grady A, Yoong S, Wolfenden L, et al. Economic evaluation of a web-based menu planning intervention to improve childcare service adherence with dietary guidelines. Implement Sci. (2021) 16:1.

Google Scholar

43. Barnes C, Yoong S, Nathan N, Wolfenden L, Wedesweiler T, Kerr J, et al. Feasibility of a web-based implementation intervention to improve child dietary intake in early childhood education and care: Pilot randomized controlled trial. J Med Internet Res. (2021) 23:e25902.

Google Scholar

44. Bruijns B, Vanderloo L, Johnson A, Adamo K, Burke S, Carson V, et al. Implementation of an e-Learning course in physical activity and sedentary behavior for pre- and in-service early childhood educators: Evaluation of the TEACH pilot study. Pilot Feasibility Stud. (2022) 8:64. doi: 10.1186/s40814-022-01015-1

PubMed Abstract | Crossref Full Text | Google Scholar

45. Brussoni M, Han C, Lin Y, Jacob J, Munday F, Zeni M, et al. Evaluation of the web-based OutsidePlay-ECE intervention to influence early childhood educators’ attitudes and supportive behaviors toward outdoor play: Randomized controlled trial. J Med Internet Res. (2022) 24:e36826. doi: 10.2196/36826

PubMed Abstract | Crossref Full Text | Google Scholar

46. Bandura A. Social foundations of thought and action: A social cognitive theory. Englewood Cliffs, NJ: Prentice-Hall (1986).

Google Scholar

47. Little B. Reciprocal determinism. In: V Zeigler-Hill, T Shackelford editors. Encyclopedia of personality and individual differences. Cham: Springer International Publishing (2018).

Google Scholar

48. Statistics Canada. Population centre and rural area classification 2016. Ottawa, ON: Statistics Canada (2017).

Google Scholar

49. Lafave L. MOESM1 of Creating a healthy eating and active environment survey (CHEERS) for childcare: An inter-rater, intra-rater reliability and validity study. (2019). Available online at: https://springernature.figshare.com/articles/journal_contribution/MOESM1_of_Creating_a_healthy_eating_and_active_environment_survey_CHEERS_for_childcare_an_inter-rater_intra-rater_reliability_and_validity_study/10071512/1 (accessed January 16, 2024).

Google Scholar

50. Lafave L, Tyminski S, Riege T, Hoy D, Dexter B. Content validity for a child care self-assessment tool: Creating healthy eating environments scale (CHEERS). Can J Diet Pract Res. (2016) 77:89–92. doi: 10.3148/cjdpr-2015-041

PubMed Abstract | Crossref Full Text | Google Scholar

51. Lafave L. Creating a healthy eating and active environment survey (CHEERS) for childcare: An inter-rater, intra-rater reliability and validity study. BMC Public Health. (2019) 19:1384. doi: 10.1186/s12889-019-7719-8

PubMed Abstract | Crossref Full Text | Google Scholar

52. Lafave L. Is the online “creating healthy eating and active environments survey” (CHEERS) tool reliable for early childhood educators in Alberta, Canada: A randomized crossover trial. Arch Public Health. (2023) 81:22. doi: 10.1186/s13690-023-01036-z

PubMed Abstract | Crossref Full Text | Google Scholar

53. Framson C, Kristal A, Schenk J, Littman A, Zeliadt S, Benitez D. Development and validation of the mindful eating questionnaire. J Am Diet Assoc. (2009) 109:1439–44.

Google Scholar

54. Lafave L, Hayek J, Lafave M. Update and validation of the Canadian behavior, attitude and nutrition knowledge survey (C-BANKS 2.0). Front Public Health. (2023) 11:1261146. doi: 10.3389/fpubh.2023.1261146

PubMed Abstract | Crossref Full Text | Google Scholar

55. Margaret Whitehead. Aspects of physical literacy: Clarification and discussion with particular reference to the physical domain. 1st ed. Routledge: Milton Park (2019). p. 300.

Google Scholar

56. Lafave L, Van Wyk N, Webster A, Hayek J, Lafave M. Developing a physical literacy knowledge, attitudes, self-efficacy, and behaviors questionnaire for early childhood educators (PLKASB-ECE): An exploratory factor analysis. PLoS One. (2024). Submitted.

Google Scholar

57. Ward D, Hales D, Haverly K, Marks J, Benjamin S, Ball S, et al. An instrument to assess the obesogenic environment of child care centers. Am J Health Behav. (2008) 32:380–6.

Google Scholar

58. Pfeiffer K, McIver K, Dowda M, Almeida M, Pate R. Validation and calibration of the actical accelerometer in preschool children. Med Sci Sports Exerc. (2006) 38:152–7.

Google Scholar

59. Sirard J, Trost S, Pfeiffer K, Dowda M, Pate R. Calibration and evaluation of an objective measure of physical activity in preschool children. J Phys Activ Health. (2005) 2:345–57.

Google Scholar

60. Pate R, Almeida M, McIver K, Pfeiffer K, Dowda M. Validation and calibration of an accelerometer in preschool children. Obesity. (2006) 14:2000–6.

Google Scholar

61. Nahikian-nelms M. Influential factors of caregiver behavior at mealtime: A study of 24 child-care programs. J Am Diet Assoc. (1997) 97:505–9. doi: 10.1016/S0002-8223(97)00130-2

PubMed Abstract | Crossref Full Text | Google Scholar

62. Stokes E. Rehabilitation outcome measures. Amsterdam: Elsevier (2011).

Google Scholar

63. Fink A. Survey research methods: International encyclopedia of education. Amsterdam: Elsevier (2010).

Google Scholar

64. Smith T, Blaser C, Geno Rasmussen C, Shuell J, Plumlee C, Yaroch A. Assessment of nutrition and physical activity practices using self-report and observation in early care and education across multiple US states. Public Health Nutr. (2017) 20:1692–8. doi: 10.1017/S1368980017000155

PubMed Abstract | Crossref Full Text | Google Scholar

65. Statistics Canada. Patterns of participation in early learning and child care among families with potential socioeconomic disadvantages in Canada. Ottawa, ON: Statistics Canada (2021).

Google Scholar

Keywords: early childhood education and care, nutrition, physical activity, online intervention, eHealth, educators, Health Promotion

Citation: Lafave LMZ, Hayek J, Webster AD and McConnell C (2024) Creating healthy eating and active environments in early learning settings: protocol of the CHEERS eHealth intervention study. Front. Nutr. 11:1337873. doi: 10.3389/fnut.2024.1337873

Received: 13 November 2023; Accepted: 12 February 2024;
Published: 28 February 2024.

Edited by:

Miroslava Rossenova Atanassova, Møreforsking AS, Norway

Reviewed by:

Temitope Erinosho, Indiana University Bloomington, United States
Cecilia Algarin, University of Chile, Chile

Copyright © 2024 Lafave, Hayek, Webster and McConnell. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Lynne M. Z. Lafave, llafave@mtroyal.ca

Download