Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 30 August 2019
Sec. Child and Adolescent Psychiatry
This article is part of the Research Topic Post-Traumatic Stress Disorder and Complex Traumatic Stress Disorder in Children and Adolescents View all 18 articles

Significant PTSD and Other Mental Health Effects Present 18 Months After the Fort Mcmurray Wildfire: Findings From 3,070 Grades 7–12 Students

  • 1Department of Computing Science, University of Alberta, Edmonton, AB, Canada
  • 2Department of Psychiatry, University of Alberta, Edmonton, AB, Canada
  • 3Alberta School of Business, University of Alberta, Edmonton, AB, Canada
  • 4Faculty of Social Work, University of Calgary, Calgary, AB, Canada
  • 5Department of Sociology and Anthropology, Mount Royal University, Calgary, AB, Canada
  • 6Fort McMurray Catholic School District, Fort McMurray, AB, Canada
  • 7Fort McMurray Public School District, Fort McMurray, AB, Canada

Background: The May 2016 wildfire in Fort McMurray, Alberta, Canada forced evacuation of the population of 88,000 individuals and destroyed 10% of the homes. Youth are particularly impacted by disaster.

Methods: Eighteen months after the wildfire, Fort McMurray Public and Catholic Schools surveyed 3,252 of the 4,407 students in Grades 7–12 to determine possible long-term psychological impacts. The survey included validated measurement scales for post-traumatic stress disorder (PTSD), depression, anxiety, use of drugs, alcohol, and tobacco, quality of life, self-esteem, and resilience. Data analysis was possible for only 3,070 students, i.e., 70% of the total student population. Anonymized data were analyzed to compare students who directly experienced lesser or greater impact from the wildfire, with greater impact defined as personally seeing the fire or having one’s home destroyed. Also, students with greater or lesser scores on the Child and Youth Resilience Measure (CYRM-12) were compared.

Results: Of the 3,070 students, 37% met criteria for probable PTSD; 31% met criteria for probable depression, and 17% for probable depression of at least moderate severity; 27% of students met criteria for probable anxiety, and 15% for probable alcohol or substance use disorder; 46% of all students met criteria for one or more probable diagnosis of PTSD, depression, anxiety, or alcohol/substance abuse, and this included students who were both present and not present in Fort McMurray at the time of the wildfire. Students with greater impact from the wildfire exhibited significantly higher scores on measures of PTSD, depression, anxiety, and alcohol/substance use. They also had lower self-esteem and quality of life scores. Students with lower resilience scores exhibited a similar pattern.

Conclusions: These findings highlight first the negative impact of disasters on youth mental health, particularly for those who directly experience wildfire, and second the role of resilience on youth mental health, with lower resilience associated with substantially lower mental health outcomes. These results emphasize the need for long-term mental health supports for youth post-disaster, with specific focus on increasing youth resilience, which may serve as a protective factor against effects of disaster on mental health.

Introduction

On May 3, 2016, a large wildfire, called “The Beast” in the popular media (1), forced the population of 88,000 living in Fort McMurray, Alberta, Canada to evacuate. The fire destroyed 10% of the homes in Fort McMurray and burned 590,000 hectares of land before being contained. The Insurance Bureau of Canada indicated that the cost of the Fort McMurray wildfire was estimated at $3.6 billion, making this the most expensive insured catastrophe in Canadian history (2). After evacuation, many individuals were displaced because their homes were damaged or made otherwise unfit for habitation by the fire. Many individuals also faced job loss and unemployment due to the damage and closure of local businesses. In addition to physical damage to local infrastructure, the community was affected by social, emotional, and psychological difficulties that are often present after a disaster (3). Youth in particular are affected by disasters given their dependence on adults, structural vulnerabilities, as well as physical, psychological, and social factors related to the youth developmental stage. However, little research has examined the impact of disasters on the mental health and well-being of youth.

Wildfires have a negative impact on the mental health of local residents in the affected areas, as indicated by previous studies and lived experience. Studies looking at both adults and children have reported that both groups exhibit an increased incidence of post-traumatic stress disorder (PTSD) (4) and increased symptoms of depression and stress (5). Studies focusing specifically on adults indicate that adults exhibit increased incidence of PTSD (6, 7), increased symptoms of depression and anxiety (7, 8), increased levels of psychological distress (9), and increased consumption of anxiolytics hypnotics (10). Studies of children and youth show that these groups exhibit increased incidence of PTSD and depression (11, 12).

In a broader context, non-wildfire disasters, including floods, earthquakes, and tsunamis, also have an adverse effect on mental health [see review in Goldmann and Galea (13) and Kar (14)]. Disasters are thought to cause increased incidence of PTSD, major depressive disorder, generalized anxiety disorder, and substance use disorder in children and adults. Tang et al. (15) also suggest an association between disasters and increased depression. Earthquakes have also been linked with increased incidence of PTSD (16). Some studies report an increase in suicide months or years after natural disasters [reviewed in Ref. (17)]. These patterns are particularly concerning because an individual’s ability or lack of ability to cope with adversity during and after a disaster plays an important role in determining long-term mental health outcomes.

Despite mental health and well-being challenges resulting from disasters, resilience plays an important role in the lives of children and youth by serving as a protective factor that mitigates the effects of disaster on mental health. Resilience refers to an individual’s capacity to handle adverse life experiences based on their mindset, resourcefulness, and support from family, friends, and community (18, 19). Higher resilience, in the form of reliance on family and friends, has been associated with buffering of the negative effects of wildfire (9, 20). Characteristics associated with non-resilience, including low socio-economic status, low social support, and poor relationships, have been linked with greater risk of psychopathology post-disaster (13, 21). Conversely, pro-resilience characteristics such as self-efficacy, optimism, hardiness, higher perceived ability to cope, and flexible adaptive responses are associated with reduced psychological symptoms after disasters (13). This is particularly important given that children and youth have been identified as being more vulnerable to psychopathology after disasters (13).

To our knowledge, only one previous study prior to 2019 examined the impact of wildfires on youth mental health at a population level, focusing on PTSD and depression (12). Our goal is to address the need to build more empirically informed evidence at the population level about the specific ways that youth’s mental health is impacted by disasters. We provide further insight into the mental health effects of wildfires on youth by focusing on PTSD, depression, anxiety, alcohol/substance use, and resilience.

By analyzing school mental health survey data collected by Fort McMurray Public and Catholic School boards in November 2017 (18 months after the 2016 wildfire), we were able to help determine the overall population mental health effects in youth. This analysis allowed specific insights into measures of symptoms indicative of PTSD, depression, anxiety, alcohol and substance misuse, tobacco use, levels of self-esteem, quality of life, and resilience. In addition to capturing information on the mental health effects using standardized scales, the Fort McMurray schools were interested in understanding how other factors may influence these measurements. Therefore, in the survey, youth were also asked specific questions about their personal exposure to the wildfire and about the direct impact the wildfire had on their lives, including if they were present and witnessed the wildfire when it occurred, as well as if their own home was destroyed by the wildfire.

We published an initial analysis (22) of the November 2017 Fort McMurray mental health survey dataset, investigating depression, anxiety, alcohol/substance misuse, self-esteem, and quality of life and comparing the Fort McMurray data to a control (non-disaster) dataset collected from Red Deer, Alberta. This initial study found that symptoms of depression and anxiety were higher in the Fort McMurray sample than in the Red Deer sample [see Figure 2 in Ref. (22)]. Rates of probable depression were higher in Fort McMurray, though rates of probable anxiety and probable alcohol/substance use disorder were not significantly different. Self-esteem and quality of life scores were lower in the Fort McMurray group. The initial study (22) did not compare PTSD symptoms between Fort McMurray and Red Deer, as the Red Deer mental health survey did not include a PTSD measure.

The current study presents an extended analysis of the Fort McMurray dataset, including an investigation of PTSD as well as examining the effects of severity of impacts from the 2016 wildfire experienced by different individuals on PTSD, depression, anxiety, alcohol/substance misuse, self-esteem, quality of life, and resilience.

Based on previous research, our hypotheses were that more serious exposure to the wildfire and more direct impacts from the wildfire would have greater negative effects on youth’s mental health. More specifically, we hypothesized that these youth would have higher risk of having clinically significant scores on measures of PTSD, depression, anxiety, and alcohol/substance misuse, while having lower scores on measures of self-esteem, quality of life, and resilience.

Materials and Methods

Overview and Ethical Considerations

The two school boards in Fort McMurray—Fort McMurray Public Schools and Fort McMurray Catholic Schools—asked all students in Grade 7–Grade 12 to complete a comprehensive survey of their mental health, in November 2017, 18 months after the 2016 wildfire. The survey was conducted to enable the school boards to evaluate the effectiveness of the programs that they put in place immediately following the wildfire (for details, see Appendix—Mental Health Support Programs in the Supplementary Materials). The November 2017 survey time was determined by the schools based on logistical and staff capacity considerations. All aspects of survey data collection, including participant consent, were administered by Fort McMurray Public Schools and Fort McMurray Catholic Schools, in accordance with their standard procedures and policies. Researchers from the University of Alberta were asked to assist in designing the survey and analyzing the survey data. After the survey data were collected by the schools, researchers from the University of Alberta analyzed an anonymized version of the data. Survey data analysis was approved by the University of Alberta’s Health Research Ethics Board on June 26th, 2017 (ethics protocol number Pro00072669).

The survey included questions to determine demographics, mental health, resilience, and personal exposure to and direct impacts of the wildfire. All survey data were collected by the two Fort McMurray school systems, under their ethical guidelines and supervision. The survey was administered as part of the schools’ standard curriculum to assess the educational and support programs they established after the wildfire. The selection of measurement instruments was made by the school systems, informed by the existing literature in this context as well as expert advice from the University of Alberta research team. Parents and guardians were made aware of the survey by written letter 2 weeks prior to survey administration in the schools. Parents/guardians had the option to opt their child(ren) out of the survey if they desired. Students, themselves, had the option to participate or not in the survey, which was explained at the start of each survey data collection session (see details below as well as the survey description script in the Supplementary Material). Survey participation was anonymous, and participants were not asked for their names. This paper presents an analysis of the survey data collected from both school boards.

Survey Questionnaires

The survey included the following 10 questionnaires (Table 1):

1. Demographics Questionnaire (Demographics, 7 questions) was a custom questionnaire assessing age, gender, the student’s grade, and school.

2. The Impact of Fire Questionnaire (IOF, 6 questions) was a custom questionnaire assessing the impact of the 2016 wildfire on the student, including whether they were present in Fort McMurray during the fire, whether they were evacuated, whether they personally saw the fire, and whether their home was destroyed.

3. Child PTSD Symptom Scale (CPSS, 19 questions) assesses symptoms of PTSD (23) and generates a score of PTSD symptom severity from 0 to 51.

4. The Patient Health Questionnaire, Adolescent version (PHQ-A, 11 questions) assesses symptoms of depression and suicidality (24, 25) and generates a score for depression symptom severity from 0 to 27.

5. The Hospital Anxiety and Depression Scale (HADS, 7 questions, anxiety-related questions only) assesses symptoms of anxiety (26) and generates a score for anxiety symptom severity from 0 to 21.

6. The CRAFFT Questionnaire (CRAFFT, 9 questions) assesses symptoms of alcohol and substance misuse (27, 28) and generates a score of alcohol/substance misuse severity from 0 to 6.

7. Tobacco Use Questionnaire (2 questions) includes two questions on tobacco use: “Over the past month: Do you smoke tobacco products? Do you use smokeless tobacco products?”

8. The Rosenberg Self-Esteem Scale (Rosenberg, 10 questions) assesses self-esteem (29) and generates a self-esteem score from 0 to 30.

9. The Kidscreen Questionnaire (Kidscreen-10, 11 questions) assesses quality of life (30) and generates a quality of life score from 0 to 44.

10. The Child and Youth Resilience Measure (CYRM-12, 12 questions) assesses resilience to adverse experience or trauma (31) and generates a resilience score from 12 to 60.

TABLE 1
www.frontiersin.org

Table 1 Questionnaire details.

Survey Administration Procedure

Students participated in the survey during regular school hours in the vast majority of cases. (A few students with special circumstances participated from home, using their own computers.) Each participant used a laptop or desktop computer to fill in the survey. The survey website used an HTML/CSS front-end and a back-end server written in the Clojure programming language (http://clojure.org). (Clojure was chosen as the server language for its high productivity with small development teams and strong track record in web applications.) Students either came to a computer laboratory or used laptops brought to their classroom, depending on their school. A survey description script was read to each class at the beginning of each survey session (reproduced in the Supplementary Material). The script explained the purpose of the survey, how to complete the survey, participant confidentiality, anonymity, and voluntary participation. Students’ confidential, anonymous, and voluntary participation in the survey was emphasized. Before participating, students were also given the opportunity to ask questions. Survey participation was anonymous, and the survey did not ask participants for their names. The survey battery included a total of 96 questions. Participation required less than 20 min for most students, though a small number of students took up to 50 min. Participants were able to skip questions, although the survey description script encouraged them to answer all questions.

Cutoff Scores and Probable Diagnoses

For each participant, we derived probable diagnoses of four different psychiatric conditions from the participant’s questionnaire answers on specific scales, combined with previously established cutoff points for probable diagnoses appropriate to each scale. Specifically, we considered PTSD (from the CPSS scale), depression (from PHQ-A), anxiety (from HADS), and alcohol/substance use disorder (from CRAFFT). We use the term “probable diagnosis” because scores were based on self-report scales, not psychiatric clinical interviews, and scores on a specific scale are not clinically diagnostic. Nonetheless, existing literature reports good correspondence between psychiatric clinical diagnoses of PTSD, depression, anxiety, and alcohol/substance use disorder with probable diagnoses based on widely published cutoff scores for the above four scales (27, 28, 3235). Each of the four probable diagnoses was defined based on a threshold value for the appropriate scale. Thus, probable PTSD was defined as having a CPSS score of 15 or more (35, 36). Probable depression was defined as having a PHQ-A score of 11 or more (33). Probable moderately severe depression was defined as having a PHQ-A score of 15 or more (32). Suicidal thinking was assessed from responses to questions 9 and 10 from the PHQ-A: question 9 “Over the past 2 weeks, how often have you been bothered by any of the following problems: Thoughts that you would be better off dead, or of hurting yourself in some way?” and question 10 “Has there been a time in the past month when you have had serious thoughts about ending your life?” Participants were defined as positive for suicidal thinking if they answered “Several days,” “More than half the days,” or “Nearly every day” to PHQ-A question 9 and “Yes” to question 10. Participants who answered “Not at all” to question 9 were not given question 10 and were defined as negative for suicidal thinking. Participants who answered “Several days,” “More than half the days,” or “Nearly every day” to PHQ-A question 9 and “No” to question 10 were defined as negative for suicidal thinking (as distinct from thinking about self-harm). (PHQ-A question 11 was not considered in the definition of suicidal thinking.) Probable anxiety was defined as having a HADS score of 11 or more (34). Probable alcohol/substance use disorder was defined as having a CRAFFT score of 2 or more (27, 28). Tobacco use was defined as answering “yes” to either of the two questions on the Tobacco Use Questionnaire. We also defined an “Any of 4 probable diagnoses” criterion as being positive for one or more of the four probable diagnoses: PTSD, depression, anxiety, or alcohol/substance use disorder.

Statistical Analysis

We defined five pairs of subgroups from participants, namely: 1) no impact of fire vs. any impact of fire; 2) present during the fire vs. not present; 3) saw the fire in person vs. did not see it; 4) home destroyed by the fire vs. home not destroyed; and 5) high resilience vs. low resilience.

1. No impact of fire vs. any impact of fire: The no impact of fire group was defined as those participants answering “no” to the following four questions: “Were you in or near Fort McMurray during any part of the 2016 wildfire?,” “Did you evacuate because of the fire?,” “Did you see the fire in person?,” “Was your home destroyed by the fire?” The any impact of fire group was defined as those participants who answered “yes” to any one or more of those four questions. Participants who did not provide an answer to all four questions were excluded from both the no impact of fire group and the any impact of fire group.

2. Present during the fire vs. not present: The present and not present during the fire groups were defined as participants answering “yes” and “no,” respectively, to the question “Were you in or near Fort McMurray during any part of the 2016 wildfire?” Participants who did not answer that question were excluded from both groups.

3. Personally witnessed the fire vs. did not see it: The personally witnessed the fire vs. did not personally witness the fire were defined as participants answering “yes” and “no,” respectively, to the question “Did you see the fire in person?” Participants who did not answer that question were excluded from both groups.

4. Home destroyed by the fire vs. home not destroyed: The home destroyed vs. not destroyed by the fire groups were defined as participants answering “yes” and “no,” respectively, to the question “Was your home destroyed by the fire?” Participants who did not answer that question were excluded from both groups.

5. High resilience vs. low resilience: Resilience was measured with the CYRM-12 questionnaire. High and low resilience groups were defined as participants whose CYRM-12 scores were, respectively, equal/above the median or below the median CYRM-12 score.

For each of these five pairs of groups, we compared the following 15 measures: 1) mean CPSS score, 2) mean PHQ-A score, 3) mean HADS score, 4) mean CRAFFT score, 5) mean Rosenberg score, 6) mean Kidscreen score, 7) mean CYRM-12 score, 8) percent probable PTSD, 9) percent probable depression, 10) percent probable moderately severe depression, 11) percent suicidal thinking, 12) percent probable anxiety, 13) percent probable alcohol/substance use disorder, 14) percent tobacco use, and 15) percent any of four probable diagnoses. Details of groups are given above. Details of questionnaire scores and probable diagnoses are given above. (Note that we did not compare mean CYRM-12 resilience scores for high vs. low resilience participants, as this would have been tautological.) In analyzing data for a given measure (e.g., mean CPSS), we included only those participants who provided answers for all questions in the relevant questionnaire or scale.

Permutation testing was used for all statistical comparisons (#iterations = 105). Permutation testing is a nonparametric method, chosen for its robustness against non-normality. All tests were two-sided, two-sample tests, with a null hypothesis of no difference between the means of the two groups for the given comparison. In total, our analysis included 74 individual statistical tests. We addressed multiple comparisons using the Benjamini–Hochberg method for false discovery rate (FDR) correction. This method computed a threshold of p = 0.027 for FDR correction. Effect sizes reported in tables are Cohen’s d (mean difference divided by pooled standard deviation). We performed all analyses using in-house computer code in the Clojure programming language (http://clojure.org). The server for the questionnaire website was written in Clojure, and the server saved participants’ (anonymous, encrypted) questionnaire answers in Clojure data structures. It was therefore simplest to analyze the data in Clojure as well. In-house analysis code included data collating, sorting, filtering, and questionnaire scoring functions as well as the permutation testing and Benjamini–Hochberg FDR algorithms, which are straightforward to implement. The code for statistical testing and FDR correction is available at http://github.com/mbrown/mrgbstats.

There were small, not statistically significant differences in the distributions of gender identification in the pairs of groups (see Supplementary Table 1 in the Supplementary Material). To test whether the differences in gender identification, though not significant, may have influenced the statistical comparisons of interest, we re-ran all of the comparisons on subsets of the data that were subsampled so as to make the distributions of gender identification as similar as possible between the groups. The gender-based subsampling did not qualitatively change the significant results; statistical comparisons that were significant in the original dataset were also significant in the subsampled dataset. In addition, there were small but, in some cases, statistically significant differences in mean age in the pairs of groups (see Supplementary Table 1 in the Supplementary Material for full details). To test for confounding effects of age, we re-ran all of the statistical comparisons on subsets of the data that were subsampled to make the distributions of ages as similar as possible between the groups (including no significant difference in mean age). The age-based subsampling did not qualitatively alter the significant results.

Results

The survey was administered to the entire available population of Grades 7–12 students in Fort McMurray, Alberta, Canada who were attending either the public schools (48% of students) or Catholic schools (52% of students) and who were attending their schools on the day the survey was conducted. Five public schools and two Catholics schools took part in the survey. In total, 3,252 students participated out of 4,407 students enrolled in both the public and Catholic systems in Grades 7–12. That is, a total of 72% of enrolled students participated in the survey. The results presented below are organized by comparison groups. For convenience, Supplementary Table 2 shows the results organized by mental health condition.

Data Exclusion

Of the 3,252 students who participated in the survey, data from 182 students were excluded due to one or more of the following exclusion criteria:

1. Age less than or equal to 10 years.

2. Age greater than or equal to 20 years.

3. Inconsistent answers among the positive and negative questions from the Rosenberg questionnaire (see details in Supplementary Material).

4. Inconsistent answers among the positive questions from the Rosenberg questionnaire and the positive questions from the Kidscreen questionnaire (see details in Supplementary Material).

5. Inconsistent answers among the nonreversed and reversed questions from the HADS questionnaire. (Answer order for two of the HADS questions is reversed to test for consistency; see details in Supplementary Material.)

Criteria 3 to 5 above excluded participants who gave inconsistent answers, possibly because they were not paying attention to the survey or did not understand the questions. After exclusions, the dataset included 3,070 participants, and statistical analysis was done on this set of participant data.

Demographics

Demographics for the 3,070 participants were as follows. Gender identification was 48% female, 48% male, 2% other, and 2% preferred not to say. Age ranged from 11 to 19; mean age was 14.32 with standard deviation 1.82.

Overall Scores and Rates of Probable Diagnoses

Table 2 shows mean questionnaire scores as well as rates for each probable diagnosis category across the entire set of 3,070 participants. For each questionnaire or probable diagnosis, only those participants who filled in every question of the relevant questionnaire were included (see N column in Table 2).

TABLE 2
www.frontiersin.org

Table 2 Overall Questionnaire Scores and Rates of Probable Diagnoses.

Overall, the survey findings reveal the following: PTSD scores were available from 2,877 students, and 37% met criteria for probable PTSD (CPSS score ≥ 15). There were 2,970 students for whom depression scores were available, and of these, 31% met criteria for probable depression (PHQ-A score ≥ 11), and 17% met criteria for probable depression of at least moderate severity (PHQ-A score ≥ 15). Of these 2,970 students, 16% exhibited suicidal thinking. Anxiety scores were available for 2,990 students, of whom 27% met criteria for probable anxiety (HADS score ≥ 11). Alcohol/substance use scores were available from 3,001 students, of whom 15% met criteria for probable alcohol/substance use (CRAFFT score ≥ 2). Tobacco use data were available from 3,011 students, and 13% exhibited tobacco use. Of the 3,070 students, 46% satisfied the “any of 4 probable diagnoses” criterion. (That is, all 3,070 students filled out at least one of the diagnostic questionnaires, and 46% met criteria for one or more probable diagnosis of PTSD, depression, anxiety, or alcohol/substance use).

No Impact of Fire Vs. Any Impact of Fire

There were no statistically significant differences between the “no impact of fire” group and the “any impact of fire” group in 14 of the 15 measures compared (Table 3). CYRM-12 resilience scores were slightly higher for the “any impact of fire” group (p = 0.0041, see Table 3). Suicidal thinking was higher for the “any impact of fire” group (p = 0.036), but this result did not survive FDR correction for multiple comparisons. Each comparison used only those students who filled out all questions in the relevant questionnaire. Numbers of students ranged from 258 to 275 for the “no impact of fire” category and 2,610 to 2,705 for the “any impact of fire” category.

TABLE 3
www.frontiersin.org

Table 3 No impact of fire vs. any impact.

Present During the Fire Vs. Not Present

There were no statistically significant differences between the “present in Fort McMurray during the fire” group vs. the “not present” group in 13 of the 15 measures compared (Table 4). CYRM-12 resilience scores were slightly higher for the “present during the fire” group (p = 0.0025, see Table 4). Rates of suicidal thinking were higher for the “present during the fire” group (p = 0.026). Each comparison used only those students who filled out all questions in the relevant questionnaire. Numbers of students ranged from 2,570 to 2,663 for the “present in Fort McMurray during the fire” category and 305 to 334 for the “any impact of fire” category.

TABLE 4
www.frontiersin.org

Table 4 Present vs. not present in Fort McMurray during fire.

Personally Witnessed the Fire vs. Did Not See It

Comparison of participants who personally witnessed the fire vs. those who did not see the fire revealed significant differences in 13 of the 15 measures tested (see Table 5). Participants who personally saw the fire exhibited higher mean scores for all mental health conditions tested, higher rates for all probable diagnoses tested, and lower means scores for quality of life. Rosenberg self-esteem and CYRM-12 resilience scores were not significantly different between these two groups. Each comparison used only those students who filled out all questions in the relevant questionnaire. Numbers of students ranged from 2,270 to 2,350 for the “personally witnessed fire” category and 604 to 641 for the “did not see the fire” category.

TABLE 5
www.frontiersin.org

Table 5 Personally witnessed fire vs. did not see fire.

Home Destroyed by the Fire Vs. Home Not Destroyed

Participants whose homes were destroyed vs. not destroyed by the fire exhibited significant differences in 12 of the 15 measures tested (see Table 6). Those whose home was destroyed had higher mean scores for all mental health conditions tested, higher rates for all probable diagnoses tested (except suicidal thinking), and lower means scores for self-esteem, quality of life, and resilience. Rates of probable depression and tobacco use were higher for the home destroyed group (p = 0.039 and p = 0.033, respectively), but these results did not survive FDR correction for multiple comparisons. Each comparison used only those students who filled out all questions in the relevant questionnaire. Numbers of students ranged from 284 to 299 for the “home destroyed” category and 2,590 to 2,691 for the “home not destroyed” category.

TABLE 6
www.frontiersin.org

Table 6 Home destroyed vs. not destroyed by fire.

High Resilience Vs. Low Resilience

The median resilience score (CYRM-12 score) across the 3,070 participants included in the statistical analysis was 48. High resilience was defined as having a CYRM-12 score of 48 or more, while low resilience was defined as having a CYRM-12 score of less than 48. There were significant differences between participants with high vs. low resilience scores on all 15 measures tested (see Table 7). Participants with high resilience showed lower scores on all mental health conditions, lower rates for all probable diagnoses, and higher self-esteem and quality of life scores. Each comparison used only those students who filled out all questions in the relevant questionnaire. Numbers of students ranged from 1,480 to 1,513 for the high resilience category and 1,376 to 1,424 for the low resilience category.

TABLE 7
www.frontiersin.org

Table 7 High vs. low resilience.

Discussion

Mental Health

This study examined the impact of the wildfire on the mental health of youth in Fort McMurray, Alberta. The findings indicate rates of probable PTSD (37%), probable depression (31%), probable anxiety (27%), and probable alcohol/substance use disorder (15%) in the population of Grades 7–12 students in Fort McMurray, Alberta 18 months after the 2016 wildfire. By way of comparison with previous Canadian studies, the prevalence of probable diagnosis of PTSD in children has been reported as 15.5% (35); prevalence of major depression in adolescents has been reported as 4–8% (37); incidence of probable anxiety in children and adolescents has been reported as 10–13% (38); and 17% of adolescents have reported binge drinking in the past month (39). In addition, comparison of the Fort McMurray survey data with control (nondisaster) data from Red Deer, Alberta (22) found that symptoms of depression and anxiety were higher in the Fort McMurray data as were rates of probable depression [see Figure 2 in Ref. (22)]. Rates of probable anxiety and probable alcohol/substance use disorder were not significantly different (22). Self-esteem and quality of life scores were lower in Fort McMurray (22). [The earlier study (22) did not compare PTSD symptoms between Fort McMurray and Red Deer, as the Red Deer mental health survey did not include a PTSD measure.] These findings therefore suggest significant elevated rates of PTSD, probable depression, and anxiety in Fort McMurray students following the wildfire. Overall, the results presented in the current study are consistent with previous studies showing increased mental health symptoms subsequent to wildfires (48, 11, 13, 40). These results highlight the need for mental health programs and supports for youth following disaster. (Consistent with this, Fort McMurray Public and Catholic Schools have put significant and ongoing work into establishing and maintaining mental health support programs for their students in the period following the wildfire. For details, see Appendix—Mental Health Support Programs in the Supplementary Materials).

Specific Impacts of the Wildfire

It was anticipated that those students who had the greatest level of impact from the 2016 wildfire, in the form of personally seeing the fire (vs. not seeing it) or having their homes destroyed (vs. not destroyed), would have more frequent mental health symptomatology. The findings indicate that students directly impacted by the fire had significantly higher scores on scales measuring symptoms related to PTSD, depression, anxiety, and substance misuse. These students also had significantly lower scores for self-esteem, quality of life, and resilience. The findings indicate that students directly impacted by the fire had higher rates of probable PTSD, depression, anxiety, and substance use disorder and higher rates of suicidal thinking and tobacco use. These results suggest that mental health impacts are more severe with increased severity of impact from wildfire on the individual, in the form of personally seeing the fire or having one’s home destroyed.

Importantly, the findings also revealed an unexpected pattern in students who had no direct impact from the fire; that is, they were out of town during the fire for a variety of reasons or were not living in Fort McMurray during the fire. The scores on almost all scales and questionnaires for these students were very similar to those who had direct experience with any impact of the fire (present during the fire, saw the fire, and/or home destroyed) in terms of mental health symptom scores, self-esteem, quality of life scores, and rates of probable diagnoses. These findings suggest that youth not directly impacted by the fire nonetheless experienced vicarious trauma as a result of the fire’s large impact on the community, similar to secondary trauma experienced by first responders and researchers in post-disaster situations (41, 42). These results are consistent with the literature, which indicates a substantial deleterious impact of wildfire disasters on population mental health (46, 811, 40). These results emphasize the need for policies and programs to support mental health in youth who are directly or indirectly impacted by disaster, as well as the need for a community-wide approach.

Resilience

Finally, resilience also played an important role in the mental health of youth. Low resilience was linked with substantially more severe mental health impacts from the wildfire. Though we do not have survey data from Fort McMurray prior to the 2016 wildfire, we believe that having a higher baseline level of individual resilience prior to a disaster would have beneficial effects on youth’s mental health. This is supported by previous research showing that higher resilience is associated with better mental health outcomes following disaster (9, 13, 20, 21). These results emphasize the need for long-term mental health supports for youth post-disaster, with specific efforts focusing on increasing youth’s resilience, which may serve as a protective factor that mitigates the effects of disaster on mental health.

Implications

In terms of interventions, there is often active discussion about whether to intervene in complete populations (so-called Universal interventions), even when only a subset of the population has issues, or whether is it better to be more focused (so-called Targeted or Selective interventions) for those with the greatest need. The issue with the latter approach, however, is that it misses large numbers of individuals who have only mild or moderate symptoms. The approach we have previously advocated is a combined approach, and we have shown this to be successful (43, 44). Nonetheless, we are not aware that this comprehensive approach has been examined after a wildfire or other major event, so its efficacy in this situation remains uncertain.

Limitations

The results presented here are based on a large sample of 3,070 participants. One limitation of the study is that clinical measures were based on self-report questionnaires as opposed to clinical interviews. Conducting a full clinical interview with each participant would not have been feasible given the large sample size. It would have been useful to have data using the same questionnaire battery from the Fort McMurray student population from before the 2016 Wildfire. This would have allowed a before and after wildfire comparison with identical instruments. Instead, we have previously presented a comparison of the Fort McMurray mental health data with control data previously collected using a very similar battery in Red Deer, Alberta (22).

Conclusion

In conclusion, the present results support existing findings that both youth and communities impacted by a wildfire, or similar major disaster, experience long-term mental health impacts. The present data extend this by examining all youth in grades 7–12 attending schools in Fort McMurray following the 2016 wildfire and identifying those groups who are most vulnerable and have the greatest risk. It is likely that providing additional assistance for all individuals to increase resilience, and also focusing on those with particularly severe wildfire impact, would be useful in terms of improving population mental health after a wildfire and other major disasters. Fort McMurray Public and Catholic Schools have put significant and ongoing work into establishing and maintaining mental health support programs for students in the aftermath of the 2016 wildfire. The findings presented here are consistent with the need for long-term mental health supports in disaster-affected communities such as Fort McMurray.

Data Availability

The dataset analyzed in this study is available from the corresponding author on reasonable request.

Ethics Statement

In November 2017, 18 months after the 2016 wildfire, the two school boards in Fort McMurray—Fort McMurray Public Schools and Fort McMurray Catholic Schools—asked all students in Grade 7–Grade 12 to complete a comprehensive survey of their mental health. The survey was conducted to enable the school boards to evaluate the effectiveness of the programs they had put in place immediately following the wildfire. Researchers from the University of Alberta were asked to collaborate and provide assistance in designing the survey and analyzing the survey data. After the data were collected, the anonymized data were made available for analysis by the researchers from the University of Alberta. The analysis of the survey data was approved by the University of Alberta’s Health Research Ethics Board on June 26th, 2017 (ethics protocol number Pro00072669).

The survey included questions to determine demographics, mental health, resilience, personal exposure to, and direct impacts of the wildfire. All survey data were collected under the auspices and ethical guidelines of the two Fort McMurray school systems and were administered as part of their standard curriculum and as an ongoing assessment of the educational and support programs they had put in place after the wildfire. The selection of measurement instruments was determined by the school systems and was informed by the existing scholarly literature and findings. Parents and guardians were notified of the process by written letter 2 weeks prior to the administration of the survey in the schools, and they had the option to opt their child(ren) out of the survey. Students had the option to participate or not in the survey, and this was explained at the start of each survey data collection session. Survey participation was anonymous; participants were not asked for their names. This paper provides an analysis of the survey data that were collected from both school boards.

Author’s Note

Some portions of the manuscript, mostly in the Materials and Methods section, are shared with a separate manuscript by the authors (22) presenting a distinct set of findings based on a separate analysis comparing the data from Fort McMurray to a similar survey dataset collected previously in Red Deer, Alberta.

Author Contributions

MB, VA, AG, PB-M, JD, CM-H, JO, MM, SN, DK, and PS were in charge of study design. MM, SN, and DK were in charge of data collection. Analysis was done by MB, IC, and PS. Manuscript preparation was done by MB, IC, PB-M, JD, CM-H, and PS.

Funding

Funding for support to the Fort McMurray schools in developing their survey and support for statistical analysis was provided by collaborative grant funding from the Canadian Institutes of Health Research, Canadian Red Cross, and Alberta Innovates Health Solutions (grant number 201600546).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Abbreviations

CPSS, Child PTSD Symptom Scale; CRAFFT, CRAFFT Questionnaire (proper name of the questionnaire is CRAFFT); CYRM-12, Child and Youth Resilience Measure; EMPATHY, Empowering a Multimodal Pathway Towards Healthy Youth project; FDR, false discovery rate; HADS, Hospital Anxiety and Depression Scale; Kidscreen-10, Kidscreen Questionnaire; PHQ-A, The Patient Health Questionnaire, Adolescent version; PTSD, post-traumatic stress disorder; Rosenberg, Rosenberg Self-Esteem Scale.

Acknowledgments

We thank Fort McMurray Public and Catholic school boards for allowing us to analyze an anonymized dataset derived from their survey. We also thank all individuals involved in the survey data collection including Fort McMurray teachers, counsellors, and other staff members.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2019.00623/full#supplementary-material

References

1. CBC. Devastating Fort McMurray wildfire declared out 15 months later | CBC News. (2017) Available at: http://www.cbc.ca/news/canada/edmonton/fort-mcmurray-fire-beast-extinguished-out-1.4271604 [Accessed April 17, 2018].

Google Scholar

2. Cryderman K. Fort McMurray wildfires to cost insurers $3.6-billion, The Globe and Mail. (2016) Available at: https://www.theglobeandmail.com/report-on-business/fort-mcmurray-wildfire-damage-to-cost-36-billion-insurance-bureau/article30788517/ [Accessed May 10, 2018].

Google Scholar

3. Cohan CL, Cole SW. Life course transitions and natural disaster: marriage, birth, and divorce following Hurricane Hugo. J Fam Psychol (2002) 16:14–25. doi: 10.1037//0893-3200.16.1.14

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Jones RT, Ribbe DP, Cunningham PB, Weddle JD, Langley AK. Psychological impact of fire disaster on children and their parents. Behav Modif (2002) 26:163–86. doi: 10.1177/0145445502026002003

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Kirsch KR, Feldt BA, Zane DF, Haywood T, Jones RW, Horney JA. Longitudinal community assessment for public health emergency response to wildfire, Bastrop County, Texas. Health Secur (2016) 14:93–104. doi: 10.1089/hs.2015.0060

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Psarros C, Theleritis C, Economou M, Tzavara C, Kioulos KT, Mantonakis L, et al. Insomnia and PTSD one month after wildfires: evidence for an independent role of the “fear of imminent death.” Int J Psychiatry Clin Pract (2017) 21:137–41. doi: 10.1080/13651501.2016.1276192

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Bryant RA, Gibbs L, Gallagher HC, Pattison P, Lusher D, MacDougall C, et al. Longitudinal study of changing psychological outcomes following the Victorian Black Saturday bushfires. Aust N Z J Psychiatry (2017) 52(6):000486741771433. doi: 10.1177/0004867417714337

CrossRef Full Text | Google Scholar

8. Papanikolaou V, Adamis D, Mellon RC, Prodromitis G. Psychological distress following wildfires disaster in a rural part of Greece: a case-control population-based study. Int J Emerg Ment Health (2011) 13:11–26.

PubMed Abstract | Google Scholar

9. Afifi WA, Felix ED, Afifi TD. The impact of uncertainty and communal coping on mental health following natural disasters. Anxiety Stress Coping (2012) 25:329–47. doi: 10.1080/10615806.2011.603048

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Caamano-Isorna F, Figueiras A, Sastre I, Montes-Martínez A, Taracido M, Piñeiro-Lamas M. Respiratory and mental health effects of wildfires: an ecological study in Galician municipalities (north-west Spain). Environ Heal (2011) 10:48. doi: 10.1186/1476-069X-10-48

CrossRef Full Text | Google Scholar

11. McDermott BM, Lee EM, Judd M, Gibbon P. Posttraumatic stress disorder and general psychopathology in children and adolescents following a wildfire disaster. Can J Psychiatry (2005) 50:137–43. doi: 10.1177/070674370505000302

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Papadatou D, Giannopoulou I, Bitsakou P, Bellali T, Talias MA, Tselepi K. Adolescents’ reactions after a wildfire disaster in Greece. J Trauma Stress (2012) 25:57–63. doi: 10.1002/jts.21656

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Goldmann E, Galea S. Mental health consequences of disasters. Annu Rev Public Health (2014) 35:169–83. doi: 10.1146/annurev-publhealth-032013-182435

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Kar N. Psychological impact of disasters on children: review of assessment and interventions. World J Pediatr (2009) 5:5–11. doi: 10.1007/s12519-009-0001-x

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Tang B, Liu X, Liu Y, Xue C, Zhang L. A meta-analysis of risk factors for depression in adults and children after natural disasters. BMC Public Health (2014) 14:623. doi: 10.1186/1471-2458-14-623

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Dai W, Chen L, Lai Z, Li Y, Wang J, Liu A. The incidence of post-traumatic stress disorder among survivors after earthquakes: a systematic review and meta-analysis. BMC Psychiatry (2016) 16:188. doi: 10.1186/s12888-016-0891-9

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Kõlves K, Kõlves KE, De Leo D. Natural disasters and suicidal behaviours: a systematic literature review. J Affect Disord (2013) 146:1–14. doi: 10.1016/j.jad.2012.07.037

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Ungar M. The social ecology of resilience: addressing contextual and cultural ambiguity of a nascent construct. Am J Orthopsychiatry (2011) 81:1–17. doi: 10.1111/j.1939-0025.2010.01067.x

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Rutter M. Implications of resilience concepts for scientific understanding. Ann N Y Acad Sci (2006) 1094:1–12. doi: 10.1196/annals.1376.002

CrossRef Full Text | Google Scholar

20. Felix E, Afifi T, Kia-Keating M, Brown L, Afifi W, Reyes G. Family functioning and posttraumatic growth among parents and youth following wildfire disasters. Am J Orthopsychiatry (2015) 85:191–200. doi: 10.1037/ort0000054

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Bryant RA, Gallagher HC, Gibbs L, Pattison P, MacDougall C, Harms L, et al., Mental health and social networks after disaster. Am J Psychiatry (2017) 174:277–85. doi: 10.1176/appi.ajp.2016.15111403

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Brown MRG, Agyapong V, Greenshaw AJ, Cribben I, Brett-MacLean P, Drolet J, et al. After the Fort McMurray wildfire there are significant increases in mental health symptoms in grade 7–12 students compared to controls. BMC Psychiatry (2019) 19:18. doi: 10.1186/s12888-018-2007-1

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Foa EB, Johnson KM, Feeny NC, Treadwell KR. The child PTSD Symptom Scale: a preliminary examination of its psychometric properties. J Clin Child Psychol (2001) 30:376–84. doi: 10.1207/S15374424JCCP3003_9

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Johnson JG, Harris ES, Spitzer RL, Williams JBW. The patient health questionnaire for adolescents: validation of an instrument for the assessment of mental disorders among adolescent primary care patients. J Adolesc Health (2002) 30:196–204. doi: 10.1016/S1054-139X(01)00333-0

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Spitzer RL, Kroenke K, Williams JBW. Group and the PHQPCS. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. JAMA (1999) 282:1737. doi: 10.1001/jama.282.18.1737

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand (1983) 67:361–70. doi: 10.1111/j.1600-0447.1983.tb09716.x

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Knight JR, Shrier LA, Bravender TD, Farrell M, Vander Bilt J, Shaffer HJ. A new brief screen for adolescent substance abuse. Arch Pediatr Adolesc Med (1999) 153:591–6. doi: 10.1001/archpedi.153.6.591

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Knight JR, Sherritt L, Harris SK, Gates EC, Chang G. Validity of brief alcohol screening tests among adolescents: a comparison of the AUDIT, POSIT, CAGE, and CRAFFT. Alcohol Clin Exp Res (2003) 27:67–73. doi: 10.1111/j.1530-0277.2003.tb02723.x

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Rosenberg M. Society and the adolescent self-image. Princeton, NJ: Princeton University Press (1965). doi: 10.1515/9781400876136

CrossRef Full Text | Google Scholar

30. Ravens-Sieberer U, Erhart M, Rajmil L, Herdman M, Auquier P, Bruil J, et al. Reliability, construct and criterion validity of the KIDSCREEN-10 score: a short measure for children and adolescents’ well-being and health-related quality of life. Qual Life Res (2010) 19:1487–500. doi: 10.1007/s11136-010-9706-5

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Liebenberg L, Ungar M, LeBlanc JC. The CYRM-12: a brief measure of resilience. Can J Public Health (2013) 104:e131–5. doi: 10.1007/BF03405676

CrossRef Full Text | Google Scholar

32. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med (2001) 16:606–13. doi: 10.1046/j.1525-1497.2001.016009606.x

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Richardson LP, McCauley E, Grossman DC, McCarty CA, Richards J, Russo JE, et al. Evaluation of the Patient Health Questionnaire-9 Item for detecting major depression among adolescents. Pediatrics (2010) 126:1117–23. doi: 10.1542/peds.2010-0852

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Snaith RP. The Hospital Anxiety and Depression Scale. Health Qual Life Outcomes (2003) 1:29. doi: 10.1186/1477-7525-1-29

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Stewart RW, Ebesutani C, Drescher CF, Young J. The Child PTSD Symptom Scale: an investigation of its psychometric properties. J Interpers Violence (2015) 32:2237–56. doi: 10.1177/0886260515596536

PubMed Abstract | CrossRef Full Text | Google Scholar

36. 36.ISSTS. Child PTSD Symptom Scale. Available at: http://www.istss.org/assessing-trauma/child-ptsd-symptom-scale.aspx [Accessed January 1, 2012].

Google Scholar

37. Hazell P. Depression in children and adolescents. BMJ Clin Evid (2009).

Google Scholar

38. Tramonte L, Willms D. The prevalence of anxiety among middle and secondary school students in Canada. Can J Public Health (2010) 101 Suppl:S19–22. doi: 10.1007/BF03403977

PubMed Abstract | CrossRef Full Text | Google Scholar

39. CAMH. Drug Use Among Ontario Students, Detailed Findings from the OSDUHS. (2017).

Google Scholar

40. Jones RT, Ribbe DP, Cunningham P. Psychosocial correlates of fire disaster among children and adolescents. J Trauma Stress (1994) 7:117–22. doi: 10.1007/BF02111917

PubMed Abstract | CrossRef Full Text | Google Scholar

41. McLennan J, Evans L, Cowlishaw S, Pamment L, Wright L. Secondary traumatic stress in postdisaster field research interviewers. J Trauma Stress (2016) 29:101–5. doi: 10.1002/jts.22072

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Alexander DA, Klein S. First responders after disasters: a review of stress reactions, at-risk, vulnerability, and resilience factors. Prehosp Disaster Med (2009) 24:87–94. doi: 10.1017/S1049023X00006610

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Silverstone PH, Bercov M, Suen VYM, Allen A, Cribben I, Goodrick J, et al. Initial findings from a novel school-based program, EMPATHY, which may help reduce depression and suicidality in youth. PLoS One (2015) 10:e0125527. doi: 10.1371/journal.pone.0125527

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Silverstone PH, Bercov M, Suen VYM, Allen A, Cribben I, Goodrick J, et al. Long-term results from the empowering a multimodal pathway toward healthy youth program, a multimodal school-based approach, show marked reductions in suicidality, depression, and anxiety in 6,227 students in grades 6–12 (aged 11–18). Front Psychiatry (2017) 8:81. doi: 10.3389/fpsyt.2017.00081

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: youth, mental health, wildfire, disaster, post-traumatic stress disorder, depression, anxiety, substance use and misuse

Citation: Brown MRG, Agyapong V, Greenshaw AJ, Cribben I, Brett-MacLean P, Drolet J, McDonald-Harker C, Omeje J, Mankowsi M, Noble S, Kitching DT and Silverstone PH (2019) Significant PTSD and Other Mental Health Effects Present 18 Months After the Fort Mcmurray Wildfire: Findings From 3,070 Grades 7–12 Students. Front. Psychiatry 10:623. doi: 10.3389/fpsyt.2019.00623

Received: 22 April 2019; Accepted: 05 August 2019;
Published: 30 August 2019.

Edited by:

Marie Rose Moro, Sorbonne Universités, France

Reviewed by:

Dimitra Laimou, University of Picardie Jules Verne, France
Katerina Kavalidou, National Suicide Research Foundation, Ireland

Copyright © 2019 Brown, Agyapong, Greenshaw, Cribben, Brett-MacLean, Drolet, McDonald-Harker, Omeje, Mankowsi, Noble, Kitching and Silverstone. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Peter Silverstone, peter.silverstone@ualberta.ca

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.