Recovery Education for Adults Transitioning From Homelessness: A Longitudinal Outcome Evaluation

Objective: Grounded in principles of adult education, Recovery Education Centres (RECs) hold promise in promoting recovery for adults with mental health challenges, but research on recovery outcomes for hard-to-reach populations participating in RECs is scant. This quasi-experimental study compares 12-month recovery outcomes of adults with histories of homelessness and mental health challenges enrolled in a REC, to those of participants of other community services for this population. Methods: This pre-post quasi-experimental study compared participants enrolled in a REC for people with histories of homelessness and mental health challenges (n = 92) to an age-and-gender frequency matched control group participating in usual services (n = 92) for this population in Toronto, Ontario. Changes from program enrollment to 12 months in personal empowerment (primary outcome), disease specific quality of life, recovery, health status, health related quality of life, and mastery were assessed. Post-hoc analyses compared subgroups with 1–13 h (n = 37) and 14+ h (n = 37) of REC participation during the study period to the control group. Linear mixed models estimated mean changes and differences in mean changes and 95% confidence intervals. Results: Mean change in perceived empowerment from program enrollment to 12 months in the intervention group [0.10 (95% CI: 0.04, 0.15)] was not significantly different from the control group [0.05 (−0.01, 0.11)], mean difference, 0.05 [(−0.03, 0.13), P = 0.25]. In the post-hoc analysis, the mean change in perceived empowerment for the intervention subgroup with 14+ h of REC participation [0.18 (0.10, 0.26)] was significantly different than in the control group [0.05 (−0.01, 0.11)] mean difference, 0.13 [(0.03, 0.23), P < 0.01]. Mean change in mastery was also significantly different for the intervention subgroup with 14+ h of REC participation [2.03 (1.04, 3.02)] vs. controls [0.60 (−0.15, 1.35)], mean difference, 1.43 [(0.19, 2.66), P = 0.02]. There were no significant differences in other outcomes. Conclusion: With sufficient hours of participation, recovery education may be a helpful adjunct to health and social services for adults with mental health challenges transitioning from homelessness.


INTRODUCTION
Recovery has become the dominant paradigm in mental health in many countries (1). In the recovery context, individuals strive to reach their full potential and achieve satisfying, hopeful, contributing lives, and despite the limitations of mental illness (2).
Recovery Education Centres (RECs), offering education and role modelling in a judgment free non-clinical environment, are a promising approach to enhancing recovery outcomes for adults experiencing mental health challenges (1,3,4). First appearing in the United States in the 1990s, RECs have since been implemented in more than 20 countries, including the United Kingdom, the United States, Canada, Australia, New Zealand, and Europe (5,6).
In qualitative studies, RECs have been found to support recovery outcomes at the personal, interpersonal and social levels, including perceived improvements in student connectedness with professionals (7) and student self-understanding and self-confidence (8). Longitudinal non-experimental quantitative studies have similarly identified benefits of participation, including greater participant knowledge and self-awareness, hopefulness, and mental wellbeing (9,10), as well as reductions in service utilisation (11,12). To our knowledge, only one published quantitative study of the impact of RECs to date has had a control group; this quasi-experimental evaluation reported short-term increases in participants' feelings of empowerment, self-efficacy, support, and affirmation (13).
Research on the effects of REC participation on disadvantaged populations, such as people transitioning from homelessness, has been scant (5,14). This gap is salient given that this population faces multiple barriers to recovery, including high rates of complex health and social challenges, stigma, discrimination, and poor access to health services (15)(16)(17)(18)(19). RECs, promoting low barrier participation, choice, self-determination, social connection, personal growth, and role modeling through peers, could offer a helpful adjunct to services for this population (14,20).
The primary objective of this quasi-experimental study was to compare the 12-month recovery outcomes of REC participants with histories of homelessness and mental health challenges, to those of a matched group of participants of other community services for this population in Toronto, Canada. A secondary objective was to examine, in a post-hoc analysis, the effect of the level of REC participation on these recovery outcomes.
For the primary analysis, we hypothesised that REC participants would experience greater increases in perceived empowerment (primary outcome), and quality of life, recovery, health status, and mastery (secondary outcomes) at 12 months, compared to a control group of participants engaged with other community services for this population.

Setting
The Supporting Transitions and Recovery Learning Centre (STAR) was launched in April 2014 at St. Michael's Hospital, an urban academic hospital in Toronto, Canada. Toronto is home to over 7,000 homeless people each night, with over 27,000 individuals using homeless shelters each year (21,22). Toronto is also a service rich setting, in which physician, hospital services and community support services, including mental health services, are offered at no cost to individuals. In addition to health services for those experiencing homelessness, dropin centres, social services and clubhouses offer recreational and vocational supports to this population.

Study Design
This study used a pre-post quasi-experimental design. Although a randomised controlled trial (RCT) was initially considered, it was thought to compromise the choice options of a disadvantaged population and therefore not pursued at this time, given the centrality of choice in REC philosophy. A total of 92 individuals with mental health challenges and recent histories of homelessness were recruited to each of the intervention and control groups from January 2017 to July 2018 and followed for 12 months. Control group participants were frequency-matched to REC participants on age and self-identified gender (14). Data were collected at the time of study enrolment (baseline) and 6 and 12 months post baseline. To be eligible, intervention participants had to have registered in the REC during the recruitment period and met REC eligibility criteria: (i) experienced challenges with maintaining housing within the past 2 years and (ii) being over 16 years of age (14). Control group participants were individuals with no prior or current participation in the REC and were recruited from community agencies that provide non-clinical, low barrier social, recreational, and vocational supports for this population (e.g., drop-in centres, clubhouses, and community centres). Given the inclusive nature of Recovery Education Centres, diagnostic information about mental health or substance use challenges was not required. A detailed description of the study protocol has been published (14).

Sample Size Calculation
A sample with at least 92 participants in each of the intervention and control groups provided 80% power to detect a medium effect size (Cohen d = 0.5) for the primary outcome, perceived empowerment, at 12 months, using a 2-sided t-test, assuming an attrition rate of 30% over the follow-up period. This was calculated using estimates from a quasi-experimental evaluation of a REC in Boston (13) that observed a difference in mean changes of 0.08 between the intervention and comparison groups from baseline to 12 months with an effect size of 0.41.
The study received Research Ethics Board approval by St. Michael's Hospital and the Centre for Addiction and Mental Health. Participation in the study was entirely voluntary. Prior to their baseline interview, individuals were asked for written informed consent. Capacity to consent was assessed by trained research staff who had experience working with this population. Specifically, together staff and participants reviewed a document with information about the study for participants to sign. When reviewing the consent form, interviewers were trained to regularly inquire if participants had questions. When a staff was uncertain about a participant's comprehension of the consent form, a consent checklist was used to confirm this comprehension. In addition, if a participant could not read or was visually impaired, another staff member was brought in to witness the consent portion of the interview and the participant's signature of the declaration of assistance.
Study participants received a $30 honorarium for attending each interview.

Intervention
STAR is among few RECs worldwide with a mandate to support people transitioning out of homelessness, and to our knowledge, unique in North America. Individuals could self-refer to STAR or be referred from hospitals, primary care clinics, as well as local shelters, community organisations and other settings serving this population. They were required to register and develop individualised learning plans upon enrolment.
STAR classes and workshops were taught by peers with lived experience of housing instability and mental health challenges, as well as social and health service professionals. Classes focus on life skills related to transitioning from homelessness to housing and other topics such as health and wellness, vocational skills, leadership and community engagement, hobbies, and interests. While operated by a hospital, the central classroom and staff offices were located at a community centre and additional participation in learning opportunities is offered in partnership with other organisations (e.g., Employment Services Centre, Libraries).

Outcomes
The primary outcome for this study was the change in selfreported personal empowerment from baseline to 12 months. Empowerment is a key dimension of recovery (23) and has been positively associated with perceived quality of life, self-esteem, and social support, and negatively associated with the severity of psychiatric symptoms (24). It was assessed using the Rogers Making Decisions Empowerment Scale (25). This measure has been used in other studies of individuals with mental health and addiction challenges (13), and has adequate psychometric properties, including internal consistency (alpha = 0.86) and factorial validity (26).
Secondary outcomes captured changes from baseline to 12 months in other domains inherent in the multidimensional view of recovery (see Table 1 For all scales, higher scores indicate greater recovery outcomes. Demographic variables that were collected at baseline were age, self-identified gender, ethnicity, employment, education, duration of longest period of homelessness, and housing stability over the past year, defined as the percentage of days stably housed. Housing stability was ascertained using the Modified Residential Time-Line Follow-Back Inventory that has high test-retest reliability and good concurrent validity in homeless populations (33).

Analysis
Sociodemographic characteristics were compared for intervention and control group participants using the two-sample t-test or Fisher's exact test. To assess change in scores from baseline to 12 months, as per the protocol analysis (14), linear mixed models with random intercepts were applied to perform repeated measures analysis of perceived empowerment and secondary outcomes (all continuous). An exchangeable correlation structure was used. The model included the main fixed effects of group (intervention vs. comparison), time (12 months vs. baseline), and the intervention × month interaction, adjusting for participant's age at baseline, self-identified gender, ethnicity, education, longest period of homelessness, and housing stability over the past year (a priori analysis). For each outcome, model-estimated mean changes from baseline to 12 months follow up and 95% CIs were examined. Differences in mean changes, 95% CIs and p-values were calculated to compare the groups (34). We conducted an "as-treated" post-hoc analysis to examine the effect of participation, as has been done in other studies on recovery services (35). This involved examining the effect of the number of hours of REC participation, rather than group membership. There is no precedent for the minimum "dose" of REC participation (i.e., number of sessions attended, or amount of time spent attending) needed to support recovery in RECs. As such, we consulted a review of 23 studies on similar interventions (i.e., peer led group sessions for participants with serious mental illness) and with similar designs to the present evaluation (longitudinal design, recovery outcomes of interest) (36). Of 23 studies, seven reported the mean number of sessions that participants attended [mean = 6.5 sessions or 13 h (6.5 × 2 h)].
To examine the effect of varying levels of participation on changes in primary and secondary outcomes from baseline to 12 months, we created three intervention subgroups based on hours of REC participation: REC registrants with no hours of participation, and therefore no exposure to the intervention (n = 18); (ii) REC registrants with 1-13 h of REC participation (n = 37), and (iii) REC registrants with 14 or more REC hours of participation during the 12 month follow up period (n = 37). The mixed effects model described above was applied again for this analysis, with the main fixed effect of group replaced with the hours of participation variable (0 h, 1-13 h, 14 or more hours, vs. control group).
Most scales had little missing data, or none (see Table 1). All statistical tests were two-sided, and a value of 0.05 or less indicated statistical significance. R software (version 3.4.1) was used for all analyses (37).

RESULTS
At baseline, across both groups (n = 184), participants had a median age of 42

Primary Outcome
Mean change ( For other outcomes, mean differences did not differ significantly between the 14 or more REC hours group and the control group at 12 months ( Table 4). Mean changes from baseline to 12 months for the group with 1-13 REC participation hours were not statistically different from those of the control group (Table 4).

DISCUSSION
This study evaluated the impact of REC membership and participation on key recovery outcomes for people with mental health challenges transitioning from homelessness in Toronto, Canada. This is only the second controlled longitudinal study of REC outcomes, following Dunn et al. (13), and is the first study examining outcomes for a population facing multiple barriers to mental health recovery. Compared to an age-and-gender frequency matched control group, REC participants did not experience statistically significant differences in any of the outcomes examined. However, both groups experienced improvement in most outcomes over 12 months.
Improvements in recovery outcomes among REC participants were also noted in qualitative findings from this evaluation (38), highlighting perceived improvements in health and wellbeing, self-esteem and confidence, interpersonal skills, and goal orientation (4).
Among the 92 REC study participants, 18 participants (20.0% of the intervention group) had no hours of participation in the REC. This is similar to the proportion of program registrants with no participation observed in other studies on recoveryoriented peer services, including recovery colleges. For example, in a study on a United Kingdom based REC, 29% of students who registered for courses never attended (11). Similarly, a study of veterans with mental health challenges who were using recovery-oriented peer support services found that 26% did not participate in learning opportunities (35). Finally, in a study of patients who were assigned a peer mentor after psychiatric hospitalisation, 34% had no contact with their mentor (39). Although a study on engagement with peer led services among previously homeless veterans with co-occurring mental illness and histories of substance use (40) did not report the proportion of participants with no attendance, it was similarly noted that participants had about one contact with the program per month, less than the intended once per week.
The post-hoc analysis highlighted that, after 12 months, those with 14 or more hours of REC participation had significantly greater improvements in perceived empowerment and mastery scores than control group participants. These finding suggest that a minimum level of REC participation may be needed to achieve key recovery outcomes. These findings support and are supported by a recent Australian study (41), in which attending a higher percentage of REC courses was associated with goal achievement. The post-hoc analysis further identified that socio-demographic characteristics were associated with the extent of participation. Specifically, participation was lower in people who were younger, non-white, unstably housed, employed, and had fewer years of education. As program participation is one of several pathways to improved recovery outcomes, our findings highlight a current gap in knowledge, as little evidence exists on the intensity of supports needed in REC and other recovery focused services for disadvantaged populations (40).
Future research should examine barriers to participating in RECs for individuals who experience multiple forms of disadvantage, such as being racialized, and having low levels of education. The social location of multiply disadvantaged groups can result in multiple barriers to accessing or engaging with available resources, producing differential effects on health and well-being (42). Finally, future research should be used to gain a more nuanced understanding of how RECs compare to other programs in terms of costs and on the reasons for limited or no subsequent engagement with RECs and other low barrier services after program enrollment.
The only other longitudinal evaluation of a REC with a comparison group (13) was conducted in Boston, USA in the 2000s and similarly examined the effects of REC participation on empowerment and other outcomes for individuals with mental health challenges relative to users of services-as-usual. There were significant increases in perceived empowerment and recovery attitudes for the intervention group relative to the comparison group, that experienced deterioration over time. Key differences from the present study are that the REC was not targeted to homeless individuals, and that a minimum of 36 h of participation was required to be eligible for study enrolment.

Limitations and Strengths
Although a randomised controlled trial (RCT) could have yielded stronger findings, pragmatic considerations advised against an RCT design at this time (13,14). While the posthoc analysis showed that REC participation for 14+ h was associated with improvements in perceived empowerment and mastery, it is notable that the intervention subgroup with 14+ h of participation in the REC was older, more likely to be white, to have attended University or post-secondary education, and less likely to be employed than the control group. Although multivariable models were adjusted for participant age, self-identified gender, ethnicity, education, longest period of homelessness, and housing stability over the past year, it is possible that greater participation in RECs could be associated with unmeasured individual characteristics that result in greater increases in self-reported empowerment. Additionally, the dose threshold of 14 h for recovery education was determined by a review of studies that examined the published the number of sessions needed to support recovery. However, the mean number rather than median number of sessions was used so it is possible that the dose determination may have been overly skewed. An additional limitation is that the study, similar to other intervention studies (18,42) did not capture additional services used by the intervention or control groups. This lack of information is particularly salient, as both the intervention and control groups experienced improvements over time. Another limitation is that in the field of patient-reported outcomes, such as empowerment, there are not standards established as to how to measure minimally important differences in outcomes (43).
Despite these limitations, this study has notable strengths compared to previous studies of REC outcomes, plagued by small sample sizes, and non-experimental designs. Importantly, the present study used rigorous quasi-experimental methods, focusing on a disadvantaged population experiencing multiple barriers to recovery, and included a control group of participants engaged with other community services. Another strength is the 12 month longitudinal follow-up period. In the review (36) of 23 longitudinal studies with similar outcomes cited earlier, only four had follow up periods of a year or more. Finally, grouping REC participants by hours of participation allowed for a more nuanced understanding of the potential impact of hours of participation on recovery outcomes.

CONCLUSION
Engaging people transitioning out of homelessness in Recovery Education may be a helpful adjunct to other services and supports for this population, although a minimum "dose" of REC participation may be needed to observe improvements in recovery outcomes. Future research should examine the processes and mechanisms that promote participation and engagement with recovery education, and the impact on recovery outcomes.

DATA AVAILABILITY STATEMENT
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

ETHICS STATEMENT
The studies involving human participants were reviewed and approved by St. Michael's Hospital and the Centre for Addiction and Mental Health. The patients/participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.

AUTHOR CONTRIBUTIONS
AD led manuscript drafting. VS was the study's Principal Investigator and supervised the drafting of this manuscript. RN and RW led the data analysis and participated in the editing of this manuscript. SH and NK participated in study design and implementation and the editing of this manuscript. All authors contributed to the article and approved the submitted version.