Skip to main content


Front. Psychiatry, 20 March 2017
Sec. Mood Disorders
Volume 8 - 2017 |

Depression Outcomes in Adults Attending Family Practice Were Not Improved by Screening, Stepped-Care, or Online CBT during a 12-Week Study when Compared to Controls in a Randomized Trial

imagePeter H. Silverstone1,2,3* imageKatherine Rittenbach2 imageVictoria Y. M. Suen2 imageAndreia Moretzsohn1 imageIvor Cribben3 imageMarni Bercov2 imageAndrea Allen2 imageCatherine Pryce2 imageDeena M. Hamza1 imageMichael Trew2
  • 1Department of Psychiatry, University of Alberta, Edmonton, AB, Canada
  • 2Strategic Clinical Network for Addiction and Mental Health, Alberta Health Services, Edmonton, AB, Canada
  • 3Department of Finance and Statistical Analysis, University of Alberta, Edmonton, AB, Canada

There is uncertainty regarding possible benefits of screening for depression in family practice, as well as the most effective treatment approach when depression is identified. Here, we examined whether screening patients for depression in primary care, and then treating them with different modalities, was better than treatment-as-usual (TAU) alone. Screening was carried out for depression using the 9-item Patient Health Questionnaire (PHQ-9), with a score of ≥10 indicating significant depressive symptoms. PHQ-9 scores were given to family physicians prior to patients being seen (except for the Control group). Patients (n = 1,489) were randomized to one of four groups. Group #1 were controls (n = 432) in which PHQ-9 was administered, but results were not shared. Group #2 was screening followed by TAU (n = 426). Group #3 was screening followed by both TAU and the opportunity to use an online cognitive behavioral therapy (CBT) treatment program (n = 440). Group #4 utilized an evidence-based Stepped-care pathway for depression (n = 191, note that this was not available at all clinics). Of the study sample 889 (60%) completed a second PHQ-9 rating at 12 weeks. There were no statistically significant differences in baseline PHQ-9 scores between these groups. Compared to baseline, mean PHQ-9 scores decreased significantly in the depressed patients over 12 weeks, but there were no statistically significant differences between any groups at 12 weeks. Thus, for those who were depressed at baseline Control group (Group #1) scores decreased from 15.3 ± 4.2 to 4.0 ± 2.6 (p < 0.001), Screening group (Group #2) scores decreased from 15.5 ± 3.9 to 4.6 ± 3.0 (p < 0.001), Online CBT group (Group #3) scores decreased from 15.4 ± 3.8 to 3.4 ± 2.7 (p < 0.01), and the Stepped-care pathway group (Group #4) scores decreased from 15.3 ± 3.6 to 5.4 ± 2.8 (p < 0.05). In conclusion, these findings from this controlled randomized study do not suggest that using depression screening tools in family practice improves outcomes. They also suggest that much of the depression seen in primary care spontaneously resolves and do not support suggestions that more complex treatment programs or pathways improve depression outcomes in primary care. Replication studies are required due to study limitations.


Depression is recognized as one of the most prevalent and costly conditions in society, occurring in approximately 10–20% of patients attending their family care physicians (1). However, it has been estimated that less than half are adequately recognized and treated (2). Depressed patients have higher rates of morbidity and mortality for a given level of medical illness (37). More specifically, depression occurs commonly in patients presenting to primary care physicians (8) and is frequently not diagnosed (911). This is important since primary care patients with depression have higher levels of morbidity and mortality, as well as greater health care costs, than similar patients without depression (12, 13). Thus, it is important to identify depression occurring in primary care patients, as well as treat it more effectively.

One suggested method to increase depression recognition is to screen for this in all adults attending primary care (14, 15) and/or looking more intently for the presence of depression in those with specific medical conditions (16, 17). Indeed, a recent US Preventive Services Task Force Recommendation was that screening for depression should occur in primary care for all adults who have not been screened previously (18). To assist this, it has been proposed that standardized depression screening tools be used for this in primary care (19). There are tools designed to help with patients screening, including patient centered-ones (20), and to also assist physicians determine appropriate antidepressants to use (21). One of the most widely used screening tools is the 9-item Patient Health Questionnaire (PHQ-9), a depression screening measure specifically developed for use in primary care (22), and widely validated in primary care (2325).

However, it should be noted that, in contrast to the US Preventive Services Task Force Recommendation, the Canadian Task Force on Preventive Health Care specifically recommended that screening for depression should not occur in primary care (19, 26). One of the reasons for such conflicting advice may be the relative lack of randomized controlled studies that can help clarify the potential benefits (or otherwise) of screening for depression in primary care. Another possible reason for these opposing recommendations may be the relative lack of access to treatment options for depressed patients when they are identified by primary care physicians.

Additionally, and the major focus of the present study was to try and help clarify the most appropriate treatment option when depression is identified. This includes previous development of a variety of Stepped-care pathways, which have been developed for use in primary care. Stepped-care treatment models usually include both medication and psychosocial interventions and may improve outcomes for depression in primary care (2733). However, such programs may be difficult to implement, can be resource and staff intensive, and the specific components of individual programs can vary widely (34, 35). Furthermore, not all studies have found statistically significant benefits from Stepped-care pathways (36, 37), and it remains somewhat uncertain which components are most effective. Several primary care practice characteristics can also significantly influence the quality of care provided to patients with depression and comorbid chronic conditions (38). Thus, while it is generally believed that effective treatment of depression decreases subsequent primary care visits (39), the success of any programs may be dependent upon perceptions of the best methods to achieve successful outcomes, and these in turn may differ between primary care physicians and their patients (40).

Nonetheless, despite uncertainty regarding the most efficacious components of a Stepped-care pathway, it is generally accepted that cognitive behavioral therapy (CBT) is an effective component of treatment of depression in primary care (41). One issue with the delivery of CBT has been access to appropriately trained therapists, and the availability of online versions has helped ameliorate this issue. A widely used free online CBT program is MoodGym, and its clinical benefits have been reported in primary care (42, 43), where it has been found to be as acceptable for most patients as face-to-face therapy (44). Such internet-based treatments are scalable and cost-effective (45), potentially making them widely available in primary care (46). Additionally, while it appears that online CBT is effective (47), other therapies may also be effectively delivered online (48). It should be noted, however, that while online psychotherapy programs are useful, they seem to be most effective when combined with face-to-face guided support (49). Indeed, a consistent finding from online studies is that such a “guided” approach usually has much higher retention rates and better outcomes (5052). Nonetheless, the practicality of a “guided” approach in family practice may be limited because of the resources required.

In summary, current guidelines vary in whether they recommend screening for all adult patients attending a primary care center. Second, there are differences in treatment approaches recommended when primary care patients are identified as being depressed. To enhance understanding in this area, we carried out a double-blind randomized study in which consecutive attendees at family practice sites were offered the option of completing a PHQ-9 rating scale on an electronic tablet while they were waiting for their physician, with follow-up ratings at 6 and 12 weeks for those who were depressed, and 12 weeks only for those who were not depressed at baseline. After informed consent, patients were randomized to one of four groups: (1) control; (2) treatment-as-usual (TAU); (3) online CBT program (MoodGym) (43, 44); and (4) a detailed Stepped-care pathway.

Based on the existing literature, it still remains uncertain whether or not interventions, particularly CBT or a Stepped-care pathway, improved depression outcomes compared to TAU. We are not aware of a previous similar randomized controlled study in primary care. Secondary hypotheses are related to the impact of screening itself and the frequency of onset of new cases of depression during the study period.

Materials and Methods

Ethical Consideration

This study was approved by written consent from the Health Research Ethics Review Board at the University of Alberta (Pro00038495) for adults aged 18 who were cognitively capable of giving informed consent. Approval was first given on 30th July 2013 and then included some small changes. The protocol presented in the present paper includes all approved changes.

Note that if any subject expressed suicidal thoughts or feelings at any time, in either written form or verbally, the patient’s physician was immediately notified. This study was conducted according to International standards of Good Clinical Practice (International Conference on Harmonization guidelines), the Declaration of Helsinki (2008 amendment, Seoul, Korea), applicable government regulations and Institutional research policies and procedures. It was registered with Clinical Trials database, Identifier: NCT01975207.

Study Flow

After a patient had registered for their appointment with their primary care physician, they were informed there was a study taking place and were given information about this. If they expressed interest, they were given information, and if they wanted to proceed they then signed an informed consent form, and also had the opportunity to discuss the study with a member of the study team. Only at this point, they were included in the study, given a unique study number, and were able to complete the PHQ-9 on an electronic tablet (Figure 1).


Figure 1. Patient flow during study. This shows the flow of patients who were randomized to each of four groups. All patients were followed up by telephone at 12 weeks. For those patients whose score was 10 or more on the 9-item Patient Health Questionnaire (PHQ-9), there was an additional telephone follow-up at 6 weeks.

Primary Study Hypotheses

The primary study hypothesis was that active treatments for depressed primary care patients (defined as those patients who scored ≥10 on PHQ-9 score following screening) would have lower scores for depression at 12 weeks compared to both controls and those who only received TAU. Thus, it was hypothesized that PHQ-9 scores would decrease to a statistically significant greater degree at 12 weeks in Group #3 (Online CBT Treatment + TAU) and Group #4 (Stepped-care pathway) compared to Group #1 (Screening Control) and Group #2 (TAU). The detailed descriptions of each of these Groups are as follows:

Group #1, Screening Control group: scores were not communicated to the patient or their physician, unless they indicated a suicide risk (utilizing predetermined criteria).

Group #2, TAU group: those who scored ≥10 on the PHQ-9 were informed of this, and the score was documented, and both the patient and their physician were notified of their score. In Group #2 treatment was up to the physician and was TAU.

Group #3, Online CBT Treatment + TAU group: those who scored ≥10 on the PHQ-9 were informed of this, and the score was documented, and both the patient and their physician were notified of their score. In addition to TAU, patients were also informed about a free online CBT program, MoodGym (43, 44). They were encouraged to use it, given a unique log-in number, and were given some information about previous publications suggesting clinical efficacy of this program.

Group #4, Stepped-care pathway: those who scored ≥10 on the PHQ-9 were informed of this, and the score was documented, and both the patient and their physician were notified of their score. In Group #4, treatment followed a specific Stepped-care pathway, in which all clinic physicians and therapists were trained. This was based on current research literature and had been used previously (53, 54). More details of the Stepped-care pathway are given below.

Secondary Hypotheses

There were additional secondary study hypotheses.

• That screening for depression would lead to lower scores in all groups when the presence of significant depression scores was supplied to physicians (Groups #2, #3, and #4) compared to the controls (Group #1), where this information was not supplied to either the patient or physician.

• That the spontaneous rate of new depression over the 12-week period would be consistent with the existing literature (55).

PHQ-9 Item

To measure depression, we used the PHQ-9, a specific depression screening measure developed for use in primary care, which has since been widely validated (2225). A score of ≥10 on the PHQ-9 indicates the presence of clinically significant depressive symptoms. In the present study, those who scored ≥10 on the PHQ-9 were considered depressed. Previously, research has suggested that scores of 10–14 are consistent with mild depression, scores of 14–20 are consistent with moderate depression, and scores of >20 are consistent with severe depression (2225).

A recent study carried out a meta-analysis, meta-regression, moderator, and sensitivity analysis of screening clinical utility of the PHQ-9 in primary care from over 40 studies involving nearly 30,000 people (56). The authors reported that the sensitivity for the PHQ-9 using a cut-off point of 10 was 81% (95% CI 72–89), and the specificity was 85% (95% CI 81–89). The authors suggested that the PHQ-9 is appropriate for screening but should not be used to confirm a clinical diagnosis.

In the present study, patients completed PHQ-9 questionnaire while waiting to see their physician. All patients were informed they would be followed up by telephone. In the follow-up telephone calls, the PHQ was read to the patient during this phone call and scored according to their answers. A similar approach has been used in previous research (57).

Stepped-Care Pathway

The Stepped-care pathway used in the present study was previously developed in Calgary, AB, Canada, utilizing updated research evidence and had been successfully utilized in 158 patients in an open-label study in 5 primary care locations during the period 2010–2011 (53, 54). In this previous open-label study, patients who scored 10–14 on the PHQ-9 (n = 61) were assigned to the watchful waiting level of intervention, patients who scored 15–19 (n = 54) were assigned to the moderate intervention level, and patients who scored 20 or higher (n = 43) were assigned to the high intervention level. Successful completion of the pathway was defined as scoring in the non-clinical range (<10) on the PHQ-9. The overall 6-month successful completion rate was 56%, and the mean reduction in PHQ-9 scores was −8.29 (SD = 6.03). At a 3-month follow-up after successful completion of the pathway, 80% of the patients assessed continued to score in the non-clinical range on the PHQ-9 (53, 54). The same methodology was utilized in the current study in Group #4, and training was given to all involved with providing this Stepped-care pathway.

In the present study, for those patients whose PHQ-9 scores were in the range 10–14 there was an initial period of “watchful waiting,” with a set follow-up appointment in 4 weeks and targeted self-management information. There were also specific clinical interventions for those whose scores were 15 or more. This intervention included additional visits, self-management information, medications prescribed according to guidelines, outside referral options, including a psychiatry consultation if they have non-response to medication within 6 weeks. It is important to note that additional resources were provided to those patients who were depressed and were randomized to Group #4, and this included increased availability of cognitive behavioral therapists.

Data Security and Data Collection

Collection of all data was on dedicated electronic tablets and was compliant with the local and international requirements for data collection. No personal information was collected (including age or gender), only the patient study number and Alberta Health Care Number. The Alberta Health Care Number cannot be linked to an individual, as this information is stored in a separate database to which the investigators had no access. It was collected to allow potential future anonymous analysis of health care utilization. Electronic data were transmitted in an encrypted manner over the internet. As soon as patient data were transmitted, neither the participant nor the study staff had any further access to that (or any other) information. It was not possible for any patient or study personnel to view their information, or anyone else’s until the study was complete. All data were stored in an encrypted manner by an independent organization that was authorized to maintain such information. At the end of the study, anonymized data were available to the research staff to analyze.

Randomization and Statistical Analysis Plan

Randomization was carried out at both a clinic and day level. There were two clinics involved, and one of these was able to enter patients into Group #4 (Stepped-care pathway). Therefore, in one clinic, patients were randomized to one of four groups (Groups #1–4) whereas in the second clinic, they were only randomized to one of three groups (Groups #1–3). This is the reason that the number of patients entered into Group #4 was lower than in the other three groups. Additionally, the randomization process was not done at an individual level but for an entire day at a clinic. This is because all communication was carried out in the waiting room and we did not want patients to hear about something being offered to one patient, when they would be offered something different. Therefore, the numbers in each group could not be perfectly matched since they depended upon the number of patients who came to a clinic on the days when that particular group was being offered.

For statistical analysis, the change in PHQ-9 was the primary outcome variable. Statistical analysis was carried out in R, version 3.1.0. In a previous study, there was a decrease of only 2 points in the PHQ-9 at 6 weeks and 6 months when no specific treatment was given (58). In comparison, use of the Depression Pathway for treatment in a pilot study led to a mean decrease in PHQ-9 of 10 points (from a mean baseline of 16) in those who completed the Treatment Pathway (53, 54). From pilot data carried out with the Stepped-care pathway, it was anticipated that 70% of patients would take part again at 12 weeks (53, 54). Additionally, based on this pilot research, we estimated that approximately 70% of subjects would have follow-up data.

Therefore, we estimated that in the completer groups, the mean decrease in PHQ-9 scores in the TAU group (Group #2) would be 2 points compared to a mean decrease in PHQ-9 scores in the Treatment Pathway group of 10 points (Group #4). A power analysis suggested that, with a 95% confidence level, the sample size needed was 32 per group. The anticipated number of patients who score at least 10 on the PHQ-9 will therefore need to be 45 in each group, on the assumption that 70% of patients will complete the 12-week assessment period. This would give a completer analysis of 32 patients per group. If 10% of patients were depressed, this would require a total recruitment of 450 in each of the four groups, for a total recruitment of 1,800 during the study period, which therefore was the number of patients we targeted for recruitment.

Analysis was carried out utilizing Wilcoxon rank paired tests comparing median scores. The Wilcoxon signed-rank test was used to test within group comparisons while the Wilcoxon rank-sum test was used to test between group medians. All results compared baseline scores to the scores at 12 weeks.


This study was carried out at two different clinics containing a total of 18 primary care physicians. During the study recruitment period from November 2013 to December 2014, a total of 1,489 patients were recruited into the study. Because patients would frequently attend several times at the same clinic during the 6-week periods we spent at each clinic, we were not able to measure the actual number of patients who were potentially eligible for the study. As noted previously, as only one of the clinics agreed to take part in the Stepped-care pathway, the numbers of patients randomized to the Stepped-care pathway (Group #4) were lower than the other groups. A total of 432 patients were randomized to the Control group (Group #1), 426 patients were randomized to screening followed by TAU (Group #2), 440 patients were randomized to TAU plus online CBT (Group #3), and 191 were randomized to the Stepped-care pathway (Group #4). Of these patients, approximately 15% of each group were depressed at baseline (PHQ-9 score ≥10) (Figure 2). A total of 889 patients (60%) of patients had a follow-up at 12 weeks, although this percentage varied between groups (Figure 2). Although not reported separately, the results did not change when controlling for site.


Figure 2. Patient numbers in each group during study. This shows the number of patients randomized to each of four groups, and the number who were followed up at 12 weeks (and the percentage) for both the total group and those who were depressed. Group #1 was the Control group; Group #2 was screening followed by treatment-as-usual (TAU); Group #3 was screening followed by TAU and online cognitive behavioral therapy (CBT); and Group #4 was the screening followed by Stepped-care. Note that not all clinics offered the Stepped-care option that is why fewer patients were randomized to this group.

In terms of depression outcomes, at baseline there were 54 (10.0%) depressed patients in the Control group, 48 (11.3%) depressed patients in the Screening group, 29 (6.6%) depressed patients in the Online CBT group, and 15 (7.9%) depressed patients in the Stepped-care pathway. There were no statistically significant differences in baseline PHQ-9 scores between these groups of depressed patients.

For all of the groups, there were statistically significant changes in PHQ-9 scores from baseline to 12 weeks (Figure 3) for Groups #1 and #2, but not for the treatment interventions, Groups #3 and #4. Thus, in the Control group (Group #1), this changed from a mean score of 4.6 ± 5.0 to 3.6 ± 4.3 (p < 0.001), and in the Screening group (Group #2), this changed from a mean score of 4.8 ± 4.9 to 4.3 ± 4.7 (p < 0.05). In the online CBT and treatment-as usual group (Group #3), this changed from a mean score of 4.1 ± 4.4 to 3.6 ± 4.4 (p = 0.06), and in the smaller Stepped-care group (Group #4), this changed from a mean score of 4.8 ± 5.5 to 4.1 ± 4.9 (p = 0.27).


Figure 3. Changes in mean 9-item Patient Health Questionnaire (PHQ-9) scores for total group. The mean scores from baseline to 12 weeks decreased across the entire group, but these were only statistically significant for the Control Group #1 (***p < 0.001) and the Screening and Treatment-as-usual Group #2 (*p < 0.05). There were no statistically significant changes for either Group #3 or Group #4. The number of patients in each group at both baseline and 12 weeks is shown in Figure 1.

In contrast, there were marked changes in mean PHQ-9 scores for those who were depressed at baseline. While the results showed that there were no statistically significantly differences at baseline between the four groups in terms of the means scores for those who had a PHQ-9 score ≥10 (Figure 4), in all groups there was a very marked drop in mean PHQ-9 scores at both 6 and 12 weeks (Figure 4). Control group (Group #1) scores decreased from 15.3 ± 4.2 to 4.0 ± 2.6 (p < 0.001), Screening group (Group #2) scores decreased from 15.5 ± 3.9 to 4.6 ± 3.0 (p < 0.001), Online CBT group (Group #3) scores decreased from 15.4 ± 3.8 to 3.4 ± 2.7 (p < 0.01), and the Stepped-care pathway group (Group #4) scores decreased from 15.3 ± 3.6 to 5.4 ± 2.8 (p < 0.05). However, there were no statistically significant differences between any of the groups in the amount of change in PHQ-9 scores at either 6 or 12 weeks (Figure 4).


Figure 4. Changes in mean 9-item Patient Health Questionnaire-9 (PHQ-9) scores for those patients who were depressed at baseline. It can be seen that the mean PHQ-9 scores decreased significantly at both 6 and 12 weeks in all groups. However, there were no statistically significant differences between any of the groups at either time point. *p < 0.05 compared to baseline, **p < 0.01 compared to baseline, ***p < 0.001 compared to baseline.

It should also be noted that among the 889 patients who completed both baseline ratings and again at 12 weeks, a total of 21 individuals had PHQ-9 scores ≥10, but whose scores were less than 10 at baseline. This would suggest that there was an incidence rate of depression of 2.4% over 12 weeks (an approximately annual incidence rate of 10%) in this sample.


We are not aware of another randomized study in primary care that has controlled for screening in the same manner as we have done. This is important to note, as the findings from our study do not support suggestions that screening for depression in primary care improves outcomes, at least as measured by PHQ-9 depression scores. While this was not the goal of the study, or part of our hypotheses, it is important to note as it has significant implications. Additionally, the present findings show that in the vast majority of cases of depression in primary care resolution occurs over a 12-week period, even in the absence of screening information passed onto the patient of physician to identify the presence of depression. Our other finding was that the type of intervention also appeared to make little difference and does not support the use of complex Stepped-care pathways compared to usual care. However, the clinics that took part were self-selected, and it is conceivable that these primary care practices practice an evidence-based approach and have a high degree of awareness for the risk of depression occurring in their patients, and thus screening would be unlikely to identify additional patients and many of the physicians may already be carrying out best practices. Additionally, as we did not have access to the clinical charts, we could not determine whether or not patients who were depressed in the Control group were in fact already detected by physicians.

One other point to note was that in reality there was very little difference between Group #2 (screening followed by TAU) and Group #3 (screening followed by TAU but with the addition of online CBT). This is because, despite our best efforts, uptake of the online CBT was very low. While a total of 25 of the potential 29 depressed patients in this group logged on, less than 5 completed more than 1 CBT session, and none of the patients completed the entire program. Thus, the possible potential impact of the CBT approach was limited. These rather disappointing results are similar to others, which have found that unless there is “guided” CBT (i.e., a person encouraging an individual on a repeated basis) very few individuals complete online CBT programs for depression (43, 4952).

In terms of improvements, it is well recognized that many patients who have depression in primary care improve spontaneously, with one review estimating that 23% of untreated depression patients in primary care will remit within 12 weeks, with higher remission rates occurring in those who have milder depressive illness (59). The fact that the mean PHQ-9 scores in all the groups were quite low at baseline (13.7–14.5) would be consistent with this.

Other Methodological Issues and Study Limitations

Despite the fact that this is a randomized controlled study, there were significant limitations that require further research before any definitive recommendations can be made. The first issue is that this study took place in only two clinics, and not the five we had intended. A second concern is that, particularly in the clinic who had training on the Stepped-care pathway, they could have integrated many of those approaches to their practice as part of their TAU, thus decreasing the apparent impact of the Stepped-care approach. Another issue with the data is that not only was the Stepped-care group much smaller than the others but it also had by far the lowest retention rates for the study. We are uncertain why this is the case, but it is possible that those who did not have a 12-week follow-up were doing better than those who were followed up. It is also important to note that our goal was to recruit patients from five separate clinics. However, despite approaching multiple clinics within the region we were able to only involve two clinics, only one of which was willing to take part in the Stepped-care pathway. This is why there were fewer patients randomized to this group (Group #4). Reasons from potential clinics as to why they were unwilling to take part in the research study included the following:

• Concerns about clinic staff resources being required was a major worry for many clinics. Many clinicians were also concerned that taking part in the study would interfere with the flow of patients.

• Clinics felt that their mental health teams were already too busy and were concerned the study would identify more patients needing treatment. They felt they could not manage more referrals, even if it was seen as a chance to prevent depression from worsening.

• Clinics were burdened with other priorities including other multiple quality improvement initiatives that were prioritized by clinic staff.

• Concerns around managing information on an ongoing basis was a concern, particularly as larger clinics have several physicians who may interact with the patient and can be hard to standardize the care approach

There were also specific concerns expressed about the Stepped-care pathway:

• The Stepped-care pathway requires initial and ongoing training—seen as time intensive for staff that are already busy with many priorities

• Stepped-care pathway requires repeated use of standardized tools and approaches, including specific advice regarding which medications would be used for specific patients, thus decreasing physician independence.

• Clinics felt that new evidence was always coming out, making it difficult to keep a detailed Stepped-care pathway up-to-date.

It should also be noted that these were “convenience” samples, i.e., only patients who came to the family practice were eligible. In terms of the randomization approach, since the waiting areas were open, it was likely that other patients in the waiting room would be aware of the study. For this reason, it was determined that randomization should occur per day, and not per patient. Thus, all patients who attended a specific clinic on an individual day would all be entered into the same group. This would avoid any possible issues where one patient in the waiting room, for example, was offered the opportunity to take part in online CBT while another was not. Another aspect that needs consideration is that after a period of time (usually 4–6 weeks) many of the patients coming to a specific clinic were those who had already come in the previous period, and therefore were not eligible. For this reason, recruitment rates decreased over time at each clinic and to address this recruitment alternated between clinics for a 6-week period (i.e., patients were only recruited at specific clinics for 6-week periods, before returning to the same clinic after a similar time period). Additionally, we did not have the resources to examine the medical charts of the patients who took part in the study. Therefore, we were not able to compare medication use, actual diagnosis, other medical diagnosis, or have access to demographic data. All of these may have helped understand the study population in more detail.

It can also be seen that making patients aware of the study, completing the informed consent process, and then completing the forms, took time. There were therefore many patients who expressed willingness to take part, and who started to complete the PHQ-9, but before completion they were called in for their appointment. In all such cases, the patient stopped entering data immediately and was not included in the study.

In terms of follow-up calls, our protocol only allowed an initial call and a maximum of only two follow-up calls, which all had to be carried out over a few days. It is possible, therefore, that different calling protocol, or use of other communication tools, may have led to higher follow-up rates at 12 weeks.


Despite the methodological issues, the present study was carried out in a relatively large group of patients who were then followed up for a meaningful period. Despite this, there was no evidence suggesting either that screening enhanced depression outcomes, or that any specific treatment intervention was more effective than TAU. Supporting the relevance of the study, our findings that the annual incidence for depression was approximately 10% are consistent with some other studies (55), although one recent study found an incidence rate of only 5% (60).

In conclusion, the findings from the present randomized controlled study in family practice suggest that most patients who have depressive symptoms have mild depression, much of which will resolve spontaneously. Our findings did not support any additional benefit for screening of patients for depression, or the use of specific treatment approaches when compared to TAU. Nonetheless, given the major burden of depression, its impact upon medical health as well as psychological health, and the key desire to minimize its occurrence, as well as the limitations of the present research, further randomized well controlled research studies in this area are critical.

Author Contributions

PS, KR, VS, MB, AA, CP, and MT designed and supervised this study. AM and DH were involved in managing and running the study and project management and data collection. IC and VS were involved in data analysis.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The reviewer NY and handling editor declared their shared affiliation, and the handling editor states that the process nevertheless met the standards of a fair and objective review.


The authors wish to thank all the primary care physicians for taking part in this study, as well as their staff for facilitating this study. Without them it would not have been possible. The authors also wish to thank Dennis Pusch, Keith S. Dobson, Robert Acton, and Leanne Quigley (Alberta Health Services, Calgary, AB, Canada and University of Calgary, Calgary, AB, Canada) for their generous support in this study, and allowing them to utilize their Stepped-care pathway for depression. The authors also wish to thank the authors of MoodGYM for allowing them to identify patients in this study who utilized their software. Financial support was provided, in part, by Alberta Health Service including a grant from Calgary Health Region.


1. Craven MA, Bland R. Depression in primary care: current and future challenges. Can J Psychiatry (2013) 58:442–8. doi: 10.1177/070674371305800802

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Lake CR, Baumer J. Academic psychiatry’s responsibility for increasing the recognition of mood disorders and risk for suicide in primary care. Curr Opin Psychiatry (2010) 23:157–66. doi:10.1097/YCO.0b013e328333e195

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Silverstone PH. Depression and outcome in acute myocardial infarction. Br Med J (1987) 294:645. doi:10.1136/bmj.294.6572.645-b

CrossRef Full Text | Google Scholar

4. Silverstone PH. Depression increases mortality and morbidity in acute life-threatening medical illness. J Psychosom Res (1990) 34:651–7. doi:10.1016/0022-3999(90)90109-H

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Meijer A, Conradi HJ, Bos EH, Thombs BD, van Melle JP, de Jonge P. Prognostic association of depression following myocardial infarction with mortality and cardiovascular events: a meta-analysis of 25 years of research. Gen Hosp Psychiatry (2011) 33:203–16. doi:10.1016/j.genhosppsych.2011.02.007

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Lichtman JH, Froelicher ES, Blumenthal JA, Carney RM, Doering LV, Frasure-Smith N, et al. Depression as a risk factor for poor prognosis among patients with acute coronary syndrome: systematic review and recommendations: a scientific statement from the American Heart Association. Circulation (2014) 129:1350–69. doi:10.1161/CIR.0000000000000019

CrossRef Full Text | Google Scholar

7. van Marwijk HW, van der Kooy KG, Stehouwer CD, Beekman AT, van Hout HP. Depression increases the onset of cardiovascular disease over and above other determinants in older primary care patients, a cohort study. BMC Cardiovasc Disord (2015) 15:40. doi:10.1186/s12872-015-0036-y

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Hickie IB. An approach to managing depression in general practice. Med J Aust (2000) 172:106–10.

Google Scholar

9. Schuyler D. Depression comes in many disguises to the providers of primary care: recognition and management. J S C Med Assoc (2000) 96:267–75.

PubMed Abstract | Google Scholar

10. Timonen M, Liukkonen T. Management of depression in adults. Br Med J (2008) 336:435–9. doi:10.1136/bmj.39478.609097.BE

CrossRef Full Text | Google Scholar

11. Thyrian JR, Eichler T, Reimann M, Wucherer D, Dreier A, Michalowsky B, et al. Depressive symptoms and depression in people screened positive for dementia in primary care – results of the Delphi-study. Int Psychogeriatr (2016) 28:929–37. doi:10.1017/S1041610215002458

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Moussavi S, Chatterji S, Verdes E, Tandon A, Patel V, Ustun B. Depression, chronic diseases, and decrements in health: results from the world health surveys. Lancet (2007) 370:851–8. doi:10.1016/S0140-6736(07)61415-9

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Ofman JJ, Badamgarav E, Henning JM, Knight K, Gano AD Jr, Levan RK, et al. Does disease management improve clinical and economic outcomes in patients with chronic diseases? A systematic review. Am J Med (2004) 117:182–92. doi:10.1016/j.amjmed.2004.03.018

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Deneke DE, Schultz HE, Fluent TE. Screening for depression in the primary care population. Psychiatr Clin North Am (2015) 38:23–43. doi:10.1016/j.psc.2014.11.006

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Soltani M, Smith S, Beck E, Johnson M. Universal depression screening, diagnosis, management, and outcomes at a student-run free clinic. Acad Psychiatry (2015) 39:259–66. doi:10.1007/s40596-014-0257-x

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Stepleman LM, Decker M, Rollock M, Casillas R, Brands T. Depression screening in Black Americans with multiple sclerosis. Psychol Health Med (2014) 19:33–9. doi:10.1080/13548506.2013.775466

CrossRef Full Text | Google Scholar

17. Willborn RJ, Barnacle M, Maack B, Petry N, Werremeyer A, Strand MA. Use of the 9-item patient health questionnaire for depression assessment in primary care patients with type 2 diabetes. J Psychosoc Nurs Ment Health Serv (2016) 54:56–63. doi:10.3928/02793695-20151109-01

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Siu AL; US Preventive Services Task Force (USPSTF), Bibbins-Domingo K, Grossman DC, Baumann LC, Davidson KW, et al. Screening for depression in adults: US preventive services task force recommendation statement. JAMA (2016) 315:380–7. doi:10.1001/jama.2015.18392

CrossRef Full Text | Google Scholar

19. Thombs BD, Ziegelstein RC. Depression screening in primary care: why the Canadian task force on preventive health care did the right thing. Can J Psychiatry (2013) 58:692–6. doi:10.1177/070674371305801207

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Krist AH, Glasgow RE, Heurtin-Roberts S, Sabo RT, Roby DH, Gorin SN, et al. The impact of behavioral and mental health risk assessments on goal setting in primary care. Transl Behav Med (2016) 6:212–9. doi:10.1007/s13142-015-0384-2

PubMed Abstract | CrossRef Full Text | Google Scholar

21. LeBlanc A, Herrin J, Williams MD, Inselman JW, Branda ME, Shah ND, et al. Shared decision making for antidepressants in primary care: a cluster randomized trial. JAMA Intern Med (2015) 175:1761–70. doi:10.1001/jamainternmed.2015.5214

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med (2001) 16:606–13. doi:10.1046/j.1525-1497.2001.016009606.x

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Löwe B, Kroenke K, Herzog W, Gräfe K. Measuring depression outcome with a brief self-report instrument: sensitivity to change of the patient health questionnaire (PHQ-9). J Affect Disord (2004) 81:61–6. doi:10.1016/S0165-0327(03)00198-8

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Fuchs CH, Haradhvala N, Hubley S, Nash JM, Keller MB, Ashley D, et al. Physician actions following a positive PHQ-2: implications for the implementation of depression screening in family medicine practice. Fam Syst Health (2015) 33:18–27. doi:10.1037/fsh0000089

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Lakkis NA, Mahmassani DM. Screening instruments for depression in primary care: a concise review for clinicians. Postgrad Med (2015) 127:99–106. doi:10.1080/00325481.2015.992721

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Canadian Task Force on Preventive Health Care, Joffres M, Jaramillo A, Dickinson J, Lewin G, Pottie K, et al. Recommendations on screening for depression in adults. CMAJ (2013) 185:775–82. doi:10.1503/cmaj.130403

CrossRef Full Text | Google Scholar

27. Franx G, Meeuwissen JA, Sinnema H, Spijker J, Huyser J, Wensing M, et al. Quality improvement in depression care in the Netherlands: the depression breakthrough collaborative. A quality improvement report. Int J Integr Care (2009) 9:e84. doi:10.5334/ijic.314

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Oosterbaan DB, Verbraak MJ, Terluin B, Hoogendoorn AW, Peyrot WJ, Muntingh A, et al. Collaborative stepped care v. care as usual for common mental disorders: 8-month, cluster randomised controlled trial. Br J Psychiatry (2013) 203:132–9. doi:10.1192/bjp.bp.112.125211

CrossRef Full Text | Google Scholar

29. van Straten A, Seekles W, van’t Veer-Tazelaar NJ, Beekman AT, Cuijpers P. Stepped care for depression in primary care: what should be offered and how? Med J Aust (2010) 192(Suppl):S36–9.

PubMed Abstract | Google Scholar

30. Unützer J, Park M. Older adults with severe, treatment-resistant depression. JAMA (2012) 308:909–18. doi:10.1001/2012.jama.10690

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Farooq S. Collaborative care for depression: a literature review and a model for implementation in developing countries. Int Health (2013) 5:24–8. doi:10.1093/inthealth/ihs015

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Franx G, Huyser J, Koetsenruijter J, van der Feltz-Cornelis CM, Verhaak PF, Grol RP, et al. Implementing guidelines for depression on antidepressant prescribing in general practice: a quasi-experimental evaluation. BMC Fam Pract (2014) 15:35. doi:10.1186/1471-2296-15-35

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Loeb D, Sieja A, Corral J, Zehnder NG, Guiton G, Nease DE. Evaluation of the role of training in the implementation of a depression screening and treatment protocol in 2 academic outpatient internal medicine clinics utilizing the electronic medical record. Am J Med Qual (2015) 30:359–66. doi:10.1177/1062860614532681

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Richards DA, Bower P, Pagel C, Weaver A, Utley M, Cape J, et al. Delivering stepped care: an analysis of implementation in routine practice. Implement Sci (2012) 7:3. doi:10.1186/1748-5908-7-3

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Hermens ML, Oud M, Sinnema H, Nauta MH, Stikkelbroek Y, van Duin D, et al. The multidisciplinary depression guideline for children and adolescents: an implementation study. Eur Child Adolesc Psychiatry (2015) 24:1207–18. doi:10.1007/s00787-014-0670-4

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Seekles W, van Straten A, Beekman A, van Marwijk H, Cuijpers P. Stepped care treatment for depression and anxiety in primary care. A randomized controlled trial. Trials (2011) 12:171. doi:10.1186/1745-6215-12-171

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Menchetti M, Sighinolfi C, Di Michele V, Peloso P, Nespeca C, Bandieri PV, et al. Effectiveness of collaborative care for depression in Italy. A randomized controlled trial. Gen Hosp Psychiatry (2013) 35:579–86. doi:10.1016/j.genhosppsych.2013.07.009

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Menear M, Duhoux A, Roberge P, Fournier L. Primary care practice characteristics associated with the quality of care received by patients with depression and comorbid chronic conditions. Gen Hosp Psychiatry (2014) 36:302–9. doi:10.1016/j.genhosppsych.2014.01.013

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Meunier MR, Angstman KB, MacLaughlin KL, Oberhelman SS, Rohrer JE, Katzelnick DJ, et al. Impact of symptom remission on outpatient visits in depressed primary care patients treated with collaborative care management and usual care. Popul Health Manag (2014) 17:180–4. doi:10.1089/pop.2013.0057

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Keeley RD, West DR, Tutt B, Nutting PA. A qualitative comparison of primary care clinicians’ and their patients’ perspectives on achieving depression care: implications for improving outcomes. BMC Fam Pract (2014) 15:13. doi:10.1186/1471-2296-15-13

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Høifødt RS, Strøm C, Kolstrup N, Eisemann M, Waterloo K. Effectiveness of cognitive behavioural therapy in primary health care: a review. Fam Pract (2011) 28:489–504. doi:10.1093/fampra/cmr017

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Hickie IB, Davenport TA, Luscombe GM, Moore M, Griffiths KM, Christensen H. Practitioner-supported delivery of internet-based cognitive behaviour therapy: evaluation of the feasibility of conducting a cluster randomised trial. Med J Aust (2010) 192(Suppl):S31–5.

PubMed Abstract | Google Scholar

43. Twomey C, O’Reilly G, Byrne M, Bury M, White A, Kissane S, et al. A randomized controlled trial of the computerized CBT programme, MoodGYM, for public mental health service users waiting for interventions. Br J Clin Psychol (2014) 53:433–50. doi:10.1111/bjc.12055

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Schneider J, Sarrami Foroushani P, Grime P, Thornicroft G. Acceptability of online self-help to people with depression: users’ views of MoodGYM versus informational websites. J Med Internet Res (2014) 16:e90. doi:10.2196/jmir.2871

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Farrer L, Christensen H, Griffiths KM, Mackinnon A. Internet-based CBT for depression with and without telephone tracking in a national helpline: randomised controlled trial. PLoS One (2011) 6:e28099. doi:10.1371/journal.pone.0028099

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Whiteside U, Richards J, Steinfeld B, Simon G, Caka S, Tachibana C, et al. Online cognitive behavioral therapy for depressed primary care patients: a pilot feasibility project. Perm J (2014) 18:21–7. doi:10.7812/TPP/13-155

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One (2010) 5:e13196. doi:10.1371/journal.pone.0013196

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Donker T, Batterham PJ, Warmerdam L, Bennett K, Bennett A, Cuijpers P, et al. Predictors and moderators of response to internet-delivered interpersonal psychotherapy and cognitive behavior therapy for depression. J Affect Disord (2013) 151:343–51. doi:10.1016/j.jad.2013.06.020

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Høifødt RS, Lillevoll KR, Griffiths KM, Wilsgaard T, Eisemann M, Waterloo K, et al. The clinical effectiveness of web-based cognitive behavioral therapy with face-to-face therapist support for depressed primary care patients: randomized controlled trial. J Med Internet Res (2013) 15:e153. doi:10.2196/jmir.2714

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Elison S, Ward J, Davies G, Moody M. Implementation of computer-assisted therapy for substance misuse: a qualitative study of Breaking Free Online using Roger’s diffusion of innovation theory. Drugs Alcohol Today (2014) 14:207–18. doi:10.1108/DAT-05-2014-0025

CrossRef Full Text | Google Scholar

51. Andersson G. Using the internet to provide cognitive behavioural therapy. Behav Res Ther (2009) 47:175–80. doi:10.1016/j.brat.2009.01.010

CrossRef Full Text | Google Scholar

52. Carrard I, Crépin C, Rouget P, Lam T, Golay A, van der Linden M. Randomised controlled trial of a guided self-help treatment on the internet for binge eating disorder. Behav Res Ther (2011) 49:482–91. doi:10.1016/j.brat.2011.05.004

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Pusch D, Dobson K, Ragusa P, Acton R. Clinical Pathway for Depression (Calgary Zone): Project Summary. Internal Manuscript. Calgary, Alberta: Alberta Health Services (2012).

Google Scholar

54. Quigley L, Dobson K, Pusch D, Acton R, Ragusa P. Integrating mental health services into primary care: a clinical pathway for the treatment of depression. Psynopsis (2012) 4:26–7.

Google Scholar

55. John A, McGregor J, Fone D, Dunstan F, Cornish R, Lyons RA, et al. Case-finding for common mental disorders of anxiety and depression in primary care: an external validation of routinely collected data. BMC Med Inform Decis Mak (2016) 16:35. doi:10.1186/s12911-016-0274-7

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Mitchell AJ, Yadegarfar M, Gill J, Stubbs B. Case finding and screening clinical utility of the patient health questionnaire (PHQ-9 and PHQ-2) for depression in primary care: a diagnostic meta-analysis of 40 studies. BJPsych Open (2016) 2:127–38. doi:10.1192/bjpo.bp.115.001685

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Fine TH, Contractor AA, Tamburrino M, Elhai JD, Prescott MR, Cohen GH, et al. Validation of the telephone-administered PHQ-9 against the in-person administered SCID-I major depression module. J Affect Disord (2013) 150:1001–7. doi:10.1016/j.jad.2013.05.029

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Christensen H, Aiken A, Batterham PJ, Walker J, Mackinnon AJ, Fenech M, et al. No clear potentiation of antidepressant medication effects by folic acid+vitamin B12 in a large community sample. J Affect Disord (2011) 130:37–45. doi:10.1016/j.jad.2010.07.029

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Whiteford HA, Harris MG, McKeon G, Baxter A, Pennell C, Barendregt JJ, et al. Estimating remission from untreated major depression: a systematic review and meta-analysis. Psychol Med (2013) 43:1569–85. doi:10.1017/S0033291712001717

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Chin WY, Wan EY, Choi EP, Chan KT, Lam CL. The 12-month incidence and predictors of PHQ-9-screened depressive symptoms in Chinese primary care patients. Ann Fam Med (2016) 14:47–53. doi:10.1370/afm.1854

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: depression, cognitive behavioral therapy, pathway, suicide, adult, mental illness, family practice, primary care

Citation: Silverstone PH, Rittenbach K, Suen VYM, Moretzsohn A, Cribben I, Bercov M, Allen A, Pryce C, Hamza DM and Trew M (2017) Depression Outcomes in Adults Attending Family Practice Were Not Improved by Screening, Stepped-Care, or Online CBT during a 12-Week Study when Compared to Controls in a Randomized Trial. Front. Psychiatry 8:32. doi: 10.3389/fpsyt.2017.00032

Received: 26 October 2016; Accepted: 15 February 2017;
Published: 20 March 2017

Edited by:

Paul Stokes, King’s College London, UK

Reviewed by:

Nefize Yalin, King’s College London, UK
Casimiro Cabrera Abreu, Queen’s University, Canada

Copyright: © 2017 Silverstone, Rittenbach, Suen, Moretzsohn, Cribben, Bercov, Allen, Pryce, Hamza and Trew. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Peter H. Silverstone,