Effectiveness of a coordinated ambulatory care program for patients with mental disorders or multiple sclerosis: results of a prospective non-randomized controlled trial in South Germany

Abstract

Background:

The Psychiatry, Neurology, Psychosomatics and Psychotherapy (PNP) program of the German statutory health insurance AOK BW promotes coordinated and evidence-based specialist care with the aim of providing individualized, guideline-based outpatient care, strengthening the collaboration between health care providers, as well as reducing care costs. The purpose of this study was to evaluate its effectiveness regarding patient-reported outcomes compared to the less specialized general practitioner program (GP) and usual care (UC).

Materials and methods:

AOK insured patients, who were on sick leave due to a mental disorder (affective disorder, anxiety disorder, adjustment disorder, somatoform disorder, alcohol abuse disorder, schizophrenia) or multiple sclerosis were included in the prospective non-randomized controlled study. All patients either participated in the PNP program (intervention group, IG-PNP), the general practitioner program (control group, CG-GP) or usual care (control group, CG-UC). Entropy balancing was used to adjust for baseline imbalance between groups. Primary outcome was health-related quality of life, assessed by the Short-form health survey (SF-36) 12 months after diagnosis. Secondary outcomes included symptom severity, functional health, and treatment satisfaction.

Results:

Of the 14,483 insured patients who were contacted, 1,104 patients participated at baseline and 725 at follow-up. The adjusted mean differences of SF-36 sum score did not significantly differ between groups: −1.89 (95%-CI = −4.60; 0.81, p = 0.170) between IG-PNP and CG-GP, and −1.42 (95%-CI = −4.05; 1.22, p = 0.293) between PNP and CG-UC. The adjusted mean differences of secondary outcomes did not differ between groups, except for a slightly higher increase of functional health in CG-UC.

Conclusion:

We found no evidence that the PNP program is superior to the GP program or to usual care in terms of patient-reported outcomes or treatment satisfaction. The results are limited by the low response rate. Accordingly, future studies should strive for more representative samples. To improve the program, an integration of further collaborative care elements and guideline recommendations might be useful.

Clinical trial registration:

DRKS (German Clinical Trials Register https://drks.de/search/en); identifier (DRKS00013114).

1 Introduction

Mental and neurological disorders are related to a high degree of personal suffering, disease burden, impaired health, and reduced quality of life (1–3). About 27% of the EU adult population aged 18–65 years is or has been affected by at least one mental disorder in the past 12 months (4). Consequently, mental and neurological disorders represent a major challenge for the health care system (5, 6).

In Germany a well-developed, but fragmented mental health care system exists (7). Large delays between detection and adequate treatment of mental disorders lead to a greater risk to maintain high degrees of burden (8–12). In addition, separated responsibilities of health care providers in different sectors impede cooperation and the transition of patients between sectors (e.g., primary care, specialist care, rehabilitation) (11). Consequently, innovative care networks aim to overcome those intersectoral barriers and to optimize care of patients with mental and neurological disorders. For example, integrating mental health care specialists into primary care helps to substantially improve access and quality of mental health care, especially for those who experience difficulties in engaging in specialized mental health care (13). Clinical practice guidelines recommend stepped and collaborative care models for the treatment of patients with depression (14, 15) and anxiety disorders (16, 17). Collaborative care aims to provide evidence-based treatment by strengthening the cooperation between health care providers. For instance, collaborative care models are superior to less integrated models and usual care among patients with mental disorders such as anxiety disorders (18) and depression (19, 20). The integration of mental health care into primary care can be accomplished in a variety of ways. With a focus on improving coordinated ambulatory care, selective contracts between statutory health insurance companies and health care providers aim to address the problems with fragmented mental health care in accordance with the German Social Security Code V (21). The established “GP program” (“HausarztProgramm”) and the “specialist program” (“FacharztProgramm”) are two of these programs developed and implemented by the German statutory health insurances AOK Baden Wuerttemberg (AOK BW) and Betriebskrankenkasse (Bosch BKK) in Southwestern Germany. The Psychiatry, Neurology, Psychosomatics and Psychotherapy (PNP) contract is part of the “specialist program.” Insurees enrolled in the “specialist program” have the option to receive specialist care within the PNP contract, if they need outpatient care in psychiatry, neurology, psychosomatics and/or psychotherapy. The aim is to provide individualized and guideline-based outpatient care, to strengthen the coordination and collaboration between health care providers, as well as to improve diagnostics. Although the PNP contract was not developed as a collaborative care model, it does follow principles of integrated care by strengthening the collaboration and enhancing the communication between health care providers and care extenders (e.g., social services called “Sozialer Dienst” provided by the AOK BW) (22, 23). Therefore, this selective contract is hereinafter referred to as the “PNP program.” The different components of the PNP program and the GP program compared to usual care are described in the study protocol (23). The PNP program has been comprehensively implemented since 2012 in Baden-Wuerttemberg, South Germany.

The evaluation of structural and process quality of the PNP program showed that the majority of the participating health care providers were satisfied with it (e.g., patient-orientated and treatment of severely ill patients, better access to care, less bureaucracy). Nevertheless, problems with access to care (e.g., delays in enrollment, patients without a primary care physicians participating in the GP program, which was required for enrolment in the specialist program), treatment (e.g., limited capacities of health care providers), and insufficient cooperation were also reported (24). The analyses of health insurance fund data suggested that the PNP program can favorably impact sick pay and sick leave days, but not treatment costs (22). In summary, international evidence shows that integrated care models can lead to long-term improvement in patient-reported outcomes among patients with mental disorders. Hence, the purpose of this study was to evaluate the effectiveness of PNP program regarding patient-reported outcomes compared to the GP program and usual care.

2 Materials and methods

2.1 Study design

We conducted a prospective non-randomized controlled trial comparing the intervention group, which consisted of patients with access to specialist care within the PNP program (intervention group: IG-PNP) with two control groups. Patients in the first control group participated in the specific GP program, but not the PNP program (CG-GP). Patients in the second control group had access to usual care only (CG-UC). We included consecutively recruited AOK insurees from the three groups between November 2017 and October 2019. We measured health-related quality of life, patient-reported symptom severity and patient satisfaction at baseline (date of sick leave) and at 12-month follow-up. Only participants who gave their informed consent were included. Participants received a compensation of 15€ for returning both questionnaires. The study protocol was published elsewhere (23).

We expected higher health-related quality of life, functional health and patient satisfaction and lower illness-specific symptom burden in the IG-PNP than in the two control groups CG-GP and CG-UC, respectively.

2.2 Inclusion and exclusion criteria

We included patients who were on sick leave due to one of the following mental or neurological disorders for the first time during the previous 12 months: affective disorders (F31.x, F32.x, F33.x, F34.1), anxiety disorders (F40.x, F41.x), adjustment disorder (F43.2), somatoform disorders (F45.x), alcohol abuse disorders (F10.x), schizophrenia (F20.x), or multiple sclerosis (G35.x). The timely availability of sick leave diagnoses allowed for recruiting study participants as soon as possible after medical appointments. Patients were eligible, if they were insured by the AOK BW, lived in Baden-Wuerttemberg, were at least 18 years old, and were treated by a health care provider licensed in Baden-Wuerttemberg. We excluded patients who had a legal guardian, lived outside of Baden-Wuerttemberg or died.

2.3 Interventions

Table 1 provides an overview of the three health care programs. A more detailed comparative description of the care programs (e.g., differences in organization and payment of health care services) can be found in the study protocol (23).

Patients who wish to participate in the PNP program must first be informed about and enrolled in the GP program by their primary care physician. The enrollment in the GP program is mandatory for participation in the PNP program or in other medical specialist’s program offered by the AOK. Both patients in the PNP program and patients in the General practitioner (GP) program had to commit to (a) a minimum time of participation of 1 year in the program and (b) first seek help from a GP enrolled in the GP program (exception: emergencies, gynecologist, ophthalmologists, pediatricians). While patients in the GP program had potentially free choice between specialists when referred by the GP, patients in the PNP program only had access to specialists participating in the specialist program when they were referred by the GP (“gate keeper”). This approach was intended to avoid unnecessary specialist consultations and enable more targeted referrals. The utilization of the intervention, e.g., contact with a PNP specialist, was not a criterion.

Patients in usual care had unrestricted access to health care providers (GP or specialist) with a license in Baden-Wuerttemberg. While this meant that patients in UC had the freedom to see the specialist of their choice, they were also still affected by the less coordinated, less facilitated access conditions as well as intersectoral barriers of routine care (e.g., long wait times for psychotherapy).

2.4 Outcome measures

The primary outcome was health-related quality of life (mental component summary score) and was measured by the Short-form health survey (SF-36) (25). Secondary outcomes included functional health (physical component summary score; SF-36) as well as different psychological symptoms measured by the Depression Module (PHQ-9) (26) and Generalized Anxiety Disorder Module (GAD-7) (27) of the Patient Health Questionnaire, by the Somatic Symptom Scale-8 (SSS-8) (28) and by the short-form of Alcohol Use Disorders Identification Test (AUDIT-C) (29). Satisfaction with ambulatory care (ZAPA) (30) was used to measure patient satisfaction with GPs and specialist care at follow-up.

2.5 Statistical analysis

A sample size of 536 patients was required to detect a clinically relevant effect regarding the primary outcome between IG-PNP and both control groups (23). We used entropy balancing (31, 32) to control for differences between the groups due to the quasi-experimental design. Entropy balancing is a reweighting method that directly targets balancing the covariate moments between the intervention and control groups. The weights designed to alleviate differences between groups in the mean, variance and skewness in selected patient characteristics were in our study: age, gender, education, residency, employment, period of selection, health-related quality of life, degree of depressive, anxiety and somatoform symptoms, degree of alcohol consumption, days of incapacity to work, mental health services utilization, medication, physical comorbidity, diagnoses of depression, somatoform disorder and anxiety disorder.

We used linear mixed models with fixed effects of group membership, time, their interaction, and further covariates (age, gender, diagnoses of sick leave) to test the effectiveness hypotheses. In a linear mixed model, both different levels that may vary but whose variation is not part of the effect being tested (e.g., person level and practice level) as well as cases that have a valid value in the outcome variable at only one measurement time can be included. Thus, more data can be included in the estimation. To control for potential confounders, the weights from entropy balancing were incorporated by using weighted maximum likelihood in the estimation. We planned to account for clustering of patients within practices, but it turned out to be unnecessary because the average cluster size was much lower than expected (1.2 patients per practice).

3 Results

3.1 Sample characteristics

Of 14,483 patients contacted, 1,104 responded at baseline (response rate: 8%), and 725 at follow-up (response rate: 5%). Due to model requirements (e.g., complete data on all covariates at baseline), data of 988 participants could be included in the main analysis (Figure 1). From IG-PNP, 1 out of 277 participants (0.4%) switched to CG-GP and 6 (2.2%) to CG-UC; from CG-GP, 19 out of 218 participants (8.7%) switched into IG-PNP and 10 (4.6%) to CG-UC and from CG-UC 3 out of 493 participants (0.6%) switched into IG-PNP and 14 (2.8%) into CG-UC during the study.

Figure 1

On average patients were 46 years old (SD = 12.2) and 61.5% were female. At baseline, 50% were in the CG-UC, 28% in IG-PNP and 22% in CG-GP program. Table 2 shows the differences between the baseline variables before and after entropy balancing. Patients in the IG-PNP were older, less educated, more likely to be on medication due to a mental or neurological disorder, more likely to have more physical comorbidities and had more often depression and anxiety diagnoses. These differences could be minimized by using entropy balancing.

3.2 Dropout

In comparison to all patients contacted at baseline, study participants were more likely to be older, female, to have more than one mental co-diagnosis and less likely to have another citizenship than the German one (Supplementary Additional File 1: Supplementary Table 1). Eligible patients and participants at baseline had similar average days of incapacity to work in the past 12 months. There were no relevant differences regarding demographic variables, health status and health services use at baseline between patients with and without follow-up data (Supplementary Additional File 1: Supplementary Table 2).

3.3 Effectiveness

There was no significant change in health-related quality of life at follow-up between groups. The model showed only negligible differences with regard to the average change over time. The decline over time was slightly, but not significantly, stronger in IG-PNP when compared to CG-GP [−1.89; 95%-confidence interval (CI) = −4.60; 0.81, p = 0.170) or CG-UC (−1.42; 95%-CI = −4.05; 1.22, p = 0.293] (Table 3). Regarding secondary outcomes, the PNP program did not yield significant improvements in functional health, depressive symptoms, anxiety symptoms, somatoform symptoms and alcohol consumption during the 12-month follow-up period. However, we found that insurees in CG-UC care achieved slightly higher functional health over time than insurees in the IG-PNP (MD 2.24, 95%-CI = −0.33; 4.16, p = 0.022) (Table 3). Since the average difference over time with regard to the outcomes was of main interest, we only display interaction terms in Table 3 as well as estimated marginal means (EMM) between baseline (t0) and 12-month follow-up (t1) in Table 4. Additionally, main effects of all outcomes can be found in Supplementary Additional File 3: Supplementary Tables 1–6.

3.4 Patient satisfaction with outpatient care

There were no differences regarding the adjusted means of patient satisfaction with general practitioners’ care (Supplementary Additional File 3: Supplementary Table 7), with specialized outpatient care (Supplementary Additional File 3: Supplementary Table 8) or with outpatient psychotherapy (Supplementary Additional File 3: Supplementary Table 9) at follow-up between the groups.

3.5 Additional analyses

To find out if specific subgroups benefit from the PNP program additional moderator analyses were performed by adding interaction terms (moderator variable*time*group) to the model. The explorative results indicate that insurees on sick leave due to multiple sclerosis may benefit more from the PNP program than UC (MD −14.99, 95%-CI = −29.71; −0.27, p = 0.046) regarding the primary outcome. Insurees with lower health-related quality of life at baseline (MD 0.19, 95%-CI = 0.03; 0.35, p = 0.020) and lower physical comorbidity (MD 1.80, 95%-CI = 0.28; 3.32, p = 0.021) may benefit more from the PNP program-contract than from GP-centered care (Supplementary Additional File 2).

4 Discussion

This prospective non-randomized controlled study examined the effectiveness of the participation in the new PNP program regarding health-related quality of life and patient satisfaction compared to a specific GP program and usual care among patients with mental disorder and multiple sclerosis on sick-leave. We found no significant differences between the IG-PNP and the control groups regarding the change of health-related quality of life, symptom burden (depressive, anxiety, somatoform symptoms, or alcohol consumption) after 1 year of inclusion. We also found no significant differences regarding patient satisfaction with received care at follow-up. However, there was a slightly higher significant increase of functional health over time in CG-UC than in IG-PNP, which does not align with the hypothesis of this study. It also contrasts with previous national and international findings on the superiority of coordinated and collaborative care-based interventions among patients with mental disorders (18–20, 33–36).

Findings based on health insurance fund data show that the PNP program favorably influenced sick leave days (22). Accordingly, we assumed that health-related quality of life or functional health are closely related to work ability, but we found no improvement in these patient-reported measures.

One possible explanation is that the study samples may be different. Due to drop-out of male patients, younger patients, patients with another citizenship than the German one and with less mental comorbidities, these patients were underrepresented in the current study, whereas there is no observed dropout among the study based on health insurance fund data (22). Furthermore, it is possible, that the specialist program favorably influences sick leave days, but the impact on health-related quality of life and functional health assessed by patient-reported outcomes was so far not measurable. One further reason might result from problems with the use of guideline-based care: Although the intervention group potentially had free access to different health services related to the PNP contract, this did not ensure that all patients of the intervention group actually received or used PNP treatment, nor did it verify the extent and appropriateness (e.g., guideline-based recommendations) of the treatments provided in the PNP intervention group. Results based on health insurance fund data indicate, that a relevant proportion of patients with depression in the GP and PNP program were still untreated or insufficiently treated during the first 12 months after sick leave (37). Although waiting times for acute and severely ill cases were lower in the PNP program compared to the control groups, it is not clear whether access to care is actually facilitated for participants of the PNP program. Reasons for this included limited capacities of treatment providers, delays in enrolment in the specialist program, and the fact that care providers did not always meet the requirements (e.g., GP without participation in the GP program) (24).

For practitioners, intensified training or education as a preparation as well as regular network meetings may be useful to strengthen and improve cooperation, and also contribute to quality improvement and assurance (38). Further, cooperation and communication among practitioners can also be enhanced through the support of case managers (39), liaison with community psychiatric teams (40) or through enabling digital communication approaches (e.g., sharing electronic patient records to foster the exchange of information). In order to reach chronically ill patients who remain on sick leave for a longer period of time or suffer from recurrent mental illness, systematic screening and early enrolment in the specialist program could be considered. Improving psychoeducation and health competence of patients can be helpful in this respect. Further, the use of systematic monitoring of the course of treatment and the systematic recording of treatment results can possibly increase the effectiveness of the PNP program. Based on the existing literature on integrated and collaborative care models, the PNP program is most likely to be placed at the “lower level” of collaboration (41, 42). In order to strengthen the collaboration and its effectiveness compared to other care models, the PNP program could benefit from (a) an increased integration and expansion of collaborative care elements in order to favorably impact patient benefit and practitioner commitment and (b) a diligent implementation and application of a more comprehensive collaborative care approach (18).

4.1 Strengths and limitations

The prospective non-randomized controlled trial was designed to evaluate the target intervention within the context of the complex health care reality. Although randomized controlled trials could provide the best evidence in evaluation studies (43), due to ethical and contractual matters randomization was not possible. All insurees of the AOK BW already decided voluntarily to participate in the GP program and in the specialized PNP program. Therefore, we cannot exclude possible selection biases. In order to minimize the risk of bias, we controlled for demographic and clinical variables using entropy balancing as well as adjustment through covariates. An intention-to-treat approach was realized to evaluate if having access to care based on the PNP program has a positive effect on (mental) health of patients compared to having access to the GP program only or to usual care. Using this approach, our results are limited to the comparison of the different health programs and we cannot derive evidence for the effectiveness of the different treatments within the programs.

The evaluation of different patient-reported outcomes is a major strength of this study compared to health insurance fund data or data from the health care providers. The high dropout rates limit generalizability of the study results. Male patients, younger patients, patients with another citizenship than the German one and with less mental comorbidities were underrepresented in our study. Possible reasons are language barriers, aspects of gender socialization and less motivation because of less identification as mentally ill person. Furthermore, it should be mentioned that the results of the moderator analyses are limited due to alpha-inflation, because alpha was not adjusted for the number of potential outcomes. Thus, there is an increased risk of false positive results, which is in particular true for the various subgroup analysis that pertain to very small samples (e.g., patients with multiple sclerosis). Therefore, we point out that they should be considered as exploratory results only. For robust results, further research should consider equally sized subgroups.

In addition, the results are limited to patients with a new sick leave due to a mental disorder or multiple sclerosis. Accordingly, we cannot generalize our results to patients without sick leaves, patients with recurred or chronic sick leaves as well as to retired patients or children.

5 Conclusion

We found no clear evidence that the PNP program is superior to the GP program or to usual care in terms of effectiveness. Patients in the PNP program reported similar levels of health-related quality of life 1 year after sick leave due to a mental disorder or multiple sclerosis in comparison to patients in the GP program or in usual care. Initial health-related quality of life, physical comorbidity and sick leave due to a diagnosis of multiple sclerosis may have an impact on the relation between change of quality of live within 12-months and group. In addition, there were no differences regarding functional health, symptom burden and satisfaction with outpatient care at follow-up between the PNP program, the GP program and usual care. Despite defined inclusion criteria and entropy balancing, the results are limited by the low response rate and the possibility of an insufficiently controlled selection bias due to relevant unobserved confounders.

References

• 1.

  WHO . The world health report 2001 - mental health: new understanding. New Hope: World Health Organization (2001).

  • Google Scholar

• 2.

  Kessler RC Aguilar-Gaxiola S Alonso J Chatterji S Lee S Ormel J et al . The global burden of mental disorders: an update from the WHO world mental health (WMH) surveys. Epidemiol Psychiatr Sci. (2009) 18:23–33. doi: 10.1017/S1121189X00001421

  • CrossRef
  • Google Scholar

• 3.

  Kobelt G Berg J Lindgren P Elias W Flachenecker P Freidel M et al . Costs and quality of life of multiple sclerosis in Germany. Eur J Health Econ. (2006) 7:34–44. doi: 10.1007/s10198-006-0384-8

  • CrossRef
  • Google Scholar

• 4.

  Wittchen HU Jacobi F . Size and burden of mental disorders in Europe—a critical review and appraisal of 27 studies. Eur Neuropsychopharmacol. (2005) 15:357–76. doi: 10.1016/j.euroneuro.2005.04.012

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 5.

  von Korff M Katon W Bush T Lin EH Simon GE Saunders K et al . Treatment costs, cost offset, and cost-effectiveness of collaborative management of depression. Psychosom Med. (1998) 60:143–9. doi: 10.1097/00006842-199803000-00005

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 6.

  Wittchen HU Jacobi F Rehm J Gustavsson A Svensson M Jönsson B et al . The size and burden of mental disorders and other disorders of the brain in Europe 2010. Eur Neuropsychopharmacol. (2011) 21:655–79. doi: 10.1016/j.euroneuro.2011.07.018

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 7.

  Schulz H Barghaan D Harfst T Koch U . Gesundheitsberichterstattung des Bundes: Psychotherapeutische Versorgung. Berlin: Robert-Koch-Institut (2008).

  • Google Scholar

• 8.

  Zepf S Mengele U Hartmann S . Zum Stand der ambulanten psychotherapeutischen Versorgung der Erwachsenen in der Bundesrepublik Deutschland. Psychother Med Psychol. (2003) 53:152–62. doi: 10.1055/s-2003-38004

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 9.

  Katon WJ Unützer J Simon G . Treatment of depression in primary care: where we are, where we can go. Med Care. (2004) 42:1153–7. doi: 10.1097/00005650-200412000-00001

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 10.

  Shedden-Mora M Gross B Lau K Gumz A Wegscheider K Löwe B . Collaborative stepped care for somatoform disorders: a pre–post-intervention study in primary care. J Psychosom Res. (2016) 80:23–30. doi: 10.1016/j.jpsychores.2015.11.004

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 11.

  Sachverständigenrat für die Konzertierte Aktion im Gesundheitswesen . Gutachten 2005: Koordination und Qualität im Gesundheitswesen. Baden-Baden: Nomos (2005).

  • Google Scholar

• 12.

  Barkham M Mullin T Leach C Stiles WB Lucock M . Stability of the CORE-OM and the BDI-I prior to therapy: evidence from routine practice. Psychol Psychother. (2007) 80:269–78. doi: 10.1348/147608306X148048

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 13.

  Davies T Lund C . Integrating mental health care into primary care systems in low-and middle-income countries: lessons from PRIME and AFFIRM. Global Mental Health. (2017) 4:e7. doi: 10.1017/gmh.2017.3

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 14.

  NICE . Depression in adults: treatment and management of depression (NICE guideline NG222). London: National Institute for Clinical Excellence (2022).

  • Google Scholar

• 15.

  Bundesärztekammer (BÄK), Kassenärztliche Bundesvereinigung (KBV), Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften (AWMF) . Nationale VersorgungsLeitlinie Unipolare Depression – Langfassung, Version 3.0.Konsultationsfassung: (2022) Available at:www.leitlinien.de/depression.

  • Google Scholar

• 16.

  NICE . Generalised anxiety disorder and panic disorder in adults: management (clinical guideline CG113). Great Britain: National Institute for Clinical Excellence (2011).

  • Google Scholar

• 17.

  Bandelow B Wiltink J Alpers GW Benecke C Deckert J Eckhardt-Henn A et al . Deutsche S3-Leitlinie Behandlung von Angststörungen. (2014). Available at:www.awmf.org/leitlinien.html.

  • Google Scholar

• 18.

  Muntingh ADT van der Feltz-Cornelis CM van Marwijk HWJ Spinhoven P van Balkom AJLM . Collaborative care for anxiety disorders in primary care: a systematic review and meta-analysis. BMC Fam Pract. (2016) 17:62. doi: 10.1186/s12875-016-0466-3

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 19.

  Katon W Von Korff M Lin E Simon G Walker G Unützer J et al . Stepped collaborative care for primary care patients with persistent symptoms of depression: a randomized trial. Arch Gen Psychiatry. (1999) 56:1109–15. doi: 10.1001/archpsyc.56.12.1109

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 20.

  Thota AB Sipe TA Byard GJ Zometa CS Hahn RA McKnight-Eily LR et al . Collaborative care to improve the management of depressive disorders: a community guide systematic review and meta-analysis. Am J Prev Med. (2012) 42:525–38. doi: 10.1016/j.amepre.2012.01.019

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 21.

  SGB V . Das Fünfte Buch Sozialgesetzbuch – Gesetzliche Krankenversicherung[SGB V Social Code Book: Statutory Health Insurance]. (2017).

  • Google Scholar

• 22.

  Engels A Reber KC Magaard JL Härter M Hawighorst-Knapstein S Chaudhuri A et al . How does the integration of collaborative care elements in a gatekeeping system affect the costs for mental health care in Germany?Eur J Health Econ. (2020) 21:751–61. doi: 10.1007/s10198-020-01170-3

  • CrossRef
  • Google Scholar

• 23.

  Magaard JL Liebherz S Melchior H Engels A König H-H Kriston L et al . Collaborative mental health care program versus a general practitioner program and usual care for treatment of patients with mental or neurological disorders in Germany: protocol of a multiperspective evaluation study. BMC Psychiatry. (2018) 18:347. doi: 10.1186/s12888-018-1914-5

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 24.

  Magaard JL Seeralan T Meister R Liebherz S Engels A König H-H et al . PNP-Vertrag–Facharztvertrag Psychotherapie, Neurologie, Psychiatrie in Baden-Württemberg: Evaluation aus der Sicht der teilnehmenden Behandlerinnen und Behandler. Psychiatr Prax. (2020) 47:71–8. doi: 10.1055/a-1043-7619

  • CrossRef
  • Google Scholar

• 25.

  Bullinger M Kirchberger I . SF-36. Fragebogen zum Gesundheitszustand. Göttingen: Hogrefe (1998).

  • Google Scholar

• 26.

  Spitzer RL Kroenke K Williams JBW . Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary care evaluation of mental disorders. Patient health questionnaire. JAMA. (1999) 282:1737–44. doi: 10.1001/jama.282.18.1737

  • CrossRef
  • Google Scholar

• 27.

  Löwe B Decker O Müller S Brähler E Schellberg D Herzog W et al . Validation and standardization of the generalized anxiety disorder screener (GAD-7) in the general population. Med Care. (2008) 46:266–74. doi: 10.1097/MLR.0b013e318160d093

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 28.

  Gierk B Kohlmann S Kroenke K Spangenberg L Zenger M Brähler E et al . The somatic symptom scale–8 (SSS-8) a brief measure of somatic symptom burden. JAMA Intern Med. (2014) 174:399–407. doi: 10.1001/jamainternmed.2013.12179

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 29.

  Bush K Kivlahan D McDonell M Fihn S Bradley K . The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Arch Intern Med. (1998) 158:1789. doi: 10.1001/archinte.158.16.1789

  • CrossRef
  • Google Scholar

• 30.

  Scholl I Hölzel L Härter M Dierks M-L Bitzer EM Kriston L . Fragebogen zur Zufriedenheit in der ambulanten Versorgung – Schwerpunkt Patientenbeteiligung (ZAPA). Klin Diagn Eval. (2011) 4:50–62.

  • Google Scholar

• 31.

  Hainmüller J . Entropy balancing for causal effects: a multivariate reweighting method to produce balanced samples in observational studies. Polit Anal. (2012) 20:25–46. doi: 10.1093/pan/mpr025

  • CrossRef
  • Google Scholar

• 32.

  Hainmüller J Xu Y . Ebalance: a Stata package for entropy balancing. J Stat Softw. (2013) 54:7. doi: 10.18637/jss.v054.i07

  • CrossRef
  • Google Scholar

• 33.

  Woltmann E Grogan-Kaylor A Perron B Georges H Kilbourne AM Bauer MS . Comparative effectiveness of collaborative chronic care models for mental health conditions across primary, specialty, and behavioral health care settings: systematic review and Meta-analysis. Am J Psychiatry. (2012) 169:790–804. doi: 10.1176/appi.ajp.2012.11111616

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 34.

  Löwe B Piontek K Daubmann A Härter M Wegscheider K König H-H et al . Effectiveness of a stepped, collaborative, and coordinated health care network for somatoform disorders (Sofu-net): a controlled cluster cohort study. Psychosom Med. (2017) 79:1016–24. doi: 10.1097/PSY.0000000000000491

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 35.

  Härter M Watzke B Daubmann A Wegscheider K König H-H Brettschneider C et al . Guideline-based stepped and collaborative care for patients with depression in a cluster-randomised trial. Sci Rep. (2018) 8:1–9. doi: 10.1038/s41598-018-27470-6

  • CrossRef
  • Google Scholar

• 36.

  Härter M Heddaeus D Steinmann M Schreiber R Brettschneider C König H-H et al . Collaborative und Stepped Care bei depressiven Erkrankungen. Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz. (2015) 58:420–9. doi: 10.1007/s00103-015-2124-7

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 37.

  Engels A König H-H Maagard JL Härter M Hawighorst-Knapstein S Ariane C et al . Depression treatment in Germany – comparing a collaborative mental health care program to the general practitioner program and usual care in terms of guideline adherence and needs-oriented resource allocation. BMC Psychiatry. (2020) 20:591. doi: 10.1186/s12888-020-02995-1

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 38.

  Heddaeus D Steinmann M Liebherz S Härter M Watzke B . Psychenet – Hamburger Netz psychische Gesundheit: Evaluation des Gesundheitsnetzes Depression aus Sicht der teilnehmenden Hausärzte, Psychotherapeuten und Psychiater. Psychiatr Prax. (2015) 42:S54–9. doi: 10.1055/s-0034-1387688

  • CrossRef
  • Google Scholar

• 39.

  Bower P Gilbody S Richards D Fletcher J Sutton A . Collaborative care for depression in primary care: making sense of a complex intervention: systematic review and meta regression. Br J Psychiatry. (2006) 189:484–93. doi: 10.1192/bjp.bp.106.023655

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 40.

  Greve N . Annäherungen an eine gemeindepsychiatrische Basisversorgung. Psychiatr Prax. (2018) 45:285–7. doi: 10.1055/a-0652-9015

  • CrossRef
  • Google Scholar

• 41.

  Collins C Hewson DL Munger R Wade T . Evolving models of behavioral health integration in primary care. New York, NY: Milbank Memorial Fund (2010).

  • Google Scholar

• 42.

  Van Steenbergen-Weijenburg KM Van der Feltz-Cornelis CM Horn EK Van Marwijk HWJ Beekman ATF Rutten FFH et al . Cost-effectiveness of collaborative care for the treatment of major depressive disorder in primary care. A sytematic review. BMC. (2010) 10:19. doi: 10.1186/1472-6963-10-19

  • CrossRef
  • Google Scholar

• 43.

  Machin D Campbell MJ . The design of studies for medical research. Chichester: John Wiley & Sons (2005).

  • Google Scholar