Skip to main content

SYSTEMATIC REVIEW article

Front. Public Health, 27 September 2021
Sec. Public Mental Health
This article is part of the Research Topic Insights in Public Mental Health: 2021 View all 25 articles

Indicators for Public Mental Health: A Scoping Review

\nDiana Peitz
&#x;Diana Peitz*Christina Kersjes&#x;Christina KersjesJulia ThomJulia ThomHeike HoellingHeike HoellingElvira MauzElvira Mauz
  • Department of Epidemiology and Health Monitoring, Robert Koch Institute, Berlin, Germany

Background: To monitor population mental health, the identification of relevant indicators is pivotal. This scoping review provides a comprehensive overview of current indicators representing the various fields of public mental health core topics. It was conducted as a first step to build up a Mental Health Surveillance for Germany.

Methods: We conducted a systematic MEDLINE search via PubMed. This search was supplemented by an extensive examination of the websites of relevant national as well as international institutions in the context of public mental health and an additional internet search via Google. To structure the data, an expert-based focus group identified superordinate topics most relevant to public mental health to which the identified indicators could be assigned to. Finally, the indicator set was screened for duplicates and appropriate content to arrive at a final set.

Results: Within the various search strategies, we identified 13.811 records. Of these records, a total of 365 records were processed for indicator extraction. The extracted indicators were then assigned to 14 topics most relevant to public mental health as identified by the expert-based focus group. After the exclusion of duplicates and those indicators not meeting criteria of specificity and target group, the final set consisted of 192 indicators.

Conclusion: The presented indicator set provides guidance in the field of current concepts in public mental health monitoring. As a comprehensive compilation, it may serve as basis for future surveillance efforts, which can be adjusted and condensed depending on the particular monitoring focus. Our work provides insights into established indicators included in former surveillance work as well as recent, not yet included indicators reflecting current developments in the field. Since our compilation mainly concludes indicators related to mental health in adults, it should be complemented with indicators specific to children and adolescents. Furthermore, our review revealed that indicators on mental health promotion and prevention are underrepresented in current literature of public mental health and should hence be focused on within future research and surveillance.

Introduction

One prior target emphasized by the World Health Organization (WHO) within the 2013th Mental Health Action Plan was that by the year 2020, “80% of countries will be routinely collecting and reporting at least a core set of mental health indicators every 2 years through their national health and social information systems […]” (1). Consecutively, all WHO member states were called to systematically gather, integrate, process, analyze, interpret, and regularly report data on the mental health of the population. These data should inform about the current state as well as trends of public mental health which may allow for evaluating measures taken in mental health prevention, promotion, and healthcare. According to that, results should serve as a reliable database for evidence-based policy advice to enable political stakeholders to plan, initiate, and assess necessary health political actions (1, 2). Most recently, COVID-19 pandemic alerted policy makers to the necessity of mental health surveillance, since public mental health appeared as vulnerable asset in need of protection and immediate crisis response (3).

Following WHO's suggestions, Germany's national public health institute, Robert Koch Institute (RKI), has begun to develop a concept for a Mental Health Surveillance (MHS) in Germany on behalf of the Federal Ministry of Health in 2019. The present study was conducted as a first step to build up a MHS for Germany. The effectivity and significance of such a surveillance approach depends on the careful selection of appropriate indicators, which sufficiently depict public mental health. To establish a solid basis for a future core indicator set, the project was started by gathering a broad range of reported indicators currently used in the field. To do so, one can draw on the work of several countries which pioneered in establishing indicator based mental health surveillance systems such as Canada (4, 5), Australia (6), or Switzerland (7). Apart from that, further suitable concepts resp. indicators for monitoring population mental health are under development as research on mental health progresses; thus, they might be found mainly in scientific papers. Nevertheless, there might be mental health related issues which hitherto are neither implemented in established surveillance systems nor addressed by current research. This calls for the inclusion of further sources such as routine or administrative data within the search strategy.

Therefore, designing a mental health surveillance system from the ground up, the purpose of the current scoping review was (1) to systematically identify important indicators in the field of public mental health on a population-based level using different search strategies, (2) to assign the hereby extracted indicators to important core topics regarding public mental health to structure this large body of data and thus (3) to identify currently most relevant topics in the field and possible gaps of indicators reflecting unattended domains in relation to public mental health.

Materials and Methods

According to our purposes, we chose the methodology of a scoping review to depict a broad picture of the current state of knowledge. Arkey and O'Malley (8) provided a methodological framework for conducting a scoping review, which was specified by Levac et al. (9). The structure of the present work followed those recommendations and was furthermore orientated on the more recent PRISMA extension for Scoping Reviews (PRISMA-ScR) (10). Thus, the method section is itemized by (1) identifying the research questions, (2) identifying relevant studies, (3) study selection, and (4) charting the data, collating, summarizing, and reporting the results.

Identifying the Research Question

Unlike a systematic review, a scoping review does not aim to evaluate the quality of the processed studies and/or reports. Instead, it informs on the extent of work already existing in the field and should help to recognize gaps within this research (810). Thus, it best meets our purpose of gaining a broad overview of available and utilized indicators in the field of public mental health in order to build a MHS for Germany from the ground up. Additionally, this approach serves to identify hitherto neglected areas in recent state-of-the-art research and monitoring work. Therefore, this scoping review deals with the following research question: Which indicators on public mental health can be identified on the base of the current state of knowledge?

Definition of an Indicator Within the Present Work

An ongoing surveillance system depends on indicators incorporating a clear title (1st level) and a clear definition resp. operationalization by explicit numerator and denominator concepts (2nd level) leading to an explicit database (3rd level), thus enabling the pursued comparisons over time (11). Within the here presented first step of indicator compilation, indicators were processed on title level (meaning theoretical concepts with empirical application on population level are referred to as indicators) to decide on their importance within the next step toward a final indicator set for a MHS.

Identifying Relevant Studies

To meet the above-mentioned demands on depicting indicators regarding the broad field of public mental health, a comprehensive search strategy including various sources was used.

Data Sources

First, we conducted a systematic MEDLINE literature search via PubMed using the MIP (Method, Issue, Participants) schema (12).

Since public mental health inidcators are not solely reported in scientific publications available on databases as MEDLINE, we decided to enrich the systematic approach by additional strategies:

In order to include already established surveillance indicators we scanned the websites of international organizations [European Union (EU), WHO, and Organization for Economic Co-operation and Development (OECD)] and the public health institutes of the 35 member countries of the OECD. To identify the websites of these public health institutes, a member list of the “International Association of National Public Health Institutes” (which can be found here: www.ianphi.org) was utilized. Additional Google searches were conducted if the websites of a national public health institute were not registered in this list.

In order to include routine and administrative data as well as country-specific indicators relevant to mental health care in Germany we conducted a distinct search on the websites of selected national stakeholders of mental health care, such as professional associations, service providers and federal agencies (DRV/Deutsche Rentenversicherung, KBV/Kassenärztliche Bundesvereinigung, DGPPN/Deutsche Gesellschaft für Psychiatrie und Psychotherapie, Psychosomatik und Nervenheilkunde, BPtK/Bundespsychotherapeutenkammer, APK/Aktion Psychisch Kranke e.V., GKV Spitzenverband/Spitzenverband Bund der Krankenkassen, AOLG/Arbeitsgemeinschaft der Obersten Landesgesundheitsbehörden and Kleine Anfragen) and a key word search using Google for indicators of mental health care and mental health care research in Germany.

Last, we scanned the reference lists of articles, which were found in the procedure mentioned above to identify further important information sources. The complete search was conducted from July to October 2019 and is depicted in Figure 1.

FIGURE 1
www.frontiersin.org

Figure 1. Flow chart scoping review.

DP and CK were in charge of the MEDLINE search while EM searched the websites of the public health institutes of different OECD countries and international organizations. JT conducted the particular search on mental health care indicators in Germany (administrative and routine data) and screened the reference lists.

Key Words for Internet and Electronic Database Search

MEDLINE (via PubMed)

Broad research question regarding articles on surveillance/monitoring systems on mental health in the general population orientated on MIP schema:

(Surveillance [tiab] OR Surveillances [tiab] OR Monitoring [tiab] OR “Information system” [tiab] OR “Information systems” [tiab] OR “Population surveillance” [MeSH Terms] OR “Epidemiological Monitoring” [MeSH Terms]) AND (“mental health” [tiab] OR “mental-health” [tiab] OR “psychological health” [tiab] OR “mental disorder” [tiab] OR “mental disorders” [tiab] OR “mentally disordered” [tiab] OR “mental health problem” [tiab] OR “mental health problems” [tiab] OR “psychiatric disorder” [tiab] OR “psychiatric disorders” [tiab] OR “mental illness” [tiab] OR “mentally ill” [tiab] OR “mental sickness” [tiab] OR “mentally sick” [tiab] OR “mental disease” [tiab] OR “mental diseases” [tiab] OR “psychic health” [tiab] OR “psychiatric health” [tiab] OR “positive mental health” [tiab] OR “well-being” [tiab] OR “mental condition” [tiab] OR “psychological condition” [tiab] OR “mental constitution” [tiab] OR “mental health” [MeSH Terms] OR “mental disorders”[MeSH Terms]) AND (“general population” [tiab] OR “nationwide” [tiab] OR “nation-wide” [tiab] OR “representative survey” [tiab] OR “national sample” [tiab] OR “population-based” [tiab] OR “population based” [tiab] OR “Population wide” [tiab] OR “Population-wide” [tiab] OR “country wide” [tiab] OR “country-wide” [tiab] OR “representative sample” [tiab] OR national* [tiab] OR “population level” [tiab]).

Specific research question regarding articles on applied indicators within surveillance/monitoring systems on mental health in the general population orientated on MIP schema:

(Indicator [tiab] OR Indicators [tiab] OR criteria [tiab] OR criterion [tiab] OR criterions [tiab] OR measure [tiab] OR measures [tiab] OR “Health status indicators” [MeSH Terms]) AND (Surveillance [tiab] OR Surveillances [tiab] OR Monitoring [tiab] OR “Information system” [tiab] OR “Information systems” [tiab] OR “Population surveillance” [MeSH Terms] OR “Epidemiological Monitoring” [MeSH Terms]) AND (“mental health” [tiab] OR “mental-health” [tiab] OR “psychological health” [tiab] OR “mental disorder” [tiab] OR “mental disorders” [tiab] OR “mentally disordered” [tiab] OR “mental health problem” [tiab] OR “mental health problems” [tiab] OR “psychiatric disorder” [tiab] OR “psychiatric disorders” [tiab] OR “mental illness” [tiab] OR “mentally ill” [tiab] OR “mental sickness” [tiab] OR “mentally sick” [tiab] OR “mental disease” [tiab] OR “mental diseases” [tiab] OR “psychic health” [tiab] OR “psychiatric health” [tiab] OR “positive mental health” [tiab] OR “well-being” [tiab] OR “mental condition” [tiab] OR “psychological condition” [tiab] OR “mental constitution” [tiab] OR “mental health” [MeSH Terms] OR “mental disorders”[MeSH Terms]).

Websites

- Selected national stakeholders of mental health care (e.g., professional associations, service providers, federal agencies): “Mental Disorders”

- International organizations (EU, WHO, OECD): “Mental Health Surveillance;” “Mental Health Indicators;” “Mental Health Monitoring”

- For each OECD country on www.ianphi.org: “Mental Health Surveillance;” “Mental Health Indicators;” “Mental Health Monitoring”

Google

- For each OCED listed public health institute not registered on www.ianphi.org[Country] Mental Health Surveillance;” “[Country] Mental Health Indicators;” “[Country] Mental Health Monitoring”

- For relevant indicators on national public mental health care and mental health care research: “*Versorgungsforschung;” “psych* Versorgung Bericht;” “psych* Versorgungssituation;” “psych* Versorgungsepidemiologie.” [translation: “*health care research;” “psych* health care report;” “psych* health care situation;” “psych* epidemiology of health care.”]

Study Selection

First, all records found via the several search paths were merged and checked for duplicates, which were then deleted. After that, documents were sequentially screened according to the inclusion and exclusion criteria defined below via the following steps: title screen, abstract screen, full record screen (see Figure 1).

We screened all types of published information (such as websites, brochures, posters, reports, scientific as well as official working and consultation papers) with a particular focus on indicators used to monitor mental health at a general population level in member states of the OECD. Records that met the following inclusion criteria were included: (1) availability in English or German language; (2) focus on public mental health; (3) focus on assessment at/database on population level (in contrast to e.g., clinical research or case studies); (4) current data (date of publication after 01.01.2000).

Since mental health surveillance needs to radically reduce complexity, only higher-order concepts can be addressed. Thus, records relating to databases on specific populations (e.g., students, veterans) instead of the general population or with a focus on developmental disorders (e.g., autism), mental disabilities, or specific mental disorders (e.g., depression, substance use, dementia) instead of broader psychopathology were excluded. Further, records with a focus on somatic public health, specific health behaviors as tobacco consumption or questionnaire development were excluded. Since indicators on national policies (existence: yes/no) do not allow for depicting changes at population-based level over time, such records were excluded as well.

All screening steps were mainly done by three reviewers (DP, CK, and EM) who were supported by members of the Mental Health Research Unit within the Department of Epidemiology and Health Monitoring at RKI. The study group (DP, CK, and EM) met regularly to discuss challenges and uncertainties within the study selection process and to review and adjust inclusion and exclusion criteria in an iterative manner. Disagreement on study inclusion was reviewed in this group on a weekly base.

Charting and Collating of the Data

Charting and collating of the results required a conceptual framework, as the extensive area of public mental health needed to be structured substantially. For this purpose, the conceptual framework of an established part of the NCD surveillance at RKI [Diabetes Surveillance (13)] served as a grounded basis for a conducted expert-based focus group. This focus group consisted of nine members of the Mental Health Research Unit within the Department of Epidemiology and Health Monitoring at RKI who possessed a wide range of expert knowledge in various fields on public mental health and its monitoring (e.g., knowledge on health care, prevention & promotion, positive mental health, psychopathology, mental health across the lifespan, expertise in working with survey data or routine data, determinants of mental health). They consisted of psychologists, public health scientists, sociologists, methodologists, and trained psychotherapists. We used the technique of a focus group to pool this expert knowledge, to generate a wide range of different topics and to discuss discrepancies directly. The focus group was led by an experienced researcher (first author, DP) and took 125 min. The group was asked to collect the most important areas of public mental health surveillance, put them into writing and arrange them on a flip board; divergencies were discussed and the group itself agreed on the final topics. A comprehension of the discussion as well as the results were returned to the participants and approved by all of them.

The identified topics served as a grid to organize resulting data from each record that was considered as eligible for indicator extraction. To do so, a standardized data charting form was created in Microsoft Excel 2010 including the following information: authorship, publication year, indicator name, indicator definition (if available), assumed superordinate topic according to the focus group, whether the indicator was already contained in a surveillance resp. monitoring system and if it was specific to a certain age group.

On the basis of this data charting form, only mental health indicators on population-based level (see criteria for record inclusion above) were included. After a screen for duplicates, we excluded (1) indicators which were extracted from more than one record or subsumed similar content [e.g., “parental mental disorders” and “substance use (alcohol and drugs) by family members” as duplicates for “family history of mental disorders”]. Furthermore, we excluded (2) indicators within appropriate content for a continued population-based assessment (e.g., context of indicator too specific: “availability of a valued safe place where an individual can and wants to go to ‘escape' from things”) and (3) indicators, which showed non-specification for mental health surveillance (resp. relying on broader concepts, e.g., “general health”). Since the MHS for Germany was piloted for adults only, within this step (4) indicators for children and youth were excluded as well. To adequately identify indicators for this age group, several search steps would have had to be extended.

Three reviewers (DP, CK, and EM) independently extracted indicators identified by the different search strategies with the help of the prepared data charting form. Uncertainties regarding the defined inclusion and exclusion criteria and consistency with the superior research question were discussed weekly. Afterwards, the assignment of the indicators to the single superordinate topics as well as the steps leading to the final set were aligned by the whole study group one by one.

Results

A total of 13.811 records were retrieved from the search. Figure 1 provides a detailed overview in which step and for what reason records were excluded. The various steps resulted in a total of 373 records which were processed for indicator extraction. A comprehensive list of these sources can be found in Appendix A.

Important Topics for Public Mental Health

The conducted expert-based focus group led to the identification of 14 superordinate topics to cover the most relevant issues in terms of public mental health monitoring. The following topics were considered important:

1. Mental Health Promotion and Prevention

2. Mental Health Resources

3. Mental Health Risks

4. Mental Health Literacy

5. Positive Mental Health

6. Psychopathology

7. Self-harm and Suicidality

8. Supply and Utilization of Mental Health Care

9. Needs, Unmet Needs and Barriers in Mental Health Care

10. Quality of Care

11. Costs of Mental Disorders

12. Burden of Disease and Mortality

13. Participation

14. [Sociodemographic Variables with an Impact on Public Mental Health]

These topics built a preliminary conceptual outline which was used to collate the records and to roughly assign the indicators to.

Indicator Assignment

In sum, N = 1.505 indicators could be extracted from the output generated by the literature research and were assigned to the superordinate topics. Screening for (1) duplicates (n = 920), (2) inappropriate content (n = 24), (3) non-specification for mental health surveillance (n = 31) and (4) indicators specified for children and youth (n = 349) resulted in a final set of 181 different indicators for the adult population. Table 1 depicts these indicators assigned to their superordinate topics.

TABLE 1
www.frontiersin.org

Table 1. Indicators of public mental health in OECD countries.

Of the 181 identified indicators, 134 stemmed from a national indicator system from at least one OECD country or an international organization. Forty-seven indicators were hitherto not included in an existing indicator system (Table 1; indicator marked with an *).

In total, 146 indicators were found in two or more records, 35 indicators were only found once (Table 1; indicator marked in italics).

The indicators varied in their specification from being very specific (e.g., #141 “Waiting times in psychiatric daycare”) to very broad (e.g., #157 “Total expenditures on mental health services”). Some indicators were separated in sub-indicators (see # 150–152; three different indicators for coercive measures).

“Psychopathology” and “Supply and Utlilization of Mental Health Care” were the topics most indicators were assigned to while “Positive Mental Health” and “Mental Health Promotion and Prevention” were the topics with the fewest indicators.

Since sociodemographic variables such as age or gender were comprised in the majority of the screened literature in Appendix A, these variables were not counted resp. included in the above mentioned systematic but listed once. Instead of choosing a quantitative approach, we compared the once listed sociodemographic determinants with commonly recommended variables in global surveillance work (79) to stratify surveillance indicators, resulting in an additional set of n = 11 sociodemographic variables with an impact on public mental health.

Discussion

Following WHO's call in monitoring the mental health of the population, this scoping review was conducted as a first step to build up an indicator-based surveillance system to observe the public mental health of the adult population in Germany on a regular base. Particularly, our present work informs about important topics and indicators in this field based on the current state of knowledge in Germany and other OECD countries.

Within the scoping review, we searched and processed all types of published information, including websites, brochures, posters, and reports to gather latest information in the field of public health, particularly on national level. This approach seems favorable to depict an exhaustive picture of important indicators in the field of public mental health based on the current state of knowledge in research, surveillance, and administrative/routine data on mental health care. Though, according to the source, indicators were very differently communicated, varying in their specification or whether an indicator could be divided in sub-indicators. Attunement regarding the broadness of scope and the consecutive operationalization should therefore be considered when processing the reported indicators for further monitoring work.

Current indicators on public mental health can be described as heterogonous as the field itself: They referred to a wide range of 14 important areas which are reflecting the mentioned topics and recommendations of the overall WHO framework (1, 79), not only with regard to mental disorders and their recovery, but also in terms of positive mental health and the field of mental health promotion and prevention. The need to sufficiently structure the broad field of mental health and chart the indicators accordingly was met by conducting an expert-based focus groups to identify these various superordinate topics.

Following the methodology of a scoping review, we included very different kinds of documents and sources. Therefore, we were able to include a wide range of indicators, developed and used in a variety of settings. For example, most of the indicators were extracted from established indicator-based surveillance systems on public mental health. This seems favorable as those indicators are likely to have been developed by an elaborate, expert-based consensus process and already been proven to predict public mental health within a monitoring system. Moreover, it can be assumed that there is an existing database for these indicators; this enables future monitoring work to compare own data with international data, such as indicators of different OECD countries. Moreover, a quarter of the extracted indicators showed to have strong significance regarding public mental health in scientific studies on the general population or routine/administrative data but are not part of any indicator system yet. Since our search approach was not limited to indicators from already existing indicator systems, it gives promising insights into these existing indicators, that reflect current issues or are of relevance in a particular part of public mental health, which otherwise might have been neglected. To build and adjust a new surveillance system from the ground up, this approach seems beneficial to identify specific and recently important concepts with appropriate indicators reflecting them.

Most of the indicators were found more than once resp. could be extracted from more than one data source. This gives a first indication regarding the emphasis and/or importance of these indicators in former surveillance or research work and thus for the mental health of the population. Furthermore, it shows that our literature search has mainly identified established concepts that are supported by multiple sources as relevant public mental health indicators. Though, the identification of hitherto less used indicators might direct to new trends in important fields (as for example stigma-related content, see indicator #180) and should be considered in building up new surveillance systems.

Most indicators were assigned to the topics “Psychopathology” and “Supply and Utilization of Mental Health Care.” On the contrary, our findings revealed that indicators on “Positive Mental Health” and particularly measures on “Mental Health Prevention and Promotion” were underrepresented regarding both the number of assigned indicators as well as their diversity of content. In terms of strengthening and promoting mental health at population level, a stronger focus on this area seems important in future monitoring work—particularly in light of the current COVID-19 pandemic and an immediate response to its impact.

Limitations and Future Research

Since this scoping review was conducted as a first step in piloting a MHS for Germany, our comprehensive search was restricted regarding the following points:

It mainly focused on indicators for adults. Future research in the field should extend this compilation by searching and depicting indicators which reflect aspects of public mental health across the whole lifespan, including particular indicators for children and adolescents who differ in their age-specific risks and resources of mental health as well as mental disorders and their assessment. These should be searched explicitly with the help of extended search strings and inclusion of institutions and monitoring systems with a focus on this age group.

Since we were interested to depict characteristics of the German health care system in building up a national MHS, some of the indicators were specific to the German system like for example “Guideline adherence mental disorders with S3 health care guidelines” (#154) which is explicitly oriented to a national health care guideline. Thus, particularly indicators regarding mental health care based on administrative and routine data that require a specific data basis (e.g., the mapping of outpatient and inpatient care of the total population, which in Germany is divided into different data bodies of different service providers) should be checked carefully before processing. Further monitoring work has to consider their own national or international specifications to appropriately align the indicators with their system.

Moreover, our concentrated search on mental health care (to include information from administrative and routine data) might have led to an overemphasizing of these indicators in the extracted indicator compilation. However, research and practice in the field of public mental health generally rather concentrated on mental health care services, recovery, and rehabilitation than on prevention or promotion. Nevertheless, prioritizing mental health efforts on prevention and promotion of mental health as well as enhancing resources and positive mental health is demanded (1, 5, 79). Future efforts should thus focus on identifying and researching indicators to assess and monitor measures of population mental health promotion and prevention, even in early states of research.

Lastly, the focus group to structure the broad field of mental health consisted of experts that were not independent of each other, so there may have been influences from hierarchy or previous relationship. It was tried to counteract these effects by emphasizing the importance of the opinion of everyone, managing speaking times and initial individual brainstorming. However, the results were solely used to give a structure when charting the indicators. Our approach has shown to be beneficial, since all of these identified topics could be filled with indicators and could thus facilitate the appropriate communication of results.

Conclusion

This scoping review presents a wide range of currently utilized indicators important to the broad field of public mental health. Our comprehensive compilation intended to serve as a solid basis on which future research and surveillance projects might build on. To do so, all or a selection of the identified indicators could be used and adjusted to the individual constitutional needs.

Furthermore, the introduced indicators might be supplemented or condensed depending on individual national or international demands and tailored to particular research questions or monitoring focus. As our compilation mostly reflects indicators related to mental health in adults, it should be extended with indicators specific to children's and adolescents' mental health to depict the whole lifespan.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.

Author Contributions

EM, DP, JT, and CK conducted the literature search. EM, DP, and CK reviewed documents for inclusion, performed the data extraction, analyzed, and interpreted the data. DP provided methodological guidance with respect to the identification, selection of documents, to charting and reporting of results, and drafted the manuscript with substantial input from JT and EM. CK and DP compiled the attachments. CK did the final language proofreading. All authors contributed to the conception, design of the study, read, and approved the submitted manuscript.

Funding

The MHS – Set-up of a National Mental Health Surveillance at Robert Koch Institute project has been funded by the Federal Ministry of Health (Grant Number: Chapter 1504 Title 54401).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We would like to thank the members of the Mental Health Research Unit within the Department of Epidemiology and Health Monitoring at RKI for their support.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2021.714497/full#supplementary-material

Abbreviations

AOLG, Arbeitsgemeinschaft der Obersten Landesgesundheitsbehörden; APK, Aktion Psychisch Kranke e. V.; BPtK, Bundespsychotherapeutenkammer; DGPPN, Deutsche Gesellschaft für Psychiatrie und Psychotherapie, Psychosomatik und Nervenheilkunde; DRV, Deutsche Rentenversicherung; EU, European Union; GKV Spitzenverband, Spitzenverband Bund der Krankenkassen; KBV, Kassenärztliche Bundesvereinigung; MHS, Mental Health Surveillance; OECD, Organization for Economic Co-operation and Development; RKI, Robert Koch Institute; WHO, World Health Organization.

References

1. World Health Organization, editor. Mental Health Action Plan 2013-2020. Geneva: WHO (2013).

2. Choi BC. The past, present, and future of public health surveillance. Scientifica. (2012) 2012:875253. doi: 10.6064/2012/875253

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Holmes EA, O'Connor RC, Perry VH, Tracey I, Wessely S, Arseneault L, et al. Multidisciplinary research priorities for the COVID-19 pandemic: a call for action for mental health science. Lancet Psychiatry. (2020) 7:547–60. doi: 10.1016/S2215-0366(20)30168-1

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Public Health Agency of Canada, editor. Report From the Canadian Chronic Disease Surveillance System: Mental Illness in Canada. Ottawa, ON: Public Health Agency of Canada (2015).

5. Orpana H, Vachon J, Dykxhoorn J, McRae L, Jayaraman G. Monitoring positive mental health and its determinants in Canada: the development of the Positive Mental Health Surveillance Indicator Framework. Health Promotion Chronic Dis Prevent Canada Res Policy Prac. (2016) 36:1–10. doi: 10.24095/hpcdp.36.1.01

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Australian Institute of Health and Welfare. Mental Health Services in Australia: Key Performance Indicators for Australian Public Mental Health services. Canberra, ACT: Australian Government (2018).

7. Moreau-Gruet F. Monitoring zur psychischen Gesundheit – mit Fokus ‹Ältere Menschen› und ‹Stress am Arbeitsplatz›. Aktualisierung 2014. Gesundheitsförderung Schweiz Arbeitspapier 2. Bern und Lausanne: obsan (2014).

8. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. (2005) 8:19–32. doi: 10.1080/1364557032000119616

CrossRef Full Text | Google Scholar

9. Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. (2010) 5:69. doi: 10.1186/1748-5908-5-69

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Internal Med. (2018) 169:467–73. doi: 10.7326/M18-0850

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Improvement NIfIa. The Good Indicators Guide: Understanding How to Use and Choose Indicators. (2017). Available online at: https://www.england.nhs.uk/improvement-hub/publication/the-good-indicators-guide-understanding-how-to-use-and-choose-indicators/ (accessed November 30, 2017).

12. Strech D, Synofzik M, Marckmann G. Systematic reviews of empirical bioethics. J Med Ethics. (2008) 34:472–7. doi: 10.1136/jme.2007.021709

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Heidemann C, Paprott R, Schmidt C, Reitzle L, Baumert J, Du Y, et al. Aufbau einer diabetes-surveillance in deutschland – ergebnisse der ersten projektphase 2015 – 2019. Epidemiologisches Bull. (2019) 473–8.

14. Lehtinen V. Building Up Good Mental Health. Guidelines Based on Existing Knowledge Helsinki. MMHE Project (2008).

15. World Health Organization, editor. Mental Health Atlas 2017. Geneva: WHO (2017).

16. National Research and Development Centre for Welfare and Health. Establishment of a Set of Mental Health Indicators for European Union. Helsinki: STAKES (2001).

17. Saxena S, van Ommeren M, Lora A, Saraceno B. Monitoring of mental health systems and services: comparison of four existing indicator schemes. Soc Psychiatry Psychiatr Epidemiol. (2006) 41:488–97. doi: 10.1007/s00127-006-0053-3

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Lehmann I, Chisholm D, Hinkov H, Hoschl C, Kapocs G, Kurimay T, et al. Development of quality indicators for mental healthcare in the Danube region. Psychiatr Danub. (2018) 30:197–206. doi: 10.24869/spsih.2018.197

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Public Health Agency of Canada. Suicide Surveillance Indicators: Quick Stats, Canada, 2017 Edition. Ottawa, ON: Public Health Agency of Canada (2017).

20. NHS Health Scotland. National Adult Mental Health and Well-being Indicators for Scotland. Final Briefing December 2007. NHS Health Scotland; Public Health Observatory Division (2007). Available online at: http://www.healthscotland.scot/media/2235/summary-briefing-paper-adult-mental-health-indicators-2007.pdf

21. Public Health Agency of Canada. Centre for Chronic Disease Prevention. Positive Mental Health Surveillance Indicator Framework: Quick Statistics, Adults (18 Years of Age and Older), Canada, 2016 Edition. Ottawa, ON: Public Health Agency of Canada (2016).

22. National Mental Health Commission, editor. Mental Health and Suicide Prevention Monitoring and Reporting Framework. Complete Final Report to the National Mental Health Commission With Appendices. Sydney, NSW (2018).

23. De Graaf R, Bijl RV, Ravelli A, Smit F, Vollebergh WA. Predictors of first incidence of DSM-III-R psychiatric disorders in the general population: findings from the Netherlands Mental Health Survey and Incidence Study. Acta Psychiatr Scand. (2002) 106:303–13. doi: 10.1034/j.1600-0447.2002.01397.x

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Norwegian Institute of Public Health. Public Health Report. Oslo (2016). Available online at: https://www.fhi.no/en/op/hin/

25. Public Health Agency of Canada. Canadian Chronic Disease Indicators, Quick Stats, 2018 Edition. Ottawa, ON: Public Health Agency of Canada (2018).

26. Henderson S, Andrews G, Hall W. Australia's mental health: an overview of the general population survey. Aust N Z J Psychiatry. (2000) 34:197–205. doi: 10.1080/j.1440-1614.2000.00686.x

PubMed Abstract | CrossRef Full Text | Google Scholar

27. WHO Regional Office for Europe, editor. Targets and Indicators for Health 2020 Version 3. Copenhagen: WHO (2016).

28. Government United Kingdom. No Health Without Mental Health. Mental Health Dashboard. Applies to: England. Department of Health (2013).

29. The Finnish Institute for Health and Welfare. Statistical Information on Welfare and Health in Finland (Formally: Welfare Compass). Helsinki (2021). Available online at: https://sotkanet.fi/sotkanet/en/index

30. Cook JA, Razzano LA, Swarbrick MA, Jonikas JA, Yost C, Burke L, et al. Health risks and changes in self-efficacy following community health screening of adults with serious mental illnesses. PLoS ONE. (2015) 10:e0123552. doi: 10.1371/journal.pone.0123552

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Angermeyer MC, Schomerus G. State of the art of population-based attitude research on mental health: a systematic review. Epidemiol Psychiatr Sci. (2017) 26:252–64. doi: 10.1017/S2045796016000627

PubMed Abstract | CrossRef Full Text | Google Scholar

32. National Mental Health Performance Subcommittee, editor. The Fourth National Mental Health Plan Measurement Strategy. Canberra, ACT: Commonwealth of Australia (2011).

33. Schibalski JV, Muller M, Ajdacic-Gross V, Vetter S, Rodgers S, Oexle N, et al. Stigma-related stress, shame and avoidant coping reactions among members of the general population with elevated symptom levels. Compr Psychiatry. (2017) 74:224–30. doi: 10.1016/j.comppsych.2017.02.001

PubMed Abstract | CrossRef Full Text | Google Scholar

34. TNS Opinion & Social. Special Eurobarometer 248 / Wave 64.4: Mental Well-Being. Brussels: European Commission (2006).

35. Healthybelgium. For a Healthy Belgium: Health and Healthcare Indicators (2021). Available online at: https://www.healthybelgium.be/en/

36. Centers for Disease Control and Prevention, editor. Mental Illness Surveillance Among Adults in the United States. Atlanta, GA (2011).

37. Norlund S, Reuterwall C, Hoog J, Janlert U, Slunga Jarvholm L. Work situation and self-perceived economic situation as predictors of change in burnout–a prospective general population-based cohort study. BMC Public Health. (2015) 15:329. doi: 10.1186/s12889-015-1681-x

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Pedersen CB, Mors O, Bertelsen A, Waltoft BL, Agerbo E, McGrath JJ, et al. A comprehensive nationwide study of the incidence rate and lifetime risk for treated mental disorders. JAMA Psychiatry. (2014) 71:573–81. doi: 10.1001/jamapsychiatry.2014.16

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Bansal N, Bhopal R, Netto G, Lyons D, Steiner MF, Sashidharan SP. Disparate patterns of hospitalisation reflect unmet needs and persistent ethnic inequalities in mental health care: the Scottish health and ethnicity linkage study. Ethn Health. (2014) 19:217–39. doi: 10.1080/13557858.2013.814764

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Wang PS, Aguilar-Gaxiola S, Alonso J, Angermeyer MC, Borges G, Bromet EJ, et al. Use of mental health services for anxiety, mood, and substance disorders in 17 countries in the WHO world mental health surveys. Lancet. (2007) 370:841–50. doi: 10.1016/S0140-6736(07)61414-7

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Colpe LJ, Barker PR, Karg RS, Batts KR, Morton KB, Gfroerer JC, et al. The National Survey on Drug Use and Health Mental Health Surveillance Study: calibration study design and field procedures. Int J Methods Psychiatr Res. (2010) 19(Suppl. 1):36–48. doi: 10.1002/mpr.311

PubMed Abstract | CrossRef Full Text | Google Scholar

42. WHO Regional Office for Europe, editor. Integrated Surveillance of Noncommunicable Diseases (iNCD). A European Union-WHO Project. Final Project Report for the Dissemination of Results. Copenhagen: WHO (2015).

43. National Institute of Mental Health. Mental Health Information. Rockville, MD: Statistics (2021). Available online at: https://www.nimh.nih.gov/health/statistics/index.shtml

44. Meyer C, Rumpf HJ, Hapke U, John U. Impact of psychiatric disorders in the general population: satisfaction with life and the influence of comorbidity and disorder duration. Soc Psychiatry Psychiatr Epidemiol. (2004) 39:435–41. doi: 10.1007/s00127-004-0755-3

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Public Health Agency of Canada, editor. Report From the Canadian Chronic Disease Surveillance System: Mood and Anxiety Disorders in Canada. Ottawa, ON: Public Health Agency of Canada (2016).

46. Norwegian Institute of Public Health. Mental Illness Among Adults. Oslo (2016). Available online at: https://www.fhi.no/en/op/hin/mental-health/psykisk-helse-hos-voksne/#prevalence-of-mental-disorders-among-adults

47. OECD, editor. Health at a Glance 2017: OECD Indicators. Paris: OECD Publishing (2017).

48. OECD, editor. Definitions for Health Care Quality Indicators 2016-2017 HCQI Data Collection. OECD (2016).

49. Kassenärztliche Bundesvereinigung (KBV). Statistische Informationen aus dem Bundesarztregister (2017). Available online at: http://www.kbv.de/media/sp/2017_12_31_BAR_Statistik.pdf

50. World Health Organization. 2018 Global Reference List of 100 Core Health Indicators (Plus Health-Related SDGs). Geneva: WHO (2018).

51. NHS England. Mental Health Five Year Forward View Dashboard. Period: Quarter 4 2018/19 (2019).

52. Gaebel W, Kowitz S, Fritze J, Zielasek J. Inanspruchnahme des Versorgungssystems bei psychischen Erkrankungen. Dtsch Arztebl Int. (2013) 110:799–808.

53. Melchior H, Schulz H, Härter M. Faktencheck Gesundheit - Regionale Unterschiede in der Diagnostik und Behandlung von Depressionen. Gütersloh: Bertelsmann Stiftung (2014).

54. Grossimlinghaus I, Falkai P, Gaebel W, Hasan A, Janner M, Janssen B, et al. [Assessment of quality indicators with routine data: presentation of a feasibility test in ten specialist clinics for psychiatry and psychotherapy]. Nervenarzt. (2015) 86:1393–9. doi: 10.1007/s00115-015-4357-y

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Statistisches Bundesamt (Destatis). Diagnosedaten der Patienten und Patientinnen in Krankenhäusern (einschl. Sterbe- und Stundenfälle) (2018). Available online at: https://www.destatis.de/DE/Publikationen/Thematisch/Gesundheit/Krankenhaeuser/DiagnosedatenKrankenhaus2120621167004.pdf?__blob=publicationFile

56. Jager M, Rossler W. Epidemiology of mental health care. Der Nervenarzt. (2012) 83:389–401; quiz 2. doi: 10.1007/s00115-011-3454-9

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Rommel A. [Migration and rehabilitation of mental diseases – perspectives and limitations in the reporting of official data of service providers]. Gesundheitswesen. (2005) 67:280–8. doi: 10.1055/s-2004-813832

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Bundesregierung. Sektorenübergreifende Versorgung von Menschen mit psychischen Erkrankungen Deutscher Bundestag (2019).

59. Gómez-Beneyto M, Rodriguez Escobar J, Rasillo Rodríguez E, Gómez González B, Blanco Quintana A, Vannerau Sánchez D, et al. Mental Health Strategy of the Spanish National Health System 2009–2013. Madrid: Ministry of Health; Social Services and Equality (2012).

60. Ministry of Health, editor. Office of the Director of Mental Health and Addiction Services: Annual Report 2017. Wellington: Ministry of Health (2019).

61. Sareen J, Stein MB, Campbell DW, Hassard T, Menec V. The relation between perceived need for mental health treatment, DSM diagnosis, and quality of life: a Canadian population-based survey. Can J Psychiatry. (2005) 50:87–94. doi: 10.1177/070674370505000203

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Brandstetter S, Dodoo-Schittko F, Speerforck S, Apfelbacher C, Grabe H-J, Jacobi F, et al. Trends in non-help-seeking for mental disorders in Germany between 1997–1999 and 2009-2012: a repeated cross-sectional study. Soc Psychiatry Psychiatr Epidemiol. (2017) 52:1005–13. doi: 10.1007/s00127-017-1384-y

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Mack S, Jacobi F, Gerschler A, Siegert J, Höfler M, Busch M, et al. Self-reported utilization of mental health services in the adult German population - evidence for unmet needs? Results of the DEGS1-Mental Health Module (DEGS1-MH). Int J Methods Psychiatr Res. (2014) 23. doi: 10.1002/mpr.1438

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Forsell Y. The pathway to meeting need for mental health services in Sweden. Psychiatr Serv. (2006) 57:114–9. doi: 10.1176/appi.ps.57.1.114

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Sachverständigenrat zur Begutachtung der Entwicklung im Gesundheitswesen. Bedarfsgerechte Steuerung der Gesundheitsversorgung. Kapitel 16: Koordinierte Versorgung von Menschen mit psychischen Erkrankungen (S. 683–758) (2018). Available online at: https://www.svr-gesundheit.de/fileadmin/user_upload/Gutachten/2018/SVR-Gutachten_2018_WEBSEITE.pdf

66. Nübel J, Müllender S, Hapke U, Jacobi F. Epidemie der Depression? Prävalenzentwicklung und Inanspruchnahme von Hilfs- und Versorgungsangeboten. Der Nervenarzt. (2019). doi: 10.1007/s00115-019-0681-y

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Wang J. Mental health treatment dropout and its correlates in a general population sample. Med Care. (2007) 45:224–9. doi: 10.1097/01.mlr.0000244506.86885.a5

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Bermejo I, Klärs G, Böhm K, Hundertmark-Mayser J, Lampert T, Maschewsky-Schneider U, et al. Evaluation des nationalen Gesundheitsziels “Depressive Erkrankungen: verhindern, früh erkennen, nachhaltig behandeln”. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. (2009) 52:897–904. doi: 10.1007/s00103-009-0939-9

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Becker N, Abholz HH. Prävalenz und Erkennen von depressiven Störungen in deutschen Allgemeinarztpraxen - eine systematische Literaturübersicht. ZFA. (2005) 81:474–81. doi: 10.1055/s-2005-872584

CrossRef Full Text | Google Scholar

70. Sundmacher L, Fischbach D, Schuettig W, Naumann C, Augustin U, Faisst C. Which hospitalisations are ambulatory care-sensitive, to what degree, and how could the rates be reduced? Results of a group consensus study in Germany. Health Policy. (2015) 119:1415–23. doi: 10.1016/j.healthpol.2015.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Hewlett E, Moran V. Making Mental Health Count: The Social and Economic Costs of Neglecting Mental Health Care. Paris: OECD Publishing (2014). doi: 10.1787/9789264208445-en

CrossRef Full Text | Google Scholar

72. Pirraglia PA, Hampton JM, Rosen AB, Witt WP. Psychological distress and trends in healthcare expenditures and outpatient healthcare. Am J Manag Care. (2011) 17:319–28.

PubMed Abstract | Google Scholar

73. DGPPN. Zahlen und Fakten der Psychiatrie und Psychotherapie (2019).

74. Jager M, Sobocki P, Rossler W. Cost of disorders of the brain in Switzerland with a focus on mental disorders. Swiss Med Wkly. (2008) 138:4–11.

PubMed Abstract | Google Scholar

75. Rüesch P, Manzoni P. Psychische Gesundheit in der Schweiz - Monitoring. In: Meyer K, Camenzind P, Meyer PC, editors. Zürich: Edition obsan (2003).

76. Hermann R, Mattke S, Members of the OECD Mental Health Care Panel. Selecting Indicators for the Quality of Mental Health Care at Health Systems Level in OECD Countries. OECD Health Technical Papers No 17. Paris: OECD Publishing (2004).

77. European Commission. POSTER - The European Core Health Indicators (ECHI) Shortlist of 88 Health Indicators Identified by Policy Area (2013). Available online at: https://ec.europa.eu/health/indicators_data/publications_en

78. Druss BG, Zhao L, Von Esenwein S, Morrato EH, Marcus SC. Understanding excess mortality in persons with mental illness: 17-year follow up of a nationally representative US survey. Med Care. (2011) 49:599–604. doi: 10.1097/MLR.0b013e31820bf86e

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Patel V, Saxena S, Lund C, Thornicroft G, Baingana F, Bolton P, et al. The Lancet Commission on global mental health and sustainable development. Lancet. (2018) 392:1553–98. doi: 10.1016/S0140-6736(18)31612-X

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: public mental health, surveillance, monitoring, indicator, scoping review

Citation: Peitz D, Kersjes C, Thom J, Hoelling H and Mauz E (2021) Indicators for Public Mental Health: A Scoping Review. Front. Public Health 9:714497. doi: 10.3389/fpubh.2021.714497

Received: 25 May 2021; Accepted: 17 August 2021;
Published: 27 September 2021.

Edited by:

Sebastian von Peter, Brandenburg Medical School Theodor Fontane, Germany

Reviewed by:

Yuriy Ignatyev, Immanuel Klinik Rüdersdorf, Germany
Zeinab Abbas, Lebanese International University, Lebanon

Copyright © 2021 Peitz, Kersjes, Thom, Hoelling and Mauz. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Diana Peitz, peitzd@rki.de

These authors share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.