Skip to main content

ORIGINAL RESEARCH article

Front. Public Health, 11 December 2017
Sec. Family Medicine and Primary Care

The Validity and Reliability Characteristics of the M-BACK Questionnaire to Assess the Barriers, Attitudes, Confidence, and Knowledge of Mental Health Staff Regarding Metabolic Health of Mental Health Service Users

\r\nAndrew Watkins,*Andrew Watkins1,2*Simon RosenbaumSimon Rosenbaum3Philip B. Ward,Philip B. Ward3,4Joanna PatchingJoanna Patching5Elizabeth Denney-WilsonElizabeth Denney-Wilson2Jane Stein-Parbury\r\nJane Stein-Parbury2
  • 1Keeping the Body in Mind Program, The Bondi Centre, South Eastern Sydney Local Health District, Sydney, NSW, Australia
  • 2Faculty of Health, University of Technology Sydney, Sydney, NSW, Australia
  • 3School of Psychiatry, University of New South Wales, Sydney, NSW, Australia
  • 4Schizophrenia Research Unit, Ingham Institute for Applied Medical Research, Liverpool, NSW, Australia
  • 5School of Nursing, University of Notre Dame, Sydney, NSW, Australia

Background: Addressing the burden of poor physical health and the subsequent gap in life expectancy experienced by people with mental illness is a major priority in mental health services. To equip mental health staff with the competence to deliver evidence-based interventions, targeted staff training regarding metabolic health is required. In order to evaluate the effectiveness of staff training regarding metabolic health, we aimed to develop a succinct measure to determine the barriers, attitudes, confidence, and knowledge of health practitioners through the development and test–retest reliability of the Metabolic-Barriers, Attitudes, Confidence, and Knowledge Questionnaire (M-BACK).

Methods: The M-BACK questionnaire was developed to evaluate the impact of specialized training in metabolic health care for mental health nurses. Content of the M-BACK was developed from a literature review and refined by an expert review panel and validated via a piloting process. To determine the test–retest reliability of the M-BACK, 31 nursing students recruited from the University of Notre Dame, Sydney completed the questionnaire on two separate occasions, 7 days apart. Intraclass correlation coefficients (ICCs) were calculated for the total score, as well as each of the four domains.

Results: Pilot testing was undertaken with a sample of 106 mental health nurses with a mean age 48.2, ranging from 24 to 63 years of age, who participated in six training courses. Questionnaire development resulted in a 16-item instrument, with each item is scored on a five-point Likert scale ranging from “strongly disagree” to “strongly agree.” Test–retest reliability of the M-BACK was completed by 30 of 31 nursing students recruited, ICCs ranged from 0.62 to 0.96.

Conclusion: The M-BACK is a reliable measure of the key elements of practitioner perceptions of barriers, and their knowledge, attitudes, and confidence regarding metabolic monitoring in people with mental illness. It can be used to assess the effectiveness of interventions aimed at increasing uptake of metabolic monitoring, a key component of programs to reduce the life expectancy gap in people living with severe mental illness.

Introduction

People with mental illness have poorer physical health outcomes in comparison to the general population. Severe mental illness (SMI), including schizophrenia and related psychotic disorders, bipolar disorder, and major depressive disorder, are associated with a reduced life expectancy of between 10 and 20 years (1, 2), primarily due to preventable cardiometabolic diseases. People with these disorders are more likely than the general population to meet criteria for metabolic syndrome (MetS) (3), a cluster of risk factors including abdominal obesity, dyslipidaemia, hypertension, and insulin resistance (4).

The Second Australian National Survey of Psychosis study reported that 60.8% of people who experienced psychosis had MetS, which is two to three times that of the general Australian population (5). People with a serious mental illness (SMI) have other risk factors including rates of smoking more than twice that of the general public, higher rates of obesity, and lower levels of physical activity than the general population (57). While the advent of second-generation antipsychotics has reduced some side effects of their first-generation predecessors, the metabolic profile of these medications has led to increasing rates of MetS in people prescribed these medications (8, 9).

Metabolic health disorders that commonly occur with second-generation antipsychotics have not been well managed by mental health services (5). There is a general lack of expertise, confidence, and practical experience in addressing physical health care among all mental health professionals (10, 11). As a result of diagnostic overshadowing, mental health nurses in particular have traditionally focused on addressing mental illness symptomatology, while the physical health care needs of service users have often been a lower priority (12).

Mental health nurses are well positioned to play a key role in providing metabolic health care to people who experience mental illness (13). While mental health nurses acknowledge that they have a role in addressing physical health needs (14), they may not have the skills or knowledge to identify and manage the metabolic complications experienced by service users, prompting recommendations for specific training in this area (1517). Barriers to mental health professionals proactively tackling the high burden of poor physical health include: a lack of time, poor knowledge, and a lack of confidence regarding metabolic screening and the provision of interventions aimed at reducing metabolic risk (18, 19). However, there is evidence that brief training can lead to improvements in rate of metabolic monitoring in inpatient settings (20).

In addition to metabolic monitoring, there is increasing evidence demonstrating the effectiveness of lifestyle interventions for preventing and treating cardiometabolic disease among people with SMI (2124) in line with exhortation to “don’t just screen, intervene” (25). Drawing on literature from the general population, the essential components of effective lifestyle interventions are well established (22, 26), including the need for a multidisciplinary approach incorporating physical activity and nutritional components along with health coaching. Evidence for the role of lifestyle interventions in reducing overall cardiometabolic risk and obesity among people with SMI has been described as overwhelming, with gaps in service delivery considered an “implementation gap,” as opposed to a “knowledge gap” (23).

Two clinical tools that measure the effectiveness of metabolic health care have been evaluated in mental health professionals. The first of these is the Physical Health Attitude Scale (PHASe) (27), a 28-item measure that assesses attitudes of mental health nurses toward physical health care of mental health service users. The PHASe tool has primarily been used to obtain a cross-sectional snapshot of the perceptions and practices of mental health nurses regarding the general physical health of service users (14, 28, 29). However, this tool does not measure knowledge change, which is a key training goal, and is not specifically focused on the area of metabolic health care. Stanton et al (30) recently developed a questionnaire [the Exercise in Mental Illness Questionnaire—Health Professionals Version (EMIQ-HP)] to investigate the knowledge, attitudes, beliefs, and behaviors of health professionals regarding exercise in the treatment of mental illness. The EMIQ-HP demonstrated excellent test–retest reliability. While valuable, its focus is limited to one modifiable risk factor, physical activity, and therefore is not ideal to assess changes regarding metabolic health education more broadly.

Physical health care incorporates a broad and diverse range of health specialties. While there are many domains of physical health care for people experiencing SMI that warrant careful attention (5), metabolic health is an area of particular concern (31). Specialized training for mental health nurses in metabolic health screening and interventions is therefore a priority. The ability to measure the effectiveness of this type of training for mental health nurses is critical.

The objectives of the study were to (1) create a succinct tool that could measure changes in perceived barriers, attitudes, confidence, and knowledge of nurses related to metabolic health care in mental health service users, (2) ensure that tool contain valid content, and (3) the instrument has reliability as to be sensitive to change to determine the effectiveness of training, education, or other initiative to improve the delivery of metabolic health care by mental health clinicians.

Materials and Methods

The development of the M-BACK commenced with a review of the literature to identify the training needs, barriers, and enablers associated with metabolic monitoring and the delivery of lifestyle interventions by mental health nurses, psychiatrists, and other allied mental health staff. Findings from that review indicated that the attitudes of clinical staff toward providing metabolic health care in mental health settings was integral to the successful delivery of such services (14, 15, 19, 27, 28). Another common finding was a low level of confidence among mental health staff in carrying out recommended metabolic health monitoring and delivering interventions (15, 16, 18, 32), in addition to a lack of knowledge in this area (15, 33, 34). Other consistent barriers to staff delivering metabolic care were workload, concerns regarding medication adherence, perceived apathy on the part of a service user or a sense of hopelessness from a staff member (15, 16, 18, 19, 27, 28, 3335).

Content Validation

Twenty questions were developed based upon four themes that were identified in the literature: barriers, attitudes, confidence, and knowledge of metabolic health care. The questionnaire was then reviewed by a panel of seven people with specialist expertise in the delivery of metabolic health care to mental health service users including clinicians, educators and researchers. Experts were chosen based upon criteria requiring them to be published experts in the field of metabolic health care of mental health service users along with clinical and/or teaching experience in this area. There was also a desire for the panel to be representative of the major disciplines in mental health care. Therefore, the panel included members from mental health nursing, psychiatry and psychology. In addition, the panel featured an exercise physiologist and dietitian that work in mental health care. Each expert reviewer was sent a copy of the questionnaire and an explanation as to the purpose of the instrument and asked to comment on the applicability, clarity, and simplicity of each item. Reviewers were also encouraged to provide comment on the overall layout and design of the questionnaire. After written feedback, six of the expert panel met to cull and refine the questions. At the conclusion of the expert consensus review 16 Likert-type questions were produced across four domain areas: barriers to delivering metabolic health care, attitudes toward metabolic health care, confidence in delivering metabolic health care, and knowledge of metabolic health care.

Pilot Testing

The 16-item M-BACK tool was pilot tested in 2013 on participants completing a training course, in order to ascertain their understanding of the statements employed in the questionnaire. The training consisted of a 2-day workshop on metabolic health care for people with a mental illness and delivered at the Australian College of Nursing. The training was designed and delivered by lead author (Andrew Watkins) with the aim of improving participants’ knowledge and confidence in providing metabolic health care screening and interventions. Training included both educational and practical elements on topics such as: how to screen for metabolic health (e.g., taking blood pressure, waist circumference), nutritional interventions (e.g., conducting a basic dietetic assessment and providing nutritional advice), exercise interventions (e.g., assessing physical activity levels and prescribing exercise), and pharmacological interventions (e.g., medications that can be used to reduce metabolic risk factors).

The pilot testing was undertaken with a sample of 106 mental health nurses with a mean age 48.2, ranging from 24 to 63 years of age over six separate courses. Participants undertook pre and post testing of the M-BACK questionnaire. There was space provided below each question and instructions provided for participants to make comments if they found the question confusing or ambiguous. Feedback from participants was circulated to the expert panel, who were given 2 weeks to provide comment. Expert group comments were collated by lead author (Andrew Watkins). The expert panel met on two occasions during the piloting phase and made refinements to several of the questions to remove any identified ambiguity that had been identified in the pretesting phase. The refined questions were reviewed at two subsequent meetings, in order to reach agreement on the question content.

The penultimate version that was then piloted with the last cohort of workshop of 19 participants who did not offer any negative feedback in relation to confusion or ambiguity of the questions. The final version incorporated numeric coding (responses included numbers) to allow for ease of scoring and facilitate statistical analysis. This version achieved approval by all authors and the expert panel.

Instrument Overview

The M-BACK (see Image S1 in Supplementary Material) is a 16-item instrument separated into four domains: knowledge, confidence, attitudes, and practice barriers in relation to metabolic health. Each item is a five-point Likert type scale ranging from Strongly Disagree (scoring 1) to Strongly Agree (scoring 5). Each domain is composed of four items and scored out of 20, with a minimum score of four and a maximum score of 20. Total score for the questionnaire is 80, with a minimum of 16 (see Image S2 in Supplementary Material).

Domain 1: Barriers

Items 1–4 address barriers to metabolic screening and intervention, including, workload, service user interest, conflict with mental health goals, and inability to effect change. These questions are negatively posed with the scoring reversed. Possible scores for this domain range from 4 to 20.

Domain 2: Attitudes

Items 5–8 investigate attitudes, including toward metabolic monitoring, the provision of smoking cessation advice, physical activity, and nutritional intake. Possible scores for this domain range from 4 to 20.

Domain 3: Confidence

Items 9–12 assess the confidence of respondents in providing interventions to prevent or treat metabolic health including smoking cessation, physical activity and nutritional interventions. Possible scores for this domain range from 4 to 20.

Domain 4: Knowledge

Items 13 through 16 assess knowledge of metabolic health, screening, interpreting pathology reports, and understanding of the metabolic side effects of neuroleptic medication. Possible scores for this domain range from 4 to 20.

Instrument Reliability

The M-BACK questionnaire is intended to assess change over time and to detect change in the items following education or training. Therefore, test–retest reliability to assess the stability of a measure over time was of particular importance for the M-BACK. The test–retest reliability for each question was determined utilizing intraclass correlation coefficients (ICCs) using a two-factor mixed effects model (36). ICC was chosen as the statistical method under the presumption that a Likert-type scale scored items are generally considered as a continuous variable and ICC is the preferred method of assessing test–retest data under these conditions (37). Using ICC will determine the proportion of total variance that occurs between time points (36).

To determine the required sample size a method devised by Walter et al. was utilized to calculate the number of subjects required for a reliability study being measured by ICC (38). This method is based on a functional approximation to earlier exact results and has shown excellent agreement with the exact results. Based on this method, the sample size determined for the 16-item scale was 29.

Thirty-two final year undergraduate nursing students from the University of Notre Dame in Sydney who had elected mental health as a specialty were invited to complete the questionnaire. There were no other exclusion criteria. Students were offered a verbal invitation to complete the questionnaire at the conclusion of a mental health lecture on therapeutic relationships. Student participants were informed of the research nature of completing the M-BACK, informed that participation was completely voluntary and there were no consequences for not participating. All participants completed a signed consent form. All 32 students completed the questionnaire on the first occasion with one person missing for the repeat questionnaire, due to illness. The sample of 31 who completed the questionnaire on the two occasions, 7 days apart had a mean age 23.9 ± 6.6 years and a majority were female (61%).

All survey data were analyzed using SPSS version 23. The data were reviewed to ensure completeness. The person who was missing for the repeated questionnaire was excluded from the analysis. ICC’s and 95% confidence intervals (Cis) were calculated for the total score, as well as each of the four domains (barriers, attitudes, confidence, and knowledge). ICCs were calculated and interpreted based on Landis and Koch, with ICCs of below 0.4 (poor to fair), 0.41–0.6 (moderate), 0.610.80 (excellent), and 0.81–1 (almost perfect) (39). The questionnaire was analyzed for individual items in addition to the four domain areas.

Ethical Considerations

Ethical approval was granted for the study by University of Technology Sydney Human Research Ethics Committee (HREC 2013000749). The research was deemed by this ethics committee to be of negligible risk and not requiring of formal debriefing strategies for participants. Anonymity was assured by keeping demographic data separate from the completed questionnaires.

Results

Content Validity

The expert panel met to discuss the M-BACK tool (with the exception of overseas participants), followed by several rounds of email correspondence. Comments received from the expert panel were incorporated into the M-BACK instrument. The expert panel contributed to further development of the content in the “attitudes” and “knowledge” sections, and wording in the “confidence” questions. Two reviewers noted that the term “consumer” needed to be used consistently rather than utilizing “client.” A number of items were reworded to make them more specific regarding a nurse’s role. For example, the original item; “Encouraging consumers to increase their level of physical activity is an important part of my role,” was reworded to; “Encouraging consumers to increase their level of physical activity is an important part of my role as a mental health nurse.” Four questions from the original literature review were culled following feedback from the expert panel as they were deemed to be redundant after all the questions were refined.

Pilot testing of the M-BACK tool allowed for feedback from course participants regarding their understanding of the statements employed in the questionnaire. The expert panel met on two occasions during the piloting phase and made refinements to several of the questions to remove ambiguity. The barriers section in particular was reworded in order to clarify that the questions were negatively framed. For example, the original item “There is no point to metabolic health screening for mental health consumers,” was reworded to “Screening for metabolic syndrome and physical health interventions are pointless as poor physical health outcomes are unavoidable.” Similarly, “I’m too busy to do health promotion work with clients” was adjusted to “My workload prevents me doing any health promotion activities with consumers.”

Instrument Reliability

Thirty-one nursing students, mean age 23.9 ± 6.6 years (61% female) participated and completed the M-BACK on two occasions, 7 days apart. ICC correlations for individual items ranged from 0.62 to 0.96 (see Table 1).

TABLE 1
www.frontiersin.org

Table 1. Intraclass correlation coefficient items.

Total Score

A high degree of reliability was found between the total M-BACK scores at both time points. The single measure ICC was considered excellent, 0.87 (95% CI 0.75–0.94). The mean between day variation was 0.54 ± 5.3.

Barriers

The ICCs for the barrier items ranged from 0.74 (Item 4 “Screening for metabolic syndrome and physical health interventions are pointless as poor physical health outcomes are unavoidable”) to 0.92 (Item 2 “Consumers with a serious mental illness are not interested in improving their physical health”). The mean ICC was 0.71 (95% CI 0.39–0.86).

Attitudes

The ICCs for the attitude items ranged from 0.78 (Item 3 “Encouraging consumers to increase their level of physical activity is an important part of my role as a mental health clinician”) to 0.93 (Item 1 “Metabolic health screening is an important part of my role as a mental health clinician”). The mean ICC was 0.80 (95% CI 0.58–0.90).

Confidence

The ICCs for the confidence items ranged from 0.73 (Item 4 “I am confident in using dietary interventions to prevent/treat metabolic syndrome in consumers”) to 0.92 (Item 1 “I am confident in my ability to screen for metabolic syndrome”). The mean ICC was 0.88 (95% CI 0.75–0.94).

Knowledge

The ICCs for the knowledge items ranged from 0.62 (Item 4 “I understand the metabolic side-effect profiles of different neuroleptic medication”) to 0.96 (Item 2 “I understand how to screen for metabolic syndrome”). The mean ICC was 0.90 (95% CI 0.80–0.96).

Discussion

The article describes the development, content validity, and test–retest reliability of a novel tool, that assesses the attitudes, confidence, knowledge, of mental health nurses in providing metabolic health care to mental health consumers and the barriers perceived in implementing this care.

The fact that metabolic health is a primary driver of premature mortality among people with SMI is well established (25, 4043). Unfortunately, mental health nurses often feel that they are ill-prepared to be able to screen and intervene for metabolic health and feel that they require training to rectify this (15, 32). The M-BACK may be of assistance in determining the reasons why metabolic screening and interventions are not occurring in clinical practice, so that training and education can be designed in a targeted way.

Despite recognition of the importance of metabolic health training there is a lack of published information on physical health training for mental health nurses and minimal information on its effectiveness (17, 44). This has led to repeated calls in the nursing literature for education and training in physical health to be provided for mental health nurses and for these educational programs to be evaluated (1416, 32, 44). This M-BACK tool can be employed to meet the identified gap in measuring the effectiveness of training and education for mental health nurses and other initiatives of mental health services to address metabolic health care. It also enables evaluation of the effectiveness of education regarding metabolic health care through pre- and posttraining testing. In a similar way the questionnaire can be used to determine effectiveness of staff-based interventions for mental health professionals.

Content validation of the M-BACK survey was achieved by expert consensus. It enabled the incorporation of the views of researchers, educators and clinicians working in the field to develop a tool that captures pertinent data and facilitates detailed analysis. The M-BACK tool is appropriate to assess current knowledge regarding metabolic health in service users with SMI. Nonetheless, revisions of the M-BACK tool may be required as new knowledge is gained. In addition, the current tool is intended to assess the views of mental health nurses; a version adapted for completion by service users and/or carers would be a valuable addition.

This study also examined the test–retest reliability of the M-BACK. The questionnaire demonstrated acceptable test–retest reliability, with an ICC of 0.87 for the total M-BACK score ranging between 0.61 and 1 for each item.

Test–retest reliability analysis will rarely achieve perfect results (45). Within the domains, the greatest variance was found within the knowledge domain and least variance within the attitudes domain. Item 4 of the knowledge domain (I understand the metabolic side-effect profiles of different neuroleptic medication) had the lowest ICC of any item throughout the questionnaire, although this was still classified as excellent according to the criteria of Landis and Koch (39). Possible explanations for why some items in a questionnaire may have greater variability using include changed knowledge or awareness of a participant, perhaps even prompted be having completed the questionnaire previously (45). Given the acceptable test–retest results, it was determined that no changes to questions were required.

Limitations

This validation study of the M-BACK questionnaire is not without limitations. A narrow definition of SMI was utilized in order to focus on service users where the greatest metabolic health risk exists, reflecting the use of antipsychotics in this population. Similarly, we used mental health nurses as the targeted clinicians for this tool, as nurses tend to have the most face-to-face contact with service users. Instrument reliability was examined in nursing students during the final year of their undergraduate training. Although students were not the primary targets of the M-BACK tool, it is unlikely that utilizing students impacted test–retest reliability of the instrument, and its applicability for use with fully qualified clinicians. Further research is needed to determine whether responses vary as a consequence of professional training background, and therefore whether discipline-specific versions of the instrument should be developed. The current version was developed in Australia, utilizing expert consultation with experts from the United Kingdom and Europe.

Conclusion

There is a clearly identified need for training and education for nursing staff regarding the metabolic health of mental health service users. The M-BACK tool is a valid and reliable instrument to measure the effectiveness of education and training to improve the attitudes, confidence, and knowledge of mental health nursing staff in relation to metabolic health and changes in perceptions of barriers to delivery of metabolic health care. Mental health services need to incorporate specific training on metabolic care for service users, and the M-BACK questionnaire will be a useful tool in future studies of training outcomes in mental health clinicians.

Ethics Approval and Consent to Participate

Written and informed consent was obtained from all research participants. Ethical approval was granted for the study by University of Technology Sydney Research Committee (HREC 2013000749).

Availability of Data and Material

The datasets used and/or analyzed during the current study available from the corresponding author on reasonable request.

Ethics Statement

Ethical approval was granted for the study by University of Technology Sydney Research Committee (HREC 2013000749).

Author Contributions

AW was the study coordinator. He led recruitment, data collection, and data analysis. He drafted the conceptual framework and the manuscript. SR was involved in the conception and design of the study and took the lead in supporting AW revising the manuscript. PW assisted the study coordinator with study design and analysis. PW was also involved in revising the conceptual framework. JP assisted the study coordinator with the recruitment, data collection, and manuscript review. ED-W revised the conceptual framework and the manuscript. JS-P assisted with design and conception of the study. She was involved in revising the conceptual framework and manuscript.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors would like to acknowledge the participants from Notre Dame University in this validation study.

Funding

This article summarizes research that was independently funded. All authors read and approved the final manuscript.

Supplementary Material

The Supplementary Material for this article can be found online at http://www.frontiersin.org/articles/10.3389/fpubh.2017.00321/full#supplementary-material.

Image S1. The M-BACK questionnaire.

Image S2. Scoring for the M-BACK questionnaire.

Abbreviations

M-BACK, metabolic barriers, attitudes, confidence, and knowledge; SMI, severe mental illness; MetS, metabolic syndrome; ICC, intraclass correlations.

References

1. Lawrence D, Hancock KJ, Kisely S. The gap in life expectancy from preventable physical illness in psychiatric patients in Western Australia: retrospective analysis of population based registers. Br Med J (2013) 346:f2539. doi:10.1136/bmj.f2539

CrossRef Full Text | Google Scholar

2. Chang CK, Hayes RD, Perera G, Broadbent MTM, Fernandes AC, Lee WE, et al. Life expectancy at birth for people with serious mental illness and other major disorders from a secondary mental health care case register in London. PLoS One (2011) 6(5):e19590. doi:10.1371/journal.pone.0019590

CrossRef Full Text | Google Scholar

3. Vancampfort D, Stubbs B, Mitchell AJ, De Hert M, Wampers M, Ward PB, et al. Risk of metabolic syndrome and its components in people with schizophrenia and related psychotic disorders, bipolar disorder and major depressive disorder: a systematic review and meta-analysis. World Psychiatry (2015) 14(3):339–47. doi:10.1002/wps.20252

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Zimmet P, Alberti KGM, Kaufman F, Tajima N, Silink M, Arslanian S, et al. The metabolic syndrome in children and adolescents—an IDF consensus report. Pediatr Diabetes (2007) 8(5):299–306. doi:10.1111/j.1399-5448.2007.00271.x

CrossRef Full Text | Google Scholar

5. Morgan V, McGrath J, Jablensky A, Badcock J, Waterreus A, Bush R, et al. Psychosis prevalence and physical, metabolic and cognitive co-morbidity: data from the second Australian national survey of psychosis. Psychol Med (2014) 44(10):2163–76. doi:10.1017/S0033291713002973

CrossRef Full Text | Google Scholar

6. Brown S, Birtwistle J, Roe L, Thompson C. The unhealthy lifestyle of people with schizophrenia. Psychol Med (1999) 29(3):697–701. doi:10.1017/S0033291798008186

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Daumit GL, Goldberg RW, Anthony C, Dickerson F, Brown CH, Kreyenbuhl J, et al. Physical activity patterns in adults with severe mental illness. J Nerv Ment Dis (2005) 193(10):641–6. doi:10.1097/01.nmd.0000180737.85895.60

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Correll CU, Manu P, Olshanskiy V, Napolitano B, Kane JM, Malhotra AK. Cardiometabolic risk of second-generation antipsychotic medications during first-time use in children and adolescents. JAMA (2009) 302(16):1765–73. doi:10.1001/jama.2009.1549

PubMed Abstract | CrossRef Full Text | Google Scholar

9. De Hert M, Schreurs V, Sweers K, Van Eyck D, Hanssens L, Sinko S, et al. Typical and atypical antipsychotics differentially affect long-term incidence rates of the metabolic syndrome in first-episode patients with schizophrenia: a retrospective chart review. Schizophr Res (2008) 101(1):295–303. doi:10.1016/j.schres.2008.01.028

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Hyland B, Judd F, Davidson S, Jolley D, Hocking B. Case managers’ attitudes to the physical health of their patients. Aust N Z J Psychiatry (2003) 37(6):710–4. doi:10.1080/j.1440-1614.2003.01264.x

CrossRef Full Text | Google Scholar

11. Organ B, Nicholson E, Castle D. Implementing a physical health strategy in a mental health service. Australas Psychiatry (2010) 18(5):456–9. doi:10.3109/10398562.2010.506217

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Gray R, Hardy S, Anderson KH. Physical Health and Severe Mental Illness: If We Don’t Do Something About It, Who Will? Int J Ment Health Nurs (2009) 18(5):299–300. doi:10.1111/j.1447-0349.2009.00640.x

CrossRef Full Text | Google Scholar

13. Happell B, Platania-Phung C, Gray R, Hardy S, Lambert T, McAllister M, et al. A role for mental health nursing in the physical health care of consumers with severe mental illness. J Psychiatr Ment Health Nurs (2011) 18(8):706–11. doi:10.1111/j.1365-2850.2010.01666.x

CrossRef Full Text | Google Scholar

14. Robson D, Haddad M, Gray R, Gournay K. Mental health nursing and physical health care: a cross-sectional study of nurses’ attitudes, practice, and perceived training needs for the physical health care of people with severe mental illness. Int J Ment Health Nurs (2012) 22(5):409–17. doi:10.1111/j.1447-0349.2012.00883.x

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Nash M. Physical care skills: a training needs analysis of inpatient and community mental health nurses: high rates of physical illness among people with severe mental illness are a cause for concern. Michael Nash considers how a training needs analysis can contribute towards the development of an education programme in physical care for nurses working in mental health settings. Ment Health Pract (2005) 9(4):20–3. doi:10.7748/mhp2005.12.9.4.20.c1896

CrossRef Full Text | Google Scholar

16. Terry J, Cutter J. Does education improve mental health practitioners’ confidence in meeting the physical health needs of mental health service users? A mixed methods pilot study. Issues Ment Health Nurs (2013) 34(4):249–55. doi:10.3109/01612840.2012.740768

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Howard L, Gamble C. Supporting mental health nurses to address the physical health needs of people with serious mental illness in acute inpatient care settings. J Psychiatr Ment Health Nurs (2011) 18(2):105–12. doi:10.1111/j.1365-2850.2010.01642.x

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Happell B, Platania-Phung C, Scott D. What determines whether nurses provide physical health care to consumers with serious mental illness? Arch Psychiatr Nurs (2014) 28(2):87–93. doi:10.1016/j.apnu.2013.11.001

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Happell B, Scott D, Platania-Phung C, Nankivell J. Should we or shouldn’t we? Mental health nurses’ views on physical health care of mental health consumers. Int J Ment Health Nurs (2012) 21(3):202–10. doi:10.1111/j.1447-0349.2011.00799.x

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Rosenbaum S, Nijjar S, Watkins A, Garwood N, Sherrington C, Tiedemann A. Nurse-assessed metabolic monitoring: a file audit of risk factor prevalence and impact of an intervention to enhance measurement of waist circumference. Int J Ment Health Nurs (2014) 23(3):252–6. doi:10.1111/inm.12057

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Daumit GL, Dickerson FB, Wang N-Y, Dalcin A, Jerome GJ, Anderson CA, et al. A behavioral weight-loss intervention in persons with serious mental illness. N Engl J Med (2013) 368(17):1594–602. doi:10.1056/NEJMoa1214530

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Naslund JA, Aschbrenner KA, Scherer EA, Pratt SI, Wolfe RS, Bartels SJ. Lifestyle intervention for people with severe obesity and serious mental illness. Am J Prev Med (2016) 50(2):145–53. doi:10.1016/j.amepre.2015.07.012

CrossRef Full Text | Google Scholar

23. Bartels SJ. Can behavioral health organizations change health behaviors? The STRIDE study and lifestyle interventions for obesity in serious mental illness. Am J Psychiatry (2015) 172(1):9–11. doi:10.1176/appi.ajp.2014.14101246

CrossRef Full Text | Google Scholar

24. Curtis J, Watkins A, Rosenbaum S, Teasdale S, Kalucy M, Samaras K, et al. Keeping the Body in Mind: an individualised lifestyle and life-skills intervention to prevent antipsychotic-induced weight gain in first episode psychosis. Early Interv Psychiatry (2016) 10:267–76. doi:10.1111/eip.12230

CrossRef Full Text | Google Scholar

25. Curtis J, Newall HD, Samaras K. The heart of the matter: cardiometabolic care in youth with psychosis. Early Interv Psychiatry (2012) 6(3):347–53. doi:10.1111/j.1751-7893.2011.00315.x

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Ward MC, White DT, Druss BG. A meta-review of lifestyle interventions for cardiovascular risk factors in the general medical population: lessons for individuals with serious mental illness. J Clin Psychiatry (2015) 76(4):e477–86. doi:10.4088/JCP.13r08657

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Robson D, Haddad M. Mental health nurses’ attitudes towards the physical health care of people with severe and enduring mental illness: the development of a measurement tool. Int J Nurs Stud (2012) 49(1):72–83. doi:10.1016/j.ijnurstu.2011.07.011

CrossRef Full Text | Google Scholar

28. Happell B, Platania-Phung C, Scott D. Proposed nurse-led initiatives in improving physical health of people with serious mental illness: a survey of nurses in mental health. J Clin Nurs (2014) 23(7–8):1018–29. doi:10.1111/jocn.12371

CrossRef Full Text | Google Scholar

29. Happell B, Platania-Phung C, Scott D. Are nurses in mental health services providing physical health care for people with serious mental illness? An Australian perspective. Issues Ment Health Nurs (2013) 34(3):198–207. doi:10.3109/01612840.2012.733907

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Stanton R, Happell BM. An exercise prescription primer for people with depression. Issues Ment Health Nurs (2013) 34(8):626–30. doi:10.3109/01612840.2012.758207

CrossRef Full Text | Google Scholar

31. De Hert M, Schreurs V, Vancampfort D, Winkel R. Metabolic syndrome in people with schizophrenia: a review. World Psychiatry (2009) 8(1):15–22. doi:10.1002/j.2051-5545.2009.tb00199.x

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Happell B, Platania-Phung C, Scott D. Physical health care for people with mental illness: training needs for nurses. Nurse Educ Today (2013) 33(4):396–401. doi:10.1016/j.nedt.2013.01.015

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Nash M. Assessing nurses’ propositional knowledge of physical health: a training exercise showed that staff need better education to identify clients at risk of experiencing drug reactions and to recognise undiagnosed physical disorders that may affect treatment, says Michael Nash. Ment Health Pract (2010) 14(2):20–3. doi:10.7748/mhp2010.10.14.2.20.c8009

CrossRef Full Text | Google Scholar

34. Hardy S, Hinks P, Gray R. Does training practice nurses to carry out physical health checks for people with severe mental illness increase the level of screening for cardiovascular risk? Int J Soc Psychiatry (2014) 60(3):236–42. doi:10.1177/0020764013483721

PubMed Abstract | CrossRef Full Text | Google Scholar

35. McDonell MG, Kaufman EA, Srebnik DS, Ciechanowski PS, Ries RK. Barriers to metabolic care for adults with serious mental illness: provider perspectives. Int J Psychiatry Med (2011) 41(4):379–87. doi:10.2190/PM.41.4.g

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull (1979) 86(2):420. doi:10.1037/0033-2909.86.2.420

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Rankin G, Stokes M. Reliability of assessment tools in rehabilitation: an illustration of appropriate statistical analyses. Clin Rehabil (1998) 12(3):187–99. doi:10.1191/026921598672178340

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Walter S, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med (1998) 17(1):101–10. doi:10.1002/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics (1977) 33(1):159–74. doi:10.2307/2529310

CrossRef Full Text | Google Scholar

40. Stewart R. Mental disorders and mortality: so many publications, so little change. Acta Psychiatr Scand (2015) 132(5):410–11. doi:10.1111/acps.12476

CrossRef Full Text | Google Scholar

41. Nielsen RE, Uggerby AS, Jensen SOW, McGrath JJ. Increasing mortality gap for patients diagnosed with schizophrenia over the last three decades – a Danish nationwide study from 1980 to 2010. Schizophr Res (2013) 146(1):22–7. doi:10.1016/j.schres.2013.02.025

CrossRef Full Text | Google Scholar

42. Connolly JG, Toomey TJ, Schneeweiss MC. Metabolic monitoring for youths initiating use of second-generation antipsychotics, 2003–2011. Psychiatr Serv (2015) 66(6):604–9. doi:10.1176/appi.ps.201400222

CrossRef Full Text | Google Scholar

43. Mangurian C, Newcomer JW, Vittinghoff E, Creasman JM, Knapp P, Fuentes-Afflick E, et al. Diabetes screening among underserved adults with severe mental illness who take antipsychotic medications. JAMA Intern Med (2015) 175(12):1977–9. doi:10.1001/jamainternmed.2015.6098

CrossRef Full Text | Google Scholar

44. Hardy S, White J, Deane K, Gray R. Educating healthcare professionals to act on the physical health needs of people with serious mental illness: a systematic search for evidence. J Psychiatr Ment Health Nurs (2011) 18(8):721–7. doi:10.1111/j.1365-2850.2011.01722.x

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Wikman A, Wärneryd B. Measurement errors in survey questions: explaining response variability. Soc Indic Res (1990) 22(2):199–212. doi:10.1007/BF00354840

CrossRef Full Text | Google Scholar

Keywords: severe mental illness, physical health, education, training, evaluation tool, service delivery, health outcomes, metabolic syndrome

Citation: Watkins A, Rosenbaum S, Ward PB, Patching J, Denney-Wilson E and Stein-Parbury J (2017) The Validity and Reliability Characteristics of the M-BACK Questionnaire to Assess the Barriers, Attitudes, Confidence, and Knowledge of Mental Health Staff Regarding Metabolic Health of Mental Health Service Users. Front. Public Health 5:321. doi: 10.3389/fpubh.2017.00321

Received: 20 June 2017; Accepted: 14 November 2017;
Published: 11 December 2017

Edited by:

Tien K. Khoo, Griffith University, Australia

Reviewed by:

Angela J. Grippo, Northern Illinois University, United States
Gillian Bartlett, McGill University, Canada

Copyright: © 2017 Watkins, Rosenbaum, Ward, Patching, Denney-Wilson and Stein-Parbury. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Andrew Watkins, andrew.watkins@health.nsw.gov.au

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.