Original Research ARTICLE
An Educational Intervention to Train Professional Nurses in Promoting Patient Engagement: A Pilot Feasibility Study
- 1Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy
- 2Azienda Sanitaria Universitaria Integrata di Trieste, Trieste, Italy
- 30-3 Center for the at-Risk Infant - Istituto di Ricovero e Cura a Carattere Scientifico (IRCCS) Eugenio Medea, Bosisio Parini, Italy
Introduction: Growing evidence recognizes that patients who are motivated to take an active role in their care can experience a range of health benefits and reduced healthcare costs. Nurses play a critical role in the effort to make patients fully engaged in their disease management. Trainings devoted to increase nurses' skills and knowledge to assess and promote patient engagement are today a medical education priority. To address this goal, we developed a program of nurse education training in patient engagement strategies (NET-PES). This paper presents pilot feasibility study and preliminary participants outcomes for NET-PES.
Methods: This is a pilot feasibility study of a 2-session program on patient engagement designed to improve professional nurses' ability to engage chronic patients in their medical journey; the training mainly focused on passing patient engagement assessment skills to clinicians as a crucial mean to improve care experience. A pre-post pilot evaluation of NET-PES included 46 nurses working with chronic conditions. A course specific competence test has been developed and validated to measure patient engagement skills. The design included self-report questionnaire completed before and after the training for evaluation purposes. Participants met in a large group for didactic presentations and then they were split into small groups in which they used role-play and case discussion to reflect upon the value of patient engagement measurement in relation to difficult cases from own practice.
Results: Forty-six nurses participated in the training program. The satisfaction questionnaire showed that the program met the educational objectives and was considered to be useful and relevant by the participants. Results demonstrated changes on clinicians' attitudes and skills in promoting engagement. Moreover, practitioners demonstrated increases on confidence regarding their ability to support their patients' engagement in the care process.
Conclusions: Learning programs teaching nurses about patient engagement strategies and assessment measures in clinical practice are key in supporting the realization of patient engagement in healthcare. Training nurses in this area is feasible and accepted and might have an impact on their ability to engage patients in the chronic care journey. Due to the limitation of the research design, further research is needed to assess the effectiveness of such a program and to verify if the benefits envisaged in this pilot are maintained on a long-term perspective and to test results by employing a randomized control study design.
Effectively managing chronic diseases and the burden they put on patients and families, clinicians, and healthcare organizations is currently a major concern for health policy makers (Vogeli et al., 2007). Promoting patient engagement is increasingly acknowledged as a way to address the challenge of chronic conditions (Hibbard and Greene, 2013; Graffigna et al., 2014) and it has been widely advocated as a crucial component of patient-centered models of sustaining healthcare innovation (Thomson et al., 2005; Washington and Lipstein, 2011). Moreover, embracing the patient engagement paradigm is an ethical priority for healthcare systems across countries (Sherman and Hilton, 2014; Solomon et al., 2016; Weil, 2016): it is well-known as a key strategy to include the patients' preferences and expectations in services' design and delivery thus maximizing their clinical effectiveness (World Health Organization, 2002; Eldh et al., 2004; Koloroutis, 2004; Elwyn et al., 2007; Jordan et al., 2008; Eaton et al., 2015; Fisher et al., 2016).
Research has validated this perspective and it has been demonstrated that enhancing patient engagement might increase patients' motivation toward treatments and the care process (Mosen et al., 2007), improve treatment outcomes (Hibbard and Greene, 2013), and generate greater satisfaction for received care (Tobiano et al., 2015). Lastly, engaging patients in their care might contribute to the system's sustainability through a reduction of healthcare services use (Remmers et al., 2009).
Nursing: A Key to Patient Engagement
In the midst of healthcare transformation and evolution, where patient engagement is an imperative to catalyze the delivery system reform (Carman et al., 2013; Fisher et al., 2016), nursing plays a critical role in the effort to make patients fully engaged in their disease management (Lammon et al., 2010; Barello et al., 2012). Professional nurses across Western countries have a well-established tradition of engaging patients in the medical course and are trained to embrace clinical models which endorse “autonomous and collaborative care of patients of all ages, families, groups, and communities, sick or well and in all clinical settings” (International Council of Nurses, 2010; Pelletier and Stichler, 2013). The concept of relationship-based care constitutes a milestone of the nursing care paradigm with several theories supporting the nurse-patient partnership as the foundation for effective care delivery (Koloroutis, 2004; McCormack and McCance, 2006; Sahlsten et al., 2007; Barello and Graffigna, 2015b). Through the relational and educational aspects of nursing care, nurses have the opportunity to build care relationships that support patient engagement, which ultimately lead to improved patients' quality of life even when life-threatening chronic conditions occur (Gruman et al., 2010; Jerofke et al., 2014; Barello and Graffigna, 2015a; Jenerette and Mayer, 2016). In their clinical encounters, nurses are recognized to be key persons whose strategies might hugely affect the patient's level of engagement in the care process (Jordan et al., 2008; Kutney-Lee et al., 2009; Laschinger et al., 2010; Deyo et al., 2016; Morath and Braaten, 2016). Research on the patients' perspective showed how the patients' perception of professionals' positive attitude toward their self-management behaviors is associated with higher level of patient engagement (Graffigna et al., 2016) and adherence to medical prescriptions (Chan et al., 2009; Schmidt et al., 2012) thus confirming the crucial role of nurses who are often in charge of self-care interventions.
Particularly, scholars (Laschinger et al., 2010; Pelletier and Stichler, 2013) agree that nurses can engage patients by enacting different behaviors and relational strategies: (1) sensitizing patients to be aware of their active role in managing their health and in playing an active part in their treatment plans and decisions; (2) providing patients with trustable information, resources, and support in order to enhance their level of health literacy; (3) stimulating the patients' autonomy in treatment decision making; (4) facilitating exchanges within the formal and informal patients' care network (health providers and family); (5) coordinating care delivered by other providers. For these reasons, nurses are today increasingly valued as professionals qualified to provide personalized and flexible care, which are fundamental for a patient engagement approach to healthcare (Needleman and Hassmiller, 2009; Naylor et al., 2011; Lewis et al., 2016).
Barriers to Patient Engagement in the Patient-Nurse Relationship
Despite the growing awareness that engaging patients in their care process should be a nursing priority, considerable barriers related to its effective realization still exist and are reported in literature. For instance, Wellard (2001), Wellard et al. (2003) showed how poor communication between patients and nurses, limited privacy, and task-focused nursing practice might hinder the patients' possibility to engage in effective disease management. According to other scholars (Eldh et al., 2006), patients tend to be disengaged in their care when they do not feel in an equal relationship, when there is a lack of information about their health condition or they experience a paternalistic attitude by their health providers. Previous research also identified patients' dissatisfaction with the limited opportunities given to them to be actual partners in their own healthcare management (Eaton et al., 2015). Probably, this is due to the fact that some health practitioners do have a vision for partnership, but frequently lack the practical resources or pragmatic skills required to actualize this principle in their daily practice (Wellard and Street, 1999; Rasmussen et al., 2001; Wellard and Rushton, 2002; Wellard et al., 2003). Then, although professionals might value and embrace the engagement philosophy, they may experience some tensions between their professional role and the raising patients' desire for autonomy and participation in the care decisions. This may limit professionals in sustaining patient engagement as well as it may be perceived as a potential attack to the established patient-clinician relationship (Kennedy et al., 2007). Moreover, lack of theoretical knowledge might impact nurses' awareness about the need to plan deliberate strategies for effectively engaging patients along their care journey (Sahlsten et al., 2008).
Collecting Patients' Experience of Engagement: The Value of Patient Engagement Measures to Support Nurses' Action
Modern healthcare systems are increasingly recognizing the need for paying attention to the patients' engagement expectations in order to best align services with patients' needs (Elwyn et al., 2007; Black, 2013; Graffigna and Barello, 2016). Patient engagement measures have the potential to drive changes in how the healthcare system is organized and delivered and might contribute to actually realize the “patient engagement promise.” Moreover, patient engagement measurements—initially developed for use in research (Hibbard et al., 2005; Graffigna and Barello, 2016)—have recently started to be considered a mandatory requirement for health professionals to enhance clinical management (Graffigna and Barello, 2016; Hibbard et al., 2016). Adopting this view also implies to consider that patients' engagement expectations might vary depending of the phase of the patients' medical journey (Barello et al., 2015b). Moreover, the patients' conception of what it means to be engaged might change widely, from being welcomed to be an active part of treatment decision and care plans (Thompson, 2007). This means that professionals' skills and actions need to be balanced and attuned with the expertise and expectations of patients. Capturing the patient engagement experience, for this reason, cannot be limited to the professionals' sensitiveness to patients' illness experience; rather, it should be systematically conducted by adopting dedicated assessment tools which are able to collect patient engagement levels. Despite resistances to their adoption still exist, clinicians increasingly recognize the benefits of collecting their patients' engagement expectations. Particularly, the call for patient engagement measures adoption has been sustained by evidences that show they can be of benefit for multiple purposes (Simmons et al., 2014; Graffigna and Barello, 2016; Hibbard et al., 2016; Roberts et al., 2016): (1) a process or outcome measure to determine the patients' characteristics that may predict their level of engagement and their risk for dis-engagement, (2) a tool to personalized interventions based on the individual's ability for self-management (3) an outcome measure for evaluating the performance and effectiveness of healthcare interventions, comparing pre- to post-intervention assessments of one patient's level of engagement; (4) an instrument to optimize and tailor professionals' relational and communicational strategies and, potentially, to improve the effectiveness of their actions.
In the light of these premises, the “measurement act” can become a precious occasion for nurses to feel empowered in their clinical effectiveness and to have concrete guidelines about how to achieve positive relationship with their patients and provide more patient-centered care. However, the innovation potentials offered by the adoption of patient engagement measurements can only be realized if clinicians can understand the values of these data in patient care and start collecting and utilizing this information in their daily practice. Indeed, a key issue limiting successful implementation of patient engagement measures is the clinician's lack of knowledge and awareness about how to effectively utilize these data in the clinical management of their patients. All these factors appear to stress the need to train professional nurses in introducing and benefit from patient engagement measures in their daily clinical practice.
The Present Study
In order to enhance professional nurses' ability to make their patients effectively engaged in their medical course, the authors (GG and SB) developed a novel program designed to train nurses in patient engagement strategies and to effectively adopt patient engagement measures in their routine practice (NET-PES program). From a theoretical point of view, the implementation of patient engagement measurement in routine patient care represents a significant change to clinical practices of both individual clinicians and healthcare organizations. Changing the organizational culture of healthcare systems is well-known to be a challenge. The phases of the change process, namely dissemination, adoption, implementation, and continuation (Fleuren et al., 2004), can be applied specifically to the process of implementing patient engagement measures in clinical practice, in the light of specific organizational and clinical issues. The training of clinicians represents the first step of dissemination.
The NET-PES program is based on the assumption that clinicians who are sensitized to the value of patient engagement, who have adequate theoretical and practical knowledge about this concept, who are provided with communication and relational skills and have reasonable confidence in their own abilities to engage patients are more likely to correctly assess and thereby to better respond to patients' engagement needs and expectations. Moreover, a central asset of the course is that without providing professionals with reliable measures for capturing their patient engagement level, they cannot succeed in tailoring their own actions on patients' care expectations and preferences. The course was developed according to extensive research about patient engagement and the factors enabling it and designed to be highly participative and interactive among participants (Hibbard et al., 2005; Graffigna and Barello, 2015a). This is a report of feasibility testing of the program along with examining potential impact and participant satisfaction.
Materials and Methods
We conducted a pre-post pilot study evaluating the feasibility of the NET-PES program. Self-report questionnaires were completed before and after the workshop for evaluation purposes. To guarantee data confidentiality and assure anonymity, each participant was assigned with a random identification number in order to track data from pre- and post-questionnaires. All nurses working with chronic patients at the Azienda Sanitaria Universitaria Integrata di Trieste (Italy) were contacted and recruited through e-mail invitations sent to the hospital units, to service medical directors and to nurse managers and they were invited to participate in the course. Only nurses having work experience with chronic patients were considered eligible for the training program. Eligible nurses interested in learning more were invited to an information session. Recruitment materials emphasized the voluntary nature of the program.
Due to the fact that it is an observational design with education as the intervention it didn't require any ethical approval by the hospital institutional review board according to the institutional and national requirements. However, we collected by all participants written informed consent for confidentiality issues. We confirm that all ongoing and related trials for this observational educational intervention will be submitted to Ethical approval and registered in ClinicalTrials.gov.
The NET-PES Program Description
According to the principles of patient engagement and activation theories (Hibbard et al., 2005; Graffigna and Barello, 2015a), a theoretically-driven educational training for nurses working with chronic patients entitled “Nurses Engagement Training in Patient Engagement Strategies” (NET-PES) was designed, delivered, and tested by researchers who have experience in adult training programs and patient engagement theories. Moreover, specific inputs were given from clinicians (GP, MM, MC, LP), which contributed to outline the main educational needs of the target participants, reviewed didactic materials and training scenarios. To guarantee adequate participation, a maximum number of 25 participants was set for each edition of the workshop. Teaching methods included adult teaching learning principles (Colliver, 2000) and provided an experiential learning environment where nurses were encouraged to share their professional experience and reflect on patient engagement strategies they enact in their daily clinical practice.
The program content was articulated into four main themes: (1) setting the scene: a didactic overview covering the core principles of patient engagement and activation theories and the evidence base for improving nurses' knowledge and skills to engage patients in their care; (2) the whys for adopting patient engagement measures: an outline of the main evidence supporting the value of patient engagement measures and the ben'efits of using them in clinical practice; (3) acquiring practical skills to use patient engagement measures in clinical practice: familiarization with the measures, understanding of clinically important differences among the patient engagement profiles, how to adapt communication and relational style to different levels of engagement, and developing shared strategies to guide potential nurses' actions based on patients' scores; (4) from theory to practice: overview of the most effective patient engagement interventions currently available in the scientific literature and tools for guiding clinical actions aimed at promoting patient engagement. Table 1 describes in details the contents, the learning objectives and the main educational techniques featuring the program.
Didactic presentations were constantly alternated with interactive discussions of clinical cases of real patients with different clinical conditions. The cases included a summary of the medical history, patient engagement profiles' card, and linkage of the patient engagement profiles to patients' clinical parameters. These allowed reflecting upon the value of collecting patient engagement measures to address the patients' needs across patient engagement profiles and, consequently, to tailor the interventions. Moreover, simulated clinical consultations enacted by a patient-actor followed by debriefing with facilitators allowed participants to share knowledge, to receive live peer feedback and to experience a collaborative learning context with colleagues working in different clinical units. The interactive fashion of the program was encouraged by facilitators and provided rich contents for the course.
The supporting materials used in the program included: the main measures of patient engagement currently available in the scientific literature (i.e., Patient Activation Measure by Hibbard et al., 2005; Patient Health Engagement Scale by Graffigna et al., 2015b), the case studies discussed and memory-aid materials including the scales' scoring system, guidance on changes in patients' needs across the patient engagement levels, and related suggested actions, and scientific articles discussing the evidence base that oriented the program's contents.
Participants' Outcomes and Program Evaluations
Feasibility was evaluated including process measures (such as participants' attendance, completion rates of assessment measures, and satisfaction with the program). Nurses engagement attitudes and skills were assessed using self-report measures administered before (T0) and at the end of the program (T1). The second day of the course was delivered 1 month after the first session. Socio-demographic and professional characteristics (i.e., age, gender, discipline, year of professional experience,) were collected before the delivery of the program.
Pre- and post-evaluation surveys included the following measures:
• The 13-item version of the Clinician Support Patient Activation Measure (CS-PAM) (Rademakers et al., 2015), which assesses clinicians' believes and attitudes toward the importance of patient self-management behaviors and his/her active role in the care process. The items of the CS-PAM are aimed at assessing the degree to which practitioners value patient activation behaviors as important (Hibbard et al., 2010). Particularly CS-PAM items might be grouped into four categories of increasing level of patient's activation behaviors that clinicians might endorse (items 1, 4, 5, 8: “patient should have the knowledge and behave in order to prevent or minimize symptoms associated with their health condition” (adherence); items 2, 6, 7: “patient can make independent judgment and action” (independency); items 9, 10, 11: “patient is able to take an active role during the consultation” (partnership); items 3, 13: “patient should be an independent information seeker” (information seeker). Each item is scored using a 5-point Likert scale (1, Strongly disagree; 2, Disagree; 3, Agree; 4, Strongly agree; 5, Not applicable).
• Clinicians Competence in Patient Engagement Strategies (CC-PES) is an ad-hoc scale developed for the aims of the program that scores clinicians on 9 items, which equate to their perceived confidence in enacting 9 key strategies to promote patient engagement. Each item is scored using a 5-point Likert scale (1, Not at all confident; 2, Not very confident; 3, Neutral; 4, Confident; 5, Very confident). Competences assessed are the followings: (1) assess the level of patients' engagement; (2) generally support patient engagement; (3) motivate patients in following medical prescriptions; (4) inform patients about disease and treatments; (5) assess patient's health literacy; (6) empathize with patients; (7) assess and manage difficult patients' emotions; (8) effectively communicate with patients and their families; (9) effectively relate with patients and their families.
• Participants' experience and satisfaction questionnaire: the post-questionnaire was created to obtain rating and qualitative reports for participants on their experience and satisfaction with the NET-PES program and recommendations for future improvements. Particularly the survey consisted of six items, including six questions rated with a 10-point Likert scale assessing nurses' satisfaction with the course in term of general satisfaction, interest, usefulness, quality of teaching, quality of didactic materials, and quality of practical sessions. Open-ended questions were also used to gather information on what participants liked most and least about the program (in terms of both didactic contents and teaching methods) and to obtain specific recommendations to improve the program itself.
The research team monitored the program fidelity by implementing monthly supervision and protocol review sessions including the principal investigators, co-investigators, and program facilitators. In addition, the principal investigator attended at least one session of the course and provided feedbacks to program facilitators. Ongoing review of the program sessions through the study period revealed both the strengths and weakness of the protocol design and intervention delivery. This pilot feasibility work has been intended to form the basis for subsequently modifying the design of the NET-PES program for a larger clinical trial.
Participants' socio-demographic and professional features and satisfaction items were analyzed through descriptive statistics. To determine the internal consistency of the adopted measures, Cronbach's α was used. As the CC-PES was ad-hoc developed for the purposes of the present study, the factorial structure was assessed with a principal component analysis (PCA). Paired-sample t-tests were used to compare T0 and T1 mean scores of CS-PAM and CC-PES. Moreover, two separate multivariate analyses of variance (MANOVAs) were used to assess pre-to-post changes in CS-PAM scales and CC-PES items. To adjust for multiple testing, consistent with recent literature (Provenzi et al., 2015), the Benjamini-Hochberg false discovery rate (FDR) procedure was used, setting q < 0.05. Basic assumptions for the use of MANOVA were checked, including assessment of normal distribution of variables through the Kolmogorov-Smirnov test. The Statistical Package for Social Sciences (SPSS) version 21.0 for Windows was used for data analysis. Open-ended responses were transcribed and analyzed using a content analysis approach. Two researchers (SB and GG) independently read and coded the open responses in order to detect recurring themes representative of the participants' viewpoints and recommendations for future improvements.
In the following paragraphs, data collected from two subsequent editions of the program are presented.
Overall, 49 nurses participated in the educational program. Among them, 46 completed both pre- and post-questionnaires and attended both sessions of the program. Of the three missing questionnaires, three pre-questionnaires were not filled because participants arrived late. Participants with missing questionnaires did not differ from included subjects for socio-demographic and professional characteristics. Mean age of included professionals was 47 years (SD = 7.08, range 25–58). Mean years of professional experience was 23.9 (SD = 8.64, range 3–35). The majority of participants were female (78.3%).
The CS-PAM pre- and post-training Cronbach's alpha was 0.89 and 0.85, respectively. Cronbach's alpha for the CC-PES was 0.87 (T0) and 0.89 (T1). As such, reliability was high for both instruments. The PCA revealed a one-factor structure for the CC-PES, with PC1 explaining 51.2% of variance (eigenvalue = 4.61).
The mean scores of CS-PAM, t(45) = 4.05, p = < 0.001, and CC-PES, t(45) = 3.48, p = 0.001, increased from T0 to T1.
The attitudes of participants toward patient activation and self-management behaviors changed from the beginning to the end of the program, F(4, 42) = 5.08, p = 0.002, = 0.33. Scores improved for each of the CS-PAM categories (Table 2). Testing for False Discovery Rate (FDR) did not affect the results and no significant mean comparison was excluded.
Participants also reported improvements in their confidence toward enacting patient engagement strategies, F(9, 37) = 2.26, p = 0.039, = 0.36. Specifically, an increase was observed in 8-out-of-9 skills depicted by the CC-PES (see Table 3). Testing for FDR did not affect the results and no significant mean comparison was excluded.
Participants' Experiences and Satisfaction
Overall, on a scale from 1 to 10, satisfaction with the program was high (mean = 8.62), as well as the level of participants' interest toward the course's contents (mean = 8.76), the perceived course usefulness (mean = 8.65), the quality of teaching (mean = 9.07), the quality of the didactic materials (mean = 8.77) and of the interactive sessions (mean = 8.79).
Moreover, from the qualitative analysis of participants' responses, several themes emerged to describe the most useful aspects of the program. Participants gave highly positive feedback after the program. Participants found the course to be interesting, useful, enjoyable, informative, and highly relevant to their own nursing practice and for teaching junior staff.
Summarizing and analyzing participants' written reports resulted in the following achievements:
Learning through sharing. Particularly, nurses reported highly positive feelings related to the opportunity to share and discuss their experience with colleagues belonging to different clinical units within a safe and stimulating learning environment. The heterogeneous group nature of the program was, in this sense, particularly valued as a fundamental factor to promote a safe climate of discussion and feedback.
Learning by doing. Moreover, participants highly valued the possibility to participate in role-playing and case scenarios with simulated patients. This allowed them to directly experience contents explained during the didactic sessions and to reflect upon them by receiving feedbacks from other participants and facilitators.
Valuing the nursing professionalism. The valorization of the nursing profession and the capitalization on the past professional experience was then considered a core aspect of the program and was highly appreciated by participants who felt professionally recognized. The contents of the course were perceived as a systematization and valorization of the daily work of nurses.
Time for self-reflection. Furthermore, the possibility to reflect while learning allowed nurses to question and discuss daily practices with patients and clinical hidden assumptions. Particularly, participants reported as a value of the program the space given to reflect upon clinical models and cultures that often are enacted without any critical thinking. Nurses commented on the importance to build a culture of patient engagement, which emphasize patients' autonomy, and is respectful of the patients' needs along the care process.
Innovation for the nursing paradigm. Finally, the course was also perceived useful due to the innovativeness of its contents. This was perceived to be a step forward from the epistemology of patient-centeredness to concrete strategies of action to actually promote the centrality of people along the care process. The possibility to experience and understand the relational value of patient engagement measures was perceived as a useful aspect of the training. Having assessment measures that concretely helps clinicians in detecting the patients' needs and expectation of being involved in their care allowed clinicians to reflect upon their relational strategies to really address the needs of patients.
Suggestions for improvements. Regarding the least favorite aspects of the program and recommendation for the future, participants least liked its brief duration, and reported to desire more individual feedback on their patient engagement during the course and in their implementation in the actual clinical practice. Finally, participants recommended that the program in the future include the testimony of nurses who successfully employed patient engagement strategies in the clinical work with chronic patients and additional guidance on communication and relational strategies to improve the engagement of both patients and their caregivers.
Selected quotes and overall descriptive themes from open-ended questions exploring participant satisfaction and recommendation for future improvements are listed in Table 4.
Table 4. Selected quotes and overall descriptive themes representing nurses satisfaction with the program and recommendation for future improvements.
In this paper we described the preliminary examination of the feasibility of a 2-session program (NET-PES) designed to train nurses in adopting patient engagement measures to enact patient engagement strategies. Healthcare quality improvement efforts are increasingly focused on chronic illness care, and there will undoubtedly be heightened interest in monitoring the clinicians' performance in supporting patient engagement in the management of their health condition; at the same time, healthcare organizations need to train their clinicians in order to provide them knowledge and skills to effectively support the patient active role. Within this context, nurses are crucial actors for sustaining this paradigmatic revolution and promoting the imperative of patient engagement. Training the next generation of clinicians—and of nurses as one of the main patient's navigators along the complexities of the current healthcare environment—means not only to emphasize the relevance of supporting patients in self-care and self-management skills, but also to sustain the acquisition of skills and strategies to monitor and encourage patient engagement along the medical course.
This pilot feasibility study demonstrated that NET-PES was associated with observable improvements in nurses' attitudes and skills for promoting patients' engagement in chronic care management. Also, qualitative feedback from participants revealed that the program made them more confident in delivering patient engagement actions. These findings, despite the small sample size, suggest preliminary evidence that a brief educational intervention designed to train nurses in patient engagement assessment and improvement is not only feasible but holds promise toward potentially improve clinicians' patient engagement strategies. The achieved results also highlighted the potential for the NET-PES program to contribute to efforts aimed at improving the quality of healthcare for persons with chronic conditions. To date, interventions in the area of patient engagement have largely concentrated on improving health providers' communication and relational behaviors and their empathy in the delivery of care (Kennedy et al., 2005; Morriss et al., 2006; Levinson et al., 2010; Otero-Sabogal et al., 2010; Cunico et al., 2012; Légaré et al., 2012). NET-PES was aimed to complement these established efforts by focusing on training engagement assessment measures particularly useful to identify the patients at high risk of disengagement ant to adapt the health professionals' relational strategies of the basis of the patients' priorities and engagement needs.
Consistent with prior studies about interventions aimed at educating providers on supporting patient activation and engagement (Greene et al., 2007; Lamiani et al., 2012; Barello et al., 2015a), our findings may indirectly suggest that this program might be potentially helpful to enhance patients' healthcare outcomes. From this perspective, previous studies have demonstrated a positive correlation between the patients' perception of their clinicians' support for autonomy in self-care and the patients' level of engagement in self-management behaviors and adherence to treatments (Graffigna et al., 2016). There are also studies that discussed the role of health practitioners' beliefs about the importance of patients being active agents in managing their health condition (Greene and Yedidia, 2005; Blakeman et al., 2006). The encouraging results of this study, unless preliminary, support the value of designing, and implementing educational initiatives dedicated to nurses among the actions to realize the patient engagement imperatives. In line with other experiences across countries, nurses may be envisaged as a powerful resource to promote organizational care models where this professional figure can absolve and foster the implementation of integrative approach to patient's care.
Despite the promising nature of these results, there are a number of limitations that warrant consideration. First, the use of pre-post design prohibits any inference of program effectiveness due to the lack of a comparison group and due the challenges to internal validity of this king of research design as suggested by Vockell and Asher (1995). Moreover the single site study limits results' generalizability. This study design—frequently adopted in research testing the feasibility and potential impact of educational interventions (Hulsman et al., 1999; Berger et al., 2010; Lamiani et al., 2011; Meyer et al., 2011; Bartels et al., 2013; Ledford et al., 2014; Arnold et al., 2015; Shah et al., 2015; Robinson et al., 2016; Viau et al., 2016) is appropriate for the demonstration of feasibility and for initial proof of concept, it is cost effective, and it is pragmatic because it allows for “real world” variability in variables. Consistent with the intent of a pilot study, our goal was to examine feasibility and potential impact. A determination of effectiveness will require a larger an appropriately selected sample, ideally employing a randomized controlled trial with follow-up measures to estimate the maintenance of achieved results across time. Finally, participants in our pilot study were recruited using a convenience sample. As attendees were largely self-selected, the surveyed group might be more open to reflection and self-improvement than a randomly selected group. Moreover, also the Hawthorne effect could have had an impact on the nurses' engagement behaviors. Hence, we are unable to generalize our findings to a different population of nurses. Also the clinicians' self-rating of self-efficacy and attitudes can be considered as a methodological weakness because of the risk of response bias. The nurses involved were not blinded to the intervention and the increase in their self-ratings can therefore reflect a willingness of the responders to show that the training course had been useful. Moreover, it should be noted that nurses' T0 scores were high in both CS-PAM and CC-PE (mean pre-training score = 3.43, SD = 0.45; mean post-training score = 3.68, SD = 0.31): this could be related to a self-selection bias because of voluntary participation and the risk of an over-representation of participants who believed in and supported patient engagement in care should not be completely neglected. Also, the majority of participants were women, and it is possible that men and women may respond differently to the program's stimuli: previous research on patient-centeredness has indeed demonstrated that gender may affect the attitudes of clinicians toward being more or less open to involve patients in the care process (Roter and Hall, 2004; Sandhu et al., 2009). More inquiry is needed to determine how nurses implement teaching principles in their practice and how patient-related factors may affect that implementation.
These findings provide preliminary evidences that a brief educational program designed to improve nurses' competences in promoting patient engagement is not only feasible, but holds promise toward potentially implementing this training in nursing educational curriculum. If proven in a future empirical trial, NET-PES program might provide a useful contribution to translate the principle of patient engagement from theories into actual practice.
Today's care models require nurses to play many different roles: these include providing high quality and compassionate nursing care; the ability to adopt a multidisciplinary perspective to the patients' care; partnering with patients and their families (Barello et al., 2014, 2015a); valuing the patients' perspective by collecting their care experience in an ecological way (Graffigna et al., 2011, 2015a). For these reasons, embracing a patient engagement care model and the necessary skills to enact it become vital components for the nurses' education. However, to effectively realize these goals, clinicians have to be provided with reliable measures to assess their patient engagement levels and trained to effectively use them. There is an increasing need to provide more resources for effective training in this area if patient engagement is to improve. Such initiatives are also essential to ensure the professional well-being of nurses themselves by valuing and recognizing their crucial role in addressing the challenges of the current healthcare environment. If demonstrated effective, learning programs teaching clinicians how to use and act on patient engagement measures in clinical practice might be a key steps in supporting the realization of patient engagement in healthcare (Barello et al., 2015a; Graffigna et al., 2016). Researchers and clinicians from different clinical areas should collaborate to share good practices and develop guidelines to advance the field of patient engagement and shift from theory into practice.
The concrete implementation of patient engagement interventions and the adoption of patient engagement measures is a dynamic and challenging process, in which different factors play a role at both individual (professional, patients, caregivers) and organizational levels. We focused here on nurse's training, but it is necessary to acknowledge the importance of other factors. First, patients and caregivers' trainings in gaining an active role in their care are of paramount importance for patient engagement successful implementation. Studies exploring patients and caregivers' attitudes clearly state that if their clinicians are open to patient's autonomy and self-care behaviors, this will encourage patients' active involvement in care (Graffigna and Barello, 2015b). Second, an organizational revision of care models (Bosio et al., 2012) and a pragmatic support for collecting and integrating patient engagement measurement into patient records and in the clinical workflow is a required step. Finally, using opinion leaders and specific organizational change strategies also appear pivotal to maximize the possibilities of innovation's adoption.
GG and SB developed the research design, coordinated data collection and wrote the manuscript. LP performed statistical analyses and give clinical supervision about the contents. GP, MM, and MC revising the work critically for important intellectual content. The authors have approved the article and agree to be accountable for all aspects of the work.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The authors are very grateful to the clinicians involved in the training who shared their experiences, insights and precious suggestions.
Arnold, R. M., Back, A. L., Barnato, A. E., Prendergast, T. J., Emlet, L. L., Karpov, I., et al. (2015). The critical care communication project: improving fellows' communication skills. J. Crit. Care 30, 250–254. doi: 10.1016/j.jcrc.2014.11.016
Barello, S., Graffigna, G., and Meyer, E. C. (2015a). Ethics and etiquette in neonatal intensive care: the value of parents' engagement in everyday ethics and recommendations for further advancing the field. JAMA Pediatr. 169:190. doi: 10.1001/jamapediatrics.2014.2958
Barello, S., Graffigna, G., and Savarese, M. (2014). Engaging patients in health management: towards a preliminary theoretical conceptualization. Psicologia della Salute 3, 11–33. doi: 10.3280/PDS2014-003002
Barello, S., Graffigna, G., Vegni, E., Savarese, M., Lombardi, F., and Bosio, A. C. (2015b). ‘Engage me in taking care of my heart’: a grounded theory study on patient–cardiologist relationship in the hospital management of heart failure. BMJ Open 5:e005582. doi: 10.1136/bmjopen-2014-005582
Bartels, S. J., Aschbrenner, K. A., Rolin, S. A., Hendrick, D. C., Naslund, J. A., and Faber, M. J. (2013). Activating older adults with serious mental illness for collaborative primary care visits. Psychiatr. Rehabil. J. 36, 278–288. doi: 10.1037/prj0000024
Berger, B., Steckelberg, A., Meyer, G., Kasper, J., and Mühlhauser, I. (2010). Training of patient and consumer representatives in the basic competencies of evidence-based medicine: a feasibility study. BMC Med. Educ. 10:1. doi: 10.1186/1472-6920-10-16
Bosio, C., Graffigna, G., and Scaratti, G. (2012). Knowing, learning and acting in health care organizations and services: challenges and opportunities for qualitative research. Qual. Res. Organ. Manage. 7, 256–274. doi: 10.1108/17465641211279743
Carman, K. L., Dardess, P., Maurer, M., Sofaer, S., Adams, K., Bechtel, C., et al. (2013). Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff. 32, 223–231. doi: 10.1377/hlthaff.2012.1133
Chan, D. K., Lonsdale, C., Ho, P. Y., Yung, P. S., and Chan, K. M. (2009). Patient motivation and adherence to post surgery rehabilitation exercise recommendations: the influence of physiotherapists' autonomy-supportive behaviors. Arch. Phys. Med. Rehabil. 90, 1977–1982. doi: 10.1016/j.apmr.2009.05.024
Cunico, L., Sartori, R., Marognolli, O., and Meneghini, A. M. (2012). Developing empathy in nursing students: a cohort longitudinal study. J. Clin. Nurs. 21, 2016–2025. doi: 10.1111/j.1365-2702.2012.04105.x
Eldh, A. C., Ehnfors, M., and Ekman, I. (2004). The phenomena of participation and non-participation in health care-experiences of patients attending a nurse-led clinic for chronic heart failure. Eur. J. Cardiovasc. Nurs. 3, 239–246. doi: 10.1016/j.ejcnurse.2004.05.001
Eldh, A. C., Ehnfors, M., and Ekman, I. (2006). The meaning of patient participation for patients and nurses at a nurse-led clinic for chronic heart failure. Eur. J. Cardiovasc. Nurs. 5, 45–53. doi: 10.1016/j.ejcnurse.2005.06.002
Fleuren, M., Wiefferink, K., and Paulussen, T. (2004). Determinants of innovation within health care organizations: literature review and Delphi study. Int. J. Qual. Health Care 16, 107–123. doi: 10.1093/intqhc/mzh030
Graffigna, G., and Barello, S. (2015a). “Modelling patient engagement in healthcare: Insight for research and pratice,” in Patient Engagement: A Consumer-Centered Model to Innovate Healthcare, eds G. Graffigna, S. Barello, and S. Triberti (Warsaw: De Gruyter Open), 27–43.
Graffigna, G., and Barello, S. (2016). “The value of measuring patient engagement in healthcare: new frontiers for healthcare quality,” in Promoting Patient Engagement and Participation for Effective Healthcare Reform, ed G. Graffigna (Hershey, PA: IGI Global), 192–214.
Graffigna, G., Barello, S., Bonanomi, A., and Lozza, E. (2015a). Measuring patient engagement: development and psychometric properties of the Patient Health Engagement (PHE) scale. Front. Psychol. 6:274. doi: 10.3389/fpsyg.2015.00274
Graffigna, G., Barello, S., Bonanomi, A., Lozza, E., and Hibbard, J. (2015b). Measuring patient activation in Italy: translation, adaptation and validation of the Italian version of the patient activation measure 13 (PAM13-I). BMC Med. Inform. Decis. Mak. 15:1. doi: 10.1186/s12911-015-0232-9
Graffigna, G., Barello, S., Bonanomi, A., and Menichetti, J. (2016). The motivating function of healthcare professional in eHealth and mHealth interventions for type 2 diabetes patients and the mediating role of patient engagement. J. Diabetes Res. 501:2974521. doi: 10.1155/2016/2974521
Graffigna, G., Barello, S., Libreri, C., and Bosio, C. A. (2014). How to engage type-2 diabetic patients in their own health management: implications for clinical practice. BMC Public Health 14:648. doi: 10.1186/1471-2458-14-648
Graffigna, G., Vegni, E., Barello, S., Olson, K., and Bosio, C. A. (2011). Studying the social construction of cancer-related fatigue experience: the heuristic value of Ethnoscience. Patient Educ. Couns. 82, 402–409. doi: 10.1016/j.pec.2010.12.017
Greene, J., Rogers, V. W., and Yedidia, M. J. (2007). The impact of implementing a chronic care residency training initiative on asthma outcomes. Acad Med. 82, 161–167. doi: 10.1097/ACM.0b013e31802d90ed
Greene, J., and Yedidia, M. J. (2005). Provider behaviours contributing to patient self-management of chronic illness among underserved populations. J. Health Care Poor Underserved 16, 808–824. doi: 10.1353/hpu.2005.0097
Gruman, J., Rovner, M. H., French, M. E., Jeffress, D., Sofaer, S., Shaller, D., et al. (2010). From patient education to patient engagement: implications for the field of patient education. Patient Educ. Couns. 78, 350–356. doi: 10.1016/j.pec.2010.02.002
Hibbard, J. H., Collins, P. A., Mahoney, E., and Baker, L. H. (2010). The development and testing of a measure assessing clinician beliefs about patient self-management. Health Expect. 13, 65–72. doi: 10.1111/j.1369-7625.2009.00571.x
Hibbard, J. H., and Greene, J. (2013). What the evidence shows about patient activation: better health outcomes and care experiences; fewer data on costs. Health Aff. 32, 207–214. doi: 10.1377/hlthaff.2012.1061
Hibbard, J. H., Greene, J., Sacks, R., Overton, V., and Parrotta, C. D. (2016). Adding a measure of patient self-management capability to risk assessment can improve prediction of high costs. Health Aff. 35, 489–494. doi: 10.1377/hlthaff.2015.1031
Hibbard, J. H., Mahoney, E. R., Stockard, J., and Tusler, M. (2005). Development and testing of a short form of the patient activation measure. Health Serv. Res. 40, 1918–1930. doi: 10.1111/j.1475-6773.2005.00438.x
Hulsman, R. L., Ros, W. J. G., Winnubst, J. A. M., and Bensing, J. M. (1999). Teaching clinically experienced physicians communication skills. A review of evaluation studies. Med. Educ. 33, 655–668. doi: 10.1046/j.1365-2923.1999.00519.x
International Council of Nurses (2010). Definition of Nursing. Available online at: http://www.icn.ch/about-icn/icn-definition-ofnursing/
Jerofke, T., Weiss, M., and Yakusheva, O. (2014). Patient perceptions of patient-empowering nurse behaviours, patient activation and functional health status in postsurgical patients with life-threatening long-term illnesses. J. Adv. Nurs. 70, 1310–1322. doi: 10.1111/jan.12286
Jordan, J. E., Briggs, A. M., Brand, C. A., and Osborne, R. H. (2008). Enhancing patient engagement in chronic disease self-management support initiatives in Australia: the need for an integrated approach. Med. J. Aust. 189, S9–S13.
Lamiani, G., Barello, S., Browning, D. M., Vegni, E., and Meyer, E. C. (2012). Uncovering and validating clinicians' experiential knowledge when facing difficult conversations: a cross-cultural perspective. Patient Educ. Couns. 87, 307–312. doi: 10.1016/j.pec.2011.11.012
Lamiani, G., Meyer, E. C., Leone, D., Vegni, E., Browning, D. M., Rider, E. A., et al. (2011). Cross-cultural adaptation of an innovative approach to learning about difficult conversations in healthcare. Med. Teach. 33, e57–e64. doi: 10.3109/0142159X.2011.534207
Lammon, C. A. B., Stanton, M. P., and Blakney, J. L. (2010). Innovative partnerships: the clinical nurse leader role in diverse clinical settings. J. Prof. Nurs. 26, 258–263. doi: 10.1016/j.profnurs.2010.06.004
Laschinger, H. K., Gilbert, S., Smith, L. M., and Leslie, K. (2010). Towards a comprehensive theory of nurse/patient empowerment: applying Kanter's empowerment theory to patient care. J. Nurs. Manage. 18, 4–13. doi: 10.1111/j.1365-2834.2009.01046.x
Ledford, C. J., Childress, M. A., Ledford, C. C., and Mundy, H. D. (2014). Refining the practice of prescribing: teaching physician learners how to talk to patients about a new prescription. J. Grad. Med. Educ. 6, 726–732. doi: 10.4300/JGME-D-14-00126.1
Légaré, F., Politi, M. C., Drolet, R., Desroches, S., Stacey, D., and Bekker, H. (2012). Training health professionals in shared decision-making: an international environmental scan. Patient Educ. Couns. 88, 159–169. doi: 10.1016/j.pec.2012.01.002
Lewis, K. B., Stacey, D., Squires, J. E., and Carroll, S. (2016). Shared decision-making models acknowledging an interprofessional approach: a theory analysis to inform nursing practice. Res Theor. Nurs Pract. 30, 26–43. doi: 10.1891/1541-6518.104.22.168
Meyer, E. C., Brodsky, D., Hansen, A. R., Lamiani, G., Sellers, D. E., and Browning, D. M. (2011). An interdisciplinary, family-focused approach to relational learning in neonatal intensive care. J. Perinatol. 31, 212–219. doi: 10.1038/jp.2010.109
Morath, J., and Braaten, C. J. S. (2016). “Nurses create reliable care by advancing patient engagement,” in High Reliability Organizations: A Healthcare Handbook for Patient Safety & Quality, eds C. Oster and J. Braaten (Indianapolis, IN: Sigma Theta Tau International), 235–252.
Morriss, R., Dowrick, C., Salmon, P., Peters, S., Rogers, A., Dunn, G., et al. (2006). Turning theory into practice: rationale, feasibility and external validity of an exploratory randomized controlled trial of training family practitioners in reattribution to manage patients with medically unexplained symptoms (the MUST). Gen. Hosp. Psychiatry 28, 343–351. doi: 10.1016/j.genhosppsych.2006.03.012
Mosen, D. M., Schmittdiel, J., Hibbard, J., Sobel, D., Remmers, C., and Bellows, J. (2007). Is patient activation associated with outcomes of care for adults with chronic conditions? J. Ambul. Care Manage. 30, 21–29. doi: 10.1097/00004479-200701000-00005
Naylor, M. D., Aiken, L. H., Kurtzman, E. T., Olds, D. M., and Hirschman, K. B. (2011). The importance of transitional care in achieving health reform. Health Aff. 30, 746–754. doi: 10.1377/hlthaff.2011.0041
Otero-Sabogal, R., Arretz, D., Siebold, S., Hallen, E., Lee, R., Ketchel, A., et al. (2010). Physician–community health worker partnering to support diabetes self-management in primary care. Qual. Prim. Care 18, 363–372.
Pelletier, L. R., and Stichler, J. F. (2013). Action brief: patient engagement and activation: a health reform imperative and improvement opportunity for nursing. Nurs. Outlook 61, 51–54. doi: 10.1016/j.outlook.2012.11.003
Provenzi, L., Borgatti, R., Menozzi, G., and Montirosso, R. (2015). A dynamic system analysis of dyadic flexibility and stability across the Face-to-Face Still-Face procedure: application of the State Space Grid. Infant Behav. Dev. 38, 1–10. doi: 10.1016/j.infbeh.2014.10.001
Rademakers, J., Jansen, D., van der Hoek, L., and Heijmans, M. (2015). Clinicians' beliefs and attitudes toward patient self-management in the Netherlands; translation and testing of the American Clinician Support for Patient Activation Measure (CS-PAM). BMC Health Serv. Res. 15:138. doi: 10.1186/s12913-015-0799-y
Rasmussen, B., Wellard, S. J., and Nankervis, A. (2001). Consumer issues in navigating health care services for people with Type 1 diabetes. J. Clin. Nurs. 10, 628–634. doi: 10.1046/j.1365-2702.2001.00550.x
Remmers, C., Hibbard, J., Mosen, D. M., Wagenfield, M., Hoye, R. E., and Jones, C. (2009). Is patient activation associated with future health outcomes and healthcare utilization among patients with diabetes? J. Ambul. Care Manage. 32, 320–327. doi: 10.1097/JAC.0b013e3181ba6e77
Roberts, N. J., Kidd, L., Dougall, N., Patel, I. S., McNarry, S., and Nixon, C. (2016). Measuring patient activation: the utility of the patient activation measure within a uk context—results from four exemplar studies and potential future applications. Patient Educ. Couns. 99, 1739–1746. doi: 10.1016/j.pec.2016.05.006
Robinson, M. R., Thiel, M. M., Shirkey, K., Zurakowski, D., and Meyer, E. C. (2016). Efficacy of training interprofessional spiritual care generalists. J. Palliat. Med. 19, 814–821. doi: 10.1089/jpm.2015.0373
Roter, D. L., and Hall, J. A. (2004). Physician gender and patient-centered communication: a critical review of empirical research. Annu. Rev. Public Health 25, 497–519. doi: 10.1146/annurev.publhealth.25.101802.123134
Sahlsten, M. J., Larsson, I. E., Sjöström, B., Lindencrona, C. S., and Plos, K. A. (2007). Patient participation in nursing care: towards a concept clarification from a nurse perspective. J. Clin. Nurs. 16, 630–637. doi: 10.1111/j.1365-2702.2006.01660.x
Sandhu, H., Adams, A., Singleton, L., Clark-Carter, D., and Kidd, J. (2009). The impact of gender dyads on doctor–patient communication: a systematic review. Patient Educ. Couns. 76, 348–355. doi: 10.1016/j.pec.2009.07.010
Schmidt, K., Gensichen, J., Petersen, J. J., Szecsenyi, J., Walther, M., Williams, G., et al. (2012). Autonomy support in primary care—validation of the German version of the Health Care Climate Questionnaire. J. Clin. Epidemiol. 65, 206–211. doi: 10.1016/j.jclinepi.2011.06.003
Shah, V. O., Carroll, C., Mals, R., Ghahate, D., Bobelu, J., Sandy, P., et al. (2015). A home-based educational intervention improves patient activation measures and diabetes health indicators among Zuni Indians. PLoS ONE 10:e0125820. doi: 10.1371/journal.pone.0125820
Simmons, L. A., Wolever, R. Q., Bechard, E. M., and Snyderman, R. (2014). Patient engagement as a risk factor in personalized health care: a systematic review of the literature on chronic disease. Genome Med. 6:16. doi: 10.1186/gm533
Solomon, M. Z., Gusmano, M. K., and Maschke, K. J. (2016). The ethical imperative and moral challenges of engaging patients and the public with evidence. Health Aff. 35, 583–589. doi: 10.1377/hlthaff.2015.1392
Thomson, R., Murtagh, M., and Khaw, F. M. (2005). Tensions in public health policy: patient engagement, evidence-based public health and health inequalities. Qual. Saf. Health Care 14, 398–400. doi: 10.1136/qshc.2005.014175
Tobiano, G., Bucknall, T., Marshall, A., Guinane, J., and Chaboyer, W. (2015). Patients' perceptions of participation in nursing care on medical wards. Scand. J. Caring Sci. 30, 260–270. doi: 10.1111/scs.12237
Viau, K. S., Jones, J. L., Murtaugh, M. A., Gren, L. H., Stanford, J. B., and Bilder, D. A. (2016). Phone-based motivational interviewing to increase self-efficacy in individuals with phenylketonuria. Mol. Genet. Metab. Rep. 6, 27–33. doi: 10.1016/j.ymgmr.2016.01.002
Vogeli, C., Shields, A. E., Lee, T. A., Gibson, T. B., Marder, W. D., Weiss, K. B., et al. (2007). Multiple chronic conditions: prevalence, health consequences, and implications for quality, care management, and costs. J. Gen. Intern. Med. 22, 391–395. doi: 10.1007/s11606-007-0322-1
Washington, A. E., and Lipstein, S. H. (2011). The Patient-Centered Outcomes Research Institute—promoting better information, decisions, and health. N. Engl. J. Med. 365:e31. doi: 10.1056/NEJMp1109407
Wellard, S., Lillibridge, J., Beanland, C., and Lewis, M. (2003). Consumer participation in acute care settings: an Australian experience. Int. J. Nurs. Pract. 9, 255–260. doi: 10.1046/j.1440-172X.2003.00429.x
Wellard, S. J., and Rushton, C. (2002). Influences of spatial practices on pressure ulcer management in the context of spinal cord injury. Int. J. Nurs. Pract. 8, 221–227. doi: 10.1046/j.1440-172X.2002.00367.x
Keywords: patient engagement, patient engagement measurement, nursing staff, hospital, professional-patient relation, empowerment, educational program, patient activation
Citation: Barello S, Graffigna G, Pitacco G, Mislej M, Cortale M and Provenzi L (2017) An Educational Intervention to Train Professional Nurses in Promoting Patient Engagement: A Pilot Feasibility Study. Front. Psychol. 7:2020. doi: 10.3389/fpsyg.2016.02020
Received: 29 June 2016; Accepted: 12 December 2016;
Published: 10 January 2017.
Edited by:Guenter Karl Schiepek, Paracelsus Medical University (PMU), Austria
Reviewed by:Suzie Xu Wang, Leeds Beckett University, UK
C. P. H. Myburgh, University of Johannesburg, South Africa
Copyright © 2017 Barello, Graffigna, Pitacco, Mislej, Cortale and Provenzi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Serena Barello, email@example.com