Midwives' Evaluation of a Neonatal Resuscitation in High- and Low-Resource Settings
Francesco Cavallin1 
Serena Calgaro2,3* 
Martina Borellini2,3 
Margherita Magnani2,3 Greta Beltramini3 Amir Hussein Abubacar Seni4 Bonifacio Rodriguez Cebola4 Ana Nicolau Tambo4 
Giovanni Putoto5 Daniele Trevisanuto3- 1Independent Statistician, Solagna, Italy
- 2Doctors With Africa Collegio Universitario Aspiranti Medici Missionari, Beira, Mozambique
- 3Department of Woman's and Child's Health, University of Padua, Padua, Italy
- 4Department of Pediatrics, Beira Central Hospital, Beira, Mozambique
- 5Doctors With Africa Collegio Universitario Aspiranti Medici Missionari, Padua, Italy
Aim: To assess midwives' evaluation of a real-life neonatal resuscitation and their opinion on importance of resuscitation interventions.
Methods: Multicenter, multi-country study.
Setting: Beira Central Hospital (Mozambique) and Azienda Ospedale-Università di Padova (Italy).
Subjects: Sixteen Mozambican midwives and 18 Italian midwives.
Interventions: Midwives' assessment was evaluated by using a predefined score, which graded each resuscitation intervention (0–2 points) and summed to a total score for each step (initial steps, bag-mask ventilation, and chest compressions). All scores were compared with referral scores given by two expert neonatologists.
Results: Both Mozambican and Italian midwives overestimated their performance regarding of initial steps taken during resuscitation, chest compressions, high-oxygen concentrations (p < 0.01), and underestimated the importance of stimulation (p < 0.05). Mozambicans overestimated suctioning (p < 0.001). Participants agreed with experts about the importance of equipment preparation, using a warmer, drying the newborn, removing wet linen and heart rate assessment.
Conclusion: Mozambican and Italian midwives overestimated the performance of a real-life neonatal resuscitation, with heterogeneous evaluation of the importance of several aspects of neonatal resuscitation. These findings may be useful for identifying educational goals.
Introduction
Globally, 2.5 million newborns died in 2018, accounting for 47% of under-5 child mortality. Around 75% of neonatal deaths occurred during the first week of life, including 1 million newborns who died within the first 24 h (1, 2). The reduction of neonatal mortality in low-income countries represents a global health priority, with Sub-Saharan Africa displaying the highest neonatal mortality rate worldwide (28 deaths per 1,000 live births) (1, 2).
About one out of four neonatal deaths is related to intrapartum-related events (2), hence interventions focusing on perinatal period can contribute to the reduction of neonatal mortality. Education in neonatal resuscitation for all health workers who are involved in the management of the newborn at birth plays an important role in improving neonatal survival (3). However, implementation of training programs in neonatal resuscitation resulted in limited impact on technical and non-technical skills, and clinical outcomes in low-income settings (4–6). While great efforts have been dedicated in developing neonatal resuscitation training programs (7, 8), understanding the best approach to ensure and maintain adequate skill levels requires further research (9). In high-income settings, high-frequency/low-dose training combined with performance-debriefings using video recordings showed some benefits in clinical outcomes as well as adherence to algorithm of neonatal resuscitation (10).
Beyond advantages in performance-debriefings, video recordings may be useful in understanding how healthcare providers evaluate performance of their peers during actual resuscitation procedures. We speculate that knowledge on this aspect may help trainers in identifying areas of improvement and educational goals. This study aimed to assess how Mozambican and Italian midwives evaluated performance of their peer during real-life neonatal resuscitations. In addition, their opinions on importance of resuscitation interventions were investigated.
Materials and Methods
Study Design
This multicenter, multicountry study investigated (i) how Mozambican and Italian midwives assess a real-life video on neonatal resuscitations and (ii) their opinion on importance of resuscitation interventions.
Participants and Settings
All 16 Mozambican midwives working at Beira Central Hospital (Mozambique) and all 18 Italian midwives working at Azienda Ospedaliera-Università di Padova (Italy) participated in the study. Beira Central Hospital is the referral hospital of the province of Sofala, Mozambique. In this hospital, about 5,000 deliveries occur every year and midwives are responsible for immediate postnatal care of all neonates, including resuscitation. Azienda Ospedaliera-Università di Padova is a referral hospital in North-Eastern Italy. In this hospital, about 3,000 deliveries occur every year and midwives are responsible for immediate postnatal care in low-risk deliveries. Both hospitals have the same neonatal resuscitation algorithm (NRP) apart from intubation and medications (7).
Assessment of Neonatal Resuscitation
Participants were asked to evaluate the performance of a neonatal resuscitation by reviewing the video recording.
The video showed an African full-term newborn with severe asphyxia requiring full resuscitation (initial steps, bag-mask ventilation and chest compressions), which was performed by a local midwife at Beira Central Hospital. This video was chosen from a video collection used in a previous study (4) because it displayed all phases of neonatal resuscitation. The identity of the midwife performing the resuscitation was protected, as the video displayed only the baby and the hands of the resuscitating provider.
Participants were instructed to evaluate the performance using a pre-defined composite score, which was described elsewhere (4). Briefly, two points were awarded for every correct decision and for every procedure that was performed properly. One point was awarded if the intervention was delayed or the technique for a given procedure was inadequate. No points were awarded for indicated procedures that were omitted or for performed procedures that were not indicated. When a step was anticipated due to skipping of the previous step, the first step was scored 0 and the following one was scored 2. When a step was delayed despite skipping the previous step, the first step was scored 0 and the following one was scored 1 (Supplementary Material). This approach allowed discriminating these different scenarios, thus leading to a more detailed score of the entire performance. Points were summed to obtain a total score for each level of resuscitation (initial steps, bag-mask ventilation and chest compressions). Scores by participants were compared with referral scores given by two neonatologists expert in neonatal resuscitation (DT, SC).
Opinions on Importance of Resuscitation Interventions
Participants were asked to fill out a written form about the importance of each aspect of neonatal resuscitation. The form included 13 items on both technical and non-technical skills, each of them was scored as: 0) not important, 1) fairly important, 2) important, and 3) very important. Scores by participants were compared with referral scores given by two neonatologists expert in neonatal resuscitation (DT, SC).
Statistical Analysis
Continuous data were expressed as median and interquartile range (IQR), and categorical data as number and percentage. Participant characteristics were compared between Mozambican and Italian midwives using Mann-Whitney-test (continuous data) or Fisher's exact-test (categorical data). Scores by participants were reported as score difference by subtracting the referral score for each item. Score differences were evaluated using Wilcoxon signed rank-test within Mozambican and Italian midwives, and compared between Mozambican and Italian midwives using Mann-Whitney-test. All tests were 2-sided and a p-value lower than 0.05 was considered statistically significant. Statistical analysis was performed using R 3.5 (R Foundation for Statistical Computing, Vienna, Austria) (11).
Ethics Committee Approval
The study was approved by the National Committee of Bioethics (Ref. 315/CNBS/13; November 1, 2013) and by the Minister of Health of the Republic of Mozambique (Ref. 08/GMS/002/2014; January 7, 2014) and by the Hospital Management of the Beira Central Hospital (August 18, 2020), and by the Ethics Committee of University of Padua (Prot. n. 0021324 del 1/4/2020). Before delivery, parents gave their consent to obtain video recordings of neonatal delivery room management and to use the data for scientific purpose (4). Written consent was obtained by participants.
Results
Participants
The study included 34 midwives (18 Italians and 16 Mozambican). Participant characteristics are shown in Table 1. Italian midwives were older and more experienced than Mozambican midwives (Table 1). All 18 Italian midwives (100%) and 11 Mozambican midwives (69%) participated in a previous course on neonatal resuscitation (Table 1).
Table 1. Participant characteristics.
Evaluation of Real-Life Neonatal Resuscitation Using Video Review
Table 2 shows the evaluation by Mozambican and Italian midwives (as compared to the evaluation by two experts in neonatal resuscitation) of the performance of a neonatal resuscitation. Both groups overestimated the performance regarding initial steps (p = 0.0007 and p = 0.004, respectively) and chest compressions (p = 0.009 and p = 0.009, respectively), with larger overestimation in Mozambican vs. Italian midwives (initial steps p = 0.0009 and chest compressions p = 0.03). Moreover, Mozambican midwives overestimated the performance regarding bag-mask ventilation (p = 0.009).
Table 2. Evaluation of the performance of a neonatal resuscitation by reviewing a video showing an African full-term newborn with severe asphyxia requiring full resuscitation (initial steps, bag-mask ventilation and chest compressions), which was performed by a local midwife at Beira Central Hospital.
Importance of Resuscitation Interventions
Table 3 and Figure 1 report the importance of resuscitation interventions according to Mozambican and Italian midwives (as compared to importance according to two experts in neonatal resuscitation).
Table 3. Importance of resuscitation interventions according to Mozambican and Italian midwives (as compared to importance according to two experts in neonatal resuscitation).
Figure 1. Overlook of importance of resuscitation interventions according to Mozambican (MO) midwives and Italian (IT) midwives (as compared to importance according to two experts in neonatal resuscitation). Resuscitation interventions: (A) preparation of equipment, (B) weighing the newborn, (C) giving high-oxygen concentrations, (D) putting the newborn under infant warmer, (E) drying the newborn, (F) removing wet linen, (G) suctioning, (H) stimulation, (I) heart rate assessment, (J) bag-mask ventilation, (K) chest compressions, (L) interventions based on priorities, and (M) adherence to steps of neonatal resuscitations.
Both groups overestimated the importance of weighing the newborn (p = 0.0004 and p = 0.04, respectively) and giving high-oxygen concentrations (p = 0.0003 and p = 0.005, respectively), with larger overestimation in Mozambican vs. Italian midwives (weighing the newborn p < 0.0001 and giving high-oxygen concentrations p = 0.004).
Both groups overestimated the importance of chest compressions (p = 0.0003 and p = 0.0003, respectively), with similar magnitude (p = 0.52).
Mozambican midwives overestimated the importance of suctioning (p = 0.0003).
Both groups underestimated the importance of stimulation (p = 0.01 and p = 0.03, respectively), with similar magnitude (p = 0.65).
Italian midwives underestimated the importance of bag-mask ventilation (p = 0.04), while Mozambican midwives underestimated the importance of interventions based on priorities (p = 0.01) and adherence to steps of neonatal resuscitations (p = 0.006).
Both groups gave adequate importance to preparation of equipment, putting the newborn under infant warmer, drying the newborn, removing wet linen and heart rate assessment (Table 3).
Discussion
In our study, midwives were prone to overestimate resuscitation performance of their peer regarding initial steps and chest compressions, with more generous evaluation by Mozambican than Italian midwives. Mozambican midwives also overestimated the performance regarding bag-mask ventilation. Furthermore, the importance of some aspects of neonatal resuscitation were overestimated (weighing the newborn, giving high-oxygen concentrations, suctioning, and chest compressions), while others were underestimated (stimulation, interventions based on priorities and adherence to steps of neonatal resuscitations), with some differences between Mozambican and Italian midwives.
The strengths of this study include the use of video recording displaying extensive neonatal resuscitation performed by a local midwife, the participation of all midwives in the two hospitals, and the use of a pre-defined score (4, 12). This study has also some limitations that should be consider when reading the results. First, the number of participants was limited, despite the inclusion of the entire staff. Second, the assessment was limited to only one video, which was chosen to show an extensive neonatal resuscitation. Third, adjustment for multiple testing was not performed due to the exploratory—rather than confirmatory—nature of the study, thus increasing the likelihood of false positive results. Fourth, some aspects of neonatal resuscitation (such as intubation and teamwork) were not investigated because they were not performed at Beira Central Hospital.
Worldwide, neonatal care at birth is entrusted to millions of healthcare providers who must acquire—but also maintain over time—a complex set of technical and non-technical skills (13). Since the most effective educational strategy to ensure and maintain adequate cognitive, technical, and behavioral skills is still unclear (9, 13), identifying weaknesses and misbelieves of healthcare providers can help trainers in selecting educational goals. When reviewing a videorecording of real-life neonatal resuscitation performed by a peer, midwives tended to overestimate the quality of resuscitation procedures, thus revealing a limited perception of the quality of such procedures. Of note, Mozambican midwives were more generous than Italian midwives, which might mirror the difference in experience and education on neonatal resuscitation in the two settings. Despite the implementation of training programs on neonatal resuscitation, our results revealed limited knowledge and awareness of the correct application of the procedures. These findings were consistent with recognized knowledge gaps about the most effective training programs in high-, middle- and low-resource settings (9, 13–15).
To provide a deeper understanding of their evaluation, midwives were also asked to rate the importance of each aspect of neonatal resuscitation. Some aspects (giving high-oxygen concentrations, suctioning, and chest compressions) were considered more relevant than their actual importance, as they have recently received less consideration in international guidelines (8, 13). In addition, weighing the newborn has the potential risk of delaying life-saving interventions (such as initiation of positive pressure ventilation). Adherence to resuscitation guidelines and interventions based on priorities are considered key elements in emergency situations (13, 16) but were considered less important by Mozambican midwives. Giving adequate importance to each aspect of neonatal resuscitation is part of a set of abilities (so-called “behavioral skills”) that are not strictly included in medical knowledge and manual skills, but are required to effectively manage emergency situations (17). Although neonatal resuscitation programs (i.e., NRP and HBB) bestow no considerations about behavioral skills (7, 8), there is a growing interest in developing such skills as vector for enhancing the transfer of theoretical knowledge and skills into clinical practice (9, 17–19). Overall, our findings offer interesting information that could be helpful in targeting goals for training programs on neonatal resuscitation in both high- and low-resource settings. This study also offers a novel idea of testing the knowledge of midwives in order to improve their training. This approach can be implemented in future studies including more videos from different centers and more independent reviewers.
In conclusion, Mozambican and Italian midwives overestimated the performance of a real-life neonatal resuscitation using video recording. When asked to score the importance of some aspects of neonatal resuscitation, they deviated from the scores given by experts in neonatal resuscitation in several important aspects. These findings highlighted the opportunity of focus in on the so-called “behavioral skills” during training programs in order to transfer theoretical knowledge and skills into clinical practice.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The study was approved by the National Committee of Bioethics (Ref. 315/CNBS/13; November 1, 2013) and by the Minister of Health of the Republic of Mozambique (Ref. 08/GMS/002/2014; January 7, 2014) and by the Hospital Management of the Beira Central Hospital (August 18, 2020), and by the Ethics Committee of University of Padua (Prot. n. 0021324 del 1/4/2020). Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.
Author Contributions
FC performed the statistical analysis, contributed to data interpretation, writing of the manuscript, and critically reviewed the manuscript. SC, MB, and MM performed the literature review, collected the data in Mozambique, contributed to data interpretation, drafted the initial manuscript, and critically reviewed the manuscript. GB performed the literature review, collected the data in Italy, contributed to data interpretation, and critically reviewed the manuscript. AS, AT, and BC contributed to the collection of data in Mozambique, contributed to data interpretation and critically reviewed the manuscript. GP and DT conceptualized the study, contributed to data interpretation, and writing of the manuscript and critically reviewed the manuscript. All authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fped.2021.644308/full#supplementary-material
References
1. World Health Organization.Newborn: reducing mortality. (2019). Available online at: https://www.who.int/news-room/fact-sheets/detail/newborns-reducing-mortality (accessed October 21, 2020).
2. United Nations Children's Fund. Levels and Trends in Child Mortality 2019. Estimates Developed by the UN Interagency Group for Child Mortality Estimation. (2019). Available online at: https://www.unicef.org/media/60561/file/UN-IGME-child-mortality-report-2019.pdf (accessed October 20, 2019).
3. World Health Organization. Pregnancy, Childbirth, Postpartum and Newborn Care: A Guide for Essential Practice. 3rd ed. Geneva: World Health Organization (2015).
4. Cavicchiolo ME, Cavallin F, Bertuola F, Pizzol D, Segafredo G, Wingi OM, et al. Effect of a low-dose/high-frequency training on real-life neonatal resuscitation in a low-resource setting. Neonatology. (2018) 114:294–302. doi: 10.1159/000490370
5. Cavicchiolo ME, Cavallin F, Staffler A, Pizzol D, Matediana E, Wingi OM, et al. Decision making and situational awareness in neonatal resuscitation in low resource settings. Resuscitation. (2019) 134:41–8. doi: 10.1016/j.resuscitation.2018.10.034
6. Ersdal HL, Vossius C, Bayo E, Mduma E, Perlman J, Lippert A, et al. A one-day “Helping Babies Breathe” course improves simulated performance but not clinical management of neonates. Resuscitation. (2013) 84:1422–7. doi: 10.1016/j.resuscitation.2013.04.005
7. American Academy of Pediatrics. Neonatal Resuscitation Program. (2020). Available online at: https://www.aap.org/en-us/continuing-medical-education/life-support/NRP/Pages/NRP.aspx (accessed December 15, 2020).
8. American Academy of Pediatrics. Helping Babies Breathe Program. (2020). Available online at: https://www.aap.org/en-us/advocacy-and-policy/aap-health-initiatives/helping-babies-survive/Pages/Helping-Babies-Breathe.aspx (accessed December 15, 2020).
9. Ehret DY, Patterson JK, Bose CL. Improving neonatal care: a global perspective. Clin Perinatol. (2017) 44:567–82. doi: 10.1016/j.clp.2017.05.002
10. Skåre C, Boldingh AM, Kramer-Johansen J, Calisch TE, Nakstad B, Nadkarni V, et al. Video performance-debriefings and ventilation-refreshers improve quality of neonatal resuscitation. Resuscitation. (2018) 132:140–6. doi: 10.1016/j.resuscitation.2018.07.013
11. R Core Team. R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing (2019).
12. Trevisanuto D, Bertuola F, Lanzoni P, Cavallin F, Matediana E, Manzungu OW, et al. Effect of a neonatal resuscitation course on healthcare providers' performances assessed by video recording in a low-resource setting. PLoS ONE. (2015) 10:e0144443. doi: 10.1371/journal.pone.0144443
13. Perlman JM, Wyllie J, Kattwinkel J, Wyckoff MH, Aziz K, Guinsburg R, et al. Part 7: neonatal resuscitation: 2015 international consensus on cardiopulmonary resuscitation and emergency cardiovascular care science with treatment recommendations. Circulation. (2015) 132(Suppl. 1):S204–41. doi: 10.1161/CIR.0000000000000276
14. Umphrey L, Breindahl M, Brown A, Saugstad OD, Thio M, Trevisanuto D, et al. When helping babies breathe is not enough: designing a novel, mid-level neonatal resuscitation algorithm for médecins sans frontières field teams working in low-resource hospital settings. Neonatology. (2018) 114:112–23. doi: 10.1159/000486705
15. Dempsey E, Pammi M, Ryan AC, Barrington KJ. Standardised formal resuscitation training programmes for reducing mortality and morbidity in newborn infants. Cochrane Database Syst Rev. (2015) 9:CD009106. doi: 10.1002/14651858.CD009106.pub2
16. Sawyer T, Henry C, Lee HC, Aziz K. Anticipation and preparation for every delivery room resuscitation. Semin Fetal Neonatal Med. (2018) 23:312–20. doi: 10.1016/j.siny.2018.06.004
17. Halamek LP, Cady RAH, Sterling MR. Using briefing, simulation and debriefing to improve human and system performance. Semin Perinatol. (2019) 43:151178. doi: 10.1053/j.semperi.2019.08.007
18. Reisman J, Arlington L, Jensen L, Louis H, Suarez-Rebling D, Nelson BD. Newborn resuscitation training in resource-limited settings: a systematic literature review. Pediatrics. (2016) 138:e20154490. doi: 10.1542/peds.2015-4490
19. Yamada N, Stave C, Fawke J. Use of Briefing and Debriefing in Neonatal Resuscitation (NLS 1562 Briefing/Debriefing). Brussels, Belgium: International Liaison Committee on Resuscitation (ILCOR) Neonatal Life Support Task Force, 2020 Feb 5. Effect of Briefing and Debriefing Following Neonatal Resuscitation on Patient/Clinician/Parent Outcomes (NLS #1562): Scoping Review (2020). Available online at: https:// www.ilcor.org (accessed December 15, 2020).
Keywords: midwife, neonatal resuscitation, video-recording, Mozambique, Italy
Citation: Cavallin F, Calgaro S, Borellini M, Magnani M, Beltramini G, Seni AHA, Cebola BR, Tambo AN, Putoto G and Trevisanuto D (2021) Midwives' Evaluation of a Neonatal Resuscitation in High- and Low-Resource Settings. Front. Pediatr. 9:644308. doi: 10.3389/fped.2021.644308
Received: 20 December 2020; Accepted: 09 February 2021;
Published: 09 March 2021.
Edited by:
Maximo Vento, La Fe Hospital, SpainReviewed by:
Jeroen Johannes van Vonderen, Leiden University Medical Center, NetherlandsJennifer A. Dawson, Royal Women's Hospital, Australia
Copyright © 2021 Cavallin, Calgaro, Borellini, Magnani, Beltramini, Seni, Cebola, Tambo, Putoto and Trevisanuto. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Serena Calgaro, serena.calgaro@gmail.com