Eliane Timm-Holzer1*
Franziska Tschan1*Sandra Keller1,2Norbert K. Semmer3Jasmin Zimmermann1
Simon A. Huber3
Martin Hübner4
Daniel Candinas2Nicolas Demartines4Markus Weber5Guido Beldi2*- 1Institute for Work and Organizational Psychology, University of Neuchâtel, Neuchâtel, Switzerland
- 2Department of Visceral Surgery and Medicine, Berne University Hospital, University of Berne, Berne, Switzerland
- 3Department of Psychology, University of Berne, Berne, Switzerland
- 4Department of Visceral Surgery, University Hospital Lausanne (CHUV), Lausanne, Switzerland
- 5Department of Surgery, Triemli Hospital, Zurich, Switzerland
Background: The team timeout (TTO) is a safety checklist to be performed by the surgical team prior to incision. Exchange of critical information is, however, important not only before but also during an operation and members of surgical teams frequently feel insufficiently informed by the operating surgeon about the ongoing procedure. To improve the exchange of critical information during surgery, the StOP?-protocol was developed: At appropriate moments during the procedure, the leading surgeon briefly interrupts the operation and informs the team about the current Status (St) and next steps/objectives (O) of the operation, as well as possible Problems (P), and encourages questions of other team members (?). The StOP?-protocol draws attention to the team. Anticipating the occurrence of StOP?-protocols may support awareness of team processes and quality issues from the beginning and thus support other interventions such as the TTO; however, it also may signal an additional demand and contribute to a phenomenon akin to “checklist fatigue.” We investigated if, and how, the introduction of the StOP?-protocol influenced TTO quality.
Methods: This was a prospective intervention study employing a pre-post design. In the visceral surgical departments of two university hospitals and one urban hospital the quality of 356 timeouts (out of 371 included operation) was assessed by external observers before (154) and after (202) the introduction of the StOP?-briefing. Timeout quality was rated in terms of timeout completeness (number of checklist items mentioned) and timeout quality (engagement, pace, social atmosphere, noise).
Results: As compared to the baseline, after the implementation of the StOP?-protocol, observed timeouts had higher completeness ratings (F = 8.69, p = 0.003) and were rated by observers as higher in engagement (F = 13.48, p < 0.001), less rushed (F = 14.85, p < 0.001), in a better social atmosphere (F = 5.83, p < 0.016) and less noisy (F = 5.35, p < 0.022).
Conclusion: Aspects of TTO are affected by the anticipation of StOP?-protocols. However, rather than harming the timeout goals by inducing “checklist fatigue,” it increases completeness and quality of the team timeout.
1. Introduction
Besides technical and medical proficiency, teamwork and communication within surgical teams have been identified as crucial factors that impact the surgical process and outcomes (Mazzocco et al., 2009; Sun et al., 2018; Paterson-Brown et al., 2019). In operation rooms (OR), establishing good teamwork is particularly challenging: During surgery, professionals with complementary roles must collaborate. At the operating table, two or more surgeons have to cooperate very closely with each other and with the scrub technician who provides instruments. Anesthesia providers ensure that the patient remains under anesthesia and stable; they often work in parallel with the surgeons, sometimes having to synchronize very closely with them. Circulators are responsible for taking and bringing instruments to the operating table, while also performing administrative duties in parallel with the operation. Because of the different tasks, roles, and perspectives of the team members during an operation, maintaining a shared mental model and high situation awareness may be difficult (Graafland et al., 2015; Afkari et al., 2016). Other challenges to good teamwork in the OR are the notoriously high noise levels which may hamper communication (Keller et al., 2016; Leitsmann et al., 2021), low team familiarity (Kurmann et al., 2014; Stucky et al., 2021) and strong hierarchies, which may hamper psychological safety and diminish speaking up (Appelbaum et al., 2020).
Therefore, interventions have been introduced that aim at fostering better teamwork and communication in the OR (McCulloch et al., 2017; Sun et al., 2018). The best known and nowadays routinely followed intervention is the team-timeout which is part of the WHO surgical safety checklists. The team timeout (TTO) is performed before the operative procedure starts. It has the objective to ensure that OR team members are on the same page about the procedure to be performed and contains checklist items to confirm important information (Haynes et al., 2009). In addition to the team-timeout, other team-related interventions may be employed (McCulloch et al., 2017), such as CRM training, Sun et al. (2018), other checklists (Lyons and Popejoy, 2014), or the StOP?-protocol intraoperative briefing (Tschan et al., 2022) used in the present study.
If multiple interventions are combined or an intervention is added to an existing practice, an important question is whether interventions influence each other. Although there are indications that different team-related interventions may be favorably combined (Buljac-Samardzic et al., 2010; McCulloch et al., 2017) or positively influence one another (Okhuysen and Eisenhardt, 2002), interferences between interventions may also be possible. An example is the tendency to become complacent or even opposed to the use of multiple checklists or interventions, described as “checklist fatigue” (Grigg, 2015).
However, it has rarely been investigated empirically if, and how, interventions influence each other (Buljac-Samardzic et al., 2010). In this prospective observational study using a pre-post design, we evaluate the impact of the introduction of an intraoperative briefing (the StOP?-protocol) on the quality of an already existing briefing (the team-timeout) in surgical departments of three different hospitals.
1.1. The team timeout checklist intervention
In 2008, the World Health Organization (WHO) recommended checklist-based team briefings as a standard for surgical teams worldwide (Haynes et al., 2009). These briefings aim to reduce errors and enhance communication and teamwork. One of the recommended briefings is the team timeout (TTO), conducted at the time the patient is anesthetized and prepared, but just before incision. The minimal standard of the TTO includes presentation of all team members, confirming patient identity, surgical procedure, site of incision, and availability of critical images. Surgeons, anesthesia providers and the nursing team inform about anticipated critical events, and the approximate surgery duration is communicated.
In Switzerland, the TTO is not mandatory by law, but it has been adopted by most hospitals (Mascherek et al., 2013; Fridrich et al., 2022); including in the three hospitals participating in this study. Although the WHO suggests which aspects should be discussed during the TTO, it also recommends that the procedure should be adapted for each hospital, indicating that differences between hospital cultures may be important.
The surgical safety checklist (including the TTO) has been related to improved patient outcomes, Haugen et al. (2019), such as reduced negative events, morbidity, and mortality (Lyons and Popejoy, 2014; Haynes et al., 2017; Abbott et al., 2018), and improved team outcomes, including better coordination and communication (Kearns et al., 2011; Molina et al., 2016). Note that not all studies found positive effects (Urbach et al., 2014; Reames et al., 2015).
However, the effectiveness of the TTO depend on its correct use and quality (van Klei et al., 2012). Studies reported low adherence rate and a reluctant adoption of the procedure, particularly for surgeons (Hurlbert and Garrett, 2009), incomplete TTO execution (van Klei et al., 2012; Fridrich et al., 2022), and inattentiveness during the TTO (Biffl et al., 2015). These are not harmless omissions: If boxes are ticked without paying attention, the risk of error detection failures increases (Cullati et al., 2013), and a false sense of security may develop (Russ S. J. et al., 2015). Thus, active participation and commitment by all team members is crucial (Hicks et al., 2014) and team members should not engage in other tasks during the TTO (Vogts et al., 2011). Furthermore, the TTO may create a sense of time pressure. Although a typical TTO takes less than two minutes, some feel that it is taking too long, and start to rush. This may result in omitting information (Vats et al., 2010; Conley et al., 2011) and create a sense of urgency that may induce tensions. A tense atmosphere during the TTO has been found to lead to dismissive communication later on (Vats et al., 2010) and to impaired collaboration throughout the surgery (Whyte et al., 2008; Cullati et al., 2013).
The importance of completeness and quality of the TTO points to the need to avoid additional burdens that may threaten the quality of the TTO. It is thus important to consider if the StOP?-protocol as an additional intervention influences the quality of the TTO.
1.2. The StOP?–Intervention
The TTO focuses on exchanging information to prevents omissions and errors, but it cannot cover all necessary information for the whole operation. More specifically, it cannot deal with specific developments that require adapted actions. Indeed, one of the main complaints of surgical team members is feeling under-informed during the operation due to the lack of regular updates from surgeons regarding the progress, specific strategic approaches and intraoperative strategy changes (Wauben et al., 2011). Such task-related information exchange during the operation is important, as more information exchange (Mazzocco et al., 2009) and particularly more case-relevant communication have been associated with better patient outcomes (Tschan et al., 2015).
Surgeons are not simply unwilling to share information during the operation with the team. Performing surgery demands high concentration, particularly on manual aspects of the task, and surgeries can be quite stressful for the surgeon (Yamaguchi and Kanemitsu, 2011). Both aspects can impair communication, and high concentration requirements on manual tasks may prevent the surgeon from focusing on the team’s information needs, which requires a change in attentional focus. Focusing on the team constitutes a task in its own right (Fernandez et al., 2008). Stress can lead to team members losing the team perspective (Driskell et al., 1999). If surgeons do communicate as they go, but without a clear shift in attention, their communication may not be properly perceived by team members remote from the table.
To facilitate intraoperative information flow and regular updates, particularly from the surgeons to the team, we developed the StOP?-protocol. This protocol, led by the responsible surgeon, is an intraoperative briefing aimed at exchanging task-and cooperation-related information (Keller et al., 2022; Tschan et al., 2022). During the operation, the surgeon informs the team about the progress of the operation (St = status of the surgery), upcoming steps and goals (O = objectives), anticipated difficulties (P = problems), and encourages team members to ask questions and share observations (? = Questions or remarks). Information about status, objectives and potential problems aim at updating the team, asking for active participation aims at encouraging equal information exchange and speaking up (Edmondson, 2003). The structure of the StOP?-intervention is similar to other briefing interventions (Marks et al., 2000; Makary et al., 2006), except that it occurs during the operation at natural breakpoints between subtasks. Between subtasks, concentration requirements for specific aspects of the task are temporally reduced, and it is easier to switch attention to the team level. Multiple StOP?-briefings can be conducted during an operation; surgeons announce when they intend conducting a StOP?-briefing for a specific operation at the end of the TTO.
Research has shown that introducing the StOP?-protocol has positive effects on patient outcomes; it is related to a reduced mortality rate, fewer unplanned reoperations and fewer prolonged hospital stays (Tschan et al., 2022).
1.3. Can one team-intervention influence another?
Numerous patient safety interventions have been implemented in surgery over the years, often as a combination of interventions (McCulloch et al., 2017; Storesund et al., 2020).
Both inhibiting and enhancing influences or interferences between different interventions seem possible. For example, adding several checklists may lead to a sense of overregulation (Grigg, 2015) and loss auf of autonomy and even the feeling of infantilization, particularly if checklists are not perceived as well-suited to specific procedures (Grigg, 2015; Dekker, 2018). If checklists multiply, they may be perceived as a hindrance to timely and efficient work (Hales and Pronovost, 2006). If interventions target similar outcomes (as for the TTO and StOP?), people may perceive redundancy (Fourcade et al., 2012). This can create a negative attitude, and medical professionals may develop “checklist fatigue” (Hales and Pronovost, 2006; Grigg, 2015). This may lead to disengagement and reduced adherence (Stock and Sundt, 2015). It is thus possible that anticipating the StoP?-briefing induces aversion and reduces TTO quality.
However, interventions may also positively influence each other. The StOP?-protocol, for instance, builds on and complements the information provided by the TTO during the operation. This may render the information communicated during the TTO more meaningful and useful for the team. Another type of enhancement may be that the introduction of the StOP?-protocol draws attention to team cooperation. In a laboratory setting, Okhuysen and Eisenhardt (2002) explored how simple interventions to foster cooperation improved knowledge integration in groups. One interesting finding of their study was that each of three different interventions not only increased the specifically instructed behavior but spilled over to increase the use of cooperative strategies that were not explicitly instructed. The authors concluded that even simple interventions influence cooperation, as they direct the attention to the team-level and create “windows of opportunity” to switch attention from the task to the team level improving cooperative strategies. Indeed, one study found that teamwork interventions (as compared to system interventions) improved TTO checklist performance (McCulloch et al., 2017). Thus, the introduction of the StOP?-protocol may constitute such a window of opportunity, direct attention to the team process, and thus improve TTO quality. Finally, the introduction of single or combined interventions has been shown to positively influence safety attitudes and the safety climate, which may in turn improve the quality of safety measures (Haynes et al., 2011).
1.4. Research questions
Because both negative and positive effects of the introduction of a new briefing on an existing intervention are plausible, we do not formulate directed research questions.
The first research question thus was to compare the completeness and the quality of the TTO, as assessed by trained observers, before and after the StOP?-protocol was introduced, to assess potential effects of the additional intervention on the TTO.
A secondary research question was to evaluate differences between participating hospitals in completeness and quality of TTO as well as in the effect of the StOP? intervention on the TTO.
2. Methods
2.1. Sample
The study was conducted in the general surgery departments of two large Swiss University Hospitals and in the general and vascular department of a middle-sized urban hospital. These hospitals agreed to participate in a larger study that aimed to investigate the effects of the StOP?-protocol on patient outcomes, using a before-after design and comparing a nine-month baseline with nine-month intervention period (Tschan et al., 2022).
For this smaller observational study, we strove to assess a mix of elective surgeries from the larger study that was typical for each hospital. Criteria to include operations during the nine-month baseline period were elective general or vascular surgeries with an expected duration of more than 1 hour, and observers had to be available. Exclusion criteria were a preexisting surgical site infection (e.g., re-operation after the patient suffered an infection) or another surgery at the same site within the last 30 days. During the intervention period, case-mix and observer availability were once again limiting factors, but we aimed to match the proportion of the different types of surgery observed during the baseline period. In total, 371 operations were observed; and a TTO was performed in 366 of these operations (98.7%). The sample size was determined by the eligibility criteria, and we did not conduct a post-hoc power analysis in accordance with current recommendations (Dziak et al., 2020). The characteristics of the operations are reported in the result section. Due to the typically unstable composition of surgical teams, which can change even within an operation (Stucky and De Jong, 2021); and to assure confidentiality, we did not collect data on specific team members. All analyses are on the team level.
2.2. Measures
2.2.1. Characteristics of operations
Operations performed were coded into 11 different categories as (1) Upper gastrointestinal (GI) tract (e.g., small bowel) (2) Lower GI tract (e.g., hemicolectomy), (3) Liver (e.g., liver resection). (4) Pancreas (e.g., Whipple procedure), (5) Hernia (e.g., inguinal hernia), (6) cholecystectomy, (7) Gastric bypass/sleeve, (8) Kidney transplants, (9) Thoracoscopy (e.g., wedge resection), (10) vascular surgery (e.g., vascular bypass), and (11) other procedures. Data for patient age and gender were collected for each operation.
2.2.2. Intervention, context
It was coded whether the operation took place during the baseline or during the intervention period (0.1). To account for organizational differences, it was coded in which of the three hospitals (A, B, C) the intervention took place, using a dummy code.
2.2.3. Team timeout completeness
The goal of the TTO is to assure that all mandatory checklist items are checked before incision. Team timeout completeness (i.e., discussing each item on the list) therefore is an important quality measure (Cullati et al., 2013; Pickering et al., 2013; Fridrich et al., 2022). TTO completeness indicates whether the items on the checklist are referred to. However, hospitals are encouraged to adapt the TTO checklist to their specific circumstances and needs (Weiser et al., 2010); therefore, the number of items on the checklist, the number of mandatory items to discuss, as well as the specific way of performing the TTO differed across hospitals. In Hospital A, the TTO had eleven items, all of them mandatory. The TTO was initiated and led by the circulating nurse who read out aloud each of the items. Responses were provided by the person responsible for the respective information (e.g., the anesthesiologist for allergies, the surgeon for potential blood loss, the scrub nurse for instruments). In Hospitals B and C, the TTO was initiated by the responsible surgeon and predominantly entailed communication between the surgeon and anesthesiology providers. The TTO checklist of Hospital B had six items, two were mandatory (patient identity and planned procedure); the TTO of Hospital C had six items, three of them mandatory (patient identity, planned procedure, prophylactic antibiotics). In hospital B and C, the non-mandatory items were only mentioned if considered relevant by the surgeon or anesthetists. To assure comparability across hospitals, TTO completeness was calculated as proportion of mandatory items communicated for each hospital. TTO completeness for Hospital A was the proportion of the 11 mandatory items discussed. For Hospital B and C, we calculated two completeness scores; one related to the mandatory items (B: 0, 0.5 or 1; C: 0, 0.33, 0.66 or 1), and one expressed as proportion of all six items on the list (all items). If the communication during the TTO was not audible enough to determine if an item was mentioned or not, the data was coded as missing; scores were only calculated if there was data for every item. None of the hospitals had established a formal sign-out procedure.
2.2.4. Team timeout quality
The TTO quality was assessed by trained observers (work psychologists) using an adapted version of known TTO quality measures (Vogts et al., 2011; Fourcade et al., 2012; Levy et al., 2012; Pickering et al., 2013; Russ S. et al., 2015). In addition to contextual aspects of the TTO (e.g., who was present, who initiated it), which are not reported here, four components of TTO quality were assessed: Engagement during TTO was assessed using a 5-point Likert scale ranging from not committed (1) to committed (5); Pace of the TTO was assessed using a 5-point Likert scale ranging from rushed (1) to calm (5); Social climate was assessed using a 5-point Likert scale ranging from irritated (1) to serene (5); Noisy conditions was assessed using a 5-poing Likert scale ranging from no noise (1) to very noisy (5). The scales provided explicit categories for the extremes, and observers were instructed to indicate the level of agreement based on the numerical values assigned to each option. After reversing the noise item, the quality components were combined into a quality index, which demonstrated good internal consistency (Cronbach’s α =0.697). About 9% (N = 33) of the observed TTO were assessed independently by two observers, and intra class correlation (ICC) was calculated to assess inter-observer agreement, yielding good results (engagement: ICC = 0.741; pace: ICC = 0.818; social climate: ICC = 0.749; noise: ICC = 0.854).
2.3. Study design
This was a prospective intervention study employing a pre-post design. The implementation consisted of the introduction of the StOP?-protocol described in the introduction. During the baseline period, the surgical team did not get any instruction related to their behavior or communication. To prepare the intervention, surgeons were individually trained on how and when to perform the StOP?-protocol. Scrub technicians and circulators as well as anesthesia providers were also informed about the StOP?-protocol.
Observer-based assessment of TTO completeness and quality during the baseline period (9 months) before the implementation of the StOP?-protocol was compared with observations during the intervention period. All TTO were observed in vivo by observers present in the OR. Surgical team members were aware of the presence of observers, but neither the members of the surgical team nor the members of the observational team were aware of the specific research question.
The study was conducted in accordance with the principles outlined in the Helsinki protocol for human subject research and was approved by the ethics committees (leading committee #161/2014). Consent from the team members to be observed was based on an opt-out procedure; teams were asked for permission to be observed before the operation, and each member of the team could at any moment before and during the process ask the observers to leave. Patient consent for two hospitals was based on general consent; in one hospital, the local ethical committee also approved inclusion of operations for patients who did not refuse the use of their data.
2.4. Statistics
Descriptive statistics are reported as means and standard deviations, or counts and percentages for categorical variables. To compare TTO quality before and after the intervention across the hospitals, we conducted 2×3 factorial ANOVA’s, with the StOP?-intervention (before, after) and the hospital (Hospital A, Hospital B, Hospital C) as fixed factors. Pairwise comparisons (before and after the intervention and between the hospitals) were assessed based on estimated marginal means and were Bonferroni adjusted; differences between hospitals in the rate of change were assessed by an intervention x hospital interaction effect; effect sizes are partial eta squared. Interobserver reliability was assessed by intraclass correlation (ICC). P less than 0.05 was considered statistically significant. We used SPSS 28 for all analyses (IBM, 2021).
3. Results
3.1. Characteristics of operations
A total of 371 operations were observed. Table 1 shows the mix of operations observed during the baseline and intervention period for each hospital. Comparing the proportion of surgery types observed before and after the intervention yielded no significant differences, indicating successful matching.
Table 1. Operations observed during baseline and Intervention per hospital.
3.2. Team timeout completeness
In 356 of the 366 operations with observed TTO, completeness of the time-out procedure could be assessed. Descriptive statistics and ANOVA results of TTO completeness are displayed in Table 2. Our analysis focuses on the mandatory items of the checklist; for results concerning all items (which were very similar), see Supplementary Table S1. Analyses showed a positive effect of the StOP? intervention on TTO completeness (Table 2, line “Intervention”). Regarding hospitals, TTO completeness was significantly higher in Hospital A than in Hospitals B and C. Completeness was somewhat higher in Hospital B as compared to Hospital C, but that difference was not significant. These results indicate that the introduction of the StOP?-protocol did have positive effects on the completeness of the TTO. There was no significant interaction effect (intervention × hospital).
Table 2. Timeout completeness before and after the StOP?–Intervention and between hospitals: mandatory items.
3.3. Team timeout quality
Descriptive statistics and ANOVA results for the TTO quality index and for each of the components of the quality index are displayed in Tables 3, 4. Analyses show a significant positive relation between the StOP? intervention and the TTO quality index (Table 3), line “Intervention”), but also for each component separately (Table 4), line “Intervention,” indicating that engagement, pace, and social climate during the TTO improved during the StOP? intervention, whereas noise during TTO decreased. Regarding the secondary research question, the analyses showed that TTO quality in Hospital A was significantly higher than in Hospital B before, but also during the intervention, both for the quality index and for the quality components (line “between hospitals” in Tables 3, 4). For Hospital C, the intervention had no significant effects on the quality index nor on the components engagement, pace and noise, and the component social climate in Hospital C was actually significantly lower after the intervention; the interaction hospital x intervention was significant for the quality index and the components engagement, social climate, and noise, but not for pace of the TTO, indicating that the intervention had differential effects in different hospitals.
Table 3. Quality index TTO before and after the StOP?-intervention and between hospitals.
Table 4. Quality of TTO for the quality components engagement, pace, social climate and noise before and after the StOP?–intervention and between Hospitals.
4. Discussion
The introduction of the StOP?-protocol in surgical wards was associated with the improvement in the quality of the TTO. These improvements encompassed completeness, engagement, pace, social climate, and noise conditions. Thus, the additional briefing did not have a negative effect on the already established briefing; rather, the intervention was related to a better TTO quality. Even in the hospital where the TTO did not improve following the intervention, only one component, social climate, declined significantly; the other components, did not change significantly.
These results are consistent with the findings by Okhuysen and Eisenhardt (2002) in a different field, as well as with previous research investigating the effects of team training interventions on TTO quality (McCulloch et al., 2017). One possible explanation for this effect is that an additional briefing opens the opportunity for teams to focus their attention on the team level. This may positively influence cooperative behavior beyond the specific target of the intervention. The effect could be due to momentary effects, whereby the anticipation of the StOP?-briefing enhances the overall attention of the team. However, it could also be a more general effect, resulting from the information and training provided for the StOP? intervention, as well as the regular refresher training. These activities may have served as reminders to team members about the importance of information exchange and collaboration in the OR.
There were marked differences in TTO quality between the hospitals, as well as some significant interaction effects, indicating differences in the impact of the intervention across hospitals. Notably, although there was an overall positive association between the StOP?-protocol and TTO quality, introducing the StOP?-protocol did not influence the quality of the TTO index or its components engagement, pace, and noise conditions in Hospital C. This lack of impact may be due to a ceiling effect, as the values in Hospital C were already close to the scale maximum before the intervention and were higher compared to the other hospitals, leaving limited room for improvement. However, the social climate during the TTO in Hospital C was significantly lower after the introduction of the StOP?. Again, this outcome may be explained by a ceiling effect or a regression toward the mean effect. Note that the social climate score before intervention was 4.7 (on a scale from 1 to 5) which decreased to 4.44 after the intervention. Social climate was markedly higher in Hospital C than in the other hospitals before the intervention but was similar and still high after the intervention. Nevertheless, alternative explanations cannot be ruled out.
When comparing hospitals, the overall TTO quality in Hospital B was lower than in Hospital A, both before and after the introduction of the StOP?-protocol. In general, hospital effects were larger than the effects of the intervention, as indicated by the partial eta squared measure. This finding confirms the presence of cultural differences between hospitals, a well-established fact (Sexton et al., 2006; Körner et al., 2015).
There was concern regarding the potential of negative effects of the StOP-protocol on the TTO, because it could lead to perceived redundancy and checklist fatigue (Hales and Pronovost, 2006; Grigg, 2015). In healthcare, some level of redundancy is generally favored as it enhances safety by reducing the risk of errors with multiple checks by different persons (Sivathasan et al., 2010). However, too much redundancy can also lead people to skip information checking, as they feel the information was already checked enough (Fourcade et al., 2012; Papaconstantinou et al., 2013). That the StOP?-intervention evidently did not lead to perceived inappropriate redundancy during the TTO and did not negatively impact the TTO quality suggests that the addition of a single briefing was not enough to induce a sense of overload. Moreover, note that the StOP?-protocol addresses other kinds of information than the TTO. Therefore, it may not be perceived as “just another checklist,” but rather as the exchange of task-and cooperation-relevant information pertaining to the procedure and to strategic changes. This argument is supported by the positive effects of the StOP?-protocol on patient outcomes (Tschan et al., 2022), and team outcomes, such as perceived collaboration quality, situation awareness, and ease of speaking up (Tschan et al., Submitted). Additionally, the StOP? protocol is not time-consuming to perform and easy to follow, and it facilitates communication among the members of the team.
This study has several limitations. Firstly, the sample size is relatively low, as only surgeries could be included for which observers were available which may also limit the representativeness of the surgeries performed. In addition, all participating surgical departments are located in midsize and large hospitals and predominantly specialize in general (visceral) and vascular surgery, thus limiting the generalizability of the findings to other surgical specialties and smaller settings.
Another limitation is that random assignment was not feasible for this intervention, so a pre-post design had to be employed. Furthermore, participants and observers were aware of the intervention, as this could not be blinded. However, neither the surgical teams nor the observers were aware of the specific research question investigated in this paper, mitigating some potential biases.
Also, we cannot entirely exclude the possibility that an item was not registered despite being mentioned in the TTO because the observer simply did not hear (or understand) it. But even if we account for this possibility, the increased TTO completeness remains noteworthy. Furthermore, the TTO should be executed loud enough to be audible for the whole OR, even for someone at the other side of the room. Lastly, like in any observational study, there is the limitation that other unmeasured factors or variables could have influenced the results.
This study has practical implications, demonstrating that the already established TTO procedure benefited from another briefing intervention overall in two out of the three hospitals. In addition, even in the hospital that did not show improvement, results did not indicate an effect akin to “checklist fatigue” or a negative impact on the TTO. While the TTO has been recognized for its positive effects on team collaboration (Lingard et al., 2008), its scope and purpose are limited. This study demonstrates that an additional intervention fostering information exchange during the operation can be beneficial and even improve the quality of an already established briefing. However, it is crucial to note that the effectiveness of each additional intervention cannot be assumed and needs to be investigated individually.
Data availability statement
The datasets presented in this article are not readily available because the raw data are available upon request from the corresponding author to researchers eligible to work with codified personal health care data under Swiss legislation. Eligibility will be determined by Kantonale Ethikkomission Bern when needed. Requests to access the datasets should be directed to guido.beldi@insel.ch.
Ethics statement
The studies involving human participants were reviewed and approved by Kantonale Ethikkommission Bern (KEK); KEK-Gesuchs_Nr: 161/14. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author contributions
ET-H, FT, SK, NS, GB, DC, ND, and MW: study conception. ET-H, JZ, and SH: data collection (including conceptual aspects). ET-H and FT: data analysis. ET-H, FT, SK, NS, JZ, MH, MW, DC, ND, and GB: substantial contributions to manuscript. All authors contributed to the article and approved the submitted version.
Funding
This project was funded by grant CR13I3_156882 from the Swiss National Science Foundations and supported by the Deutsche Bosch-Stiftung, grant # 12.5.A381.0040.0. The funders and supporters of the study had no role in study design, data collection, analyses, interpretation, or writing. Open access funding by University of Neuchâtel.
Acknowledgments
The authors thank Raffael Bittel, Anne-Sophie Brandt, Paola Cubillos, Margaux Grund, Ysaline Hug, Céline Lui, Paola Paaz, Gabriela Schenker, Annkathrin Schmidli, and Eva Silberschmidt for their help in observations; Catherine Blanc, Nicolas Croxatto, Brigitte Dubach, Claudine Fanton, Uwe Klopsch, Christine Oechslin, Yvonne Hänggi, and Francois Marguet for their support for logistical and organizational aspects of the study.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1195024/full#supplementary-material
References
Abbott, T. E. F., Ahmad, T., Phull, M. K., Fowler, A. J., Hewson, R., Biccard, B. M., et al. (2018). The surgical safety checklist and patient outcomes after surgery: a prospective observational cohort study, systematic review and meta-analysis. Br. J. Anaesth. 120, 146–155. doi: 10.1016/j.bja.2017.08.002
Afkari, H., Bednarik, R., Mäkelä, S., and Eivazi, S. (2016). Mechanisms for maintaining situation awareness in the micro-neurosurgical operating room. Int. J. Hum. Comp. Stud. 95, 1–14. doi: 10.1016/j.ijhcs.2016.05.004
Appelbaum, N. P., Lockeman, K. S., Orr, S., Huff, T. A., Hogan, C. J., Queen, B. A., et al. (2020). Perceived influence of power distance, psychological safety, and team cohesion on team effectiveness. J. Interprof. Care 34, 20–26. doi: 10.1080/13561820.2019.1633290
Biffl, W. L., Gallagher, A. W., Pieracci, F. M., and Berumen, C. (2015). Suboptimal compliance with surgical safety checklists in Colorado: a prospective observational study reveals differences between surgical specialties. Patient Saf. Surg. 9:5. doi: 10.1186/s13037-014-0056-z
Buljac-Samardzic, M., Dekker-van Doorn, C. M., van Wijngaarden, J. D., and van Wijk, K. P. (2010). Interventions to improve team effectiveness: a systematic review [review]. Health Policy 94, 183–195. doi: 10.1016/j.healthpol.2009.09.015
Conley, D. M., Singer, S. J., Edmondson, L., Berry, W. R., and Gawande, A. A. (2011). Effective surgical safety checklist implementation. J. Am. Coll. Surg. 212, 873–879. doi: 10.1016/j.jamcollsurg.2011.01.052
Cullati, S., Le Du, S., Rae, A. C., Micallef, M., Khabiri, E., Ourahmoune, A., et al. (2013). Is the surgical safety checklist successfully conducted? An observational study of social interactions in the operating rooms of a tertiary hospital. BMJ Qual. Saf. 22, 639–646. doi: 10.1136/bmjqs-2012-001634
Dekker, S. (2018). The safety anarchist. Relying on human expertise and innovation, reducing bureaucracy and compliance. Oxfordshire: Roudledge, Taylor & Francis Group
Driskell, J. E., Salas, E., and Johnston, J. (1999). Does stress Lead to a loss of team perspective? Group Dyn. Theory Res. Pract. 3, 291–302. doi: 10.1037/1089-2699.3.4.291
Dziak, J. J., Dierker, L. C., and Abar, B. (2020). The interpretation of statistical power after the data have been gathered. Curr. Psychol. 39, 870–877. doi: 10.1007/s12144-018-0018-1
Edmondson, A. (2003). Speaking up in the operating room: how team leaders promote learning in interdidisciplinary action teams. J. Manag. Stud. 40, 1419–1452. doi: 10.1111/1467-6486.00386
Fernandez, R., Kozlowski, S. W., Shapiro, M. J., and Salas, E. (2008). Toward a definition of teamwork in emergency medicine. Acad. Emerg. Med. 15, 1104–1112. doi: 10.1111/j.1553-2712.2008.00250.x
Fourcade, A., Blache, J. L., Grenier, C., Bourgain, J. L., and Minvielle, E. (2012). Barriers to staff adoption of a surgical safety checklist [research support, non-U.S. Gov't]. BMJ Qual. Saf. 21, 191–197. doi: 10.1136/bmjqs-2011-000094
Fridrich, A., Imhof, A., and Schwappach, D. L. B. (2022). Compliance with the surgical safety checklist in Switzerland: an observational multicenter study based on self-reported data. Patient Saf. Surg. 16:17. doi: 10.1186/s13037-022-00327-8
Graafland, M., Schraagen, J. M. C., Boermeester, M. A., Bemelman, W. A., and Schijven, M. P. (2015). Training situational awareness to reduce surgical errors in the operating room. Br. J. Surg. 102, 16–23. doi: 10.1002/bjs.9643
Grigg, E. (2015). Smarter clinical checklists: how to minimize checklist fatigue and maximize clinician performance. Anesth. Analg. 121, 570–573. doi: 10.1213/ANE.0000000000000352
Hales, B. M., and Pronovost, P. J. (2006). The checklist--a tool for error management and performance improvement. J. Crit. Care 21, 231–235. doi: 10.1016/j.jcrc.2006.06.002
Haugen, A. S., Sevdalis, N., and Softeland, E. (2019). Impact of the World Health Organization surgical safety checklist on patient safety. Anesthesiology 131, 420–425. doi: 10.1097/ALN.0000000000002674
Haynes, A. B., Edmondson, L., Lipsitz, S. R., Molina, G., Neville, B. A., Singer, S. J., et al. (2017). Mortality trends after a voluntary checklist-based surgical safety collaborative. Ann. Surg. 266, 923–929. doi: 10.1097/SLA.0000000000002249
Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A. H., Dellinger, E. P., et al. (2009). A surgical safety checklist to reduce morbidity and mortality in a global population. N. Engl. J. Med. 360, 491–499. doi: 10.1056/NEJMsa0810119
Haynes, A. B., Weiser, T. G., Berry, W. R., Lipsitz, S. R., Breizat, A. H., Dellinger, E. P., et al. (2011). Changes in safety attitude and relationship to decreased postoperative morbidity and mortality following implementation of a checklist-based surgical safety intervention. BMJ Qual. Saf. 20, 102–107. doi: 10.1136/bmjqs.2009.040022
Hicks, C. W., Rosen, M., Hobson, D. B., Ko, C., and Wick, E. C. (2014). Improving safety and quality of care with enhanced teamwork through operating room briefings. JAMA Surg. 149, 863–868. doi: 10.1001/jamasurg.2014.172
Hurlbert, S. N., and Garrett, J. (2009). Improving operating room safety. Patient Saf. Surg. 3:25. doi: 10.1186/1754-9493-3-25
Kearns, R. J., Uppal, V., Bonner, J., Robertson, J., Daniel, M., and McGrady, E. M. (2011). The introduction of a surgical safety checklist in a tertiary referral obstetric Centre. BMJ Qual. Saf. 20, 818–822. doi: 10.1136/bmjqs.2010.050179
Keller, S., Tschan, F., Beldi, G., Kurmann, A., Candinas, D., and Semmer, N. K. (2016). Noise peaks influence communication in the operating room. An observational study. Ergonomics 59, 1541–1552. doi: 10.1080/00140139.2016.1159736
Keller, S., Tschan, F., Semmer, N. K., Trelle, S., Manser, T., and Beldi, G. (2022). StOP? II trial: cluster randomized clinical trial to test the implementation of a toolbox for structured communication in the operating room—study protocol. Trials 23:878. doi: 10.1186/s13063-022-06775-y
Körner, M., Wirtz, M. A., Bengel, J., and Göritz, A. S. (2015). Relationship of organizational culture, teamwork and job satisfaction in interprofessional teams. BMC Health Serv. Res. 15:243. doi: 10.1186/s12913-015-0888-y
Kurmann, A., Keller, S., Tschan-Semmer, F., Seelandt, J., Semmer, N. K., Candinas, D., et al. (2014). Impact of team familiarity in the operating room on surgical complications. World J. Surg. 38, 3047–3052. doi: 10.1007/s00268-014-2680-2
Leitsmann, C., Uhlig, A., Popeneciu, I. V., Boos, M., Ahyai, S. A., Schmid, M., et al. (2021). The silent operation theatre optimisation system (SOTOS©) to reduce noise pollution during da Vinci robot-assisted laparoscopic radical prostatectomy. J. Robot. Surg. 15, 519–527. doi: 10.1007/s11701-020-01135-x
Levy, S. M., Senter, C. E., Hawkins, R. B., Zhao, J. Y., Doody, K., Kao, L. S., et al. (2012). Implementing a surgical checklist: more than checking a box [evaluation studies]. Surgery 152, 331–336. doi: 10.1016/j.surg.2012.05.034
Lingard, L., Regehr, G., Orser, B., Reznick, R., Baker, G. R., Doran, D., et al. (2008). Evaluation of a preoperative checklist and team briefing among surgeons, nurses, and anesthesiologists to reduce failures in communication. Arch. Surg. 143, 12–17. doi: 10.1001/archsurg.2007.21
Lyons, V. E., and Popejoy, L. L. (2014). Meta-analysis of surgical safety checklist effects on teamwork, communication, morbidity, mortality, and safety. West. J. Nurs. Res. 36, 245–261. doi: 10.1177/0193945913505782
Makary, M. A., Holzmueller, C. G., Thompson, D., Rowen, L., Heitmiller, E. S., Maley, W. R., et al. (2006). Operating room briefings: working on the same page. Jt. Comm. J. Qual. Patient Saf. 32, 351–355. doi: 10.1016/S1553-7250(06)32045-4
Marks, M. A., Zaccaro, S. J., and Mathieu, J. E. (2000). Performance implications of leader briefings and team-interaction training for team adaptation to novel environments. J. Appl. Psychol. 85, 971–986. doi: 10.1037/0021-9010.85.6.971
Mascherek, A. C., Schwappach, D. L., and Bezzola, P. (2013). Frequency of use and knowledge of the WHO-surgical checklist in Swiss hospitals: a cross-sectional online survey. Patient Saf. Surg. 7:36. doi: 10.1186/1754-9493-7-36
Mazzocco, K., Petitti, D. B., Fong, K. T., Bonacum, D., Brookey, J., Graham, S., et al. (2009). Surgical team behaviors and patient outcomes. Am. J. Surg. 197, 678–685. doi: 10.1016/j.amjsurg.2008.03.002
McCulloch, P., Morgan, L., New, S., Catchpole, K., Roberston, E., Hadi, M., et al. (2017). Combining systems and teamwork approaches to enhance the effectiveness of safety improvement interventions in surgery: the safer delivery of surgical services (S3) program. Ann. Surg. 265, 90–96. doi: 10.1097/sla.0000000000001589
Molina, G., Jiang, W., Edmondson, L., Gibbons, L., Huang, L. C., Kiang, M. V., et al. (2016). Implementation of the surgical safety checklist in South Carolina hospitals is associated with improvement in perceived perioperative safety. J. Am. Coll. Surg. 222, 725–736e5. doi: 10.1016/j.jamcollsurg.2015.12.052
Okhuysen, G. A., and Eisenhardt, K. M. (2002). Integrating knowledge in groups: how formal interventions enable flexibility. Organ. Sci. 13, 370–386. doi: 10.1287/orsc.13.4.370.2947
Papaconstantinou, H. T., Jo, C., Reznik, S. I., Smythe, W. R., and Wehbe-Janek, H. (2013). Implementation of a surgical safety checklist: impact on surgical team perspectives. Ochsner J. 13, 299–309.
Paterson-Brown, S., Youngson, G., McIlhenny, C., Maran, N., Flin, R., and Yule, S. (2019). Raising awareness of non-technical skills in operating theatres. BMJ 364:l61. doi: 10.1136/bmj.l61
Pickering, S. P., Robertson, E. R., Griffin, D., Hadi, M., Morgan, L. J., Catchpole, K. C., et al. (2013). Compliance and use of the World Health Organization checklist in U.K. operating theatres. Br. J. Surg. 100, 1664–1670. doi: 10.1002/bjs.9305
Reames, B. N., Krell, R. W., Campbell, D. A. Jr., and Dimick, J. B. (2015). A checklist-based intervention to improve surgical outcomes in Michigan: evaluation of the keystone surgery program. JAMA Surg. 150, 208–215. doi: 10.1001/jamasurg.2014.2873
Russ, S., Rout, S., Caris, J., Mansell, J., Davies, R., Mayer, E., et al. (2015). Measuring variation in use of the WHO surgical safety checklist in the operating room: a multicenter prospective cross-sectional study. J. Am. Coll. Surg. 220, 1–11e4. doi: 10.1016/j.jamcollsurg.2014.09.021
Russ, S. J., Sevdalis, N., Moorthy, K., Mayer, E. K., Rout, S., Caris, J., et al. (2015). A qualitative evaluation of the barriers and facilitators toward implementation of the WHO surgical safety checklist across hospitals in England: lessons from the "surgical checklist implementation project". Ann. Surg. 261, 81–91. doi: 10.1097/sla.0000000000000793
Sexton, J. B., Makary, M. A., Tersigni, A. R., Pryor, D., Hendrich, A., Thomas, E. J., et al. (2006). Teamwork in the operating room: frontline perspectives among hospitals and operating room personnel. Anesthesiology 105, 877–884. doi: 10.1097/sla.0000000000000793
Sivathasan, N., Rakowski, K. R., Robertson, B. F., and Vijayarajan, L. (2010). The World Health Organization's 'Surgical safety Checklist': should evidence-based initiatives be enforced in hospital policy? JRSM Short Rep 1:40. doi: 10.1258/shorts.2010.010007
Stock, C. T., and Sundt, T. (2015). Timeout for checklists? Ann. Surg. 261, 841–842. doi: 10.1097/sla.0000000000001141
Storesund, A., Haugen, A. S., Flaatten, H., Nortvedt, M. W., Eide, G. E., Boermeester, M. A., et al. (2020). Clinical efficacy of combined surgical patient safety system and the World Health Organization's checklists in surgery: a nonrandomized clinical trial. JAMA Surg. 155, 562–570. doi: 10.1001/jamasurg.2020.0989
Stucky, C. H., and De Jong, M. J. (2021). Surgical team familiarity: an integrative review. AORN J. 113, 64–75. doi: 10.1002/aorn.13281
Stucky, C. H., De Jong, M. J., and Liu, Y. (2021). Military surgical team performance: the impact of familiarity, team size, and nurse anesthesia students. J. Perianesth. Nurs. 37, 86–93. doi: 10.1016/j.jopan.2021.04.008
Sun, R., Marshall, D. C., Sykes, M. C., Maruthappu, M., and Shalhoub, J. (2018). The impact of improving teamwork on patient outcomes in surgery: a systematic review. Int. J. Surg. 53, 171–177. doi: 10.1016/j.ijsu.2018.03.044
Tschan, F., Keller, S., Semmer, N. K., Timm-Holzer, E., Zimmermann, J., Huber, S. A., et al. (2022). Effects of structured intraoperative briefings on patient outcomes: multicentre before-and-after study. Br. J. Surg. 109, 136–144. doi: 10.1093/bjs/znab384
Tschan, F., Seelandt, J. C., Keller, S., Semmer, N. K., Kurmann, A., Candinas, D., et al. (2015). Impact of case-relevant and case-irrelevant communication within the surgical team on surgical-site infection. Br. J. Surg. 102, 1718–1725. doi: 10.1002/bjs.9927
Tschan, F., Timm-Holzer, E., Keller, S., Zimmermann, J., Semmer, N. K., Huber, S. A., et al. (Submitted). Improving situation awareness, ease of speaking up, and team collaboration through an intraoperative briefing fostering information exchange: a before-after intervention study
Urbach, D. R., Govindarajan, A., Saskin, R., Wilton, A. S., and Baxter, N. N. (2014). Introduction of surgical safety checklists in Ontario, Canada [research support, non-U.S. Gov't]. N. Engl. J. Med. 370, 1029–1038. doi: 10.1056/NEJMsa1308261
van Klei, W. A., Hoff, R. G., van Aarnhem, E. E., Simmermacher, R. K., Regli, L. P., Kappen, T. H., et al. (2012). Effects of the introduction of the WHO "surgical safety checklist" on in-hospital mortality: a cohort study. Ann. Surg. 255, 44–49. doi: 10.1097/SLA.0b013e31823779ae
Vats, A., Vincent, C. A., Nagpal, K., Davies, R. W., Darzi, A., and Moorthy, K. (2010). Practical challenges of introducing WHO surgical checklist: UK pilot experience. BMJ 340:b5433. doi: 10.1136/bmj.b5433
Vogts, N., Hannam, J. A., Merry, A. F., and Mitchell, S. J. (2011). Compliance and quality in administration of a surgical safety checklist in a tertiary New Zealand hospital. N. Z. Med. J. 124, 48–58.
Wauben, L. S. G. L., Dekker-van Doorn, C. M., van Wijngaarden, J. D. H., Goossens, R. H. M., Huijsman, R., Klein, J., et al. (2011). Discrepant perceptions of communication, teamwork and situation awareness among surgical team members. Int. J. Qual. Health Care 23, 159–166. doi: 10.1093/intqhc/mzq079
Weiser, T. G., Haynes, A. B., Lashoher, A., Dziekan, G., Boorman, D. J., Berry, W. R., et al. (2010). Perspectives in quality: designing the WHO surgical safety checklist. Int. J. Qual. Health Care 22, 365–370. doi: 10.1093/intqhc/mzq039
Whyte, S., Lingard, L., Espin, S., Baker, G. R., Bohnen, J., Orser, B. A., et al. (2008). Paradoxical effects of interprofessional briefings on OR team performance. Cogn. Tech. Work 10, 287–294. doi: 10.1007/s10111-007-0086-8
Keywords: teamwork in surgery, surgical checklist, intraoperative briefing, patient safety, teamwork in medicine, team intervention
Citation: Timm-Holzer E, Tschan F, Keller S, Semmer NK, Zimmermann J, Huber SA, Hübner M, Candinas D, Demartines N, Weber M and Beldi G (2023) No signs of check-list fatigue – introducing the StOP? intra-operative briefing enhances the quality of an established pre-operative briefing in a pre-post intervention study. Front. Psychol. 14:1195024. doi: 10.3389/fpsyg.2023.1195024
Edited by:
Margarete Boos, University of Göttingen, GermanyReviewed by:
Eleonora Orena, IRCCS Carlo Besta Neurological Institute Foundation, ItalySven Staender, Männedorf Hospital, Switzerland
Copyright © 2023 Timm-Holzer, Tschan, Keller, Semmer, Zimmermann, Huber, Hübner, Candinas, Demartines, Weber and Beldi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Eliane Timm-Holzer, eliane.timm@unibe.ch; Franziska Tschan, Franziska.tschan@unine.ch; Guido Beldi, guido.beldi@insel.ch