Outcomes of Vital Sign Monitoring of an Acute Surgical Cohort With Wearable Sensors and Digital Alerting Systems: A Pragmatically Designed Cohort Study and Propensity-Matched Analysis

Introduction

Prodromal alterations in vital parameters help identify clinical deterioration through early changes, often preceding adverse events (Goldhill et al., 1999; Buist et al., 2004; Cuthbertson et al., 2007; DeVita et al., 2010; Smith, 2010; Kenzaka et al., 2012; Hollis et al., 2016). Therefore, monitoring of these physiological parameters is considered a fundamental aspect of delivering clinical care. Despite this, clinical deterioration can go undetected with unfavourable consequences: late referrals to intensive care; worsened morbidity, and mortality (McQuillan et al., 1998; Culliane et al., 2005; Britain and N. P. S. A., 2007; Luettel et al., 2007; NICE, 2007; Findlay et al., 2012).

Vital signs, consisting of heart rate (HR), respiratory rate (RR), temperature, blood pressure (BP), oxygen saturations (& supplemental oxygen), and level of consciousness, are routinely but intermittently monitored for individuals admitted to non-intensive (general) hospital wards. The frequency of monitoring and subsequent action has been protocolised through the endorsement of the National Early Warning Score (NEWS 2) by The Royal College of Physicians. Each parameter is individually scored according to severity and combined for a total NEWS 2 score. Observations are performed every 4–6 h for those with a score of one to four, hourly for a score of five to seven, and continuously for patients with a NEWS 2 score of 7 or more. For acutely unwell individuals, an increased frequency of monitoring is required (Royal College of Physicians, 2017).

Early warning scores predicate that individuals at risk of deterioration are identified early through initial variations in vital parameters (e.g., elevated respiratory rate or reduced blood pressure), allowing for early intervention (Ridley, 2005). Indeed, their implementation has shown good predictive value on deterioration, positively influencing clinical outcomes (Downey et al., 2017). However, several limitations are recognised, critically their intermittent nature, allowing for acute deterioration in between measurements to be missed (Downey et al., 2017). Inadequate monitoring frequency and NEWS 2 calculations; transcribing errors from observation machines; misplacement of paper-based charts have, additionally, all been reported (Chen et al., 2009; Edwards et al., 2010; Christofidis et al., 2014).

Near real-time continuous monitoring of vital signs using novel wearable sensors, without hindering ambulation, may offer a solution to tackle these issues. A culmination of additional data points and reduced reliance on clinical personnel availability for performing observations may allow for earlier recognition of deterioration with reduced workload for healthcare staff (Tarassenko et al., 2006). Subsequent alerting mechanisms prompt healthcare professionals to act accordingly. These alerts are generated when pre-established thresholds for vital parameters, often configurable, are breached, informing healthcare professionals on mobile phone devices or central monitoring hubs. This, in time, can be used to predict deterioration rather than relying on protocol-driven intermittent traditional based measurements (Wells et al., 2022).

Although a meta-analysis supported the use of alerting systems in cases of sepsis to reduce hospital and intensive care length of stay (Joshi et al., 2019), another study reported there was a paucity in the literature with regards to the efficacy of wearable continuous monitoring on clinical outcomes (Leenen et al., 2020). Furthermore, an additional study reported no conclusive evidence to favour continuous monitoring outside of intensive care settings (Downey et al., 2018b). The heterogeneity of study designs, patient selection bias, complexity of interventions, and lack of controls, however, has limited meaningful conclusions. Moreover, the real-world applicability of such interventions is seldom reported, an essential component to understanding implementation of wearable solutions.

Recent experiences of nursing staff based on a surgical ward reported the potential utilitarian value of wearable sensors in providing individualised patient monitoring, aiding clinical decision making, and increasing efficiency in prioritising patients, particularly during busier shifts. However, they noted that not all patients may require continuous monitoring and a selection process should be in place that can be adapted to an individual’s needs (Areia et al., 2022).

To date, studies have focussed on demonstrating acceptability, feasibility, reliability, and experiences of wearable sensor based continuous monitoring (Hernandez-Silveira et al., 2015; Downey C. et al., 2018c; Breteler et al., 2019; Leenen et al., 2020; Weenk et al., 2020), with real-world incorporation of digital alerts into remote monitoring yet to be studied. As such, the aim of this work was to pragmatically test this in an acute surgical cohort, highlighting our implementation experience.

Materials and Methods

Study Design

This pragmatically designed, single-centre, pre-post implementation study was conducted on the acute surgical unit at our institution (West Middlesex University Hospital). This unit typically dealt with common surgical presentations referred from the emergency department or from primary care. These include s acute abdominal pain caused by a variety of pathologies (e.g., bowel obstruction, appendicitis, cholecystitis, diverticulitis) but also acute bleeding symptoms (e.g., haematuria, rectal bleeding) and was staffed by a rotating on-call system of healthcare professionals. Therefore, this represented a cohort with potential to rapidly deteriorate where the utilisation of digital alerts may be impactful. A medical cohort was considered but the rapid transfer of patients to other long stay wards risked a high rate of data attrition; given the financial and logistical needs to engineer the wards for digital alerting systems, as detailed in our published protocol, the surgical unit was favoured (Iqbal et al., 2021b). The pre-implementation phase dates from September 2017 to May 2019 and post-implementation phase from May 2019 to March 2020.

The pre-implementation phase involved using the SensiumVitals™ system in combination with usual care. However, healthcare staff were unable to view the sensor data and digital alerts were not generated. Usual care, in our institution, involved intermittent monitoring of vital signs in accordance with NEWS2.

In the post-implementation phase, alerting systems following recognition of abnormal parameters were activated. These alerts were transmitted to mobile devices and central monitoring hubs, with alert acknowledgement required from healthcare staff.

All participants provided informed consent. Ethical approval for this study was granted by the Yorkshire & The Humber—Leeds East Research Ethics Committee on 1st September 2017 (reference: 17/YH/0296; IRAS: 222979) and this trial was performed in accordance with Good Clinical Practice guidelines and the Declaration of Helsinki. Patient data were anonymised to ensure privacy. Storage and handling of personal data complied with the General Data Protection Regulation.

Wearable Sensor and Alerting Thresholds

A disposable, lightweight, waterproof, wearable “patch” created by SensiumVitals™ was attached to a participant’s chest with two adhesive ECG electrodes, recording HR, RR and axillary temperature every 2 minutes. These data and any subsequent generated alerts were viewable and actionable through a secured web-browser or mobile device provided to healthcare staff. Patented embedded algorithms processed captured data to prevent reporting of noisy or irregular signals, thereby reducing false alerts. This consists of an initial stage of digital filtering, whereby unwanted artefacts are removed from recorded signals (i.e., from external sources or through muscular electrical activity); a decision-making stage follows this by ensuring the recorded signal meets a series of rules and empirically derived thresholds to allow the final value to be recorded and interpreted by the end user; this ensures a quality assurance check has been undertaken (Wong et al., 2009; Hernandez-Silveira et al., 2015). Further details have been described in our protocol (Iqbal et al., 2021b).

Alerts were generated when pre-established thresholds were breeched for 10 consecutive minutes for measured vital signs. A 10-min window was based on (unpublished) internal pilot testing data which tested periods ranging from 6 to 18 min. Ten minutes was chosen to balance the risk of alert fatigue to healthcare staff against the potential usefulness of alerts. These thresholds were individually tailorable but were initially programmed to trigger, in accordance with red (heart rate over 131 beats per minute, respiratory rate over 25 breaths per minute) and yellow (temperature of 38.1°C) NEWS2 cut-offs (Royal College of Physicians, 2017).

Subsequent actions taken by healthcare staff were recorded, these included: repeating a full set of observations; reviewing the clinical status of the participant; escalating for a review from a senior member of the healthcare team; re-adjusting the electrodes for improved data capture; initiating further treatment or following a protocol (e.g., sepsis 6 (Levy et al., 2010)); or taking no further action. The decision to act upon the alert remained at the clinical discretion of the healthcare professional who received the alert.

Eligibility Criteria

Adults (aged over 18 years) admitted to the acute surgical unit and able to understand the participant information sheet were eligible for inclusion. Individuals with cardiac implantable electronic devices; a skin reaction to the wearable sensor or its components; an open chest wound; or those who withdrew consent were excluded from the study.

Outcome Measures

Measurable outcomes included hospital length of stay, intensive care use (planned or unplanned), and 28-days mortality. Outcomes were obtained from case note review, SensiumVitals™ data, and electronic health records.

Statistical Analysis

All values are expressed as median (range) or number (%). Categorical variables were compared using the chi-squared or Fisher’s exact test, dependent on the observations available. Non-parametric data were analysed using the Wilcoxon Rank Sum test. Odds ratio and incidence rate ratios were calculated for recorded outcome measures.

Propensity score matching (PSM) was used to estimate the effect of digital alerting on clinical outcomes accounting for confounding by the included covariates. Balanced cohorts were created using 1:1 “optimal” PSM logistic regression model (Austin, 2014). Included covariates were age, sex, ethnicity, American Society of Anaesthesiologists (ASA) grade, presenting NEWS 2 score, and comorbidities as per the Charlson Index (Armitage et al., 2010).

Balance diagnostics were conducted using standardised mean differences, with a value of ≤0.1 indicating good balance; love plots were generated to depict balance (Austin, 2014).

Data analysis was performed in RStudio version 3.6.3 (R Studio, Boston, MA, United States) with ggplot2, Matchit, gtsummary packages (Austin, 2014; Wickham et al., 2016; Sjoberg et al., 2021). A p value of <0.05 was deemed as statistically significant.

Power Considerations

Formal power calculations on the primary outcome were not possible given the lack of data. A previous study estimated sample sizes of 325–625 to be appropriate; however, the results of the recruited 226 participants were not significant (Downey C. et al., 2018). We, therefore, aimed to recruit a minimum of 600 individuals.

Owing to the COVID-19 pandemic and restructuring of the acute surgical unit, this trial concluded prematurely, limiting our original planned sample size.

Results

Baseline Demographics and Balanced Cohort Assembly

The 1:1 matching method matched the post-implementation group (n = 141) with the same number of subjects from the pre-implementation group (n = 141) with the remaining unmatched samples dropped (n = 138, Figure 1). After matching, only ethnicity: Minority Ethnic and admission type (i.e., elective or emergency) remained imbalanced. However, given the low number of participants across these variables, and the overall improvement in other ethnicity categories, this difference was not deemed meaningful. Baseline demographics of the unmatched and matched cohorts are presented in Table 1. The standardised mean differences of all covariates are displayed as a love plot in Figure 2. The median age of the entire cohort was 52 (range: 18–95) years and the median duration of wearing the sensor was 1.3 (interquartile range: 0.7–2.0) days.

FIGURE 1

FIGURE 1. Participant flow diagram.

TABLE 1

TABLE 1. Baseline demographics before and after propensity score matching.

FIGURE 2

FIGURE 2. Love plot depicting covariate balance with standardized mean differences following propensity score matching.

Response to Alerts and Clinical Outcomes

Overall, 78 alerts were generated for 46 participants. Of which, 58 alerts (33 participants) were actioned. Nursing staff acknowledged generated alerts through a designated mobile application on provided devices, a detailed breakdown of responses by abnormal vital parameter is tabulated in Table 2 for actioned alerts. Members of the research team met weekly with ward managers and senior nurses to monitor the workflow change and feedback previous alerting acknowledgement times as well as gather barriers to change and will be described separately. Briefly, however, themes relating to inappropriate resources (i.e., poor staffing levels and sudden unincentivized workflow changes) were noted. Furthermore, regular training sessions for the nursing staff to encourage use of mobile devices in responding to digital alerts was provided.

TABLE 2

TABLE 2. Action taken following abnormal vital sign (heart rate, respiratory rate, temperature) alert.

The median alert acknowledgement time was 111 (range: 1–2,146) minutes. The sizeable variation in alert acknowledgement time has been plotted in Figure 3.

FIGURE 3

FIGURE 3. Time series displaying the alert acknowledgement time by healthcare staff.

Clinical events have been summarised in Table 3. Overall, planned (odds ratio (OR): 0.49; 95% CI 0.02–5.20) and unplanned (OR: 0.49; 95% CI 0.02–5.20) intensive care admissions, 28-days mortality (OR 0.99; 95% CI 0.04–25.3), and length of stay (incidence rate ratio: 1.03; 95% CI 0.92–1.14) were similar across both cohorts, following propensity score matching.

TABLE 3

TABLE 3. Summary of outcome measures before and after propensity score matching.

Discussion

This study demonstrated similar outcome measures (i.e., hospital LOS, mortality, and ITU admissions) with the use of wearable sensors and alerting systems across an acute surgical cohort in our institution. In contrast, a recent meta-analysis reported that digital alerting reduced hospital LOS (Iqbal et al., 2021c). However, the majority of constituent studies were of low quality; moreover, the considerable variation in time taken to respond to an alert by healthcare staff, rapid turnover of participants resulting in the short duration of sensor use, and the premature conclusion of our trial may additionally explain our findings. Perceptions of healthcare staff involved in this study were largely favourable of digital solutions given the potential improvements for patient safety and reduced staff burden, despite no previous experience with telemetry or digital solutions (Joshi et al., 2022). However, this contradicts our findings of prolonged response times. This is likely to be multifactorial including changing culture of adopting innovation; inadequate resources (both time and available training) for healthcare professionals; winter-bed pressures; but, particularly in this study, the perceived usefulness by healthcare professionals and the impact of sensing technology in its current state was deemed as unincentivized additional labour given rota shortages and absence of permanent staff (Joshi et al., 2022).

Alerts generated for abnormal respiratory rates were common in our cohort, yet none of the participants required escalation for senior review and were deemed well. This false alarm phenomenon has been reported elsewhere and is a recognised limitation of impedance pneumography as a technique utilised by the sensor to measure respiratory rate (Wong et al., 2009; Downey et al., 2019). Furthermore, this may affect the perceived usefulness of sensing systems, contributing to disengagement from healthcare staff and prolonged response times, as noted in our study. Machine learning approaches have the potential to improve artefact detection (Moeyersons et al., 2021); further work is required to determine if the implementation of classification models, convolutional neural networks, or heuristic algorithms within wearable sensors can improve the accuracy of respiratory rate readings. Conversely, alerts for abnormal heart rate and temperature resulted in senior review and initiation of further treatment but the proportion of meaningful actions taken were low, suggesting that further optimisation for parameter thresholds was required and warrants further exploration. Despite this, wearable sensors were well perceived by the participants, with enhanced feelings of patient safety, comfort, and centralised monitoring (Joshi et al., 2021), in keeping with the literature (Downey et al., 2018a; Weenk et al., 2020).

Implementation of digital technologies has historically been challenging, largely due to human and organisational factors. Parallels can be drawn from the introduction and implementation of electronic health records (EHR). Although global evidence has demonstrated the improved record quality, increased administrative efficiency, and enhanced quality of care (such as reduced medication errors and higher guideline adherence) with EHR use (Nguyen et al., 2014; Campanella et al., 2016; Baumann et al., 2018), implementation across complex hospital systems has been challenging, particularly in the United Kingdom (Wachter, 2016).

One facet of complexity science, a physician’s perception of uncertainty, was linked to poor EHR use across a diverse range of medical specialties (Lanham et al., 2014). Changes to workflow, time constraints, and lack of user involvement have all been reported as major barriers to successful implementation (Nguyen et al., 2014). To draw parallels, although sensors are increasingly able to measure multiple vital parameters, not all parameters can be recorded by all sensor systems and some parameters remain intermittent (i.e., blood pressure). As a result, there remains a reliance on multiple methods for adequate early warning score calculations. This can be a source of frustration for healthcare staff and for patients requiring multiple modalities for monitoring, reducing overall healthcare efficiency.

One study reported the experience of alert fatigue for healthcare staff; the burdensome nature to carry additional devices; and inadequate training for nursing staff to interpret continuous data as barriers to successful adoption of digital alerting (Weenk et al., 2020). These factors are likely to have contributed towards the substantial variation in alert acknowledgement by healthcare staff noted in this trial. Introduction of health policies and legislation, in conjunction with apt resources, may be a meaningful way to facilitate workflow change. The passage of the Health Information Technology for Economic and Clinical Health Act in 2009 and the Meaningful Use policy, helped overcome the previously stagnant adoption of EHR (Cohen, 2016; Health IT, 2016; FastStats, 2019).

Although our pragmatic design highlights real-world applicability, it presents inherent limitations. Firstly, this study used PSM to adjust for several important variables, however additional relevant information that could affect outcomes may be missing. Secondly, the lack of randomisation makes establishing causal relationships difficult. Furthermore, clinical research was difficult to mandate resulting in an unincentivized workflow change to healthcare staff, a limitation in effectively testing the efficacy of digital alerting systems in the real world. The fast turnover of the acute surgical unit, in hindsight, likely contributed to the short length of stay and duration of sensor limiting the inference of our outcome measures and risking attrition bias. The pandemic has accelerated the adoption of digital technologies and altered perceptions favourably towards their adoption (Golinelli et al., 2020; Whitelaw et al., 2020); as this trial concluded prematurely, at the onset of COVID-19, our work may be perceived differently if it were repeated in the current climate. Additionally, the early conclusion of this work has likely resulted in the underpowering of our trial. Lastly, digital literacy, human and system factors (e.g., staffing) play a significant contributory role in successful adoption of novel digital solutions and were not fully examined in this trial.

Future research should seek to include information system evaluation frameworks that test implementation attributes, strategies, and organisational aspects during piloting of digital solutions, particularly as the pandemic has altered attitudes towards digitisation (Golinelli et al., 2020; Whitelaw et al., 2020). Indeed, sensors and alerting systems have been met favourably when used for remote monitoring of individuals suspected of COVID-19 (Iqbal et al., 2021a). Furthermore, further refinements to wearable sensors are required to offer monitoring of all vital parameters, this may aid workflow improvement and adoption. Following this, trials should test a variety of alerting mechanisms that are actionable by multiple healthcare professionals of different seniority. Our work has highlighted the need to consider organisational, system, and human factors when implementing novel digital solutions. For optimal integration, we recommend the involvement of healthcare staff during trial design when changes to workflows are expected with consideration of mandated changes; PDSA cycles for model of improvement may be a useful tool in such settings, allowing for regular evaluations (Leis and Shojania, 2017). Testing novel digital solutions through the quality improvement measures may be a more effective means of testing their real-world efficacy. Furthermore, we recommend ensuring adequate training (and re-training) is provided with the introduction of new technologies and that a variety of healthcare professionals are included in an area of the hospital with longer inpatient stay. This trial may have been perceived differently if junior doctors were responsible for acknowledging clinical alerts.

In conclusion, wearable sensors and alerting systems remain an area of growing interest, particularly in the pandemic era; as the growth of development increases, an alternative workflow favouring digitisation is likely to take precedent. For successful implementation and optimisation of novel systems, human and organisational factors should be tested in conjunction of digital solution deployment where further work should be conducted.

Data Availability Statement

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

Ethics Statement

The studies involving human participants were reviewed and approved by Yorkshire & The Humber - Leeds East Research Ethics Committee. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

FMI drafted the manuscript. Significant amendments were made by RF, MW, TK, AS, MJ, SK, HA, and AD. Statistical analyses were performed by FMI and HA. All authors approved the final manuscript.

Funding

This work was supported by a grant provided through CW+ (the official charity of Chelsea and Westminster Hospital). Infrastructure support for this research was provided by the NIHR Imperial Biomedical Research Centre (BRC) and the NIHR Imperial Patient Safety Translational Research Centre (PSTRC).

Conflict of Interest

AD is Chair of the Health Security initiative and HA is the Chief Scientific Officer at Flagship Pioneering UK Ltd. Flagship Pioneering had no role in the development, conduct or analysis of the current study.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fbioe.2022.895973/full#supplementary-material

References

Areia, C., King, E., Ede, J., Young, L., Tarassenko, L., Watkinson, P., et al. (2022). Experiences of Current Vital Signs Monitoring Practices and Views of Wearable Monitoring: a Qualitative Study in Patients and Nurses. J. Adv. Nurs. 78, 810–822. doi:10.1111/jan.15055

PubMed Abstract | CrossRef Full Text | Google Scholar

Armitage, J. N., and van der Meulen, J. H.Group (2010). On Behalf of the R. C. Of S. C. CIdentifying Co-morbidity in Surgical Patients Using Administrative Data with the Royal College of Surgeons Charlson Score. Br. J. Surg. 97, 772–781. doi:10.1002/bjs.6930

PubMed Abstract | CrossRef Full Text | Google Scholar

Austin, P. C. (2014). The Use of Propensity Score Methods With Survival Or Time-To-Event Outcomes: Reporting Measures of Effect Similar to Those Used In Randomized Experiments. Stat. Med. 33, 1242–1258. doi:10.1002/sim.5984

PubMed Abstract | CrossRef Full Text | Google Scholar

Baumann, L. A., Baker, J., and Elshaug, A. G. (2018). The Impact of Electronic Health Record Systems on Clinical Documentation Times: A Systematic Review. Health Policy 122, 827–836. doi:10.1016/j.healthpol.2018.05.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Breteler, M. J. M., KleinJan, E. J., Dohmen, D. A. J., Leenen, L. P. H., Ruurda, J. P., Blokhuis, T. J., et al. (2019). Vital Signs Monitoring with Wearable Sensors in High-Risk Surgical Patients: A Clinical Validation Study. Anesthesiology.

Google Scholar

Britain), N. P. S. A. (2007). Safer Care for the Acutely Ill Patient: Learning from Serious Incidents: The Fifth Report from the Patient Safety Observatory. National Patient Safety Agency.

Google Scholar

Buist, M., Bernard, S., Nguyen, T. V., Moore, G., and Anderson, J. (2004). Association between Clinically Abnormal Observations and Subsequent In-Hospital Mortality: a Prospective Study. Resuscitation 62, 137–141. doi:10.1016/j.resuscitation.2004.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Campanella, P., Lovato, E., Marone, C., Fallacara, L., Mancuso, A., Ricciardi, W., et al. (2016). The Impact of Electronic Health Records on Healthcare Quality: a Systematic Review and Meta-Analysis. Eur. J. Public Health 26, 60–64. doi:10.1093/eurpub/ckv122

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, J., Hillman, K., Bellomo, R., Flabouris, A., Finfer, S., and Cretikos, M. (2009). The Impact of Introducing Medical Emergency Team System on the Documentations of Vital Signs. Resuscitation 80, 35–43. doi:10.1016/j.resuscitation.2008.10.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Christofidis, M. J., Hill, A., Horswill, M. S., and Watson, M. O. (2014). Observation Charts with Overlapping Blood Pressure and Heart Rate Graphs Do Not Yield the Performance Advantage that Health Professionals Assume: An Experimental Study. J. Adv. Nurs. 70, 610–624. doi:10.1111/jan.12223

PubMed Abstract | CrossRef Full Text | Google Scholar

Cohen, M. F. (2016). Impact of the HITECH Financial Incentives on EHR Adoption in Small, Physician-Owned Practices. Int. J. Med. Inf. 94, 143–154. doi:10.1016/j.ijmedinf.2016.06.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Culliane, M., Fg, H. C., and Lucas, S. (2005). NCEPOD 2005 Report-An Acute Problem. Report. London: NCEPOD-National Confidental Enquiry into Patient Outcome and Death.

Google Scholar

Cuthbertson, B. H., Boroujerdi, M., McKie, L., Aucott, L., and Prescott, G. (2007). Can Physiological Variables and Early Warning Scoring Systems Allow Early Recognition of the Deteriorating Surgical Patient? Crit. Care Med. 35, 402–409. doi:10.1097/01.CCM.0000254826.10520.87

PubMed Abstract | CrossRef Full Text | Google Scholar

DeVita, M. A., Smith, G. B., Adam, S. K., Adams-Pizarro, I., Buist, M., Bellomo, R., et al. (2010). "Identifying the Hospitalised Patient in Crisis"-A Consensus Conference on the Afferent Limb of Rapid Response Systems. Resuscitation 81, 375–382. doi:10.1016/j.resuscitation.2009.12.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Downey, C., Brown, J. M., Jayne, D. G., and Randell, R. (2018a). Patient Attitudes towards Remote Continuous Vital Signs Monitoring on General Surgery Wards: An Interview Study. Int. J. Med. Inf. 114, 52–56. doi:10.1016/j.ijmedinf.2018.03.014

CrossRef Full Text | Google Scholar

Downey, C., Chapman, S., Randell, R., Brown, J. M., and Jayne, D. G. (2018b). The Impact of Continuous versus Intermittent Vital Signs Monitoring in Hospitals: A Systematic Review and Narrative Synthesis. Int. J. Nurs. Stud. 84, 19–27. doi:10.1016/j.ijnurstu.2018.04.013

CrossRef Full Text | Google Scholar

Downey, C., Randell, R., Brown, J., Jayne, D. G., and Jayne, D. G. (2018c). Continuous versus Intermittent Vital Signs Monitoring Using a Wearable, Wireless Patch in Patients Admitted to Surgical Wards: Pilot Cluster Randomized Controlled Trial. J. Med. Internet Res. 20, e10802. doi:10.2196/10802

PubMed Abstract | CrossRef Full Text | Google Scholar

Downey, C. L., Tahir, W., Randell, R., Brown, J. M., and Jayne, D. G. (2017). Strengths and Limitations of Early Warning Scores: A Systematic Review and Narrative Synthesis. Int. J. Nurs. Stud. 76, 106–119. doi:10.1016/j.ijnurstu.2017.09.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Downey, C., Ng, S., Jayne, D., and Wong, D. (2019). Reliability of a Wearable Wireless Patch for Continuous Remote Monitoring of Vital Signs in Patients Recovering from Major Surgery: a Clinical Validation Study from the TRaCINg Trial. BMJ Open 9, e031150. doi:10.1136/bmjopen-2019-031150

PubMed Abstract | CrossRef Full Text | Google Scholar

Edwards, M., McKay, H., Van Leuvan, C., and Mitchell, I. (2010). Modified Early Warning Scores: Inaccurate Summation or Inaccurate Assignment of Score? Crit. Care 14, P257. doi:10.1186/cc8489

CrossRef Full Text | Google Scholar

FastStats (2019). Electronic Medical Records/Electronic Health Records (EMRs/EHRs). Available at: https://www.cdc.gov/nchs/fastats/electronic-medical-records.htm (Accessed July 20, 2021).

Google Scholar

Findlay, G., Shotton, H., and Mason, K. (2012). Time to Intervene? A Review of Patients Who Underwent Cardiopulmonary Resuscitation as a Result of an In-Hospital Cardiorespiratory Arrest. National Confidential Enquiry into Patient Oucome and Death.

Google Scholar

Goldhill, D. R., White, S. A., and Sumner, A. (1999). Physiological Values and Procedures in the 24 H before ICU Admission from the Ward. Anaesthesia 54, 529–534. doi:10.1046/j.1365-2044.1999.00837.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Golinelli, D., Boetto, E., Carullo, G., Nuzzolese, A. G., Landini, M. P., and Fantini, M. P. (2020). Adoption of Digital Technologies in Health Care during the COVID-19 Pandemic: Systematic Review of Early Scientific Literature. J. Med. Internet Res. 22, e22280. doi:10.2196/22280

PubMed Abstract | CrossRef Full Text | Google Scholar

Health IT (2016). Quick Stats. Available at: https://dashboard.healthit.gov/quickstats/quickstats.php (Accessed July 20, 2021).

Google Scholar

Hernandez-Silveira, M., Ahmed, K., Ang, S.-S., Zandari, F., Mehta, T., Weir, R., et al. (2015). Assessment of the Feasibility of an Ultra-low Power, Wireless Digital Patch for the Continuous Ambulatory Monitoring of Vital Signs. BMJ Open 5, e006606. doi:10.1136/bmjopen-2014-006606

PubMed Abstract | CrossRef Full Text | Google Scholar

Hollis, R. H., Graham, L. A., Lazenby, J. P., Brown, D. M., Taylor, B. B., Heslin, M. J., et al. (2016). A Role for the Early Warning Score in Early Identification of Critical Postoperative Complications. Ann. Surg. 263, 918–923. doi:10.1097/SLA.0000000000001514

PubMed Abstract | CrossRef Full Text | Google Scholar

Iqbal, F. M., Joshi, M., Davies, G., Khan, S., Ashrafian, H., and Darzi, A. (2021a). The Pilot, Proof of Concept REMOTE-COVID Trial: Remote Monitoring Use in Suspected Cases of COVID-19 (SARS-CoV 2). BMC Public Health 21, 1–8. doi:10.1186/s12889-021-10660-9

CrossRef Full Text | Google Scholar

Iqbal, F. M., Joshi, M., Khan, S., Ashrafian, H., and Darzi, A. (2021b). Implementation of Wearable Sensors and Digital Alerting Systems in Secondary Care: Protocol for a Real-World Prospective Study Evaluating Clinical Outcomes. JMIR Res. Protoc. 10, e26240. doi:10.2196/26240

PubMed Abstract | CrossRef Full Text | Google Scholar

Iqbal, F. M., Lam, K., Joshi, M., Khan, S., Ashrafian, H., and Darzi, A. (2021c). Clinical Outcomes of Digital Sensor Alerting Systems in Remote Monitoring: a Systematic Review and Meta-Analysis. npj Digit. Med. 4, 1–12. doi:10.1038/s41746-020-00378-0

CrossRef Full Text | Google Scholar

Joshi, M., Archer, S., Morbi, A., Arora, S., Kwasnicki, R., Ashrafian, H., et al. (2021). Short-Term Wearable Sensors for In-Hospital Medical and Surgical Patients: Mixed Methods Analysis of Patient Perspectives. JMIR Perioper. Med. 4, e18836. doi:10.2196/18836

PubMed Abstract | CrossRef Full Text | Google Scholar

Joshi, M., Archer, S., Morbi, A., Ashrafian, H., Arora, S., Khan, S., et al. (2022). Perceptions on the Use of Wearable Sensors and Continuous Monitoring in Surgical Patients: Interview Study Among Surgical Staff. JMIR Form. Res. 6, e27866. doi:10.2196/27866

PubMed Abstract | CrossRef Full Text | Google Scholar

Joshi, M., Ashrafian, H., Arora, S., Khan, S., Cooke, G., and Darzi, A. (2019). Digital Alerting and Outcomes in Patients with Sepsis: Systematic Review and Meta-Analysis. J. Med. Internet Res. 21, e15166. doi:10.2196/15166

PubMed Abstract | CrossRef Full Text | Google Scholar

Kenzaka, T., Okayama, M., Kuroki, S., Fukui, M., Yahata, S., Hayashi, H., et al. (2012). Importance of Vital Signs to the Early Diagnosis and Severity of Sepsis: Association between Vital Signs and Sequential Organ Failure Assessment Score in Patients with Sepsis. Intern. Med. 51, 871–876. doi:10.2169/internalmedicine.51.6951

PubMed Abstract | CrossRef Full Text | Google Scholar

Lanham, H. J., Sittig, D. F., Leykum, L. K., Parchman, M. L., Pugh, J. A., and McDaniel, R. R. (2014). Understanding Differences in Electronic Health Record (EHR) Use: Linking Individual Physicians' Perceptions of Uncertainty and EHR Use Patterns in Ambulatory Care. J. Am. Med. Inf. Assoc. 21, 73–81. doi:10.1136/amiajnl-2012-001377

CrossRef Full Text | Google Scholar

Leenen, J. P. L., Leerentveld, C., van Dijk, J. D., van Westreenen, H. L., Schoonhoven, L., and Patijn, G. A. (2020). Current Evidence for Continuous Vital Signs Monitoring by Wearable Wireless Devices in Hospitalized Adults: Systematic Review. J. Med. Internet Res. 22, e18636. doi:10.2196/18636

PubMed Abstract | CrossRef Full Text | Google Scholar

Leis, J. A., and Shojania, K. G. (2017). A Primer on PDSA: Executing plan–Do–study–act Cycles in Practice, Not Just in Name. BMJ Qual. Saf. 26, 572. doi:10.1136/bmjqs-2016-006245

PubMed Abstract | CrossRef Full Text | Google Scholar

Levy, M. M., Dellinger, R. P., Townsend, S. R., Linde-Zwirble, W. T., Marshall, J. C., Bion, J., et al. (2010). The Surviving Sepsis Campaign: Results of an International Guideline-Based Performance Improvement Program Targeting Severe Sepsis. Intensive Care Med. 36, 222–231. doi:10.1007/s00134-009-1738-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Luettel, D., Beaumont, K., and Healey, F. (2007). Recognising and Responding Appropriately to Early Signs of Deterioration in Hospitalised Patients, 21. National Patient Safety Agency.

Google Scholar

McQuillan, P., Pilkington, S., Allan, A., Taylor, B., Short, A., Morgan, G., et al. (1998). Confidential Inquiry into Quality of Care before Admission to Intensive Care. Bmj 316, 1853–1858. doi:10.1136/bmj.316.7148.1853

PubMed Abstract | CrossRef Full Text | Google Scholar

Moeyersons, J., Morales, J., Seeuws, N., van Hoof, C., Hermeling, E., Groenendaal, W., et al. (2021). Artefact Detection in Impedance Pneumography Signals: A Machine Learning Approach. Sensors 21, 2613. doi:10.3390/s21082613

PubMed Abstract | CrossRef Full Text | Google Scholar

Nguyen, L., Bellucci, E., and Nguyen, L. T. (2014). Electronic Health Records Implementation: an Evaluation of Information System Impact and Contingency Factors. Int. J. Med. Inf. 83, 779–796. doi:10.1016/j.ijmedinf.2014.06.011

CrossRef Full Text | Google Scholar

NICE, T. C. for C. P. (2007). Acutely Ill Patients in Hospital: Recognition of and Response to Acute Illness in Adults in Hospital. NICE clincial guideline, 50.

Google Scholar

Ridley, S. (2005). The Recognition and Early Management of Critical Illness. Ann. R. Coll. Surg. Engl. 87, 315–322. doi:10.1308/003588405X60669

PubMed Abstract | CrossRef Full Text | Google Scholar

Royal College of Physicians (2017). National Early Warning Score (NEWS) 2 | RCP London. NEWS 2.

Google Scholar

Sjoberg, D. D., Whiting, K., and Curry, M. (2021). Reproducible Summary Tables with the Gtsummary Package. R J. doi:10.32614/rj-2021-053

CrossRef Full Text | Google Scholar

Smith, G. B. (2010). In-hospital Cardiac Arrest: Is it Time for an In-Hospital 'chain of Prevention'? Resuscitation 81, 1209–1211. doi:10.1016/j.resuscitation.2010.04.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Tarassenko, L., Hann, A., and Young, D. (2006). Integrated Monitoring and Analysis for Early Warning of Patient Deterioration. Br. J. Anaesth. 97, 64–68. doi:10.1093/bja/ael113

PubMed Abstract | CrossRef Full Text | Google Scholar

Wachter, R. (2016). Making IT Work: Harnessing the Power of Health Information Technology to Improve Care in England. London, UK: Department of Health.

Google Scholar

Weenk, M., Bredie, S. J., Koeneman, M., Hesselink, G., van Goor, H., and van de Belt, T. H. (2020). Continuous Monitoring of Vital Signs in the General Ward Using Wearable Devices: Randomized Controlled Trial. J. Med. Internet Res. 22, e15471. doi:10.2196/15471

PubMed Abstract | CrossRef Full Text | Google Scholar

Wells, C. I., Xu, W., Penfold, J. A., Keane, C., Gharibans, A. A., Bissett, I. P., et al. (2022). Wearable Devices to Monitor Recovery after Abdominal Surgery: Scoping Review. BJS Open 6. zrac031. doi:10.1093/bjsopen/zrac031

PubMed Abstract | CrossRef Full Text | Google Scholar

Whitelaw, S., Mamas, M. A., Topol, E., and Van Spall, H. G. C. (2020). Applications of Digital Technology in COVID-19 Pandemic Planning and Response. Lancet Digital Health 2, e435–e440. doi:10.1016/S2589-7500(20)30142-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Wickham, H., Chang, W., and Wickham, M. H. (2016). Package ‘ggplot2. Create Elegant Data Vis. Using Gramm. Graph. Version 2, 1–189. doi:10.1111/j.1541-0420.2011.01616.x

CrossRef Full Text | Google Scholar

Wong, A. C. W., McDonagh, D., Omeni, O., Nunn, C., Hernandez-Silveira, M., and Burdett, A. J. (2009). “Sensium: an Ultra-Low-Power Wireless Body Sensor Network Platform: Design & Application Challenges,” in 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE), 6576. doi:10.1109/IEMBS.2009.5334001

CrossRef Full Text | Google Scholar