Skip to main content

REVIEW article

Front. Digit. Health, 17 May 2022
Sec. Health Informatics
This article is part of the Research Topic Mobile and Wearable Systems for Health Monitoring View all 14 articles

Potentials and Challenges of Pervasive Sensing in the Intensive Care Unit

  • 1Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
  • 2Department of Medicine, University of Florida, Gainesville, FL, United States
  • 3Department of Anesthesiology, University of Florida, Gainesville, FL, United States
  • 4Department of Medicine, University of Florida, Gainesville, FL, United States

Patients in critical care settings often require continuous and multifaceted monitoring. However, current clinical monitoring practices fail to capture important functional and behavioral indices such as mobility or agitation. Recent advances in non-invasive sensing technology, high throughput computing, and deep learning techniques are expected to transform the existing patient monitoring paradigm by enabling and streamlining granular and continuous monitoring of these crucial critical care measures. In this review, we highlight current approaches to pervasive sensing in critical care and identify limitations, future challenges, and opportunities in this emerging field.

Current Critical Monitoring Paradigm

Critically ill patients in the intensive care unit (ICU) require constant monitoring. Currently, “continuous” monitoring of ICU patients is limited to automated vital sign measurements such as heart rate, blood pressure, body temperature, oxygen saturation, and respiratory rate. Other monitoring activities are limited by nurse availability for observing and documenting events, e.g., documenting falls or self-extubation events or detecting any exacerbation in important clinical indices such as mobility, agitation, pain, and consciousness. At present, assessment of these indices heavily relies on manual and repetitive examinations by nurses, leading to increased work pressure and the potential for burnout (1, 2). These manual indices also suffer from human error in data entry, observer subjectivity, and limited measurement granularity (35).

A more granular and continuous assessment of such critical care indices would enable a more comprehensive view of patient health. For example, granular functional status and behavioral assessment could lead to timely and personalized interventions based on data-driven guidelines. The need for continuous and automated monitoring of ICU patients has led researchers to incorporate non-traditional methodologies such as computer vision, wearable sensing technology, and various analytics algorithms (6). A comprehensive picture of the current state of the research in this domain will help outline the next steps and point out some of the questions that need to be answered. This work evaluates the feasibility of such monitoring approaches that are amenable to pervasive sensing in the ICU.

In the following sections, we detail current applications of pervasive sensing in ICU patient care settings. We then outline the knowledge gap in the literature, discuss current limitations, and highlight potential avenues for future research in augmenting traditional intensive patient care with pervasive sensing technology.

Recent Advances in Critical Care Monitoring

Currently, monitoring ICU patients' functional status and behavioral aspects is limited in both granularity and information-richness. Pervasive sensing of the patient and their surrounding environment can provide a more comprehensive, continuous assessment of patient status. It can aid in quantifying patient health trajectories during the ICU stay. Two of the main avenues of research for pervasive sensing in the ICU involve using wearable accelerometers or computer vision devices, such as thermal or depth cameras, for monitoring the status of the patient and their environment. Wearable accelerometer devices, often resembling wristwatches, are lightweight, non-invasive, and easy to use. They allow for various computational analyses, do not pose any safety or comfort concerns for the patient, and do not impede the care procedures in the ICU. Wearable sensors have been previously used for quantifying human mobility and activity monitoring in various populations, and numerous analytic approaches showcase their potential uses for ICU patients (79). Applications of wearable accelerometers in the critical care setting are wide-ranging, including but not limited to physical activity (1013) and energy expenditure monitoring (14), sleep detection (8, 15), agitation or sedation monitoring (16, 17), physiological signal monitoring (18, 19), fall detection (20, 21), delirium detection and subtyping (9, 22), sepsis subtyping (12), and frailty determination (23).

Another potential avenue for pervasive ICU monitoring involves the application of computer vision techniques. Computer vision provides a means for non-contact sensing of the patient and their surroundings in the ICU, providing rich information on several physical functions and behavioral aspects. Possible applications of computer vision in the critical care setting fall into two categories: (a) healthcare team observation, such as measuring nursing workload (24) or monitoring hand hygiene (25), and (b) patient monitoring. This article focuses on the latter—computer vision applications for assessing patients and their environment. Previous research has demonstrated the potential applications of computer vision for fall detection (26, 27), sleep pose detection (28), agitation detection (29), physical activity monitoring (30, 31), head pose detection (22), physiological signal monitoring (32), and visitation detection (22, 33) in hospital settings (Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. Applications of pervasive sensing for monitoring ICU patients, iconfinder.com.

Physical Function Monitoring

ICU patients spend most of their time lying in bed, with significantly less time sitting in a chair, standing, or walking (22, 34). Patients' limited physical activity in the ICU has been linked with disruptions in circadian rhythm, a higher risk of delirium, and adverse outcomes in terms of cognitive and functional status at the time of hospital discharge and in the long term. Efforts at introducing physical therapy and early mobilization improve the patients' mobility and clinical outcomes such as delirium days, discharge disposition, and the risk of readmission or death (3538). However, currently, there is a need for an objective, continuous, and accurate evaluation method to quantify the effect of rehabilitation practices. Additionally, such quantitative measures could be used to evaluate the association between a patient's activity levels and their outcomes during and after their ICU stay.

Existing clinical routine measurements of patients' mobility and physical status consist of limited standardized observational scores such as the ICU Mobility Scale (IMS) (39, 40). These observational evaluations aim to quantify patient mobility (40), but they still lack granularity and objectivity. Additionally, they provide limited information about mobility patterns' complex and dynamic nature throughout the ICU stay.

Computer vision and wearable accelerometer devices can provide more granular, objective, and continuous information on functional activity. Both approaches have been used to study physical activity in clinical settings to examine the association with health outcomes such as delirium or sepsis. However, there is limited research using computer vision or accelerometers in the critical care domain (Table 1), despite the high prevalence of sepsis or delirium in ICU patients. For example, delirium prevalence in specialized ICUs can be as high as 87%, and sepsis prevalence can be as high as 39% (46, 47).

TABLE 1
www.frontiersin.org

Table 1. Peer-reviewed publications using wearable devices and computer vision in monitoring patients.

Physical Activity

Recent efforts in the field of computer vision have applied deep learning techniques to build models for automated physical activity and posture recognition. Different camera types have been used to detect patient mobility, including Red-Green-Blue (RGB) cameras, depth cameras, and cameras that capture both color and depth images, such as the Microsoft Kinect device. Multi-view settings using multiple cameras installed at different positions also have been used for capturing a more encompassing view of the patient room (28, 31, 41, 42).

Generally, automated detection of patient mobility using computer vision first requires patient identification in the scene. After patient recognition, manually annotated datasets are used to train the model to classify patient pose and mobility. Such systems have been able to accurately classify patients' high-level activities such as nothing in bed (doing nothing, lying in bed), in-bed activity, out-of-bed activity, and walking (30), and postures such as lying in bed, sitting on the bed, sitting on the chair, and standing (22) in the ICU. Depth camera-based systems have been able to classify four provider activities: “moving the patient into and out of bed” and “moving the patient into and out of a chair” without incorporating the challenging step of patient recognition (48, 49).

While computer vision techniques can identify a patient's posture, accelerometer devices can quantify the movement intensity. Wearable devices allow for convenient data collection and analysis since they provide continuous and patient-specific data streams. Wearable accelerometers have been used for examining physical activity patterns in different cohorts in various ICU settings, including delirium patients, sepsis patients, and patients with unilaterally motor impairment (1013, 43, 50).

Energy Expenditure

Building on activity intensity detection, wearable accelerometer devices have been used for determining energy expenditure. Previously energy expenditure estimation of accelerometer devices has been validated in the healthy adult population (14). However, it has been shown that energy expenditure is overestimated in ICU patients by comparing mechanical ventilation with indirect calorimetry. The current methodology of estimation of energy expenditure relies on the detection of physical activity. It does not incorporate physiological conditions such as fever with shivering that may alter the energy expenditure (51). Accurate estimation of energy expenditure in ICU patients enables optimizing enteral feeding details to prevent overfeeding and underfeeding, both of which increase the risk of infection and prolonged weaning from mechanical ventilation (52).

Frailty

Accelerometer devices have also been used to detect frailty (23), a geriatric syndrome defined as “a clinically recognizable state of increased vulnerability, resulting from the aging-associated decline in reserve and function across multiple physiologic systems such that the ability to cope with every day or acute stressors is compromised” (53). There is increasing evidence of frailty being an indicator for decreased reserve and increased vulnerability in critical care patients (54, 55). Frailty has been shown to increase the risk of both adverse events such as death and discharge to skilled nursing homes and prolonged hospitalization and loss of independence after hospital discharge (56, 57).

Falls

ICU patients experience decreased functional status and more muscle atrophy (58) exacerbated by minimal physical activity. They also suffer from impaired consciousness and attention (59), further compounded by disrupted circadian rhythm and sedation. While previous research has demonstrated the importance of physical activity in ICU patients, the increased risk of falls is brought on by confusion and agitation (60). Computer vision can detect falls in hospital settings (26, 27, 44, 45), as well as accelerometer-based monitoring systems (20, 21). Still, these approaches have not been adequately investigated in the ICU.

Despite the importance of accurate assessment and monitoring of physical activity, energy expenditure, fall risk, and frailty in ICU patients, few studies have investigated the use of pervasive sensing to facilitate assessment and monitoring.

Behavioral Monitoring

Facial Expressions

Behavioral indices such as pain facial expressions are different from physical activity indices. They do not elucidate gross variations in patients and thus could elude the nurses' observation. Facial expressions can also be influenced by sedative-hypnotics and analgesics commonly used in the ICU. While there is no validated facial expressions score in critical care, a few preliminary studies have examined anxiety-related facial expressions. Anxiety is highly prevalent in critical care patients (61, 62). However, it is rarely screened in routine care settings in the ICU (62). Computer vision approaches have been used for anxiety detection (63, 64), focusing on features such as head movement, mouth, and eye movement, and heart activity as indicators of anxiety. Patient head pose angle and variability have also been studied using computer vision and associated with pain and agitation indicators (22, 6567).

Pain

Continuous and objective monitoring of patient pain in the ICU, including for non-communicative patient populations, can pave the way for real-time adjustments to analgesics for optimal patient care, patient experience, and better health outcomes.

While wearable accelerometers have previously been used for studying pain (68), no study has investigated the relationship between pain and physical activity in the ICU settings, leaving unanswered the question of the complicated relationship between mobility, mental agitation, stress, and pain. The issue of pain in the ICU has many aspects. In addition to the potential effect of pain on a patient's physical activity, facial expressions and physiological signals may also be affected by pain. Previous work has investigated the feasibility of pain detection using vital signs (69, 70). Although this approach uses data routinely collected in the ICU, it has not shown strong specificity for pain detection. Formalizing facial expression of pain using facial action units (71) and advances in deep learning and computational power available have made it more plausible to move toward automated detection of facial expression of pain in the ICU. Facial expressions are assessed manually using several behavioral pain scales such as Non-verbal Pain Scale (NVP), Behavioral Pain Scale (BPS), and Critical Care Pain Observation Tool (CPOT), particularly for non-communicative patients (7274). Researchers have used deep learning approaches to detect facial expressions of pain and to recognize individual facial action units associated with pain. Still, robust automated detection of pain in the ICU scene based on facial information requires more research and validation (7579).

Agitation/Sedation

Agitation is prevalent in the ICU and is a large factor in conditions such as delirium (80). Current methods for assessing delirium rely on transient rather than continuous assessment, which is an important limitation given the waxing and waning characteristics which help define delirium. Over-sedation has been shown to lengthen ICU duration and put a patient at higher risk for delirium (81). In comparison, under-sedation has been linked with increased agitation and a higher risk of self-extubation (82, 83). Optimizing sedation to better control patients' agitation may lower the patient's risk of removing endotracheal tubes (84). Similar to pain, accurate detection of a patient's agitation and sedation levels will improve the administration of sedative interventions to optimize clinical decisions. Previous research has used sensors for monitoring agitation in critical care settings. Agitation detection methods have shown strong performance using accelerometers (16, 17, 85), image-based approaches (29), and pupillometric video devices (86). Using wearable devices to study anxiety, researchers used Google Glass to discover that heart rate, but not spontaneous blink rate, changes in anxious patients (87).

Sleep Detection

Previous studies have shown generally poor sleep quality in critical care settings (88). Sleep disruption in the ICU has been linked to various factors, including but not limited to the type and severity of the underlying medical condition, round the clock health care activities, enteral feeding, medication side effects, lack of natural light exposure and noise levels, and general disruptions to patients' circadian rhythm (8890).

Sleep disturbance in ICU patients has been studied to determine its effect on patient outcomes and recovery (91) and has been shown to increase the risk of a longer stay in the ICU, worse discharge outcomes, impaired defense mechanism, and sleep disturbances that persist or develop after discharge (90). Determining a patient's sleep quality during their stay in the ICU allows for evaluating the effectiveness of the administered sleep hygiene interventions. Polysomnography, as the gold standard for studying sleep, has previously been investigated in ICU patients. However, polysomnography data require interpretation and might not be feasible for continuous data collection throughout the patient's stay in the ICU since it typically includes several EEG leads, electro-oculography, and chin electromyography (92, 93).

Accelerometer devices have been evaluated in quantifying sleep in healthy populations (15). However, previous studies have shown that they overestimate sleep in the ICU settings, possibly because the implemented sleep detection algorithms rely on a lack of physical activity in determining sleep events. ICU patients typically have low activity throughout the day, resulting in fractured sleep and shallower sleep stages (8). Other researchers have used computer vision to detect sleep pose, but these studies have been investigated based on data from healthy adults, limiting the generalizability of their performance to the ICU setting (28, 94).

Environmental Monitoring

ICU patients spend most of their ICU stay in one room, leaving the room only for medical procedures. Information about the ICU room environment can enhance our understanding of possible contributing factors to patients' recovery speed. Wearable accelerometer devices are more suited for monitoring patients' physical activity, but they do not capture any information about patients' surroundings. Computer vision techniques offer additional opportunities for capturing and studying the effects of environmental factors on patients' recovery trajectories.

Visitation Detection

To encourage sleep hygiene, hospitals generally implement official guidelines for regulating the presence of visitors in the ICU. However, visitations and interactions with the environment may be beneficial in improving patients' experience by reducing their anxiety, leading to a lowered risk of delirium and an overall more positive experience during their ICU stay (95, 96). Accurate detection of the number of visitors and healthcare personnel in the room and environmental factors such as a room's noise and light at all hours allows for quantifying the effects of such disruptions on patients' sleep quality and circadian rhythm integrity. Computer vision has been used to determine the number of people in ICU care rooms (31, 33, 97) to understand the association between visitation and clinical care disruptions to patients with patients' sleep hygiene and outcomes. Such information could assist in developing more accurate evidence-based visitation and sleep quality guidelines for ICU patients.

Light and Noise Monitoring

Light and noise intensity levels are primary contributors to sleep deprivation and fragmentation in the ICU (91). Previous studies have demonstrated the feasibility of using affordable light and noise intensity sensors in ICU rooms (22, 98). Several studies using noise intensity sensors in the ICU have determined that noise level frequently surpasses the levels recommended by the World Health Organization (WHO) (99, 100). Various sleep hygiene interventions in the ICU population incorporate light and noise exposure limits with mixed results in efficacy. Accurate, continuous light and noise intensity measures can enhance our understanding of the effect of environmental factors on patient sleep and the efficacy of sleep hygiene guidelines (90).

Non-Contact Vital Sign Monitoring

In addition to novel physical activity and behavioral indices, the use of computer vision and wearable devices has enabled non-contact monitoring of vital signs such as heart rate and blood pressure in the ICU. Such devices could remove the need for electrodes and cuff-based devices sensitive to movement artifacts, prone to detachment, and restricting patient movement. Recent research in computer vision and wearable devices has focused on the feasibility of non-contact monitoring of vital signs, including the use of RGB and thermal cameras for contactless estimation of heart rate, blood pressure, blood oxygen saturation, and respiration rate in research, hospital and ICU settings [e.g., (32, 101106)]. Wearable devices have been used for measuring heart rate, oxygen saturation, and blood pressure in hospital and ICU patients [e.g., (18, 19, 107)].

Post-Discharge Monitoring

Critical care patients often require longitudinal monitoring and follow-up visits after discharge from the hospital. Patients' discharge destination can vary depending on the health status, ranging from home and home care for more stable patients to hospice for those who need more care with a lower chance for recovery. While clinicians have access to many tools to assess patients and determine a prognosis, current assessments do not extend well to post-discharge monitoring, resulting in less quantifiable information about post-discharge recovery (108). Computer vision approaches are not suitable in these scenarios due to technical and especially privacy concerns. However, wearable sensors can be used for physical activity monitoring and patient recovery (109), facilitating more comprehensive evaluations between follow-up visits. There is currently limited research on using this methodology to monitor the improvement in patients' functional status in free-living settings among survivors of critical illness (109111). With the increasing popularity of accelerometer-equipped smartwatches, it is also possible to monitor physical activity before and after a patient's ICU stay to examine its relation with health recovery.

Technical Challenges and Future Directions

While the current body of literature shows strong potential for using these novel approaches in critical care for faster, more personalized, and more accurate clinical decisions, several challenges need to be addressed (Figure 2).

FIGURE 2
www.frontiersin.org

Figure 2. Directions of future research to enable effective and reliable pervasive monitoring in the ICU.

Ethical and Privacy Concerns

Deep learning methods discussed in many of the computer vision-based studies mentioned in this review require large, labeled datasets for training and validation. The developed models need to be validated in diverse populations in ICU settings and consider age, gender, primary diagnosis, and race. However, ethical and legal reasons rightly prevent the construction of public datasets to protect the privacy of patients, their visitors, and the healthcare team (112). Existing Privacy guidelines typically mandate deidentification and temporary recordings, while the current state of research still requires raw recordings of the ICU room for post-event annotations and analysis. While research in this direction could potentially facilitate the clinical workflow, researchers should be cognizant of the privacy implications and the tradeoff between privacy and technological benefits.

Computer Vision

An essential intermediate step in several computer vision approaches is detecting a patient in the room of each video frame. Previous research (113115) has shown promising results in facial recognition in each single frame or tracking the patient face during the recording, but most of these studies are validated on an ideal frontal full-face view of a patient's face or with standard lighting. Real-world ICU rooms may be crowded, with varying degrees of lighting and numerous objects that could partially obscure the patient's face, such as ventilators or oxygen masks. Patient face identification will be even more challenging due to variations in the face angle and obscuring elements such as facial hair or glasses. Improved patient recognition adapted to the ICU setting will make computer vision solutions more robust. Because of the variable location of the bed and patient, the ideal developed methodology should be agnostic to the bed/patient location and position.

Sleep Detection

Sleep detection methods still require further research for reliable use in ICU patients. Future approaches may focus on multimodal models and using wearable sensors to collect information on activity, heart rate, and body temperature. Current wearable activity sensors determine sleep based on a lack of activity and wake periods, but this does not account for the minimal activity of the ICU patients, thus resulting in low specificity.

Pain Assessment

Researchers also need to consider the effect of pain relief medications, nociceptive generators, and interindividual differences in pain processing in studying patients' pain. However, this is a challenging concept since medication effect changes over time depending on pharmacokinetics such as age, sex, weight, body surface area, renal and hepatic function, fluid shifts, medication dosage, time since administration, administration route, and drug-drug interactions. This complexity often increases for continuous infusions of medications. Additionally, model development relies on patient self-report and nurses' observation for non-verbal patients. The uncertainty regarding how to translate pain intensity assessments into objective, rational clinical decisions for analgesic therapies that reduce pain intensity and patient risk further complicates developing generalizable and reliable models. There is also a need to integrate outcomes pertaining to pain, analgesic requirement, and “patient function” to provide a more holistic perspective on recovery trajectories.

Wearable Devices

Another implementation challenge for using wearable devices in the ICU is the requirement of current devices to be tightly secured on the skin to better capture patients' subtle movements. This may prove to be an inconvenience for some patients, as continuous contact with the skin might cause irritation or even could pose risks for infection, tissue ischemia, compartment syndrome, and wound breakdown. Furthermore, for patients with medical equipment on their wrists, wrist-worn accelerometer devices might not be an option unless future medical equipment includes built-in accelerometers.

Forward-Compatibility

The inclusion of multiple data streams for different patient care tasks using pervasive sensing also requires generalizability, interoperability, scalability, and reliability of the systems. Interoperable and generalizable systems can operate together and be incorporated into different monitoring platforms, while scalable systems will accommodate collecting data from a larger number of patients. The accompanying analytical algorithms need to be adaptable for new hardware choices. Moreover, there must be a consensus on the measured variables better to evaluate the performance of proposed methods and devices. Ultimately, the positive impact of such systems in critical care needs to be rigorously assessed and validated.

Model Validation With Minimal Data Burden

To improve the adoption of pervasive sensing in routine care in the ICU, developed models and devices should be easily manageable by the care team with minimal or no required training. Any developed model should be validated to reduce the false alarm rate in the ICU -as is investigated with vital sign-based alarms (116)-and should optimize the visualization approach to prevent data fatigue. The presentation of new information should be determined by considering the preferences of the physicians and their team and could include facets such as a daily summary, continuous display or separate tabs, or simple alarms for specific, pre-determined events.

Real-Time Models

Ultimately, any developed detection and prediction model should report a patient's status in real-time to allow the ICU team to implement timely interventions, such as incorporating more active physical therapy regimens, improving sleep hygiene routines, and adapting administered medications. The necessary communications infrastructure and reporting medium should be optimized to avoid alarm fatigue to the already overburdened ICU nurses.

Conclusion

Patients in the ICU have diverse and heterogeneous health backgrounds, which necessitate more personalized and dynamic treatments and interventions. This calls for developing monitoring methodologies that provide continuous, objective, and quantifiable patient information. Traditional monitoring of vital signs, nursing observations, and self-reported pain scores is essential but does not provide a comprehensive view of the patient's overall health status.

Advances in computation and computer vision fields and the development of accurate measuring devices such as wearable accelerometers have introduced more options for patient monitoring in-home, community, and hospital settings. The acute nature of health events in the ICU can benefit from pervasive, passive sensing methodologies that reduce nurses' workload and replace some of the tasks that require repetition of measurements, such as detection of pain and agitation. Moreover, pervasive sensing technology can enable measuring indices that were not previously recorded, including a patient's physical activity level, facial expressions, and head pose variations. Classification algorithms trained on the data from similar scenarios may allow for more timely prediction of adverse events such as falls and delirium, enabling the healthcare team to prevent their occurrence.

Many of the proposed domains of the ABCDEF bundle,1 an evidence-based guide for clinicians to improve ICU patients' recovery and outcomes that emphasize pain assessment, prevention, and management (117), require accurate monitoring of the patients during their stay in the ICU. Continuous monitoring of pain levels using computer vision approaches will be helpful for continuous and accurate pain assessment and ultimately for real-time adaptation of pain medications. The choice of analgesia and sedation is another domain in this guideline that can benefit from continuous monitoring of the patients' sedation levels to personalize analgesia choice. Quantifying patients' mobility also improves the evaluation of the effectiveness of the administered mobility and exercise regimens. Moreover, the use of accelerometer and vision sensors to detect delirium can improve delirium assessments, as proposed in the ABCDEF bundle.

Author Contributions

AD and PR developed the concept for the study. AD drafted the manuscript and designed and created the figures. PR substantially revised the manuscript and revised the figures. BS, AB, and PT substantially revised the manuscript. All authors were approved the final manuscript.

Funding

PR was supported by 5R01AG055337 from National Institute of Aging (NIH/NIA), CAREER award 1750192 from the National Science Foundation, 1R01EB029699 and 1R21EB027344 from the National Institute of Biomedical Imaging and Bioengineering (NIH/NIBIB), R01GM-110240 from the National Institute of General Medical Science (NIH/NIGMS), 1R01NS120924 from the National Institute of Neurological Disorders and Stroke (NIH/NINDS), and R01 DK121730 from the National Institute of Diabetes and Digestive and Kidney Diseases (NIH/NIDDK). AB was supported R01 GM110240 from the National Institute of General Medical Sciences (NIH/NIGMS), R01 EB029699 and R21 EB027344 from the National Institute of Biomedical Imaging and Bioengineering (NIH/NIBIB), R01 NS120924 from the National Institute of Neurological Disorders and Stroke (NIH/NINDS), and by R01 DK121730 from the National Institute of Diabetes and Digestive and Kidney Diseases (NIH/NIDDK). PT was supported by 5R01GM114290 and 5R01AG055337.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

1. ^Assess, Prevent, and Manage Pain, Both Spontaneous Awakening Trials (SAT) and Spontaneous Breathing Trials (SBT), Choice of analgesia and sedation, Delirium: Assess, Prevent, and Manage, Early mobility and Exercise, and Family engagement and empowerment.

References

1. Parry SM, Granger CL, Berney S, Jones J, Beach L, El-Ansary D, et al. Assessment of impairment and activity limitations in the critically ill: a systematic review of measurement instruments and their clinimetric properties. Intensive Care Med. (2015) 41:744–62. doi: 10.1007/s00134-015-3672-x

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Thrush A, Rozek M, Dekerlegand JL. The clinical utility of the functional status score for the intensive care unit (FSS-ICU) at a long-term acute care hospital: a prospective cohort study. Phys Ther. (2012) 92:1536–45. doi: 10.2522/ptj.20110412

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Drews FA. Patient monitors in critical care: Lessons for improvement. In: Kerm H, James BB, Margaret AK, Mary LG, editors. Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 3: Performance and Tools). Rockville, MD: Agency for Healthcare Research and Quality (US).

PubMed Abstract | Google Scholar

4. Eltaybani S, Mohamed N, Abdelwareth M. Nature of nursing errors and their contributing factors in intensive care units. Nurs Crit Care. (2019) 24:47–54. doi: 10.1111/nicc.12350

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Phillips ML, Kuruvilla V, Bailey M. Implementation of the Critical Care Pain Observation Tool increases the frequency of pain assessment for noncommunicative ICU patients. Austr Crit Care. (2019) 32:367–72. doi: 10.1016/j.aucc.2018.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Lovejoy CA, Buch V, Maruthappu M. Artificial intelligence in the intensive care unit. Crit Care. (2019) 23:7. doi: 10.1186/s13054-018-2301-9

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Schwab KE, To AQ, Chang J, Ronish B, Needham DM, Martin JL, et al. Actigraphy to measure physical activity in the intensive care unit: a systematic review. J Intensive Care Med. (2019) 885066619863654. doi: 10.1177/0885066619863654

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Schwab KE, Ronish B, Needham DM, To AQ, Martin JL, Kamdar BB. Actigraphy to evaluate sleep in the intensive care unit. A systematic review. Ann Am Thorac Soc. (2018) 15:1075–82. doi: 10.1513/AnnalsATS.201801-004OC

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Davoudi A, Manini TM, Bihorac A, Rashidi P. Role of wearable accelerometer devices in delirium studies: a systematic review. Crit Care Expl. (2019) 1:e0027. doi: 10.1097/CCE.0000000000000027

PubMed Abstract | CrossRef Full Text | Google Scholar

10. LaBuzetta J, Hermiz J, Gilja V, Karanjia N. Using accelerometers in the neurological ICU to monitor unilaterally motor impaired patients (P3.204). Neurology. (2016) 86:P3.204.

Google Scholar

11. Winkelman C, Higgins PA, Chen Y-JK. Activity in the chronically critically ill. Dimens Crit Care Nurs. (2005) 24:281–90. doi: 10.1097/00003465-200511000-00011

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Davoudi A, Corbett DB, Ozrazgat-Baslanti T, Bihorac A, Brakenridge SC, Manini TM, et al. Activity and Circadian Rhythm of Sepsis Patients in the Intensive Care Unit. Las Vegas, NV (2018). p. 17–20. doi: 10.1109/BHI.2018.8333359

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Liu R, Fazio SA, Zhang H, Ramli AA, Liu X, Adams JY. Early mobility recognition for intensive care unit patients using accelerometers. arXiv preprint arXiv:2106.15017. (2021). doi: 10.48550/arXiv.2106.15017

CrossRef Full Text | Google Scholar

14. Krüger J, Kraft M, Gründling M, Friesecke S, Gärtner S, Vogt LJ, et al. Evaluation of a non-invasive multisensor accelerometer for calculating energy expenditure in ventilated intensive care patients compared to indirect calorimetry and predictive equations. J Clin Monit Comput. (2017) 31:1009–17. doi: 10.1007/s10877-016-9934-5

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Ancoli-Israel S, Cole R, Alessi C, Chambers M, Moorcroft W, Pollak CP. The role of actigraphy in the study of sleep and circadian rhythms. Sleep. (2003) 26:342–92. doi: 10.1093/sleep/26.3.342

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Raj R, Ussavarungsi K, Nugent K. Accelerometer-based devices can be used to monitor sedation/agitation in the intensive care unit. J Crit Care. (2014) 29:748–52. doi: 10.1016/j.jcrc.2014.05.014

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Grap MJ, Borchers CT, Munro CL, Elswick RK, Sessler CN. Actigraphy in the critically ill: correlation with activity, agitation, and sedation. Am J Crit Care. (2005) 14:52–60. doi: 10.4037/ajcc2005.14.1.52

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Murali S, Rincon F, Cassina T, Cook S, Goy J-J. Heart rate and oxygen saturation monitoring with a new wearable wireless device in the intensive care unit: pilot comparison trial. JMIR Biomed Eng. (2020) 5:e18158. doi: 10.2196/18158

CrossRef Full Text | Google Scholar

19. Kroll RR, Boyd JG, Maslove DM. Accuracy of a wrist-worn wearable device for monitoring heart rates in hospital inpatients: a prospective observational study. J Med Internet Res. (2016) 18:e253. doi: 10.2196/jmir.6025

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Wu F, Zhao H, Zhao Y, Zhong H. Development of a wearable-sensor-based fall detection system. Int J Telemed Appl. (2015) 2015:576364–576364. doi: 10.1155/2015/576364

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Sucerquia A, López JD, Vargas-Bonilla JF. Real-life/real-time elderly fall detection with a triaxial accelerometer. Sensors. (2018) 18:1101. doi: 10.3390/s18041101

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Davoudi A, Malhotra KR, Shickel B, Siegel S, Williams S, Ruppert M, et al. Intelligent ICU for autonomous patient monitoring using pervasive sensing and deep learning. Sci Rep. (2019) 9:8020. doi: 10.1038/s41598-019-44004-w

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Lee H, Joseph B, Enriquez A, Najafi B. Toward using a smartwatch to monitor frailty in a hospital setting: using a single wrist-wearable sensor to assess frailty in bedbound inpatients. Gerontology. (2018) 64:389–400. doi: 10.1159/000484241

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Adomat R, Hicks C. Measuring nursing workload in intensive care: an observational study using closed circuit video cameras. J Adv Nurs. (2003) 42:402–12. doi: 10.1046/j.1365-2648.2003.02632.x

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Haque A, Guo M, Alahi A, Yeung S, Luo Z, Rege A, et al. Towards vision-based smart hospitals: a system for tracking and monitoring hand hygiene compliance. arXiv preprint arXiv:1708.00163. (2017). doi: 10.48550/arXiv.1708.00163

CrossRef Full Text | Google Scholar

26. Krempel E, Birnstill P, Beyerer J. A privacy-aware fall detection system for hospitals and nursing facilities. Eur J Secur Res. (2017) 2:83–95. doi: 10.1007/s41125-017-0016-6

CrossRef Full Text | Google Scholar

27. Dašić P, Dašić J, Crvenković B. Improving patient safety in hospitals through usage of cloud supported video surveillance. Open Access Macedonian J Med Sci. (2017) 5:101–6. doi: 10.3889/oamjms.2017.042

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Torres C, Hammond SD, Fried JC, Manjunath B. Sleep pose recognition in an icu using multimodal data and environmental feedback. Springer. (2015) 56–66. doi: 10.1007/978-3-319-20904-3_6

CrossRef Full Text | Google Scholar

29. Chase JG, Agogue F, Starfinger C, Lam Z, Shaw GM, Rudge AD, et al. Quantifying agitation in sedated ICU patients using digital imaging. Comput Methods Programs Biomed. (2004) 76:131–41. doi: 10.1016/j.cmpb.2004.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Ma AJ, Rawat N, Reiter A, Shrock C, Zhan A, Stone A, et al. Measuring patient mobility in the ICU using a novel noninvasive sensor. Crit Care Med. (2017) 45:630. doi: 10.1097/CCM.0000000000002265

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Torres C, Rose K, Fried JC, Manjunath B. Summarization of ICU patient motion from multimodal multiview videos. arXiv preprint arXiv:1706.09430. (2017). doi: 10.48550/arXiv.1706.09430

CrossRef Full Text | Google Scholar

32. Rasche S, Trumpp A, Waldow T, Gaetjen F, Plötze K, Wedekind D, et al. Camera-based photoplethysmography in critical care patients. Clin Hemorheol Microcirc. (2016) 64:77–90. doi: 10.3233/CH-162048

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Malhotra KR, Davoudi A, Siegel S, Bihorac A, Rashidi P. Autonomous detection of disruptions in the intensive care unit using deep mask R-CNN. IEEE. (2018) 1944–19442. doi: 10.1109/CVPRW.2018.00241

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Connolly BA, Mortimore JL, Douiri A, Rose JW, Hart N, Berney SC. Low levels of physical activity during critical illness and weaning: the evidence–reality gap. J Intensive Care Med. (2017) 34:818–27. doi: 10.1177/0885066617716377

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Hunter A, Johnson L, Coustasse A. Reduction of intensive care unit length of stay: the case of early mobilization. Health Care Manag. (2014) 33:128–35. doi: 10.1097/HCM.0000000000000006

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Ota H, Kawai H, Sato M, Ito K, Fujishima S, Suzuki H. Effect of early mobilization on discharge disposition of mechanically ventilated patients. J Phys Ther Sci. (2015) 27:859–64. doi: 10.1589/jpts.27.859

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Mendez-Tellez PA, Nusr R, Feldman D, Needham DM. Early physical rehabilitation in the ICU: a review for the neurohospitalist. Neurohospitalist. (2012) 2:96–105. doi: 10.1177/1941874412447631

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Morris PE, Griffin L, Berry M, Thompson C, Hite RD, Winkelman C, et al. Receiving early mobility during an intensive care unit admission is a predictor of improved outcomes in acute respiratory failure. Am J Med Sci. (2011) 341:373–7. doi: 10.1097/MAJ.0b013e31820ab4f6

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Hodgson C, Needham D, Haines K, Bailey M, Ward A, Harrold M, et al. Feasibility and inter-rater reliability of the ICU Mobility Scale. Heart Lung J Acute Crit Care. (2014) 43:19–24. doi: 10.1016/j.hrtlng.2013.11.003

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Peterson ML, Lukens K, Fulk G. Psychometric properties of physical function measures used in the intensive care unit: a systematic review. J Acute Care Phys Ther. (2018) 9:78–90. doi: 10.1097/JAT.0000000000000073

CrossRef Full Text | Google Scholar

41. Torres C, Fried JC, Rose K, Manjunath BS. A multiview multimodal system for monitoring patient sleep. IEEE Trans Multimedia. (2018) 20:3057–68. doi: 10.1109/TMM.2018.2829162

CrossRef Full Text | Google Scholar

42. Liu B, Guo M, Chou E, Mehra R, Yeung S, Downing NL, et al. 3d Point Cloud-Based Visual Prediction of ICU Mobility Care Activities. (2018). p. 17–29.

Google Scholar

43. Fazio S, Doroy A, Da Marto N, Taylor S, Anderson N, Young HM, et al. Quantifying mobility in the ICU: comparison of electronic health record documentation and accelerometer-based sensors to clinician-annotated video. Crit Care Expl. (2020) 2:91. doi: 10.1097/CCE.0000000000000091

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Mecocci A, Micheli F, Zoppetti C, Baghini A. Automatic Falls Detection in Hospital-Room Context. Wroclaw: IEEE (2016). doi: 10.1109/CogInfoCom.2016.7804537

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Brown Kramer J, Sabalka L, Rush B, Jones K, Nolte T. Automated Depth Video Monitoring for Fall Reduction: A Case Study. Seattle, WA: IEEE (2020). p. 294–5. doi: 10.1109/CVPRW50498.2020.00155

CrossRef Full Text | Google Scholar

46. Sakr Y, Jaschinski U, Wittebole X, Szakmany T, Lipman J, Ñamendys-Silva SA, et al. Sepsis in intensive care unit patients: worldwide data from the intensive care over nations audit. Open For Infect Dis. (2018) 5:ofy313. doi: 10.1093/ofid/ofy313

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Cavallazzi R, Saad M, Marik PE. Delirium in the ICU: an overview. Ann Intensive Care. (2012) 2:49–49. doi: 10.1186/2110-5820-2-49

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Chou E, Tan M, Zou C, Guo M, Haque A, Milstein A, et al. Privacy-preserving action recognition for smart hospitals using low-resolution depth images. arXiv preprint arXiv:1811.09950. (2018). doi: 10.48550/arXiv.1811.09950

CrossRef Full Text | Google Scholar

49. Yeung S, Rinaldo F, Jopling J, Liu B, Mehra R, Downing NL, et al. A computer vision system for deep learning-based detection of patient mobilization activities in the ICU. NPJ Digital Medicine. (2019) 2:11. doi: 10.1038/s41746-019-0087-z

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Verceles AC, Hager ER. Use of accelerometry to monitor physical activity in critically ill subjects: a systematic review. Respir Care. (2015) 60:1330–6. doi: 10.4187/respcare.03677

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Moonen HPFX, Beckers KJH, van Zanten ARH. Energy expenditure and indirect calorimetry in critical illness and convalescence: current evidence and practical considerations. J Intensive Care. (2021) 9:8. doi: 10.1186/s40560-021-00524-0

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Reid C. Frequency of under- and overfeeding in mechanically ventilated ICU patients: causes and possible consequences. J Hum Nutr Diet. (2006) 19:13–22. doi: 10.1111/j.1365-277X.2006.00661.x

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Xue Q-L. The frailty syndrome: definition and natural history. Clin Geriatr Med. (2011) 27:1. doi: 10.1016/j.cger.2010.08.009

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Ferrante LE, Pisani MA, Murphy TE, Gahbauer EA, Leo-Summers LS, Gill TM. The association of frailty with post-ICU disability, nursing home admission, and mortality: a longitudinal study. Chest. (2018) 153:1378–86. doi: 10.1016/j.chest.2018.03.007

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Falvey JR, Ferrante LE. Frailty assessment in the ICU: translation to 'real-world' clinical practice. Anaesthesia. (2019) 74:700–3. doi: 10.1111/anae.14617

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Makary MA, Segev DL, Pronovost PJ, Syin D, Bandeen-Roche K, Patel P, et al. Frailty as a predictor of surgical outcomes in older patients. J Am Coll Surg. (2010) 210:901–8. doi: 10.1016/j.jamcollsurg.2010.01.028

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. (2001) 56:M146–156. doi: 10.1093/gerona/56.3.M146

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Jolley SE, Bunnell AE, Hough CL. ICU-acquired weakness. Chest. (2016) 150:1129–40. doi: 10.1016/j.chest.2016.03.045

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Figueroa-Ramos MI, Arroyo-Novoa CM, Lee KA, Padilla G, Puntillo KA. Sleep and delirium in ICU patients: a review of mechanisms and manifestations. Intensive Care Med. (2009) 35:781–95. doi: 10.1007/s00134-009-1397-4

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Richardson A, Carter R. Falls in critical care: a local review to identify incidence and risk. Nurs Crit Care. (2017) 22:270–5. doi: 10.1111/nicc.12151

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Nelson JE, Meier DE, Oei EJ, Nierman DM, Senzel RS, Manfredi PL, et al. Self-reported symptom experience of critically ill cancer patients receiving intensive care. Crit Care Med. (2001) 29:277–82. doi: 10.1097/00003246-200102000-00010

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Rincon HG, Granados M, Unutzer J, Gomez M, Duran R, Badiel M, et al. Prevalence, detection and treatment of anxiety, depression, and delirium in the adult critical care unit. Psychosomatics. (2001) 42:391–6. doi: 10.1176/appi.psy.42.5.391

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Giannakakis G, Pediaditis M, Manousos D, Kazantzaki E, Chiarugi F, Simos PG, et al. Stress and anxiety detection using facial cues from videos. Biomed Signal Process Control. (2017) 31:89–101. doi: 10.1016/j.bspc.2016.06.020

CrossRef Full Text | Google Scholar

64. Nagasawa T, Takahashi R, Koopipat C, Tsumura N. Stress Estimation Using Multimodal Biosignal Information From RGB Facial Video. Seattle, WA: IEEE (2020). p. 292–3. doi: 10.1109/CVPRW50498.2020.00154

CrossRef Full Text | Google Scholar

65. Werner P, Al-Hamadi A, Niese R, Walter S, Gruss S, Traue HC. Towards Pain Monitoring: Facial Expression, Head Pose, a New Database, an Automatic System and Remaining Challenges. Bristol: BMVA Press (2013). p. 1–13. doi: 10.5244/C.27.119

CrossRef Full Text | Google Scholar

66. Werner P, Al-Hamadi A, Limbrecht-Ecklundt K, Walter S, Traue HC. Head movements and postures as pain behavior. PLoS ONE. (2018) 13:e0192767. doi: 10.1371/journal.pone.0192767

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Amos B, Ludwiczuk B, Satyanarayanan M. OpenFace: A General-Purpose Face Recognition Library With Mobile Applications. Pittsburgh, PA: CMU School of Computer Science (2016).

Google Scholar

68. Perraudin CGM, Illiano VP, Calvo F, O'Hare E, Donnelly SC, Mullan RH, et al. Observational study of a wearable sensor and smartphone application supporting unsupervised exercises to assess pain and stiffness. Digit Biomark. (2018) 2:106–25. doi: 10.1159/000493277

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Arbour C, Choinière M, Topolovec-Vranic J, Loiselle CG, Gélinas C. Can fluctuations in vital signs be used for pain assessment in critically ill patients with a traumatic brain injury? Pain Res Treat. (2014) 2014:175794–175794. doi: 10.1155/2014/175794

PubMed Abstract | CrossRef Full Text | Google Scholar

70. Erden S, Demir Kalkan NA, Ugras G, Arslan U, Arslan S. Vital Signs: Valid Indicators to Assess Pain in Intensive Care Unit Patients? An Observational, Descriptive Study. New York, NY (2018). doi: 10.1111/nhs.12543

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Lucey P, Cohn JF, Prkachin KM, Solomon PE, Matthews I. Painful Data: The UNBC-McMaster Shoulder Pain Expression Archive Database. Santa Barbara, CA: IEEE (2011). p. 57–64. doi: 10.1109/FG.2011.5771462

PubMed Abstract | CrossRef Full Text | Google Scholar

72. Arif-Rahu M, Grap MJ. Facial expression and pain in the critically ill non-communicative patient: state of science review. Intens Crit Care Nurs. (2010) 26:343–52. doi: 10.1016/j.iccn.2010.08.007

PubMed Abstract | CrossRef Full Text | Google Scholar

73. McGuire DB, Kaiser KS, Haisfield-Wolfe ME, Iyamu F. Pain assessment in noncommunicative adult palliative care patients. Nurs Clin North Am. (2016) 51:397–431. doi: 10.1016/j.cnur.2016.05.009

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Odhner M, Wegman D, Freeland N, Steinmetz A, Ingersoll GL. Assessing pain control in nonverbal critically ill adults. Dimension Crit Care Nurs. (2003) 22:260–7. doi: 10.1097/00003465-200311000-00010

PubMed Abstract | CrossRef Full Text | Google Scholar

75. Rahu MA, Grap MJ, Cohn JF, Munro CL, Lyon DE, Sessler CN. Facial expression as an indicator of pain in critically ill intubated adults during endotracheal suctioning. Am J Crit Care. (2013) 22:412–22. doi: 10.4037/ajcc2013705

PubMed Abstract | CrossRef Full Text | Google Scholar

76. Lucey P, Cohn JF, Matthews I, Lucey S, Sridharan S, Howlett J, et al. Automatically detecting pain in video through facial action units. IEEE Trans Syst Man Cybernet B. (2011) 41:664–74. doi: 10.1109/TSMCB.2010.2082525

PubMed Abstract | CrossRef Full Text | Google Scholar

77. Chen Z, Ansari R, Wilkie D. Automated pain detection from facial expressions using FACS: a review. arXiv e-prints. (2018). doi: 10.48550/arXiv.1811.07988

PubMed Abstract | CrossRef Full Text | Google Scholar

78. Soar J, Bargshady G, Zhou X, Whittaker F. Deep Learning Model for Detection of Pain Intensity from Facial Expression. Cham: Springer International Publishing (2018). p. 249–54. doi: 10.1007/978-3-319-94523-1_22

CrossRef Full Text | Google Scholar

79. Nerella S, Bihorac A, Tighe P, Rashidi P. Facial action unit detection on icu data for pain assessment. arXiv preprint arXiv:2005.02121. (2020). doi: 10.48550/arXiv.2005.02121

CrossRef Full Text | Google Scholar

80. Chevrolet J-C, Jolliet P. Clinical review: agitation and delirium in the critically ill–significance and management. Crit Care. (2007) 11:214–214. doi: 10.1186/cc5787

PubMed Abstract | CrossRef Full Text | Google Scholar

81. Hughes CG, McGrane S, Pandharipande PP. Sedation in the intensive care setting. Clin Pharmacol. (2012) 4:53. doi: 10.2147/CPAA.S26582

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Jackson DL, Proudfoot CW, Cann KF, Walsh TS. The incidence of sub-optimal sedation in the ICU: a systematic review. Crit Care. (2009) 13:R204. doi: 10.1186/cc8212

PubMed Abstract | CrossRef Full Text | Google Scholar

83. Selvan K, Edriss H, Sigler M, Tseng J. Self-extubation in ICU patients. Southw Respirat Crit Care Chronicles. (2014) 2:31–4. doi: 10.12746/swrccc.v2i8.169

CrossRef Full Text | Google Scholar

84. Singh PM, Rewari V, Chandralekha A, Arora MK, Trikha A. A retrospective analysis of determinants of self-extubation in a tertiary care intensive care unit. J Emerg Trauma Shock. (2013) 6:241–5. doi: 10.4103/0974-2700.120363

PubMed Abstract | CrossRef Full Text | Google Scholar

85. Casale P, Pujol O, Radeva P. Classifying Agitation in Sedated ICU Patients. Girona: Citeseer (2010).

Google Scholar

86. Rouche O, Wolak-Thierry A, Destoop Q, Milloncourt L, Floch T, Raclot P, et al. Evaluation of the depth of sedation in an intensive care unit based on the photo motor reflex variations measured by video pupillometry. Ann Intensive Care. (2013) 3:5–5. doi: 10.1186/2110-5820-3-5

PubMed Abstract | CrossRef Full Text | Google Scholar

87. Miranda D, Calderón M, Favela J. Anxiety detection using wearable monitoring. In: Proceedings of the 5th Mexican Conference on Human-Computer Interaction. New York, NY: ACM (2014). doi: 10.1145/2676690.2676694

CrossRef Full Text | Google Scholar

88. Medrzycka-Dabrowska W, Lewandowska K, Kwiecień-Jaguś K, Czyz-Szypenbajl K. Sleep deprivation in intensive care unit - systematic review. Open Med. (2018) 13:384–93. doi: 10.1515/med-2018-0057

PubMed Abstract | CrossRef Full Text | Google Scholar

89. Ding Q, Redeker NS, Pisani MA, Yaggi HK, Knauert MP. Factors influencing patients' sleep in the intensive care unit: perceptions of patients and clinical staff. Am J Crit Care. (2017) 26:278–86. doi: 10.4037/ajcc2017333

PubMed Abstract | CrossRef Full Text | Google Scholar

90. Pisani MA, Friese RS, Gehlbach BK, Schwab RJ, Weinhouse GL, Jones SF. Sleep in the intensive care unit. Am J Respir Crit Care Med. (2015) 191:731–8. doi: 10.1164/rccm.201411-2099CI

PubMed Abstract | CrossRef Full Text | Google Scholar

91. Delaney LJ, Van Haren F, Lopez V. Sleeping on a problem: the impact of sleep disturbance on intensive care patients - a clinical review. Ann Intensive Care. (2015) 5:3–3. doi: 10.1186/s13613-015-0043-2

PubMed Abstract | CrossRef Full Text | Google Scholar

92. Andersen J, Boesen H, Skovgaard OK. Sleep in the Intensive Care Unit measured by polysomnography. Minerva Anestesiol. (2013) 79:804–15.

PubMed Abstract | Google Scholar

93. Elliott R, McKinley S, Cistulli P, Fien M. Characterisation of sleep in intensive care using 24-hour polysomnography: an observational study. Crit Care. (2013) 17:R46–R46. doi: 10.1186/cc12565

PubMed Abstract | CrossRef Full Text | Google Scholar

94. Lee J, Hong M, Ryu S. Sleep monitoring system using kinect sensor. Int J Distribut Sensor Netw. (2015) 11:875371. doi: 10.1155/2015/875371

CrossRef Full Text | Google Scholar

95. Rosa RG, Tonietto TF, da Silva DB, Gutierres FA, Ascoli AM, Madeira LC, et al. Effectiveness and safety of an extended ICU visitation model for delirium prevention: a before and after study. Crit Care Med. (2017) 45:1660–7. doi: 10.1097/CCM.0000000000002588

PubMed Abstract | CrossRef Full Text | Google Scholar

96. Teixeira C, Rosa RG. The rationale of flexible ICU visiting hours for delirium prevention. J Emerg Crit Care Med. (2018) 2:7. doi: 10.21037/jeccm.2018.10.07

CrossRef Full Text | Google Scholar

97. Torres C, Fried JC, Manjunath BS. Healthcare event and activity logging. IEEE J Transl Eng Health Med. (2018) 6:1600212. doi: 10.1109/JTEHM.2018.2863386

PubMed Abstract | CrossRef Full Text | Google Scholar

98. Voigt LP, Reynolds K, Mehryar M, Chan WS, Kostelecky N, Pastores SM, et al. Monitoring sound and light continuously in an intensive care unit patient room: a pilot study. J Crit Care. (2017) 39:36–9. doi: 10.1016/j.jcrc.2016.12.020

PubMed Abstract | CrossRef Full Text | Google Scholar

99. Berglund B, Lindvall T, Schwela DH, Organization WH. Guidelines for Community Noise. London: World Health Organization (1999).

Google Scholar

100. Tainter CR, Levine AR, Quraishi SA, Butterly AD, Stahl DL, Eikermann M, et al. Noise levels in surgical ICUs are consistently above recommended standards. Crit Care Med. (2016) 44:147–52. doi: 10.1097/CCM.0000000000001378

PubMed Abstract | CrossRef Full Text | Google Scholar

101. Ben-Ari J, Zimlichman E, Adi N, Sorkine P. Contactless respiratory and heart rate monitoring: validation of an innovative tool. J Med Eng Technol. (2010) 34:393–8. doi: 10.3109/03091902.2010.503308

PubMed Abstract | CrossRef Full Text | Google Scholar

102. Condrea F, Ivan V-A, Leordeanu M. In Search of Life: Learning from Synthetic Data to Detect Vital Signs in Videos. (2020). p. 298–9. doi: 10.1109/CVPRW50498.2020.00157

CrossRef Full Text | Google Scholar

103. van Gastel M, Stuijk S, de Haan G. New principle for measuring arterial blood oxygenation, enabling motion-robust remote monitoring. Sci Rep. (2016) 6:38609. doi: 10.1038/srep38609

PubMed Abstract | CrossRef Full Text | Google Scholar

104. Guazzi AR, Villarroel M, Jorge J, Daly J, Frise MC, Robbins PA, et al. Non-contact measurement of oxygen saturation with an RGB camera. Biomed Opt Express. (2015) 6:3320–38. doi: 10.1364/BOE.6.003320

PubMed Abstract | CrossRef Full Text | Google Scholar

105. Lyra S, Mayer L, Ou L, Chen D, Timms P, Tay A, et al. A deep learning-based camera approach for vital sign monitoring using thermography images for ICU patients. Sensors. (2021) 21:1495. doi: 10.3390/s21041495

PubMed Abstract | CrossRef Full Text | Google Scholar

106. L'Her E, Nazir S, Pateau V, Visvikis D. Accuracy of noncontact surface imaging for tidal volume and respiratory rate measurements in the ICU. J Clin Monitor Comput. (2021) 21:708. doi: 10.1007/s10877-021-00708-x

PubMed Abstract | CrossRef Full Text | Google Scholar

107. Weenk M, van Goor H, Frietman B, Engelen LJ, van Laarhoven CJ, Smit J, et al. Continuous monitoring of vital signs using wearable devices on the general ward: pilot study. JMIR Mhealth Uhealth. (2017) 5:e91. doi: 10.2196/mhealth.7208

PubMed Abstract | CrossRef Full Text | Google Scholar

108. Mebazaa A, Casadio MC, Azoulay E, Guidet B, Jaber S, Levy B, et al. Post-ICU discharge and outcome: rationale and methods of the The French and euRopean Outcome reGistry in Intensive Care Units (FROG-ICU) observational study. BMC Anesthesiol. (2015) 15:143. doi: 10.1186/s12871-015-0129-2

PubMed Abstract | CrossRef Full Text | Google Scholar

109. Gluck S, Chapple L-AS, Chapman MJ, Iwashyna TJ, Deane AM. A scoping review of use of wearable devices to evaluate outcomes in survivors of critical illness. Crit Care Resuscitat. (2017) 19:197.

PubMed Abstract | Google Scholar

110. Anderson JL, Yoward LS, Green AJ. A study investigating the validity of an accelerometer in quantification of step count in adult hospital inpatients recovering from critical illness. Clin Rehabil. (2019) 33:936–42. doi: 10.1177/0269215519829893

PubMed Abstract | CrossRef Full Text | Google Scholar

111. Gandotra S, Bakhru R, Shields K, Berry M, Files D. Monitoring activity levels in ICU survivors with accelerometers. Chest. (2017) 152:A394. doi: 10.1016/j.chest.2017.08.420

CrossRef Full Text | Google Scholar

112. Gerke S, Yeung S, Cohen IG. Ethical and legal aspects of ambient intelligence in hospitals. J Am Med Assoc. (2020) 323:601–2. doi: 10.1001/jama.2019.21699

PubMed Abstract | CrossRef Full Text | Google Scholar

113. Parkhi OM, Vedaldi A, Zisserman A. Deep Face Recognition. Swansea: BMVA Press (2015). p. 6. doi: 10.5244/C.29.41

CrossRef Full Text | Google Scholar

114. Schroff F, Kalenichenko D, Philbin J. Facenet: A Unified Embedding for Face Recognition and Clustering. (2015). p. 815–23. doi: 10.1109/CVPR.2015.7298682

CrossRef Full Text | Google Scholar

115. Lahasan B, Lutfi SL, San-Segundo R. A survey on techniques to handle face recognition challenges: occlusion, single sample per subject and expression. Artif Intellig Rev. (2019) 52:949–79. doi: 10.1007/s10462-017-9578-y

CrossRef Full Text | Google Scholar

116. Au-Yeung W-TM, Sahani AK, Isselbacher EM, Armoundas AA. Reduction of false alarms in the intensive care unit using an optimized machine learning based approach. NPJ Digit Med. (2019) 2:1–5. doi: 10.1038/s41746-019-0160-7

PubMed Abstract | CrossRef Full Text | Google Scholar

117. Marra A, Ely EW, Pandharipande PP, Patel MB. The ABCDEF bundle in critical care. Crit Care Clin. (2017) 33:225–43. doi: 10.1016/j.ccc.2016.12.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: intensive care unit (ICU), wearable device, computer vision, pervasive sensing, patient monitoring

Citation: Davoudi A, Shickel B, Tighe PJ, Bihorac A and Rashidi P (2022) Potentials and Challenges of Pervasive Sensing in the Intensive Care Unit. Front. Digit. Health 4:773387. doi: 10.3389/fdgth.2022.773387

Received: 09 September 2021; Accepted: 08 April 2022;
Published: 17 May 2022.

Edited by:

Panicos Kyriacou, City University of London, United Kingdom

Reviewed by:

Yan Wang, Guangdong Technion-Israel Institute of Technology (GTIIT), China
Eftim Zdravevski, Saints Cyril and Methodius University of Skopje, North Macedonia
M. Shamim Kaiser, Jahangirnagar University, Bangladesh

Copyright © 2022 Davoudi, Shickel, Tighe, Bihorac and Rashidi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Anis Davoudi, anisdavoudi@ufl.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.