Skip to main content

REVIEW article

Front. Digit. Health, 23 June 2020
Sec. Connected Health
This article is part of the Research Topic Mobile and Wearable Systems for Health Monitoring View all 14 articles

Wearable Sensors for COVID-19: A Call to Action to Harness Our Digital Infrastructure for Remote Patient Monitoring and Virtual Assessments

  • 1Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, United States
  • 2Department of Electrical Engineering, Case Western Reserve University, Cleveland, OH, United States
  • 3Department of Orthopaedics, University Hospitals of Cleveland Medical Center, Cleveland, OH, United States
  • 4Division of Cardiology, Department of Medicine, David Geffen School of Medicine at UCLA, University of California, Los Angeles, Los Angeles, CA, United States
  • 5Frances Payne Bolton School of Nursing, Case Western Reserve University, Cleveland, OH, United States

The COVID-19 pandemic has brought into sharp focus the need to harness and leverage our digital infrastructure for remote patient monitoring. As current viral tests and vaccines are slow to emerge, we see a need for more robust disease detection and monitoring of individual and population health, which could be aided by wearable sensors. While the utility of this technology has been used to correlate physiological metrics to daily living and human performance, the translation of such technology toward predicting the incidence of COVID-19 remains a necessity. When used in conjunction with predictive platforms, users of wearable devices could be alerted when changes in their metrics match those associated with COVID-19. Anonymous data localized to regions such as neighborhoods or zip codes could provide public health officials and researchers a valuable tool to track and mitigate the spread of the virus, particularly during a second wave. Identifiable data, for example remote monitoring of cohorts (family, businesses, and facilities) associated with individuals diagnosed with COVID-19, can provide valuable data such as acceleration of transmission and symptom onset. This manuscript describes clinically relevant physiological metrics which can be measured from commercial devices today and highlights their role in tracking the health, stability, and recovery of COVID-19+ individuals and front-line workers. Our goal disseminating from this paper is to initiate a call to action among front-line workers and engineers toward developing digital health platforms for monitoring and managing this pandemic.

Introduction

Overview of COVID-19

The Coronavirus Disease 2019 (COVID-19), first recognized in December 2019 in Wuhan, China, is the latest respiratory disease pandemic currently plaguing global health. It has been shown to be caused by a novel coronavirus, severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), that is structurally related to the virus that causes SARS. Li et al. defined a suspected COVID-19 case as pneumonia that matched the following four criteria: (1) fever, with or without a recorded temperature; (2) radiographic evidence of pneumonia; (3) low or normal white-cell count or low lymphocyte count; and (4) no reduction in symptoms after antimicrobial treatment for 3 days (1). As its name suggests, the leading cause of fatality from COVID-19 is hypoxic respiratory failure (24). COVID-19 has posed significant challenges for the medical and civilian communities analogous to what was experienced in two preceding instances of the SARS-CoV virus outbreak in 2002 and 2003 and the Middle East Respiratory Syndrome (MERS) in 2012 (1, 5, 6). Importantly, Li et al. studied 425 patients with confirmed COVID-19 in Wuhan and estimated that the basic reproduction number (R0) for SARS-CoV-2, at the time, to be 2.2 (1). This suggests that each infected person, on average, can spread the infection to an average of 2.2 other people. The virus will likely continue to spread unless this number falls below 1.0 (5). Moreover, timely and effective containment strategies have been a cornerstone of managing the COVID-19 outbreak and reducing viral transmission.

Return to Daily Living Post-COVID-19: From Testing to Digital Health Implementation

Most plans for recovery and the return to “normal,” every-day life are centered on testing—namely determining those who currently have an infection and those who have developed antibodies against the virus, indicating a possible recovery. With any test, there may be false positive or false negative results (7). Of note, an antibody test, while useful in quantifying the number of cases that have occurred in a population, is typically not suitable for early disease detection and its association with immunity to the virus has been put into question (8). Additionally, there is considerable cross-reactivity between SARS-CoV-2 and four other coronaviruses, including those associated with the common cold (9). Polymerase chain reaction (PCR)-based tests are highly sensitive and specific in the laboratory setting; however, high costs and limited availability make these tests difficult to suit population health needs. In the face of a pandemic, time is of the essence and researchers must think of new ways to improve disease diagnosis and monitoring of disease progression.

With new tests in clinical trials, we believe there is an opportunity to leverage advances in remote patient monitoring technology to assist in early disease detection and monitoring by analyzing systemic infection precursors (Figure 1). Wearable sensor data may enable providers and patients to be alerted of a potential SARS-CoV-2 infection before symptoms become severe (Figure 1A). Importantly, a recent study showed that individuals with pre-existing hypertension, heart disease, or diabetes, which makes up nearly half of the United States population, had higher rates of intensive care hospitalization and death when diagnosed with COVID-19 (12). Additionally, data suggests that this vulnerable patient population also typically underreport their symptoms (1315), making remote detection of disease through objective measures a possible way to improve timely escalation of care. On a larger scale, hospitals could use localized, de-identified data to track the spread and severity of the outbreak without violation of users' privacy to provide population-level care (Figures 1B,C). This becomes more relevant when one considers that the asymptomatic carrier rate is estimated to be between 25 and 50% of the entire United States population (16, 17). With such a large population potentially carrying the virus, digital health technologies that measure physiologic parameters can be leveraged to help identify population clusters to identify an emerging COVID-19 outbreak. Harnessing this information is feasible as ~16% of the United States population (~52.8 million people) currently have a smartwatch (18). Such technology may enable a more precise approach for subsequent more advanced testing (e.g., physiological testing), contact tracing, and quarantining. To further incentivize the adoption of such technologies, we envision companies that produce wearables will continue to work with insurance providers and other governing bodies to make these devices more accessible to the public (13). Most recently, in Germany, the Robert Koch Institute (equivalent of the United States Center for Disease Control and Prevention, CDC) supported the adoption of a smartphone app (Corona-Datenspende) which tracked temperature, pulse, and sleep from a minimum of 10,000 volunteers wearing smartwatches or fitness trackers with the aim of understanding how much of the population is clinically symptomatic from an influenza-like illness (ILI) (14). To date, more than 160,000 people have already enrolled (15). Results from the app will be displayed on an interactive online map, enabling both health authorities and the general public to better assess the prevalence and community distributions of infections (14). In the United States, a study published in early 2020 from the Scripps Research Institute demonstrated the ability to predict “hot spots” for influenza utilizing resting heart rate and sleep data from a smartwatch or fitness band (16). The team analyzed data from more than 47,000 consistent Fitbit users in five states (California, Texas, New York, Illinois, and Pennsylvania) over a 2-years period and found that when a cluster of individuals in one-region presented with increased heart rate, a subsequent rise in ILIs was detected. These models to map the prevalence of ILIs have correlated well with CDC data in the range of 0.84–0.9 (16). These studies highlight the clinical applications of wearable sensor technology and in the case of a pandemic, where “flattening the curve” is critical to limiting disease morbidity and mortality, such tools have the potential to improve health at the population level.

FIGURE 1
www.frontiersin.org

Figure 1. Correlating clinical symptoms to the immune response of COVID-19 and when the implementation of wearable technology fits into the virus timeline. (A) Correlating symptoms to the immunological pathway of COVID-19 described in this figure. Wearable sensors can be used to detect changes in physiological metrics before a formal diagnosis. (B) Image from the WHOOP application correlating a decrease in recovery with a diagnosis by an individual diagnosed with COVID-19 on Wednesday the 18th (red bar). (C) Schematic detailing an example of an iPhone application collecting physiological data from a wearable sensor and translating those metrics to alert an individual on his/her overall health status. Figure reproduced and modified from Azuravesta Design (10), (A) and Team (11), (B).

Measurement of Physiological Metrics From Wearable Sensors for COVID-19 Monitoring

COVID-19, along with other viral illnesses, is associated with several physiological changes that can be monitored using wearable sensors (Table 1). Many metrics derived from heart rhythm such as heart rate (HR), heart rate variability (HRV), resting heart rate (RHR), and respiration rate (RR) could serve as potential markers of COVID-19 infection and are already measured by wearable devices such as the Apple Watch, WHOOP Strap, Fitbit, Zephyr BioHarness, or VivaLNK Vital Scout (Table 2). Additionally, changes in electrocardiogram (ECG) waveforms could contain information indicative of an infection. Many wearables report more complex metrics such as stress, recovery, activity, and sleep, which are typically calculated using a combination of cardiac and accelerometer-derived metrics. Due to the integration of multiple measurements, these metrics should exhibit an aggregate higher signal to noise ratio (SNR) than individual raw signals alone and, therefore, have higher predictive value. Core body temperature and arterial oxygen saturation (SpO2) are also of clinical value due to the high prevalence of fever and respiratory symptoms in COVID-19; however, such measurements are not routinely measured by the commercial wearables today. Furthermore, as patient-centered quality metrics are considered, we hypothesize that wearable devices, once validated via rigorous longitudinal randomized controlled trials, can decrease invasive metrics derived from arterial blood gas procedures (intended to detect how well lungs move oxygen into the blood) or from obtaining cardiac troponins (indicative of myocardial injury) (17).

TABLE 1
www.frontiersin.org

Table 1. Sensor modalities for monitoring physiological metrics relevant to COVID-19.

TABLE 2
www.frontiersin.org

Table 2. Sampling of commercial wearable sensors used to monitor physiological parameters necessary for COVID-19 detection.

The upcoming sub-sections in this paper will focus on the current role wearable sensors in providing remote patient monitoring for COVID-19. Our goal in each of these sub-sections is to (1) summarize the clinical relevance of each physiological metric as it relates to COVID-19, (2) provide a brief technical overview of each parameter detection modality, and (3) provide a brief overview of patient implications as it relates to quality of care. Discussion of current clinical trials utilizing commercially available, off-the-shelf (COTS) wearable devices pertinent sensors to COVID-19 is included to highlight the current work in this domain (Table 3).

TABLE 3
www.frontiersin.org

Table 3. Current clinical trials utilizing commercial wearable sensor devices to diagnose and monitor COVID-19.

Cardiovascular Monitoring

There are several metrics related to cardiac function such as HR, HRV, and heart rhythm wherein changes in these metrics may be indicative of COVID-19 infection. Viral illness increases physiological stress on the body which typically manifests as an overall increase in HR. In many cases of viral infection, an elevated HR can be detected hours or days before the onset of symptoms (20). Elevation in HR is also a typical physiological response during fever as the body begins to mount a defense to infection (21). An increase in RHR can be indicative of systemic illness, and thus RHR data, on a population scale, has been proven to accurately model the outbreak of influenza (as previously described) (16). HRV, measured as the average time difference between heart beats, provides insight into overall health, performance, and stress of an individual. High HRV is associated with fitness and health (22). A significant decrease in HRV indicates inadequate recovery and is indicative of increased physiological stress (23). While there is a lack of clinical evidence on the predictive value of HRV for viral illness detection, there is a large amount of self-reported and anecdotal evidence which leads us to postulate that HRV trends can be used to predict the onset of illness (23). Researchers at Scripps recently launched the Digital Engagement and Tracking for Early Control and Treatment (DETECT) study which seeks to correlate changes in HR to the incidence of acquiring a viral infection such as COVID-19 (24, 25). While other viral illnesses are being studied as well, the primary objective of this study is to assess HR, activity, and sleep data in 100,000 individuals to identify ILIs via the CareEvolution's myDataHelps application (24). The study, which commenced this past March, will utilize the Apple Watch, Garmin watch, and Fitbit, which are connected to Apple Health, Amazefit, or Google Fit platforms, respectively. Another study by the team at Scripps Research Institute, in collaboration with Stanford University and Fitbit, is assessing whether changes in HR, skin temperature, and SpO2 can be used to predict the onset of COVID-19 before symptoms even start (26). These studies build upon the work published earlier this year by Scripps in correlating changes in HR to influenza (16).

Electrocardiogram (ECG) and photoplethysmography (PPG) are widely used in wearable technology to monitor cardiac function (2730). ECG is a measurement of the electrical activity in the heart, and PPG uses light (at specific nanometer wavelengths) to measure changes in blood volume (27, 31). While ECG sensors are typically implemented in the form of an epidermal patch that adheres to the stratum corneum (e.g., Zio Patch) and/or via leads to a benchtop instrument, the commoditization of wrist-worn monitors with predictive algorithms has enabled the measurement of heart rhythms from wearable devices such as the Apple Watch 4 and 5, although this measurement is not continuous (32, 33). On the other hand, PPG can be measured continuously in many locations on the body including the wrist, fingertips, earlobes, torso, and more (31). In this sense, PPG is more versatile and can be implemented in more form factors including watches and earbuds (27). While both are viable to monitor the metrics discussed above, ECG is a more direct measurement of heart activity which could potentially provide more insight toward the onset of COVID-19. There is growing evidence suggesting that COVID-19 is burdened by a higher risk of arrhythmic events (34). A study by Driggin et al. found that in 138 hospitalized COVID-19 patients, arrhythmias such as ventricular tachycardia/fibrillation represented the leading complication (19.6%) after acute respiratory distress syndrome, particularly in those admitted to intensive care unit where the prevalence rose to 44.4% (35). Future work toward moving this field forward, leveraging data analytics and wearable sensors, could involve detecting such arrhythmias in patients with COVID-19 in a real-time manner toward improving patient outcomes.

Cardiovascular Strain, Sleep, and Activity Levels

Many currently available wearable devices provide users with calculations of advanced metrics such as stress or strain, sleep, activity, and recovery. These metrics typically rely on a combination of measurements and are calculated daily. The combined measurements and long measurement time for these metrics should yield a higher SNR and thus will likely be better predictors of COVID-19 infection than any single raw metric. Cardiovascular stress or strain (the terms are used interchangeably between analytical platforms) is expressed as a dimensionless unit derived from a combination of HR and HRV data measured over a given day. For the purposes of this paper, we will use the word strain. Devices such as WHOOP measure cardiovascular strain based on time spent in HR zones. In the context of athletic performance, a field where cardiovascular strain has been extensively studied to modulate the internal workloads of athletes (2730, 36), an individual undergoing a strength-based workout with minimal reps and periods of rest will have a lower strain if their HR is not elevated for extended periods of time (27, 36, 37). Increasing weight and adding new strength exercises will cause muscle soreness and muscle fatigue. This microtrauma from the eccentric lengthening of the muscle fibers will cause a decrease in HRV especially in the morning. Fatigued muscles will result in higher strain as the day progresses because the body is working harder to recover due to the disturbances in the individuals' homeostatic state. Along the same lines, cardiovascular strain is also expected to increase when fighting a viral infection. A viral infection such as influenza or COVID-19 does this by increasing the stress on the cardiovascular system, indicated by increases in RHR, HR, blood pressure, and an intrinsic stress hormone called catecholamines (38). Sleep is usually detected using a combination of HR patterns and accelerometer data. Sleep quality is assessed primarily through the analysis of HR, RHR, and HRV, but accelerometry may be used to determine disturbances. Elevated sleep duration has been shown to be predictive of ILI. An increase in sleep duration paired with a decrease in sleep quality would be expected to occur in COVID-19 cases. Activity metrics are intended to report the amount of physical exertion for a day or a given timeframe. Activity scores are typically based on periods of elevated HR and accelerometry. While changes in activity data may not be particularly useful for individual treatment or diagnosis, general trends in activity data for a large population could likely be used for pandemic modeling or to study the health effects of social distancing and isolation. Martin et al. studied the relationship between exercise and respiratory track viral infections in small animal models and concluded that moderate intensity exercise reduced inflammation and improved the immune response to respiratory viral infections (39). The use of wearable sensors toward monitoring activity levels could provide an objective means of staying physically active and healthy during the COVID-19 pandemic. Recovery assessments are based on sleep, sleep quality, and HRV. There is a growing amount of evidence showing a clear downward trend in recovery scores in the days leading up to the onset of COVID-19 symptoms. These complex metrics may prove to be reliable indicators of COVID-19, but it is important to consider that each wearable device uses different algorithms and measurements for the calculation of these scores, which severely limits the population on which analysis of these metrics can be performed.

Respiration Monitoring

Respiration rate (RR) is of critical interest in COVID-19 cases due to the severe effects the virus can have on the lungs. COVID-19 presents as a lower-respiratory tract infection in most cases which can cause inflammation of lung tissue, coughing, and shortness of breath (40). The respiratory damage caused by COVID-19 reduces the overall efficiency of the lungs which results in an increased RR to compensate (40). Significantly increased RR is not as common in cases of other viral illnesses such as influenza or the common cold because these viruses typically affect the upper-respiratory tract (40). It may be concerning, however, that by time the patient is tachypneic, the disease may already be in an advanced stage. In a person who has a high likelihood of COVID-19 exposure, a device that is able to detect subtle changes in respiratory function prior to the onset of clinical symptoms, such as shallow respirations, wheezing, and shortness of breath, has the potential to be an effective tool. Of note, findings by Luo et al. indicated that as many as 70% of frontline health care workers are testing positive for COVID-19 (41). Frontline staff who care for patients with COVID-19 could benefit from the remote use of a wearable-sensor remote monitoring mechanism to objectively monitor for pre-clinical signs of infection, as a measure to prevent spread to other colleagues or patients. Additionally, current COVID-19 guidelines suggest that measuring resting RR can be used utilized as a criterion for intensive care unit (ICU) admission (42).

A recent review by Massaroni et al. assessed the suitability of different contact-based techniques for monitoring RR in clinical settings, occupational settings, and sports performance (43). Specifically, in the context of clinical settings, the authors noted that contact-based techniques such as strain, impedance, biopotential, and light intensity measurements offer a platform to detect RR in a non-invasive and unobtrusive manner. Toward the use of biopotential measurements for RR monitoring, RR can be derived from wearable devices that measure heart activity due to a phenomenon known as Respiratory Sinus Arrhythmia (RSA) (44). RSA results in increased HR during inspiration and decreased HR during expiration. Using this information, any wearable that can accurately measure heart rhythm can be used to derive respiration rate if an appropriate algorithm is implemented. Baseline resting of respiration rate can be determined when a subject is asleep and shows very little variation from night to night (40). Therefore, a significant increase in resting respiration rate indicates a high likelihood of decreased respiratory efficiency. WHOOP has focused on correlating changes in RR and recovery levels to predicting COVID-19 in their users (45). WHOOP, which recently partnered with Central Queensland University (CQU) and the Cleveland Clinic on such a study, will utilize the data collected from WHOOP's hardware from volunteers who have self-identified as having contracted COVID-19 to study changes in their respiration rate over time (45). The data, which is currently being collected for this study utilized the WHOOP 3.0 strap, was validated externally to determine the accuracy of respiration rate during sleep when compared against polysomnography (46). Based on the study, the team from WHOOP hypothesizes that measuring respiration rate during sleep could be valuable in detecting abnormal respiratory behavior in COVID-19 patients before symptoms are present (45). Recently, researchers from Duke University launched the “CovIdentify” study which utilizes devices such as the Fitbit and data from the Apple Health app to monitor an individual's sleep schedules, oxygen levels, activity levels, and HR over a 12 months period to determine if they are risk for COVID-19 (47, 48). Once the data is collected, the team will utilize their predictive algorithms to detect respiratory infections from the COVID-19 virus. Respiration rates are typically obtained in research and clinical-related settings which may not be indicative of individual's respirations at home; however, given that COVID-19 can complicate existing chronic respiratory disease, monitoring individuals in home settings can receive a more patient-centered approach to prescribing treatment (49). There remains an unmet medical need to ensure that algorithms that correlate changes in RR to COVID-19 are sensitive enough to filter out other lower respiratory infections such as pneumonia or influenza. Toward achieving this goal, the design of clinical trials to mitigate false positive diagnosis is critical toward the application of wearable sensor technology for COVID-19 monitoring.

SpO2

The assessment of a patient with a respiratory illness typically includes measurement of the blood oxygen saturation (SpO2), as hypoxia in certain clinical scenarios is indicative of a pneumonia. This is of particular importance in monitoring progression and severity of disease in COVID-19, where resting SpO2 was found to be significantly lower in patients with a severe stage of the disease as determined by clinical symptoms and CT scan. SpO2 measurements < 90% during hospital admission is seen in COVID-19 patients with higher systemic inflammatory markers and increased disease mortality (50, 51). While validated oximeters are abundant in the inpatient setting, few patients have this technology available in their homes. Smartphone-based pulse oximetry in the form of a camera-based app and a probe-based app, the latter using an external plug-in probe, have been developed by several companies and evaluated in two published studies (52, 53). The plug-in probes showed modest accuracy in identifying hypoxia as measured by standard pulse-oximetry; however, the camera-based technology had limited ability to accurately detect hypoxia and is not considered standard of care for this purpose in the literature. PPG technology has been utilized in wearable pulse oximetry and a large number of fingertip-type oximeters are commercially available, but few meet acceptable accuracy standards (54). Examples include the MightySat™ Rx (Masimo) and Pulsox-310 (Konica Minolta). These available technologies were designed for oxygen management in chronic diseases such as chronic obstructive pulmonary disease (COPD) and sleep apnea; moreover, little research has looked at their utility in early detection and management of disease progression in acute respiratory illnesses. At present, this technology may be particularly useful, as more patients with mild symptoms of COVID-19 are being asked to stay at home and report changes in their respiratory symptoms via telemedicine modalities in an attempt to reduce the spread of the disease. In elderly patients or those with medical co-morbidities that are known to be at higher risk of disease progression, current wearable PPG technology may have a role in identifying those patients who are self-isolating at home that need a higher level of care due to hypoxemia which may or may not be accompanied by other clinical symptoms of early respiratory distress.

Temperature

Temperature measurement is extremely important to COVID-19 detection and has already been widely used by numerous countries as an immediate test to determine if travelers or citizens may be infected with COVID-19. While quarantining individuals with fever may prevent transmission to some degree, this approach to temperature monitoring is not sufficient because COVID-19 can be transmitted before a fever develops. Continuous monitoring of skin temperature is currently being implemented using wearable devices such as the TempTraq, Oura ring, VivaLNK Fever Scout, and QardioCORE. The TempTraq skin temperature sensor adheres to the body for 72 h and is currently being used to measure the temperature of frontline workers here at University Hospitals Cleveland Medical Center (55). A study performed by Stanford University using the MOVES, Scanadu Scout, Basis B1, Basis Peak, iHealth-finger, Masimo, RadTarge, and Withings found a notable increase in skin temperature as well as HR and RHR in the period preceding and during a viral infection (20). This change in skin temperature, particularly if paired with RHR and HRV information, could be used to predict COVID-19 infection before symptoms arise. Any such temperature sensing wearable device could also be used for fever tracking during illness and alert users and medical staff to a dangerous fever or sharp change in temperature. While skin temperature measurement is easy to implement, it has been shown to deviate up to 12°F from core body temperature (20). Additionally, temporal, oral, aural, and axillary temperature measurements have all been shown to be invalid estimations of core body temperature (compared against rectal thermometry) and are more prone to change due to environmental or behavioral factors (56). Core body temperature measurement provides a much more stable baseline for assessment and could prove to be more reliably indicative of illness than skin temperature and provide more insight into fevers for remote patient monitoring. Researchers at UT Southwestern Medical Center found that fluctuations in core body temperature regulate the body's circadian rhythm (57). In the study, the researchers focused on cultured mouse cells and tissues and found that genes related to circadian functions were influenced by changes in core temperature. Clinically, analytical platforms combining core body temperature measurements with those of respiration rate, HR, or HRV, could provide a more robust platform for predicting the incidence of COVID-19 in ways not done today.

Continuous skin temperature measurement is simple to implement in both hardware and software and can easily be implemented into a wearable device. Analog solutions such as thermocouples and thermistors could be used reliably, but digital temperature sensors are likely better for wearable applications due to their small size (~1 × 1 mm), low power requirements, and improved control. Such a sensor could be integrated into many existing wearable form factors though adhesive patches will likely prove more reliable due to constant contact with the skin. The gold standard for core body temperature is rectal thermometry. This measurement modality is not feasible for continuous measurement where non-invasive and unobtrusive monitoring is required. A large body of research has shown that core body temperature can be reliably predicted from skin temperature and HR through the use of Kalman filters or other machine learning (ML) algorithms (58, 59). While this technology needs further research and development before clinical or diagnostic use, the application of such algorithms could provide a non-invasive method to study the response of core body temperature to illness and provide advanced remote patient monitoring capabilities for fever treatment.

While there have not been any clinical trials correlating core body temperature to incidences of COVID-19, the smart thermometer maker, Kinsa, has shown from skin temperature data where people with the flu (and more recently COVID-19 infections) are located (60). The team studied a population in Miami-Dade County, Florida and found that a spike in fevers coincided with the well-known reports of Miami residents and tourists loosely following social distancing recommendations. As beaches closed and other isolation strategies were implemented in the county, the team found a significant drop in fevers. The team also noted that the trends observed in Miami hold true for other areas of the country that they studied: as individuals adhered to social distancing guidelines, within 5 days, a downward dip in fevers was observed (60). Another start-up, Oura, has partnered with the University of California, San Francisco on a new study to see if its device, Oura Ring, can detect physiological signs that may indicate the onset of COVID-19 (61). The study includes two parts wherein part one involves having 2,000 frontline healthcare professionals wear the Oura Ring to track skin temperature, sleep pattern, HR, and activity levels. Part two of the study will involve Oura's general user population wherein its 150,000 global users can opt in to participate and add to the overall pool of information with their ring's readings and daily symptom surveys (61). Recently an Oura user in Finland claimed that the ring alerted him that he was displaying symptoms of COVID-19 based on decreased recovery levels (from 80 to 90% to 54 coupled) and an increase in skin temperature of ~1°C. These changes prompted the individual to get tested (61). The test results confirmed, that while asymptomatic, the individual had COVID-19 (61). The compilation of de-identified data sets from studies such as the two mentioned for temperature monitoring and those mentioned earlier on could lead to the development of an early detection algorithm.

Early Detection Algorithm Technology is Needed for COVID-19 Monitoring

Many of the physiological changes measured by wearable devices discussed in the above sections can potentially be detected before a user experiences any significant clinical symptoms of illness (Figure 2A). We postulate that wearable devices can detect and alert users of possible infection with SARS-CoV-2 before they develop clinical symptoms through the development of an early detection algorithm (EDA) (Figures 2A,B). By notifying wearable device users of possible early infection, EDA could allow them the ability to self-isolate, seek care or diagnostic testing, and take other steps to mitigate transmission of the infection during a critical period of the disease process. Additionally, wearables could be used for remote patient monitoring in mild cases by allowing patients to report their vitals from home, saving critical hospital resources and reducing the risk of transmission to health care providers by avoiding in-person assessments (Figure 2C). A combination of the metrics listed above could result in a sufficiently high SNR to be used as a predictor of viral illness or COVID-19 risk. Developing an EDA with a high true positive and true negative rate is imperative for the translation of this technological platform for remote patient monitoring. Clinical staff such as intensive care nurses use early-warning system indicators to detect if individuals are at risk for further complications related to their care (62). Remote patient monitoring using wearable sensor technology provides an opportunity for developing more effective patient interventions, balancing nurse-patient care ratios, and decreasing costs associated with readmission rates and futile medical care.

FIGURE 2
www.frontiersin.org

Figure 2. Clinical pathway summarizing the role of wearable sensor technology and predictive analytics for monitoring COVID-19. (A) Physiological metrics currently capable of being measured from commercial wearable sensors. (B) Changes in physiological metrics can be inputted into an early detection algorithm for COVID-19 monitoring. The goal of such algorithms is to ensure the true positive rate is robust to support the use of the analytics for real-time clinical decision making. (C) Integrated analytics to monitor COVID-19 can be used to monitor individual or population health. HRV, heart rate variability; Resp Rate, respiration rate; SpO2, blood oxygen saturation; Temp, temperature; TP, True Positive; FP, False Positive; TN, True Negative; FN, False Negative.

Future Outlook and Recommendations: Adopting Wearable Sensor Technology

The development of integrated sensor technology has made it possible to remotely measure many physiologic parameters accurately, many of which are clinically useful in monitoring disease progression in a viral illness. The scope of influence of this technology is broad; it may be used to help to identify an individual under home-quarantine that needs a higher level-of-care or a community where an emerging outbreak may be imminent and requires an early intervention. We suspect that one of the largest impediments for the mass adoption of wearable sensors (and digital health technologies overall) in the United States toward remote patient monitoring is the issue of data privacy, data sharing, and underreporting. Wearable technology companies must ensure that only users who choose to participate will share their data (as done by WHOOP), and that the data will be anonymized and used for COVID-19 research only. Germany have provided us with a good example of how population health data can be handled, acknowledging their strong privacy concerns and stances on the limited collection of digital data (63). Underreporting of data by some populations may require their consent for safe data sharing and privacy agreements so that it can be used to inform better care, thus decreasing health disparities. The implementation of current trials demonstrates the convergence of wearable data, self-reported symptoms, molecular testing, and geospatial data toward developing platforms for managing COVID-19 and other outbreaks which may arise in the future. Building upon such trials, we see an opportunity to design a device that can accurately monitor many or all metrics of interest and through machine learning is able to develop an algorithm to reliably detect changes in population health status. A collaboration leveraging the expertise of clinicians, data scientists, engineers, and nurses is imperative to facilitate this advancement and may even be more acutely desired should there be a second wave of this pandemic.

Author Contributions

DS, ED, EH, and SK wrote and edited the manuscript. TW, JH, JV, and CD contributed to the editing of the manuscript. All authors contributed to the article and approved the submitted version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors acknowledge collaboration between Case Western Reserve University, University Hospitals Cleveland Medical Center, and the University of California Los Angeles as it relates to this manuscript.

References

1. Li Q, Guan X, Wu P, Wang X, Zhou L, Tong Y, et al. Early transmission dynamics in Wuhan, China, of novel coronavirus–infected pneumonia. N Engl J Med. (2020) 382:1199–207. doi: 10.1056/NEJMoa2001316

PubMed Abstract | CrossRef Full Text | Google Scholar

2. PNAS. Activation of the SARS Coronavirus Spike Protein via Sequential Proteolytic Cleavage at Two Distinct Sites. PNAS. (2020). Available online at: https://www.pnas.org/content/106/14/5871 (accessed 19 April, 2020).

PubMed Abstract | Google Scholar

3. Yan R, Zhang Y, Li Y, Xia L, Guo Y, and Zhou Q. Structural basis for the recognition of SARS-CoV-2 by full-length human ACE2. Science. (2020) 367:1444–8. doi: 10.1126/science.abb2762

PubMed Abstract | CrossRef Full Text | Google Scholar

4. The New York Times. What Does Coronavirus Do to the Body? The New York Times. (2020). Available online at: https://www.nytimes.com/article/coronavirus-body-symptoms.html (accessed 19 April, 2020).

5. Fauci AS, Lane HC, and Redfield RR. Covid-19—navigating the uncharted. N Engl J Med. (2020) 382:1268–9. doi: 10.1056/NEJMe2002387

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Paules CI, Marston HD, and Fauci AS. Coronavirus infections—more than just the common cold. JAMA. (2020) 323:707–8. doi: 10.1001/jama.2020.0757

PubMed Abstract | CrossRef Full Text | Google Scholar

7. The Washington Post. A ‘Negative’ Coronavirus Test Result Doesn't Always Mean You Aren't Infected. The Washington Post. (2020). Available online at: https://www.washingtonpost.com/science/2020/03/26/negative-coronavirus-test-result-doesnt-always-mean-you-arent-infected/ (accessed April 12, 2020).

8. Berkeley Lovelace WF Jr. WHO Officials Say it's Unclear Whether Recovered Coronavirus Patients are Immune to Second Infection. CNBC. (2020). Available online at: https://www.cnbc.com/2020/04/13/who-officials-say-its-unclear-whether-recovered-coronavirus-patients-are-immune-to-second-infection.html (accessed April 15, 2020).

9. Topol E. Opinion: How Digital Data Collection Can Help Track Covid-19 Cases in Real Time. Washington Post. (2020). Available online at: https://www.washingtonpost.com/opinions/2020/04/10/how-digital-data-collection-can-help-track-covid-19-cases-real-time/ (accessed April 12, 2020).

10. Azuravesta Design. COVID-19 Pandemic. Azuravesta Design. (2020). Available online at: https://www.azuravesta.com/covid-19-pandemic (accessed April 16, 2020).

11. Team WDS. Heart Rate & Valuable WHOOP Data in COVID-19: Coronavirus. WHOOP. (2020). Available online at: https://www.whoop.com/thelocker/whoop-data-coronavirus/ (accessed April 16, 2020).

12. Ferrari R, Di Pasquale G, and Rapezzi C. Commentary: what is the relationship between Covid-19 and cardiovascular disease? Int J Cardiol. (2020) 310:167–8. doi: 10.1016/j.ijcard.2020.03.074

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Miller C. Aetna Launches New Program to Earn a Free Apple Watch. (2019). Available online at: https://9to5mac.com/2019/05/02/aetna-apple-watch-attain-program/ (accessed April 12, 2020).

14. Germany Launches Smartwatch App to Monitor Coronavirus Spread. (2020). Available online at: https://finance.yahoo.com/news/germany-launches-smartwatch-app-monitor-123109671.html (accessed April 12, 2020).

15. The New York Times. Germany Launches Smartwatch App to Monitor Coronavirus Spread. The New York Times. (2020). Available online at: https://www.nytimes.com/reuters/2020/04/07/technology/07reuters-health-coronavirus-germany-tech.html (accessed April 12, 2020).

16. The Lancet Digital Health. Harnessing Wearable Device Data to Improve State-Level Real-Time Surveillance of Influenza-Like Illness in the USA: A Population-Based Study. (2020). The Lancet Digital Health. Available online at: https://www.thelancet.com/journals/landig/article/PIIS2589-7500(19)30222-5/fulltext (accessed April 12, 2020).

17. American College of Cardiology. Troponin and BNP Use in COVID-19. American College of Cardiology. (2020). Available online at: https://www.acc.org/latest-in-cardiology/articles/2020/03/18/15/25/troponin-and-bnp-use-in-covid19 (accessed April 20, 2020).

18. TechCrunch. Sixteen Percent of US Adults Own a Smartwatch. TechCrunch. (2020). Available online at: https://social.techcrunch.com/2019/02/12/sixteen-percent-of-u-s-adults-own-a-smartwatch/ (accessed April 12, 2020).

19. Google Docs. Wearables for COVID-19 Remote Monitoring. Google Docs. (2020). Available online at: https://docs.google.com/spreadsheets/d/1rPvE3cBtMIfVhpSYqOpLy2WgEDaHqY1CEpyGSRVFUaI/edit?usp=sharing&usp=embed_facebook (accessed June 1, 2020).

20. Li X, Dunn J, Salins D, Zhou G, Zhou W, Rose SMS-F, et al. Digital health: tracking physiomes and activity using wearable biosensors reveals useful health-related information. PLOS Biol. (2017) 15:e2001402. doi: 10.1371/journal.pbio.2001402

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Karjalainen J, and Viitasalo M. Fever and cardiac rhythm. Arch Intern Med. (1986) 146:1169–71. doi: 10.1001/archinte.146.6.1169

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Holmes K. 5 Mental Ways to Improve Heart Rate Variability & Immunity. WHOOP. (2020). Available online at: https://www.whoop.com/thelocker/mental-ways-to-increase-hrv-immunity/ (accessed April 13, 2020).

23. Deusen MV. Heart Rate Variability: The Ultimate Guide to HRV. WHOOP. (2019). Available online at: https://www.whoop.com/thelocker/heart-rate-variability-hrv/ (accessed April 12, 2020).

24. ClinicalTrials.gov. The DETECT (Digital Engagement and Tracking for Early Control, and Treatment) Study–Full Text View. ClinicalTrials.gov. (2020). Available online at: https://clinicaltrials.gov/ct2/show/NCT04336020 (accessed April 18, 2020).

25. Detect. (2020). Available onine at: https://detectstudy.org/ (accessed April 18, 2020).

Google Scholar

26. Healthcare IT News. Scripps, Stanford Working With Fibit to Assess Wearables' COVID-19 Tracking Abilities. Healthcare IT News. (2020). Available online at: https://www.healthcareitnews.com/news/scripps-stanford-working-fibit-assess-wearables-covid-19-tracking-abilities (accessed April 18, 2020).

27. Seshadri DR, Li RT, Voos JE, Rowbottom JR, Alfes CM, Zorman CA, et al. Wearable sensors for monitoring the physiological and biochemical profile of the athlete. Npj Digit Med. (2019) 2:72. doi: 10.1038/s41746-019-0150-9

CrossRef Full Text | Google Scholar

28. Seshadri DR, Drummond C, Craker J, Rowbottom JR, and Voos JE. Wearable devices for sports: new integrated technologies allow coaches, physicians, and trainers to better understand the physical demands of athletes in real time. IEEE Pulse. (2017) 8:38–43. doi: 10.1109/MPUL.2016.2627240

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Seshadri DR, Rowbottom JR, Drummond C, Voos JE, and Craker J. A review of wearable technology: moving beyond the hype: from need through sensor implementation. In: 2016 8th Cairo International Biomedical Engineering Conference (CIBEC). (2016). p. 52–5. doi: 10.1109/CIBEC.2016.7836118

CrossRef Full Text | Google Scholar

30. Seshadri DR, Magliato S, Voos JE, and Drummond C. Clinical translation of biomedical sensors for sports medicine. J Med Eng Technol. (2019) 43:66–81. doi: 10.1080/03091902.2019.1612474

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Castaneda D, Esparza A, Ghamari M, Soltanpur C, and Nazeran H. A review on wearable photoplethysmography sensors and their potential future applications in health care. Int J Biosens Bioelectron. (2018) 4:195–202. doi: 10.15406/ijbsbe.2018.04.00125

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Seshadri DR, Bittel B, Browsky D, Houghtaling P, Drummond CK, Desai MY, et al. Accuracy of apple watch for detection of atrial fibrillation. Circulation. (2020) 141:702–3. doi: 10.1161/CIRCULATIONAHA.119.044126

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Seshadri DR, Bittel B, Browsky D, Houghtaling P, Drummond CK, Desai M, et al. Accuracy of the apple watch 4 to measure heart rate in patients with atrial fibrillation. IEEE J Transl Eng Health Med. (2020) 8:2700204. doi: 10.1109/JTEHM.2019.2950397

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Lazzerini PE, Boutjdir M, and Capecchi PL. COVID-19, arrhythmic risk and inflammation: mind the gap! Circulation. (2020). doi: 10.1161/CIRCULATIONAHA.120.047293. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Driggin E, Madhavan MV, Bikdeli B, Chuich T, Laracy J, Bondi-Zoccai G, et al. Cardiovascular considerations for patients, health care workers, and health systems during the coronavirus disease 2019 (COVID-19) pandemic. J Am Coll Cardiol. (2020) 75:2352–71. doi: 10.1016/j.jacc.2020.03.031

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Seshadri DR, Li RT, Voos JE, Rowbottom JR, Alfes CM, Zorman CA, et al. Wearable sensors for monitoring the internal and external workload of the athlete. Npj Digit Med. (2019) 2:1–18. doi: 10.1038/s41746-019-0149-2

CrossRef Full Text | Google Scholar

37. Lynch A. Ask Us Anything: WHOOP Strain. WHOOP. (2019). Available online at: https://www.whoop.com/thelocker/ask-us-anything-strain/ (accessed June 1, 2020).

38. Torrance Memorial Medical Center. Nov 14 P on, 2017. How Can the Flu Affect Your Heart? Torrance Memorial Medical Center. (2020). Available online at: https://www.torrancememorial.org/News_Center/2017/November/How_Can_the_Flu_Affect_Your_Heart_.aspx (accessed June 1, 2020).

39. Martin SA, Pence BD, and Woods JA. Exercise and respiratory tract viral infections. Exerc Sport Sci Rev. (2009) 37:157–64. doi: 10.1097/JES.0b013e3181b7b57b

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Capodilupo E. Tracking Respiratory Rate and the Coronavirus. WHOOP. (2020). Available online at: https://www.whoop.com/the-locker/respiratory-rate-tracking-coronavirus/ (accessed April 4, 2020).

41. Luo M, Cao S, Wei L, Tang R, Hong S, Liu R, et al. Precautions for intubating patients with COVID-19. Anesthesiol J Am Soc Anesthesiol. (2020). 132:1616–8. doi: 10.1097/ALN.0000000000003288

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Frontiers. Remote Respiratory Monitoring in the Time of COVID-19: Physiology. (2020). Available online at: https://www.frontiersin.org/articles/10.3389/fphys.2020.00635/full (accessed May 31, 2020).

43. Massaroni C, Nicolò A, Lo Presti D, Sacchetti M, Silvestri S, and Schena E. Contact-based methods for measuring respiratory rate. Sensors. (2019) 19:908. doi: 10.3390/s19040908

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Hayano J, Yasuma F, Okada A, Mukai S, and Fujinami T. Respiratory sinus arrhythmia. Circulation. (1996) 94:842–7. doi: 10.1161/01.CIR.94.4.842

PubMed Abstract | CrossRef Full Text | Google Scholar

45. TechCrunch. Researchers to Study if Startup's Wrist-Worn Wearable Can Detect Early COVID-19 Respiratory Issues. TechCrunch. Available online at: https://social.techcrunch.com/2020/04/01/researchers-to-study-if-startups-wrist-worn-wearable-can-detect-early-covid-19-respiratory-issues/ (accessed April 18, 2020).

46. Berryhill S, Morton CJ, Dean A, Berryhill A, Provencio-Dean N, Patel SI, et al. Effect of wearables on sleep in healthy individuals: a randomized cross-over trial and validation study. J Clin Sleep Med. (2020) 775–83. doi: 10.5664/jcsm.8356

PubMed Abstract | CrossRef Full Text | Google Scholar

47. CovIdentify. A Duke University Study. (2020). Available online at: https://covidentify.org/ (accessed April 18, 2020).

48. Duke Pratt School of Engineering. ‘CovIdentify’ Pits Smartphones and Wearable Tech Against the Coronavirus. Duke Pratt School of Engineering. (2020). Available online at: https://pratt.duke.edu/about/news/covidentify-pits-smartphones-and-wearable-tech-against-coronavirus (accessed April 18, 2020).

49. Chu M, Nguyen T, Pandey V, Zhou Y, Pham HN, Bar-Yoseph R, et al. Respiration rate and volume measurements using wearable strain sensors. Npj Digit Med. (2019) 2:1–9. doi: 10.1038/s41746-019-0083-3

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Dai H, Zhang X, Xia J, Zhang T, Shang Y, Huang R, et al. High-resolution chest CT features and clinical characteristics of patients infected with COVID-19 in Jiangsu, China. Int J Infect Dis IJID Off Publ Int Soc Infect Dis. (2020) 95:106–12. doi: 10.1016/j.ijid.2020.04.003

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Wang Z, Yang B, Li Q, Wen L, and Zhang R. Clinical features of 69 cases with coronavirus disease 2019 in Wuhan, China. Clin Infect Dis. (2020). doi: 10.1093/cid/ciaa272. [Epub ahead of print].

CrossRef Full Text | Google Scholar

52. Tomlinson S, Behrmann S, Cranford J, Louie M, and Hashikawa A. Accuracy of smartphone-based pulse oximetry compared with hospital-grade pulse oximetry in healthy children. Telemed J E-Health Off J Am Telemed Assoc. (2018) 24:527–35. doi: 10.1089/tmj.2017.0166

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Tayfur I, and Afacan MA. Reliability of smartphone measurements of vital parameters: a prospective study using a reference method. Am J Emerg Med. (2019) 37:1527–30. doi: 10.1016/j.ajem.2019.03.021

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Tamura T. Current progress of photoplethysmography and SPO2 for health monitoring. Biomed Eng Lett. (2019) 9:21–36. doi: 10.1007/s13534-019-00097-w

PubMed Abstract | CrossRef Full Text | Google Scholar

55. News. Best Baby Digital Thermometer: TempTraq. TempTraq. (2020). Available online at: https://www.temptraq.com/News/University-Hospitals-expands-use-of-TempTraq%C2%AE-syst (accessed May 3, 2020).

56. Ganio MS, Brown CM, Casa DJ, Becker SM, Yeargin SW, McDermott BP, et al. Validity and reliability of devices that assess body temperature during indoor exercise in the heat. J Athl Train. (2009) 44:124–35. doi: 10.4085/1062-6050-44.2.124

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Buhr ED, Yoo ED, and Takahashi JS. Temperature as a universal resetting cue for mammalian circadian oscillators. Science. (2010). 330:379–385. doi: 10.1126/science.1195262

PubMed Abstract | CrossRef Full Text | Google Scholar

58. USARIEM. Core Body Temperature Estimation From Heart Rate. (2020). Available online at: https://www.usariem.army.mil/index.cfm/modeling/cbt_algorithm (accessed April 12, 2020).

59. Eggenberger P, MacRae BA, Kemp S, Bürgisser M, Rossi RM, and Annaheim S. Prediction of core body temperature based on skin temperature, heat flux, and heart rate under different exercise and clothing conditions in the heat in young adult males. Front Physiol. (2018) 9:1780. doi: 10.3389/fphys.2018.01780

PubMed Abstract | CrossRef Full Text | Google Scholar

60. TechCrunch. Kinsa's Fever Map Could Show Just How Crucial it is to Stay Home to Stop COVID-19 Spread. TechCrunch. Available online at: https://social.techcrunch.com/2020/03/23/kinsas-fever-map-could-show-just-how-crucial-it-is-to-stay-home-to-stop-covid-19-spread/ (accessed April 12, 2020).

61. TechCrunch. Oura Partners With UCSF to Determine if its Smart Ring Can Help Detect COVID-19 Early. TechCrunch. (2020). Available online at: https://social.techcrunch.com/2020/03/23/oura-partners-with-ucsf-to-determine-if-its-smart-ring-can-hep-detect-covid-19-early/ (accessed April 18, 2020).

62. Kavanaugh MJ, So JD, Park PJ, and Davis KL. Validation of the intensive care unit early warning dashboard: quality improvement utilizing a retrospective case-control evaluation. Telemed J E-Health Off J Am Telemed Assoc. (2017) 23:88–95. doi: 10.1089/tmj.2016.0073

PubMed Abstract | CrossRef Full Text | Google Scholar

63. HodgeMon N. Feb 3, Pm 2020 1:22. Germany's Dual Approach to Data Regulation Under the GDPR. Compliance Week. (2020). Available online at: https://www.complianceweek.com/data-privacy/germanys-dual-approach-to-data-regulation-under-the-gdpr/28386.article (accessed April 12, 2020).

Keywords: wearable sensors, COVID-19, pandemic, predictive analytics, remote patient monitoring

Citation: Seshadri DR, Davies EV, Harlow ER, Hsu JJ, Knighton SC, Walker TA, Voos JE and Drummond CK (2020) Wearable Sensors for COVID-19: A Call to Action to Harness Our Digital Infrastructure for Remote Patient Monitoring and Virtual Assessments. Front. Digit. Health 2:8. doi: 10.3389/fdgth.2020.00008

Received: 03 May 2020; Accepted: 11 June 2020;
Published: 23 June 2020.

Edited by:

Mohamed Elgendi, University of British Columbia, Canada

Reviewed by:

Maria Vittoria Bulgheroni, Ab.Acus, Italy
Carlo Massaroni, Campus Bio-Medico University, Italy

Copyright © 2020 Seshadri, Davies, Harlow, Hsu, Knighton, Walker, Voos and Drummond. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Dhruv R. Seshadri, dhruv.seshadri@case.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.