Skip to main content

REVIEW article

Front. Comms. Net., 17 May 2021
Sec. IoT and Sensor Networks
Volume 2 - 2021 | https://doi.org/10.3389/frcmn.2021.648181

Can Radar Remote Life Sensing Technology Help Combat COVID-19?

  • 1Biosensing Laboratory, Department of Electrical Engineering, University of Hawaii at Manoa, Honolulu, HI, United States
  • 2Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, Bangladesh
  • 3Microwave Sensing, Signals and Systems Group, Department of Microelectronics, Delft University of Technology (TU Delft), Delft, Netherlands

COVID-19, caused by SARS-CoV-2, is now a global pandemic disease. This outbreak has affected every aspect of life including work, leisure, and interaction with technology. Governments around the world have issued orders for travel bans, social distancing, and lockdown to control the spread of the virus and prevent strain on hospitals. This paper explores potential applications for radar-based non-contact remote respiration sensing technology that may help to combat the COVID-19 pandemic, and outlines potential advantages that may also help to reduce the spread of the virus. Applications arising from recent developments in the state of the art for transceiver and signal processing technologies will be discussed along associated technical implications. These applications include remote breathing rate monitoring, continuous identity authentication, occupancy detection, and hand gesture recognition. This paper also highlights future research directions that must be explored further to bring this innovative non-contact sensor technology into real-world implementation.

Introduction

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has spread globally, after pneumonia of unknown cause was detected in Wuhan, China and first reported to the world health organization (WHO) on December 31, 2019 (World Health Organization, 2020). Since then, the associated coronavirus disease, COVID-19, has infected more than 54 million people all over the world and almost 10.9 million people in the United States (John Hopkins Medicine, 2020). The world is facing unprecedented challenges due to COVID-19 that jeopardize the priority of ensuring public health and safety. It has been found in various clinical investigations that most people infected by COVID-19 experience mild to moderate respiratory illness, and in some cases deadly breathing-related problems (Singhal, 2020). Governments in different countries are imposing travel bans, social distancing, and personal hygiene awareness. However, the spread of this deadly virus is increasing at a rapid rate which also imposes severe restrictions on day-to-day life. As more and more countries are on lockdown due to COVID-19 and an increasing number of people are living in isolation, the installation of in-home Doppler radar-based respiratory sensing systems can be beneficial. Doppler radar can potentially provide remote tracking of breathing rate and heart rate for isolated subjects (Lin, 1975), and recognize variations in breathing pattern to detect potential symptoms of COVID-19 (Grado et al., 2020; Taylor et al., 2020). Effective screening and timely isolation of patients can help reduce the number of infections. In addition, early recognition of infection through vital signs self-monitoring can allow early intervention and associated improvement in outcomes (Guidance for Industry and Food and Drug Administration Staff, 2020). Moreover, this unobtrusive respiration sensing technology can also be beneficial to track the status of breathing patterns after patients have left the hospital or ICU. Existing technology and solutions need to be developed quickly for diagnosis, monitoring, and molecular assessment to combat the current pandemic. Technologies need to provide unobtrusive monitoring to identify outbreak hotspots, count of occupants in closed indoor environments, and accurate recognition of symptoms without the need for physical proximity or contact.

Thus, remote vital sign sensing using microwave Doppler radar can have the potential to provide critical breathing-related information unobtrusively during this pandemic. A radar modified for biomedical purposes can track breathing rate through clothing (Droitcour et al., 2001; Islam et al., 2019), heart rate variability (Massagram et al., 2009a), tidal volume (Massagram et al., 2009b), and pulse pressure (Singh et al., 2011). Moreover, radar sensor technology has proved its initial efficacy for recognizing subject identity from breathing patterns (Islam et al., 2020e) and can also be used to count the number of occupants in a room (Yavari et al., 2014), which can potentially be used for security and surveillance applications to implement lockdown restrictions properly. This non-contact sensing solution is also intrinsically hygienic as it can also be used for gesture recognition unobtrusively (Zhang et al., 2016) or to replace push-button screens with contactless interactions.

This article provides an in-depth discussion of how radar-based non-contact sensing technology and its application in different areas can be used to help fight COVID-19 and reduce the spread of the disease. Prior research has mostly focused on discussing the state of the art of non-contact sensing techniques, without elaborating on the specific potential scope to fight COVD-19 (Taylor et al., 2020). The core contribution of this work is to illustrate different potential areas of non-contact radio-based sensing technology that may help in this fight. In this context, non-contact radio-based sensing technologies have the below capabilities which will be described in detail in the rest of the paper:

• Radar can track breathing rate and heart rate remotely without attaching any sensor to body surfaces. So, this non-contact sensing methodology can help to reduce the spread of the disease from patients to healthcare workers.

• An emerging area for radar sensing technology is the recognition of individuals from body motion information (breathing rate and heart rate). Authenticating people remotely can also help to maintain travel-related lockdown restrictions.

• Radar non-contact sensing technology can count the number of occupants in indoor settings, which may help to maintain lockdown restrictions and provide information for contact-tracing activities.

• Radar sensing technology can recognize hand gesture motion patterns. Unobtrusive hand gesture recognition is intrinsically hygienic and can replace contact interactions such as pushing buttons and/or touching screens, which can potentially reduce the spread of COVID-19.

The rest of the manuscript is organized as follows. How Does COVID-19 Affect the Heart and Respiratory System? section presents the effect of COVID-19 on the heart and respiratory system, whereas Basic Principle of Radar-Based Physiological Sensing section is focused on the basic principles of radar-based non-contact physiological sensing technology. Application Areas of Radar-Based Physiological Sensing Technology to Combat COVID-19 section provides a discussion on specific applications of radar-based non-contact respiration sensing technology (i.e., identity authentication systems, occupancy detection, and hand gesture recognition) to combat COVID-19. Discussion section concludes this paper.

How Does COVID-19 Affect the Heart and Respiratory System?

The effect of COVID-19 on the lungs and heart is becoming well understood and, as the pandemic continues, more information about the role of the virus is damaging the human respiratory system and other organs will become much clearer (Singhal, 2020). It has been observed in various clinical investigations that during severe SARS-COV-2 infection, heart function decreases because of direct viral infection in the heart (John Hopkins Medicine, 2020). From prior studies and recent pandemic experiences, it is quite clear that COVID-19 is a respiratory-related disorder severely affecting the lungs (Singhal, 2020). Respiratory patterns associated with COVID-19 are considered to be generally distinct from those associated with flu or the common cold, with many infected persons exhibiting Tachypnea (Wang et al., 2020). While normal breathing involves rates of about 12 breaths/min and chest displacement on the order of 1 cm, COVID-19 related rates can be 20–30 breaths/min, with chest displacements of 0.5 cm or less. In the case of older patients, heart failure is occurring due to coronary artery disease or hypertension, as the body has decreased cardiac reserve capacity (John Hopkins Medicine, 2020). On the other hand, for younger patient’s heart failure occurs due to inflammation of the heart muscles and heart electrical system (John Hopkins Medicine, 2020). Shortness of breath is another common symptom of COVID-19 which can indicate when patients should seek medical attention. In addition, during exams, medical professionals need to interact directly with the patients to monitor vital signs which increases the risk of further infection. Thus, remote respiration sensing using microwave Doppler radar may help not only reveal the presence and severity of the disease but also minimize the risk of infection transmission between medical professionals and patients due to close contact (Lin, 1975).

Basic Principle of Radar-Based Physiological Sensing

Doppler radar first emerged in 1930 and it was employed for physiological sensing research since 1971 (Lin, 1975). Radar stands for “radio detection and ranging” (Lin, 1975). Radar is in its essence a transceiver that contains a transmitter and receiver of electromagnetic waves. Different radar topologies are used for acquiring the desired information (e.g., range, velocity, and angle) (Lin, 1975). Radars are usually named after the modulation technique which is used for the transmit signal. A simple configuration can be thought of as a pure continuous-wave (CW) system that can sense target motion based on the Doppler shift of the received reflected signal. A CW radar constantly sends and receives a narrow bandwidth signal. Due to its narrow bandwidth, the design of filters and amplifiers are simpler, as are the demodulation and signal processing algorithms (Droitcour, 2006). Although CW radar can measure velocity without any ambiguity, the main limitation is that pure CW radars cannot measure absolute range (Lin, 1975). To detect the target range with CW radar, the signal should have a type of timing marker to allow measurement of the round-trip delay time. One solution to the range issue is using frequency-modulated continuous-wave (FMCW) radar. This can detect both range and velocity of the target (Droitcour, 2006). The frequency modulation is usually triangular for FMCW systems, and the frequency varies gradually. Altimeters and Doppler navigation devices use this type of radar (Fioranelli et al., 2019). A Doppler radar motion sensing system typically transmits a continuous wave (CW) electromagnetic signal (sometimes frequency modulated) that is reflected off a target and then demodulated in the receiver (Droitcour, 2006). According to Doppler theory, a target with a time-varying position but no net velocity will modulate a reflected signal with a phase shift that varies in proportion to the time-varying position of the target. The phase difference is due to the variations in the round-trip time travel of the signal reflected off the target (Droitcour, 2006). Figure 1 illustrates the human subject’s chest motion and phase modulation caused by this movement. The transmitted signal can be expressed by the following equations:

T(t)=cos[ω0t+ϕ(t)](1)

where, ω0 is the oscillation frequency of the transmitted signal, and ϕ(t) is the oscillator phase noise. Phase noise is a characteristic of any signal source and it is due to random phase fluctuations within the oscillator. If the subject is at a nominal distance d0 with respect to the transmitting antenna, and has a time-varying displacement x(t), the distance between the target and radar will be:

d(t)=d0+x(t)(2)

The transmitted microwave signal travels to the target and the backscattered signal which carries body motion information is captured by the receiving antenna. The received portion of the signal goes through a phase change due to path length variations and amplitude change. It can be expressed by the following equations:

R(t)=Arcos{ω0t+2πλ[2d0+2x(t)]+ϕ(t2d0c)+θ0}(3)

where R(t) is the time-delayed version of the transmitted signal, Ar is the received signal amplitude, λ is the wavelength of the signal and θ0 is the constant phase shift and after demodulating the time-delayed version of the phase information which can be better described as phase demodulation.

θ(t)=2fc[2πx(t)]=4πx(t)λ(4)

Thus, demodulating the phase will then provide a signal directly proportional to the small movement of the chest surface due to cardio-respiratory activities (Droitcour, 2006). The peak-to-peak chest motion due to respiration ranges in adults from 4 to 12 mm (Droitcour, 2006), while the peak-to-peak motion due to the heartbeat is in the range of 0.5 mm, with smaller variations from subject to subject (Benchetrit, 2000). When the wavelength is less than twice the peak-to-peak motion, the signal can be demodulated by simply multiplying the signal with an unmodulated signal from the same source (Droitcour, 2006). A Doppler radar with a frequency band around 2.4–24 GHz is mostly used for this type of biomedical application (Droitcour, 2006). There are no known health hazards attached to the system, as the maximum power consumption limit is almost 1,000 times less than the peak power of the ordinary global system for mobile communication (GSM) cellphone that is commonly encountered in day-to-day life (Benchetrit, 2000). The signal is then down-converted to baseband by mixing this with the transmitted signal and then sent to a low noise amplifier for amplification. When the signal is down-converted, it is multiplied with the same phase signal and a quadrature version of the transmitted signal. We receive two different types of channel signals; one is called the in-phase signal (I channel) and the other one is the quadrature-phase signal (Q channel). The output can be described by:

BI(t)=AIcos[4πd0λ+4πx(t)λ+θ0](5)
BQ(t)=AQsin[4πd0λ+4πx(t)λ+θ0] (6)

where, BI is the in-phase and BQ is the quadrature version of the signal. To extract the maximum chest displacement information, we can use the arc-tangent demodulation technique to extract the phase information from the two-channel receiver (Massagram et al., 2009b; Massagram et al., 2009a). Then the received signal is digitized using a data acquisition system (DAQ). Finally, a customized digital interface (e.g., in LABVIEW or MATLAB) can capture the respiration pattern. Figure 2 shows the typical block diagram of the Doppler radar transceiver for physiological sensing. After capturing the signal, we can use digital signal processing techniques and estimate the breathing rate and heart rate (Li et al., 2013). Figure 2B illustrates at the top the time domain signal of the I and Q channels. If we perform a fast Fourier transform (FFT), which is the basic signal processing technique for extracting the spectrum from a time-domain signal, we can see two different dominant peaks. The first peak is the respiration, and the next dominant peak is the heartbeat. During respiration activities, breathing is impacted by heart movement, so the heartbeat signal is superimposed on breathing signals.

FIGURE 1
www.frontiersin.org

FIGURE 1. Basic principle of non-contcat physiological sensing using microwave Doppler radar. The phase change of the reflected signal represented as θ(t) is directly propotional to the small movement of the chest surface x(t) due to cardio-respiratory activity. From Droitcour et al. (2001).

FIGURE 2
www.frontiersin.org

FIGURE 2. Doppler transceiver functionality. A typical single channel Doppler radar trasnceiver, (A), is used to produce time varying signals and spectra, (B) resulting from a human subject 1.5 m away from the radar. From Li et al. (2013).

In literature, many technologies have been utilized for daily activities and vital signs monitoring such as camera-based sensors and wearable devices (accelerometer, gyroscope, and magnetic sensor) (Shah and Fioranelli, 2019). Vision-based sensing is a mature technology, however it is light-dependent and often creates privacy concerns when deployed in private home environments. Wearable devices need to be worn on the body or otherwise carried around, which is often uncomfortable and not suitable for long-term monitoring applications (sleep, daily activities) (Shah and Fioranelli, 2019). Additionally, both vision-based and wearable sensors can come at a high cost due to their deployment complexity, maintenance overhead, and computationally expensive processing (Shah and Fioranelli, 2019). On the other hand, radar has non-contact-monitoring capabilities and an increasingly lower cost due to growth in inexpensive consumer electronics operating at microwave/millimeter-wave frequencies driven by the demand in automotive collision avoidance as well as 5G and Wi-Fi communications. As an example of the economical integration of radar systems with everyday objects, Google has integrated a 60-GHz radar with a mobile phone for automatic contactless control utilizing hand gestures, and also more recently within smart thermostats for human presence detection (Bohn, 2019; CNBC, 2020).

Remote life sensing of humans with Doppler radar has been widely used and reported in several research articles, with proof of concepts demonstrated for various applications (Li et al., 2013). This non-contact and non-invasive form of measurement has several potential advantages especially for neonates or infants at risk of sudden infant death syndrome (Hafner et al., 2007), adults with sleep disorders (Baboli et al., 2020), and burn victims because of its non-contact and unobtrusive measurement (Li et al., 2013). This form of respiration monitoring reduces patient discomfort and distress as electrodes need not be attached to the body. The inherent advantage of this unobtrusive non-contact measurement technique has increased its area of potential applications in occupancy detection, energy management in smart homes, baby monitoring, and has also opened the door to many other indoor applications (Li et al., 2013). In the last decade, with the growing interest in health and life sciences in the engineering community, many researchers have been contributing to the development of new front-end architectures, baseband signal processing methods, and system-level integration in biomedical radar to improve detection accuracy and robustness (Li et al., 2013). Moreover, Doppler radar has also been implemented to monitor the health and behavior of land and sea animals, including lizards and fish (Singh et al., 2012). Sleep monitoring is another emerging application that alleviates the use of obtrusive devices such as spirometers that can change the sleeping pattern (Baboli et al., 2015). A clinical study was performed to monitor patients with sleep apnea problems using radar sensors in conjunction with traditional sensors (Baboli et al., 2020). Sleep respiration monitoring devices have recently received FDA approval for commercial use in the United States (FDA, 2009). As radar can track sleep apnea events and sleep stages, any kind of breathing disorder can be easily tracked by such a biomedical sensor (Baboli et al., 2020). All these achievements can be used to present a clear picture of how this sensor technology can help to fight against the COVID-19 pandemic.

Application Areas of Radar-Based Physiological Sensing Technology to Combat COVID-19

At the time of writing this article, most countries are on lockdown to minimize the spread of COVID-19. Moreover, those patients who have tested positive for COVID-19 without severe symptoms are in self-isolation at home. Even the robust healthcare system in developed countries is facing shortages of healthcare professionals, personal protective equipment, and mechanical ventilators in intensive-care-units (ICU) (Kissler et al., 2020). Thus, remote vital sign sensing of patients using radiofrequency (Radar) is gaining attention to support the monitoring of patient vital signs in their home environment during this public health emergency (Alwashmi, 2020). Additionally, new policies have been introduced to the development of remote vital signs monitoring devices to improve existing vital signs monitoring facilities (FDA, 2009). Considering the inherited advantages of this sensor technology, the system has the potential to fight COVID-19, as illustrated in the areas of applications in Figure 3. Specifically, we will focus on describing four different potential technological aspects of biomedical Doppler radar to combat COVID-19: remote breathing monitoring, unique identification, occupancy detection, and hand gesture recognition. The subsections will describe in detail the potential application areas.

FIGURE 3
www.frontiersin.org

FIGURE 3. Potential application areas of Radar-based physiological sensing technology for fighting the COVID-19 pandemic.

Remote Breathing Monitoring

Triage decisions, diagnosis, prognosis, and the early detection of COVID-19 patient deterioration also depend on changes in respiratory rate (Massaroni et al., 2020). The World Health Organization (WHO) suggests that in a sedentary condition, if breathing rate crosses greater than 30 breaths/min then there is a higher chance of severe pneumonia in adults, while the threshold value for infants varies according to their age (World Health Organization, 2020). The decision on the use of supplemental oxygen in the ICU is also decided based on the breathing rate of the patient (Ayebare et al., 2020). Additionally, continuous monitoring of breathing rate helps with timely recognition of COVID-19 patient deterioration, thus contributing to early intervention strategies (Sun Q. et al., 2020). Thus, microwave Doppler radar which exploits the modulation of the radio waves reflected by respiratory-related thoracic movements is a promising technology for continuous respiratory monitoring (Lin, 1975; Droitcour, 2006; Li et al., 2013). Prior research has demonstrated the feasibility of utilizing Doppler radar for tracking breathing rate and heart rate accurately (Lin, 1975, Islam et al., 2019a; Droitcour et al., 2001; Droitcour, 2006; Li et al., 2013). Moreover, the feasibility of extracting different abnormal respiratory patterns using microwave Doppler radar has been investigated (Islam et al., 2019b; Lee et al., 2014). Figure 4 illustrates the spectral density (FFT) and continuous wavelet transform of radar captured normal (Figure 4A) and Cheyne-Stokes (Figure 4B) breathing patterns. For normal breathing, the breathing rate can be seen in the FFT and continuous wavelet transform, which is around 0.24 Hz (Lee et al., 2014). For Cheyne-Stokes breathing the dominant FFT peak is not as visible but it is much more visible in the continuous wavelet transform which is around 0.977 Hz. Cheyne-Stokes breathing is a respiratory disorder often encountered by patients with stroke, brain tumors, and traumatic brain injury (Lee et al., 2014). The overall validation of the radar measurement in comparison to the gold standard respiration belt signal for eight different abnormal respiratory patterns was also investigated and the accuracy of the radar measurement was around 94.25% (Lee et al., 2014). Patients that need continuous vital sign monitoring, even during everyday life activities, can be equipped with the radar system in their home environment, which can provide valuable information about their breathing status. During pandemic isolation, if a patient has a breathing problem occurring, an alarm can go off to warn caregivers that he/she may need emergency contact with the medical team. Similarly, radar can also track any breathing rate related discrepancies, such as if respiratory rate exceeds 30 breaths/min, and could trigger an alarm to warn the monitored subject. In this way, early medical intervention can be ensured at the earliest onset of breathing problems to help reduce fatality rates. Also, proximity to an infected person during the measurement of vital signs greatly increases the likelihood of contagion transfer. Non-contact radar-based vital signs monitoring may thus allow greater control of viral spread due to its remote form of measurement. However, there are some technological challenges in deploying such a sensor system in a multi-subject environment, which is likely to occur in a hospital or in-home environment. When there are multiple subjects in front of the radar, a combined mixture of breathing patterns results which may appear as interference countering the determination of the true respiration patterns (Islam et al., 2018a; Islam et al., 2018b; Islam et al., 2020d). Thus, the next section details some technical achievements addressing the challenge of multiple subject monitoring.

FIGURE 4
www.frontiersin.org

FIGURE 4. Spectral density (FFT) and continuous wavelet transform of normal breathing, (A), and Cheyne Stokes breathing, (B). Taken from Lee et al. (2014).

Challenges for Respiration Sensing in a Multi-Subject Environment

Separating individual respiratory signatures from a combined mixture is a critical challenge that must be met in order to implement this sensor technology in real-world scenarios (Islam et al., 2018a; Islam et al., 2018b; Islam et al., 2020d). The technology works well for isolated single subjects, especially when subjects are following social isolation and keeping physically separated from each other. In a typical home or hospital environment, there is a significant probability of the presence of multiple subjects in the radar field of view, which results in radar measurement of a combined mixture of breathing patterns that is difficult to separate (Islam et al., 2018a; Islam et al., 2018b). Figure 5 illustrates the challenges of respiration sensing in multi-subject environment. Prior research has focused on utilizing separate antennas for each different occupant, which is not usefully scalable in realistic scenarios (Islam et al., 2018b). Still, having more than one antenna element helps to estimate the angular location or spatial position of the target (Islam et al., 2018b). If the antenna array elements are separated by distance, d, with a wavefront incident at an angle, θ, due to the path difference between antenna array elements when the wavefronts are incident from two different subjects, the incoming received signal experiences a phase difference, δϕ. The relationship between the phase difference and path difference is kdsin(θ)=δϕ, where K is the wavenumber, and θ is the angular location of the target. Estimating the angular location of the target/subject is called the direction of arrival (DOA) (Islam et al., 2018b). Angular discrimination of radar is the minimum distance between two equal targets at the same range in which radar can distinguish them (Islam et al., 2018b). Using an antenna array provides an angular discrimination range which is represented as: SA2Rsin(θ/2); where R is the radial distance from the target and SA is the angular discrimination limit. Additionally, a prior attempt also utilized Independent component Analysis (ICA) which is an advanced signal processing technique to isolate the respiratory patterns from combined mixtures within a single field of view (Islam et al., 2018a). ICA is essentially a method for recovering the independent source signals from a mixture of signals (Islam et al., 2018b). Suppose that there are mixtures of signals x1 and x2 are a linear combination of independent source signals s1 and s2. The linear mixture can be written as: x1=a11s1+a12s2, x2=a21s1+a22s2, where A is the mixing matrix A=[a11a12a21a22] and S is the source signal matrix, S=[s1 s2].

FIGURE 5
www.frontiersin.org

FIGURE 5. Illustration of challenges of respiration sensing in multi-subject environments. While it is possible to isolate one well-spaced subject’s respiratory signature from a combined mixture using direction of arrival (DOA), subjects closer together impose antenna array resolution limitations for DOA. Alternatively, the ICA/JADE algorithm can employ spectral analysis to isolate respiratory signaturesfor subjects in close proximity.

In summary, ICA attempts to recover pure source signals by estimating a linear transformation using a criterion that measures statistical independence among the sources. The objective of ICA is to find a separating matrix or demixing matrix, W which is equivalent to W=A1. Finally, the output independent separated source signals can be represented as S(t)=WX. This demixing matrix may be achieved using higher-order statistics (Islam et al., 2018a). Several algorithms are available in the literature (Islam et al., 2018b). In a recent attempt, an intelligent decision algorithm is proposed for integrating these two different approaches (ICA and DOA) to separate independent respiratory signatures from combined mixtures, using each method only in the scenarios where they work best. The proposed decision algorithm helps to overcome the resolution limit of the antenna array spacing by coherently combining two different approaches (Islam et al., 2020d). During the COVID-19 pandemic, hospitals are experiencing overwhelming numbers of patients so tracking vital signs using traditional contact sensors increases the probability of infection between patients and caregivers due to close contact, and at the same time presence of multiple subjects in front of the sensor will be higher. By integrating these approaches, the scientific community can further advance utilizing this technology in hospital and in-home environments especially for the presence of multiple subjects.

One of the fundamental challenges in radio-frequency (RF) based respiration sensing technology is the motion noise produced by random torso or limb movement. Prior research successfully demonstrated radar remote respiration sensing during random body movement (Li and Lin, 2008; Gu et al., 2013a; Gu et al., 2013b). In their proposed method random body movement can be minimized in three different ways. The frist method involves utilization of phase compensation at the RF front end (Gu et al., 2013a), the second involves adding phase-compensation at the baseband signal (Gu et al., 2013a), and the third involves cancellation of random body movement during demodulation (Li and Lin, 2008). Multipath is another challenging problem in this research area, where multiple reflections of the transmitted signal return via different special paths. However, recent advancements in directional antennas and beamforming can help to mitigate this effect by making direct path refections distinct from and multipath copies. Also, multipath signals mostly act as static clutter that can be removed in the RF front end, and also during postprocessing by bandpass filtering and removing the mean of the signal (Yang et al., 2020).

Radar-Based Continuous Identity Authentication

Artificial intelligence (AI) has been used by countries to support the fight against the viral pandemic affecting the entire world since the beginning of 2020 (John Hopkins Medicine, 2020; World Health Organization, 2020). China, the first epicenter of this disease, used authentication technology such as facial recognition to restrict the movement of the population which helped stop the spread of the virus (Reuters, 2020). However, video camera image-based approaches suffer from several irreconcilable dilemmas, including a lack of privacy and degraded performance under low light ambient conditions (Islam et al., 2020e). Besides, cybercrimes are increasing rapidly and thousands of coronavirus-related websites are subjects to attacks and abuse (Reuters, 2020). Phishing attacks through these websites can potentially be used to steal people’s passwords, ID, and social security card information. Thus, multi-factor authentication can also help to fight against this type of unprecedented situation during the COVID-19 pandemic (Block et al., 2020). Social distancing and good implementation of lockdown can help prevent the spread of the virus (Block et al., 2020). Thus, a Radar-based identity authentication system has certain potential advantages to overcome the challenges faced by users and the government of the country to implement lockdown properly.

Identity authentication using microwave Doppler radar is gaining interest and is another emerging potential field that researchers are exploring as an alternative to the camera and fingerprint-based biometric systems which have several privacy issues (Lin et al., 2017, Rahman et al., 2018). The existing biometric-based authentication system is far from satisfactory and not completely trustworthy, as it is a one-pass validation system (Lin et al., 2017). People must intentionally engage themselves, such as scanning a fingerprint or repeating their password after a certain interval of time (Lin et al., 2017). To replace or supplement traditional biometric systems, researchers have tried using different physiological traits, such as iris (Jiu et al., 2016), vein (Wang and Wang, 2017), eye movement (Lyamin and Cherepovskaya, 2017), keystroke dynamics (Pinto et al., 2014), and gaze pattern (Mock et al., 2012) to create multi-factor continuous authentication. All these proposed attempts require either the user’s intentional engagement with the authentication system or contact with the data acquisition sensors (Lin et al., 2017, Rahman et al., 2018). Considering all these limitations, unobtrusive forms of measurement for cardiac motion-based security systems are gaining more research interest in the search for new biometric authentication systems.

The basic idea of cardiopulmonary motion-based identity authentication exploits the fact that different people have differences in physical organ, size, shape, and muscle strength (Islam et al., 2020e). In addition, different people breathe differently in terms of their tidal volume, airflow profile, breathing depth, and energy (Benchetrit, 2000). The complete cardiac motion cycle consists of five different stages including 1) ventricular filling (VF) 2) atrial systole (AS), 3) isovolumetric ventricular contraction (IC), 4) ventricular ejection (VE), and 5) isovolumetric ventricular relaxation (IR) (Benchetrit, 2000). These cycles are significantly unique because of different volumes, surface shape, and moving dynamics (speed, acceleration, etc.), and deformation of the heart (Benchetrit, 2000; Islam et al., 2020e). It has also been demonstrated in various clinical investigations that no two persons have the same cardiac blood circulation heart (Benchetrit, 2000; Islam et al., 2020e).

Dynamic segmentation is a method that essentially evaluates the displacement and identifying points in the range of 30–70% amplitude of both inhale and exhale episodes, which defines four boundary points of a trapezium of the radar-captured respiration patterns (Rahman et al., 2018). The ratio of these two areas provides a useful feature that indicates how quickly the next cycle of inhalation starts (Rahman et al., 2018). Figure 6 illustrates the inhale/exhale area ratio features for two different subjects, which differ significantly. Based on these unique features, a k-nearest neighbor (KNN) algorithm was integrated to identify each person which showed a classification accuracy of almost 90% (Rahman et al., 2018). To increase the accuracy of the proposed method, the minor component analysis was performed on subject data sets which showed overlapping inhale and exhale area ratios. For extracting minor components, a linear demodulation technique is employed. The variations in minor components show the radar-cross section (RCS) and a high-frequency component of respiration and heart signal modulation. Higuchi fractal dimension analysis was performed on minor components of the radar captured signals to identify overlapped inhale/exhale area ratios of subjects, which increased the classification accuracy to 95% (Rahman et al., 2018). The proposed dynamic segmentation method clearly shows efficacy.

FIGURE 6
www.frontiersin.org

FIGURE 6. Respiratory pattern classifiers used for subject recognition. Dynamically segmented inhale/exhale area ratios of two subjects significantly differ, (A), as do signal patterns relating to the dynamics of breathing near the points where the inhale and exhale transition occurs, (B). From Rahman et al. (2018).

A study was conducted by a research group at the University of Buffalo on seventy-eight different participants for identity authentication (Lin et al., 2017). From the radar captured signal they extracted five different points which were hypothesized to fully represent cardiac motion. Based on this hypothesis, the experiment illustrated that heart-based geometry measures differ from person to person due to differences in size, position, and anatomy of the heart, chest configuration, and various other factors. From their experimental findings, it was also clear that no two subjects had the same heart, tissue, and blood circulation system, as there were significant differences in their cardiac cycle points measured in the radar data set (Lin et al., 2017). Figure 7 illustrates the cardiac motion marker for one segment captured from the radar respiration measurement. Within that segment from the five different points velocity and displacements were calculated and stored in the system for different participants. A support vector machine (SVM) with a radial basis function kernel classifier was employed to uniquely identify different participants. A study of 78 subjects was reported, and the proposed system achieved an accuracy of 98.61% and a 4.42% equal error rate. One of the limitations of the proposed system is that the complete study was performed with healthy sedentary persons. For further investigation, in another study, the feasibility of recognizing people after performing post-physiological activities was tested (Islam et al., 2020b). It was found that subject recognition still worked with an accuracy of 92% (Islam et al., 2019a; Islam et al., 2020b). Experimental results demonstrated that, after short exertion, dynamically segmented exhale area and breathing depth increased by more than 1.4 times for all participants, which made evident the uniqueness of the residual heart volume after expiration for recognizing each subject, even after short exertion (Islam et al., 2019a; Islam et al., 2020b). Furthermore, there was another investigation of identity authentication of patients with obstructive sleep apnea (OSA) symptoms based on extracting respiratory features (peak power spectral density, packing density, and linear envelop error) for radar captured paradoxical breathing patterns, in a small-scale clinical sleep study integrating three different machine learning classifiers (SVM, KNN, and random forest) (Islam et al.,2020). Their proposed OSA-based authentication method was tested and validated for five OSA patients with 93.75% accuracy, using a KNN classifier that outperformed other classifiers (Islam et al.,2020). A research group at MIT also published papers on emotion recognition from radar captured respiration patterns (Zhao et al., 2016).

FIGURE 7
www.frontiersin.org

FIGURE 7. Cardiac motion marker. The cardiac motion cycle defined by five different markers (red dots) at five different points of displacement and timing was calculated as a unique feature for recognizing people. From Lin et al. (2017).

The radar-based identity authentication approach is not a mature technology yet. However, all the reported research demonstrated the efficacy of the proposed radar captured cardiopulmonary-based identity authentication technique, which encourages further investigations. Thus, the emerging radar-based identity authentication approach can help to recognize people unobtrusively for implementing lockdown or tracking. The multi-factor authentication system described can thus be beneficial for reducing vulnerability to malicious activities (theft of personal information, ID, and social security) during this pandemic.

Radar-Based Occupancy Detection

Radar is an attractive approach for estimating the number of occupants in a building and it is gaining research attention (Yavari et al., 2014). The detection of human cardiopulmonary motion using microwave Doppler radar can be a potential way of recognizing the number of occupants in a room (Yavari et al., 2014). Conventional occupancy sensors are typically motion sensors such as passive infrared (PIR) sensors (Abedi et al., 2019). A significant drawback of PIR sensors is the high rate of false detection rate as it only recognizes motion (Abedi et al., 2019). When subjects are stationary in a home environment, traditional occupancy sensors cannot determine the true presence of humans (Yavari et al., 2014). An alternative to the PIR sensor is video camera-based sensing technology (Abedi et al., 2019). However, video-image-based occupancy detection is accompanied by considerable privacy concerns (Abedi et al., 2019). The detection of human cardiopulmonary motion with Doppler radar could provide a promising approach to overcome the conventional sensor problems of false triggering and dead spots when humans are sedentary (Yavari et al., 2018).

Prior research efforts have demonstrated the efficacy of this technology to count the number of occupants in a home environment based on received signal strength (RSS) (Yavari et al., 2018). Radar reflected power at the receiving antenna can be described by the radar equation:

PR=PTGTGRσλ2(4π)3 R4(7)

PR is the received power, PT is the transmitted power, GT, GR is the antenna transmitting and receiving gains, σ is the radar cross-section and λ is the wavelength. The radar cross-section is the only term determined by the number of subjects, not by the transceiver. It is essentially a measure of how well the target reflects the transmitted radar signal in the direction of the transceiver. For occupancy detection, RCS will be affected by the number of subjects and hence RSS will also be changed with the number of occupants. Thus, the RSS method has the potential to count the number of occupants in a room. Figure 8 illustrates an experimental setup of occupancy detection where a 2.4-GHz continuous wave (CW) quadrature radar system was used. Radar output was recorded for 23 min. Figure 8C shows the radar measurement where the spike represents the entrance of a new subject after every 90 min. Figure 9 shows the radar received power as a function of the number of occupants. There is an increasing power trend seen in signal strength received by radar transceivers. Reflected signal power, or in other words, RSS, is directly proportional to the number of occupants in each space. The reported experimental results demonstrate the possibility of the estimation of the number of occupants in an indoor area. Additionally, when the subjects are in a sitting position without moving their hands, radar can estimate the number of occupants in an indoor environment. RSS can be a good indicator for counting the number of occupants. A radar with + 7 dBm output power was employed in 257 ft2 classroom for counting ten subjects. Thus, the proposed RSS method demonstrates the efficacy of counting the number of occupants in a classroom (Yavari et al., 2018).

FIGURE 8
www.frontiersin.org

FIGURE 8. Radar-based subject presence detection and count. Experimental setup for radar measurement in a classroom, (A), filled with subjects for testing, (B), and raw radar data used for assessing presence, (C). From Yavari et al. (2018).

FIGURE 9
www.frontiersin.org

FIGURE 9. Experimental results with ten occupants in an indoor environment. The RSS of the received signal is significantly different for different numbers of occupants. From Yavari et al. (2018).

In another attempt, a 24-GHz K-LC3 wide-angle CW Doppler radar transceiver has been employed for detecting the occupancy state (vacancy/occupied) (Abedi et al., 2019). In their attempt, they investigated two different approaches, the first approach is a threshold-based decision algorithm and another one is a deep neural network-based approach. By utilizing the deep learning model, the need for specialized feature extraction is removed, because the task for feature extraction in a DNN model is performed automatically by the initial layers (Zhao et al., 2016). For the threshold-based approach, a threshold was predefined based on the amplitude of the radar-captured signal within the range of recorded signal amplitude (−1 V to +1 V). If the average signal amplitude for a certain window size of 10 s crosses the amplitude level, then this method can determine whether the room is occupied or vacant (Abedi et al., 2019). Figure 10 illustrates the output of the radar sensor signal where the blue line represents the occupied state, and the red line illustrates the unoccupied cases. For the case of the deep learning model, 10-s of sensor data is fed into the model wherein 500 of these cases, the room was unoccupied and in the other 500 cases room was occupied. The evaluation of the model was performed through 3-fold cross-validation. The threshold-based method has achieved an average accuracy of 84.3% (Abedi et al., 2019). On the other hand, the deep neural network model-based approach outperformed with an average accuracy of 98.9%. The experimental study clearly illustrates the efficacy of reliable and accurate occupancy detection and counting the number of people in a home environment.

FIGURE 10
www.frontiersin.org

FIGURE 10. Experimental results of radar-based occupancy state determination where blue line represents occupied and red line denotes unoccupied. From Abedi et al. (2019).

During this COVID-19 pandemic governments in different countries are struggling for implementing strict lockdowns. Occupancy detection using radar systems can help to track the number of occupants in a room and at the same time, and if some new people enter a room it can produce some alarm. Strict social isolation and quarantine can be better implemented by installing this intelligent radar-based physiological sensing system.

Radar-Based Hand Gesture Recognition

During this pandemic, a lot of people have been infected with COVID-19 by touching the contaminant surface (Kampf et al., 2020). In general, viruses and bacteria surviving on any surface for a long time could contaminate the interface and cause people’s health problems (Sun Y. et al., 2020). Radar-based hand gesture recognition may help people to interact with the system in a contactless way to reduce the risk of being infected with the virus in a public environment (Sun Y. et al., 2020). For example, recently tech giant Google has integrated a 60 GHz radar into the smartphone Pixel 4 which essentially allows users to control different buttons without touching the screen (Bohn, 2019). This non-contact hand gesture recognition is intrinsically hygienic because users need to touch much fewer surfaces or buttons. Additionally, radar sensors are preferred over cameras due to privacy-invasive reasons and are insensitive to ambient light (Sun Y. et al., 2020).

In one study, a 2.4 GHz CW radar system with a transmission power of 10.0 dBm was employed for hand gesture recognition (Sakamoto et al., 2018). The same antenna is used for transmitting and receiving, where the transmitting/receiving signals are isolated with a hybrid coupler. The received signal is mixed with the in-phase and quadrature-phase of the transmitted signal and then low-pass filtered with a cut of frequency 10 Hz. After analog to digital conversion in-phase (I) and quadrature (Q) signal is obtained with the sampling frequency of 1 kHz. The A/D converter is connected to the signal cable through dc coupling, and dc subtraction is also performed in the post-processing of the signal. The dc subtraction helps avoid distortion in I-Q plots, while still capturing even slow-moving respiration and heartbeat. This study was performed on ten different participants for recognizing six different hand gestures. The subjects were seated in front of the radar system with their arm approximately 120 cm from the radar antennas. For gesture recognition, they used the trajectory image of the I-Q plot of received signals. This I-Q plot signal not only changes in terms of the phase but also varies with the amplitude. The trajectory images are converted to a low-resolution JPEG image with a size of 30 pixels and then feed into a convolutional neural network (CNN) to recognize different hand gestures (Sakamoto et al., 2018). Figure 11 illustrates the experimental setup, radar I/Q plot associated JPEG images, and block diagram of the CNN architecture. The basic idea of having different orientations in the I-Q plot is due to the change in effective radar cross-section (ERCS) with the orientation of the hand gestures. ERCS changes with the shape, size of the target/subject (Snigdha et al., 2020). The input images with a size of 30×30 pixels are convoluted with 40 types of filters in a layer having a size of 5×5, resulting in 40 images, and then images are passed through CNN layers. The overall classification accuracy of the proposed system was around 91.3% (Sakamoto et al., 2018). The proposed technique clearly illustrates the feasibility of gesture recognition using CW radar with computationally inexpensive time-domain signal representation (I-Q plot) (Sakamoto et al., 2018). Most of the attempts in literature focused on utilizing FMCW radar to recognize hand gestures due to range, velocity, and angle estimation capabilities (Yu et al., 2020). Most reported research is based on machine learning to recognize features of the gestures from radar echoes. The time-frequency spectrogram method considered the range estimation of each chirp (Zhang et al., 2018), the micro-Doppler spectrogram considered the velocity estimation of each frame (Ritchie et al., 2017), and the range-Doppler image (RDI) considered both the range and velocity estimation of each frame ( Wang et al., 2016). RDI is one of the most popular feature extraction methods for hand gesture recognition using FMCW radar. It is worth mentioning that the Google Soli project uses RDI and recognizes hand gestures by integrating CNN (Wang et al., 2016). This prototype has been implemented in Google Pixel 4 phones (Wang et al., 2016; Yu et al., 2020). In addition to the RDI used in (Wang et al., 2016; Zhang et al., 2018) the literature, recently a study also reported the feasibility of utilizing range-angle image (RAI) for hand gesture recognition (Yu et al., 2020). Their study also showed that the performance of the RAI method is better than the RDI approach (Yu et al., 2020). In their attempt, they also considered fusion architecture to consider both RAI and RDI images which also increases the performance of the system. They used a 77–81 GHz Texas Instrument (TI) FMCW radar chip to capture the RDI and RAI images of participants’ hand gestures. In their experiment, they collected data set for 12 hand gestures of 11 different participants. After converting the measurements into a range-Doppler image (RDI) and range angle image (RAI) these were feed into the CNN model. The model is shown in Figure 12. The accuracy of the RDI and RAI approach is 81.04 and 91.51%, respectively. It is also observed that RAI has better performance than RDI under the settings of one transmit antenna and four receive antennas. After fusing RDI and RAI dataset the overall performance of the system is around 92.74%.

FIGURE 11
www.frontiersin.org

FIGURE 11. Radar-based hand gesture recognition. Experimental setup with subjects in seated position in front of the radar system in an anechoic chamber, (A), and example images of radar I/Q plots associated with gestures, (B), and block diagram of CNN used of pattern recognition, (C). From Sakamoto et al. (2018).

FIGURE 12
www.frontiersin.org

FIGURE 12. Range Doppler Image (RDI) and Range Angle Image (RAI) gesture recognition. Experimental results are shown for horizontal RDI, with palm swept from right to left (A), vertical RDI (B), horizontal RAI (C), and vertical RAI (D). Gesture recognition system network model is also shown, (E). From Yu et al. (2020).

Recent Efforts by Industry and Academia to Implement Radar Sensor Technology to Fight Against COVID-19

Israel’s military radar system is being adapted to remotely monitor the vital signs of patients suffering from COVID-19 (TechRadar, 2019). The system uses an array of radar and optical sensors with which vital signs were measured and displayed on monitors for medical professionals (doctors and nurses) in a sterile environment to avoid direct contact for the risk of infection (No Camels Team Israel, 2020). The Israel defense company Elbit Systems and Vayyar, a tech company, are working together to advance this technology and have already demonstrated the efficacy of this non-contact remote respiration monitoring technology to fight against the COVID-19 pandemic (No Camels Team Israel, 2020). Additionally, they have also conducted an extensive clinical study with Rabin Medical Center to test the efficacy of radar-based non-contact breathing monitoring of COVID-19 patients at the point of diagnosis and during treatment (No Camels Team Israel, 2020). The goal of their project is to use non-contact sensing of respiration to help reduce the number of infections by helping medical personnel avoid close contact with patients.

In another attempt, MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) in collaboration with the Boston clinical team also reported some promising results of remote sensing of respiration of COVID-19 patients (Adam, 2020). MIT developed a Wi-Fi-like box called Emerald which also uses reflected wireless signals in the environment and artificial intelligence to infer people’s vital signs, sleep, and movement (Adam, 2020). This signal emits roughly 1,000 times less radiation than a standard cell phone so there are no known additional health hazards for this technique (Adam, 2020). Additionally, with prior consent, they installed their device into a COVID-19 patient’s room to monitor respiration, demonstrating efficacy for monitoring breathing rate and heart rate remotely, confirmed with checks by medical professionals (Adam, 2020). Figure 13 illustrates the results of the recorded breathing rate of COVID-19 patients in their home environment. Remote monitoring products like Emerald developed by MIT could also help to expand healthcare facilities as the demand on hospital spikes with an increasing number of COVID-19 patients. Additionally, safe, remote, non-contact, and continuous breathing monitoring could also allow hospitals and physicians to triage less severe patients and monitor them in their own home, while still allowing them to respond quickly in case of aggravated illness. Many other research groups and industries are working hard to bring this potential sensor technology into the real world to combat COVID-19.

FIGURE 13
www.frontiersin.org

FIGURE 13. Radar measurement of COVID-19 affected breathing. A dataset of COVID-19 patient breathing recorded by MIT’s product clearly illustrates the feasibility of remote respiration sensing using radar to fight against COVID-19. From Adam (2020).

Discussion

This COVID-19 pandemic has disrupted and impacted the lives of hundreds of thousands of people and continues to bring new challenges every day. During these times of uncertainty, high stress, and anxiousness, it is important to make supportive technology available to common people to at least minimize the spread of the virus and associated distress. Researchers and industry should work together to bring this remote sensing technology into real-world implementation, addressing functionality and production issues, to ease current life difficulties associated with precautions and isolation.

Radar is an attractive approach for sensing breathing rate and heart rate remotely, as installing this sensor technology in a home or hospital environment can help to reduce the risk of potential exposure from close contact with infected persons for measurement of their vital signs. Furthermore, tracking breathing rate and heart rate ubiquitously can provide screening for signs of respiratory distress and associated infection. For COVID-19 infected patients with less severe symptoms, a non-contact continuous breathing monitoring system can help them to self-monitor and respond quickly in case of aggravated illness or shortness of breath. At the same time, the radar system can be integrated with a telemedicine system to send respiration-related information to physicians so that the patients need not be worried about unnecessary emergency visits to the hospital.

For implementing lock-down and social isolation restrictions strictly, radar-based occupancy sensing can also provide potential help. Radar can determine the number of occupants in a room or a house. So, if there is an intruder or any inappropriate social gathering, it can objectively raise an alarm to make sure that people are following social isolation and quarantine rules strictly. Maintaining strict social isolation and quarantine can help to reduce the spread of the virus which also helps to reduce the fatality rate. For proper implementation of lockdown and travel bans, a radar-based ID system can potentially track a person if this type of sensor system is integrated with a cell phone. Many countries are struggling when visitors are traveling from an infected area. Many governments have imposed a 14-day quarantine rule for visitors. However, in reality, it is difficult to track each visitor, many of who are visiting for recreation. Thus, a radar-based unobtrusive recognition system can help to implement this type of quarantine rule more strictly so that the spread of the virus can be reduced. Radar-based automatic hand gesture recognition can also help to reduce the spread of the virus.

Over the last four decades, there has been significant improvement in Doppler radar-based physiological sensing technology. Many researchers continue to significantly improve the necessary hardware and signal processing techniques. This is high time for industry and researchers to work together to bring this sensor technology to the application for the benefit of humanity during this unprecedented COVID-19 pandemic.

In a nutshell, this paper summarizes recent advancements in different emerging applications of non-contact radar sensing technologies having relevance in the fight against COVID-19, including remote breathing monitoring, continuous identity authentication, occupancy sensing, and hand gesture recognition. It also discusses recently demonstrated techniques and their associated advantages in application areas relevant to COVID-19. Table 1 provides a summary analysis, comparing recently integrated algorithms and their accuracy to the established state of the art.

TABLE 1
www.frontiersin.org

TABLE 1. Advancement in the latest technical methods with a comparative accuracy analysis for different radar-based applications.

Author Contributions

SI contributed to the conception and design of the work. SI, FF contributed to the manuscript drafting. SI, FF, and VL contributed to the critical revision of the article, and approval for the final version of the article.

Funding

Research by SI and FF for writing this paper was not funded by any organization. During the writing of this paper VL was supported in part by the United States National Science Foundation under Grant No. IIS1915738.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Abedi, M., Jazizadeh, F., and Banff, A. B. (2019). “Deep-learning for occupancy detection using Doppler radar and infrared thermal array sensors,” in 36th international symposium on automation and robotics in construction, Banff, Canada, May 21, 2019. doi:10.22260/ISARC2019/0146

CrossRef Full Text | Google Scholar

Adam, C.-S. (2020). CSAIL device lets doctors monitor COVID-19 patients from a distance. Available at: https://www.csail.mit.edu/news/csail-device-lets-doctors-monitor-covid-19-patients-distance (Accessed August, 2020).

Google Scholar

Alwashmi, M. F. (2020). The use of digital health in the detection and management of COVID-19. Int. J. Environ. Res. Public Health 17, E2906. doi:10.3390/ijeprh17082906

PubMed Abstract | CrossRef Full Text | Google Scholar

Ayebare, R. R., Flick, R., Okware, S., Bodo, B., and Lamorde, M. (2020). Adoption of COVID-19 triage strategies for low-income settings. Lancet Respir. Med. 8, e22. doi:10.1016/s2213-2600(20)30114-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Baboli, M., Singh, A., Soll, B., Boric-Lubecke, O., and Lubecke, V. M. (2015). Good night: sleep monitoring using a physiological radar monitoring system integrated with a polysomnography system. IEEE Microwave 16 (6), 34–41. doi:10.1109/MMM.2015.2419771

CrossRef Full Text | Google Scholar

Baboli, M., Singh, A., Soll, B., Boric-Lubecke, O., and Lubecke, V. M. (2020). Wireless sleep apnea detection using continuous wave quadrature Doppler radar. IEEE Sensors J. 20 (1), 538–545. doi:10.1109/JSEN.2019.2941198

CrossRef Full Text | Google Scholar

Benchetrit, G. (2000). Breathing pattern in humans: diversity and individuality. Respir. Physiol. 122 (2–3), 123–129. doi:10.1016/S0034-5687(00)00154-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Block, P., Hoffman, M., Raabe, I. J., Dowd, J. B., Rahal, C., Kashyap, R., et al. (2020). Social network-based distancing strategies to flatten the COVID-19 curve in a post-lockdown world. Nat. Hum. Behav. 4 (6), 588–596. doi:10.1038/s41562-020-0898-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Bohn, D. (2019). Google Pixel 4 and 4 XL handson: this time, it’s not about the camera. Available at: https://www.theverge.com/2019/10/15/20908071/google-pixel-4-xl-photos-video-hands-on-camera-screen-specs-price(Accessed November 4, 2020).

Google Scholar

CNBC (2020). Google announces new Nest Thermostat that uses radar to detect when you’re nearby. Available at: https://www.cnbc.com/2020/10/12/google-announces-new-nest-thermostat-with-soli-radar.html (Accessed October 12, 2000).

Google Scholar

Droitcour, A. D. (2006). Non-contact measurement of heart and respiration rates with a single chip microwave Doppler radar. Ph.D. dissertation. Stanford (CA): Stanford University.

Google Scholar

Droitcour, A., Lubecke, V., Lin, J., and Boric-Lubecke, O. (2001). “A microwave radio for Doppler radar sensing of vital signs,” in 2001 IEEE MTT-S international microwave sympsoium digest (Cat. No. 01CH37157), Phoenix, AZ, May 20–24, 2001 (New York, NY: IEEE), 175–178. doi:10.1109/MWSYM.2001.966866

CrossRef Full Text | Google Scholar

Fioranelli, F., Le Kernec, J., and Shah, S. A. (2019). Radar for health care: recognizing human activities and monitoring vital signs. IEEE Potentials 38 (4), 16–23. doi:10.1109/MPOT.2019.2906977

CrossRef Full Text | Google Scholar

Grado, C., Islam, S. M. M., Lubecke, L. C., and Lubecke, V. (2020). “UAV radar sensing of respiratory variations for COVID-type disorders,” in IEEE Asia-pacific microwave conference (APMC’20). Hong Kong, China, 8–11 December 2020 (New York, NY: IEEE).

CrossRef Full Text | Google Scholar

Gu, C., Wang, G., Inoue, T., and Li, C. (2013a). “Doppler radar vital sign detection with random body movement cancellation based on adaptive phase compensation,” in Proceedings of the 2013 IEEE MTT-S international microwave symposium digest (MTT), Seattle, WA, June 2–7, 2013 (New York, NY: IEEE), 1–3. doi:10.1109/MWSYM.2013.6697618

CrossRef Full Text | Google Scholar

Gu, C., Wang, G., Li, Y., Inoue, T., and Li, C. (2013b). A hybrid radar-camera sensing system with phase compensation for random body movement cancellation in Doppler vital sign detection. IEEE Trans. Microwave Theory Tech. 61, 4678–4688. doi:10.1109/TMTT.2013.2288226

CrossRef Full Text | Google Scholar

Guidance for Industry and Food and Drug Administration Staff (2020). Enforcement policy for non-invasive remote monitoring devices used to support patient monitoring during the coronavirus disease 2019 (COVID-19) public health emergency (revised). Available at: https://www.fda.gov/regulatory-information/search-fda-guidance-documents/enforcement-policy-non-invasive-remote-monitoring-devices-used-support-patient-monitoring-during (Accessed October, 2020).

Google Scholar

Hafner, N., Mostafanezhad, I., Lubecke, V. M., Boric-Lubecke, O., and Host-Madsen, A. (2007). “Non-contact cardiopulmonary sensing with a baby monitor,” in 29th annual international conference of the IEEE engineering in medicine and biology society, Lyon, France, August 22–26, 2007 (New York, NY: IEEE), 2300–2302. doi:10.1109/IEMBS.2007.4352785

PubMed Abstract | CrossRef Full Text | Google Scholar

Islam, S. M. M., Yavari, E., Rahman, A., Lubecke, V. M., and Boric-Lubecke, O. (2018a). “Separation of respiratory signature for multiple subjects using independent component analysis with the JADE algorithm,” in 2018 40th annual international conference of the IEEE engineering in medicine and biology society, Honolulu, HI, July 17–21, 2018 (New York, NY: IEEE), 1234–1237. doi:10.1109/EMBC.2018.8512583

CrossRef Full Text | Google Scholar

Islam, S. M. M., Yavari, E., Rahman, A., Lubecke, V. M., and Boric-Lubecke, O. (2018b). “Direction of arrival estimation of physiological signals of multiple subjects using phase comparison monopulse radar,” in 2018 Asia-Pacific microwave conference (APMC), Kyoto, Japan, November 6–9, 2018 (New York, NY: IEEE), 411–413. doi:10.23919/APMC.2018.8617539

CrossRef Full Text | Google Scholar

Islam, S. M. M., Rahman, A., Prasad, N., Boric-Lubecke, O., and Lubecke, V. M. (2019a). “Identity authentication system using a support vector machine (SVM) on radar respiration measurements,” in 2019 93rd ARFTG microwave measurement conference (ARFTG), Boston, MA, June 7, 2019 (New York, NY: IEEE), 1–5. doi:10.1109/ARFTG.2019.8739240

CrossRef Full Text | Google Scholar

Islam, S. M. M., Yavari, E., Rahman, A., Lubecke, V. M., and Boric-Lubecke, O. (2019b). “Multiple subject respiratory pattern recognition and estimation of direction of arrival using phase-comparison monopulse radar,” in 2019 IEEE radio and wireless symposium (RWS), Orlando, FL, January 20–23, 2019 (New York, NY: IEEE), 1–4. doi:10.1109/RWS.2019.8714272

CrossRef Full Text | Google Scholar

Islam, S. M. M., Rahman, A., Yavari, E., Baboli, M., Boric-Lubecke, O., and Lubecke, V. M. (2020a). “Identity authentication of OSA patients using microwave Doppler radar and machine learning classifiers,” in 2020 IEEE radio and wireless symposium (RWS), San Antonio, TX, January 26–29, 2020 (New York, NY: IEEE), 251–254. doi:10.1109/RWS45077.2020.9049983

CrossRef Full Text | Google Scholar

Islam, S. M. M., Sylvester, A., Orpilla, G., and Lubecke, V. M. (2020b). “Respiratory feature extraction for radar-based continuous identity authentication,” in 2020 IEEE radio and wireless symposium (RWS), San Antonio, TX, January 26–29, 2020 (New York, NY: IEEE), 119–122. doi:10.1109/RWS45077.2020.9050013

CrossRef Full Text | Google Scholar

Islam, S. M. M., Motoyama, N., Pacheco, S., and Lubecke, V. M. (2020c). “Non-contact vital signs monitoring for multiple subjects using a millimeter wave FMCW automotive radar,” in 2020 IEEE/MTT-S international microwave symposium (IMS), Los Angeles, CA, August 4–6, 2020 (New York, NY: IEEE), 783–786. doi:10.1109/IMS30576.2020.9223838

CrossRef Full Text | Google Scholar

Islam, S. M. M., Boric-Lubecke, O., and Lubekce, V. M. (2020d). Concurrent respiration monitoring of multiple subjects by phase-comparison monopulse radar using independent component analysis (ICA) with JADE algorithm and direction of arrival (DOA). IEEE Access 8, 73558–73569. doi:10.1109/ACCESS.2020.2988038

CrossRef Full Text | Google Scholar

Islam, S. M. M., Borić-Lubecke, O., Zheng, Y., and Lubecke, V. M. (2020). Radar-based non-contact continuous identity authentication. Remote Sens. 12 (14), 2279. doi:10.3390/rs12142279

CrossRef Full Text | Google Scholar

Jiu, F., Noronha, K., and Jayaswal, D. (2016). “Biometric identification through detection of retinal vasculature,” in 2016 IEEE first international conference on power electronics, intelligent control and energy systems (ICPEICES), Delhi, India, July 4–6, 2016, 1–5. doi:10.1109/ICPEICES.2016.7853731

CrossRef Full Text | Google Scholar

John Hopkins Medicine (2020). Can coronavirus cause heart damage? Available at: https://www.hopkinsmedicine.org/health/conditions-and-diseases/coronavirus/can-coronavirus-cause-heart-damage (Accessed October 30, 2020).

Google Scholar

Johns Hopkins University and Medicine (2020a). Coronavirus disease (COVID-19) Pandemic. Available at: https://www.who.int/emergencies/diseases/novel-coronavirus-2019 (Accessed October 30, 2020).

Johns Hopkins University and Medicine (2020b). Coronavirus disease. Available at: https://coronavirus.jhu.edu/map.html (Accessed October 30, 2020).

FDA (2009). Kai sensors receives FDA clearance for its wireless, non-contact respiratory device. Available at: https://www.meddeviceonline.com/doc/kai-sensors-receives-fda-clearance-for-its-0001 (Accessed June 17, 2009).

Google Scholar

Kampf, G., Todt, D., Pfaender, S., and Steinmann, E. (2020). Persistence of coronaviruses on inanimate surfaces and its inactivation with biocidal agents. J. Hosp. Infect. 104, 246–251. doi:10.1016/j.jhin.2020.01.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Kissler, S. M., Tedijanto, C., Goldstein, E., Grad, Y. H., and Lipsitch, M. (2020). Projecting the transmission dynamics of SARS-CoV-2 through the post-pandemic period. Science 368, 860–868. doi:10.1126/science.abb5793

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, Y. S., Pathirana, P. N., Steinfort, C. L., and Caelli, T. (2014). Monitoring and analysis of respiratory patterns using microwave Doppler radar. IEEE J. Transl. Eng. Health Med. 2, 1–12. doi:10.1109/JTEHM.2014.2365776

CrossRef Full Text | Google Scholar

Li, C., and Lin, J. (2008). Random body movement cancellation in Doppler radar vital sign detection. IEEE Trans. Microwave Theory Tech. 56, 3143–3152. doi:10.1109/TMTT.2008.2007139

CrossRef Full Text | Google Scholar

Li, C., Lubecke, V. M., Boric-Lubecke, O., and Lin, J. (2013). A review on recent advances in Doppler radar sensors for noncontact healthcare monitoring. IEEE Trans. Microwave Theory Tech. 61 (5), 2046–2060. doi:10.1109/TMTT.2013.2256924

CrossRef Full Text | Google Scholar

Lin, F., Song, C., Zhuang, Y., Xu, W., Li, C., and Ren, K. (2017). “Cardiac scan: a non-contact and continuous heart-based user authentication system,” in Proceedings of the 23rd annual conference on mobile computing and communication, Snowbird, UT, October 16–20, 2017, 315–328. doi:10.1145/3117811.3117839

CrossRef Full Text | Google Scholar

Lin, J. C. (1975). Noninvasive microwave measurement of respiration. Proc. IEEE 63 (10), 1530. doi:10.1109/proc.1975.9992

CrossRef Full Text | Google Scholar

Lyamin, A. V., and Cherepovskaya, E. N. (2017). An approach to biometric identification by using low-frequency eye tracker. IEEE Trans. Inform. Forensics Secur. 12 (4), 881–891. doi:10.1109/TIFS.2016.2639342

CrossRef Full Text | Google Scholar

Massagram, W., Lubecke, V. M., and Boric-Lubecke, O. (2009a). “Microwave non-invasive sensing of respiratory tidal volume,” in Annual international conference of the IEEE engineering in medicine and biology society, Minneapolis, MN, September 3–6, 2009, 4832–4835. doi:10.1109/IEMBS.2009.5332667

PubMed Abstract | CrossRef Full Text | Google Scholar

Massagram, W., Lubecke, V. M., Host-Madsen, A., and Boric-Lubecke, O. (2009b). Assessment of heart rate variability and respiratory sinus arrhythmia via Doppler radar. IEEE Trans. Microwave Theor. Techn. 57 (10), 2542–2549. doi:10.1109/TMTT.2009.2029716

CrossRef Full Text | Google Scholar

Massaroni, C., Nicolò, A., Schena, E., and Sacchetti, M. (2020). Remote respiratory monitoring in the time of COVID-19. Front. Physiol. 11, 635. doi:10.3389/fphys.2020.00635

PubMed Abstract | CrossRef Full Text | Google Scholar

Mock, K., Hoanca, B., Weaver, J., and Milton, M. (2012). “Real-time continuous iris recognition for authentication using an eye tracker,” in Proceedings of the 2012 ACM conference on Computer and communications security–CCS’12, Raleigh, NC, October 1, 2012, 1007–1009. doi:10.1145/2382196.2382307

CrossRef Full Text | Google Scholar

No Camels Team Israel (2020). Adapts military radar systems for remote COVID-19 patient monitoring. Available at: https://nocamels.com/2020/04/israel-military-radar-systems-remote-monitoring/ (Accessed November 1, 2020).

Google Scholar

Pinto, P., Patrão, B., and Santos, H. (2014). “Free typed text using keystroke dynamics for continuous authentication,” in Advanced information systems engineering. Editors C. Salinesi, M. C. Norrie, and Ó. Pastor (Berlin, Heidelberg: Springer Berlin Heidelberg), Vol. 7908, 33–45.

CrossRef Full Text | Google Scholar

Rahman, A., Lubecke, V. M., Boric-Lubecke, O., Prins, J. H., and Sakamoto, T. (2018). Doppler radar techniques for accurate respiration characterization and subject identification. IEEE J. Emerg. Sel. Top. Circuits Syst. 8 (2), 350–359. doi:10.1109/JETCAS.2018.2818181

CrossRef Full Text | Google Scholar

Reuters (2020). China’s coronavirus campaign offers glimpse into surveillance system. Available at: https://www.reuters.com/article/us-health-coronavirus-china-surveillance/chinas-coronavirus-campaign-offers-glimpse-into-surveillance-system-idUSKBN2320LZ (Accessed September, 2020).

Google Scholar

Ritchie, M., Jones, A., Brown, J., and Griffiths, H. D. (2017). “Hand getsure classification using 24 GHz FMCW dual polarised radar,” in International conference on radar systems (Radar 2017), Belfast, NIR, October 23–26, 2017, 1–6. doi:10.1049/cp.2017.0482

CrossRef Full Text | Google Scholar

Sakamoto, T., Gao, X., Yavari, E., Rahman, A., Boric-Lubecke, O., and Lubecke, V. M. (2018). Hand gesture recognition using a radar echo I-Q plot and a convolutional neural network. IEEE Sens. Lett. 2 (3), 1–4. doi:10.1109/LSENS.2018.2866371

CrossRef Full Text | Google Scholar

Shah, S. A., and Fioranelli, F. (2019). RF sensing technologies for assisted daily living in healthcare: a comprehensive review. IEEE Aerosp. Electron. Syst. Mag. 34 (11), 26–44. doi:10.1109/MAES.2019.2933971

CrossRef Full Text | Google Scholar

Singh, A., Lee, S., Butler, M., and Lubecke, V. (2012). “Activity monitoring and motion classification of the lizard Chamaeleo jacksonii using multiple Doppler radars,” in Annual IEEE international engineering in medicine and biology society conference, San Diego, CA, August 28–September 1, 2012 (New York, NY: IEEE), 4525–4528. doi:10.1109/EMBC.2012.6346973

PubMed Abstract | CrossRef Full Text | Google Scholar

Singh, A., Lubecke, V., and Boric-Lubecke, O. (2011). “Pulse pressure monitoring through non-contact cardiac motion detection using 2.45 GHz microwave Doppler radar,” in Annual international conference of the IEEE engineering in medicine and biology society, Boston, MA, August 30–September 3, 2011 (New York, NY: IEEE), 4336–4339. doi:10.1109/IEMBS.2011.6091076

PubMed Abstract | CrossRef Full Text | Google Scholar

Singhal, T. (2020). A review of coronavirus disease-2019 (COVID-19). Indian J. Pediatr. 87 (4), 281–286. doi:10.1007/s12098-020-03263-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Snigdha, F., Islam, S. M. M., and Boric-Lubecke, O. (2020). “Obstructive sleep apnea events classification by effective radar cross-section (ERCS) method by using microwave Doppler Radar and machine learning classifiers,” in IEEE MTT-S international microwave biomedical conference (IMBIOC’20). Toulouse, France, December 14–17, 2020 (New York, NY: IEEE).

CrossRef Full Text | Google Scholar

Sun, Q., Qiu, H., Huang, M., and Yang, Y. (2020). Lower mortality of COVID-19 by early recognition and intervention: experience from Jiangsu Province. Ann. Intensive Care 10, 33. doi:10.1186/s13613-020-00650-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Sun, Y., Fei, T., Li, X., Warnecke, A., Warsitz, E., and Pohl, N. (2020). Real-time radar-based gesture detection and recognition built in an edge-computing platform. IEEE Sensors J. 20 (18), 10706–10716. doi:10.1109/JSEN.2020.2994292

CrossRef Full Text | Google Scholar

Taylor, W., Abbasi, Q. H., Dashtipour, K., Ansari, S., Shah, S. A., Khalid, A., et al. (2020). A review of the state of the art in non-contact sensing for COVID-19. Sensors 20 (19), 5665. doi:10.3390/s20195665

PubMed Abstract | CrossRef Full Text | Google Scholar

Techradar (2019). Google Pixel 5 needs the Pixel 4's most maligned feature, because of Covid-19. Available at: https://www.techradar.com/news/google-pixel-5-needs-the-pixel-4s-most-maligned-feature-because-of-covid (Accessed November 1, 2020).

Wang, J., and Wang, G. (2017). Quality-specific hand vein recognition system. IEEE Trans. Inform. Forensics Secur. 12 (11), 2599–2610. doi:10.1109/TIFS.2017.2713340

CrossRef Full Text | Google Scholar

Wang, S., Song, J., Lien, J., Poupyrev, I., and Hilliges, O. (2016). “Interaction with Soli: exploring fine-grained dynamic gesture recognition in the radio-frequency spectrum”, in Proccedings of the 29th annual Symposium on user interface Software and technology. New York, NY, December 21, 2020, 851–860.

Google Scholar

Wang, Y., Hu, M -H., Li, Q., Zhang, X. -P., Zhai, G., and Yao, N. (2020). Abnormal respiratory patterns classifier may contribute to large-scale screening of people infected with COVID-19 in an accurate and unobtrisve manner. ArXiv abs/2002.05534.

World Health Organization (2020). WHO clinical management of severe acute respiratory infection (SARI) when COVID-19 disease is suspected. Available at: https://www.who.int/publications/i/item/10665-332299 (Accessed October 30, 2020).

Google Scholar

Yang, F., He, Z., Guo, S., Fu, Y., Li, L., Lu, J., et al. (2020). Non-contact driver respiration rate detection technology based on suppression of multipath interference with directional antenna. Information 11 (4), 192. doi:10.3390/info11040192

CrossRef Full Text | Google Scholar

Yavari, E., Gao, X., and Boric-Lubecke, O. (2018). “Subject count estimation by using Doppler radar occupancy sensor,” in 40th annual international conference of the IEEE engineering in medicine and biology society, Honolulu, HI, July 18–21, 2018 (New York, NY: IEEE), 4428–4431. doi:10.1109/EMBC.2018.8513388

CrossRef Full Text | Google Scholar

Yavari, E., Song, C., Lubecke, V., and Boric-Lubecke, O. (2014). Is there anybody in there?: intelligent radar occupancy sensors. IEEE Microwave Mag. 15 (2), 57–64. doi:10.1109/MMM.2013.2296210

CrossRef Full Text | Google Scholar

Yu, J.-T., Yen, L., and Tseng, P.-H. (2020). “mmWave radar-based hand gesture recognition using range-angle image,” in IEEE 91st vehicular technology conference (VTC2020-Spring), Antwerp, Belgium, May 25–28, 2020 (New York, NY: IEEE), 1–5. doi:10.1109/VTC2020-Spring48590.2020.9128573

CrossRef Full Text | Google Scholar

Zhang, S., Li, G., Ritchie, M., Fioranelli, F., and Griffiths, H. (2016). “Dynamic hand gesture classification based on radar micro-Doppler signatures,” in CIE international conference on radar (RADAR), Guangzhou, China, October 10–13, 2016 (New York, NY: IEEE), 1–4. doi:10.1109/RADAR.2016.8059518

CrossRef Full Text | Google Scholar

Zhang, Z., Tian, Z., and Zhou, M. (2018). Latern: dynamic continuous hand gesture recognition using FMCW radar sensor. IEEE Sensors J. 18 (8), 3278–3289. doi:10.1109/jsen.2018.2808688

CrossRef Full Text | Google Scholar

Zhao, M., Adib, F., and Katabi, D. (2016). “Emotion recognition using wireless signals,” in Proceedings of the 22nd annual international conference on mobile Computing and networking. New York, NY, October 3, 2016, 95–108. doi:10.1145/2973750.2973762

CrossRef Full Text | Google Scholar

Keywords: radar remote sensing, identity authentication, gesture recognition, occupancy sensing, breathing

Citation: Islam SMM, Fioranelli F and Lubecke VM (2021) Can Radar Remote Life Sensing Technology Help Combat COVID-19?. Front. Comms. Net 2:648181. doi: 10.3389/frcmn.2021.648181

Received: 31 December 2020; Accepted: 08 February 2021;
Published: 17 May 2021.

Edited by:

Ahmad Alsharoa, Missouri University of Science and Technology, United States

Reviewed by:

Daniyal Haider, De Montfort University, United Kingdom
Weitao Xu, City University of Hong Kong, Hong Kong

Copyright © 2021 Islam, Fioranelli and Lubecke. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Shekh M. M. Islam, shekh@hawaii.edu

Download