Original Research ARTICLE
Nasopharyngeal Swabs Are More Sensitive Than Oropharyngeal Swabs for COVID-19 Diagnosis and Monitoring the SARS-CoV-2 Load
- 1Department of Orthopedic Surgery, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- 2Department of Respiratory and Critical Care Medicine, Key Laboratory of Pulmonary Diseases of Health Ministry, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- 3Department of Epidemiology and Biostatistics, School of Public Health, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- 4Department of Infectious Diseases, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- 5Department of Laboratory Medicine, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
Objective: Detection of SARS-CoV-2 by oropharyngeal swabs (OPS) and nasopharyngeal swabs (NPS) is an essential method for coronavirus disease 2019 (COVID-19) management. It is not clear how detection rate, sensitivity, and the risk of exposure for medical providers differ in two sampling methods.
Methods: In this prospective study, 120 paired NPS and OPS specimens were collected from 120 inpatients with confirmed COVID-19. SARS-CoV-2 nucleic acid in swabs were detected by real-time RT-PCR. The SARS-CoV-2 detection rate, sensitivity, and viral load were analyzed with regards NPS and OPS. Sampling discomfort reported by patients was evaluated.
Results: The SARS-CoV-2 detection rate was significantly higher for NPS [46.7% (56/120)] than OPS [10.0% (12/120)] (P < 0.001). The sensitivity of NPS was also significantly higher than that of OPS (P < 0.001). At the time of sampling, the time of detectable SARS-CoV-2 had a longer median duration (25.0 vs. 20.5 days, respectively) and a longer maximum duration (41 vs. 39 days, respectively) in NPS than OPS. The mean cycle threshold (Ct) value of NPS (37.8, 95% CI: 37.0–38.6) was significantly lower than that of OPS (39.4, 95% CI: 38.9–39.8) by 1.6 (95% CI 1.0–2.2, P < 0.001), indicating that the SARS-CoV-2 load was significantly higher in NPS specimens than OPS. Patient discomfort was low in both sampling methods. During NPS sampling, patients were significantly less likely to have nausea and vomit.
Conclusions: NPS had significantly higher SARS-CoV-2 detection rate, sensitivity, and viral load than OPS. NPS could reduce droplets production during swabs. NPS should be recommended for diagnosing COVID-19 and monitoring SARS-CoV-2 load.
Chinese Clinical Trial Registry, number: ChiCTR2000029883.
Coronavirus disease 2019 (COVID-19) has developed into a devastating pandemic. As of April 20, 2020, there were 2,314,621 confirmed cases confirmed cases globally, and 157,847 people have lost their lives (1). This pathogen is a novel enveloped RNA beta coronavirus named severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) (2).
Detection of SARS-CoV-2 nucleic acid in upper respiratory specimens is essential for COVID-19 management, including diagnosis, risk assessment of transmission, and decisions regarding quarantine of patients. How to increase sensitivity of SARS-CoV-2 detection is key. To obtain upper respiratory specimens, medical providers usually use oropharyngeal swabs (OPS) and nasopharyngeal swabs (NPS) (3). However, it is unclear how the detection rate and sensitivity differ in the two sampling methods. Wang et al. (4) reported that the detection rate of SARS-CoV-2 was higher in nasal swabs [63% (5/8)] than in pharyngeal swabs [32% (126/398)]. Another small sample study analyzed 17 patients in early stages of COVID-19 and found that a higher viral load was detected in the nose than in the throat (5). Therefore, larger sample studies are needed to investigate that NPS specimens are more sensitive than OPS specimens for SARS-CoV-2 detection.
Meanwhile, during swab sampling, patients may feel uncomfortable and nauseous, causing them to cough, sneeze, and vomit. This may produce droplets and increase the risk of exposure for the medical providers (6). Currently, it is unclear how the risk differs in the two sampling methods.
In this prospective study, we investigated detection rate and sensitivity of SARS-CoV-2 in paired NPS and OPS from 120 confirmed COVID-19 patients. We also studied patient-reported discomfort level during sampling.
Materials and Methods
Study Design and Participants
In this prospective, single-center study, we recruited 120 laboratory-confirmed COVID-19 inpatients between February 15 and March 2, 2020, at Tongji Hospital, Tongji Medical College of Huazhong University of Science and Technology, in Wuhan, China. We excluded patients in critical conditions. Demographic data, comorbidities, symptoms, disease severity (7), imaging examinations, previous nucleic acid test results, and other laboratory findings on or close to the day of sampling were collected from electronic medical records using data collection forms. Another physician on our team reviewed the data independently. We obtained missing core data by direct communication with attending clinicians. None of the sampling operations affected the patients' normal treatment routines.
The studies involving human participants were reviewed and approved by the ethical committee of Tongji Hospital (file number TJ-IRB20200204). The requirement for written informed consent was waived by the ethics committee for this study, but all the participants provided their oral informed consent.
Synthetic fiber swabs with plastic shafts and sampling tubes containing 3.5 mL viral transport medium were supplied by YOCON® (Beijing, China). Trained medical providers first labeled the tubes with patient information, then obtained paired NPS and OPS specimens. For NPS, patients were instructed to blow their noses; providers gently passed the swab into the posterior nasopharynx via the nostril, rotated for 10 s, and withdrew slowly (8). For OPS, providers wiped the pharyngeal tonsil and posterior pharynx with the swab, avoiding the tongue (9). Immediately after sampling, providers placed the swabs into transport media and tightened the tube cap. Swab samples were kept at 2–8°C and immediately submitted to the Clinical Lab of Tongji Hospital designated by the Chinese Center for Disease Control and Prevention.
Participants rated discomfort level experienced during the respective sampling. The questionnaires were collected from 103 patients. An arbitrary rating scale (1–4) was used with 1 being no discomfort and 4 being unbearable discomfort (9). Participants also rated specific symptoms during sampling, including rhinocnesmus, running nose, sneeze, cough, bleeding, nausea, vomit, and lachrymation, using a visual analog scale (VAS) with 0 being no feeling and 10 being the strongest feeling.
Nucleic Acid Extraction and Real-Time RT-PCR for SARS-COV-2
After collection, RNA extraction and reverse transcription and polymerase chain reaction (RT-PCR) analysis were completed within 24 h according to the manufacturer′s instruction (DAAN Gene, Guangzhou, China). In brief, RNA was extracted from 200 μL of each sample with Viral RNA Isolation Kit, eluted in 50 μL of elution buffer, and used as the template for all assays. For real-time RT-PCR analysis, target genes including open reading frame (ORF1ab) and nucleocapsid protein (N) were simultaneously amplified and tested. Primer sequences for the ORF1ab gene were forward primer CCCTGTGGGTTTTACACTTAA; reverse primer ACGATTGTGCATCAGCTGA; and the probe 5′-FAM-CCGTCTGCGGTATGTGGAAAGGTTATGG-BHQ1-3′. Primer sequences for the N gene were forward primer GGGGAACTTCTCCTGCTAGAAT; reverse primer CAGACATTTTGCTCTCAAGCTG; and the probe 5′-VIC-TTGCTGCTGCTTGACAGATT-TAMRA-3′, which were recommended by the National Institute for Viral Disease Control and Prevention of China (http://ivdc.chinacdc.cn/kyjz/202001/t20200121_211337.html). The 25 μL RT-PCR reaction system contained 17 μL reaction mixture A, 3 μL reaction mixture B, and 5 μL RNA template. RT and PCR were performed under the following conditions of 50°C for 20 min, 95°C for 15 min, 45 cycles consisting of 94°C for 15 s, and 55°C for 45 s. The cut-off cycle threshold (Ct) value was 40 for both genes, and the Ct values of both genes were <40 was defined as positive. The Ct values were used as relative SARS-CoV-2 RNA expression with lower Ct values corresponding to higher viral copy numbers (4, 5).
Descriptive analyses on patient and clinical characteristics were presented as a median (interquartile range, IQR) or percentage (%). Primary results, including Ct values, patient-reported discomfort scores and detection rates, were reported as point estimates and 95% confidence intervals (95% CI). To investigate the diagnostic sensitivity of each method, we defined true positives as patients with positive SARS-CoV-2 result by at least one sampling method (10). McNemar's test or Wilcoxon signed rank test was used to compare the difference between the two sampling methods, unless otherwise indicated. Cohen's kappa statistics was used to determine the agreement of virus detection results between paired NPS and OPS. The statistical analysis was performed using the SAS software (version 9.4) with a two-sided significance threshold of P < 0.05.
Clinical Characteristics of the Patients
This study included 120 hospitalized COVID-19 patients, 83/120 (69.2%) of which were in severe conditions (Table 1). At the time of sampling, the duration since symptom onset had a median of 27.0 days (IQR 23.0–31.5), ranging between 3 and 49 days. Most patients showed improvement during treatment: 108/120 (90.0%) were afebrile for at least 3 days, 115/120 (95.8%) had milder symptoms, and 98/105 (93.3%) had improved chest CT scans. Patients showed mostly normal laboratory findings. 61/120 patients (50.8%) already had one negative SARS-CoV-2 result by OPS, and they needed one more negative test result to meet discharge criteria (7).
NPS Had Higher Detection Rate of SARS-COV-2 Than OPS
To compare the detection rate of each method, we analyzed paired NPS and OPS specimens from 120 COVID-19 patients. Detection rate is the percentage of positive results in total samples. The detection rate of NPS is 46.7% (56/120), and the detection rate of OPS is 10.0% (12/120). NPS had a significantly higher detection rate of SARS-CoV-2 than OPS (P < 0.001, Kappa = 0.19 with 95% CI 0.07–0.31, Table 2).
To understand whether treatment could confound the difference in detection rates, we stratified patients based on time since symptom onset. With the extension of the course of disease, positive detection rates of SARS-CoV-2 gradually decreased by both NPS and OPS (Ptrend = 0.016 and 0.011, respectively, Figure 1A). A total of 21 days after symptom onset, NPS had a significantly higher detection rate than OPS (P < 0.001). Less than 21 days after symptom onset, although the detection rate of NPS was higher than that of OPS [≤14 days: 71.4% (5/7) vs. 28.6% (2/7), respectively; 15–21 days: 57.1% (8/14) vs. 28.6% (4/14), respectively], the difference was not significant.
Figure 1. SARS-CoV-2 detection by NPS and OPS. (A) The detection rate (with 95% CI) of NPS and OPS with the development of the time course. (B) Time course (with IQR) of the detectable SARS-CoV-2 by paired NPS and OPS from 120 patients. (C) Time course of the detectable SARS-CoV-2 by paired NPS and OPS form 61 patients who needed one more negative SARS-CoV-2 result to meet the discharge criteria.
At the time of sampling, the time of SARS-CoV-2 detection since symptom onset had a longer maximum duration (41 vs. 39 days, respectively) and a longer median duration (25.0 vs. 20.5 days, respectively) in NPS than OPS (Figure 1B).
Furthermore, we analyzed paired NPS and OPS specimens from 61 patients who needed one more negative SARS-CoV-2 result to meet the discharge criteria. 26/61 (42.6%) had positive NPS results, which did not meet the criteria and continued to be quarantined. Only 5/61 (8.2%) had positive OPS results and continued to be quarantined (Figure 1C).
NPS Was More Diagnostically Sensitive in Detecting SARS-COV-2 Than OPS
To investigate the diagnostic sensitivity of each method, we identified 57 patients, who had tested positive for SARS-CoV-2 by either NPS or OPS, as true positives. Sensitivity is the percentage of true positives correctly identified by each method. The sensitivity of NPS was significantly higher than that of OPS [98.3% (56/57, 95% CI 94.8–100.0) vs. 21.1% (12/57, 95% CI 10.5–31.6), respectively, P < 0.001, Table S1].
Furthermore, to understand whether patient conditions could confound the difference in sensitivity, we stratified patients based on clinical characteristics and laboratory values. In all stratifications except febrile condition, the sensitivity of NPS was significantly higher than that of OPS (P < 0.05). In the seven febrile patients, there was no significant sensitivity difference between NPS and OPS, which may be explained by the small sample size.
NPS Specimens Showed Higher SARS-COV-2 Load Than OPS
We then studied whether the difference in detection rate is caused by the difference in SARS-CoV-2 load in NPS and OPS specimens with regards to the duration since the symptom onset.
To analyze the SARS-CoV-2 load of 120 paired specimens by real-time RT-PCR, we plotted NPS cycle threshold (Ct) values against OPS Ct values (Figure 2A). The Ct values were used as relative SARS-CoV-2 RNA expression with lower Ct values corresponding to higher viral copy numbers (4, 5). The mean Ct value of NPS (37.8, 95% CI 37.0–38.6) was significantly lower than that of OPS (39.4, 95% CI 38.9–39.8) by 1.6 (95% CI 1.0–2.2, P < 0.001) (Figure 2C), indicating a significantly higher viral load in NPS specimens. During treatment, NPS and OPS Ct values both increased, NPS Ct values were consistently lower than OPS Ct values (Figure 2B).
Figure 2. PCR cycle threshold (Ct) value detected in NPS and OPS specimens. (A) Comparison of Ct values of 120 paired NPS and OPS specimens. Each data point represents the Ct values of NPS and OPS from one patient. (B) Ct values for NPS and OPS during treatment. Solid curves represent the trend derived by locally weighted scatterplot smoothing method. (C) Comparison of Ct values (with 95% CI) of paired NPS and OPS from 120 patients. (D) Comparison of Ct values (with 95% CI) of paired NPS and OPS from 57 patients with positive SARS-CoV-2. A lower Ct value corresponds to a higher viral load.
In 57 patients with positive SARS-CoV-2 by either NPS or OPS, 52/57 (91.2%) had NPS Ct value lower than OPS Ct value (Figure 2A). In other words, NPS specimens from true positive patients had a higher viral load than OPS. The mean Ct value of NPS (35.3, 95% CI 33.9–36.8) was significantly lower than that of OPS (38.7, 95% CI 37.7–39.6) by 3.3 (95% CI 2.2–4.5, P < 0.001), indicating that the viral load was 10 times higher in NPS specimens than OPS (95% CI 4.6–22.6) (Figure 2D).
Evaluation of Patient-Reported Discomfort Levels and Symptoms During Sampling
To study patient discomfort level during sampling and possibility of droplets production, we analyzed questionnaires from 103 patients. Patients reported significantly higher overall discomfort levels when taking NPS (P < 0.001) (Figure 3A). The reported discomfort levels caused by each symptom, including rhinocenesmus, lachrymation, running nose, nausea, coughing, vomit, sneezing, and bleeding, were low in both NPS and OPS, with average scores all <3 out 10 (Figure 3B). When taking OPS, patients were significantly more likely to have nausea and vomit (P < 0.01) than NPS. Although patients coughed (23 vs. 28 patients, respectively) and sneezed (18 vs. 11 patients, respectively) during NPS and OPS, the difference was not significant (Figure 3C).
Figure 3. Patient discomfort levels during NPS and OPS sampling (N = 103). (A) Percentage of four varying discomfort levels reported by patients during swab sampling. (B) Mean scores (with standard deviation) of symptoms during sampling. (C) Frequency of each symptom during sampling. *P < 0.01, **P < 0.001.
This prospective study analyzed paired NPS and OPS specimens for SARS-CoV-2 detection by real-time RT-PCR in 120 inpatients with laboratory-confirmed COVID-19. We found that NPS was more sensitive to detecting SARS-CoV-2 than OPS. The SARS-CoV-2 load was higher in NPS specimens. As the patients' conditions improved, viral load in the upper respiratory tract decreased but could be detected for longer time in NPS specimens. Patient discomfort was low in both sampling methods. During NPS sampling, patients had significantly less nausea and vomit, which could lead to reduced droplet production, thus decreasing the risk of exposure for medical providers.
The SARS-CoV-2 detection rate of pharyngeal swabs is low [32% (126/398)] (4). For influenza B and A, diagnostic sensitivity of NPS [78% (25/32)] was higher than OPS [63% (20/32)] (11). It is unclear how the detection sensitivity for SARS-CoV-2 differs in NPS and OPS. We found that in 120 COVID-19 patients, NPS had a significantly higher SARS-CoV-2 detection rate than OPS (46.7% (56/120) and 10.0% (12/120), respectively) (Table 2). The detection rate for SARS-CoV-2 was lower than influenza in both sampling methods. Most patients in this study were in recovery (Table 1), so SARS-CoV-2 shedding could explain the low detection rate, and 63/120 (52.5%) patients presented negative SARS-CoV-2. With the extension of the time course and the progressed treatment, detection rates of NPS and OPS both decreased (Figure 1A). However, compared to the OPS samples obtained at the same time, NPS consistently had higher detection rate, especially 21 days after symptoms onset (Figures 1A,B).
Sixty-one patients who needed one more negative SARS-CoV-2 result to meet the discharge criteria (7), took paired NPS and OPS. A total of 26/61 (42.6%) exhibited positive NPS results and continued to be quarantined, but only 5/61 (8.2%) exhibited positive OPS results and were required to be quarantined (Figure 1C). This finding suggested that there were false-negative results in OPS specimens. In other words, if providers only analyzed OPS specimens, patients with positive SARS-CoV-2 could be mistakenly released from quarantine, increasing the risk of transmission to the public.
Zhou et al. (3) found that in COVID-19 survivors, the duration of viral shredding in OPS had a median of 20 and a maximum of 37 days. We found that at the time of sampling, the detectable SARS-CoV-2 in OPS persisted for a median of 20.5 days and a maximum of 39 days, which was consistent with Zhou's findings (Figure 1B). However, compared to OPS, detectable SARS-CoV-2 in NPS had a longer median duration (25 days) and maximum duration (41 days, Figure 1B). The maximum duration of viral shedding in NPS was longer than what was reported by Young et al. (12), who suggested that the duration of viral shedding from nasopharyngeal aspirates could persist up to at least 24 days after symptom onset. These findings indicated that NPS could detect SARS-CoV-2 for a longer duration after symptom onset.
To investigate the diagnostic sensitivity of each method, we identified the 57 patients who exhibited positive SARS-CoV-2 in either NPS or OPS as true positives. NPS showed significantly higher sensitivity than OPS in 57 paired NPS and OPS specimens [56/57 (98.3%) and 12/57 (21.1%), respectively] (Table S1). The sensitivity difference was not affected by clinical characteristics or laboratory findings, except for afebrile condition. This result suggested that NPS was more diagnostically accurate than OPS.
All patients received treatment after disease confirmed. We found that with the extension of the time course and the progressed treatment, while the SARS-CoV-2 load decreased, NPS specimens had a consistently higher viral load than OPS specimens (Figure 2B). Zou et al. (5) also reported that the SARS-CoV-2 load was significantly higher in nasal samples than in throat samples from 17 patients in early stages of COVID-19. We found that the viral load in NPS specimens was 10 times higher than OPS, in 57 patients with positive results by either NPS or OPS (Figures 2A,C). Altogether, the reasons that NPS had a higher virus load and higher sensitivity than OPS could be: (1) the amount of virus was higher in the nasopharynx than the oropharynx after SARS-CoV-2 infection; (2) NPS had a larger contact surface area with the nasopharynx, leading to more of the virus being collected.
During sampling, patients could produce droplets, thus increasing the risk of exposure for medical providers (6). We evaluated the patients' discomfort levels and droplet-producing symptoms, such as nausea, vomiting, coughing, and sneezing. The discomfort caused by the two sampling methods was similar to other respiratory virus sampling, and the symptoms were generally mild (Figures 3A,B) (9). Patients were significantly more likely to have nausea and vomit during OPS than NPS. Although the differences in coughing and sneezing during NPS and OPS sampling were not significant, the frequencies of coughing were lower in NPS than OPS (23 vs. 28 times, respectively). These results suggested that NPS sampling may be associated with less droplet production. Additionally, droplets produced during NPS and risk of exposure can be easily reduced, if medical providers stand next to the patient instead of face-to-face and cover the patient's mouth with a face mask (6).
Our study has limitations. First, most patients in this study were in recovery. The median duration since symptom onset was 27 days. Patients could have viral shedding, and so detection rates may not accurately reflect diagnostic sensitivity. Second, we could not quantify droplets produced due to equipment limitations. Instead, we used symptoms during sampling to represent the possibility of droplets produced.
In summary, we found that NPS was more sensitive for SARS-CoV-2 detection than OPS. NPS specimens had higher SARS-CoV-2 load than OPS specimens. NPS could reduce droplets production during swabs, especially when combined with other approaches. NPS should be recommended for diagnosing COVID-19 and monitoring SARS-CoV-2 load.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
The studies involving human participants were reviewed and approved by the Ethical Committee of Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology. Written informed consent from the participants' legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.
HW, QL, and SX contributed to conception and design of the study. QL and SX organized the database. HW, MZ, MY, KL, and DX carried out sample collection and data acquisition. YL and FW performed the laboratory sample analysis. JH, YX, JY, and PY performed the statistical analysis. SX wrote the first draft of the manuscript. HW, QL, and JH wrote sections of the manuscript. All authors approved the final manuscript as submitted and agreed to be accountable for all aspects of the work.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We would like to thank all the patients for contributing to this study and wish them a smooth recovery. We thank the physicians, nurses, and laboratory staff for their hard work that made this trial possible. We also thank Huizi Guo for assisting with the preparation of this manuscript.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2020.00334/full#supplementary-material
1. World Health Organization. Coronavirus Disease (COVID-2019) Situation Reports. (2020). Available online at: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/situation-reports (accessed April 20, 2020).
3. Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet. (2020) 395:1054–62. doi: 10.1016/S0140-6736(20)30566-3
6. World Health Organization. Infection Prevention and Control During Healthcare for Probable or Confirmed Cases of Middle East Respiratory Syndrome Coronavirus (MERS-CoV) Infection. Interim guidance (2015). Available online at: https://www.who.int/csr/disease/coronavirus_infections/ipc-mers-cov/en/ (accessed April 20, 2020).
7. National Health Commission of the People's Republic of China. Diagnosis and Treatment Protocol for COVID – 19 (Trial version seven) (2020). Available online at: https://www.chinadaily.com.cn/pdf/2020/1.Clinical.Protocols.for.the.Diagnosis.and.Treatment.of.COVID-19.V7.pdf (accessed April 20, 2020).
9. Ek P, Bottiger B, Dahlman D, Hansen KB, Nyman M, Nilsson AC. A combination of naso- and oropharyngeal swabs improves the diagnostic yield of respiratory viruses in adult emergency department patients. Infect Dis. (2019) 51:241–8. doi: 10.1080/23744235.2018.1546055
10. Lieberman D, Lieberman D, Shimoni A, Keren-Naus A, Steinberg R, Shemer-Avni Y. Identification of respiratory viruses in adults: nasopharyngeal versus oropharyngeal sampling. J Clin Microbiol. (2009) 47:3439–43. doi: 10.1128/JCM.00886-09
11. Hernes SS, Quarsten H, Hamre R, Hagen E, Bjorvatn B, Bakke PS. A comparison of nasopharyngeal and oropharyngeal swabbing for the detection of influenza virus by real-time PCR. Eur J Clin Microbiol Infect Dis. (2013) 32:381–5. doi: 10.1007/s10096-012-1753-0
Keywords: SARS-CoV-2, COVID-19, nasopharyngeal swab, oropharyngeal swab, sensitivity, viral load
Citation: Wang H, Liu Q, Hu J, Zhou M, Yu M, Li K, Xu D, Xiao Y, Yang J, Lu Y, Wang F, Yin P and Xu S (2020) Nasopharyngeal Swabs Are More Sensitive Than Oropharyngeal Swabs for COVID-19 Diagnosis and Monitoring the SARS-CoV-2 Load. Front. Med. 7:334. doi: 10.3389/fmed.2020.00334
Received: 01 May 2020; Accepted: 04 June 2020;
Published: 18 June 2020.
Edited by:Zisis Kozlakidis, International Agency for Research on Cancer (IARC), France
Reviewed by:Huanping Zhang, First Hospital of Shanxi Medical University, China
Wen Li, Zhejiang University, China
Copyright © 2020 Wang, Liu, Hu, Zhou, Yu, Li, Xu, Xiao, Yang, Lu, Wang, Yin and Xu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Shu-yun Xu, email@example.com
†These authors have contributed equally to this work