Low sensitivity of the COVID-19 antigen test (PANBIO™ COVID-19 Ag rapid test) to detect asymptomatic infections in health personnel of the National Institute of Respiratory Diseases
Eduardo Becerril Vargas* 
Gabriel Cojuc-Konigsberg 
Mario Alberto Mujica Sánchez María Del Carmen García Colín Daniel Alfredo Camacho Corral Hugo Hansel Chávez Morales José Nicolas Aguirre Pineda Eduardo Martínez Bravo Alejandro Ortiz Martínez José Arturo Martínez Orozco Victor Manuel Rodríguez-Sánchez Jesús Ariel Mariscal Ochoa Brian Pantoja Jiménez Israel A. Morales Lozada 
Andrea Iraís Cuevas Rodriguez*- Clinical Microbiology Laboratory, National Institute of Respiratory Diseases, Mexico City, Mexico
Background: COVID-19 requires an early diagnosis to optimize management and limit transmission. SARS-CoV-2 is able to spread effectively. Infected asymptomatic individuals have been found to be contagious. RT-qPCR is the currently recommended laboratory method for diagnosing acute infection. However, rapid antigen detection (RAD) tests are not only fast, but require less specialized training. The possibility of using RAD tests to identify asymptomatic patients is attractive, as it could effectively contribute to minimizing the hospital spread of SARS-CoV-2. The objective of the study was to determine the performance of RAD vs. RT-qPCR for the detection of asymptomatic cases in INER health personnel.
Methods: In order to follow WHO guidelines, generalized tests, a test station for health care workers was implemented on demand. A rapid test was carried out and a second sample was taken to be processed by RT-qPCR. With the results of both tests we conducted a retrospective study. Sensitivity, specificity, positive predictive value, negative predictive value and negative likelihood ratios were calculated.
Results: A total of 1640 RAD tests were performed in health care workers (mean age was 39, 69, 47% with a self-reported comorbidity). Participants provided 1,640 valid RAD/RT-qPCR test pairs with 2% testing positive via RT-qPCR. 12 RAD samples were positive for SARS-CoV-2. Overall sensitivity of the PANBIO ™ COVID-19 Ag Rapid Test test was 35.2%.
Conclusions: RADs are not recommended for the detection of asymptomatic cases due to low performance.
Introduction
The pandemic caused by SARS-CoV-2 remains a global challenge. Although the initial identification and subsequent implementation of diagnostic methods was extremely rapid, the pandemic could not be contained, unlike the 2002–2003 SARS-CoV-1 outbreak. One reason for this is the efficient spread of SARS-CoV-2, in part because of asymptomatic individuals who are able to transmit the virus without being detected. Due to the magnitude of the pandemic, the World Health Organization (WHO) has recommended widespread testing for SARS-CoV-2 (1–3).
Early diagnosis plays a crucial role in reducing the transmission chain of SARS-CoV-2 and in the timely clinical management of COVID-19. RT-qPCR is currently the recommended laboratory method to diagnose acute SARS-CoV-2 infection. Several factors limit the use of these time-consuming technique, such as preparation of working solutions, extraction and transfer of nucleic acids to the amplification device, and having trained personnel, (4). Due to the variable performance observed between different RT-qPCR assays, it is currently recommended to repeat the test in patients with intermediate or high clinical suspicion of COVID-19 infection when the initial result is negative (5–7).
The recommendation of extensive and repeated testing, as well as rapid viral spread throughout the world are some components that have exponentially increased the number of performed RT-qPCR. High test volumes pose important challenges for clinical laboratories, particularly regarding equipment and personnel (8).
Multiple tools have been developed for the rapid detection of SARS-CoV-2 in order to streamline testing. Rapid antigen detection (RAD) tests that qualitatively detect SARS-CoV-2 antigens are currently available. RAD tests detect viral antigens using SARS-CoV-2 antibodies that are coated and immobilized on a device. RAD test results can be interpreted without a specialized instrument and are available in < 30 min. Therefore, RAD tests can decrease the workload in hospitals and diagnostic laboratories and improve turnaround time and reagent restrictions for PCR processing. Nonetheless, RAD tests are currently recommended for confirmation of symptomatic cases, with limited evidence for detection in asymptomatic people. A sensitivity of 50–90% has been reported, so it is important to continue evaluating the performance of these diagnostic tests (9).
The objective of the study is to evaluate the diagnostic utility of the Abbott PANBIO™ COVID-19 Ag test in asymptomatic individuals in a high-exposure environment. The aforementioned test is a lateral flow colorimetric immunochromatographic assay, which contains specific antibodies for the SARS-CoV-2 antigen. When the antigen is present, a visible black band appears on the test line as a result of antigen-antibody complex formation. The result is obtained in 5 to 8 min.
Materials and methods
A retrospective observational study was performed. All asymptomatic National Institute of Respiratory Diseases (INER) health workers who attended the testing module and underwent both a rapid Ag ABBOTT PANBIOTM test and an RT-qPCR from December 2020 to May 2021 were included.
Patients who developed symptoms after obtaining a positive RT-qPCR and/or Rapid Test and patients without a case notification in the National Epidemiological Surveillance System (SISVER-SIVANE) were excluded.
The results of rapid antigen detection tests (RAD) and RT-qPCR performed on health personnel were gathered and reviewed. With the obtained information a database was created to conduct a statistical analysis. The clinical data of the patients was obtained from the Epidemiological Surveillance System for Respiratory Diseases.
Statistical analysis was performed using the statistical package SPSS 27. Results are presented through descriptive statistics. Medians with ranges and/or means with standard deviations were used for quantitative variables; for qualitative data, frequencies and percentages were used.
The following were calculated:
- Sensitivity: defined as the number of true positive results divided by the sum of the true positive and false negative results.
- Specificity: defined as the number of true negative results divided by the sum of true negative and false positive results.
- Positive predictive value (PPV): defined as the number of true positives divided by the sum of the true positive and false positive results.
- Negative predictive value (NPV): defined as the number of true negatives divided by the sum of the true negative and false negative results.
- Negative likelihood ratio (LR-): defined as sensitivity divided by 1 minus specificity.
Ethical considerations
This study follows the ethical guidelines established for the use of patient information and has been approved by INER's ethical committee.
Results
A total of 2,193 rapid tests were performed on health personnel during the study period. 551 tests were excluded since the subjects presented symptoms at the time of taking the nasopharyngeal sample; 1,640 test results were included in the study. The tests were performed on 1080 INER workers (Figure 1).
Figure 1. Number of tests performed in the study.
Mean age was 39.69 ± 11.03 years, 64% (1052/1080) were women (Figure 2). 41% (442/1080) of the evaluated health personnel were nursing personnel and people with administrative activities and 14% (151/1080) were medical staff (Table 1).
Figure 2. Distribution of INER staff by age and gender.
Table 1. Designations of the tested personnel.
47% (508/1080) of the health personnel included in our study had at least one comorbidity. Obesity, overweight and systemic arterial hypertension (SAH) were the most frequent associated comorbidities in included subjects (Table 2).
Table 2. Frequency of comorbidities in the patients included for the analysis.
Of the 1,640 samples, 34 (2%) were reported positive by RT-1PCR and the rest were negative for SARS-CoV-2. 12 (0.7%) RAD tests were positive for SARS-CoV-2. Health personnel not related to direct patient care, such as administrative personnel and chemists, had the highest rates of positive tests. The highest number of asymptomatic carriers were reported in chemists, nurses and doctors (Table 3).
Table 3. Frequency of asymptomatic infections.
For the detection of SARS-CoV-2, sensitivity through the rapid antigen detection test was 35.2% and specificity was 100%, with a PPV of 100%, an NPV of 98.6% and LR- of 0.65 (Table 4).
Table 4. Comparison between RT-PCR performance (reference method) and PANBIO COVID-19 Ag Rapid test.
Discussion
This study was designed to compare the performance of the PANBIO™ COVID-19 Ag test with RT-QPCR -the current gold standard. for the identification of health workers infected with SARS-CoV-2 who were asymptomatic.
Sensitivity through rapid antigen detection test was 35.2%. The performance obtained in the study for the detection of asymptomatic carriers was lower when compared with the existing evidence on asymptomatic patients reported by Fenollar et al. (45.4%) (10), Torres et al. (48.1%) (11), Linares et al. (54.5%) (12) and Bulilette et al. (59%) (13). However, in contrast with our study, these protocols were carried out in people who were in contact with a positive symptomatic patient with a testing timeframe of < 7 days after exposure, and were not carried out in an environment with constant exposure to the virus such as healthcare workers.
Improvement in antigen test performance is required because of the potentially large number of false negatives due to low sensitivity, despite the high specificity of the assay. Nevertheless, the PANBIO ™ COVID-19 Ag Rapid test has several benefits over RT-qPCR for SARS-CoV-2 detection, such as simplicity of use, easy availability, low cost, and a short time needed to obtain the results.
The prevalence of asymptomatic patients in our study was 2%, which to our knowledge is much lower than that reported in different meta-analyses conducted to date, ranging from 15.6 to 35.1%14, (15). The low number of asymptomatic carriers at INER can be explained by the intense training given to all staff for the proper use of personal protective equipment (16).
The viral load of SARS-CoV-2 reaches its peak around the time of symptom onset (14). This information it is still uncertain for asymptomatic individuals. Peak viral loads are particularly relevant when studying RNA viruses, since an exponential phase of replication has been described, which can go from undetectable levels to millions in a day, and could be useful as a threshold in asymptomatic subjects (17). Further studies could be conducted in order to determine the ideal time for testing.
Among the strengths of the current study is that it reflects the performance of the rapid antigen test in a real-life environment, where high exposure to COVID-19 is encountered. Among its limitations is the lack of knowledge of specific time between exposure and testing. Therefore, it could be determined if the test was performed too soon or too late.
Conclusions
The use of rapid antigen tests is not recommended to identify people with SARS-CoV-2 infection who are asymptomatic and should not be used in ruling out diagnoses in these individuals. In populations with high disease prevalence, rapid antigen tests could be utilized for screening programs and ruling in confirmed cases.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by Comité de Ética en Investigación del Instituto Nacional de Enfermedades Respiratorias Ismael Cosío Villegas. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author contributions
Conception and design of study: EB, GC-K, and JA. Drafting of manuscript and critical revision: EB, GC-K, JA, EM, AO, and MA. Data analysis and interpretation: EB, EM, and AO. Acquisition of data, laboratory, and clinical: DA, JA, HH, BP, VR-S, and MA. Approval of final version of manuscript: MA, EB, and GC-K. All authors contributed to the article and approved the submitted version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DK, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR Euro surveillance: bulletin Europeen sur les maladies transmissible. Eur Commun Dis Bull. (2020) (2020):25. doi: 10.2807/1560-7917.ES.25, 3.2000045
2. Ksiazek TG, Erdman D, Goldsmith CS, Zaki SR, Peret T, Emery S, et al. A novel coronavirus associated with severe acute respiratory síndrome. N Engl J Med. (2003) 348:1953–66. doi: 10.1056/NEJMoa030781
3. Wiersinga WJ, Rhodes A, Cheng AC, Peacock SJ, Prescott HC. Transmission, diagnosis, and treatment of coronavirus disease 2019 (COVID-19): a review. JAMA. (2020) 324:782–93. doi: 10.1001/jama.2020.12839
4. Long C, Xu H, Shen Q, Zhang X, Fan B, Wang C, et al. Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT? Eur J Radiol. (2020) 126:108961. doi: 10.1016/j.ejrad.2020.108961
5. Lee TH, Junhao Lin R, Lin RTP, Barkham T, Rao P, Leo YS, et al. Testing for SARS-CoV-2: can we stop at two? Clin Infect Dis. (2020) 71:2246–2248. doi: 10.1093/cid/ciaa459
6. Gandhi RT, Lynch JB, Del Rio C. Mild or moderate COVID. N Engl J Med. (2020) 383:1757–66. doi: 10.1056/NEJMcp2009249
7. Infectious Diseases Society of America. IDSA Guidelines on the Diagnosis of COVID-19: Molecular Diagnostic Testing. (2020). Available online at: https://www.idsociety.org/practice-guideline/covid-19-guideline-diagnostics/ (accessed May 15, 2022).
8. Gremmels H, Winkel BMF, Schuurman R, Rosingh A, Rigter NAM, Rodriguez O, et al. Real-life validation of the Panbio™ COVID-19 antigen rapid test (Abbott) in community-dwelling subjects with symptoms of potential SARS-CoV-2 infection. EClinical Medicine. (2021) 31:100677. doi: 10.1016/j.eclinm.2020.100677
9. Pray IW, Ford L, Cole D, Lee C, Bigouette JP, Abedi GR, et al. CDC COVID-19 Surge Laboratory Group. Performance of an antigen-based test for asymptomatic and symptomatic SARS-CoV-2 testing at two university campuses—Wisconsin, September–October 2020. MMWR Morb Mortal Wkly Rep. (2021) 69:1642–7. doi: 10.15585/mmwr.mm695152a3
10. Alemany A, Baró B, Ouchi D, Rodó P, Ubals M, Corbacho-Monné M, et al. Analytical and clinical performance of the panbio COVID-19 antigen-detecting rapid diagnostic test. J Infect. (2021) 82:186–230. doi: 10.1016/j.jinf.12, 033.
11. Smith AM, Perelson AS. Influenza A virus infection kinetics: quantitative data and models. Wiley Interdiscip Rev Syst Biol Med. (2011) 3:429–45. doi: 10.1002/wsbm.129
12. He J, Guo Y, Mao R, Zhang J. Proportion of asymptomatic coronavirus disease 2019 (COVID-19): a systematic review and meta-analysis. J Med Virol. (2021) 93:820–30. doi: 10.1002/jmv.26326
13. Byambasuren O. Estimating the extent of asymptomatic COVID-19 and its potential for community transmission: systematic review and meta-analysis. J Assoc Med Microbiol Infect Dis Can. (2020) 5:223–34. doi: 10.1101/05, 10.20097543
14. Pratha Sah, Meagan C., Fitzpatrick, Charlotte F., Zimmer, et al. Asymptomatic SARS-CoV-2 infection: a systematic review and meta-analysis. PNAS. (2021) 118:e2109229118. doi: 10.1073/pnas.2109229118
15. Buitrago-Garcia D, Egli-Gany D, Counotte MJ, Hossmann S, Imeri H, Ipekci AM, et al. Occurrence and transmission potential of asymptomatic and presymptomatic SARS-CoV-2 infections: a living systematic review and meta-analysis. PLoS Med. (2020) 17:e1003346. doi: 10.1371/journal.pmed.1003346
16. Miguel Ángel Salazar, Leslie Chavez-Galan, Armando Castorena-Maldonado, Maribel Mateo-Alonso, Nadia Otilia Diaz-Vazquez, et al. Low incidence and mortality by SARS-CoV-2 infection among healthcare workers in a health national center in mexico: successful establishment of an occupational medicine program. Front Public Health. (2021) 9:651144. doi: 10.3389/fpubh.2021.651144
Keywords: COVID-19, rapid antigen tests, asymptomatic, detection, PCR
Citation: Becerril Vargas E, Cojuc-Konigsberg G, Alberto Mujica Sánchez M, García Colín MDC, Alfredo Camacho Corral D, Hansel Chávez Morales H, Aguirre Pineda JN, Martínez Bravo E, Ortiz Martínez A, Martínez Orozco JA, Rodríguez-Sánchez VM, Ochoa JAM, Pantoja Jiménez B, Morales Lozada IA and Cuevas Rodriguez AI (2022) Low sensitivity of the COVID-19 antigen test (PANBIO™ COVID-19 Ag rapid test) to detect asymptomatic infections in health personnel of the National Institute of Respiratory Diseases. Front. Med. 9:977924. doi: 10.3389/fmed.2022.977924
Received: 25 June 2022; Accepted: 16 August 2022;
Published: 14 September 2022.
Edited by:
Diana Vilar-Compte, Instituto Nacional de Cancerologia, MexicoReviewed by:
Mohammad Alghounaim, Amiri Hospital, KuwaitRamón Pérez-Tanoira, University of Helsinki, Finland
Copyright © 2022 Becerril Vargas, Cojuc-Konigsberg, Alberto Mujica Sánchez, García Colín, Alfredo Camacho Corral, Hansel Chávez Morales, Aguirre Pineda, Martínez Bravo, Ortiz Martínez, Martínez Orozco, Rodríguez-Sánchez, Ochoa, Pantoja Jiménez, Morales Lozada and Cuevas Rodriguez. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Andrea Iraís Cuevas Rodriguez, a.idc1910@gmail.com; Eduardo Becerril Vargas, edobec.var@gmail.com