SYSTEMATIC REVIEW article
Effectiveness of Surgical Face Masks in Reducing Acute Respiratory Infections in Non-Healthcare Settings: A Systematic Review and Meta-Analysis
- 1Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore, Singapore
- 2Centre for Infectious Disease Epidemiology and Research, National University of Singapore, Singapore, Singapore
Background: Acute respiratory illnesses (ARIs) are the most common respiratory infectious diseases among humans globally. Surgical mask (SM) wearing has been shown to be effective in reducing ARI among healthcare workers. However, the effectiveness of SM in reducing ARI in the non-healthcare settings remains unclear. This review aims to summarize and assess the association between SM wearing and ARI incidence, from existing interventional and observational studies conducted in non-healthcare settings.
Methods: Systematic literature searches conducted in PubMed, Cochrane Library, and Embase databases identified 503 unique studies. After screening, 15 studies (5 randomized controlled trials and 10 observational studies) were assessed for reporting and methodological qualities. Proportions of ARI episodes in each group and adjusted summary statistics with their relevant 95% CIs were extracted. Data from 10 observational studies were pooled using the generic inverse variance method.
Results: A total of 23,892 participants between 7 and 89 years old involved across 15 studies from 11 countries were involved. Key settings identified were Hajj, schools, and in-flight settings. A modest but non-significant protective effect of SM on ARI incidence was observed (pooled OR 0.96, 95% CI 0.8–1.15). Subgroup analysis according to age group, outcome ascertainment and different non-healthcare settings also revealed no significant associations between SM use and ARI incidence.
Conclusion: Surgical mask wearing among individuals in non-healthcare settings is not significantly associated with reduction in ARI incidence in this meta-review.
Acute respiratory infections (ARIs) have resulted in significant morbidity and mortality globally. Many respiratory viruses attribute to ARI. These include influenza viruses, rhinoviruses, and coronaviruses. Coronaviruses, namely, human coronavirus NL63, 229E, OC43, and HKU1, attributed to a significant proportion of ARI (1, 2). Similarly, SARS-CoV (2003) (3), MERS-CoV (2012) (4), and the recent SARS-CoV-2 (5) are transmitted via droplet/aerosols and close contacts and resulted in significant fatality. At the time of writing, the global toll of COVID-19 stands at 2,145,512 cases, including 143,308 deaths (6).
In the absence of pharmaceutical interventions such as vaccine and anti-virals for most respiratory viruses including coronavirus disease 2019 (COVID-19) (7), non-pharmaceutical interventions such as personal protection equipment are crucial to curb community spread (7). However, there are inconsistent policies and recommendations on the use of surgical masks (SM) in the community in the early stage of the COVID-19 pandemic. WHO (8), Centers for Disease Control and Prevention (CDC), and national authorities have advocated the usage of SM, as opposed to N95 respirators, only among symptomatic individuals. Otherwise, one is to practice good personal and hand hygiene as the key mitigation measure.
WHO only conditionally recommends SM wearing by asymptomatic individuals in the community in situations of epidemic and pandemic (9). However, as community transmission becomes more rampant in many countries at the early phase of the pandemic, mask wearing has become a norm, as asymptomatic transmission remains a possibility with limited evidence to show otherwise (10, 11). With an increase in SM usage worldwide, a global shortage which is detrimental to the healthcare setting and pandemic control ensues.
The efficacy of SM usage to prevent transmission of influenza-like illness (ILI) and laboratory-confirmed influenza have been shown in a number of studies among symptomatic patients (12–14). However, the protective effect of SMs among healthy individuals in a community setting remains unclear. Existing systematic reviews and meta-analyses consistently found SMs ineffective at preventing ILI or influenza episodes when worn by an uninfected individual (15–17). However, a study that examined the protective effect of SM use against secondary influenza episode in a household setting, found a 70% reduction in reported episodes when participants were compliant in SM use (18).
Conflicting stance regarding the usage of SMs among healthy individuals to reduce the risk of respiratory infections remains even with the publication of a systematic review assessing the efficacy/effectiveness of SM against respiratory infections in 2011 (16). The review found face mask to be the best performing non-pharmaceutical intervention across seven included studies. However, all included studies primarily assessed SARS incidence only, and were predominantly hospital based (85.7%) or only involved healthcare workers (71.4%). The remaining non-hospital-based study involved SM usage in households with healthcare workers as the index case, and another included non-healthcare workers who were hospitalized. In hospital settings and/or among healthcare workers, occupational requirements, and increased knowledge on personal protection increase compliance to SM usage. However, SM usage may differ significantly in non-healthcare-related settings or workers. Thus, the review's findings may not extend to a community setting and/or a non-healthcare setting. With the limited supply of surgical mask for the healthcare workers globally to manage the large influx of COVID-19 patients, there is a pressing need to investigate the efficacy or effectiveness of SM use in the non-healthcare settings so as to guide policyholder on the usage of SM in the community. Thus, the study aims to perform a systematic review and meta-analysis to assess the effectiveness or efficacy of SM usage in decreasing the incidence of respiratory infectious disease and non-influenza respiratory infection in the community.
Materials and Methods
Search Identification and Selection
Systematic literature searches were conducted in PubMed, Cochrane Library, and Embase databases. Eligible studies were assessed for the reporting and methodological quality. Proportions of populations reporting ARI episodes in each group and adjusted summary statistics with their relevant 95% CIs were extracted when reported. A pooled odds ratio was estimated using the generic inverse variance method and heterogeneity was assessed. Relevant peer-reviewed literature that assessed the effectiveness/efficacy of surgical face masks (SM) in preventing community-acquired acute respiratory infections (ARIs) were identified and extracted from PubMed, EMBASE, and Cochrane databases on February 25, 2020. Specific search terms defined by the Population, Intervention/Exposure, Comparator, and Study design (PICOS/PEOS; Supplementary Table 1) utilized for each database are provided in (Supplementary Table 2). In all databases, a filter to identify studies published from 2010 was applied to capture more recent published studies that are more representative of the current social, behavioral, educational, and economic status of the general population, which may be attribute to the risk of ARI and compliance to SM usage. Reference lists of relevant reviews were also hand-searched to identify additional studies. This study was conducted in accordance to Cochrane's Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.
Identified publications were screened according to criteria in the following hierarchy by three authors, and any disagreement was reviewed by the fourth author to reach a final consensus, and included in the review if they fulfilled all criteria:
• Type of intervention/exposure: Surgical face mask usage in comparison with a comparable control group (no surgical face mask usage or use of hand hygiene practices only).
• Type of study: Peer-reviewed publications on interventional (randomized controlled trials) and observational (cohort studies, cross-sectional studies, and case-controlled studies) studies.
• Type of participants: Participants are individuals living in a general community setting, not healthcare workers or patients in clinical and medical setting.
• Types of outcomes: Incidence or episodes of (i) acute respiratory infectious disease and (ii) non-influenza respiratory infections in a community setting.
This review defines ARI as any acute respiratory infectious disease, including influenza-like illnesses and non-influenza respiratory infections, regardless whether the illness was clinically diagnosed, laboratory confirmed, or self-reported as defined by the study. Studies utilizing variations of facial protective gear (e.g., respirators and goggles) as an intervention/exposure or were conducted in settings outside of the general community were excluded in alignment with the goal to assess the recommendation of SM usage in a community setting. Relevance of the extracted studies was first assessed with titles and abstracts, before full texts of relevant studies were retrieved for further screening and validation based on the aforementioned criteria. A PRISMA flow diagram of the study selection process is shown in Figure 1.
Data extracted from included studies were consolidated with Microsoft Excel 2016, and presented in Tables 1, 2. Corresponding authors of included studies were contacted when clarification or more information were required. The following data were extracted from each study: authors, year of publication, study and population characteristics, description of the measures implemented in intervention and control groups, and outcomes. Study designs of included studies were also assessed based on their design features as recommended by the Cochrane Handbook for Systematic Reviews and Meta-analyses (33), in addition to extracting their reported study design. Outcome measures extracted for the intervention and control groups, when available, include (1) number of ARI episodes, (2) summary statistic for ARI incidence [relative risk (RR), odds ratio (OR), or hazard ratio (HR)] and their corresponding 95% confidence interval (95% CI), and (3) any other key findings.
In addition, the review authors noticed some of the selected studies had an additional intervention group which implemented SM usage with hand hygiene practices in the general community. These studies were excluded from the main analysis, but the relevant data are also extracted and presented in Supplementary Table 8.
Included studies were individually evaluated for their reporting and methodological quality using methods described in (Appendix B). For observational studies, reporting quality was evaluated using the STrengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement (34, 35), and methodological quality was evaluated using the National Heart, Lung, and Blood Institute (NHLBI) quality assessment tool for Quality Assessment Tool for Observational Cohort, Cross-sectional and Case–Control Studies (36). For interventional studies, reporting, and methodology qualities were, respectively, assessed using the Consolidated Standards of Reporting Trials (CONSORT) statement (37), and Cochrane's Risk of Bias Tool (RoB 2.0) for cluster-randomized trials (38).
Pooled ORs with their corresponding 95% CIs were estimated with a random-effects model and the generic inverse variance method. The inbuilt RevMan calculator was used to estimate each study's OR and the corresponding 95% CIs when raw event data were available, otherwise the reported ORs were utilized. The estimated OR was subsequently utilized to calculate the log(OR) and standard errors of each individual study with the RevMan calculator. The I2 statistic and Cochran Q-test was used to evaluate statistical heterogeneity, where heterogeneity was characterized as minimal (<25%), low (25–50%), moderate (50–75%), or high (>75%) and was significant if p < 0.05. Subgroup analyses analyzing the effects of (1) study design (interventional vs. observational), (2) outcome ascertainment (self-reported or clinically diagnosed ARI episode vs. laboratory-confirmed ARI episode), (3) age, and (4) study setting (hajj setting vs. school setting vs. flight setting) on the protective effect of wearing SM on ARI incidence was also explored. Publication bias for studies included in the meta-analysis was assessed with conventional and contoured funnel plots. All statistical tests were two sided and performed using Review Manager 5.3, except for funnel plots that were generated with STATA 13 (StataCorp, Texas).
All stages of screening, data extraction, and study quality assessments were conducted in duplicate by MW, SG, and PC. Discrepancies were resolved by consensus with JP at the end of each procedure before moving on to the next stage of analysis.
Screening Results and Characteristics of Included Studies
A total of 503 unique studies identified through our literature search were screened after the removal of 120 duplicates, and inclusion of two additional studies identified from external sources. The full texts of 57 potential studies were further assessed for eligibility and a total of 15 studies were selected for final inclusion into the review. The studies included in this systematic review are five cluster-randomized controlled trials (cluster RCT), seven cross-sectional studies, one cohort study, one nested case–control study, and one retrospective cohort study. All five RCTs and a cross-sectional study (29) were excluded from the meta-analysis. The reported summary statistics of three cluster RCTs were appropriately adjusted to account for the cluster design but were not the same measure [two studies reported HRs (19, 21), one study reported OR (18)]. Conventionally, only the same summary statistics across studies can be pooled using the generic inverse variance method when raw event data were unavailable. Hence, these reported summary statistics from these three cluster RCTs could not be pooled via the inverse generic variance method, whereas the remaining two cluster RCTs did not report summary statistics (20, 22). Thus, a total of 10 observational studies were included in the meta-analysis. The flow chart of the screening process and specific reasons for article exclusion are shown in Figure 1.
To provide readers with a general idea on the causal effect of SM usage on ARI incidence, the authors also explored combining the different summary measures reported using the generic inverse variance method (Figure 4). Summary statistics for all cluster RCTs were pooled after calculating the RRs for studies not reporting any summary statistics, with the RevMan calculator. Nonetheless, the authors did not consider the pooled estimate from cluster RCTs as part of the main meta-analysis results due to possible inaccuracy of the pooled estimate. Inaccuracy is likely present due to different summary measures across studies and the crude summary statistics [which were not adjusted for the clustering and other confounders present in the original study (39)] utilized to generate the pooled summary estimate.
An overview of the study characteristics is presented in Table 2. A total of 23,892 participants between 7 and 89 years old involved across 15 studies from 11 countries were included in this review. The health status of participants in all studies was all mixed, except for two studies which did not specify the health status of their participants (19, 21). Design features of seven studies suggested a retrospective cohort study design, although these studies were reported as cross-sectional (23, 25, 26, 29) or observational design (24, 30), or had no reported study design (28). The remaining eight studies had design features that corresponded to their reported study designs.
It is worthy to note that 8 of the 15 studies examined the effectiveness/efficacy of SM in hajj settings (22–26, 28, 29, 31) whereas the remaining investigated the same effect in students living on- or off-campus [4 studies (19, 21, 27, 30)], in households [2 studies (18, 20)], and in a flight setting [1 study (32)]. Of the five interventional studies included in this review, only one study compared hand washing with SM usage; the remaining four studies compared basic education—hand hygiene and/or SM usage and/or infection control–with mask wearing. The 10 observational studies included mainly compared the general lack of SM usage with its general use among participants; only 2 observational studies explored the effects with varying extents of SM usage on ARI prevention (25, 27).
Systematic Review of Surgical Face Mask Wearing on ARI Incidence
Key findings on the effectiveness/efficacy of SM usage on ARI incidence are summarized in Table 3. Most studies assessed ARI incidence through self-reported influenza-like illness (ILI) as the sole (n = 4) or one of the outcomes together with laboratory-confirmed influenza (n = 2). The remaining studies assessed ARI incidence through laboratory-confirmed influenza (n = 3), clinically defined influenza (n = 1) or study-defined respiratory outcomes encompassing respiratory illness (n = 2), (upper) respiratory tract infections (n = 2), and cough (n = 1). A variety of summary risk estimates were reported when used, with seven studies reporting ORs, four studies reporting RRs, and two studies reporting HRs.
Across the studies, mixed effects of SM use on ARI incidence were observed, ranging from significantly decreased incidence (22, 25, 27, 30, 32) to no significant difference (18–21, 23, 24, 26, 28, 29, 31) compared with non-usage of SMs. Infection rates were generally lower in groups with SM usage, except in six studies (20, 23, 24, 26, 28, 31). Moreover, lower proportions of participants with ARI were consistently observed in groups who wore SMs for a longer duration [>8 vs. ≤ 8 h (22)] or more persistently [frequent/continued SM usage vs. occasional/irregular SM usage vs. non-SM usage (25, 27)] when studies stratified findings according to varying levels of SM usage. This suggests that varying extents of SM usage is associated with SMs' effectiveness in ARI prevention. Nonetheless, this difference in infection rates between groups were not significantly different (p > 0.05) in all but one study [p = 0.04 (22)].
It is worthy to note that when Suess et al. (18) analyzed data from compliant participants (i.e., per-protocol analysis), only a 70% reduction in odds of laboratory-confirmed secondary influenza episode was observed among household members with SM usage compared with household members without it (OR 0.30, 95% CI 0.10–0.94; p = 0.04) (18). A significant reduction in odds of laboratory-confirmed secondary influenza incidence was also observed in households who implemented interventions (used SM solely or in conjunction with hand hygiene practices) <36 h after symptom onset of the index case, regardless of participant compliance to the interventions (OR 0.16, 95% CI 0.03–0.92; p = 0.04).
Meta-Analysis of Surgical Mask Wearing on ARI Incidence
The estimated pooled odds ratio suggests that SM usage is not associated to preventing ARI incidence, and hence ineffective in preventing ARI incidence in non-healthcare settings. This is because the protective effect of SMs did not reach statistical significance (95% CI 0.8–1.15), although it lowered odds of ARI incidence by 4% compared with non-usage (pooled OR 0.96, Figure 2). Nonetheless, moderate heterogeneity was detected across the pooled studies (I2 = 58%, p = 0.006; Figure 2), indicating certain inconsistency in the findings on efficacy of SMs in ARI prevention.
Figure 2. Pooled odds ratio for ARI incidence when surgical masks were worn, compared with not wearing surgical masks, in observational studies (n = 10 studies) estimated with the generic inverse method and a random-effects model. SM, surgical face mask; No SM, no surgical face mask; OR, odds ratio.
The protective effect of SMs was more evident among children, demonstrated by a 15% lowered odds of ARI incidence (pooled OR 0.85; Figure 2). In contrast, increased odds for ARI incidence were observed among the adult-and-child and the adult-only populations with SM usage. SM usage was estimated to increase odds for ARI incidence in the adult-and-child population by 16% (pooled OR 1.16; Figure 2) and by 2% increased odds in the adult-only population (pooled OR 1.02; Figure 2). Nonetheless, the associations in all mentioned sub-populations were non-significant (95% CI: children-only: 0.75–1.40, adult-and-children: 0.4–2.89, adult-only: 0.75–1.40; Figure 2), indicating the ARI incidence was not associated with increased harm or protection from SM usage. Unexplained heterogeneity between studies were still observed in each subpopulation, particularly in the adult-only subpopulation (I2 = 56%, p = 0.04; Figure 2), with no statistically significant subgroup differences detected (p = 0.58; Figure 2). This suggests that age group of participants does not modify the effect of SM usage on ARI incidence, and hence is unlikely to be a factor behind the differential effects observed across pooled studies. Conventional and contoured funnel plots of the studies pooled in the meta-analysis suggests a slight asymmetry in the areas of mid to high statistical significance on the right side of the funnel plot (Supplementary Figures 1, 2). However, publication bias is unlikely to be the underlying cause of the observed plot asymmetry, as much as there is a lack of studies realizing a statistically significant harm associated with SM usage on ARI incidence. Subgroup analysis of the studies according to whether the ARI episode was laboratory-confirmed or not (i.e., self-reported or clinically confirmed) showed differential results on the effectiveness of SM usage on ARI prevention. A non-significant protective effect with SM usage was demonstrated when ARI incidence was laboratory-confirmed (pooled OR 0.82, 95% CI 0.63–1.07; Figure 3). When ARI incidence was self-reported or clinically confirmed, a non-significant harmful effect with SM usage was shown (pooled OR 1.10, 95% CI 0.84–1.45; Figure 3). Nonetheless, the subgroup difference detected was not statistically significant (p = 0.14; Figure 3). Unexplained inconsistencies in study findings was also detected within each subgroup, especially in the laboratory-confirmed outcomes subgroup where significant moderate heterogeneity was detected (I2 = 68%, p = 0.02). This indicates that the outcome ascertainment method used in pooled studies does not influence the association between SM usage and ARI incidence, and thus an unlikely cause for differential effects observed across pooled studies.
Figure 3. Subgroup analysis of ARI incidence when surgical masks were worn compared with not wearing surgical masks, according to outcome ascertainment methods, estimated with the generic inverse method and a random-effects model. SM, surgical face mask; No SM, no surgical face mask; OR, odds ratio.
When studies were stratified by study settings, results suggest that SM use has limited protective effect, and may even be harmful in mass gathering settings such as Hajj (pooled OR 1.10, 95% CI 0.45–1.45; Figure 4). However, in enclosed settings such as in schools or flights, a statistically non-significant protective effect against ARI was observed with SM use in studies conducted in schools, the same as that observed amongst children-only studies (Figure 4). This was attributable to the exact same studies included in these two subgroups.
Figure 4. Pooled summary statistic for ARI incidence according to study settings, estimated with the generic inverse variance method and a random-effects model. SM, surgical face mask; No SM/HH, no surgical face mask or hand hygiene practices; OR, odds ratio.
Subgroup analysis of the outcome according to study design could not be performed in this review as there were insufficient interventional studies with suitable data to generate a pooled summary estimate.
However, the authors did estimate the pooled summary statistic on the effects of SM wearing on ARI incidence in cluster RCTs and found a similar non-significant protective effect of SM usage on ARI incidence (Figure 5). A 13% reduction in ARI incidence was noted with SM usage, compared with non-SM usage or implementation of hand-hygiene practices, although this reduction is not statistically significant (pooled summary statistic: 0.87, 95% CI 0.74–1.04; Figure 4). Nonetheless, the authors would like to highlight that the estimated pooled summary statistic only intends to provide a general idea on the direction of relationship between SM usage and ARI incidence. The pooled summary statistic in Figure 4 does not intend to, and is unable to quantitatively summaries the effects of SM usage on ARI incidence across the cluster RCTs included in this review. This is largely a result of the inaccuracy arising from reasons mentioned in Section Screening results and Characteristics of included studies.
Figure 5. Pooled summary statistic for ARI incidence when surgical masks were worn compared with not wearing surgical masks in cluster randomized controlled trials, estimated with the generic inverse variance method and a random-effects model. SM, surgical face mask; No SM/HH, no surgical face mask or hand-hygiene practices; RR, risk ratio; OR, odds ratio; HR, hazard ratio.
Reporting and Methodological Quality Assessment
High overall reporting quality was generally observed in the cluster RCTs, whereas only half of the observational studies had high overall reporting quality (25–27, 29, 30). The remaining observational studies had a low overall reporting quality, of which low-quality reporting was found in methods and results section of a study (31), and in either of the section in the remaining four studies (23, 24, 28, 31, 32) (Tables 3, 4).
Methodological quality was poor in general across all studies. All cluster RCTs are at a high risk of overall bias, indicating poor overall methodological quality (Tables 3, 4). The generally high overall risk can be attributed to a high risk of bias from randomization as subversion was likely absent in all cluster RCTs. Bias from timing of identification and recruitment of individual participants in relation to timing of randomization is also likely to be present in two studies with baseline imbalances across groups that suggest the likelihood of recruitment bias (19, 21). Suess et al. (18) was at high risk of bias from reported deviations that arose because of trial context that may have affected the outcome. Three studies also measured multiple outcomes but reported only a single outcome (22), or measured the same outcome at multiple instances but only reported the outcome at a single instance (19, 21), rendering them at high risk of bias from selective reporting. The observational studies were generally at low risk of selection bias, except for three studies which were at moderate risk of selection bias (23, 24, 26). However, unclear or low participation rate was a common issue identified in all cross-sectional and cohort studies included in this review. All but three studies (23, 27, 29) did not specify the number of eligible subjects identified in the course of the study, of which two studies had a participation rate <50% (27, 29). Most studies were also at high risk of misclassification and detection bias, with only three studies at low or moderate risk of bias in these two domains (24, 27, 31). In the misclassification bias domain, a moderate- to high-risk recall bias mainly exists due to the use of retrospectively collected participant-reported exposures to assess exposure across all studies. It was also unclear whether a study utilizing a self-administered questionnaire was able to assess exposures across participants consistently because interpretation may vary across participants (23). Most of the observational studies were also at high risk of other biases, mainly arising from lack of sample size justification and/or attrition rates >20%.
Detailed results for the quality assessment of included studies can be found in Supplementary Tables 5–7.
Effectiveness of Surgical Mask Usage on ARI Incidence in Non-healthcare Setting
Our results found that SM usage had a non-significant protective effect in reducing the risk of ARI among asymptomatic individuals in non-healthcare settings (pooled OR 0.96, 95% CI 0.8–1.15; Figure 2). The protective effect is also observed within or outside healthcare settings [healthcare setting pooled OR = 0.53; 95% CI 0.16–1.71 (17); community pooled RR = 0.78, 95% CI 0.51–1.20 (40)], regardless of those who were infected or uninfected (15). This contrasts with a review by Jefferson et al. (16), which found face mask to be the best performing intervention compared with other physical non-pharmaceutical interventions studied across different population and settings. Nonetheless, SM was only found to be significantly protective against SARS in the case–control subgroup (pooled OR 0.32, 95% CI 0.26–0.39), and studies related to SM usage was largely based in the healthcare setting and among healthcare workers (16). This limits the generalizability of the study given the different compliance in SM wearing between healthcare workers and the general population.
This review observed a non-significant protective effect that was more prominent in the younger age group (pooled OR 0.85, 95% CI 0.75–1.40; Figure 2). This contradicts with an experimental study that assessed transmission reduction potential by personal respirators, surgical masks, and homemade masks. The study attributed a significantly less protective effect of all types of mask usage for children, plausibly due to an inferior fit of masks on their smaller faces (41). The observed age-specific difference in effect is also likely because majority of the observational studies among the adult and adult-and-children populations were conducted in Hajj settings. As shown in Figure 4, there were differential effects of SM use in mass gatherings such as Hajj, and other enclosed settings in schools or flights. The annual Hajj, which involves as many as 2 million pilgrims nested in highly dense areas for a prolonged period, cannot be generalized to a regular community. Other conditions favoring the spread of infectious diseases include the physical exertion of pilgrims in overcrowded conditions, limited access to resources, humid conditions, and low compliance to mask usage due to religious beliefs (42–44). The combined effects of greater compliance with mask usage and hygiene practices in a more controlled environment could amplify the protective effect of SM usage among children.
SM use was protective against ARI incidence when outcomes were laboratory-confirmed episodes (pooled OR 0.82, 95% CI 0.63–1.07; Figure 3), but harmful when outcomes were self-reported or clinically diagnosed. The contrasting observations might be attributed to the subjective nature of self-reported or clinically diagnosed outcome and retrospective collection of self-reported outcomes in most included studies. Such data collection methods are liable to inaccuracies from the participants' judgment of personal condition and recall bias (45). Effects of SM usage in studies utilizing self-reported or clinically diagnosed episodes could also have been diminished by (1) participants overstating the actual experience of illness at the baseline or understating the condition at the end point, and (2) the inability to detect asymptomatic carriers. Conversely, a laboratory-confirmed outcome is more objective and does not require any participant judgment, enabling more accurate evaluation of ARI even among asymptomatic participants.
The effectiveness of face mask in source control hinges on the specific mode of transmission of etiological agent. Studies included in this review measured influenza or ILI, which are collectively caused by a broad range of viruses of varying infectivity and transmission routes (46). Direct and indirect contact are the primary transmission routes of respiratory syncytial virus and adenovirus, which causes ILI, whereas SARS is mainly spread through contact and droplet transmission (3, 47). Influenza is thought to be primarily transmitted through droplet expulsion, although evidence supporting airborne transmission is growing (48). A recent study found significant reduction in influenza virus emitted through droplets and not aerosols produced by infected individuals after SM usage (13). Another study showed that SM is more effective at reducing influenza viral RNA copies in coarse particles >5 μm (25-fold) than fine aerosols <5 μm (2.8-fold) emitted by an infected wearer (12). SM's effectiveness in preventing influenza decreases with decreasing particle size. As short-range aerosol inhalation is currently the main transmission mode of SARS-CoV-2 in the ongoing COVID-19 pandemic, the usage of SMs may not be highly effective to filter these fine aerosols completely.
The effectiveness of SM usage at reducing environmental risk faced by uninfected individuals remains unclear as existing evidence is limited to mechanistic challenge on masks with largely conflicting results. A study observed lower amount of influenza virus by 1.1- to 55-fold with an average of 6-fold with varying SM design (49). Conversely, SM has also been found to allow penetration of particles as small as 0.04–0.2 μm (influenza virus: 0.08–0.12 μm) (50). Specifically, Bae et al. (51) reported a low effectiveness of filtering SARS-CoV-2 on the basis of the small particle size as SARS-CoV (0.08–0.14 μm). At the time of conducting this review, research found increasing evidence of asymptomatic transmission of SARS-CoV-2 (10, 11). A sweeping change in recommendations to encourage SM usage by the general public was made amidst growing concerns of an increasing asymptomatic infected population, to prevent asymptomatic infected individuals from exposing uninfected individuals to the virus. Despite limited evidence on SM's effectiveness in reducing SARS-CoV-2 transmission due to its plausible airborne transmission mode and small viral particle size, the mechanistic feasibility of masking combined with large-scale uptake by populations might reap effectiveness that have yet to be measured in clinical trials (52).
Effectiveness of Hand Hygiene on ARI Incidence
Three studies included in this review also found no significant protective effect of SM coupled with hand-sanitizer use (SM+HH) on ARI incidence (18, 19, 21) compared with control groups [adjusted HR (95% CI) 0.87 (0.73–1.02) (19), 0.78 (0.57–1.08) (21), adjusted OR (95% CI) 0.62 (0.23–1.65) (18); Appendix D, Supplementary Table 8]. However, the results could have been limited by differential protective effect conferred by different types of hand sanitizer used and potential improper application. Gel-based sanitizers were used in two studies (19, 21) and the remaining study likely used liquid-based sanitizer (18). The superiority of liquid-based hand sanitizers to its gel-based counterparts may have resulted in the lack of effectiveness observed (53). More recent evidence also points to increased effectiveness of hand sanitizer in reducing microorganism burden when properly applied in accordance to EN 1500 standards (54).
Nonetheless, WHO recommends that masks are only effective when used in tandem with proper and frequent hand hygiene (55). Findings from a household cluster RCT (56) suggested the risk of influenza transmission is significantly low when healthy family members practice SM usage and frequent hand hygiene within 36 h of symptom onset of an infected family member [adjusted OR 0.16, 95% (CI 0.03–0.92), p = 0.04 (18)]. There is also evidence on hand washing with soap and/or hand sanitizer's effectiveness in removing influenza virus (57, 58). These conflicted findings supported inconclusive findings from a review on hand hygiene's protective effect in the community setting (59). Hence, although hand hygiene shows potential in reducing influenza infection and transmission, its effectiveness depends on the types of hand hygiene practiced (e.g., hand sanitizer, washing with soap, and water), usage frequency, proper application, and the setting in which practices are implemented.
Apart from use of SM and hand hygiene, other non-pharmaceutical interventions commonly employed in conjunction will also influence the risk of ARI in the community (60). However, the effectiveness of these measures is beyond the scope of this review and has been extensively evaluated in this other recently published review (61).
Strengths and Limitations
A strength of this review lies in the comprehensive outcomes examined, utilizing an extensive list of pathogens referenced from Jefferson et al. (16) in our search strategy. This compares with the review by Xiao et al. (40) which examined laboratory-confirmed influenza outcomes, or that by Cowling et al. (15) which focused on influenza, flu, and respiratory infections. The period in which evidence for this review was collected also sets it apart from existing reviews. Jefferson et al. (16) explored studies from 1980 to 2010 and Xiao et al. (40) went as far back as 1946. By including studies published in the past decade only, this review presents evidence more representative of the current and rapidly evolving environmental and social–behavioral factors. Next, no limits were imposed on health status and age of populations studied. This diversification increases the representativeness and generalizability of our findings to a community profile. Collectively, the study constitutes an update of SM efficacy investigated in Jefferson's review (16).
This review also complements the review by Xiao et al. (40) in terms of intervention and population evaluated. We focused on assessing SM usage, a more feasible apparatus for the general public as opposed to more intricate facial protective gear included in Xiao et al. (40), that should be reserved for healthcare workers or vulnerable populations. Unlike Xiao et al. (40), this review focused solely on assessing SM's efficacy among the uninfected population. In addition, the included studies were assessed for reporting and methodological qualities, providing additional insight to the reported findings and inadequacy in existing studies to constitute strong evidence on SM efficacy.
However, limitations exist in this review. First, the study settings were largely homogenous. More than half of the studies included were conducted during Hajj, which is unique and distinctly different from the general community setting. This limits the external validity of our results. Second, the authors pooled adjusted summary measures of studies included in the meta-analysis, but residual confounding may still exist in the reported summary measures. Third, the RCTs included cannot be pooled accurately as summary estimates reported were incompatible for a meta-analysis. Analysis of pooled RCT data, where SM use is better complied with and purposely differentiated between groups, would have constituted more robust evidence on the efficacy of SMs between wearers and non-wearers. Fourth, poor methodological quality was determined across all studies included in this analysis. This review highlights a paucity in well-conducted research examining the efficacy/effectiveness of SMs against ARI incidence in the general community. Non-standardization of methodologies and assessed outcomes inhibited accounting for inconsistencies in compliance to SM usage by the study populations, likely undermining the effectiveness of SMs in preventing ARI. On the contrary, compliance tend to be unusually high during epidemics due to increased risk perception (62). Next, although the funnel plots only showed slight asymmetry (Supplementary Figures 1, 2), there is a likelihood of publication bias as we only searched published literature. Lastly, there is diminished relevance for SM use in resource constrained conditions amidst epidemics. The strict focus on SM in this review was to examine the effectiveness of personal protection equipment that was accessible for the general population. However, there is extensive substitution of SM using reusable cloth masks or face coverings in the current pandemic due to supply constraints. Their efficacy/effectiveness in preventing ARI have not been widely evaluated, and future trials should compare the efficacy/effectiveness of reusable cloth masks to a standard (either SMs or even respirators) to inform policies on cloth mask usage. Nonetheless, such trial findings need to be interpreted with caution as cloth mask production is not regulated, and the quality and construct between products in this category may vary widely. This is unlike SMs which have a consistent quality and construct due to them being a regulated product under 21 CFR 878.4040 (63).
Existing studies are characterized by weak methodologies and a lack of overall significant effect, possibly constrained by small sample sizes. Well-designed, executed, and adequately funded trials are needed to provide robust evidence on SM efficacy in reducing transmission in the general community. Larger studies could be beneficial given their increased sensitivity to small effect sizes, and RCTs have the added benefit of establishing causality over observational studies (although it may be more resource intensive). Well-designed in vivo studies on uninfected individuals wearing SM could also be conducted to investigate the proportion of virus of varying sizes that can be blocked by SM via droplet or aerosolized transmission. These studies would form the basis of strong evidence to inform policies and practices on SM usage in the community during times of pandemic.
Our review found that SMs were not associated to ARI incidence, indicating that SMs may be ineffective in preventing respiratory illness when worn by an uninfected individual in the general community. However, given the weak methodologies across studies assessed and the possibility of residual confounding, an absence of evidence cannot be simply regarded as an evidence of absence. SM usage cannot be a standalone strategy to protect against infection, but ought to be used together with other physical intervention methods such as hand hygiene and social distancing to combat multiple modes of virus transmission in the community.
Data Availability Statement
All datasets generated for this study are included in the article/Supplementary Material.
JP conceptualized the study. MW, SG, and PC drafted the article, screened the studies, and extracted data. MW analyzed data and prepared the figures and tables. JP validated the final screened studies and analysis, critically edited draft, and interpretation of the findings. All authors have read and agreed to the published version of the article.
This research received funding from Ministry of Defense (N-608-000-065-001).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2020.564280/full#supplementary-material
2. Malhotra B, Swamy MA, Janardhan Reddy PV, Gupta ML. Viruses causing severe acute respiratory infections (sari) in children ≤ 5 years of age at a tertiary care hospital in Rajasthan, India. Indian J Med Res. (2016) 144:877–85. doi: 10.4103/ijmr.IJMR_22_15
3. Anderson RM, Fraser C, Ghani AC, Donnelly CA, Riley S, Ferguson NM, et al. Epidemiology, transmission dynamics and control of SARS: the 2002-2003 epidemic. Philos Trans R Soc Lond B Biol Sci. (2004) 359:1091–105. doi: 10.1098/rstb.2004.1490
5. Service RF. You may be Able to Spread Coronavirus Just by Breathing, New Report Finds. (2020). Available online at: https://www.sciencemag.org/news/2020/04/you-may-be-able-spread-coronavirus-just-breathing-new-report-finds# (accessed May 4, 2020).
6. Worldometer. Covid-19 Coronavirus Pandemic. (2020). Available online at: https://www.worldometers.info/coronavirus/ (accessed April 17, 2020).
7. Khan S, Siddique R, Shereen MA, Ali A, Liu J, Bai Q, et al. The emergence of a novel coronavirus (SARS-CoV-2), their biology and therapeutic options. J Clin Microbiol. (2020) 58:e00187–20. doi: 10.1128/JCM.01297-20
8. WHO. Coronavirus Disease (covid-19) Advice for the Public: When and How to Use Masks. (2020). Available online at: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/advice-for-public/when-and-how-to-use-masks (accessed April 17, 2020).
9. European Centre for Disease Prevention and Control. Using Face Masks in the Community. (2020). Available online at: https://www.ecdc.europa.eu/sites/default/files/documents/COVID-19-use-face-masks-community.pdf (accessed April 9, 2020).
10. Huang L, Zhang X, Zhang X, Wei Z, Zhang L, Xu J, et al. Rapid asymptomatic transmission of covid-19 during the incubation period demonstrating strong infectivity in a cluster of youngsters aged 16-23 years outside Wuhan and characteristics of young patients with covid-19: a prospective contact-tracing study. J Infect. (2020) 80:e1–13. doi: 10.1016/j.jinf.2020.03.006
12. Milton DK, Fabian MP, Cowling BJ, Grantham ML, McDevitt JJ. Influenza virus aerosols in human exhaled breath: particle size, culturability, and effect of surgical masks. PLoS Pathog. (2013) 9:e1003205. doi: 10.1371/journal.ppat.1003205
13. Leung NHL, Chu DKW, Shiu EYC, Chan KH, McDevitt JJ, Hau BJP, et al. Respiratory virus shedding in exhaled breath and efficacy of face masks. Nat Med. (2020) 26:676–80. doi: 10.1038/s41591-020-0843-2
14. Johnson DF, Druce JD, Birch C, Grayson ML. A quantitative assessment of the efficacy of surgical and n95 masks to filter influenza virus in patients with acute influenza infection. Clin Infect Dis. (2009) 49:275–7. doi: 10.1086/600041
16. Jefferson T, Del Mar CB, Dooley L, Ferroni E, Al-Ansary LA, Bawazeer GA, et al. Physical interventions to interrupt or reduce the spread of respiratory viruses. Cochrane Database Syst Rev. (2011) 2011:CD006207. doi: 10.1002/14651858.CD006207.pub4
17. Saunders-Hastings P, Crispo JAG, Sikora L, Krewski D. Effectiveness of personal protective measures in reducing pandemic influenza transmission: a systematic review and meta-analysis. Epidemics. (2017) 20:1–20. doi: 10.1016/j.epidem.2017.04.003
18. Suess T, Remschmidt C, Schink SB, Schweiger B, Nitsche A, Schroeder K, et al. The role of facemasks and hand hygiene in the prevention of influenza transmission in households: results from a cluster randomised trial; Berlin, Germany, 2009-2011. BMC Infect Dis. (2012) 12:26. doi: 10.1186/1471-2334-12-26
19. Aiello AE, Murray GF, Perez V, Coulborn RM, Davis BM, Uddin M, et al. Mask use, hand hygiene, and seasonal influenza-like illness among young adults: a randomized intervention trial. J Infect Dis. (2010) 201:491–8. doi: 10.1086/650396
20. Simmerman JM, Suntarattiwong P, Levy J, Jarman RG, Kaewchana S, Gibbons RV, et al. Findings from a household randomized controlled trial of hand washing and face masks to reduce influenza transmission in Bangkok, Thailand. Influenza Other Respir Viruses. (2011) 5:256–67. doi: 10.1111/j.1750-2659.2011.00205.x
21. Aiello AE, Perez V, Coulborn RM, Davis BM, Uddin M, et al. Facemasks, hand hygiene, and influenza among young adults: a randomized intervention trial. PLoS ONE. (2012) 7:e29744. doi: 10.1371/journal.pone.0029744
22. Barasheed O, Almasri N, Badahdah AM, Heron L, Taylor J, McPhee K, et al. Pilot randomised controlled trial to test effectiveness of facemasks in preventing influenza-like illness transmission among Australian Hajj Pilgrims in 2011. Infect Disord Drug Targets. (2014) 14:110–6. doi: 10.2174/1871526514666141021112855
23. Deris ZZ, Hasan H, Sulaiman SA, Wahab MSA, Naing NN, et al. The prevalence of acute respiratory symptoms and role of protective measures among Malaysian Hajj Pilgrims. J Travel Med. (2010) 17:82–8. doi: 10.1111/j.1708-8305.2009.00384.x
24. Gautret P, Vu Hai V, Sani S, Doutchi M, Parola P, et al. Protective measures against acute respiratory symptoms in french pilgrims participating in the hajj of 2009. J Travel Med. (2011) 18:53–5. doi: 10.1111/j.1708-8305.2010.00480.x
26. Balaban V, Stauffer WM, Hammad A, Afgarshe M, Abd-Alla M, Ahmed Q, et al. Protective practices and respiratory illness among us travelers to the 2009 hajj. J Travel Med. (2012) 19:163–8. doi: 10.1111/j.1708-8305.2012.00602.x
27. Kim CO, Nam CM, Lee DC, Chang J, Lee JW. Is abdominal obesity associated with the 2009 influenza a (h1n1) pandemic in Korean school-aged children? Influenza Other Respir Viruses. (2012) 6:313–7. doi: 10.1111/j.1750-2659.2011.00318.x
28. Gautret P, Benkouiten S, Griffiths K, Sridhar S. The inevitable hajj cough: surveillance data in french pilgrims, 2012–2014. Travel Med Infect Dis. (2015) 13:485–9. doi: 10.1016/j.tmaid.2015.09.008
29. Hashim S, Ayub ZN, Mohamed Z, Hasan H, Harun A, Ismail N, et al. The prevalence and preventive measures of the respiratory illness among Malaysian Pilgrims in 2013 hajj season. J Travel Med. (2016) 23:tav019. doi: 10.1093/jtm/tav019
30. Uchida M, Kaneko M, Hidaka Y, Yamamoto H, Honda T, Takeuchi S, et al. Effectiveness of vaccination and wearing masks on seasonal influenza in Matsumoto city, Japan, in the 2014/2015 season: an observational study among all elementary schoolchildren. Prevent Med Rep. (2017) 5:86–91. doi: 10.1016/j.pmedr.2016.12.002
32. Zhang L, Peng Z, Ou J, Zeng G, Fontaine RE, Liu M, et al. Protection by face masks against influenza a(h1n1)pdm09 virus on trans-pacific passenger aircraft, 2009. Emerg Infect Dis. (2013) 19:1403–10. doi: 10.3201/eid1909.121765
34. Vandenbroucke JP, von Elm E, Altman DG, Gøtzsche PC, Mulrow CD, Pocock SJ, et al. Strengthening the reporting of observational studies in epidemiology (strobe): explanation and elaboration. Int J Surg. (2014) 12:1500–24. doi: 10.1016/j.ijsu.2014.07.014
35. Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke, et al. The strengthening the reporting of observational studies in epidemiology (strobe) statement: guidelines for reporting observational studies. Ann Intern Med. (2007) 147:573–7. doi: 10.7326/0003-4819-147-8-200710160-00010
36. National Lung HBI. Nhlbi Study Quality Assessment Tools. (2020). Available online at: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools (accessed July 30, 2020).
39. Higgins JPT, Eldridge S, Li TJ. Chapter 23: Including Variants on Randomized Trials. Available online at: https://training.cochrane.org/handbook/current/chapter-23#section-23-1-3 (accessed April 17, 2020).
40. Xiao J, Shiu EYC, Gao H, Wong JY, Fong MW, Ryu S, et al. Nonpharmaceutical measures for pandemic influenza in nonhealthcare settings-personal protective and environmental measures. Emerg Infect Dis. (2020) 26:967–75. doi: 10.3201/eid2605.190994
41. van der Sande M, Teunis P, Sabel R. Professional and home-made face masks reduce exposure to respiratory infections among the general population. PLoS ONE. (2008) 3:e2618. doi: 10.1371/journal.pone.0002618
42. Benkouiten S, Brouqui P, Gautret P. Non-pharmaceutical interventions for the prevention of respiratory tract infections during hajj pilgrimage. Travel Med Infect Dis. (2014) 12:429–42. doi: 10.1016/j.tmaid.2014.06.005
50. Lee SA, Grinshpun SA, Reponen T. Respiratory performance offered by n95 respirators and surgical masks: human subject evaluation with NaCl aerosol representing bacterial and viral particle size range. Ann Occup Hyg. (2008) 52:177–85. doi: 10.1093/annhyg/men005
51. Bae S, Kim MC, Kim JY, Cha HH, Lim JS, Jung J, et al. Effectiveness of surgical and cotton masks in blocking SARS–CoV-2: A controlled comparison in 4 patients. Ann Intern Med. (2020) 173:W22–3. doi: 10.7326/M20-1342
54. Babeluk R, Jutz S, Mertlitz S, Matiasek J, Klaus C. Hand hygiene–evaluation of three disinfectant hand sanitizers in a community setting. PLoS ONE. (2014) 9:e111969. doi: 10.1371/journal.pone.0111969
55. WHO. Interim Guidance: Advice on the Use of Masks in the Community, During Home Care, and in Health Care Settings in the Context of covid-19. Available online at: https://www.who.int/publications-detail/advice-on-the-use-of-masks-in-the-community-during-home-care-and-in-healthcare-settings-in-the-context-of-the-novel-coronavirus-(2019-ncov)-outbreak (accessed April 17, 2020).
56. Cowling BJ, Chan KH, Fang VJ, Cheng CKY, Fung ROP, Wai W, et al. Facemasks and hand hygiene to prevent influenza transmission in households: A cluster randomized trial. Ann Intern Med. (2009) 151:437–46. doi: 10.7326/0003-4819-151-7-200910060-00142
57. Grayson ML, Melvani S, Druce J, Barr IG, Ballard SA, Johnson PDR, et al. Efficacy of soap and water and alcohol-based hand-rub preparations against live H1N1 influenza virus on the hands of human volunteers. Clin Infect Dis. (2009) 48:285–91. doi: 10.1086/595845
58. Larson EL, Cohen B, Baxter KA. Analysis of alcohol-based hand sanitizer delivery systems: efficacy of foam, gel, and wipes against influenza a (H1N1) virus on hands. Am J Infect Control. (2012) 40:806–9. doi: 10.1016/j.ajic.2011.10.016
59. Moncion K, Young K, Tunis M, Rempel S, Stirling R, et al. Effectiveness of hand hygiene practices in preventing influenza virus infection in the community setting: a systematic review. Can Commun Dis Rep. (2019) 45:12–23. doi: 10.14745/ccdr.v45i01a02
60. World Health Organization, Writing G, Bell D, Nicoll A, Fukuda K, Horby P, Monto A. Non-pharmaceutical interventions for pandemic influenza, international measures. Emerg Infect Dis. (2006) 12:81–7. doi: 10.3201/eid1201.051370
61. Chu DK, Akl EA, Duda S, Solo K, Yaacoub S, Schünemann HJ, et al. Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and covid-19: a systematic review and meta-analysis. Lancet. (2020) 395:1973–87. doi: 10.1016/S0140-6736(20)31142-9
62. Taylor M, Raphael B, Barr M, Agho K, Stevens G, et al. Public health measures during an anticipated influenza pandemic: factors influencing willingness to comply. Risk Manag Healthc Policy. (2009) 2:9–20. doi: 10.2147/RMHP.S4810
63. FDA. N95 Respirators and Surgical Masks (Face Masks). (2020). Available online at: https://www.fda.gov/medical-devices/personal-protective-equipment-infection-control/n95-respirators-and-surgical-masks-face-masks (accessed April 16, 2020).
Keywords: surgical mask, systematic review, acute respiratory infection, non-healthcare settings, prevention
Citation: Wang MX, Gwee SXW, Chua PEY and Pang J (2020) Effectiveness of Surgical Face Masks in Reducing Acute Respiratory Infections in Non-Healthcare Settings: A Systematic Review and Meta-Analysis. Front. Med. 7:564280. doi: 10.3389/fmed.2020.564280
Received: 21 May 2020; Accepted: 17 August 2020;
Published: 25 September 2020.
Edited by:Diamantis Plachouras, European Centre for Disease Prevention and Control (ECDC), Sweden
Reviewed by:Tarek A. Ahmad, Bibliotheca Alexandrina, Egypt
Elizabeth Haworth, University of Tasmania, Australia
Copyright © 2020 Wang, Gwee, Chua and Pang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Junxiong Pang, firstname.lastname@example.org
†These authors have contributed equally to this work