Skip to main content

ORIGINAL RESEARCH article

Front. Microbiol., 23 November 2023
Sec. Infectious Agents and Disease

Evaluating various composite sampling modes for detecting pathogenic SARS-CoV-2 virus in raw sewage

Ye LiYe Li1Kurt T. Ash,Kurt T. Ash1,2Dominique C. Joyner,Dominique C. Joyner1,2Daniel E. Williams,Daniel E. Williams1,2Isabella Alamilla,Isabella Alamilla1,3Peter J. McKayPeter J. McKay3Chris IlerChris Iler4Terry C. Hazen,,,,
Terry C. Hazen1,2,5,6,7*
  • 1Department of Civil and Environmental Engineering, University of Tennessee, Knoxville, Knoxville, TN, United States
  • 2Biosciences Division, Oak Ridge National Laboratory, Oak Ridge, TN, United States
  • 3Student Health Center, University of Tennessee, Knoxville, Knoxville, TN, United States
  • 4Department of Facilities Services, University of Tennessee, Knoxville, Knoxville, TN, United States
  • 5Department of Microbiology, University of Tennessee, Knoxville, Knoxville, TN, United States
  • 6Bredesen Center, University of Tennessee, Knoxville, Knoxville, TN, United States
  • 7Department of Earth and Planetary Sciences, University of Tennessee, Knoxville, Knoxville, TN, United States

Inadequate sampling approaches to wastewater analyses can introduce biases, leading to inaccurate results such as false negatives and significant over- or underestimation of average daily viral concentrations, due to the sporadic nature of viral input. To address this challenge, we conducted a field trial within the University of Tennessee residence halls, employing different composite sampling modes that encompassed different time intervals (1 h, 2 h, 4 h, 6 h, and 24 h) across various time windows (morning, afternoon, evening, and late-night). Our primary objective was to identify the optimal approach for generating representative composite samples of SARS-CoV-2 from raw wastewater. Utilizing reverse transcription-quantitative polymerase chain reaction, we quantified the levels of SARS-CoV-2 RNA and pepper mild mottle virus (PMMoV) RNA in raw sewage. Our findings consistently demonstrated that PMMoV RNA, an indicator virus of human fecal contamination in water environment, exhibited higher abundance and lower variability compared to pathogenic SARS-CoV-2 RNA. Significantly, both SARS-CoV-2 and PMMoV RNA exhibited greater variability in 1 h individual composite samples throughout the entire sampling period, contrasting with the stability observed in other time-based composite samples. Through a comprehensive analysis of various composite sampling modes using the Quade Nonparametric ANCOVA test with date, PMMoV concentration and site as covariates, we concluded that employing a composite sampler during a focused 6 h morning window for pathogenic SARS-CoV-2 RNA is a pragmatic and cost-effective strategy for achieving representative composite samples within a single day in wastewater-based epidemiology applications. This method has the potential to significantly enhance the accuracy and reliability of data collected at the community level, thereby contributing to more informed public health decision-making during a pandemic.

1 Introduction

Wastewater-based epidemiology (WBE) has emerged as an indispensable tool for monitoring and enhancing public health on university campuses, garnering significant global recognition. As of August 31, 2023, a recent study conducted by University of California Merced researchers reveals that 288 universities across 72 countries have adopted WBE practices (WBE Collaborative, 2023). Notably, the implementation of WBE gained substantial traction during the 2020–2021 academic year and has proven effective in reducing the prevalence of SARS-CoV-2 within university communities (Lee et al., 2023).

Sampling approaches are a crucial aspect of WBE, as improperly designed sampling approaches can lead to issues such as false negatives and substantial over- or underestimation of daily average viral concentrations. These issues stem from the inability to capture the extreme or peak values in the temporally variable viral input or the accidental acquisition of these values. On September 6, 2023, a comprehensive literature search was conducted using the Web Science Core Collection database, with no restrictions on publication date or language. The search criteria included terms associated with SARS-CoV-2, wastewater, and university campuses, yielding 154 articles on the subject. Following a thorough review of all identified papers, 108 records were eliminated due to lack of relevance to the campus, resulting in the final selection of 46 articles. Table 1 provides a summary of the information presented in these articles from 41 universities. This table demonstrates that universities employ three sampling methodologies frequently in WBE: grab sampling, composite sampling, and passive sampling. The autosampler is typically used with composite sampling. Due to the discrete and variable nature of SARS-CoV-2 inputs into a catchment, the accuracy of grab sampling is questionable despite its cost-effectiveness and efficiency compared to composite sampling. When autosamplers are inaccessible due to factors such as low flow rates, logistical restrictions, or financial constraints, grab sampling techniques are required. However, determining the precise relationship between the amount collected and the environmental concentration remains a difficult task (Wilson et al., 2022).

TABLE 1
www.frontiersin.org

Table 1. Characteristics of included studies.

Composite sampling methods are frequently favored in universities for the purpose of wastewater sampling, as seen by the data presented in Table 1. Indeed, a majority of 30 out of the total of 41 colleges opted to employ a composite sampling approach. The temporal extent during which samples are gathered is a critical determinant in composite sampling. A significant proportion of colleges have implemented a standardized sampling time of 24 h, but other durations ranging from 3 to 96 h have been used by some institutions. Although it is commonly believed that increasing the period of composite sampling results in more representative samples, Ahmed et al. (2021) give an alternative viewpoint. The authors suggest that employing shorter sampling intervals, such as 2 h, 4 h, and 6 h, within a 24 h timeframe, could potentially produce results that are more representative. This is particularly relevant in scenarios where the distance between buildings and sampling sites is comparatively short. Furthermore, the temporal aspect of sampling emerges as an additional crucial factor to be considered when dealing with shorter sampling durations. In a recent study conducted by Randazzo et al. (2020), it has been proposed that the collection of wastewater samples in the morning may be a potentially effective approach for the surveillance of SARS-CoV-2. This hypothesis is based on the observation that the morning period coincides with a time of an increase in human activity, which could potentially result in increased viral shedding from individuals and, consequently, higher viral loads in the collected samples. The aforementioned observation potentially provides a rationale for the prevalent practice among educational institutions to initiate their sample collection protocols in the early hours of the day, as indicated by the data presented in Table 1. However, the sampling process used by Jain et al. (2022) started in the afternoon and lasted for a total of 21 h, resulting in the omission of a segment of the morning wastewater. In order to assess the reliability of the sampling times (morning, afternoon, evening, and late night) in depicting the COVID-19 trend, a thorough investigation is necessary.

To address these challenges, we undertook a comprehensive comparative analysis of various sampling durations (1 h, 2 h, 4 h, 6 h, and 24 h) and sampling times (morning, afternoon, evening, and late night) using autosamplers to collect raw sewage. Our objective was to identify the most effective strategy for achieving representative sampling of the pathogenic virus SARS-CoV-2. Given that PMMoV is a widely used indicator virus for normalizing SARS-CoV-2 data (as shown in Table 1), it is also crucial to assess the abundance and variability of PMMoV in comparison to SARS-CoV-2 across different composite sampling durations. This assessment has multiple benefits, such as, improving result accuracy, increasing data collection efficiency, reducing labor needs, optimizing laboratory resource utilization, and addressing issues like autosampler battery depletion and viral decay.

2 Materials and methods

2.1 Sewage sampling

Wastewater was collected from 3 buildings in the University of Tennessee, Knoxville campus. These residence halls accommodated more than 400 students. Two Hach AS950 Portable Peristaltic Samplers (Hach, Loveland, CO) were used to collect up to 24 discrete samples from September 14, 2020, to September 21, 2021. To procure these samples from specific dormitories with predefined student populations, the collection process involved sampling from the downstream of dispense valves or sewer manholes before their contents were mixed with other sewer lines. The characteristics of these dormitories are summarized in Table 2. The autosampler was programmed to collect a 300 or 400-milliliter sample every hour over a 24 h duration. However, a few samples were not collected due to low flow rates or batteries that were out of power. The autosamplers were promptly transported to the BSL-2 laboratory on campus the following day within 3 h of the final collection interval.

TABLE 2
www.frontiersin.org

Table 2. Characteristics of different time-based composite samples.

2.2 Sample processing

Upon arrival at the laboratory, the composite samples were manually mixed thoroughly and uniformly to incorporate time points at 2, 4, 6, or 24 h within the 24 h period into a 500 mL bottle (Figure 1). Furthermore, we opted to choose multiple composite samples of 2 h and 4 h durations, representing the different sampling times (morning, afternoon, night) from a single 24 h time period. We then divided an equal volume from each of these samples and combined them to form a single composite sample representing the entire 24 h period.

FIGURE 1
www.frontiersin.org

Figure 1. Sampling process diagram of different time-based composite samples.

The sewage samples were processed through a series of steps: they were initially pasteurized for 2 h at 60°C in a water bath, followed by centrifugation at 5,000 × g for 10 min. To remove any substantial suspended particulate matter, the samples were then filtered through nitrocellulose filters with pore sizes of 0.45 μm and 0.22 μm. Subsequently, concentration was achieved using an Amicon Ultra-15 filtration device, with centrifugation at either 4,000 × g for 30 min (Swing-arm rotor) or 5,000 × g for 20 min (Fixed-angle rotor) at room temperature. The resulting concentrated solution, approximately 250 μL, was carefully transferred to 2 mL DNA LoBind tubes. RNA extraction was performed using the Qiagen viral RNA Mini Kit, following manufacturer instructions, yielding 60 μL of extracted RNA, with a negative control using DNase/RNase-free water. Finally, the RNA samples were stored at −80°C and subsequently subjected to RT-qPCR analysis within 24 h following extraction (Ash et al., 2023; Li et al., 2023).

2.3 RT-qPCR

To quantify the concentrations of SARS-CoV-2 and PMMoV RNA in each sample, we utilized RT-qPCR. Specifically, we quantified SARS-CoV-2 N1 using the TaqPath 1-Step RT-qPCR Master Mix, CG (Thermo Fisher Scientific) on an Applied Biosystems QuantStudios 7 Pro Real-Time PCR System instrument. Each 20 μL reaction mixture consisted of 5 μL of 4X Master Mix (Thermo Fisher Scientific), 0.25 μL of a 10 μmol/L probe, 1 μL each of 10 μmol/L forward and reverse primers, 7.75 μL of nuclease-free water, and 5 μL of nucleic acid extract. Accurate pipetting of reagents into 96-well plates was followed by 10 s of vortex mixing. The RT-qPCR cycling conditions encompassed initial uracil-DNA glycosylase incubation for 2 min at 25°C, reverse transcription for 15 min at 50°C, activation of the Taq enzyme for 2 min at 95°C, and a two-step cycling process involving 3 s at 95°C and 30 s at 55°C, repeated for a total of 45 cycles. A positive test result was determined by the presence of an exponential fluorescent curve that intersected the threshold within 40 cycles (cycle threshold [Ct] <40).

The quantification of PMMoV was performed using the TaqPath 1-Step RT-qPCR Master Mix, CG (Thermo Fisher Scientific) on a QuantStudios 7 Pro instrument. Each reaction consisted of 20 μL, comprising 5 μL of 4X Master Mix from Thermo Fisher Scientific, 0.5 μL of 10 μmol/L probe, 1.8 μL each of 10 μmol/L forward and reverse primers, 8.9 μL of nuclease-free water, and 2 μL of nucleic acid extract. The reagents were carefully transferred into 96-well plates using pipettes and subsequently mixed by vortexing for 10 s. The thermocycling conditions utilized in this study were as follows: incubation of uracil-DNA glycosylase for 2 min at 25°C, reverse transcription carried out for 15 min at 50°C, activation of the Taq enzyme for 10 min at 95°C, and a two-step cycling process consisting of 30 s at 95°C followed by 1 min at 60°C, repeated for a total of 40 cycles.

Each RT-qPCR run included one positive PMMoV controls and negative controls, consisting of Mastermix and DNase/RNase-free water. The RT-qPCR reactions were conducted in triplicate. The criterion for classifying a sample as positive was that all replicates yielded positive results, with each individual replicate falling within the linear range of the standard curve. The N1 standard curve exhibited a high level of efficiency, with a value of 94.669% (R2 = 1). The quantification of SARS-CoV-2 RNA was determined by calculating the average of three replicates of viral copies. The outputs of RT-qPCR were transformed into units of copies per liter. In this study, the detection limit for SARS-CoV-2 and PMMoV was determined to be 20 and 10 copies per liter, respectively.

2.4 Data analysis

All statistical analyses were performed using SPSS (IBM Corp. Released 2019. IBM SPSS Statistics for Windows, Version 26.0. Armonk, NY: IBM Corp). The data were examined for normality and homogeneity of variance. The paired t-test was used to compare 24 h average and 24 h time-based composite samples of SARS-CoV-2 and PMMoV RNA. Due to the non-normal distribution of the data in our study, the Quade Nonparametric ANCOVA test was performed on composite samples throughout a range of sampling durations (1 h, 2 h, 4 h, 6 h, and 24 h) and sampling times (morning, afternoon, evening, and late-night), with the date and PMMoV concentration as covariates. All statistical differences were determined by p < 0.01.

3 Results

3.1 Concentration and variability of SARS-CoV-2 and PMMoV in raw sewage

Table 3 displays the pathogenic virus of SARS-CoV-2 and indicator virus of PMMoV RNA concentrations of 24 h average and 24 h composite samples collected at 2 h and 4 h time intervals. The 24 h average composite sample is the numeric average concentration of the 24 h period samples. Comparing the 24 h average concentrations with the corresponding 24 h composite samples for both SARS-CoV-2 and PMMoV, no significant differences were observed. However, there were significant positive correlations between the 24 h average concentrations and the corresponding 24 h composite samples for both SARS-CoV-2 and PMMoV (paired t-test, Correlation = 0.985 and 0.989, value of p = 0.002 and 0.001, for SARS-CoV-2 and PMMoV).

TABLE 3
www.frontiersin.org

Table 3. Concentration of SARS-CoV-2 and PMMoV RNA in 2 h, 24 h average, and 24 h time-based composite samples, and 4 h, 24 h average, and 24 h time-based composite samples.

Figures 2, 3 show the concentrations of SARS-CoV-2 and PMMoV RNA in composite samples collected at different time intervals (1 h, 2 h, 4 h, and 6 h). During the sampling period, the concentration of SARS-CoV-2 RNA was 3.60 ± 4.24, 2.77 ± 3.26, 3.06 ± 3.54, 2.83 ± 3.08, 3.22 ± 3.45 log10 copies/L in the 1 h, 2 h, 4 h, 6 h, and 24 h time-based composite samples, respectively. Meanwhile, the corresponding concentrations of PMMoV RNA were 4.2 ± 4.43, 4.13 ± 4.41, 3.87 ± 3.81, 3.86 ± 3.91, 4.06 ± 4.02 log10 copies/L in the 1 h, 2 h, 4 h, 6 h, and 24 h time-based composite samples, respectively. The mean concentration of PMMoV RNA was significantly greater than the mean concentrations of SARS-CoV-2 RNA in all the time-based composite samples, respectively (paired t-test, t = −3.884, value of p <0.01, Figure 4). The standard deviations (SDs) of SARS-CoV-2 and PMMoV RNA were calculated to assess the variation within each time-based composite sample. Notably, the variation of SARS-CoV-2 did not show significant differences with the PMMoV RNA in 1 h, 2 h, 4 h, 6 h, and 24 h time-based composite samples, respectively (Figure 4). The coefficient of variation values (CVs) were calculated to further assess the variation within each time-based composite sample for SARS-CoV-2 and PMMoV RNA. For SARS-CoV-2 RNA, the CVs ranged from 1.91 to 0.33, 1.54 to 2.25, 0.63 to 1.94, and 1.06 to 1.27 in the 1 h, 2 h, 4 h, and 6 h time-based composite samples, respectively. In contrast, the CVs for PMMoV RNA were significantly smaller than those of SARS-CoV-2 RNA (paired t-test, t = 5.150, value of p <0.01), ranging from 0.92 to 1.40, 0.37 to 1.25, 0.27, to 1.25, and 0.41 to 0.77 in the 1 h, 2 h, 4 h, and 6 h time-based composite samples, respectively (Figure 4).

FIGURE 2
www.frontiersin.org

Figure 2. Concentration of SARS-CoV-2 fluctuation in 1-h (A), 2-h (B), 4-h (C), and 6-h (D) time-based composite samples.

FIGURE 3
www.frontiersin.org

Figure 3. Concentration of PMMoV fluctuation in 1-h (A), 2-h (B), 4-h (C), and 6-h (D) time-based composite samples.

FIGURE 4
www.frontiersin.org

Figure 4. Mean virus concentration, standard deviations, and coefficient of variation of SARS-CoV-2 and PMMoV RNA on different sampling durations of composite samples.

3.2 The impact of different sampling durations and time periods on composite samples

Figure 5 illustrates the different sampling durations and time periods used for composite samples in this study. As discussed earlier, the 24 h average concentrations of SARS-CoV-2 and PMMoV RNA accurately represent the 24 h composite samples within their respective sampling intervals. So the 24 h composite samples in this study were derived from the 24 h average concentrations of SARS-CoV-2 and PMMoV RNA. Statistical analysis using the Quade Nonparametric ANCOVA test revealed a significant difference in SARS-CoV-2 RNA concentrations between the 24 h time-based composite samples and the 1 h, 2 h, and 4 h time-based composite samples (t = −3.066, −4.311, −2.790, respectively, p < 0.01), with date, concentration of PMMoV and sampling sites as covariates. However, there was no significant difference observed in SARS-CoV-2 RNA concentrations between the 24 h and 6 h time-based composite samples. In addition, there was no significant difference observed in PMMoV RNA concentrations between the 24 h composite samples and other time-based composite samples with date as covariates.

FIGURE 5
www.frontiersin.org

Figure 5. Different sampling durations and time periods of composite samples.

In addition, our statistical analysis, utilizing the Quade Nonparametric ANCOVA test with date and concentration of PMMoV and sampling sites as covariates, the morning time period showed no significance with the 24 h composite samples compared to other time periods (t = −2.388, p > 0.01, Figure 5). The morning time frame is defined as sampling from 6:01 am to 12:00 pm, the afternoon from 12:01 pm to 6:00 pm, the evening from 6:01 pm to 12:00 am, and the late-night hours from 12:01 am to 6:00 am. However, there were no significant variations observed in the concentrations of PMMoV RNA among the various time periods. These findings highlight the potential importance of selecting the morning time for sampling the pathogenic virus, as it could provide a representative snapshot of the entire day’s virus concentration levels. This information can be valuable for designing sampling strategies aimed at capturing accurate and comprehensive data on SARS-CoV-2 RNA concentrations throughout the day.

4 Discussion

Our findings indicate that the 24 h average concentrations of both SARS-CoV-2 and PMMoV RNA are consistent with the corresponding 24 h composite samples. This suggests that the 24 h average concentrations of SARS-CoV-2 and PMMoV RNA could accurately represent the 24 h composite samples over the respective sampling intervals.

Our results reveal a consistent pattern where the mean concentration of PMMoV RNA exceeded that of SARS-CoV-2 RNA across all time-based composite samples These results indicate that, on average, the abundance of PMMoV RNA was higher than that of SARS-CoV-2 RNA in the samples obtained at various time intervals. The difference in prevalence between PMMoV and SARS-CoV-2 can be attributed to the differential shedding patterns and origins of these viruses. PMMoV, being an indicator virus commonly used for detection purposes, is excreted by both asymptomatic and symptomatic individuals, with dietary consumption playing a role in its transmission (Rosario et al., 2009; Wu et al., 2020). On the other hand, SARS-CoV-2 is a virulent virus primarily released by individuals who have contracted the infection, resulting in a narrower source of transmission and lower prevalence compared to PMMoV.

Both SARS-CoV-2 and PMMoV RNA exhibited greater variability in the 1 h individual composite samples compared to longer time-based composite samples highlighting an important consideration in wastewater surveillance. The present investigation aligns with the research conducted by Bertanza et al. (2022), as it demonstrates that applying shorter sampling intervals, such as the 1 h interval employed in this study, facilitates a more comprehensive view of the temporal fluctuations in substance dynamics within a 24 h period. It is crucial to acknowledge that the SDs of PMMoV, used as an indicator virus, did not exhibit a significant difference from the pathogenic virus SARS-CoV-2. This implies that there is no statistically significant distinction between these two viruses when assessing variation using SDs. Furthermore, the CVs also offer valuable insights into the variation and consistency of viral RNA concentrations within different time-based composite samples of wastewater. The finding that CVs for SARS-CoV-2 RNA were notably higher compared to those of PMMoV RNA underscores the contrasting dynamics of these viruses in wastewater. The lower CVs for PMMoV RNA indicate that the concentrations of PMMoV RNA in each time-based composite sample were more consistent and less variable compared to the concentrations of SARS-CoV-2 RNA (Wu et al., 2022), particularly in the 1 h and 2 h composite samples (Figure 5). This is likely because the concentrations of PMMoV RNA in a sewage system depend directly on the diet of infected pepper plants by the contributing populations (Ash et al., 2023), which may vary throughout the day, leading to fluctuating CVs. On the other hand, pathogenic viruses like SARS-CoV-2 or other enteric viruses, which are typically present in lower concentrations, are expected to exhibit more variability throughout the day. This observation is consistent with the results reported by Ahmed et al. (2021), which demonstrated that the concentrations of indicator viruses of crAssphage and PMMoV exhibited significantly lower variability compared to the pathogenic virus HAdV.

The results of this study shed light on the selection of appropriate sampling modes for studying the temporal variations in SARS-CoV-2 and PMMoV RNA concentrations. The significant difference in SARS-CoV-2 RNA concentrations between the 24 h time-based composite samples and shorter time intervals (1 h, 2 h, and 4 h) highlights the dynamic nature of SARS-CoV-2 RNA concentration patterns over shorter time frames. This suggests that shorter composite intervals are essential for capturing rapid fluctuations in SARS-CoV-2 RNA concentrations, which could be crucial for monitoring and responding to outbreaks in real-time. The lack of a significant difference between the 24 h and 6 h time-based composite samples for SARS-CoV-2 RNA suggests that a 6 h sampling interval can effectively capture the overall trends and patterns in SARS-CoV-2 RNA concentrations over a 24 h period. This finding has practical implications, as it allows for a more efficient sampling strategy while maintaining accuracy. Furthermore, the study’s comparison to previous research, such as Mohapatra et al. (2023) and Wartell et al. (2022), indicates that different sampling intervals may be suitable depending on the specific objectives of a study. For instance, transitioning from 6 h to 12 h composites, as observed by Mohapatra et al. (2023), did not significantly impact sensitivity in their detection methods, suggesting flexibility in designing sampling protocols. In contrast, the lack of significant differences in PMMoV RNA concentrations between various time-based composite samples implies that PMMoV RNA exhibits less temporal variability within the studied time frames. This information is essential for understanding the behavior of PMMoV RNA and selecting appropriate sampling strategies when studying this particular virus.

The results of our statistical analysis demonstrate a significant temporal variation in SARS-CoV-2 RNA concentrations, which is influenced by the time of day at which samples were collected. This finding underscores the importance of considering diurnal patterns when designing sampling strategies for monitoring viral presence and concentration in a given environment. The distinct differences observed between the morning and other time periods in terms of SARS-CoV-2 RNA concentrations are particularly noteworthy. The reduced variability in the morning samples with the 24 h samples suggests that this time frame may be more suitable for accurately assessing the daily viral dynamics within the sampled environment. The morning period corresponds to a time when human activity typically surges, potentially leading to increased viral shedding from individuals and subsequently higher viral loads in the collected samples. This is consistent with most universities that they initiated their sample collection protocols in the early hours of the day, as indicated in Table 1. Researchers and public health officials should take this into account when planning surveillance and sampling efforts. Understanding these temporal variations in viral concentrations can have practical implications for public health strategies, especially in settings like campuses, where individuals congregate and interact. It highlights the importance of targeted sampling during peak activity periods to ensure that monitoring efforts accurately reflect the potential viral risk within a community. The lack of significant variations in PMMoV RNA concentrations across the different time periods indicates that PMMoV may not exhibit the same diurnal patterns as SARS-CoV-2. This finding is valuable in understanding the behavior of PMMoV and suggests that its dynamics may be less influenced by daily fluctuations.

5 Conclusion

This study conducted a field trial to assess various sampling modes and timings using autosamplers for the detection of the pathogenic virus SARS-CoV-2 and the indicator virus PMMoV RNA in raw sewage collected from university dormitories. The findings highlight the efficacy of 24 h composite samples in reducing variability, particularly when targeting pathogenic viruses such as SARS-CoV-2. Furthermore, our research also suggests that employing a composite sampler during a focused 6 h morning window can provide a practical, cost-effective, and time-efficient method to ensure representative sampling in wastewater-based epidemiology applications. This insight contributes valuable options for optimizing wastewater sampling strategies in the context of pathogen detection and epidemiological surveillance.

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Author contributions

YL: Data curation, Formal analysis, Investigation, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing. KA: Formal analysis, Investigation, Methodology, Resources, Validation, Writing – review & editing. DJ: Investigation, Methodology, Validation, Writing – review & editing. DW: Investigation, Methodology, Validation, Writing – review & editing. IA: Investigation, Methodology, Writing – review & editing. PM: Investigation, Methodology, Writing – review & editing. CI: Investigation, Methodology, Project administration, Writing – review & editing. TH: Funding acquisition, Project administration, Supervision, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Acknowledgments

The author would like to thank the Office of Research & Engagement of the University of Tennessee, Knoxville, for providing funding for the project.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Acer, P. T., Kelly, L. M., Lover, A. A., and Butler, C. S. (2022). Quantifying the relationship between SARS-CoV-2 wastewater concentrations and building-level COVID-19 prevalence at an isolation residence: a passive sampling approach. Int. J. Environ. Res. Public Health 19:1245. doi: 10.3390/ijerph191811245

PubMed Abstract | CrossRef Full Text | Google Scholar

Ahmed, W., Bivins, A., Bertsch, P. M., Bibby, K., Gyawali, P., Sherchan, S. P., et al. (2021). Intraday variability of indicator and pathogenic viruses in 1-h and 24-h composite wastewater samples: implications for wastewater-based epidemiology. Environ. Res. 193:110531. doi: 10.1016/j.envres.2020.110531

PubMed Abstract | CrossRef Full Text | Google Scholar

Anderson-Coughlin, B. L., Shearer, A. E., Omar, A. N., Litt, P. K., Bernberg, E., Murphy, M., et al. (2022). Coordination of SARS-CoV-2 wastewater and clinical testing of university students demonstrates the importance of sampling duration and collection time. Sci. Total Environ. 830:154619. doi: 10.1016/j.scitotenv.2022.154619

PubMed Abstract | CrossRef Full Text | Google Scholar

Ash, K. T., Li, Y., Alamilla, I., Joyner, D. C., Williams, D. E., McKay, P. J., et al. (2023). SARS-CoV-2 raw wastewater surveillance from student residences on an urban university campus. Front. Microbiol. 14. doi: 10.3389/fmicb.2023.1101205

PubMed Abstract | CrossRef Full Text | Google Scholar

Bertanza, G., Boiocchi, R., and Pedrazzani, R. (2022). Improving the quality of wastewater treatment plant monitoring by adopting proper sampling strategies and data processing criteria. Sci. Total Environ. 806:150724. doi: 10.1016/j.scitotenv.2021.150724

PubMed Abstract | CrossRef Full Text | Google Scholar

Betancourt, W. Q., Schmitz, B. W., Innes, G. K., Prasek, S. M., Brown, K. M. P., Stark, E. R., et al. (2021). COVID-19 containment on a college campus via wastewater-based epidemiology, targeted clinical testing and an intervention. Sci. Total Environ. 779:146408. doi: 10.1016/j.scitotenv.2021.146408

PubMed Abstract | CrossRef Full Text | Google Scholar

Bitter, L. C., Kibbee, R., Jiménez, G. C., and Örmeci, B. (2022). Wastewater surveillance of SARS-CoV-2 at a Canadian university campus and the impact of wastewater characteristics on viral RNA detection. Acs ES T Water 2, 2034–2046. doi: 10.1021/acsestwater.2c00060

PubMed Abstract | CrossRef Full Text | Google Scholar

Bivins, A., and Bibby, K. (2021). Wastewater surveillance during mass COVID-19 vaccination on a college campus. Environ. Sci. Technol. Lett. 8, 792–798. doi: 10.1021/acs.estlett.1c00519

PubMed Abstract | CrossRef Full Text | Google Scholar

Bivins, A., Lott, M., Shaffer, M., Wu, Z. Y., North, D., Lipp, E. K., et al. (2021). Building-level wastewater surveillance using tampon swabs and RT-LAMP for rapid SARS-CoV-2 RNA detection. Environ. Sci. Water Res. Technol. 8, 173–183. doi: 10.1039/D1EW00496D

CrossRef Full Text | Google Scholar

Cavany, S., Bivins, A., Wu, Z., North, D., Bibby, K., and Perkins, T. A. (2022). Inferring SARS-CoV-2 RNA shedding into wastewater relative to the time of infection. Epidemiol. Infect. 150:e21. doi: 10.1017/S0950268821002752

PubMed Abstract | CrossRef Full Text | Google Scholar

Cha, G., Graham, K. E., Zhu, K. J., Rao, G., Lindner, B. G., Kocaman, K., et al. (2023). Parallel deployment of passive and composite samplers for surveillance and variant profiling of SARS-CoV-2 in sewage. Sci. Total Environ. 866:161101. doi: 10.1016/j.scitotenv.2022.161101

PubMed Abstract | CrossRef Full Text | Google Scholar

Chua, F. J. D., Kim, S. Y., Hill, E., Cai, J. W., Lee, W. L., Gu, X. Q., et al. (2023). Co-incidence of BA.1 and BA.2 at the start of Singapore's omicron wave revealed by community and university campus wastewater surveillance. Sci. Total Environ. 875:162611. doi: 10.1016/j.scitotenv.2023.162611

PubMed Abstract | CrossRef Full Text | Google Scholar

Colosi, L. M., Barry, K. E., Kotay, S. M., Porter, M. D., Poulter, M. D., Ratliff, C., et al. (2021). Development of wastewater pooled surveillance of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) from congregate living settings. Appl. Environ. Microbiol. 87, e0043321–e0000421. doi: 10.1128/AEM.00433-21

PubMed Abstract | CrossRef Full Text | Google Scholar

Conway, M. J., Kado, S., Kooienga, B. K., Sarette, J. S., Kirby, M. H., Marten, A. D., et al. (2023). SARS-CoV-2 wastewater monitoring in rural and small metropolitan communities in Central Michigan. Sci. Total Environ. 894:165013. doi: 10.1016/j.scitotenv.2023.165013

CrossRef Full Text | Google Scholar

Corchis-Scott, R., Geng, Q. D., Al Riahi, A. M., Labak, A., Podadera, A., Ng, K. K. S., et al. (2023). Actionable wastewater surveillance: application to a university residence hall during the transition between Delta and omicron resurgences of COVID-19. Front. Public Health 11:9423. doi: 10.3389/fpubh.2023.1139423

PubMed Abstract | CrossRef Full Text | Google Scholar

de Llanos, R., Cejudo-Marín, R., Barneo, M., Pérez-Cataluña, A., Barberá-Riera, M., Rebagliato, M., et al. (2022). Monitoring the evolution of SARS-CoV-2 on a Spanish university campus through wastewater analysis: a pilot project for the reopening strategy. Sci. Total Environ. 845:157370. doi: 10.1016/j.scitotenv.2022.157370

CrossRef Full Text | Google Scholar

Fahrenfeld, N., Medina, W. R. M., D'Elia, S., Modica, M., Ruiz, A., and McLane, M. (2022). Comparison of residential dormitory COVID-19 monitoring via weekly saliva testing and sewage monitoring. Sci. Total Environ. 814:151947. doi: 10.1016/j.scitotenv.2021.151947

PubMed Abstract | CrossRef Full Text | Google Scholar

Gibas, C., Lambirth, K., Mittal, N., Juel, M. A. I., Barua, V. B., Brazell, L. R., et al. (2021). Implementing building-level SARS-CoV-2 wastewater surveillance on a university campus. Sci. Total Environ. 782:146749. doi: 10.1016/j.scitotenv.2021.146749

PubMed Abstract | CrossRef Full Text | Google Scholar

Jain, N., Hamilton, D., Mital, S., Ilias, A., Brinkmann, M., and McPhedran, K. (2022). Long-term passive wastewater surveillance of SARS-CoV-2 for seven university dormitories in comparison to municipal surveillance. Sci. Total Environ. 852:158421. doi: 10.1016/j.scitotenv.2022.158421

PubMed Abstract | CrossRef Full Text | Google Scholar

Johnson, W., Reeves, K., Liebig, J., Feula, A., Butler, C., Alkire, M., et al. (2022). Effectiveness of building-level sewage surveillance during both community-spread and sporadic-infection phases of SARS-CoV-2 in a university campus population. FEMS Microbes 3:xtac024. doi: 10.1093/femsmc/xtac024

PubMed Abstract | CrossRef Full Text | Google Scholar

Karthikeyan, S., Levy, J. I., De Hoff, P., Humphrey, G., Birmingham, A., Jepsen, K., et al. (2022). Wastewater sequencing reveals early cryptic SARS-CoV-2 variant transmission. Nature 609, 101–108. doi: 10.1038/s41586-022-05049-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Karthikeyan, S., Nguyen, A., McDonald, D., Zong, Y. J., Ronquillo, N., Ren, J. T., et al. (2021). Rapid, large-scale wastewater surveillance and automated reporting system enable early detection of nearly 85% of COVID-19 cases on a university campus. Msystems 6:e0079321. doi: 10.1128/msystems.00793-21

PubMed Abstract | CrossRef Full Text | Google Scholar

Kazenelson, J., Jefferson, T., Rhodes, R. G., Cahoon, L. B., and Frampton, A. R. (2023). Detection of SARS-CoV-2 RNA in wastewater from an enclosed college campus serves as an early warning surveillance system. PLoS One 18:e0288808. doi: 10.1371/journal.pone.0288808

PubMed Abstract | CrossRef Full Text | Google Scholar

Kotay, S. M., Tanabe, K. O., Colosi, L. M., Poulter, M. D., Barry, K. E., Holstege, C. P., et al. (2022). Building-level wastewater surveillance for SARS-CoV-2 in occupied university dormitories as an outbreak forecasting tool: one year case study. Acs ES T Water 2, 2094–2104. doi: 10.1021/acsestwater.2c00057

CrossRef Full Text | Google Scholar

Langan, L. M., O’Brien, M., Rundell, Z. C., Back, J. A., Ryan, B. J., Chambliss, C. K., et al. (2022). Comparative analysis of RNA-extraction approaches and associated influences on RT-qPCR of the SARS-CoV-2 RNA in a university residence hall and quarantine location. Acs ES T Water 2, 1929–1943. doi: 10.1021/acsestwater.1c00476

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, J., Acosta, N., Waddell, B. J., Du, K., Xiang, K., Van Doorn, J., et al. (2023). Campus node-based wastewater surveillance enables COVID-19 case localization and confirms lower SARS-CoV-2 burden relative to the surrounding community. Water Res. 244:120469. doi: 10.1016/j.watres.2023.120469

CrossRef Full Text | Google Scholar

Lee, L., Valmond, L., Thomas, J., Kim, A., Austin, P., Foster, M., et al. (2022). Wastewater surveillance in smaller college communities may aid future public health initiatives. PLoS One 17:e0270385. doi: 10.1371/journal.pone.0270385

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, Y., Ash, K. T., Joyner, D. C., Williams, D. E., Alamilla, I., McKay, P., et al. (2023). Decay of enveloped SARS-CoV-2 and non-enveloped PMMoV RNA in raw sewage from university dormitories. Front. Microbiol. 14:1144026. doi: 10.3389/fmicb.2023.1144026

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, P., Ibaraki, M., VanTassell, J., Geith, K., Cavallo, M., Kann, R., et al. (2022). A sensitive, simple, and low-cost method for COVID-19 wastewater surveillance at an institutional level. Sci. Total Environ. 807:151047. doi: 10.1016/j.scitotenv.2021.151047

PubMed Abstract | CrossRef Full Text | Google Scholar

Lu, E., Ai, Y., Davis, A., Straathof, J., Halloran, K., Hull, N., et al. (2022). Wastewater surveillance of SARS-CoV-2 in dormitories as a part of comprehensive university campus COVID-19 monitoring. Environ. Res. 212:113580. doi: 10.1016/j.envres.2022.113580

PubMed Abstract | CrossRef Full Text | Google Scholar

Mangwana, N., Archer, E., Muller, C. J., Preiser, W., Wolfaardt, G., Kasprzyk-Hordern, B., et al. (2022). Sewage surveillance of SARS-CoV-2 at student campus residences in the Western cape, South Africa. Sci. Total Environ. 851:158028. doi: 10.1016/j.scitotenv.2022.158028

PubMed Abstract | CrossRef Full Text | Google Scholar

Mohapatra, S., Bhatia, S., Senaratna, K. Y. K., Jong, M.-C., Lim, C. M. B., Gangesh, G. R., et al. (2023). Wastewater surveillance of SARS-CoV-2 and chemical markers in campus dormitories in an evolving COVID−19 pandemic. J. Hazard. Mater. 446:130690. doi: 10.1016/j.jhazmat.2022.130690

PubMed Abstract | CrossRef Full Text | Google Scholar

Rainey, A. L., Buschang, K., O’Connor, A., Love, D., Wormington, A. M., Messcher, R. L., et al. (2022). Retrospective analysis of wastewater-based epidemiology of SARS-CoV-2 in residences on a large college campus: relationships between wastewater outcomes and COVID-19 cases across two semesters with different COVID-19 mitigation policies. Acs Es&T Water 3, 16–29. doi: 10.1021/acsestwater.2c00275

PubMed Abstract | CrossRef Full Text | Google Scholar

Randazzo, W., Cuevas-Ferrando, E., Sanjuán, R., Domingo-Calap, P., and Sánchez, G. (2020). Metropolitan wastewater analysis for COVID-19 epidemiological surveillance. Int. J. Hyg. Environ. Health 230:113621. doi: 10.1016/j.ijheh.2020.113621

PubMed Abstract | CrossRef Full Text | Google Scholar

Reeves, K., Liebig, J., Feula, A., Saldi, T., Lasda, E., Johnson, W., et al. (2021). High-resolution within-sewer SARS-CoV-2 surveillance facilitates informed intervention. Water Res. 204:117613. doi: 10.1016/j.watres.2021.117613

PubMed Abstract | CrossRef Full Text | Google Scholar

Rondeau, N. C., Rose, O. J., Alt, E. R., Ariyan, L. A., Elikan, A. B., Everard, J. L., et al. (2023). Building-level detection threshold of SARS-CoV-2 in wastewater. Microbiol. Spect. 11, e02929–e02922. doi: 10.1128/spectrum.02929-22

CrossRef Full Text | Google Scholar

Rosario, K., Symonds, E. M., Sinigalliano, C., Stewart, J., and Breitbart, M. (2009). Pepper mild mottle virus as an indicator of fecal pollution. Appl. Environ. Microbiol. 75, 7261–7267. doi: 10.1128/AEM.00410-09

CrossRef Full Text | Google Scholar

Schmitz, B. W., Innes, G. K., Prasek, S. M., Betancourt, W. Q., Stark, E. R., Foster, A. R., et al. (2021). Enumerating asymptomatic COVID-19 cases and estimating SARS-CoV-2 fecal shedding rates via wastewater-based epidemiology. Sci. Total Environ. 801:149794. doi: 10.1016/j.scitotenv.2021.149794

PubMed Abstract | CrossRef Full Text | Google Scholar

Scott, L. C., Aubee, A., Babahaji, L., Vigil, K., Tims, S., and Aw, T. G. (2021). Targeted wastewater surveillance of SARS-CoV-2 on a university campus for COVID-19 outbreak detection and mitigation. Environ. Res. 200:111374. doi: 10.1016/j.envres.2021.111374

CrossRef Full Text | Google Scholar

Sellers, S. C., Gosnell, E., Bryant, D., Belmonte, S., Self, S., McCarter, M. S., et al. (2022). Building-level wastewater surveillance of SARS-CoV-2 is associated with transmission and variant trends in a university setting. Environ. Res. 215:114277. doi: 10.1016/j.envres.2022.114277

PubMed Abstract | CrossRef Full Text | Google Scholar

Sharaby, Y., Gilboa, Y., Alfiya, Y., Sabach, S., Cheruti, U., and Friedler, E. (2023). Whole campus wastewater surveillance of SARS-CoV-2 for COVID-19 outbreak management. Water Sci. Technol. 87, 910–923. doi: 10.2166/wst.2023.030

CrossRef Full Text | Google Scholar

Sharkey, M. E., Kumar, N., Mantero, A. M. A., Babler, K. M., Boone, M. M., Cardentey, Y., et al. (2021). Lessons learned from SARS-CoV-2 measurements in wastewater. Sci. Total Environ. 798:149177. doi: 10.1016/j.scitotenv.2021.149177

PubMed Abstract | CrossRef Full Text | Google Scholar

Solo-Gabriele, H. M., Kumar, S., Abelson, S., Penso, J., Contreras, J., Babler, K. M., et al. (2023). Predicting COVID-19 cases using SARS-CoV-2 RNA in air, surface swab and wastewater samples. Sci. Total Environ. 857:159188. doi: 10.1016/j.scitotenv.2022.159188

PubMed Abstract | CrossRef Full Text | Google Scholar

Strike, W., Amirsoleimani, A., Olaleye, A., Noble, A., Lewis, K., Faulkner, L., et al. (2022). Development and validation of a simplified method for analysis of SARS-CoV-2 RNA in university dormitories. Acs ES T Water 2, 1984–1991. doi: 10.1021/acsestwater.2c00044

PubMed Abstract | CrossRef Full Text | Google Scholar

Swain, M. J., Carter, B., Snowdon, K., and Faust, R. A. (2023). The implementation and utilization of wastewater-based epidemiology: experiences from a local health department. J. Public Health Manag. Pract. 29, 322–325. doi: 10.1097/phh.0000000000001714

PubMed Abstract | CrossRef Full Text | Google Scholar

Sweetapple, C., Melville-Shreeve, P., Chen, A. S., Grimsley, J. M., Bunce, J. T., Gaze, W., et al. (2022). Building knowledge of university campus population dynamics to enhance near-to-source sewage surveillance for SARS-CoV-2 detection. Sci. Total Environ. 806:150406. doi: 10.1016/j.scitotenv.2021.150406

PubMed Abstract | CrossRef Full Text | Google Scholar

Swift, C. L., Isanovic, M., Correa Velez, K. E., Sellers, S. C., and Norman, R. S. (2022). Wastewater surveillance of SARS-CoV-2 mutational profiles at a university and its surrounding community reveals a 20G outbreak on campus. PLoS One 17:e0266407. doi: 10.1371/journal.pone.0266407

CrossRef Full Text | Google Scholar

Vo, V., Tillett, R. L., Chang, C.-L., Gerrity, D., Betancourt, W. Q., and Oh, E. C. (2022). SARS-CoV-2 variant detection at a university dormitory using wastewater genomic tools. Sci. Total Environ. 805:149930. doi: 10.1016/j.scitotenv.2021.149930

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, Y., Liu, P., Zhang, H., Ibaraki, M., VanTassell, J., Geith, K., et al. (2022). Early warning of a COVID-19 surge on a university campus based on wastewater surveillance for SARS-CoV-2 at residence halls. Sci. Total Environ. 821:153291. doi: 10.1016/j.scitotenv.2022.153291

PubMed Abstract | CrossRef Full Text | Google Scholar

Wartell, B. A., Proano, C., Bakalian, L., Kaya, D., Croft, K., McCreary, M., et al. (2022). Implementing wastewater surveillance for SARS-CoV-2 on a university campus: lessons learned. Water Environ. Res. 94:e10807. doi: 10.1002/wer.10807

PubMed Abstract | CrossRef Full Text | Google Scholar

WBE Collaborative. (2023). COVID-19WBECollaborative. Available at: www.COVID19wbec.org

Google Scholar

Welling, C. M., Singleton, D. R., Haase, S. B., Browning, C. H., Stoner, B. R., Gunsch, C. K., et al. (2022). Predictive values of time-dense SARS-CoV-2 wastewater analysis in university campus buildings. Sci. Total Environ. 835:155401. doi: 10.1016/j.scitotenv.2022.155401

PubMed Abstract | CrossRef Full Text | Google Scholar

Wilson, M., Qiu, Y., Yu, J., Lee, B. E., McCarthy, D. T., and Pang, X. (2022). Comparison of auto sampling and passive sampling methods for SARS-CoV-2 detection in wastewater. Pathogens 11:359. doi: 10.3390/pathogens11030359

PubMed Abstract | CrossRef Full Text | Google Scholar

Wright, J., Driver, E. M., Bowes, D. A., Johnston, B., and Halden, R. U. (2022). Comparison of high-frequency in-pipe SARS-CoV-2 wastewater-based surveillance to concurrent COVID-19 random clinical testing on a public US university campus. Sci. Total Environ. 820:152877. doi: 10.1016/j.scitotenv.2021.152877

PubMed Abstract | CrossRef Full Text | Google Scholar

Wu, F., Xiao, A., Zhang, J., Moniz, K., Endo, N., Armas, F., et al. (2022). SARS-CoV-2 RNA concentrations in wastewater foreshadow dynamics and clinical presentation of new COVID-19 cases. Sci. Total Environ. 805:150121. doi: 10.1016/j.scitotenv.2021.150121

PubMed Abstract | CrossRef Full Text | Google Scholar

Wu, F., Zhang, J., Xiao, A., Gu, X., Lee, W. L., Armas, F., et al. (2020). SARS-CoV-2 Titers in wastewater are higher than expected from clinically confirmed cases. Msystems 5:10.1128/msystems.00614-00620. doi: 10.1128/msystems.00614-20

PubMed Abstract | CrossRef Full Text | Google Scholar

Yaglom, H. D., Maurer, M., Collins, B., Hojnacki, J., Monroy-Nieto, J., Bowers, J. R., et al. (2022). One health genomic surveillance and response to a university-based outbreak of the SARS-CoV-2 Delta AY.25 lineage, Arizona, 2021. PLoS One 17:e0272830. doi: 10.1371/journal.pone.0272830

PubMed Abstract | CrossRef Full Text | Google Scholar

Zambrana, W., Catoe, D., Coffman, M. M., Kim, S., Anand, A., Solis, D., et al. (2022). SARS-CoV-2 RNA and N antigen quantification via wastewater at the campus level, building cluster level, and individual-building level. Acs ES T Water 2, 2025–2033. doi: 10.1021/acsestwater.2c00050

CrossRef Full Text | Google Scholar

Zhan, Q. Y., Babler, K. M., Sharkey, M. E., Amirali, A., Beaver, C. C., Boone, M. M., et al. (2022). Relationships between SARS-CoV-2 in wastewater and COVID-19 clinical cases and hospitalizations, with and without normalization against indicators of human waste. Acs ES T Water. 2, 1992–2003. doi: 10.1021/acsestwater.2c00045

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: SARS-CoV-2 RNA, PMMoV RNA, raw sewage, sampling modes, sampling duration, sampling timing

Citation: Li Y, Ash KT, Joyner DC, Williams DE, Alamilla I, McKay PJ, Iler C and Hazen TC (2023) Evaluating various composite sampling modes for detecting pathogenic SARS-CoV-2 virus in raw sewage. Front. Microbiol. 14:1305967. doi: 10.3389/fmicb.2023.1305967

Received: 02 October 2023; Accepted: 10 November 2023;
Published: 23 November 2023.

Edited by:

Juan Luis Muñoz-Bellido, University of Salamanca, Spain

Reviewed by:

Fuqing Wu, The University of Texas Health Science Center at Houston, United States
Gary Antonio Toranzos, University of Puerto Rico, Puerto Rico

Copyright © 2023 Li, Ash, Joyner, Williams, Alamilla, McKay, Iler and Hazen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Terry C. Hazen, tchazen@utk.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.