Skip to main content

ORIGINAL RESEARCH article

Front. Bioeng. Biotechnol., 23 October 2020
Sec. Biosafety and Biosecurity
Volume 8 - 2020 | https://doi.org/10.3389/fbioe.2020.592621

Hot, Humid Air Decontamination of Aircraft Confirmed That High Temperature and High Humidity Are Critical for Inactivation of Infectious, Enveloped Ribonucleic Acid (RNA) Virus

Tony L. Buhr* Alice A. Young Erica Borgers-Klonkowski Neil L. Kennihan Harold K. Barnette Zachary A. Minter Matthew D. Bohmke Emily B. Osborn Shelia M. Hamilton Monique B. Kimani Mark W. Hammon Charles T. Miller Ryan S. Mackie Jennifer M. Innocenti Misty D. Bensman Bradford W. Gutting Samuel D. Lilly Emlyn E. Hammer Vanessa L. Yates Brooke B. Luck
  • Naval Surface Warfare Center-Dahlgren Division, Concepts and Experimentation Branch (B64), Dahlgren, VA, United States

Aims: To develop infectious (live/dead) enveloped virus test indicators and response surface methodology (RSM) models that evaluate survival of an enveloped ribonucleic acid (RNA) virus on contaminated aircraft materials after exposure to hot, humid air (HHA).

Methods and Results: Enveloped RNA bacteriophage Phi6 (Φ6) was dried on wiring insulation, aircraft performance coating (APC), polypropylene, and nylon at ≥ 8 log10 plaque-forming units (PFU) test coupon−1. Only 2.4 log10 inactivation was measured on APC at 70°Celsius (°C), 5% relative humidity (RH) after 24 h. In contrast, HHA RSM models showed a 90% probability of a 7 log10 inactivation at ≥63°C, 90% RH after 1 h, and decontamination kinetics were similar across different materials. HHA decontamination of C-130 and C-17 aircraft showed >7 log10 and ≥5.9 log10 inactivation of enveloped virus on 100 and 110 test indicators, respectively, with a 1-h treatment, excluding ramp-up and ramp-down times.

Conclusions: Enveloped RNA virus test indicators were successfully developed, lab tested for HHA decontamination, analyzed for RSM, and field-tested in aircraft demonstrations.

Significance and Impact of the Study: The utility of HHA decontamination was demonstrated after inactivating enveloped RNA virus on aircraft with a 1-h HHA treatment within aircraft temperature and RH limits.

Introduction

There is a need to develop aircraft decontamination procedures for enveloped RNA viruses ranging from hemorrhagic fever viruses to coronaviruses (Centers for Disease Control Prevention, 2019; National Business Aviation Association, 2020). A candidate procedure for aircraft decontamination is hot, humid air (HHA), which has been tested for Bacillus spore decontamination (Buhr et al., 2012, 2015, 2016). HHA decontamination is highly feasible for enveloped virus decontamination since enveloped viruses are considered much easier to kill than spores (Spaulding, 1957). In order to develop HHA decontamination profiles and test in aircraft field demonstrations, a biosafety level 1 (BSL-1) enveloped RNA virus was needed as a test indicator to meet the requirements imposed by biosafety and environmental reviews for field testing. Field test approval is a lengthy process that can require decades of compiled research to approve BSL-1 organisms for field testing, regardless of whether the organism is contained or released during the test (Bishop and Robinson, 2014; Buhr et al., 2016). It is particularly challenging to justify and approve enveloped virus strains for rapid field testing (2 months for biosafety approval at different facilities, enveloped virus test indicator preparation, and 2 aircraft field tests including results) during a pandemic such as the SARS-CoV-2/COVID-19 pandemic. Furthermore, active, infectious virus was needed for a live/dead (infectious/non-infectious for viruses) assay since live/dead assays are the hallmark of decontamination testing.

Φ6 is a BSL-1 enveloped RNA virus originally isolated in a bean field as a lytic virus that infected the plant pathogenic bacterium Pseudomonas syringae pathovar phaseolicola (Vidaver et al., 1973; Van Etten et al., 1976; Mindich, 2004). Early hopes to produce the virus in large quantities to spray on bean fields as an environmentally friendly biocontrol agent were never commercially realized. However, due to its rare combination as a BSL-1, enveloped RNA virus it has been proposed as a general surrogate for a number of different enveloped RNA viruses particularly for field testing (Gallandat and Lantagne, 2017). The Φ6 envelope structure is similar to many other enveloped viruses as the envelope consists of a glycoprotein/protein-embedded lipid membrane, and the host cell has similar temperature sensitivity to mammalian cells at around 40°C. This is important since the envelope components are considered a primary target for inactivation by many different decontaminants (McDonnell and Burke, 2011; Wiggington et al., 2012). Here Φ6 was prepared to develop BSL-1 enveloped virus test indicators at ≥ 7.6 log10 coupon−1, test HHA decontamination parameters, develop response surface models for HHA decontamination, and measure enveloped virus inactivation during C-130 and C-17 aircraft field tests.

Materials and Methods

Φ6 and Host Cell Preparations

Φ6 and its host organism P. syringae pathovar phaseolicola HB10Y (HB10Y), causal agent of halo blight of the common bean, Phaseolus vulgaris, were isolated in Spain. Both were a kind gift from Dr. Leonard Mindich at Rutgers University, New Jersey Medical School. HB10Y was prepared by inoculating 100–200 ml of 3% tryptic soy broth (TSB; Fluka PN#T8907-1KG) in a 1-liter (l) smooth-bottom Erlenmeyer flask with a high efficiency particulate air filter cap. Cultures were incubated at 26 ± 2°C, 200 revolutions (rev) minute (min)−1 for 20 ± 2 hours (h). 11.1 ml of 100% glycerol (Sigma PN #G7757-500ML) was added per 100 ml of host culture. The final concentration of glycerol was 10%. One-ml aliquots of HB10Y were pipetted into screw-cap microfuge tubes with O-rings and stored at −80°C. HB10Y samples were titered prior to freezing by serially diluting samples in 10 millimolar (mM) of 4-(2-hydroxyethyl)-1-piperazineethanesulfonic acid (HEPES, Sigma PN#H4034-100G) + 10% Sucrose (Sigma PN #S7903-250G), pH 7.0, and plating on Tryptic Soy Agar (TSA; Hardy Diagnostics, Santa Maria, CA). Plates were inverted and incubated at 26 ± 2°C for 48 ± 2 h to show titers of ~109 cells ml−1. After freezing, tubes were thawed at room temperature (RT, 22 ± 3°C), serially diluted, and plated to show sustained viability after long-term storage at −80°C.

Φ6 was prepared after inoculating broth cultures of HB10Y. A frozen stock prep of HB10Y was thawed at 22 ± 3°C. HB10Y was added either directly from a frozen stock or by transferring a single colony from a streaked TSA plate to 100–200 ml of 3% TSB in a 1-l smooth-bottom Erlenmeyer flask with a HEPA cap and incubated at 26 ± 2°C, 200 rev min−1 overnight. Cells were then diluted and grown to mid-log phase. The host flask was inoculated with 0.5–1 ml of Φ6 at a concentration of ~1-2e11 plaque-forming units (PFU) ml−1 at the time of inoculation. The culture was incubated at 26 ± 2°C, 200 rev min−1 for 24 ± 2 h. The Φ6 preparation was stored at 4°C until after titering was completed. After titer determination was completed, typically around 1-2e11 PFU ml−1, then 1–1.3 ml volumes were aliquoted into 1.5-ml screw-cap tubes with O-rings, inverted, and stored at −80°C.

Environmental Test Chamber Setup and Validation

Thermotron SM-8-8200 (Thermotron Industries, Holland, MI, USA) environmental chambers were used to control temperature and RH as described (Buhr et al., 2015).

Coupon Materials and Sterilization

Square 2 centimeter (cm) × 2 cm coupons of different test materials or the inside surface of 50-ml Techno Plastic Products AG, Switzerland (TPP®), polypropylene conical tubes were inoculated with >8 log10 Φ6 virus inoculum. The inoculated 2 cm × 2 cm coupons were set inside sterile TPP® tubes during testing (Buhr et al., 2012, 2015, 2016). Materials for inoculation included aluminum 2024-T3 coupons painted with water-based aircraft performance coating (APC), stainless-steel 304 coupons painted with Navy Top Coat (NTC) [Coatings Group at the University of Dayton Research Institute (Dayton, OH, USA)], wiring insulation (Kapton Film Type HN, 1 mil, Reference No. 6197844-00 from Cole Parmer, Vernon Hills, IL, USA), and nylon webbing (nylon) (US Netting, Erie, PA, USA) with the ends of each coupon cauterized to prevent fraying. Polypropylene plastic and wiring insulation represent non-porous materials found on commercial and military aircraft. APC and NTC represent semi-porous surfaces found on military aircraft and ships, with APC the primary focus for this testing. Nylon webbing represents porous materials found on military and commercial aircraft since nylon is used to manufacture various carpets and fabrics. Prior to inoculating and testing, coupons were rinsed with 18 mega-Ohm-cm, de-ionized water, placed on absorbent paper in an autoclave-safe container, and autoclaved for 30 min at 121°C, 100 kilopascals. Autoclaved coupons were stored in sterile containers until used. Microbial recovery from autoclaved APC coupons was variable. There was no visible damage, changes in contact angle measurements, or evidence of surface variability on autoclaved APC coupons after inspection with a scanning electron microscope (data not shown). In order to clean and remove interferents such as dried, residual paint solvent, APC coupons were soaked in 70% ethanol for 20 min, rinsed at least 3 times with sterile 18 mega-ohm-cm water, and dried.

Response Surface Methodology (RSM)

RSM was used for previous work with HHA decontamination of materials contaminated with spores because the RSM Design of Experiments (DOE) was requested by the funding agencies as an industry-accepted method to describe HHA points of failure (Beauregard et al., 1992; Lenth, 2009; Myers et al., 2009; Buhr et al., 2012, 2015). RSM required three equally spaced test parameters for each variable; time, temperature, and humidity. An extensive amount of trial-and-error testing showed a very rapid and dramatic impact of temperature and RH on virus decontamination. Test temperatures were 55, 60, and 65°C. Test RH was 50, 70, and 90%. Test times were 1, 5, and 9 h to provide a practical timeframe for decontamination of ≤ 24 h. RSM DOE test parameters are displayed in Figure 1. The first 13 test runs (first iteration) included the center and corners of the experimental test box. The latter 6 test runs (second iteration) included the face-points at the center of each side of the test box.

FIGURE 1
www.frontiersin.org

Figure 1. Response surface methodology (RSM) design of experiments (DOE) for three test factors (°C, % relative humidity, time in h).

Virus Test Method and Design

An overlay procedure used for Φ6 was adapted from procedures used for Escherichia coli and its bacteriophages using TSA and TSB media instead of Luria–Bertani agar and broth. Plates were incubated at 26 ± 2°C for 20 ± 2 h before quantifying plaques. Plates were then incubated another 24 ± 2 h at RT and scored a final time.

Φ6 stock preps were removed from −80°C storage and thawed at RT prior to preparing inoculum by transferring stock Φ6 into 50-ml conical tubes containing 10 mM HEPES + 10% sucrose pH 7.0 for a final concentration of 1-2e9 PFU ml−1. The infectious virus concentration was confirmed by titering. Test coupons and conical tubes were inoculated with 0.1 ml of Φ6 inoculum, held at RT for 24 ± 2 h to dry allowing virus to adhere to the test material, then transferred to TPP® tubes. Following exposure of Φ6 to various hot humid air decontamination testing parameters, samples were extracted and plated.

For Φ6 extraction, 5 ml of 10 mM HEPES + 10% sucrose pH 7 were added to each conical tube with a virus-inoculated coupon and vortexed for 2 min. After vortexing, 5 ml of HB10Y log-phase culture was added and allowed to infect at RT for 15 min, followed by 2 min of vortexing. Each sample was serially diluted in 900 μl of 10 mM HEPES + 10% sucrose pH 7 out to the −6 dilution. For each Φ6 dilution, 1,000 μl for the first dilution and 200 μl for subsequent dilutions were transferred into individual tubes containing 200 μl log-phase HB10Y. Then, 1,200 or 200 μl of those Φ6/HB10Y mixtures was added to individual TSB overlay tubes, poured onto individual TSA plates, and allowed to solidify for ≥30 min. Solidified plates were then inverted, incubated for 20 ± 2 h at 26°C, and quantified. Plates were incubated another 24 h at RT and quantified a final time. Quantitation and calculations of survival were performed as previously described (Buhr et al., 2012, 2014). The maximum (100%) recoverable virus reference, the inoculum titer, was used to calculate extraction efficiency. Extraction efficiency was the number of PFU removed from non-treated control coupons divided by the number of PFU in the inoculum.

Response Surface Methodology (RSM) Performance Envelopes—Mathematical Model Development

RSM to represent survivability of Φ6 bacteriophage were developed. For a given DOE point, sample data varied with respect to initial Φ6 bacteriophage population and a final surviving Φ6 bacteriophage population. To facilitate model development, the results of the samples were normalized into a Survival Fraction (SF). A SF is simply the surviving population divided by the initial population. SF is assumed to never be greater than one or less than zero.

The smallest non-zero SF that may be observed is limited due to the initial population being a finite number. Specifically, the smallest observable SF is 1 divided by the initial population. However, if the results reflect that of a 1-ml sample taken from a 10-ml sample (as is true for this data), then the smallest observable SF is 10 divided by the initial population. If extraction efficiency is <100%, then the smallest observable SF becomes 10 divided by the initial population divided by the extraction efficiency. If test data shows a surviving population of zero, it is likely because the theoretical SF is smaller than the smallest observable SF. Because of the limitation imposed by a finite initial population, any test result showing a survival population of zero was treated as a SF that is less than or equal to the smallest observable SF.

The geometric mean survival fraction (GMSF) equation below shows how GMSF was calculated for each DOE point. In Equation 1, “N” represents the number of samples for a given DOE point.

GMSF = (i = 1N  survival_counti initial_populationi)1N    (1)

All GMSF values from the experiments lie between “0” and “1,” and they differ from each other by orders of magnitude, which can make it difficult to find a good fit to the data. To avoid this problem and to facilitate the data fitting process, it is desirable to transform the widely varying GMSF values such that the transformed values are distributed in a linear fashion. To achieve this, the natural log of the GMSF values was computed. However, this transform still resulted in a very non-linear distribution. A second transform was performed, using Equation 2 below, that flipped the sign of the first transform and then took its natural log. This yielded a more linear distribution of data.

GMSFiT = ln(-1·ln(GMSFi))    (2)

One benefit of this transform is that it constrains all model predictions to a value between “0” and “1” and thereby prevents a result that contradicts the definition of SF. Data fit exploration focused on obtaining a good fit to the data set of transformed GMSF values. During the data fitting process, a constraint was imposed on the fit such that as temperature and/or RH and/or time increase, SF decreases consistently without exception. The final functional form for predicting GMSF is shown in the system of equations below (Equation 3).

       f = c0+c1T+c2R+c3H+c4TR+c5TH+c6HR           +c7(T-T0)n1(R-R0)n2(H-H0)n3GMSF= e-ef    (3)

Where:

T = temperature (°C), R = relative humidity (%), H = time (hours)

c0 to c7 = addition and multiplication coefficients

n1 to n3 = power coefficients

T0 = temperature offset coefficient

R0 = relative humidity offset coefficient

H0 = time offset coefficient

GMSF = geometric mean survival fraction.

As is evident in the data, a given exposure condition will result in a distribution of various SF values that can vary geometrically. Because of this geometric variation, it is appropriate to assume the natural log of the survival fractions for a given sample follow a normal distribution for a given exposure condition. An estimate of the expected distribution of results is important because it helps a user identify a probability that an expected total kill will occur for a given exposure condition. For example, a user can utilize the expected distribution to identify the exposure condition required to achieve at least a 7 log10 kill with a 95% probability.

Most of the exposure DOE points consist of only 5 samples, and this small sample size increases the uncertainty in determining the population geometric standard deviation (GSD) from the sample geometric standard deviation. There was no clear and consistent pattern in the sample geometric standard deviations that would allow for the development of a reasonable equation to predict geometric standard deviation as a function of exposure conditions. However, the DOE center point (Temp = 60, RH = 70, H = 5) consists of 25 samples for each medium and consists of enough data to reasonably estimate a geometric standard deviation that is assumed to be representative for the entire DOE factor space. Using the test results from the DOE center point for each medium, the geometric standard deviation was computed using Equation 4 below.

      f = i=1n(ln(SFi)-ln(GMSF))2n-1GSD = ef    (4)

Where:

n = number of samples

i = indexed reference to a particular sample

SFi = survival fraction for sample “i”

GMSF = geometric mean survival fraction

GSD = geometric standard deviation.

The normal distribution of possible Survival Fraction logs for a given exposure condition is described by the natural log of the GMSF predicted using Equation 3 and the natural log of the GSD computed using Equation 4. The GMSF will vary based on exposure conditions and medium, but the GSD will only vary by medium. The equations for the Normal distribution are provided in Equations 5 and 6 below.

PDF=12πσ2e-(ln(x)-μ)22σ2    (5)
CDF=12+12erf[ln(x)-μ2σ2]    (6)

Where:

PDF = probability distribution function. Characterizes the relative frequency of occurrence.

CDF = cumulative distribution function. The integral of the PDF with results ranging from 0 to 1.

x = horizontal axis of possible Survival Fractions

μ = natural log of geometric mean survival fraction (GMSF)

σ = natural log of geometric standard deviation (GSD)

erf = the error function.

The cumulative distribution function equation returns the area for a region under the Probability Distribution Function curve by integrating from -∞ to a specified SF. A CDF result of “0.95” indicates that 95% of the SF values observed will be less than the specified SF.

The Solver add-in for Microsoft Excel 2016 was used to explore various fits to the transformed survival fractions. The Solver add-in has the added benefit of allowing fit constraints which was crucial to obtaining a good and reasonable fit. The “Evolutionary” method in Solver proved a valuable tool in optimizing the coefficients shown in Equation 3. Excel was also used to produce the various plots in this report and assess model performance.

C-130 and C-17 Aircraft Test Demonstrations

Enveloped virus test indicators consisted of APC coupons inoculated with 1 of 5 independent virus preparations at >8 log10 coupon−1, and the test coupons were placed inside TPP® tubes prior to storage, shipping, and testing. Test indicators were placed in 20–22 locations with 5 test indicators per location within the aircraft. Each of the 5 test indicators was inoculated with an independent virus preparation. HHA tests were conducted inside a C-130 fuselage located at Army Combat Capabilities Developmental Command, Edgewood, MD, USA (Figure 2), or in a C-17 located at Dover Air Force Base, Dover, DE, USA (Figure 3), using a previously tested HHA system (Buhr et al., 2016) ran and managed/monitored by a consortium listed in the acknowledgments. After HHA exposure, the test indicators were shipped to a laboratory for virus extraction. Shipping controls were shipped, but not treated with HHA. Laboratory controls were not shipped. Both control sets were prepared, extracted, and quantified alongside the test indicators. Shipping and laboratory controls were maintained inside 50-ml conical tubes with 0.2-μm filter caps that allowed equilibration of temperature and humidity exactly the same as the test samples. The controls were maintained at ambient temperature and humidity and measured using data loggers, while test samples were exposed to HHA.

FIGURE 2
www.frontiersin.org

Figure 2. Side view of a C-130 showing the sampling layout for low, middle, and high sampling sites.

FIGURE 3
www.frontiersin.org

Figure 3. Side view of a C-17 showing the sampling layout for low, middle, and high sampling sites.

Results

HHA Inactivation of Enveloped RNA Virus

In order to develop RSM performance envelopes, partial inactivation data was needed especially at the DOE mid-point. A small test at 50, 60, 70, and 80°C, RH at 5 or 90% for 1 and 24 h, produced critical data showing that high RH was critical for enveloped virus inactivation (Table 1). The virus inoculum was held at RT while test samples were exposed to temp/RH. There was only 2.4 log10 enveloped virus inactivation at 70°C, 5% RH, for 24 h compared to complete inactivation at 70°C, 90% RH, for 1 h. In addition, there was no enveloped virus inactivation after drying enveloped virus on NTC and treating at 26.7°C at 5, 30, 55, and 80% RH for up to 10 d (data not shown). These data drove the test parameters shown in Figure 1. Although 65°C was greater than the original 60°C temperature goal, 65°C was selected for the experimental design because inactivation at <60°C was too slow to generate RSM that met the <24 h objective. Therefore, 65°C was incorporated in the DOE and 60°C, 70% RH, 5 h, was set as the mid-point for the final DOE in order to obtain sufficient partial kill data to develop the RSM performance envelopes.

TABLE 1
www.frontiersin.org

Table 1. Log10 PFU recovered (survival) and reduction (L.R.) after drying Φ6 on APC coupons (enveloped virus test indicator) and then hot air exposure at 5 or 90% RH for 1 or 24 h.

Overall, there were several thousand trial-and-error data points leading to the HHA decontamination DOE data set in Table 2, which shows data from nineteen test runs with five independent virus preparations per coupon type. There were 475 Φ6 virus test samples and 475 corresponding controls, plus non-inoculated coupon controls. Each test variable (temperature, RH, and time) had an impact on decontamination. Importantly, high RH, high temperature, and longer times increased inactivation rates as expected. Inactivation of enveloped virus dried on to materials was found to be ≥7 log10 at 60°C, 90%, for 9 h. This surpassed the original goal of ≥7 log10 at ≤ 60°C, 24 h. Furthermore, the enveloped virus inoculum held in aqueous solution (solution controls) was shown to be much more sensitive to the rise in temperature than virus dried on to materials and subjected to hot, humid air. Therefore, water and/or high humidity were significant parameters for inactivating enveloped virus.

TABLE 2
www.frontiersin.org

Table 2. Log10 virus survival of Φ6 after drying on to different materials and then exposure to different temperatures, RH, and time according to the DOE in Figure 1.

There was one statistical outlier for APC at 60°C, 50% RH for 5 h (Table 2). The subsequent RSM modeling showed that decontamination kinetics of all materials was essentially the same so long as this data point was treated as an outlier. A full set of tests was not repeated for 60°C, 50% RH, for 5 h because there was no information advantage to update this outlier for this large data set. Much trial and error indicated that APC coupons required 70% ethanol cleaning to remove residue that interfered with microbe recovery and ethanol cleaning was specific to APC; hence, the source of this outlier was likely due to insufficiently cleaned APC coupons.

HHA RSM for Enveloped RNA Virus Inactivation

RSM for each material (Figure 4) were constructed from the DOE Φ6 inactivation data in Table 2. Inactivation of Φ6 virus was similar on all coupon types indicating that material type had little impact on inactivation kinetics. Since virus inactivation was similar across each material, an additional composite RSM was generated (Figure 4). The models more clearly showed virus inactivation kinetics compared to the table data. At 1 h, there was a 90% probability of at least a 7 log10 virus inactivation at 65°C, 90% RH, after virus-contaminated materials were treated with HHA.

FIGURE 4
www.frontiersin.org

Figure 4. Models with a 90% statistical probability of Φ6 virus inactivation after virus was dried on to nylon, polypropylene, wiring insulation, or aircraft performance coating after incubation in hot humid air. Composite models are the accumulation of data for all 4 materials. Areas are represented as >7 log10 (red), 6–7 log10 (orange), 5–6 log10 (gold), 4–5 log10 (yellow), 3–4 log10 (green), 2–3 log10 (dark green), 1–2 log10 (blue), and <1 log10 (dark blue) virus inactivation.

The composite model after 1 h of virus inactivation was critical for directing HHA parameters during the aircraft field testing. The RSM models were calculated using relative humidity because the laboratory environmental chambers controlled humidity using relative humidity. After extensive testing to develop methods and results to develop the RSM models using relative humidity, the sponsoring agencies then requested that relative humidity be converted to dew points for large aircraft testing. Based on a 4 log10 objective and the 4 log10 inactivation parameters in the RSM composite model (Figure 4), relative humidity was converted to dew points. This conversion showed that 4 log10 inactivation occurred at a dew point humidity of ≥59.4°C for 1 h, excluding ramp-up and ramp-down times, so long as the temperature was above the dew point. Therefore, the translation made it apparent that absolute humidity or dew point strongly correlated with inactivation. For example, there was a 90% probability of a 4 log10 kill at ≥61.7°C and a dew point humidity ≥59.4°C. The temperature could go up or down with the same inactivation kinetics so long as the absolute humidity/dew point was maintained. Hence, the inactivation kinetics correlated with the total amount of water in the air. Models with dew points and/or absolute humidity are in the queue for future development.

C-130 Aircraft Field Test

A total of 100 enveloped virus test indicators were distributed at 20 sites throughout a C-130 fuselage as depicted in Figure 2. Based on the RSM in Figure 4 and with a >4 log10 inactivation goal, the HHA goals for the C-130 were ≥61.7°C and a dew point humidity of ≥59.4°C for 1 h, excluding ramp-up and ramp-down times. The measured HHA parameters for the C-130 are shown in Figure 5. For clarity, both RH and dew points are shown in Figure 5 so that the parameters can be compared to both the RSM expressed in RH and the large-scale aircraft objective expressed as a dew point. As shown, the temperature and humidity goals were exceeded. In addition, the ramp-up time was 2.5–3 h, which was longer than lab testing with a ramp-up of 1 h; hence, ramp-up conditions on the aircraft likely contributed to enveloped virus inactivation. Ramp-down time was nearly 2 h, which was also much longer than lab conditions. The total HHA time including ramp-up and ramp-down for the C-130 was 5.5 h compared to 2 h in the lab-based RSM. The C-130 temperatures were always above the dew points so there was no condensation on the virus-inoculated APC samples (Figure 5). Samples were shipped to a lab for extraction. Table 3 shows 8.1 ± 0.1 log10 PFU were recovered on 10 non-shipped control samples and 25 ground-shipped control samples out of 8.3 ± 0.1 log10 PFU dried on to the APC coupons. The loss of 0.2 log10 PFU on the control coupons could have been due to extraction efficiency and/or a small drop in virus viability. In either case, the 8.1 log10 PFU recovery on the control coupons was high, and if validated there was no significant loss of viability during transportation to and from the field site. The detection range was 1.0–8.1 log10. Since the temperature and RH limits were exceeded for a 7 log10 kill and there was no viable virus recovered from any test indicator, there is practical confidence that a complete >8 log10 kill was achieved.

FIGURE 5
www.frontiersin.org

Figure 5. Temperature and humidity profiles during HHA decontamination of a C-130. (A) Temperature (°C) and RH (%) from seven locations (A–G) throughout the C-130. (B) Temperature and dew point (°C) from seven locations (A–G) throughout the C-130. (C) Temperature (°C) and RH (%) logged within two sets of shipping controls (SC).

TABLE 3
www.frontiersin.org

Table 3. Log10 PFU recovered (survival) and reduction (L.R.) after drying 8.3 ± 0.1 log10 of Φ6 per APC coupon (enveloped virus test indicator) and then HHA exposure in a C-130 aircraft.

C-17 Aircraft Field Test

A total of 110 enveloped virus test indicators were distributed throughout the C-17 as depicted in Figure 3. Based on the RSM in Figure 4, results from the C-130 test, and with a >4 log10 inactivation goal, the HHA parameters were set to ≥61.7°C and a dew point humidity of ≥57.2°C for the C-17, at which point a 1-h “hold time” was started. Another goal was to increase the temperature and humidity during the 1 h “hold time” to 61.7°C and a dew point humidity of ≥59.4°C. The measured HHA parameters for the C-17 are shown in Figure 6. For clarity, both RH and dew points are shown in Figure 6 so that the parameters can be compared to both the RSM expressed in RH and the large-scale aircraft objective expressed as a dew point. The temperature reached 65.0°C and humidity reached a 60.6°C dew point, surpassing the temperature and humidity goals during the 1 h hold time. In addition, the ramp-up time was 1.5 h, which saved >1 h compared to the C-130 test, but was 0.5 h longer than lab tests. Ramp-down time was 45 min compared to 2 h for the C-130 and only one min for lab tests. The total HHA time for the C-17 was <3.5 h compared to 5.5 h for the C-130 and 2 h for lab tests. The C-17 temperatures were always above the dew points so there was no condensation on the virus-inoculated APC samples (Figure 6). Samples were ground-shipped to a lab for extraction. Table 4 shows 7.6 ± 0.1 log10 PFU on 10 non-shipped control samples and 25 ground-shipped control samples out of 8.2 ± 0.1 log10 PFU dried on to the APC coupons. The loss of 0.6 log10 PFU on the control coupons could have been due to extraction efficiency and/or a drop in virus viability. In either case, the 7.6 log10 PFU recovery on the control coupons was high and it showed no practical significant loss of virus viability during transportation to and from the field site. The limit of detection was 1.0 log10. Since there was viable PFU from at least one of the 110 test indicators, all samples with no viable PFU were assigned 1.0 log10. Site 15 on the C-17 showed the lowest log reduction of 5.9 ± 0.6 log10 PFU. This site had the most air movement. Although there were no TPP® tubes with temperature and RH readings at Site 15, we speculate that the rapid air movement slowed the penetration of moist air across the 0.2 um membrane of the TPP® tubes, hence the lowest level of inactivation. Every other C-17 location had at least a 6 log10 reduction. Ramp-up/ramp-down times were longer than the lab tests used for RSM, and raising the heat and humidity during the 1 h hold time contributed to the virus inactivation. Hence the goal of >4 log10 reduction was surpassed as predicted by RSM.

FIGURE 6
www.frontiersin.org

Figure 6. Temperature and humidity profiles during HHA decontamination of a C-17. (A) Temperature (°C) and RH (%) from eight locations (A–H) throughout the C-17. (B) Temperature and dew point (°C) from eight locations (A–H) throughout the C-17. (C) Temperature (°C) and RH (%) logged within two sets of shipping controls (SC).

TABLE 4
www.frontiersin.org

Table 4. Log10 PFU recovered (survival) and reduction (L.R.) after drying 8.2 ± 0.1 log10 of Φ6 per APC coupon (enveloped virus test indicator) and then HHA exposure in a C-17 aircraft.

Discussion

Φ6 was selected as a BSL-1, enveloped RNA virus test indicator for both lab and field tests. Φ6 has been widely used as an enveloped virus surrogate (de Carvalgo et al., 2017). The structural similarity of Φ6 to many other enveloped viruses including coronaviruses suggest that the Φ6 structure should be similarly susceptible to general decontaminants. Furthermore, the structural molecules of the virus are produced by host cells with similar temperature sensitivity at around 40°C, further suggesting that Φ6 should be similarly susceptible to general decontaminants.

For this study, virus was dried ≥24 h before exposing to the environmental test conditions because (1) the level of virus drying/level of free water was an important consideration for standardizing these tests and ≥24 h drying mitigated drying variability and (2) ≥24 h drying was done in attempt to mimic environments where free water is limited, especially for virus bound in debris. There was no Φ6 inactivation after the virus was dried on different surfaces for at least 24 h at RT followed by a 10-d exposure to 26.7°C at 80% RH, and there was only 2.4 log10 inactivation at 70°C, 5% RH, for 24 h. This is a higher level of temperature and humidity stability than reported in other enveloped virus studies, but none of the articles we reviewed tested virus that was dried for at least 24 h. A review of articles describing enveloped virus stability to temperature and/or humidity, including coronavirus, showed that most stability tests were with wet virus or virus that was only dried for an hour. Sizun et al. (2000), Rabenau et al. (2005), and Chan et al. (2011) tested similar coronaviruses including dried SARS-CoV, CoV-229E, and CoV-OC-43 at different virus concentrations, virus purities, additives such as fetal calf serum, and fomites, but all the tests were at ambient environmental conditions of 21–25°C, which contrasts with no virus inactivation at 26.7°C, 80% RH, 10 d in this study. Complete virus inactivation ranged from 3 h up to 13 d across these reports. Numerous published reports for enveloped virus stability have tested wet virus preparations (e.g., Anonymous–Department of Homeland Security, 2020; Biryukov et al., 2020; Castaño et al., 2020; Harbourt et al., 2020; Matson et al., 2020; Ren et al., 2020) and also showed much higher sensitivity to temperature and RH than reported in the current study. While there are numerous differences in methods and results described across these studies, a key difference in the testing described herein was that virus was dried at least 24 h before exposing to the environmental test conditions and that may be a key variable for virus stability.

There is general agreement in the literature that higher temperature and humidity will increase the inactivation rates for enveloped virus. However, a direct side-by-side study would eliminate the impact of methods to define temperature and humidity profiles. This would also highlight physiochemical similarities/differences inherent to a specific virus or common to virus families (Nims and Plavsic, 2013; Castaño et al., 2020). Side-by-side testing comparing dried Φ6 to several dried coronaviruses, including Φ6 SARS-CoV-2, are moving forward in our lab. Once these data are collected, a more standardized comparison can be made between the temperature and humidity susceptibility among these enveloped viruses.

There are numerous mathematical tools that can be used to analyze decontamination data. RSM models were very useful here since they provided simplified graphical data to rapidly adjust to changing goals for log reduction, time, temperature, and humidity. This became very important since the HHA goals (requirements) were frequently redefined by end users (aircraft maintenance authorities at Aircraft Mobility Command) over the past 20 years, and numerous goal changes were directed during the COVID-19 pandemic. The original goals were to show enveloped virus inactivation of ≥7 log10 out of a ≥8 log10 challenge. This challenge level was set because measurements with high concentrations of microbes greatly increased the confidence in inactivation and it mitigated the risk of incomplete decontamination (Hamilton et al., 2013), an important consideration for decision makers that assess contamination/decontamination. High challenge levels are important since exposure limits (infectious dosages) are not well-defined for many viruses such as SARS-CoV and SARS-CoV-2. Although HHA does not fall under the EPA's regulatory jurisdiction because it is not classified as a chemical disinfectant, the inactivation goal was reduced from 7 log10 to 3 log10 inactivation by the funding agencies during the COVID-19 pandemic to match the EPA N-list for decontaminants and provide decontaminant options to end users. The HHA RSM showed 90% probability levels of inactivation for log reductions of 0 through 7 log10, which allowed for rapid adjustments during the aircraft testing.

There were originally no time limitations set for aircraft sterilization (spore decontamination). The HHA time goal was reduced to ≤ 24 h for enveloped virus to increase HHA throughput and user acceptance. The time goal was further reduced by the end users and funding agencies to “1 h hold time; <6 h total time” after the COVID-19 pandemic had begun.

The HHA temperature goal was originally capped at the accepted temperature limit of C-130 aircraft (80°C), but that was for sterilization (spore decontamination). The HHA temperature goal was reduced to 60°C for the enveloped virus to increase HHA acceptance over a range of aircraft since 60°C is a standard, accepted test temperature for most aircraft materials. The time goal of ≤ 24 h provided the rationale for measuring HHA over several hours to develop RSM models. However, the end users and funding agencies raised the accepted temperature limit to 68.3°C during COVID-19 to reduce decontamination time.

Although there was a strong preference to reduce/eliminate humidity from HHA to reduce cost and complexity, all of the experimental data here showed that Φ6 was stable after drying. Virus was quickly inactivated after it was diluted in aqueous solutions and heated (solution control data). For HHA, the combination of high heat and high humidity, i.e., a high dew point, was critical to virus inactivation on materials in hour-long timeframes. This is consistent with long-known observations that enveloped virus is stabilized after drying on fomites. As an example, the enveloped virus smallpox was stabilized after it peeled/sloughed along with host cells and then dried on porous materials including clothes and blankets. Furthermore, historic data shows that enveloped viruses were stabilized in cold, dry climates (Fenn, 2001).

The end goal of the RSM was simplistic graphs where all decontamination test variables could be compared, understood, and utilized for field testing and field application. This was particularly useful for large hot, humid air decontamination systems with fluctuating temperature and RH, potential power disruptions, and decontamination goals that have fluctuated widely over time. Since the RSM models showed little difference in inactivation kinetics among the different materials, a composite RSM was developed as a primary reference guide. This reference guide served the purpose of guiding HHA field testing in aircraft. The RSM models translated to field demonstrations because there was a ≥5.9 log10 enveloped virus inactivation after both aircraft field tests, as predicted. The RSM models were also used as a guide for a number of iterative improvements between the first and second aircraft demonstration that shortened the overall HHA decontamination time from 5.5 to <3.5 h.

There were numerous conclusions. The Φ6 test indicators were useful measurements of inactivation for both lab and field testing. HHA successfully inactivated enveloped virus at high temperature and high humidity. The RSM models were adaptable to changes in user requirements and successfully utilized to predict HHA results for field applications. Much methods development and testing remains to confirm HHA inactivation kinetics across virus species, and to develop HHA models that include HHA ramp-up and ramp-down times. Lastly, HHA decontamination of aircraft was successful because the enveloped virus on the C-17 aircraft was inactivated, the aircraft was flown after the HHA field test, and then the C-17 was certified as an operational aircraft.

Data Availability Statement

All datasets generated for this study are included in the article/supplementary material.

Author Contributions

TB was the principal investigator and the principal for methods development, test design, execution analysis, and writing. AY was a lead tester and contributed to methods development test design, execution, and data assembly. EB-K, NK, ZM, MBo, and EO participated in methods development, test design, test execution, and data assembly. SH, MK, MH, CM, RM, JI, MBe, BG, VY, SL, EH, and BL contributed to test execution and data assembly. HB was the math modeler. All team members participated or contributed to writing, figures, tables, and/or editing.

Funding

This work was supported through funding provided by the Defense Threat Reduction Agency (DTRA), Hazard Mitigation Capability Area (BA2 and 3 funds, Project Number CB10141), and Joint Program Executive Office CBRND/Joint Program Manager-CBRN Protection/Joint Biological Agent Decontamination System Program (JBADS).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

Thanks are due to Dr. Tabitha Newman for technical support. The aircraft demonstration events involved a consortium of supporters including DTRA, JPEO-CBRND, Aeroclave, LLC, Air Force, Air Mobility Command, United States Transportation Command, Naval Surface Warfare Center—Dahlgren Division, Air Force Research Lab, METSS Corporation, CCDC, and Dover Air Force Base. This manuscript has been released as a pre-print at bioRxiv (Buhr et al., 2020).

Abbreviations

RSM, response surface methodology; HHA, hot humid air; APC, aircraft performance coating; PFU, plaque-forming units; RH, relative humidity; HB010Y, P. syringae pathovar phaseolicola; TSA, tryptic soy agar; TSB, tryptic soy broth; HEPES, 4-(2-hydroxyethyl)-1-piperazineethanesulfonic acid; DOE, design of experiment; NTC, naval topcoat; SF, survival fraction; GMSF, geometric mean survival fraction; GSD, geometric standard deviation; TPP©, Techno plastic products.

References

Anonymous–Department of Homeland Security (2020). Estimated Natural Decay of SARS-CoV-2 (Virus That Causes COVID-19) on Surfaces Under a Range of Temperatures and Relative Humidity. Available online at: https://www.dhs.gov/science-and-technology/sars-calculator#:~:text=COVID%20Stability%3A&text=Relative%20Humidity%20and%20Temperature%20can,Humidity%20between%2020%2D60%25 (accessed June 1, 2020).

Beauregard, M. R., Mikulak, R. J., and Olson, B. A. (1992). A Practical Guide to Statistical Quality Improvement, Opening up the Statistical Toolbox. New York, NY: Van Nostrand Reinhold, 351–360.

Biryukov, J., Boydston, J. A., Dunning, R. A., Yeager, J. J., Wood, S., Reese, A. L., et al. (2020). Increasing temperature and relative humidity accelerates inactivation of SARS-CoV-2 on surfaces. mSphere 5:e00441-20. doi: 10.1128/mSphere.00441-20

PubMed Abstract | CrossRef Full Text | Google Scholar

Bishop, A. H., and Robinson, C. V. (2014). Bacillus thuringiensis HD-1 cry-: development of a safe non-insecticidal simulant for bacillus anthracis. J. Appl. Microbiol. 117, 654–662. doi: 10.1111/jam.12560

PubMed Abstract | CrossRef Full Text | Google Scholar

Buhr, T., Young, A., Bensman, M., Minter, Z., Kennihan, N., Johnson, C., et al. (2016). Hot, humid air decontamination of a C-130 aircraft contaminated with spores of two acrystalliferous Bacillus thuringiensis strains, surrogates for Bacillus anthracis. J. Appl. Microbiol. 120, 1074–1084. doi: 10.1111/jam.13055

PubMed Abstract | CrossRef Full Text | Google Scholar

Buhr, T., Young, A. A., Barnette, H., Minter, Z. A., Kennihan, N., McPherson, D. C., et al. (2015). Test methods and response surface models for hot, humid air decontamination of materials contaminated with dirty spores of Bacillus anthracis ΔSterne and B. thuringiensis Al Hakam. J. Appl. Microbiol. 119, 1263–1277. doi: 10.1111/jam.12928

PubMed Abstract | CrossRef Full Text | Google Scholar

Buhr, T., Young, A. A., Johnson, C. A., Minter, Z., and Wells, C. (2014). Decontamination of materials contaminated with Francisella philomiragia or MS2 bacteriophage using PES-Solid, a solid source of peracetic acid. J. Appl. Microbiol. 117, 397–404. doi: 10.1111/jam.12540

PubMed Abstract | CrossRef Full Text | Google Scholar

Buhr, T. L., Young, A. A., Borgers-Klonkowski, E., Kennihan, N. L., Barnette, H. K., Minter, Z. A., et al. (2020). Hot, humid air decontamination of aircraft confirmed that high temperature and high humidity are critical for inactivation of infectious, enveloped ribonucleic acid (RNA) virus. bioRxiv [Preprint]. 1–29. doi: 10.1101/2020.07.20.212365

CrossRef Full Text | Google Scholar

Buhr, T. L., Young, A. A., Minter, Z. A., and Wells, C. M. (2012). Test method development to evaluate hot, humid air decontamination of materials contaminated with Bacillus anthracis ΔSterne and B. thuringiensis Al Hakam spores. J. Appl. Microbiol. 113, 1037–1051. doi: 10.1111/j.1365-2672.2012.05423.x

CrossRef Full Text | Google Scholar

Castaño, N., Cordts, S., Jalil, M. K., Zhang, K., Koppaka, S., and Bick, A. (2020). Fomite transmission and disinfection strategies for SARS-CoV-2 and related viruses. arXiv.2005.11443 [q-bio.OT]. 1–24.

Google Scholar

Centers for Disease Control Prevention (2019). Interim Guidance for Ebola Virus Cleaning, Disinfection and Waste Disposal in Commercial Passenger Aircraft. Available online at: https://www.cdc.gov/vhf/ebola/prevention/cleaning-commercial-passenger-aircraft.html (accessed May 15, 2020).

Chan, K. H., Malik Peiris, J. S., Lam, S. Y., Poon, L. L. M., Yuen, K. Y., Seto, W. H., et al. (2011). The effects of temperature and relative humidity on the viability of the SARS coronavirus. Adv. Virol. 2011:734690. doi: 10.1155/2011/734690

CrossRef Full Text | Google Scholar

de Carvalgo, N. A., Stachler, E. N., Cimabue, N., and Bibby, K. (2017). Evaluation of Phi6 persistence and suitability as an enveloped virus surrogate. Environ. Sci. Technol. 51, 8692–8700. doi: 10.1021/acs.est.7b01296

PubMed Abstract | CrossRef Full Text | Google Scholar

Fenn, E. A. (2001). Pox Americana: The Great Smallpox Epidemic of 1775-82. New York, NY: Hill and Wang.

PubMed Abstract

Gallandat, K., and Lantagne, D. (2017). Selection of a biosafety level 1 (BSL-1) surrogate to evaluate surface disinfection efficacy in ebola outbreaks: comparison of four bacteriophages. PLoS ONE 12:e0177943. doi: 10.1371/journal.pone.0177943

PubMed Abstract | CrossRef Full Text | Google Scholar

Hamilton, M., Hamilton, G., Goeres, D., and Parker, A. (2013). Guidelines for the statistical analysis of a collaborative study of a laboratory disinfectant product performance test method. JAOAC Inte. 96, 1138–1151. doi: 10.5740/jaoacint.12-217

CrossRef Full Text | Google Scholar

Harbourt, D., Haddow, A., Piper, A., Bloomfield, H., Kearney, B., Gibson, K., et al. (2020). Modelling the stability of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) on skin, currency, and clothing. medRXiv [Preprint]. 1–18. doi: 10.1101/2020.07.01.20.20144253

CrossRef Full Text | Google Scholar

Lenth, R. V. (2009). Response-surface methods in R, using rsm. J. Stat. Softw. 32, 1–17. doi: 10.18637/jss.v032.i07

CrossRef Full Text | Google Scholar

Matson, M. J., Yinda, C. K., Seifert, S. N., Bushmaker, T., Fischer, R., van Doremalen, N., et al. (2020). Effect of environmental conditions on SARS-CoV-2 stability in human nasal mucus and sputum. Emer. Infect. Dis. 26, 2276–2278. doi: 10.3201/eid2609.202267

PubMed Abstract | CrossRef Full Text | Google Scholar

McDonnell, G., and Burke, P. (2011). Disinfection: is it time to reconsider Spaulding? J. Hosp. Inf. 78, 163–170. doi: 10.1016/j.jhin.2011.05.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Mindich, L. (2004). Packaging, replication and recombination of the segmented genomes of bacteriophage Φ6 and its relatives. Virus Res. 101, 83–92. doi: 10.1016/j.virusres.2003.12.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Myers, R. H., Montgomery, D. C., and Anderson-Cook, C. M. (2009). Response Surface Methodology. Hoboken, NJ: John Wiley & Sons, Inc.

Google Scholar

National Business Aviation Association (2020). Aircraft Disinfection for the Coronarvirus. Available online at: https://nbaa.org/aircraft-operations/safety/coronavirus/aircraft-disinfection-coronavirus/ (accessed May 15, 2020).

Google Scholar

Nims, R. W., and Plavsic, M. (2013). Intra-family and inter-family comparisons for viral susceptibility to heat inactivation. J. Microbial biochem. Tech. 5, 136–141. doi: 10.4172/1948-5948.1000112

CrossRef Full Text

Rabenau, H. F., Cinatl, J., Morgenstern, B., Bauer, G., Preiser, W., and Doerr, H. W. (2005). Stability and inactivation of SARS coronavirus. Med. Microbiol. Immunol. 194, 1–6. doi: 10.1007/s00430-004-0219-0

CrossRef Full Text | Google Scholar

Ren, S.-Y., Wang, W.-B., Hao, Y.-G., Zhang, H.-R., Wang, Z.-C., Chen, Y.-L., et al. (2020). Stability and infectivity of coronaviruses in inanimate environments. World J Clin Cases. (2020) 8:1391–9. doi: 10.12998/wjcc.v8.i8.1391

PubMed Abstract | CrossRef Full Text | Google Scholar

Sizun, J., Yu, M. W., and Talbot, P. J. (2000). Survival of human coronaviruses 229E and OC43 is suspension and after drying on surfaces: a possible source of hospital-acquired infections. J. Hosp. Infect. 46, 55–60. doi: 10.1053/jhin.2000.0795

PubMed Abstract | CrossRef Full Text | Google Scholar

Spaulding, E. H. (1957). Chemical disinfection and antisepsis in the hospital. J. Hosp. Res. 9, 5–31.

Google Scholar

Van Etten, J., Lane, L., Gonzalez, C., Partridge, J., and Vidaver, A. (1976). Comparative properties of bacteriophage phi6 and phi6 nucleocapsid. J. Virol. 18, 652–658. doi: 10.1128/JVI.18.2.652-658.1976

PubMed Abstract | CrossRef Full Text | Google Scholar

Vidaver, A. K., Roski, R. K., and Van Etten, J. L. (1973). Bacteriophage phi6: a lipid-containing virus of Pseudomonas phaseolicola. J. Virol. 11, 799–805. doi: 10.1128/JVI.11.5.799-805.1973

PubMed Abstract | CrossRef Full Text | Google Scholar

Wiggington, K. R., Pecson, B. M., Sigstam, T., Bosshard, F., and Kohn, T. (2012). Virus inactivation mechanisms: impact of disinfectants on virus function and structural integrity. Environ. Sci. Technol. 46, 12069–12078. doi: 10.1021/es3029473

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: Φ6, enveloped virus, decontamination, hot humid air, aircraft

Citation: Buhr TL, Young AA, Borgers-Klonkowski E, Kennihan NL, Barnette HK, Minter ZA, Bohmke MD, Osborn EB, Hamilton SM, Kimani MB, Hammon MW, Miller CT, Mackie RS, Innocenti JM, Bensman MD, Gutting BW, Lilly SD, Hammer EE, Yates VL and Luck BB (2020) Hot, Humid Air Decontamination of Aircraft Confirmed That High Temperature and High Humidity Are Critical for Inactivation of Infectious, Enveloped Ribonucleic Acid (RNA) Virus. Front. Bioeng. Biotechnol. 8:592621. doi: 10.3389/fbioe.2020.592621

Received: 07 August 2020; Accepted: 17 September 2020;
Published: 23 October 2020.

Edited by:

Stephen Allen Morse, Centers for Disease Control and Prevention (CDC), United States

Reviewed by:

Raymond Whiting Nims, RMC Pharmaceutical Solutions, Inc., United States
Dana Mitzel, Agricultural Research Service, United States

Copyright © 2020 Buhr, Young, Borgers-Klonkowski, Kennihan, Barnette, Minter, Bohmke, Osborn, Hamilton, Kimani, Hammon, Miller, Mackie, Innocenti, Bensman, Gutting, Lilly, Hammer, Yates and Luck. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Tony L. Buhr, tony.buhr@navy.mil

Download