ORIGINAL RESEARCH article

Front. Immunol., 06 September 2023

Sec. Viral Immunology

Volume 14 - 2023 | https://doi.org/10.3389/fimmu.2023.1178520

Comprehensive profiling of pre-infection antibodies identifies HIV targets associated with viremic control and viral load

  • 1. Department of Pathology, Johns Hopkins University School of Medicine, Baltimore, MD, United States

  • 2. Institute for Cell Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, United States

  • 3. Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, United States

  • 4. Statistical Center for HIV/AIDS Research and Prevention, Fred Hutchinson Cancer Research Center, Seattle, WA, United States

  • 5. Zambart, University of Zambia School of Public Health, Lusaka, Zambia

  • 6. Clinical Research Department, London School of Hygiene and Tropical Medicine, London, United Kingdom

  • 7. Desmond Tutu TB Center, Department of Paediatrics and Child Health, Stellenbosch University, Western Cape, South Africa

  • 8. FHI 360, Durham, NC, United States

  • 9. Department of Infectious Disease, Imperial College London, London, United Kingdom

  • 10. Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, United Kingdom

  • 11. Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, United States

  • 12. Quantitative Sciences Division, Department of Oncology, Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins University School of Medicine, Baltimore, MD, United States

  • 13. Laboratory of Immunoregulation, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Baltimore, MD, United States

Abstract

Background:

High HIV viral load (VL) is associated with increased transmission risk and faster disease progression. HIV controllers achieve viral suppression without antiretroviral (ARV) treatment. We evaluated viremic control in a community-randomized trial with >48,000 participants.

Methods:

A massively multiplexed antibody profiling system, VirScan, was used to quantify pre- and post-infection antibody reactivity to HIV peptides in 664 samples from 429 participants (13 controllers, 135 viremic non-controllers, 64 other non-controllers, 217 uninfected persons). Controllers had VLs <2,000 copies/mL with no ARV drugs detected at the first HIV-positive visit and one year later. Viremic non-controllers had VLs 2,000 copies/mL with no ARV drugs detected at the first HIV-positive visit. Other non-controllers had either ARV drugs detected at the first HIV-positive visit (n=47) or VLs <2,000 copies/mL with no ARV drugs detected at only one HIV-positive visit (n=17).

Results:

We identified pre-infection HIV antibody reactivities that correlated with post-infection VL. Pre-infection reactivity to an epitope in the HR2 domain of gp41 was associated with controller status and lower VL. Pre-infection reactivity to an epitope in the C2 domain of gp120 was associated with non-controller status and higher VL. Different patterns of antibody reactivity were observed over time for these two epitopes.

Conclusion:

These studies suggest that pre-infection HIV antibodies are associated with controller status and modulation of HIV VL. These findings may inform research on antibody-based interventions for HIV treatment.

Introduction

High HIV viral load (VL) is associated with increased transmission risk and faster disease progression. HIV controllers have low VLs without antiretroviral treatment (ART; elite controllers: <50 copies/mL; viremic controllers: <2,000 copies/mL) (). HIV control develops early in infection (, ) and is associated with improved health outcomes (, ). Understanding the factors that lead to HIV control may inform the design of therapeutic HIV vaccines and antibody-based treatment strategies.

Many HIV controllers are infected with replication-competent viruses (, ) suggesting that host factors play a role in HIV control. Control is associated with class I HLA-B*57 and HLA-B*27 alleles (), suggesting a role for CD8+ T cell responses. CD8+ T cell depletion in non-human primate models of elite control leads to viral rebound (). Controllers also have more effective HIV-specific CD8+ T cell responses than non-controllers (, ) with increased cytotoxicity toward infected cells (). Humoral immunity was initially not thought to play a major role in HIV control because early research described controllers with low titers of HIV-specific antibodies () and neutralizing antibodies (nAb) (, ), consistent with reduced antigen exposure. However, subsequent studies demonstrated higher levels of antibody dependent cellular cytotoxicity (ADCC) () and potent broadly neutralizing antibody (bnAb) responses (, ) in a subset of controllers. Antibody isotype diversity and polyfunctionality are also associated with control (, ). Using a massively multiplexed antibody profiling system (VirScan), we previously identified seven primary antibody targets in HIV controllers with established infection ().

HIV-specific antibody responses develop in some persistently uninfected persons after viral exposure. In female sex workers, these antibodies exhibit cross-clade viral neutralization activity () and may () or may not () be associated with resistance to subsequent infection. In men who have sex with men, nAbs can develop following repeated oral HIV exposure (, ). Pre-existing ADCC in exposed infants is associated with lower rates of HIV acquisition (, ) and reduced morbidity after infection (). The role of pre-infection antibodies in HIV control has not been explored.

Logistical barriers have hampered efforts to define the role of pre-existing HIV exposure-induced or cross-reactive immunity in HIV control. HIV control is typically identified in persons with established infection (, , ). Most studies include small numbers of controllers and lack pre-infection samples from controllers. A very large longitudinal study is required to identify a cohort of seroconverters who meet the criteria for HIV control and have pre-infection samples available for analysis.

The HPTN 071 (PopART) trial enrolled >48,000 participants in Zambia and South Africa (). Participants were followed for up to three years with annual HIV testing and sample storage; 978 seroconverters were identified in the enrolled cohort (). In this report, we used VirScan to compare pre-infection antibody reactivity in HIV controllers and viremic non-controllers in HPTN 071.

Methods

Source of samples

This study used samples and data from HPTN 071 (PopART) (NCT 019000977) (). The trial was conducted in 21 urban communities in Zambia and South Africa (), where HIV subtype C is predominant (). The trial enrolled a population cohort of >48,000 adults (ages 18-44), randomly selected from each community, and demonstrated that population-level delivery of a combination HIV prevention package that included universal HIV testing, linkage to care and immediate offer of ART, was associated with reduced HIV incidence (). Plasma samples were collected at annual visits from enrolled participants. VirScan was used to analyze antibody profiles in a subset of the 978 seroconverters identified in this trial. Antibody profiles were also characterized for a subset of participants who were uninfected at all study visits; participants in this group reported 0-1 lifetime sexual partners and were matched to the seroconverter group based on gender, age, and study community.

Laboratory methods

Laboratory testing was performed at the HPTN Laboratory Center (Johns Hopkins University, Baltimore, MD). HIV status was determined at each study visit (). Pre-infection samples additionally had no RNA detected using an assay with a limit of detection (LOD) of 400 copies/mL (); the same assay was used to measure VL in samples collected at HIV-positive visits. VL values for HIV-positive samples with no RNA detected or RNA detected below the LOD were set at 399 copies/mL. Samples were analyzed for the presence of ARV drugs using a qualitative assay that detects 22 ARV drugs in five classes (LOD: 2 ng/mL or 20 ng/mL, depending on the drug) ().

Samples were also analyzed using VirScan (, ). VirScan is a multiplexed phage-display assay that provides quantitative data for antibody binding to displayed peptides (56 amino acids long with 28 amino acid overlaps) (, ). The VirScan library includes peptides that span the genomes of >200 viruses that infect humans, including >3,300 peptides from multiple HIV subtypes and strains (, ). After sample incubation with the phage library, antibody-bound phage were immunoprecipitated using magnetic beads coated with protein A and protein G. Peptide-encoding DNA present in immunoprecipitated phage was amplified by polymerase chain reaction (PCR) using primers with sample-specific barcodes. PCR products were sequenced using the NovaSeq 6000 instrument with the S2 flowcell (Illumina, San Diego, CA) to determine the amino acid sequences of peptides bound by antibodies in study samples.

VirScan data analysis

Longitudinal samples for each participant were included on the same 96-well immunoprecipitation plate. Each plate included 7-8 mock reactions (beads only; negative controls) and a positive control sample in triplicate (pooled plasma from 10 HPTN 071 participants with infection duration >2 years and VL >2,000 copies/mL). Antibody reactivity data for individual peptides were reported as raw read counts, fold change values (compared to read counts in observed mock reactions), and associated p-values. Raw read counts for each peptide were determined via exact matching of the first 50 nucleotides of peptide coding DNA, with one added read count for each peptide. Fold changes and p-values were determined using the exact test for the negative binomial distribution implemented in the edgeR package (, 42). Fold change values were set at one under the following conditions: read count <15, fold change <3, and/or p-value >0.001. After adjustment, fold change values >1 indicated significant antibody binding. Z-statistics were calculated by transforming p-values.

Viral aggregate reactivity scores (VARscores) are a measure of the overall level and breadth of antibody reactivity across a viral genome. In this study, VARscores and associated p-values were calculated by comparing mean log2 fold change values for virus specific peptides to distributions of expected mean log2 fold change values for randomly selected peptides in VirScan (43). Viruses that had a VARscore greater than an empirically defined cutoff and a p-value below a Bonferroni-corrected cutoff were considered significant targets of an antibody response. Scores were calculated iteratively; in each iteration, peptides from all viruses in genera with a significantly targeted virus were removed from the pool of peptides used to generate random distributions. This process was performed a maximum of 10 iterations or until no new viruses met the reactivity thresholds. When comparing VARscores for participants with reactivity to specific peptides, those peptides were excluded from the calculation. HIV-1 VARscores were calculated as the mean VARscore across all HIV-1 subtypes.

Statistical methods

Statistical analysis of peptide-level antibody reactivity between participant groups was performed using t-tests. Observed p-values were used to calculate multiple comparison corrected q-values to control the false discovery rate; q-values <5% were considered statistically significant (44). Alternatively, peptides of interest were selected from a cluster of peptides with observed differential reactivity (mean z-statistic for group A >1, mean z-statistic for group B <1, mean z-statistic for group A >2x that for group B). Likely antibody epitopes represented by overlapping peptides with differential reactivity were identified with epitopefindr v1.1.30 (45). Epitope reactivity was determined by selecting the maximum reactivity to any peptide with the epitope. Epitope visualization on the env trimer structure (PDB ID: 6VRW) (46) was performed with PyMOL v2.0 (47); epitope sequences from UniProt ID P04583 were aligned to the 6VRW sequence to define epitope position on the structure. VL and fold change values were log10-transformed prior to statistical analysis. Univariate analyses were performed using Fisher’s exact test for categorical variables or the t-test for continuous variables; paired t-tests were used for longitudinal analysis of continuous variables. Correlation analyses were performed using Pearson’s method. Statistical analyses were performed using R v4.1.2 (48). Data were visualized using ggplot2 v3.3.6 (49).

Study approval

HPTN 071 (PopART) study participants provided written informed consent prior to enrollment. The study was approved by the institutional review boards and ethics committees at the London School of Hygiene and Tropical Medicine, the University of Zambia, and Stellenbosch University.

Results

Study cohort

Previous analyses identified 978 seroconverters in the HPTN 071 trial (). The approach used to identify participants for inclusion in this report is shown in Figure 1. Viral load and ARV drug testing were used to determine controller status for a subset of seroconverters (n=585) who were selected based on seroconversion timing and availability of samples required for analysis. Participants were classified as controllers if they had a VL <2,000 copies/mL with no ARV drugs detected at the first HIV-positive visit (baseline; infection duration 0-1 years) and the second HIV-positive visit (follow-up; infection duration 1-2 years). This approach for classifying controllers is consistent with criteria used in prior studies (, , 50). Participants were classified as viremic non-controllers if they had a VL 2,000 copies/mL with no ARV drugs detected at baseline. The final cohort for the main analyses described in this report included 148 seroconverters, including 13 controllers and 135 viremic non-controllers. Some analyses described in the Supplemental File included an additional 47 participants who were suppressed on ART at baseline (VL <400 copies/mL), 17 non-controllers with natural suppression at baseline only (VL <2,000 copies/mL, no ARV drugs detected), and a matched control group of 217 participants who remained uninfected throughout the study.

Figure 1

Association between pre-infection antibody reactivity and HIV controller status

We used VirScan to compare pre-infection antibody reactivity for the 13 controllers and 135 viremic non-controllers. Both groups had low-level antibody binding to HIV peptides across the genome (Figures 2A, B). Two clusters of peptides were identified that had differential reactivity in these two participant groups. One cluster of nine overlapping peptides had higher levels of antibody reactivity in viremic non-controllers (V cluster); each of the individual peptides in this cluster had significantly higher mean antibody reactivity in the viremic non-controller group (q<0.05; p ≤ 0.000151; Figure 3). A second cluster of 12 overlapping peptides had higher mean levels of antibody reactivity in controllers (C cluster). The individual peptides in this cluster did not have significantly different antibody binding in the two groups after multiple testing correction, but had higher antibody reactivity in the controller group when the analysis was based on observed differences in z-statistics; this likely reflected the small number of controllers included in the analysis who had reactivity to these peptides.

Figure 2

Figure 3

The peptides in each cluster contained a common epitope (Figures 2C, D; Supplemental File 2). Peptides in the C cluster shared an epitope in the C-terminal heptad repeat region (HR2) of gp41 (C epitope). Peptides in the V cluster shared an epitope in the second constant (C2) region of gp120 (V epitope). Pre-infection reactivity to the C epitope (adjusted fold change >1) was observed more frequently among controllers vs. viremic non-controllers (3/13 [23.1%] vs. 5/135 [3.7%], p=0.023). Pre-infection reactivity to the V epitope was not observed among controllers but was common among viremic non-controllers (0/13 [0.0%] vs. 43/135 [31.9%], p=0.011). We did not find any sequences with homology to the C or V epitopes using BLAST, aside from HIV-1 and simian immunodeficiency virus (SIV) sequences (51).

Association between broad pre-infection antibody reactivity to HIV peptides and HIV controller status

We next compared the depth and breadth of antibody reactivity to HIV peptides across the viral genome in the 13 controllers and 135 viremic non-controllers. This analysis was performed using an aggregate measure of antibody reactivity (VARscore); higher VARscores (generally >1) indicate prior viral exposure (52). Mean HIV-1 VARscores were low in both groups (controllers: 0.24, viremic non-controllers: 0.18, p=0.533; Supplemental File 3), consistent with their HIV-uninfected status.

Association between broad pre-infection antibody reactivity to HIV and C or V epitope reactivity

We next compared pre-infection HIV-1 VARscores for participants with vs. without pre-infection reactivity to the C or V epitope (adjusted fold change >1 vs. adjusted fold change = 1; Figure 4). For this analysis, HIV-1 VARscores were calculated after removing VirScan data for peptides with the relevant epitope (C or V). First, we compared VARscores for participants with (n=8) vs. without (n=140) pre-infection reactivity to the C epitope. Participants with pre-infection reactivity to the C epitope had higher mean HIV-1 VARscores (reactive: 0.75, not reactive: 0.15, p=0.0063); this suggests that reactivity to the C epitope may have been induced by prior HIV exposure. Next, we compared VARscores for participants with (n=43) vs. without (n=105) pre-infection reactivity to the V epitope. HIV-1 VARscores were low in both groups with no difference between groups (reactive: 0.23, not reactive: 0.15, p=0.058); this suggests that reactivity to the V epitope may not have been induced by prior HIV exposure.

Figure 4

Changes in antibody reactivity to the C and V epitopes after HIV infection

We next compared antibody reactivity to the C and V epitopes at the pre-infection visit and the first HIV-positive visit (baseline, infection duration 0-1 year). VirScan data were available at baseline for 145/148 participants, including 7/8 participants with pre-infection reactivity to the C epitope and 42/43 participants with pre-infection reactivity to the V epitope. (Supplemental File 4). VirScan data were available at follow-up for 86/148 participants, including 7/8 participants with pre-infection reactivity to the C epitope and 26/43 participants with preinfection reactivity to the V epitope.

At baseline, almost all participants (143/145 [98.6%]) had C epitope reactivity; this included all seven participants with pre-infection reactivity to this epitope (Supplemental File 5A). Reactivity to this epitope (mean fold change) increased at baseline for the seven participants with pre-infection reactivity (pre-infection: 10.3, baseline: 29.1, p=0.0041). Mean baseline reactivity was similar for participants with vs. without pre-infection reactivity (reactive at pre-infection: 29.1, not reactive at pre-infection: 22.2, p=0.059). We then evaluated reactivity to the C epitope at follow-up (infection duration 1-2 years) when infection was more established. At follow-up, all 86 participants had reactivity to the C epitope, including all seven participants with pre-infection reactivity (Figure 5A). Mean reactivity was higher at follow-up than pre-infection for participants with pre-infection reactivity (pre-infection: 10.3, follow-up: 42.5, p=0.00036). Mean reactivity was also higher at follow-up for those with vs. without pre-infection reactivity (reactive at pre-infection: 42.5, not reactive at pre-infection: 25.9, p=0.0088). The findings from analysis of data from the baseline and follow-up visits are consistent with results from the VARscore analysis, indicating that HIV exposure induces and boosts expression of C epitope antibodies.

Figure 5

Different patterns of antibody reactivity were observed for the V epitope. Only 37/145 (25.5%) participants had reactivity to the V epitope at baseline (Supplemental File 5B); most (32/37 [86.5%]) of these participants also had pre-infection reactivity to this epitope. Ten additional participants with pre-infection reactivity to the V epitope were no longer reactive to this epitope at baseline. There was no increase in V epitope reactivity (mean fold change) after infection for the 32 participants who had V epitope reactivity at both visits (pre-infection: 6.4, baseline: 6.1, p=0.33). We also observed no difference in mean baseline reactivity for participants with vs. without pre-infection reactivity (reactive at pre-infection: 6.1, not reactive at pre-infection: 6.8, p=0.68). Furthermore, only 18/86 (20.9%) participants had reactivity to the V epitope at follow-up, including 15 participants with pre-infection reactivity (Figure 5B). An additional 11 participants with pre-infection reactivity did not have reactivity to this epitope at follow-up. Mean reactivity was unchanged at follow-up (vs. pre-infection) for the 15 participants with reactivity at both visits (pre-infection: 6.5, follow-up: 7.3, p=0.68), and there was no difference in mean follow-up reactivity for participants with vs. without pre-infection reactivity (reactive at pre-infection: 7.3, not reactive at pre-infection: 7.2, p=0.58). These findings are consistent with results from the VARscore analysis, indicating that expression of V epitope antibodies is not induced or boosted by HIV exposure or HIV infection.

Association between antibody reactivity to the C and V epitopes and viral load

We next evaluated whether pre-infection reactivity to the C and V epitopes was associated with VL after infection. Participants with pre-infection reactivity to the C epitope had lower mean VLs at baseline than those without pre-infection reactivity, but the difference was not statistically significant (reactive at pre-infection: 23,969 copies/mL, not reactive at pre-infection: 98,982 copies/mL, p=0.16; Supplemental File 6A). A significant difference was observed for mean VL at follow-up (reactive at pre-infection: 4,594 copies/mL, not reactive at pre-infection: 81,124 copies/mL, p=0.014; Figure 6A). These findings indicate that the pre-infection reactivity to the C epitope is associated with lower VLs in established infection.

Figure 6

The opposite association was observed for the V epitope. Participants with pre-infection reactivity to the V epitope had higher mean VLs at baseline but the difference was not statistically significant (reactive at pre-infection: 119,243 copies/mL, not reactive at pre-infection: 84,969 copies/mL, p=0.068; Supplemental File 6B). A significant difference was observed for mean VL at follow-up (reactive at pre-infection: 150,647 copies/mL, not reactive at pre-infection: 42,709 copies/mL, p=0.0016; Figure 6B). These findings indicate that the pre-infection reactivity to the V epitope is associated with higher VLs in established infection.

We also evaluated whether the strength of antibody reactivity to the C and V epitopes at baseline or follow-up was correlated with VL at the same visit (Figure 7). In persons with C epitope reactivity, the strength of reactivity was inversely correlated with VL at baseline (R= -0.17, p=0.039) and follow-up (R= -0.25, p=0.019). There was no observed correlation between the strength of reactivity to the V epitope and VL at either visit.

Figure 7

Association between pre-infection antibody reactivity and infection risk

As a final step, we evaluated whether pre-infection antibody reactivity was associated with subsequent HIV infection (Supplemental File 7). There were no differences in mean antibody reactivity for 212 seroconverters vs. 217 uninfected participants to any HIV peptides in the VirScan library, including those with the C or V epitopes. Mean pre-infection HIV-1 VARscores were also low with no difference between groups (seroconverters: 0.186, uninfected: 0.217 p=0.134; Supplemental File 8).

Discussion

Previous studies demonstrated that HIV-specific pre-existing antibody responses can be protective in non-controllers (, ) but did not include a comprehensive evaluation of reactivity to all expressed HIV peptides. In this study, we used VirScan to compare pre-infection antibody profiles in controllers and viremic non-controllers in HPTN 071. All participants, independent of controller or infection status, had low-level antibody binding to HIV peptides across the viral genome prior to infection; this may reflect a combination of HIV-specific and non-specific binding to target peptides. A subset of participants had pre-infection antibodies to the C and V epitopes; this reactivity was associated with HIV controller status and VL after infection. Neither of these epitopes is targeted by bnAbs under investigation for HIV treatment and prevention (53, 54).

We found that the C epitope (gp41, HR2) was targeted more frequently prior to infection in controllers vs. viremic non-controllers (23.1% vs. 3.7%). Pre-infection reactivity to this epitope was also associated with higher overall HIV-specific antibody responses prior to infection, suggesting that production of C epitope antibodies was stimulated by HIV exposure without infection. At follow-up (infection duration: 1-2 years), pre-infection responses were boosted and all participants had reactivity to this epitope. Pre- and post-infection reactivity to the C epitope were also associated with lower VL after infection.

The 12 peptides with the C epitope overlap with an HR2 epitope that was targeted in controllers with established HIV infection in our prior study (). HR2 plays a critical role in viral fusion; antibodies targeting this region may impair hairpin formation and viral entry (55). NAbs targeting HR2 have been described in slow progressors (56) and controllers (57), while non-neutralizing HR2 antibodies with robust ADCC activity were found in a non-controller (58). This report demonstrates that pre-infection antibody reactivity to the C epitope is associated with controller status and lower VL after infection, consistent with antibody-mediated suppression of viral replication.

Antibodies to V epitope (gp120, C2) were only present prior to infection in viremic non-controllers. In contrast to the C epitope, pre-infection reactivity to this epitope was not associated with pre-infection reactivity to other HIV peptides, suggesting that production of V epitope antibodies was triggered by a mechanism other than HIV exposure. Changes in reactivity to the V epitope over time were also different from those observed for the C epitope. At follow-up, pre-infection responses to the V epitope were not boosted or consistently maintained, and only three participants developed V epitope reactivity after infection. Overall, these data suggest that V epitope reactivity was triggered by an unidentified, non-HIV antigen.

The nine peptides with the V epitope (C2 target) did not overlap with epitopes identified in our previous work. However, in the RV144 trial (NCT00223080; Thailand), vaccination induced protective antibodies targeting C2; these antibodies were associated with higher levels of ADCC and reduced HIV acquisition risk (59). This contrasts with the findings in our study, where pre-existing V-epitope reactivity was not protective and was instead associated with higher post-infection viral loads and non-controller status. These conflicting results may reflect subtype-specific differences in antibody responses targeting C2.

Pre-existing non-neutralizing or cross-reactive antibodies can sometimes facilitate viral entry by interacting with complement and/or the Fc receptor through antibody dependent enhancement (ADE) (60). In HIV infection, ADE allows rapid viral trafficking by antigen presenting cells (e.g., macrophages) to lymph node resident CD4+ T cells following mucosal transmission, enhancing early processes required to establish robust infection (6164). Infection-enhancing antibodies targeting env have been associated with HIV transmission risk (65) and higher VL after infection (66). We find that pre-infection reactivity to the V epitope is associated with non-controller status and higher VL after infection. Taken together, our findings suggest that V epitope reactivity might modulate VL via ADE in early infection.

This study had several limitations. First, negative HIV status pre-infection was determined using a sensitive antigen/antibody assay and an RNA assay with a LOD of 400 copies/mL; it is possible that some participants with low RNA and antibody levels could have been misclassified as uninfected. Second, the controller cohort used for peptide discovery was very small (n=13); this may have limited our ability to identify other pre-infection antibody specificities associated with HIV control. Third, the study cohort only included participants with presumed HIV subtype C; as inter-subtype genetic diversity may influence antibody responses, further studies are needed to assess generalizability of the findings in this study to persons with other HIV subtypes. Fourth, the VirScan assay measures antibody binding to unglycosylated, linear epitopes; antibody binding detected with VirScan may not correlate with antibody binding to the native HIV envelope trimer. Fifth, the phage-display library used in this report did not include HIV antisense protein peptides (67). Sixth, most prior studies of pre-infection HIV antibodies have focused on mucosal IgA responses (, ); this report was limited to the analysis of plasma IgG reactivity and did not include other isotypes or mucosal responses. Seventh, we did not evaluate other factors known to contribute to viral load modulation (e.g., HLA haplotype (), cellular immune responses to HIV infection (), viral factors (68, 69)). Finally, we did not assess antibody profiles in viremic controllers identified in HPTN 071 who were HIV positive at study enrollment; that analysis will be described in a separate report.

Conclusion

We identified two env epitopes that were targeted in some persons prior to infection. Reactivity to one epitope was associated with natural control of HIV infection and appeared to reduce VL via antibody-mediated suppression of viral replication. In contrast, reactivity to the other epitope was not present in HIV controllers and appeared to increase VL, possibly via ADE early in infection. These findings enhance our understanding of humoral mechanisms impacting controller status and VL and could inform the design of antibody-based approaches for HIV treatment.

Statements

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by the institutional review boards and ethics committees at the London School of Hygiene and Tropical Medicine, the University of Zambia, and Stellenbosch University. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

WG-M: designed the study, performed testing, analyzed data, drafted the manuscript. WM: performed testing, analyzed data. SEH: performed testing. MT: performed testing. EP-M: HPTN 071 (PopART) QAQC representative, responsible for HIV and viral load testing. WC: responsible for antiretroviral drug testing. AB: performed antiretroviral drug testing. JB: provided expertise on viremic control. EW: HPTN 071 (PopART) data analyst. HA: HPTN 071 (PopART) site PI for Zambia. PB: HPTN 071 (PopART) site PI for South Africa. AM: HPTN 071 (PopART) study manager. BK: provided laboratory support for HPTN 071 (PopART) in Zambia. KS: HPTN 071 (PopART) Zambia site investigator. S-AM: HPTN 071 (PopART) research manager. AV: provided laboratory support for HPTN 071 (PopART) in South Africa. SF: HPTN 071 (PopART) protocol co-chair. RH: HPTN 071 (PopART) protocol chair. IR: provided statistical and bioinformatics expertise, analyzed data. KK: provided statistical and bioinformatics expertise, analyzed data. OL: designed the study, provided input into data analysis. HBL: designed the study, analyzed data. SHE: designed the study, analyzed data, drafted the manuscript. All authors contributed to the manuscript and approved the submitted version.

Funding

This work was supported by the National Institute of Allergy and Infectious Diseases (NIAID) of the National Institutes of Health (NIH) through R01-AI095068, the National Institute of General Medical Sciences (NIGMS) through R01-GM136724, and by the HIV Prevention Trials Network (HPTN), which is sponsored by the NIAID under Cooperative Agreements UM1‐AI068619, UM1‐AI068617 and UM1‐AI068613, with funding from the U.S. President’s Emergency Plan for AIDS Relief (PEPFAR). Additional support was provided by the Division of Intramural Research, NIAID. Additional funding for the HPTN 071 (PopART) trial was provided by the International Initiative for Impact Evaluation (3ie) with support from the Bill & Melinda Gates Foundation, as well as by NIAID, the National Institute on Drug Abuse (NIDA) and the National Institute of Mental Health (NIMH), all part of NIH. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIAID, NIMH, NIDA, PEPFAR, 3ie or the Bill & Melinda Gates Foundation. Richard Hayes also received support from the UK Medical Research Council (MRC) and the UK Department for International Development (DFID) under the MRC/DFID Concordat agreement, which is also part of the EDCTP2 programme supported by the European Union (MR/R010161/1). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Acknowledgments

The authors thank the participants of the HPTN 071 (PopART) trial for their participation, the laboratory staff at study sites and the HPTN Laboratory Center for their assistance with sample processing and testing.

Conflict of interest

Author HBL is an inventor on an issued patent US20160320406A filed by Brigham and Women’s Hospital that covers the use of the VirScan technology, is a founder of ImmuneID, Portal Bioscience and Alchemab, and is an advisor to TScan Therapeutics.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fimmu.2023.1178520/full#supplementary-material

References

  • 1

    DeeksSGWalkerBD. Human immunodeficiency virus controllers: mechanisms of durable virus control in the absence of antiretroviral therapy. Immunity (2007) 27(3):406–16. doi: 10.1016/j.immuni.2007.08.010

  • 2

    PereyraFAddoMMKaufmannDELiuYMiuraTRathodAet al. Genetic and immunologic heterogeneity among persons who control HIV infection in the absence of therapy. J Infect Dis (2008) 197(4):563–71. doi: 10.1086/526786

  • 3

    OkuliczJFMarconiVCLandrumMLWegnerSWeintrobAGanesanAet al. Clinical outcomes of elite controllers, viremic controllers, and long-term nonprogressors in the US Department of Defense HIV natural history study. J Infect Dis (2009) 200(11):1714–23. doi: 10.1086/646609

  • 4

    GoujardCChaixMLLambotteODeveauCSinetMGuergnonJet al. Spontaneous control of viral replication during primary HIV infection: when is “HIV controller” status established? Clin Infect Dis (2009) 49(6):982–6. doi: 10.1086/605504

  • 5

    Gonzalo-GilEIkediobiUSuttonRE. Mechanisms of virologic control and clinical characteristics of HIV+ Elite/viremic controllers. Yale J Biol Med (2017) 90(2):245–59.

  • 6

    BlanksonJNBaileyJRThayilSYangHCLassenKLaiJet al. Isolation and characterization of replication-competent human immunodeficiency virus type 1 from a subset of elite suppressors. J Virol (2007) 81(5):2508–18. doi: 10.1128/JVI.02165-06

  • 7

    LamineACaumont-SarcosAChaixMLSaez-CirionARouziouxCDelfraissyJFet al. Replication-competent HIV strains infect HIV controllers despite undetectable viremia (ANRS EP36 study). AIDS (2007) 21(8):1043–5. doi: 10.1097/QAD.0b013e3280d5a7ac

  • 8

    InternationalHIVCSPereyraFJiaXMcLarenPJTelentiAde BakkerPIet al. The major genetic determinants of HIV-1 control affect HLA class I peptide presentation. Science (2010) 330(6010):1551–7. doi: 10.1126/science.1195271

  • 9

    FriedrichTCValentineLEYantLJRakaszEGPiaskowskiSMFurlottJRet al. Subdominant CD8+ T-cell responses are involved in durable control of AIDS virus replication. J Virol (2007) 81(7):3465–76. doi: 10.1128/JVI.02392-06

  • 10

    PandreaIGaufinTGautamRKristoffJMandellDMontefioriDet al. Functional cure of SIVagm infection in rhesus macaques results in complete recovery of CD4+ T cells and is reverted by CD8+ cell depletion. PloS Pathog (2011) 7(8):e1002170. doi: 10.1371/journal.ppat.1002170

  • 11

    ChowdhuryAHayesTLBosingerSELawsonBOVanderfordTSchmitzJEet al. Differential impact of in vivo CD8+ T lymphocyte depletion in controller versus progressor simian immunodeficiency virus-infected macaques. J Virol (2015) 89(17):8677–86. doi: 10.1128/JVI.00869-15

  • 12

    BettsMRNasonMCWestSMDe RosaSCMiguelesSAAbrahamJet al. HIV nonprogressors preferentially maintain highly functional HIV-specific CD8+ T cells. Blood (2006) 107(12):4781–9. doi: 10.1182/blood-2005-12-4818

  • 13

    Saez-CirionALacabaratzCLambotteOVersmissePUrrutiaABoufassaFet al. HIV controllers exhibit potent CD8 T cell capacity to suppress HIV infection ex vivo and peculiar cytotoxic T lymphocyte activation phenotype. Proc Natl Acad Sci USA (2007) 104(16):6776–81. doi: 10.1073/pnas.0611244104

  • 14

    LecurouxCGiraultICheretAVersmissePNembotGMeyerLet al. CD8 T-cells from most HIV-infected patients lack ex vivo HIV-suppressive capacity during acute and early infection. PloS One (2013) 8(3):e59767. doi: 10.1371/journal.pone.0059767

  • 15

    MiguelesSALaboricoACShupertWLSabbaghianMSRabinRHallahanCWet al. HIV-specific CD8+ T cell proliferation is coupled to perforin expression and is maintained in nonprogressors. Nat Immunol (2002) 3(11):1061–8. doi: 10.1038/ni845

  • 16

    PereyraFPalmerSMiuraTBlockBLWiegandARothchildACet al. Persistent low-level viremia in HIV-1 elite controllers and relationship to immunologic parameters. J Infect Dis (2009) 200(6):984–90. doi: 10.1086/605446

  • 17

    BaileyJRLassenKGYangHCQuinnTCRaySCBlanksonJNet al. Neutralizing antibodies do not mediate suppression of human immunodeficiency virus type 1 in elite suppressors or selection of plasma virus variants in patients on highly active antiretroviral therapy. J Virol (2006) 80(10):4758–70. doi: 10.1128/JVI.80.10.4758-4770.2006

  • 18

    LambotteOFerrariGMoogCYatesNLLiaoHXParksRJet al. Heterogeneous neutralizing antibody and antibody-dependent cell cytotoxicity responses in HIV-1 elite controllers. AIDS (2009) 23(8):897906. doi: 10.1097/QAD.0b013e328329f97d

  • 19

    Doria-RoseNAKleinRMDanielsMGO’DellSNasonMLapedesAet al. Breadth of human immunodeficiency virus-specific neutralizing activity in sera: clustering analysis and association with clinical variables. J Virol (2010) 84(3):1631–6. doi: 10.1128/JVI.01482-09

  • 20

    LambotteOPollaraJBoufassaFMoogCVenetAHaynesBFet al. High antibody-dependent cellular cytotoxicity responses are correlated with strong CD8 T cell viral suppressive activity but not with B57 status in HIV-1 elite controllers. PloS One (2013) 8(9):e74855. doi: 10.1371/journal.pone.0074855

  • 21

    ScheidJFMouquetHUeberheideBDiskinRKleinFOliveiraTYet al. Sequence and structural convergence of broad and potent HIV antibodies that mimic CD4 binding. Science (2011) 333(6049):1633–7. doi: 10.1126/science.1207227

  • 22

    FreundNTWangHScharfLNogueiraLHorwitzJABar-OnYet al. Coexistence of potent HIV-1 broadly neutralizing antibodies and antibody-sensitive viruses in a viremic controller. Sci Transl Med (2017) 9(373):eaal2144. doi: 10.1126/scitranslmed.aal2144

  • 23

    AckermanMEMikhailovaABrownEPDowellKGWalkerBDBailey-KelloggCet al. Polyfunctional HIV-specific antibody responses are associated with spontaneous HIV control. PloS Pathog (2016) 12(1):e1005315. doi: 10.1371/journal.ppat.1005315

  • 24

    NabiRMoldoveanuZWeiQGolubETDurkinHGGreenblattRMet al. Differences in serum IgA responses to HIV-1 gp41 in elite controllers compared to viral suppressors on highly active antiretroviral therapy. PloS One (2017) 12(7):e0180245. doi: 10.1371/journal.pone.0180245

  • 25

    KammersKChenAMonacoDRHudelsonSEGrant-McAuleyWMooreRDet al. HIV antibody profiles in HIV controllers and persons with treatment-induced viral suppression. Front Immunol (2021) 12:740395. doi: 10.3389/fimmu.2021.740395

  • 26

    BrolidenKHinkulaJDevitoCKiamaPKimaniJTrabbatoniDet al. Functional HIV-1 specific IgA antibodies in HIV-1 exposed, persistently IgG seronegative female sex workers. Immunol Lett (2001) 79(1-2):2936. doi: 10.1016/S0165-2478(01)00263-2

  • 27

    DevitoCHinkulaJKaulRKimaniJKiamaPLopalcoLet al. Cross-clade HIV-1-specific neutralizing IgA in mucosal and systemic compartments of HIV-1-exposed, persistently seronegative subjects. J Acquir Immune Defic Syndr (2002) 30(4):413–20. doi: 10.1097/00042560-200208010-00007

  • 28

    ChoiRYLevinsonPGuthrieBLLohman-PayneBBosireRLiuAYet al. Cervicovaginal HIV-1-neutralizing immunoglobulin A detected among HIV-1-exposed seronegative female partners in HIV-1-discordant couples. AIDS (2012) 26(17):2155–63. doi: 10.1097/QAD.0b013e328359b99b

  • 29

    HirbodTKaulRReichardCKimaniJNgugiEBwayoJJet al. HIV-neutralizing immunoglobulin A and HIV-specific proliferation are independently associated with reduced HIV acquisition in Kenyan sex workers. AIDS (2008) 22(6):727–35. doi: 10.1097/QAD.0b013e3282f56b64

  • 30

    HortonREBallTBWachichiCJaokoWRutherfordWJMcKinnonLet al. Cervical HIV-specific IgA in a population of commercial sex workers correlates with repeated exposure but not resistance to HIV. AIDS Res Hum Retroviruses (2009) 25(1):8392. doi: 10.1089/aid.2008.0207

  • 31

    HasselrotKBrattGHirbodTSabergPEhnlundMLopalcoLet al. Orally exposed uninfected individuals have systemic anti-HIV responses associating with partners’ viral load. AIDS (2010) 24(1):3543. doi: 10.1097/QAD.0b013e3283329853

  • 32

    HasselrotKSabergPHirbodTSoderlundJEhnlundMBrattGet al. Oral HIV-exposure elicits mucosal HIV-neutralizing antibodies in uninfected men who have sex with men. AIDS (2009) 23(3):329–33. doi: 10.1097/QAD.0b013e32831f924c

  • 33

    ThomasASMoreauYJiangWIsaacJEEwingAWhiteLFet al. Pre-existing infant antibody-dependent cellular cytotoxicity associates with reduced HIV-1 acquisition and lower morbidity. Cell Rep Med (2021) 2(10):100412. doi: 10.1016/j.xcrm.2021.100412

  • 34

    FarquharCVanCottTBosireRBermudezCMbori-NgachaDLohman-PayneBet al. Salivary human immunodeficiency virus (HIV)-1-specific immunoglobulin A in HIV-1-exposed infants in Kenya. Clin Exp Immunol (2008) 153(1):3743. doi: 10.1111/j.1365-2249.2008.03664.x

  • 35

    HayesRJDonnellDFloydSMandlaNBwalyaJSabapathyKet al. Effect of universal testing and treatment on HIV incidence - HPTN 071 (PopART). N Engl J Med (2019) 381(3):207–18. doi: 10.1056/NEJMoa1814556

  • 36

    EshlemanSHPiwowar-ManningEWilsonEALennonDFogelJMAgyeiYet al. Determination of HIV status and identification of incident HIV infections in a large, community-randomized trial: HPTN 071 (PopART). J Int AIDS Soc (2020) 23(2):e25452. doi: 10.1002/jia2.25452

  • 37

    BbosaNKaleebuPSsemwangaD. HIV subtype diversity worldwide. Curr Opin HIV AIDS (2019) 14(3):153–60. doi: 10.1097/COH.0000000000000534

  • 38

    MarzinkeMABreaudAParsonsTLCohenMSPiwowar-ManningEEshlemanSHet al. The development and validation of a method using high-resolution mass spectrometry (HRMS) for the qualitative detection of antiretroviral agents in human blood. Clin Chim Acta (2014) 433:157–68. doi: 10.1016/j.cca.2014.03.016

  • 39

    EshlemanSHLaeyendeckerOKammersKChenASivayMVKottapalliSet al. Comprehensive profiling of HIV antibody evolution. Cell Rep (2019) 27(5):142233 e4. doi: 10.1016/j.celrep.2019.03.097

  • 40

    XuGJKulaTXuQLiMZVernonSDNdung’uTet al. Viral immunology. Comprehensive serological profiling of human populations using a synthetic human virome. Science (2015) 348(6239):aaa0698. doi: 10.1126/science.aaa0698

  • 41

    RobinsonMDMcCarthyDJSmythGK. edgeR: a Bioconductor package for differential expression analysis of digital gene expression data. Bioinformatics (2010) 26(1):139–40. doi: 10.1093/bioinformatics/btp616

  • 42

    ChenAKammersKLarmanHBScharpfRBRuczinskiI. Detecting antibody reactivities in Phage ImmunoPrecipitation Sequencing data. BMC Genomics (2022) 23(1):654. doi: 10.1186/s12864-022-08869-y

  • 43

    MorgenlanderWRLarmanHB. R package ‘ARscore’ (2022). Available at: https://github.com/wmorgen1/ARscore/.

  • 44

    StoreyJDTibshIraniR. Statistical significance for genomewide studies. Proc Natl Acad Sci USA (2003) 100(16):9440–5. doi: 10.1073/pnas.1530509100

  • 45

    SieB. epitopefindr: Minimal Overlaps from BLAST Alignments. R package Version 1.1.30 (2022). Available at: https://brandonsie.github.io/epitopefindr/.

  • 46

    GormanJChuangGYLaiYTShenCHBoyingtonJCDruzAet al. Structure of super-potent antibody CAP256-VRC26.25 in complex with HIV-1 envelope reveals a combined mode of trimer-apex recognition. Cell Rep (2020) 31(1):107488. doi: 10.1016/j.celrep.2020.03.052

  • 47

    The PyMOL Molecular Graphics System. Version 2.0. Schrödinger, LLC.

  • 48

    R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing (2013). Available at: http://www.R-project.org/.

  • 49

    WickhamH. ggplot2: Elegant Graphics for Data Analysis. New York: Springer-Verlag (2016).

  • 50

    OlsonADMeyerLPrinsMThiebautRGurdasaniDGuiguetMet al. An evaluation of HIV elite controller definitions within a large seroconverter cohort collaboration. PloS One (2014) 9(1):e86719. doi: 10.1371/journal.pone.0086719

  • 51

    AltschulSFGishWMillerWMyersEWLipmanDJ. Basic local alignment search tool. J Mol Biol (1990) 215(3):403–10. doi: 10.1016/S0022-2836(05)80360-2

  • 52

    PouCNkulikiyimfuraDHenckelEOlinALakshmikanthTMikesJet al. The repertoire of maternal anti-viral antibodies in human newborns. Nat Med (2019) 25(4):591–6. doi: 10.1038/s41591-019-0392-8

  • 53

    WalshSRSeamanMS. Broadly neutralizing antibodies for HIV-1 prevention. Front Immunol (2021) 12:712122. doi: 10.3389/fimmu.2021.712122

  • 54

    CaskeyM. Broadly neutralizing antibodies for the treatment and prevention of HIV infection. Curr Opin HIV AIDS (2020) 15(1):4955. doi: 10.1097/COH.0000000000000600

  • 55

    LiJChenXHuangJJiangSChenYH. Identification of critical antibody-binding sites in the HIV-1 gp41 six-helix bundle core as potential targets for HIV-1 fusion inhibitors. Immunobiology (2009) 214(1):5160. doi: 10.1016/j.imbio.2008.04.005

  • 56

    ZhangXHanXDaiDBaoMZhangZZhangMet al. Mimotopes selected by biopanning with high-titer HIV-neutralizing antibodies in plasma from Chinese slow progressors. Braz J Infect Dis (2012) 16(6):510–6. doi: 10.1016/j.bjid.2012.07.003

  • 57

    TrottMWeibetaSAntoniSKochJvon BriesenHHustMet al. Functional characterization of two scFv-Fc antibodies from an HIV controller selected on soluble HIV-1 Env complexes: a neutralizing V3- and a trimer-specific gp41 antibody. PloS One (2014) 9(5):e97478. doi: 10.1371/journal.pone.0097478

  • 58

    WilliamsKLStumpfMNaimanNEDingSGarrettMGobillotTet al. Identification of HIV gp41-specific antibodies that mediate killing of infected cells. PloS Pathog (2019) 15(2):e1007572. doi: 10.1371/journal.ppat.1007572

  • 59

    TolbertWDVanVSherburnRTuyishimeMYanFNguyenDNet al. Recognition patterns of the C1/C2 epitopes involved in fc-mediated response in HIV-1 natural infection and the RV114 vaccine trial. mBio (2020) 11(3):e00208-20. doi: 10.1128/mBio.00208-20

  • 60

    YangXZhangXZhaoXYuanMZhangKDaiJet al. Antibody-dependent enhancement: ‘‘Evil’’ Antibodies favorable for viral infections. Viruses (2022) 14(8):1739. doi: 10.3390/v14081739

  • 61

    RobinsonWEJr.MontefioriDCMitchellWM. Antibody-dependent enhancement of human immunodeficiency virus type 1 infection. Lancet (1988) 1(8589):790–4. doi: 10.1016/S0140-6736(88)91657-1

  • 62

    HomsyJMeyerMLevyJA. Serum enhancement of human immunodeficiency virus (HIV) infection correlates with disease in HIV-infected individuals. J Virol (1990) 64(4):1437–40. doi: 10.1128/jvi.64.4.1437-1440.1990

  • 63

    TakedaATuazonCUEnnisFA. Antibody-enhanced infection by HIV-1 via Fc receptor-mediated entry. Science (1988) 242(4878):580–3. doi: 10.1126/science.2972065

  • 64

    WilleySAasa-ChapmanMMO’FarrellSPellegrinoPWilliamsIWeissRAet al. Extensive complement-dependent enhancement of HIV-1 by autologous non-neutralising antibodies at early stages of infection. Retrovirology (2011) 8:16. doi: 10.1186/1742-4690-8-16

  • 65

    MarasiniBVyasHKLakhasheSKHarirajuDAkhtarARatcliffeSJet al. Mucosal AIDS virus transmission is enhanced by antiviral IgG isolated early in infection. AIDS (2021) 35(15):2423–32. doi: 10.1097/QAD.0000000000003050

  • 66

    SzaboJProhaszkaZTothFDGyurisASegesdiJBanhegyiDet al. Strong correlation between the complement-mediated antibody-dependent enhancement of HIV-1 infection and plasma viral load. AIDS (1999) 13(14):1841–9. doi: 10.1097/00002030-199910010-00005

  • 67

    AfframYZapataJCGholizadehZTolbertWDZhouWIglesias-UsselMDet al. The HIV-1 antisense protein ASP is a transmembrane protein of the cell surface and an integral protein of the viral envelope. J Virol (2019) 93(21):e00574-19. doi: 10.1128/JVI.00574-19

  • 68

    FraserCLythgoeKLeventhalGEShirreffGHollingsworthTDAlizonSet al. Virulence and pathogenesis of HIV-1 infection: an evolutionary perspective. Science (2014) 343(6177):1243727. doi: 10.1126/science.1243727

  • 69

    HollingsworthTDLaeyendeckerOShirreffGDonnellyCASerwaddaDWawerMJet al. HIV-1 transmitting couples have similar viral load set-points in Rakai, Uganda. PloS Pathog (2010) 6(5):e1000876. doi: 10.1371/journal.ppat.1000876

Summary

Keywords

HIV, controllers, viral load, antibodies, pre-infection

Citation

Grant-McAuley W, Morgenlander W, Hudelson SE, Thakar M, Piwowar-Manning E, Clarke W, Breaud A, Blankson J, Wilson E, Ayles H, Bock P, Moore A, Kosloff B, Shanaube K, Meehan S-A, van Deventer A, Fidler S, Hayes R, Ruczinski I, Kammers K, Laeyendecker O, Larman HB and Eshleman SH (2023) Comprehensive profiling of pre-infection antibodies identifies HIV targets associated with viremic control and viral load. Front. Immunol. 14:1178520. doi: 10.3389/fimmu.2023.1178520

Received

02 March 2023

Accepted

15 August 2023

Published

06 September 2023

Volume

14 - 2023

Edited by

Zhong-Min Ma, University of California, Davis, United States

Reviewed by

Ryan P. McNamara, Ragon Institute, United States; Nancie M. Archin, University of North Carolina Hospitals, United States

Updates

Copyright

*Correspondence: Susan H. Eshleman,

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics