Skip to main content

ORIGINAL RESEARCH article

Front. Microbiol., 25 April 2022
Sec. Virology
This article is part of the Research Topic HIV-1 Genetic Diversity, Volume II View all 21 articles

HIV-1-Transmitted Drug Resistance and Transmission Clusters in Newly Diagnosed Patients in Portugal Between 2014 and 2019

\r\nMarta Pingarilho*Marta Pingarilho1*Victor PimentelVictor Pimentel1Mafalda N. S. MirandaMafalda N. S. Miranda1Ana Rita SilvaAna Rita Silva2Antnio DinizAntónio Diniz3Bianca Branco AscenoBianca Branco Ascenção4Carmela PieiroCarmela Piñeiro5Carmo KochCarmo Koch6Catarina RodriguesCatarina Rodrigues7Ctia CaldasCátia Caldas5Clia MoraisCélia Morais8Domitília FariaDomitília Faria9Elisabete Gomes da SilvaElisabete Gomes da Silva10Eugnio TefiloEugénio Teófilo11Ftima MonteiroFátima Monteiro6Fausto RoxoFausto Roxo12Fernando MaltezFernando Maltez13Fernando RodriguesFernando Rodrigues8Guilhermina GaioGuilhermina Gaião14Helena RamosHelena Ramos15Inês CostaInês Costa16Isabel GermanoIsabel Germano7Joana SimesJoana Simões7Joaquim OliveiraJoaquim Oliveira17Jos FerreiraJosé Ferreira18Jos PoasJosé Poças4Jos Saraiva da CunhaJosé Saraiva da Cunha17Jorge SoaresJorge Soares5Júlia HenriquesJúlia Henriques16Kamal MansinhoKamal Mansinho19Liliana PedroLiliana Pedro9Maria Joo AleixoMaria João Aleixo20Maria Joo GonalvesMaria João Gonçalves21Maria Jos ManataMaria José Manata13Margarida MouroMargarida Mouro22Margarida SerradoMargarida Serrado3Micaela CaixeiroMicaela Caixeiro23Nuno MarquesNuno Marques20Olga CostaOlga Costa24Patrícia PachecoPatrícia Pacheco23Paula ProenaPaula Proença25Paulo RodriguesPaulo Rodrigues2Raquel PinhoRaquel Pinho9Raquel TavaresRaquel Tavares2Ricardo Correia de AbreuRicardo Correia de Abreu26Rita Crte-RealRita Côrte-Real24Rosrio SerroRosário Serrão5Rui Sarmento e CastroRui Sarmento e Castro21Sofia NunesSofia Nunes22Telo FariaTelo Faria10Teresa BaptistaTeresa Baptista19Maria Rosrio O. MartinsMaria Rosário O. Martins1Perptua Gomes,Perpétua Gomes16,28Luís MendoLuís Mendão27Daniel SimesDaniel Simões27Ana AbecasisAna Abecasis1 on behalf of the BESTHOPE Study Group
  • 1Global Health and Tropical Medicine (GHTM), Instituto de Higiene e Medicina Tropical (IHMT), Universidade Nova de Lisboa (UNL), Lisbon, Portugal
  • 2Serviço de Infeciologia, Hospital Beatriz Ângelo, Loures, Portugal
  • 3Unidade de Imunodeficiência, Centro Hospitalar Universitário Lisboa Norte - HPV, Lisbon, Portugal
  • 4Serviço de Infeciologia, Centro Hospitalar de Setúbal, Setúbal, Portugal
  • 5Serviço de Doenças Infeciosas, Centro Hospitalar Universitário de São João, Porto, Portugal
  • 6Centro de Biologia Molecular, Serviço de Imunohemoterapia do Centro Hospitalar Universitário de São João, Porto, Portugal
  • 7Serviço de Medicina, Hospital de São José, Centro Hospitalar Universitário de Lisboa Central, Lisbon, Portugal
  • 8Serviço de Patologia Clínica, Centro Hospitalar e Universitário de Coimbra, Coimbra, Portugal
  • 9Serviço de Medicina, Hospital de Portimão, Centro Hospitalar Universitário do Algarve, Portimão, Portugal
  • 10Unidade Local de Saúde do Baixo Alentejo, Hospital José Joaquim Fernandes, Beja, Portugal
  • 11Serviço de Medicina, Hospital de Santo António dos Capuchos, Centro Hospitalar Universitário de Lisboa Central, Lisbon, Portugal
  • 12Hospital de Dia de Doenças Infeciosas, Hospital Distrital de Santarém, Santarém, Portugal
  • 13Serviço de Doenças Infeciosas, Hospital de Curry Cabral, Centro Hospitalar Universitário de Lisboa Central, Lisbon, Portugal
  • 14Serviço de Patologia Clínica, Hospital de Santa Maria, Centro Hospitalar Universitário de Lisboa Norte, Lisbon, Portugal
  • 15Serviço de Patologia Clínica, Centro Hospitalar do Porto, Porto, Portugal
  • 16Laboratório de Biologia Molecular (LMCBM, SPC, CHLO-HEM), Lisbon, Portugal
  • 17Serviço de Doenças, Centro Hospitalar e Universitário de Coimbra, Coimbra, Portugal
  • 18Serviço de Medicina, Hospital de Faro, Centro Hospitalar Universitário do Algarve, Faro, Portugal
  • 19Serviço de Doenças Infeciosas, Hospital de Egas Moniz, Centro Hospitalar de Lisboa Ocidental, Lisbon, Portugal
  • 20Serviço de Infeciologia, Hospital Garcia da Orta, Almada, Portugal
  • 21Serviço de Infeciologia, Centro Hospitalar do Porto, Porto, Portugal
  • 22Serviço de Infeciologia, Hospital de Aveiro, Centro Hospitalar Baixo Vouga, Aveiro, Portugal
  • 23Serviço de Infeciologia, Hospital Professor Doutor Fernando da Fonseca, Amadora, Portugal
  • 24Serviço de Patologia Clínica, Biologia Molecular, Centro Hospitalar Universitário de Lisboa Central, Lisbon, Portugal
  • 25Serviço de Infeciologia, Hospital de Faro, Centro Hospitalar Universitário do Algarve, Faro, Portugal
  • 26Serviço de Infeciologia, Unidade de Local de Saúde de Matosinhos, Hospital Pedro Hispano, Matosinhos, Portugal
  • 27Grupo de Ativistas em Tratamentos (GAT), Lisbon, Portugal
  • 28Centro de Investigação Interdisciplinar Egas Moniz (CiiEM), Instituto Universitário Egas Moniz, Costa da Caparica, Portugal

Objective: To describe and analyze transmitted drug resistance (TDR) between 2014 and 2019 in newly infected patients with HIV-1 in Portugal and to characterize its transmission networks.

Methods: Clinical, socioepidemiological, and risk behavior data were collected from 820 newly diagnosed patients in Portugal between September 2014 and December 2019. The sequences obtained from drug resistance testing were used for subtyping, TDR determination, and transmission cluster (TC) analyses.

Results: In Portugal, the overall prevalence of TDR between 2014 and 2019 was 11.0%. TDR presented a decreasing trend from 16.7% in 2014 to 9.2% in 2016 (pfor–trend = 0.114). Multivariate analysis indicated that TDR was significantly associated with transmission route (MSM presented a lower probability of presenting TDR when compared to heterosexual contact) and with subtype (subtype C presented significantly more TDR when compared to subtype B). TC analysis corroborated that the heterosexual risk group presented a higher proportion of TDR in TCs when compared to MSMs. Among subtype A1, TDR reached 16.6% in heterosexuals, followed by 14.2% in patients infected with subtype B and 9.4% in patients infected with subtype G.

Conclusion: Our molecular epidemiology approach indicates that the HIV-1 epidemic in Portugal is changing among risk group populations, with heterosexuals showing increasing levels of HIV-1 transmission and TDR. Prevention measures for this subpopulation should be reinforced.

Introduction

The “Treatment for All” program was implemented in many countries with an aim to offer treatment and care to anyone diagnosed with HIV, regardless of the stage of infection (CD4 cell count). In Portugal, this program was implemented in 2015 [World Health Organiztion (WHO), 2021]. The widespread use and increased coverage of antiretroviral therapy (ART) have reduced the risk of HIV transmission, decreased HIV-related morbidity and mortality, and improved life quality. However, treatment scale-up can potentiate the risk for the development of antiretroviral (ARV) drug resistance, which can be transmitted to newly infected individuals (Palella et al., 1998; Lima et al., 1999; Clavel and Hance, 2004; Cohen et al., 2011). TDR in HIV-1-infected patients has become a major concern as it may lead to the failure of first-line ART. There are several studies indicating that the prevalence of TDR is largely variable in different settings and risk groups and that this could be related to the differences in the availability of treatment and levels of socioeconomic development (Pennings, 2013; Frentz et al., 2014; Yang et al., 2015). For example, TDR levels are highly discrepant when we compare Germany (18.4%) (van de Laar et al., 2019)[9], Belgium (15.7%) (van de Laar et al., 2019)[9], Hungary (7.1%) (van de Laar et al., 2019)[9], Netherlands (12.3%) (van de Laar et al., 2019)[9], Mozambique (14.0% in women) (Pina-Araujo et al., 2014)[10], Latin America (7.7%) (Avila-Rios et al., 2016)[11], and Washington DC (20.0%) (Aldous et al., 2017)[12]. Portugal, on the other hand, presented an overall TDR of 9.4% between 2001 and 2017, with a significantly increasing trend from 7.9% in 2003 to 13.1% in 2017 (Pingarilho et al., 2020). These results were obtained in a retrospective study of our study group and were based only on RegaDB, a laboratory database including clinical, demographic, and genomic data of patients followed up in hospitals located in the southern region of Portugal.

As the HIV epidemic continues to spread, it is very important to investigate the prevalence and transmission of TDR over the years in individual settings/locations. Moreover, the phylogenetic analysis provides insight into the HIV transmission clusters (TCs). The characterization of HIV-1 transmission clusters and associated TDR allows for targeted interventions to individuals at higher risk.

In this study, we aim to describe TDR between 2014 and 2019 in newly diagnosed patients with HIV-1 in Portugal, characterize the most prevalent drug resistance mutations, and identify predictors of TDR in Portugal. Furthermore, we aim to characterize HIV-1 transmission clusters involving these patients.

Materials and Methods

Study Population and Data Collection

The protocol was in accordance with the Declaration of Helsinki and approved by the Ethical Committee of all hospitals involved in the study.

Clinical, socioepidemiological, and risk behavior data were collected prospectively from 820 newly diagnosed patients from 17 hospitals located across the whole country from north to south of Portugal between September 2014 and December 2019. This sampling corresponds to a sampling rate of 17% of the total newly diagnosed cases in Portugal within these 5 years. The BEST HOPE database contains anonymized patients’ information, including demographic, clinical, behavioral, and genotype resistance data. The data of all the patients were generated in the context of routine clinical care.

Drug Resistance Analyses and Subtyping

The genomic data included protease and reverse transcriptase sequences obtained through population sequencing performed at the molecular biology laboratories of different hospitals during daily care routine analysis. The genomic sequences were obtained for all the patients at the time of diagnosis, before starting ARV therapy. TDR was defined as the presence of one or more surveillance drug resistance mutations (SDRMs) according to the WHO 2009 surveillance list (Bennett et al., 2009)[14]. Nucleotide sequences were submitted to the Calibrated Population Resistance tool version 8.0. Clinical resistance to ARV drugs was inferred using the Stanford HIVdb v8.4. HIV-1 subtypes and circulating recombinant forms (CRFs) were determined as previously described (Pineda-Peña et al., 2013; Struck et al., 2014)[15,16]. Sequence alignments and associated metadata are available from the authors upon request.

Late Presenters and Late Presenters With Advanced Disease

According to the European Late Presenter Consensus working group, late presenters (LP) were defined as a CD4 count lower than 350 cells/μL at the time of diagnosis or present with an AIDS-defining event at diagnosis, regardless of the CD4 cell count. A subgroup of late presenters, called late presenters with advanced disease (LPAD), were characterized by presenting a CD4 count lower than 200 cells/μL or an AIDS-defining event, regardless of the CD4 cell count (Antinori et al., 2011). The groups of patients considered as LP or LPAD were stratified and analyzed according to this definition.

Genetic Ambiguities

HIV-1 protease and reverse transcriptase sequences derived from standard genotyping methods were used to determine the recentness of infection, which was calculated based on the ambiguity rate of the genomic sequences. Chronic infection was defined as an ambiguity rate with a cut-off value higher than 0.45% and recent infection as an ambiguity rate with a cut-off value equal to or below 0.45% (Andersson et al., 2013).

Transmission Cluster Identification

For the TC analysis, the dataset was divided into three separate datasets: subtypes B, A, and G. Control sequences were collected from the Los Alamos database and included all HIV-1 pol subtype (B, A, and G) sequences from Europe, South America, and Africa1 (Kuiken et al., 2003). Three reference sequences (from subtypes B and C) were used as outgroup. The resulting dataset was aligned against the global background dataset selected as control using VIRULIGN (Libin et al., 2019). Sequences with low quality, duplicates, and clones were deleted. The sequence dataset for transmission cluster analysis included the sequences of 500 patients from subtypes B, A, and G (obtained from the BEST HOPE dataset) and the sequences included in the control dataset. The total number of sequences used in this analysis was 37,822 (333 seqs were from BEST HOPE and 37,489 seqs were from controls), 7,853 (78 seqs were from BEST HOPE and 7,775 seqs were from controls), and 2,254 (89 seqs were from BEST HOPE and 2,165 seqs were from controls) from subtypes B, A, and G, respectively, with a length of 947 nucleotides. Codon positions associated with drug resistance were removed from the alignment. Maximum likelihood (ML) phylogenies were constructed using FastTree with the generalized time-reversible model. Statistical support of clades was assessed using the Shimodaira-Hasegawa-like test (SH-test). Putative transmission clusters were identified using ClusterPicker v1.332 (Ragonnet-Cronin et al., 2013)[21] and were defined as clades with branch support ≥ 0.99 in the likelihood ratio test (aLRT), as implemented in ClusterPicker v1.332. The clusters were categorized based on the size as large clusters (comprising eight patients or more) and small clusters (comprising less than eight patients). The origin of transmission clusters was assigned if at least 66% of the sequences in the cluster corresponded to the same sampling country. If there was no consistent sampling country for at least 66% of the sequences in the cluster, no origin was assigned.

Statistical Analysis

Proportions and confidence intervals for proportions were calculated using a 95% Wilson confidence interval for binomially distributed data. The differences between the prevalence of resistance in naïve patients were analyzed using the Mann–Whitney U test and the X2 tests. Logistic regression was used to examine the association between demographic and clinical factors and the occurrence of SDRMs, and to analyze the trends over time. For all the statistical analyses, we considered a 5% significance level. All the analyses were conducted in SPSS Statistic version 25 software and R3.5.1.

Results

Epidemiological and Clinical Data

The characteristics of the study population are presented in Table 1. More than half (77.3%) of the patients (n = 820) included in the database were men. The median age at diagnosis was 37.0 (IQR: 29.0–47.0) years. During this period (2014–2019), new diagnoses occurred predominantly (56.0%) between the ages of 22 and 40 years. The main modes of transmission were heterosexual and homosexual contact (49.8% and 47.3%, respectively), followed by intravenous drug use (1.8%). Most patients were born in Portugal (71.9%), and patients born abroad (13.9%) originated from Portuguese-Speaking African Countries (PSAC) and Brazil (11.2%). Individuals with a higher level of education had a higher prevalence when compared to the individuals with other levels of education (35.1%). Most patients (74.4%) were employed; however, 44.2% of them considered the current income as insufficient. More than half (68.5%) were single, 20.9% were married, and 8.3% were divorced and widowers (0.5%). About 75.5% of men reported having sex with men, and 12.9% of men reported having sex with both men and women. However, 100% of women included in the study reported only having sex with men. Based on the percentage of genomic ambiguities, approximately half of the patients (51.3%) presented chronic disease, while 70.0% presented infection stage A. About 82.2% presented no AIDS-defining events, and 70.2% had no sexually transmitted diseases other than HIV. Patients who reported STIs other than HIV were heterosexual (15.3%) and MSMs (43.4%) (data not shown). Patients were predominantly infected with subtype B (40.6%), followed by subtype G (10.9%). At diagnosis, the median viral load (VL) was 4.9 (IQR: 4.4–5.5) Log10 copies/ml, and the CD4 cell count was 339.0 (IQR: 140.0–519.0) cells/μL. About 52.4% of the study population were late presenters. Moreover, the study population presented 31.3% of patients diagnosed as late presenters with advanced disease, with a CD4 count lower than 200 cells/μL. About 77.4% of the LPAD cases were men, and 93.0% were heterosexual. None were MSM. Among these LPAD cases, more than half were born in Portugal (52.8%), and 45.3% were migrants. Among the migrants, 62.5% were born in Africa (data not shown).

TABLE 1
www.frontiersin.org

Table 1. Demographic and patients characteristics.

Transmitted HIV Drug Resistance

The overall prevalence of TDR between 2014 and 2019 was 11.0% (95%CI: 9.0–13.3%). Nucleoside reverse transcriptase inhibitor (NRTI) mutations were detected in 3.9% (95%CI: 2.8–5.5%), non-nucleoside reverse transcriptase inhibitor (NNRTI) mutations in 5.0% (95%CI: 3.6–6.6%), and protease inhibitors (PI) in 3.9% (95%CI: 2.8–5.5%) of the HIV cases. In total, 9.6% (95%CI: 7.8–11.9%) presented single-class resistance, 1.2% (95%CI: 0.7–2.2%) dual-class resistance, and 0.2% triple-class resistance (Figure 1). Trends for TDR were determined for the period 2014–2016, where it was decreasing, and for the period 2017–2019, where it was increasing (Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1. Proportion of transmitted drug resistance (TDR) in sequences obtained from newly diagnosed patients between 2014 and 2019. NRTI, Nucleoside reverse transcriptase inhibitor; NNRTI, Non-nucleoside reverse transcriptase inhibitor; PI, Protease inhibitor; CI, confidence interval; OR, odds ratio.

Overall TDR presented a decreasing trend from 16.7% in 2014 to 9.2% in 2016 (pfor–trend = 0.114), and TDR to NRTIs also showed a declining trend (4.17% in 2014 to 3.17% in 2016; pfor–trend = 0.361). TDR to NNRTIs presented a significantly decreasing trend from 12.5% in 2014 to 2.82% in 2016 (pfor–trend < 0.05). TDR to PIs, on the other hand, presented an increasing trend (2.08% in 2014 to 4.23% in 2016; pfor–trend = 0.797). Between 2017 and 2019, TDR presented an increasing trend from 8.9% in 2017 to 21.9% in 2019 (pfor–trend < 0.05) and also showed an increasing trend for all the drug classes, however, without statistical significance (Figure 1).

According to the HIVdb Stanford database algorithm, NNRTIs presented the highest level of high-level resistance (9.7%) among the drug classes. Nevirapine (NVP) showed the highest proportion of high-level resistance (4.7%), followed by efavirenz (EFV) with 3.7%, and both are related to the most frequently detected mutation K103NS (3.1%). High-level resistance to NRTIs occurred in 2.7% of the patients, with TDR to emtricitabine (FTC) and lamivudine (3TC) presenting the highest levels (1.0%), which is related to M41L (1.4%) mutation. High-level resistance to PIs was found in 0.4% of the patients, with atazanavir (ATV) presenting 0.4% of high-level resistance, which is related to the presence of L90M mutation (2.2%) (Figures 2A,B).

FIGURE 2
www.frontiersin.org

Figure 2. (A) Proportion of resistance mutations in the sequences of newly diagnosed patients and (B) Predicted phenotypic resistance (Stanford scores) to antiretroviral drugs currently recommended as first-line therapy in Portugal for newly diagnosed patients (2014–2019). NRTI, Nucleoside reverse transcriptase inhibitor; NNRTI, Non-nucleoside reverse transcriptase inhibitor; PI, Protease inhibitor; FTC, Emtricitabine; TDF, Tenofovir; 3TC, Lamivudine; ABC, Abacavir; EFV, Efavirenz; RPV, Rilpivirine; DRV/r, Darunavir; LPV/r, Lopinavir; ATV/r, Atazanavir. Scores of low-level (score 2 and 3), intermediate-level (score 4), or high-level (score 5) resistance were used to predict phenotypic resistance.

We also analyzed the association between HIV drug resistance mutations and subtypes of infection. We observed that individuals infected with subtype B were more likely to develop mutations associated with resistance to all the antiretroviral classes (NRTIs, NNRTIs, and PIs). In the individuals infected with subtype B, resistance to NRTIs can be attributed mainly to the M41L (0.8%), K219QR, and T215rev (0.4%) mutations. For NNRTIs, the most common mutations were K103NS (1.20%) and G190SA (0.4%), and for PIs, the main mutation found was M46IL (0.6%) (data not shown).

Predictors of Transmitted Drug Resistance

The clinical and sociodemographic factors significantly associated with TDR in the univariate model were transmission route (sex between men, OR = 0.62), stage of infection (stage C, OR = 2.04), having an AIDS-defining event (patients without AIDS-defining events, OR = 0.52), and being infected with subtype C (OR = 2.86). The multivariate analysis indicated that TDR was significantly associated with the transmission route (MSM presented a lower probability of having TDR when compared to the heterosexual contact) and infection with subtype C (compared to subtype B) (Table 2).

TABLE 2
www.frontiersin.org

Table 2. Unadjusted and adjusted regression analysis of factors associated with HIV-transmitted drug resistance.

Inference of Transmission Clusters

Based on the PR+RT phylogenetic analysis, transmission clusters (TCs) were defined as clades with a branch support value 99% for subtypes B, A, and G.

We identified 87 transmission clusters comprising 273 of the 500 patients (54.6%). The average cluster size was 17.4, with a minimum of 2 (31 clusters) and a maximum of 118 (1 cluster).

When the proportion of transmission clusters between the subtypes was compared, patients carrying subtype G strains were more likely to be inside the clusters (67/89; 75.3%), followed by subtypes B (180/333; 54.1%) and A (22/78; 28.2%) (p < 0.001). Subtype G and A sequences in clusters presented a high proportion of heterosexual patients (84.1% and 57.1%, respectively). On the other hand, among subtype B sequences inside the clusters, 72.7% belonged to the MSM population.

Among the subtypes B, A, and G, 52 out of 500 (10.6%) patients presented HIV drug resistance, while almost the same proportion was observed in transmission clusters (9.5%). The highest prevalence of TDR (73%) was observed among small clusters (cluster size lower than 10 sequences). When we analyzed TDR inside the clusters between the subtypes, we observed different proportions of TDR. Subtypes A1 (13.6%) and B (9.8%) were more likely to carry SDRMs inside the clusters when compared to subtype G (7.5%). Regardless of the subtypes, the heterosexual population presented the highest proportion of TDR compared to MSMs. Among subtype A1, heterosexuals presented 16.7% of TDR, followed by 14.3% in patients infected with subtype B and in lower proportion (9.4%) in patients with subtype G (Tables 3, 4).

TABLE 3
www.frontiersin.org

Table 3. Subtypes, TDR, and risk factor of patients associated with HIV-1 molecular transmission clusters.

TABLE 4
www.frontiersin.org

Table 4. Characteristic of patients in HIV-1 molecular transmission clusters according to the transmission route.

Discussion

This study aimed to understand HIV-1-transmitted drug resistance in newly diagnosed patients by providing a current picture of transmitted drug resistance patterns in these populations. This study is particularly important, as it provides information that can guide the development of preventive measures directed at specific risk populations.

The study population was mostly composed of men (77.3%). The most prevalent age group was 22–40 years, and most patients originated from Portugal and were included in the heterosexual and MSM risk groups. The characteristics of this population are consistent with the patterns reported in the latest Portuguese health authorities report. Clinically, it is worth emphasizing the high prevalence of very late presenters (LPAD; 31.5%) identified in this study, which is also consistent with the prevalence reported in the Portuguese health authorities report (Direção Geral da Saúde and Instituto Nacional de Saúde Doutor Ricardo Jorge, 2020).

Our study showed that the estimated prevalence of TDR in Portugal was 11.0% (IC95%: 9.0–13.3) in patients diagnosed between 2014 and 2019. A decreasing trend for TDR was also observed between 2014 and 2016. A similar trend was observed for NRTIs and NNRTIs, but not for PIs, which showed increasing TDR in this period. Between 2017 and 2019, an increasing trend was observed for TDR and all drug classes. This increasing trend in TDR had already been observed by our study group in a longitudinal study that included patients between 2001 and 2017 (Pingarilho et al., 2020), as well as in a study published by a Canadian group (Rocheleau et al., 2018). This increase could be related to population mobility and an increase in the number of migrants from Portuguese-speaking Sub-Saharan African countries, where TDR has been increasing in the last few years (Rhee et al., 2015; Pingarilho et al., 2018; Sebastião et al., 2019; Pimentel et al., 2020).

The most prevalent mutation detected was K103N, which confers high-level resistance to NVP and EFV, followed by M41L, which reduces susceptibility to TDF and ABC when in combination with other NRTI mutations, and M184VI, which causes high-level resistance to 3TC and FTC. L90M resistance mutation presented the highest prevalence for PIs, and it causes reduced susceptibility to ATV and LPV. L90M mutation (1.8%) was widely observed in patients infected with subtype C, and this could be the reason for the increased resistance to PIs noticed in our study (3.9%), compared to 2.8% obtained in our previously published study (Pingarilho et al., 2020).

We also observed that the risk of TDR was significantly higher in patients infected with subtype C when compared to those infected with subtype B. We hypothesize that this finding could be explained by the higher prevalence of L90M mutations among MSMs infected with subtype C, eventually caused by its forward transmission in MSM transmission clusters. However, in this study, the transmission clusters of subtype C were not reconstructed, since the prevalence of this subtype was lower than 10%. Future studies will address this problem.

Although the L90M mutation was more frequent among the MSM group, in fact, the overall TDR was 1.7 times (p = 0.027) higher within the heterosexual population than that observed in the MSM group. This result is discordant from previous studies that have shown faster onward transmission of HIV infection with less reversion of DRM in the MSM transmission clusters and therefore a potentization of the transmission of TDR (Vercauteren et al., 2009). However, this finding agrees with the results obtained through transmission cluster analyses, which showed that subtype G heterosexuals (Pineda-Peña et al., 2019) were more frequently inside clusters when compared to subtypes A and B, indicating that transmission is more active in this subgroup. This is in contrast to what other European studies showed, where it was concluded that non-B subtypes are associated with the heterosexual population and are less frequently found in the transmission clusters (Lorenzin et al., 2019; Paraskevis et al., 2019; Pimentel et al., 2022). Since our study is based on newly diagnosed patients, we believe that our results present a more recent view of the epidemic in the country that could already reflect a successful impact of pre-exposure prophylaxis (PrEP) among the MSM patients, with a slowdown of HIV transmission clusters in this risk group. We hypothesize that MSM patients, in addition to auto-testing more frequently, have a higher risk perception that plays an important role in the acceptance of PrEP (Plotzker et al., 2017). Consistently with our hypothesis, some other studies have already reported that there is a high level of willingness and acceptance of PrEP use among MSM (Frankis et al., 2016; Phan and Vu, 2017; Spinner et al., 2018; Nguyen et al., 2021). Moreover, in Portugal, it is known that almost the entire population interested in using PrEP is MSM; however, no such study has been published until now. Nevertheless, a study conducted in 2016 reported that in France, more than 95% of the people interested in the use of PrEP were MSM (Loos et al., 2016).

The overall rate of TDR was 9.5% inside the clusters compared to 11.5% outside the clusters, and the highest proportion of TDR was observed in small clusters (73%), mostly composed of heterosexuals. Subtype A presented the highest prevalence of TDR in clusters, followed by subtypes B and G. However, consistent with the results of the analyses of TCs, we observed that heterosexual individuals from subtype G presented higher levels of TDR in clusters, compared to MSMs of the same subtype. The same was observed for subtypes A and B, where heterosexuals inside the clusters presented higher levels of TDR compared to MSM, despite the fact that subtype B presented a higher rate of MSM. Heterosexual transmission accounts for approximately 57.8% of the new HIV infections in Portugal in the last few years, with migrants contributing to approximately 43.1% of these new infections, mostly from Sub-Saharan African countries (51.2%), where heterosexual transmission is predominant (Direção Geral da Saúde and Instituto Nacional de Saúde Doutor Ricardo Jorge, 2020). Most of these heterosexual contacts present small clusters of two individuals (men–women), indicating low levels of forward transmission that still represent a high proportion of TDR transmission in Portugal.

Given the new trends presented in this manuscript, our results seem to indicate that the successful HIV prevention measures implemented in the MSM populations, which include the use of PreP (pre-exposure prophylaxis), frequent medical appointments and testing, and earlier diagnosis in community-based centers, seem to have been successful in decreasing the HIV transmission and consequently the TDR among the MSM group. Since, in Portugal, PreP is mostly used by the MSM population and not by heterosexuals, this can explain the higher proportion of heterosexuals in TCs and hence higher TDR transmission in heterosexuals. Also, it is important to note that the MSM population is more frequently tested and has an opportunity for earlier diagnosis, which may imply less transmission of HIV and thus TDR. HIV-1 prevention measures should now be strengthened for heterosexual risk groups.

Conclusion

The transmission patterns of HIV-1 are changing in Portugal, probably due to the new prevention measures introduced in the country and which are mostly accepted by the MSM groups. However, it is very important to address the heterosexual group where TDR is increasing and which presents high levels of late diagnosis. For this reason, it is important to develop preventive measures for HIV-1 transmission addressing the specificities of this group.

Data Availability Statement

The data analyzed in this study is subject to the following licenses/restrictions: The dataset would be available through requisition and explanation of the study purposes. Requests to access these datasets should be directed to AS, ana.abecasis@ihmt.unl.

Other members of the BESTHOPE study group

Ana Bandeiras, Ana Pimenta, Anabela Granado, André Gomes, António Maio, Catarina Messias, Celina Bredes, Diana Seixas, Diva Trigo, Edite Mateus, Fátima Gonçalves, Filipa Azevedo, Francisco Vale, Henriqueta Pereira, Inês Siva, Isabel Casella, Isabel Diogo, Isabel Neves, Joana Sá, Joana Simões, Joana Granado, Joana Vasconcelos, João Cabo, João Pereira-Vaz, João Domingos, João Torres, Joaquim Cabanas, Johana Jesus, José Melo Cristino, Karen Pereira, Luís Caldeira, Luísa Sêco, Lurdes Correia, Manuela Simão, Maria Saudade Ivo, Mariana Pessanha, Marta Feijó, Margarida Cardoso, Nildelema Malaba, Nádia Gomes, Natália Patrício, Nuno Luís, Nuno Janeiro, Patrícia Carvalho, Paula Brito, Pedro Simões, Rosário Prazos, Sara Lino, Sara Casanova, Sofia Pinheiro, Sónia Marques, Sofia Jordão, Sueila Martins, Telma Azevedo, Teresa Meira, Vanda Mota, and Vanda Silva.

Author Contributions

MP and AA: conceptualization and writing—original draft and writing—reviewing and editing. MP, MNM, and VP: data curation and validation. MP, MNM, VP, and AA: formal analysis. AA: funding acquisition, project administration, and supervision. MP, VP, PG, and MRM: investigation. MP, VP, MRM, and AA: methodology. PG, AS, AD, BA, CP, CK, CR, CC, CM, DF, ES, ET, FMo, FaR, FMa, FeR, GG, HR, IC, IG, JSi, JO, JF, JP, JC, JSo, JH, KM, LP, MA, MG, MJM, MGM, MS, MC, NM, OC, PPa, PPr, PR, RP, RT, RA, RR, RS, RC, SN, TF, and TB: resources, data collection, and approval of the publication contents. All authors contributed to the article and approved the submitted version.

Funding

This study was supported by the European funds through grant Bio-Molecular and Epidemiological Surveillance of HIV Transmitted Drug Resistance, Hepatitis Co-Infections and Ongoing Transmission Patterns in Europe (BEST HOPE) (project funded through HIVERA: Harmonizing Integrating Vitalizing European Research on HIV/Aids, grant no: 249697); by FCT for funds to GHTM-UID/Multi/04413/2013 and GHTM-UID/04413/2020; by the MigrantHIV project (financed by FCT: PTDC/DTP-EPI/7066/2014); by Characterization of drug-resistance TB and HIV, and associated sociobehavioral factors among migrants in Lisbon, Portugal project financed by GHTM-UID/Multi/04413/2013; and by Integriv project (financed by FCT: PTDC/SAU-INF/31990/2017).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We would like to thank Dr. Ricardo Camacho, who passed away in 2018, who designed and triggered this study. Without his deep involvement, this study would not have been possible. We would also like to thank the patients included in this study.

Footnotes

  1. ^ http://www.hiv.lanl.gov

References

Aldous, A. M., Castel, A. D., Parenti, D. M., Greenberg, A. E., Benator, D., Kumar, P., et al. (2017). Prevalence and trends in transmitted and acquired antiretroviral drug resistance, Washington, DC, 1999–2014. BMC Res. Notes 10:474. doi: 10.1186/s13104-017-2764-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Andersson, E., Shao, W., Bontell, I., Cham, F., Cuong, D. D., Wondwossen, A., et al. (2013). Evaluation of sequence ambiguities of the HIV-1 pol gene as a method to identify recent HIV-1 infection in transmitted drug resistance surveys. Infect Genet Evol 18, 125–131. doi: 10.1016/j.meegid.2013.03.050

PubMed Abstract | CrossRef Full Text | Google Scholar

Antinori, A., Coenen, T., Costagiola, D., Dedes, N., Ellefson, M., Gatell, J., et al. (2011). Late presentation of HIV infection: a consensus definition. HIV Med. 12, 61–64. doi: 10.1111/j.1468-1293.2010.00857.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Avila-Rios, S., Sued, O., Rhee, S.-Y., Shafer, R. W., Reyes-Teran, G., and Ravasi, G. (2016). Surveillance of HIV transmitted drug resistance in latin america and the caribbean: a systematic review and meta-analysis. PLoS One 11:e0158560. doi: 10.1371/journal.pone.0158560

PubMed Abstract | CrossRef Full Text | Google Scholar

Bennett, D. E., Camacho, R. J., Otelea, D., Kuritzkes, D. R., Fleury, H., Kiuchi, M., et al. (2009). Drug resistance mutations for surveillance of transmitted HIV-1 drug-resistance: 2009 update. PLoS One 4:e4724. doi: 10.1371/journal.pone.0004724

PubMed Abstract | CrossRef Full Text | Google Scholar

Clavel, F., and Hance, A. J. (2004). HIV drug resistance. New Eng. J. Med. 350, 1023–1035. doi: 10.1056/NEJMra025195

PubMed Abstract | CrossRef Full Text | Google Scholar

Cohen, M. S., Chen, Y. Q., McCauley, M., Gamble, T., Hosseinipour, M. C., Kumarasamy, N., et al. (2011). Prevention of HIV-1 infection with early antiretroviral therapy. New Eng. J. Med. 365, 493–505. doi: 10.1056/NEJMoa1105243

PubMed Abstract | CrossRef Full Text | Google Scholar

Direção Geral da Saúde, and Instituto Nacional de Saúde Doutor Ricardo Jorge (2020). Infeção VIH e SIDA em Portugal- 2020. Portugal: DGS.

Google Scholar

Frankis, J. S., Young, I., Lorimer, K., Davis, M., and Flowers, P. (2016). Towards preparedness for PrEP: PrEP awareness and acceptability among MSM at high risk of HIV transmission who use sociosexual media in four celtic nations: scotland, wales, northern ireland and the republic of ireland: an online survey. Sex Transm Infect. 92, 279–285. doi: 10.1136/sextrans-2015-052101

PubMed Abstract | CrossRef Full Text | Google Scholar

Frentz, D., Van de Vijver, D. A., Abecasis, A. B., Albert, J., Hamouda, O., Jørgensen, L. B., et al. (2014). Increase in transmitted resistance to non-nucleoside reverse transcriptase inhibitors among newly diagnosed HIV-1 infections in Europe. BMC Infect Dis. 14:407. doi: 10.1186/1471-2334-14-407

PubMed Abstract | CrossRef Full Text | Google Scholar

Kuiken, C., Korber, B., and Shafer, R. W. (2003). HIV sequence databases. AIDS Rev. 5, 52–61.

Google Scholar

Libin, P. J. K., Deforche, K., Abecasis, A. B., and Theys, K. (2019). VIRULIGN: fast codon-correct alignment and annotation of viral genomes. Bio. Oxf. Eng. 35, 1763–1765. doi: 10.1093/bioinformatics/bty851

PubMed Abstract | CrossRef Full Text | Google Scholar

Lima, V. D., Harrigan, R., Bangsberg, D. R., Hogg, R. S., Gross, R., Yip, B., et al. (1999). The combined effect of modern highly active antiretroviral therapy regimens and adherence on mortality over time. J. Acquir Immune Defic Syndr 2009, 529–536. doi: 10.1097/QAI.0b013e31819675e9

PubMed Abstract | CrossRef Full Text | Google Scholar

Loos, J., Nöstlinger, C., Reyniers, T., Colebunders, R., Jespers, V., Manirankunda, L., et al. (2016). PrEP for african migrants in Europe? A research agenda. Lancet HIV 3, e505–e507. doi: 10.1016/S2352-3018(16)30173-4

CrossRef Full Text | Google Scholar

Lorenzin, G., Gargiulo, F., Caruso, A., Caccuri, F., Focà, E., Celotti, A., et al. (2019). Prevalence of non-B HIV-1 subtypes in north italy and analysis of transmission clusters based on sequence data analysis. Microorganisms 8:36. doi: 10.3390/microorganisms8010036

PubMed Abstract | CrossRef Full Text | Google Scholar

Nguyen, L. H., Nguyen, H. L. T., Tran, B. X., Larsson, M., Rocha, L. E. C., Thorson, A., et al. (2021). A qualitative assessment in acceptability and barriers to use pre-exposure prophylaxis (PrEP) among men who have sex with men: implications for service delivery in Vietnam. BMC Infect. Dis. 21:472. doi: 10.1186/s12879-021-06178-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Palella, F. J., Delaney, K. M., Moorman, A. C., Loveless, M. O., Fuhrer, J., Satten, G. A., et al. (1998). Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. HIV outpatient study investigators. New Eng. J. Med. 338, 853–860. doi: 10.1056/NEJM199803263381301

PubMed Abstract | CrossRef Full Text | Google Scholar

Paraskevis, D., Beloukas, A., Stasinos, K., Pantazis, N., de Mendoza, C., Bannert, N., et al. (2019). HIV-1 molecular transmission clusters in nine european countries and canada: association with demographic and clinical factors. BMC Med. 17:4. doi: 10.1186/s12916-018-1241-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Pennings, P. S. (2013). HIV drug resistance: problems and perspectives. Infect Dis. Rep. 2013:e5. doi: 10.4081/idr.2013.s1.e5

PubMed Abstract | CrossRef Full Text | Google Scholar

Phan, H. T. T., and Vu, N. T. T. (2017). Acceptance to use daily oral pre-exposure prophylaxis (PrEP) as an HIV prevention method and ability to pay for PrEP among men who have sex with men in ho chi minh city. Vietnam. Health (N Y) 9, 1326–1336. doi: 10.4236/health.2017.99096

CrossRef Full Text | Google Scholar

Pimentel, V., Giordano, S., Marta, P., Daniela, A., Mafalda, M., Isabel, D., et al. (2022). Differential patterns of post-migration HIV-1 infection acquisition among portuguese immigrants of different geographical origin. AID. [Online ahead of print] doi: 10.1097/QAD.0000000000003203

PubMed Abstract | CrossRef Full Text | Google Scholar

Pimentel, V., Pingarilho, M., Alves, D., Diogo, I., Fernandes, S., Miranda, M., et al. (2020). Molecular epidemiology of HIV-1 infected migrants followed up in portugal: trends between 2001-2017. Viruses 12, 268. doi: 10.3390/v12030268

PubMed Abstract | CrossRef Full Text | Google Scholar

Pina-Araujo, M., Guimarães, M. L., Bello, G., Vicente, A. C. P., and Morgado, M. G. (2014). Profile of the HIV epidemic in cape verde: molecular epidemiology and drug resistance mutations among HIV-1 and HIV-2 infected patients from distinct islands of the archipelago. PLoS One 9:e96201. doi: 10.1371/journal.pone.0096201

PubMed Abstract | CrossRef Full Text | Google Scholar

Pineda-Peña, A.-C., Faria, N. R., Imbrechts, S., Libin, P., Abecasis, A. B., Deforche, K., et al. (2013). Automated subtyping of HIV-1 genetic sequences for clinical and surveillance purposes: performance evaluation of the new REGA version 3 and seven other tools. Infect. Genet. Evol. J. Mol. Epidemiol. Evol. Genet. Infect. Dis. 19, 337–348. doi: 10.1016/j.meegid.2013.04.032

PubMed Abstract | CrossRef Full Text | Google Scholar

Pineda-Peña, A.-C., Pingarilho, M., Li, G., Vrancken, B., Libin, P., Gomes, P., et al. (2019). Drivers of HIV-1 transmission: the portuguese case. PLoS One 14:e0218226. doi: 10.1371/journal.pone.0218226

PubMed Abstract | CrossRef Full Text | Google Scholar

Pingarilho, M., Pimentel, V., Diogo, I., Fernandes, S., Miranda, M., Pineda-Pena, A., et al. (2020). Increasing prevalence of HIV-1 transmitted drug resistance in portugal: implications for first line treatment recommendations. Viruses 12:1238. doi: 10.3390/v12111238

PubMed Abstract | CrossRef Full Text | Google Scholar

Pingarilho, M., Pineda-Peña, A., Gomes, P., Libin, P., Theys, K., and Abecasis, A. (2018). Molecular epidemiology of hiv infection in portuguese migrant population. Viruse 12:268.

Google Scholar

Plotzker, R., Seekaew, P., Jantarapakde, J., Pengnonyang, S., Trachunthong, D., Linjongrat, D., et al. (2017). Importance of risk perception: predictors of PrEP acceptance among thai MSM and TG women at a community-based health service. JAIDS J. Acquir Immune Defic Syndr 76, 473–481. doi: 10.1097/QAI.0000000000001536

PubMed Abstract | CrossRef Full Text | Google Scholar

Ragonnet-Cronin, M., Hodcroft, E., Hué, S., Fearnhill, E., Delpech, V., Brown, A. J. L., et al. (2013). Automated analysis of phylogenetic clusters. BMC Bioinform. 14:317. doi: 10.1186/1471-2105-14-317

PubMed Abstract | CrossRef Full Text | Google Scholar

Rhee, S.-Y., Blanco, J. L., Jordan, M. R., Taylor, J., Lemey, P., Varghese, V., et al. (2015). Geographic and temporal trends in the molecular epidemiology and genetic mechanisms of transmitted HIV-1 drug resistance: an individual-patient- and sequence-level meta-analysis. PLoS Med. 12:1001810. doi: 10.1371/journal.pmed.1001810

PubMed Abstract | CrossRef Full Text | Google Scholar

Rocheleau, G., Brumme, C. J., Shoveller, J., Lima, V. D., and Harrigan, P. R. (2018). Longitudinal trends of HIV drug resistance in a large canadian cohort, 1996-2016. Clin. Microbiol. Infect. Publ. Eur. Soc. Clin. Microbiol. Infect. Dis. 24, 185–191. doi: 10.1016/j.cmi.2017.06.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Sebastião, C. S., Neto, Z., de Jesus, C. S., Mirandela, M., Jandondo, D., Couto-Fernandez, J. C., et al. (2019). Genetic diversity and drug resistance of HIV-1 among infected pregnant women newly diagnosed in luanda, angola. PLoS One 14:e0225251. doi: 10.1371/journal.pone.0225251

PubMed Abstract | CrossRef Full Text | Google Scholar

Spinner, C. D., Hanhoff, N., Krznaric, I., Knecht, G., Kuemmerle, T., Ruesenberg, R., et al. (2018). 2016 PREP attitudes in germany: high awareness and acceptance in MSM at risk of HIV. Infection 46, 405–408. doi: 10.1007/s15010-018-1127-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Struck, D., Lawyer, G., Ternes, A.-M., Schmit, J.-C., and Bercoff, D. P. (2014). COMET: adaptive context-based modeling for ultrafast HIV-1 subtype identification. Nucleic Acids Res. 42:e144. doi: 10.1093/nar/gku739

PubMed Abstract | CrossRef Full Text | Google Scholar

van de Laar, M. J., Bosman, A., Pharris, A., Andersson, E., Assoumou, L., Ay, E., et al. (2019). Piloting a surveillance system for HIV drug resistance in the European Union. Eurosurveillance 24:1800390. doi: 10.2807/1560-7917.ES.2019.24.19.1800390

PubMed Abstract | CrossRef Full Text | Google Scholar

Vercauteren, J., Wensing, A. M. J., van de Vijver, D. A., Albert, J., Balotta, C., Hamouda, O., et al. (2009). Transmission of drug-resistant HIV-1 is stabilizing in europe. J. Infect. Dis. 200, 1503–1508. doi: 10.1086/644505

PubMed Abstract | CrossRef Full Text | Google Scholar

World Health Organiztion (WHO) (2021). Portugal on Fast Track to Achieve HIV Targets Ahead of 2020 Deadline. Available online at: https://www.euro.who.int/en/countries/portugal/news/news/2018/7/portugal-on-fast-track-to-achieve-hiv-targets-ahead-of-2020-deadline (accessed May 6, 2021)

Google Scholar

Yang, W.-L., Kouyos, R. D., Böni, J., Yerly, S., Klimkait, T., Aubert, V., et al. (2015). Persistence of transmitted HIV-1 drug resistance mutations associated with fitness costs and viral genetic backgrounds. PLoS Pathog 11:e1004722. doi: 10.1371/journal.ppat.1004722

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: HIV-1, TDR, transmission clusters, Portugal, newly infected patients

Citation: Pingarilho M, Pimentel V, Miranda MNS, Silva AR, Diniz A, Ascenção BB, Piñeiro C, Koch C, Rodrigues C, Caldas C, Morais C, Faria D, da Silva EG, Teófilo E, Monteiro F, Roxo F, Maltez F, Rodrigues F, Gaião G, Ramos H, Costa I, Germano I, Simões J, Oliveira J, Ferreira J, Poças J, da Cunha JS, Soares J, Henriques J, Mansinho K, Pedro L, Aleixo MJ, Gonçalves MJ, Manata MJ, Mouro M, Serrado M, Caixeiro M, Marques N, Costa O, Pacheco P, Proença P, Rodrigues P, Pinho R, Tavares R, de Abreu RC, Côrte-Real R, Serrão R, Castro RS, Nunes S, Faria T, Baptista T, Martins MRO, Gomes P, Mendão L, Simões D and Abecasis A (2022) HIV-1-Transmitted Drug Resistance and Transmission Clusters in Newly Diagnosed Patients in Portugal Between 2014 and 2019. Front. Microbiol. 13:823208. doi: 10.3389/fmicb.2022.823208

Received: 26 November 2021; Accepted: 21 March 2022;
Published: 25 April 2022.

Edited by:

Joris Hemelaar, University of Oxford, United Kingdom

Reviewed by:

Marta Giovanetti, Oswaldo Cruz Foundation (Fiocruz), Brazil
Philippe Colson, IHU Mediterranee Infection, France
Orna Mor, Ministry of Health, Israel

Copyright © 2022 Pingarilho, Pimentel, Miranda, Silva, Diniz, Ascenção, Piñeiro, Koch, Rodrigues, Caldas, Morais, Faria, da Silva, Teófilo, Monteiro, Roxo, Maltez, Rodrigues, Gaião, Ramos, Costa, Germano, Simões, Oliveira, Ferreira, Poças, da Cunha, Soares, Henriques, Mansinho, Pedro, Aleixo, Gonçalves, Manata, Mouro, Serrado, Caixeiro, Marques, Costa, Pacheco, Proença, Rodrigues, Pinho, Tavares, de Abreu, Côrte-Real, Serrão, Castro, Nunes, Faria, Baptista, Martins, Gomes, Mendão, Simões and Abecasis. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Marta Pingarilho, martapingarilho@ihmt.unl.pt

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.