ORIGINAL RESEARCH article

Front. Microbiol., 06 August 2015

Sec. Antimicrobials, Resistance and Chemotherapy

Volume 6 - 2015 | https://doi.org/10.3389/fmicb.2015.00800

Albendazole induces oxidative stress and DNA damage in the parasitic protozoan Giardia duodenalis

  • 1. Departamento de Genética y Biología Molecular, Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional México City, Mexico

  • 2. Department of Biochemistry, Instituto Nacional de Cardiología Ignacio Chávez México City, Mexico

Abstract

The control of Giardia duodenalis infections is carried out mainly by drugs, among these albendazole (ABZ) is commonly used. Although the cytotoxic effect of ABZ usually involves binding to β-tubulin, it has been suggested that oxidative stress may also play a role in its parasiticidal mechanism. In this work the effect of ABZ in Giardia clones that are susceptible or resistant to different concentrations (1.35, 8, and 250 μM) of this drug was analyzed. Reactive oxygen species (ROS) were induced by ABZ in susceptible clones and this was associated with a decrease in growth that was alleviated by cysteine supplementation. Remarkably, ABZ-resistant clones exhibited partial cross-resistance to H2O2, whereas a Giardia H2O2-resistant strain can grow in the presence of ABZ. Lipid oxidation and protein carbonylation in ABZ-treated parasites did not show significant differences as compared to untreated parasites; however, ABZ induced the formation of 8OHdG adducts and DNA degradation, indicating nucleic acid oxidative damage. This was supported by observations of histone H2AX phosphorylation in ABZ-susceptible trophozoites treated with 250 μM ABZ. Flow cytometry analysis showed that ABZ partially arrested cell cycle in drug-susceptible clones at G2/M phase at the expense of cells in G1 phase. Also, ABZ treatment resulted in phosphatidylserine exposure on the parasite surface, an event related to apoptosis. All together these data suggest that ROS induced by ABZ affect Giardia genetic material through oxidative stress mechanisms and subsequent induction of apoptotic-like events.

Introduction

Giardia duodenalis is an intestinal parasitic protozoan that causes the infection known as giardiasis which affects about 280 million people around the world; 500,000 new cases are reported each year (; ). This parasite is orally transmitted by the ingestion of infective cysts. Once in the host’s stomach excystation occurs and trophozoites emerge. At the duodenum the parasites replicate and colonize this portion of the intestine. Subsequently trophozoites are transported by peristalsis to the jejunum and the ileum where encystation takes place and mature cysts are expelled in the stool (; ). The infection can be asymptomatic or present several clinical manifestations ranging from mild to severe symptoms that include diarrhea, steatorrhea, post-prandial epigastric pain, anorexia, bloating, and flatulence (; ). Some infected patients may develop a chronic infection with recurrent diarrhea, steatorrhea, malabsorption, weight loss, and poor growth in children (; ).

The control of this infection is mainly carried out by treatment with chemotherapeutic agents. Among the drugs used are components that belong to 5-nitroimidazoles (e.g., metronidazole) and benzimidazoles (e.g., albendazole) derivatives. Other drugs prescribed against Giardia include nitazoxanide, furazolidone, paromomycin, and quinacrine (; ). Among these drugs albendazole (ABZ) is given in massive chemotherapy interventions against helminths based on its relative safety, high efficacy, broad spectrum against helminths, and low cost (; ). Further ABZ has been used against Giardia, particularly when metronidazole refractory cases occur (; ). The side effects of this drug are rare but in some cases anorexia, constipation and neutropenia have been reported (). The use of ABZ is contraindicated during pregnancy due to possible teratogenic effects, although such effects have not been entirely confirmed (; ).

In pharmacokinetic studies it has been determined that after its absorption, ABZ is oxidized to its metabolites, sulphoxide and sulphone, by cytochrome P450 and/or by flavin-dependent oxidases (). The production of these metabolites has been reported in Giardia after ABZ exposure (; ). It has also been reported that in helminths and fungi ABZ selectively binds to four β-tubulin sites, preventing its polymerization and affecting microtubule stability which in turn inhibits mobility and transport of molecules within the microorganism (; ; ). In helminths, ABZ-resistant parasites harbor hot-spot mutations in β-tubulin encoding different amino acids, particularly at glutamate 198 and phenylalanine 200 (; ; ). In Giardia, it has been established that hot-spot amino acid mutations in β-tubulin are absent (; ) suggesting that the induction of ABZ-resistant phenotypes involves different mechanisms.

Regarding ABZ resistance in Giardia, it has been reported that resistant trophozoites display morphological changes, particularly in the median body, despite the conserved amino acid residues at positions 198 and 200 in β-tubulin (; ; ). On the other hand, chromosomal rearrangements have been documented in ABZ-treated parasites, although there is no evidence of a gene or group of genes that may be affected during ABZ resistance in this parasite (). Previous studies by our group suggest that diverse metabolic mechanisms may be involved in the ABZ resistance in Giardia that could include components of antioxidant and energy metabolism as well as cytoskeletal changes in the parasite ().

In this context, recent reports have suggested a direct relationship between the use of ABZ and oxidative stress. In a report in which ABZ was administered to rats in various doses and times, oxidative stress was elicited particularly in hepatocytes (). Other studies have also shown the ability of ABZ to induce oxidative stress in sheep liver (), and ABZ consumption may be correlated with liver damage in humans (). In Dicrocoelium dendriticum, a fluke of veterinary and human health importance, an increase in antioxidant enzyme activity after ABZ exposure was identified (). However, no reports on oxidative damage due to ABZ in other parasites are available.

To determine in more detail the mode of action of ABZ in Giardia, in this work we have assessed the induction of oxidative stress by ABZ in G. duodenalis trophozoites by monitoring reactive oxygen species (ROS) formation. Results identified ABZ-induced oxidative stress in this protozoan. Oxidative damage to the parasite´s DNA is associated with cell cycle arrest and apoptosis. The consequences of this stress and its possible relationship to ABZ resistance in Giardia are discussed.

Materials and Methods

Trophozoite Cultures, Growth of ABZ-Resistant Clones and Obtention of H2O2-Resistant Trophozoites

Giardia duodenalis trophozoites of the WB strain (ATCC#30957) and ABZ-resistant clones were maintained in TYI-S-33 medium supplemented with 10% adult bovine serum (HyClone) and antibiotic/antimycotic solution (Thermo, USA) at 37°C () in 4.5 mL screw-capped vials. ABZ-resistant trophozoites were selected by continuous subculture under increasing sub-lethal concentrations of ABZ (Sigma cat. A-4673). When parasites were adapted to each increase of drug concentration, cultures were cloned by limiting dilution using the corresponding ABZ concentration (). Trophozoites were sub-cultured twice a week under the continuous presence of drug (for ABZ-resistant clones) and for the ABZ-sensitive clones only in the presence of the vehicle (N, N-dimethylformamide; DMF, Sigma). To obtain the H2O2-resistant parasites (ROX), trophozoites were selected by continuous subculture under increasing sub-lethal concentrations of H2O2 (Sigma, USA). Vials containing trophozoites were refilled to three-quarter capacity and H2O2-resistant parasites were cultured as described above for ABZ-resistant Giardia. Stock solutions (0.01–25 mM) of ABZ in DMF or DMF alone were used in all assays. Oxidative stress was induced by exposing the parasites to 100 μM H2O2 and these cultures were used as positive controls ().

Determination of Trophozoite Growth

Trophozoite growth was assessed by the fluorescent tracer SYTOX Green according to the manufacturer’s instructions (Invitrogen, USA). Briefly, trophozoites were washed three times in phosphate buffered saline (PBS) then suspended in lysis buffer (6% SDS, 10 mM HEPES) using a Vortex shaker for 10 s. A stock solution of SYTOX Green (5 mM) was added in a 1:5 v/v ratio and incubated for 10 min in the dark. The standard growth curve was obtained using variable numbers of lysed trophozoites and absorbance values of each sample from non-treated and treated trophozoites were determined in 96-well, black-bottomed microtiter plates using a FACSCalibur reader fitted with 504/525 nm excitation/emission filters (). Negative control absorbance values were obtained from wells with no cells.

Detection of Reactive Oxigen Species (ROS) in Trophozoites Incubated with ABZ or H2O2

Albendazole-sensitive trophozoites were incubated with ABZ (1.35, 8, and 250 μM), Dimethylformamide (DMF referred as vehicle) or H2O2 (100 μM) as control for oxidative stress, for 16 h at 37°C. ROS formation was assessed by Image-IT LIVE Green Reactive Oxygen Species Detection KitTM according to manufacturer´s instructions (Life Technologies, USA). After incubation, trophozoites were washed in PBS and suspended in 25 μM 6-carboxy-2′,7′-dichlorodihydrofluorescein diacetate (carboxy- H2DCFDA) at 37°C for 30 min. Then Hoechst 33342 was added at a final concentration of 1 μM for 5 min. Cell fluorescence signals were detected at the end of the incubation period in a Beckman FACSCalibur Flow Cytometer or in an optical microscope using the BD FACSComp software.

Determination of Cross-Resistance to ABZ and H2O2 and Protection by Cysteine

The cross resistance between ABZ and H2O2 was evaluated using the ABZ-resistant and H2O2-resistant clones mentioned above. The ABZ-resistant clones (R1.35, R8, R250) were exposed to 0, 25, 50, 75, and 100 μM H2O2 for 24 h at 37°C. Cell number was determined by SYTOX Green. Resistance to ABZ was determined in ROX (H2O2-resistant) parasites which were exposed to 0.05, 0.1, 0.2, 0.4, and 0.8 μM of ABZ for 24 h at 37°C. In control cultures, ABZ or H2O2 were not added. Cell number was also determined using SYTOX Green. For cysteine protection assays, ABZ-sensitive trophozoites were grown in TYI-S-33 medium supplemented with different concentrations of cysteine (0.5, 1, 2, or 4 mM). Then, trophozoites were incubated in the presence of 0.2 μM ABZ for 48 h at 37°C. Cell growth was determined by SYTOX Green as indicated above.

Detection of Protein Carbonylation and Lipid Peroxidation

Albendazole-sensitive trophozoites were incubated with DMF, ABZ (1.35, 8, and 250 μM) or H2O2 (100 μM) for 24 h at 37°C. Protein carbonylation was determined using a commercial kit (Protein Carbonyl Assay, Cayman Chemical, USA). Trophozoites were washed with PBS, suspended in lysis solution (50 mM MES, 1 mM EDTA at pH 7.4) and lysed by three cycles of freezing-thawing followed by centrifugation at 10,000 x g for 10 min. Subsequently the protein was derivatized with dinitrophenylhydrazine (DNPH) for 60 min in the dark, the reaction was stopped with 20% trichloroacetic acid and samples were centrifuged at 10,000 × g for 10 min. Then the samples were washed three times with ethanol/ethyl acetate solution. Finally, the proteins were suspended in guanidine hydrochloride and the absorbance was determined at 450 nm (). The concentration of protein in the soluble fraction was determined by absorbance at 280 nm.

For lipid peroxidation determination, after incubation with compounds or vehicle a solution of 1-methyl-2-phenylindole in a mixture of acetonitrile/methanol (3:1) was added to trophozoite homogenates. For malondialdehyde (MDA) determination, the reaction was initiated by adding HCl to a 37% v/v final concentration and for the 4-hydroxynonenal (HNE) assay methanesulfonic acid and FeCl3 at 34 μM (final concentration each) were used. The absorbance at 586 nm was measured upon incubation of the reaction mixture at 45°C for 40 min. For each series of assays, the absorbance of a control containing water instead of a sample was always subtracted. For each assay homogenate, a control sample in which the reagent was replaced by acetonitrile/methanol (3:1, v/v) was included. A standard curve of trimethoxypropane was used in all assays (; ).

Detection of DNA Fragmentation

Albendazole-sensitive trophozoites were incubated with different concentrations of ABZ (1.35, 8 and 250 μM), DMF or H2O2 (100 μM) for 24 h at 37°C, then washed twice in PBS 1X and incubated overnight at 42°C in a lysis solution (10 mM Tris-HCl, pH 7.4, 10 mM EDTA, 150 mM NaCl, 0.4% sodium dodecyl sulfate, and 200 μg/mL proteinase K). RNA was removed by incubating samples with 20 mg/mL RNase A at 37°C for 30 min. The lysate was treated with phenol/chloroform (1:1) and nucleic acids were precipitated at -20°C with 0.3 M sodium acetate pH 7 and ethanol. After quantification, the extent of DNA fragmentation was analyzed by electrophoresis on 1% agarose/ethidium bromide gels ().

Detection of Oxidative DNA Damage

DNA damage was assessed by immunofluorescence with an anti-8-hydroxydeoxyguanosine (8OHdG) monoclonal antibody (Santa Cruz Technologies, USA). ABZ-sensitive trophozoites treated with DMF, different concentrations of ABZ (1.35, 8, and 250 μM) or H2O2 (100 μM) for 16 h at 37°C were incubated for 1 h at 37°C on poly-L-lysine-coated (2 mg/ml) coverslips, rinsed twice with PBS and fixed with a solution of methanol:acetone (1:1 v/v) at -20°C. Fixed cells were treated with 0.05 N HCl for 5 min on ice, rinsed with PBS and washed with PBS containing 35, 50, and 75% ethanol consecutively for 3 min each time. DNA was denatured in situ with 0.15 N NaOH in 70% ethanol for 4 min. The precipitate was rinsed twice with PBS and incubated with 0.2 μg/ml Hoechst dye for 10 min. Subsequently parasites were washed with PBS containing 75, 50, and 35% ethanol consecutively in the presence of 4% formaldehyde for 2 min each time. The samples were incubated in trypsin solution (49.5 mM Tris base, 1 mM EDTA, 150.7 mM Na2HPO4, 14.9 mM K2HPO4, 0.1% trypsin at pH 7.2) for 10 min at 37°C and washed three times with PBS. Trophozoites were then incubated for 30 min with 1% bovine serum albumin (BSA) to block nonspecific binding and incubated with mouse monoclonal anti- 8-OHdG for 1 h. After a wash with PBS, cells were incubated for 1 h at room temperature with goat anti-mouse IgG coupled to FITC (Santa Cruz Technologies, USA). Samples were analyzed using a Zeiss microscope equipped with epifluorescence illumination as previously described ().

Detection of Protein-MDA Adducts and H2AX Phosphorylation by Western Blot

Both protein-MDA adducts and histone H2AX phosphorylation (at ser139) were evaluated by Western blot assays using specific antibodies. In these, ABZ-sensitive trophozoites were incubated with DMF, different concentrations of ABZ (1.35, 8, and 250 μM) or H2O2 (100 μM) for 24 h at 37°C, washed with PBS tree times and suspended in lysis buffer. Twenty microgram of protein were analyzed by SDS-PAGE in 12% acrylamide gels for the protein-MDA assay and in 15% acrylamide gels for detection of H2AX phosphorylation. After electrophoresis, gels were transferred to nitrocellulose membranes. Membranes were blocked with PBS containing 0.1% Tween-20 and 1% skim milk for 2 h at 37°C. After washing with Tris-buffered saline (TBS) membranes were incubated with rabbit anti-MDA (Abcam, USA) and rabbit anti-H2AX (Millipore, USA) antibodies for 1 h at room temperature under constant shaking. Membranes were washed and incubated with horseradish peroxidase-conjugated mouse anti-rabbit IgG (Thermo, USA). Chemiluminescence detection was performed with the Amersham ECL detection kit according to manufacturer’s instructions (; ).

Identification and Quantification of Apoptotic and Necrotic Cells

The cells undergoing apoptotic or necrotic processes after ABZ- or H2O2 exposure were analyzed by flow cytometry in which fluorescence by annexin V binding (green) and propidium iodide (PI) uptake (red) were quantified. Positioning of quadrants on annexin V/PI dot plots was analyzed according to the following pattern: living cells (annexin V-/PI-), early apoptotic/primary apoptotic cells (annexin V+/PI-), late apoptotic/secondary apoptotic cells (annexin V+/PI+) and necrotic cells (annexin V-/PI+). The assay was carried out using the Annexin V-FITC Apoptosis Detection Kit (BioVision, USA) following the manufacturer´s instructions. Briefly, cells were incubated with DMF, different concentrations of ABZ (1.35, 8, and 250 μM) or H2O2 (100 μM) for 24 h. Then, trophozoites were centrifuged at 440 × g at 4°C and suspended in 500 μl of 1X binding buffer. Cells were then incubated with 5 μl of annexin V–FITC and 5 μl of PI (50 μg/ml) for 5 min in the dark at room temperature. The FITC and PI fluorescence was measured with a FACS Calibur Flow Cytometer equipped with an FL-1 filter (530 nm) and an FL-2 filter (585 nm), respectively, in at least 10,000 events () in each experiment.

Determination of Cell Cycle Stages in G. duodenalis Trophozoites Exposed to ABZ

To determine the proportions of trophozoites at the different cycle stages, nuclear staining with PI was coupled to flow cytometry. In brief, ABZ-sensitive trophozoites were exposed to different concentrations of ABZ (1.35, 8, and 250 μM) for 4 h at 37°C, washed with PBS and fixed 30 min with 70% ethanol in PBS. Then cells were washed again and incubated in PBS containing 0.1 mg/mL RNAase overnight at 4°C. Finally cell pellets were washed, stained with PI (1 μM in PBS), washed and resuspended in small volume (200–300 μL) for analysis in a FACS Calibur Flow Cytometer in at least 10,000 events per sample. The histogram areas were identified as reported by .

Statistical Analyses

All the data were obtained from at least three experiments and where indicated the results are expressed as mean ± SD. Inter-group variation was assessed by one-way analysis of variance (ANOVA) followed by Tukey’s multiple comparison test. Statistical significance was determined if p ≤ 0.05.

Results

Intracellular ROS Formation

In some reports using animal models ABZ was shown to produce oxidative damage (; ). In G. duodenalis oxidative stress damage has been induced using pro-oxidant compounds such as H2O2 (; ) in which intracellular ROS formation hallmarks this phenomenon. ABZ-exposed parasites showed greater ROS signals than parasites not exposed to the drug (Figure 1, top panels). The effect was mainly detected at the highest ABZ concentration tested (250 μM), however, ROS formation could be determined by flow cytometry at lower concentrations (Figure 1, bottom panels).

FIGURE 1

To determine the localization of intracellular ROS formation within the trophozoites confocal microscopy was used. In these experiments the typical altered morphology caused by benzimidazoles () was observed in ABZ-treated trophozoites (Figure 2A top panel c). In these cells ROS formation was also evident in most cells as determined by fluorescent staining (Figure 2A top panel d). When individual cells were observed the trophozoites´nuclei were determined as the primary site of ROS formation (Figure 2B) as judged by fluorescent staining at low ABZ concentrations used (1.35 μM and 8 μM). At the highest drug concentration used (250 μM) there was a widespread distribution of ROS throughout the trophozoite cytoplasm (Figure 2B middle panel).

FIGURE 2

Cross Resistance to ABZ and H2O2 in Giardia Trophozites

The ABZ-resistant clones, namely R1.35, R.8, and R.250 (; ) were used to determine whether cross-resistance to classical oxidative stressor (H2O2) and ABZ was induced in the resistant trophozoites. For this purpose the ABZ-resistant clones were incubated under increasing concentrations of H2O2, and cell growth was determined. In general the resistant clones R1.35 and R.250 showed a tendency to increased resistance to H2O2-induced death in comparison to the ABZ-susceptible WB strain (Figure 3A). A special case is the R8 resistant strain which frequently behave, in this and other studies, as a “transition state” between low and high ABZ resistance depending on the parameter that is evaluated (see also Figure 6A; ; )

FIGURE 3

). Parasites were exposed to the indicated H2O2 concentrations for 24 h and the cell number was determined by SYTOX Green. As control, wild type WB strain (white bars) was incubated with the indicated H2O2 concentration. (B) Cross-resistance to ABZ in a H2O2-resistant G. dudodenalis. A H2O2-resistant Giardia strain (ROX) was obtained by sub-culturing the WB strain in increasing H2O2 concentration for 6 months. Control WB (white bars) and ROX (gray bars) trophozoites were exposed to the indicated increasing ABZ concentrations for 24 h and the cell number was determined using the fluorescent tracer SYTOX Green. The ROX strain showed cross-resistance to ABZ. (C) Cysteine protection of Giardia trophozoites exposed to ABZ. WB trophozoites were incubated in growth medium with 0.5 mM (white bar), 1 mM (lined up to the right bar), 2 mM (lined up to the left bar), or 4 mM (boxed bar) of cysteine for 24 h and then trophozoites were further incubated with 0.2 μM ABZ for 48 h. In all graphs the results are the mean ± SD of at least three independent experiments. In graphs (B,C) indicates p ≤ 0.05 by ANOVA and Tukey´s analysis in which values obtained with WB trophozoites were compared with values obtained in ROX trophozoites exposed to the different ABZ concentrations (B). (C) Values obtained in WB trophozoites treated with 0.5 mM cysteine were compared to values obtained in WB trophozoites treated with different cysteine concentrations and then exposed to ABZ.

Resistance to H2O2 was achieved by using continuous trophozoite subcultures under increasing concentrations of H2O2. Following this procedure for approximately 6 months, a strain displaying resistance to 75 μM H2O2 was obtained (ROX). This strain was incubated in the presence of ABZ showing a significantly higher growth rate as compared with the H2O2-susceptible WB strain (Figure 3B).

Cysteine Increases Tolerance to ABZ in the Drug Treated Trophozoites

Giardia duodenalis possesses a bacterial-like antioxidant metabolism in which cysteine is the major antioxidant thiol instead of glutathione. To test if increased levels of extracellular cysteine may confer increased tolerance to the drug in ABZ-susceptible trophozoites, these clones were incubated in culture media containing different cysteine concentrations and subsequently ABZ at 0.2 μM was added and after 48 h-incubation trophozoite growth was measured. As a result, parasites incubated at cysteine concentrations higher than 1 mM showed higher growth after ABZ exposure than those incubated at lower concentrations of this amino acid (Figure 3C). These results suggest that cysteine may help to contend the ROS damage upon ABZ exposure.

Damage to Biomolecules after ABZ Exposure in G. duodenalis Trophozoites

The formation of intracellular ROS may trigger oxidative damage to various biomolecules such as proteins, lipids, and DNA. Protein carbonylation was determined in ABZ-sensitive trophozoites exposed to increasing ABZ concentrations. As can be seen in Figure 4A, a consistent but not statistically significant increase in protein carbonylation correlated with the increase in drug concentration, confirming the presence of oxidative damage by ABZ treatment in cellular proteins of G. duodenalis.

FIGURE 4

The levels of lipid peroxidation in healthy cells are maintained under controlled limits but these can be affected, i.e., increased, when cells are treated with pro-oxidant xenobiotics. This process leads to the formation of some intermediates such as MDA and HNE. The determination of such intermediates was carried out after ABZ exposure of drug–sensitive trophozoites. In both cases there was not a significant change in ABZ-treated parasites as compared with untreated cultures contrary to the drug susceptible clones exposed to H2O2 used as a control (Figure 4B). This observation was further corroborated using antibodies detecting MDA-protein adducts which displayed more intense staining only when drug susceptible trophozoites were exposed to H2O2 (Figure 4C).

Oxidative damage to DNA by ABZ treatment was determined by immunocytochemistry assays using antibodies against 8-OHdG. In these, a significant increase in intranuclear staining, denoting 8-OHdG-containing DNA in ABZ-treated cells was observed (Figure 5). At the highest drug concentrations used (250 μM) the fluorescent signal was observed in nucleus and the entire cytosol displayed a diffuse pattern with a punctuated pattern in some regions within the trophozoites (Figure 5).

FIGURE 5

Characterization of DNA Damage in G. duodenalis Trophozoites Induced by ABZ

From the previous observations we concluded that ABZ caused a preferential oxidative damage at the DNA level over other biomolecules which could be severe as judged by the extra nuclear 8OHdG detection at higher ABZ concentrations. To assess damage to DNA integrity, genomic DNA was purified from control and ABZ-exposed trophozoites and analyzed in agarose gels to assess its integrity (presence of a high-sized band) or partial/total degradation. As shown in Figure 6A, genomic DNA was broken down in ABZ-exposed trophozoites as determined by the presence of diffuse and low molecular weight bands. This DNA degradation was absent or present at a lesser extent in the ABZ- and ROX-resistant strains. To further confirm the damage to the double stranded DNA, anti-histone H2AX antibodies were used. This protein becomes phosphorylated upon DNA double-strand break. In Figure 6B it is shown that exposure of parasites to the highest ABZ concentration (250 μM) induced a H2A signal indicating damage to DNA. The level of phosphorylated Giardia H2A was proportional to the DNA damage, therefore the signal was better observed at the highest concentration of ABZ.

FIGURE 6

ABZ Induces Apoptosis-Like Death and Partial Cell Cycle Arrest in G. duodenalis Trophozoites

To determine if ABZ causes necrosis or an apoptotic-like phenomenon, the translocation of phosphatidylserine in ABZ treated trophozoites was detected using anti-annexin V antibodies as a specific marker of early apoptosis. Trophozoites exposed to ABZ displayed a significant increase in annexin V staining. At higher drug concentration a significant number of cells positive to both markers indicated a process of cell death involving late apoptosis and necrosis (Figure 7). In further experiments the trophozoites nuclei were stained with PI to assess if ABZ exposure may alter the cell cycle progression between control and ABZ-exposed trophozoites. As can be observed in Figure 8, ABZ produced a noticeable and consistent decrease in the G1 subpopulation (yellow area, from 14.6% in vehicle-treated cells to 2.7% in 250 μM ABZ-treated cells), a slight decrease in the S-phase subpopulation in 1.35 μM ABZ-treated cells as compared to DMF-treated cells (stripped area, from 27 to 22.1%, respectively) and a moderated increase in G2 subpopulation between these same samples (blue area, from 61.0 to 69.9%, respectively). The cells treated with 8 μM ABZ displayed a similar distribution to the one observed in the population exposed to 250 μM ABZ. These data suggest that cytotoxic ABZ concentrations allow only a partial G1→S→G2 transit in cells in a pattern (G2 >> S > G1 > M) that indicates an arrested state at the G2/M phase boundary.

FIGURE 7

FIGURE 8

Discussion

Parasitic diseases by protozoa and helminths represent a serious health problem worldwide. The control of the infections caused by these parasites is carried out mainly by drug treatment. The drug ABZ is a broad spectrum benzimidazole with an anti-helminthic effect and its low cost makes this drug a suitable candidate for mass drug administration programs to deworm children in countries where giardiasis is endemic as well. However, up to five 400 mg doses are needed to clear infections by G. duodenalis, limiting the utility of these campaigns to diminish burdens of giardiasis. Also, the use of suboptimal doses may engender and disseminate ABZ-resistant Giardia (; ). Likewise many parasites including Giardia exhibit cross-resistance to diverse drugs. Therefore, it is essential to understand the mechanisms involved in the toxicity of the drugs used; this understanding can help to devise high efficiency regimes and new and effective drugs against resistant strains (). Understanding the mechanisms of the effects of ABZ on Giardia will also help to define at least in part, the ABZ toxicity reported in some patients particularly in the liver, as well as other side effects such as possible teratogenisis (; ).

In this context, the mechanisms of ABZ action have been studied mainly in helminthic parasites and information in protozoans is limited. The main mechanism of ABZ action involves binding to β-tubulin causing the destabilization of the cytoskeleton. In this regard, resistance to ABZ has been associated with point mutations in this protein and so far other effects of ABZ have received little attention. Some studies in mammalian cells have correlated the use of ABZ to the presence of oxidative stress. Since the susceptibility of many parasites to oxidative stress has been reported (), in this study we have evaluated the capacity of ABZ to induce oxidative stress in the protozoan parasite G. duodenalis.

The results indicated that ABZ exposure induced intracellular ROS formation in drug susceptible trophozoites and interestingly ROS were detected mainly in the nuclei. Therefore, oxidative-stress caused by ABZ can be part of the cytotoxic effect of this drug in Giardia. An important aspect to be addressed in future studies is to determine which ROS are involved as well as the mechanisms inducing their formation.

Since ABZ cytotoxicity was herein related to oxidative stress, another pro-oxidant molecule (H2O2) was evaluated. Of note, a partial degree of cross-resistance to this agent was detected in the ABZ-resistant clones suggesting that similar antioxidant responses may be induced by each compound. This correlation between drug resistance and antioxidant response has also been suggested in drug resistant Leishmania strains () and in other pathogens such as Plasmodium and Pseudomonas (; ). The phenomenon of cross-resistance in Giardia to different drugs including metronidazole and ABZ has already been reported () although the causes of this have not yet been fully elucidated. The protection conferred by cysteine in ABZ-treated trophozoites further suggests that this drug induces some toxicity through oxidative stress thus cysteine may provide a reductive environment, however, the mechanisms involved in this protective effect remains to be elucidated. Interestingly in a recent study of our group, a set of antioxidant enzymes present in Giardia (e.g., NADH oxidase, flavoprotein-A, superoxide reductase, peroxiredoxins, ; ) have shown an increased expression along to increased intracellular cysteine concentrations in the ABZ-resistant clones used in this study (). Other processes as drug metabolization could also play a role in resistance because Giardia apparently has metronidazole-activating enzymes (nitro reductases; ) and ABZ metabolites (sulphoxide and sulphone) have been detected in this parasite (). Interestingly these are accumulated in lower levels in the ABZ-resistant clones ().

Regarding the damage promoted by ABZ in trophozoites, two interesting findings were observed: (a), the lack of lipid peroxidation and protein carbonylation, and (b) the presence of DNA damage as a main mechanism of the cytotoxic effect of ABZ. The lack of lipid peroxidation may be due either to the fact that Giardia uptakes lipids and cholesterol from exogenous sources, to the unique lipid metabolism in this parasite, or to the nuclear localization of ROS that may limit damage to membrane-associated lipid metabolites (; ). Moreover, protein carbonylation, an irreversible oxidative damage, showed only a tendency (not statistically significant) to increase when high ABZ concentrations were used, despite being easily detected when the parasites were treated with H2O2. Although carbonylation is an important marker for protein damage, it will also be important to analyze if other mechanisms of oxidative damage to proteins () may occur in the ABZ treated trophozoites.

The detection of 8OHdG adducts, together with DNA degradation in ABZ exposed trophozoites indicated that the DNA was the most affected molecule by the pro-oxidant action of ABZ. The in vitro damage of DNA by drugs such as metronidazole has been recently shown in Giardia (). Other redox active drugs such as benzinidsazole and hydroxymethylnitrofurazone have been reported to affect mainly DNA (), a pattern commonly present in necrosis. Further evidence of DNA damage in ABZ-treated trophozoites included histone H2AX phosphorylation that indicates a repair signal after DNA double strand break. In particular, H2AX phosphorylation observed in parasites treated with 250 μM ABZ could be due to the cell damage induced by the drug. Thus, phosphorylation of histone H2AX will be activated upon damage of trophozoites by ABZ. As shown in Figure 7, a process of necrosis appears particularly significantly when the parasites are exposed to 250 μM and in this condition H2AX phosphorylation occurs.

In other parasites such as Toxoplasma gondii, the phosphorylation of H2AX has been correlated with loss of pathological potential and reduced growth rates (). It is worth mentioning that the typical ladder pattern of DNA degradation observed in Giardia exposed to ABZ was not entirely similar to the one associated with apoptosis in other organisms or as commonly present in necrosis (). Thus the DNA degradation pattern correlates with an apoptotic-like phenomenon present in G. duodenalis. Indeed, the detection of phosphatidylserine translocation to the outer side of the cell membrane suggested an apoptotic-like event.

Our findings resemble studies reported by others regarding an apoptotic-like process in Giardia when it is exposed to classical inducers of oxidative stress and to metronidazole (). Interestingly a partial arrest in S and G2 phases of the cell cycle was observed in ABZ-exposed trophozoites that correlate with the induction of oxidative stress and an apoptotic-like process. It is noteworthy that the cell cycle arrest is not complete and this allows a portion of the cell population to continue through the cell cycle. The effect of different drugs on the Giardia cell cycle has been reported to show different phenomena, including partial arrest in different cell cycle stages depending on the drug under study (). In our work, ABZ-treated trophozoites showed a pattern consistent with Giardia trophozoites displaying incomplete cytokinesis upon exposure to microtubule-acting compounds ().

In summary, this work demonstrated that ABZ induces the formation of intracellular of ROS in G. duodenalis leading to an oxidative stress status where the main affected biomolecule is DNA. This damage involves the formation of 8OHdG adducts and double-strand DNA break. This damage in turn leads to cell cycle dysregulation and eventually apoptotic-like cell death. These observations allow us to expand our understanding on the cytotoxic mechanism of ABZ in Giardia and opens future directions to a rational drug design for giardiasis, considering antioxidant responses as likely mechanisms of multidrug resistance. In this context, generating ROS or inhibiting endogenous antioxidant enzymes would be a rational approach to developing new anti-Giardia drugs as previously proposed for other parasites ().

Statements

Acknowledgments

We would like to thank Dean Befus and Benjamin Rosenthal for critically reading the manuscript and for their help in reviewing the English language. Authors are grateful to José Pedraza Chaverri and Omar Medina Campos for their help in the assays for the detection of lipid peroxidation, to Blanca E. Herrera-Ramirez, Isabel Torres, Olga Garibay Cerdenares, and Viridiana Olin-Sandoval for their helpful technical assistance and to Arturo Pérez-Taylor for informatics assistance. RM-E was recipient of a doctoral fellowship from CONACYT (Reference No. 215120). This work was partially supported by Conacyt Grant No 49724-M.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  • 1

    AnkarklevJ.Jerlström-HultqvistJ.RingqvistE.TroellK.SvärdS. G. (2010). Behind the smile: cell biology and disease mechanisms of Giardia species.Nat. Rev. Microbiol.8413422. 10.1038/nrmicro2317

  • 2

    Argüello-GarcíaR.Cruz-SotoM.González-TrejoR.Paz-MaldonadoL. M.Bazán-TejedaM. L.Mendoza-HernándezG.et al (2015). An antioxidant response is involved in resistance of Giardia duodenalis to albendazole.Front. Microbiol.10:286. 10.3389/fmicb.2015.00286

  • 3

    Argüello-GarcíaR.Cruz-SotoM.Romero-MontoyaL.Ortega-PierresG. (2009). In vitro resistance to 5-nitroimidazoles and benzimidazoles in Giardia duodenalis: variability and variation in gene expression.Infect. Genet. Evol.910571064. 10.1016/j.meegid.2009.05.015

  • 4

    BagchiS.OnikuA. E.ToppingK.MamhoudZ. N.PagetT. A. (2012). Programmed cell death in Giardia.Parasitology139894903. 10.1017/S003118201200011X

  • 5

    BártíkováH.VokřálI.SkálováL.LamkaJ.SzotákováB. (2010). In vitro oxidative metabolism of xenobiotics in the lancet fluke (Dicrocoelium dendriticum) and the effects of albendazole and albendazole sulphoxide ex vivo.Xenobiotica40593601. 10.3109/00498254.2010.497565

  • 6

    BergM.García-HernándezR.CuypersB.VanaerschotM.ManzanoJ. I.PovedaJ. A.et al (2015). Experimental resistance to drug combinations in Leishmania donovani: metabolic and phenotypic adaptations.Antimicrob. Agents Chemother.5922422255. 10.1128/AAC.04231-14

  • 7

    ChavezB.Cedillo-RiveraR.Martinez-PalomoA. (1992). Giardia lamblia: ultrastructural study of the in vitro effect of benzimidazoles.J. Protozool.39510515. 10.1111/j.1550-7408.1992.tb04841.x

  • 8

    DasS.StevensT.CastilloC.VillasenõrA.ArredondoH.ReddyK. (2002). Lipid metabolism in mucous-dwelling amitochondriate protozoa.Int. J. Parasitol.32655675. 10.1016/S0020-7519(02)00006-1

  • 9

    DaviesC.DeyN.NegretteO. S.ParadaL. A.BasombrioM. A.GargN. J. (2014). Hepatotoxicity in mice of a novel anti-parasite drug candidate hydroxymethylnitrofurazone: a comparison with Benznidazole.PLoS Negl. Trop. Dis.8:e3231. 10.1371/journal.pntd.0003231

  • 10

    DayanA. D. (2003). Albendazole, mebendazole and praziquantel. Review of non-clinical toxicity and pharmacokinetics.Acta. Trop.86141159. 10.1016/S0001-706X(03)00031-7

  • 11

    DiawaraA.HalpennyC. M.ChurcherT. S.MwandawiroC.KiharaJ.KaplanR. M.et al (2013). Association between response to albendazole treatment and β-tubulin genotype frequencies in soil-transmitted helminths.PLoS Negl. Trop. Dis.7:e2247. 10.1371/journal.pntd.0002247

  • 12

    DimitrijevićB.BorozanS.Katić-RadivojevićS.StojanovićS. (2012). Effects of infection intensity with Strongyloides papillosus and albendazole treatment on development of oxidative/nitrosative stress in sheep.Vet. Parasitol.186364375. 10.1016/j.vetpar.2011.11.017

  • 13

    GardnerT. B.HillD. R. (2001). Treatment of giardiasis.Clin. Microbiol. Rev.14114128. 10.1128/CMR.14.1.114-128.2001

  • 14

    Gérard-MonnierD.ErdelmeierI.RégnardK.Moze-HenryN.YadanJ. C.ChaudièreJ. (1998). Reactions of 1-methyl-2-phenylindole with malondialdehyde and 4-hydroxyalkenals. Analytical applications to a colorimetric assay of lipid peroxidation.Chem. Res. Toxicol.1111761183. 10.1021/tx9701790

  • 15

    GerphagnonM.LatourD.ColombetJ.Sime-NgandoT. (2013). A double staining method using SYTOX green and calcofluor white for studying fungal parasites of phytoplankton.Appl. Environ. Microbiol.7939433951. 10.1128/AEM.00696-613

  • 16

    GhoshE.GhoshA.GhoshA. N.NozakiT.GangulyS. (2009). Oxidative stress-induced cell cycle blockage and a protease-independent programmed cell death in microaerophilic Giardia lamblia.Drug. Des. Devel. Ther.3103110.

  • 17

    GibsonG. R.RamirezD.MaierJ.CastilloC.DasS. (1999). Giardia lamblia: incorporation of free and conjugated fatty acids into glycerol-based phospholipids.Exp. Parasitol.92111. 10.1006/expr.1999.4389

  • 18

    HansenT. V.ThamsborgS. M.OlsenA.PrichardR. K.NejsumP. (2013). Genetic variations in the beta-tubulin gene and the internal transcribed spacer 2 region of Trichuris species from man and baboons.Parasit Vectors.6:236. 10.1186/1756-3305-6-236

  • 19

    HofštetrováK.UzlíkováM.TůmováP.TroellK.SvärdS. G.NohýnkováE. (2010). Giardia intestinalis: aphidicolin influence on the trophozoite cell cycle.Exp. Parasitol.124159166. 10.1016/j.exppara.2009.09.004

  • 20

    KeisterD. B. (1983). Axenic culture of Giardia lamblia in TYI-S-33 medium supplemented with bile.Trans. R. Soc. Trop. Med. Hyg.77487488. 10.1016/0035-9203(83)90120-7

  • 21

    KriskoA.RadmanM. (2010). Protein damage and death by radiation in Escherichia coli and Deinococcus radiodurans.Proc. Natl. Acad. Sci. U.S.A.1071437314377. 10.1073/pnas.1009312107

  • 22

    LaneS.LloydD. (2002). Current trends in research into the waterborne parasite Giardia.Crit. Rev. Microbiol.28123147. 10.1080/1040-840291046713

  • 23

    LehaneA. M.McDevittC. A.KirkK.FidockD. A. (2012). Degrees of chloroquine resistance in Plasmodium – is the redox system involved?Int. J. Parasitol. Drugs Drug Resist.24757. 10.1016/j.ijpddr.2011.11.001

  • 24

    LeméeV.ZahariaI.NevezG.RabodonirinaM.BrasseurP.BalletJ. J.et al (2000). Metronidazole and albendazole susceptibility of 11 clinical isolates of Giardia duodenalis from France.J. Antimicrob. Chemother.46819821. 10.1093/jac/46.5.819

  • 25

    LiL.WangC. C. (2006). A likely molecular basis of the susceptibility of Giardia lamblia towards oxygen.Mol. Microbiol.59202211. 10.1111/j.1365-2958.2005.04896.x

  • 26

    LocatelliC.PedrosaR. C.De BemA. F.Creczynski-PasaT. B.CordovaC. A.Wilhelm-FilhoD. (2004). A comparative study of albendazole and mebendazole-induced, time-dependent oxidative stress.Redox. Rep.98995. 10.1179/135100004225004751

  • 27

    MarianteR. M.VanciniR. G.MeloA. L.BenchimolM. (2005). Giardia lamblia: evaluation of the in vitro effects of nocodazole and colchicine on trophozoites.Exp. Parasitol.1106272. 10.1016/j.exppara.2005.01.007

  • 28

    MastronicolaD.FalabellaM.TestaF.PucilloL. P.TeixeiraM.SartiP.et al (2014). Functional characterization of peroxiredoxins from the human protozoan parasite Giardia intestinalis.PLoS Negl. Trop. Dis.8:e2631. 10.1371/journal.pntd.0002631

  • 29

    MøllerI. M.Rogowska-WrzesinskaA.RaoR. S. (2011). Protein carbonylation and metal-catalyzed protein oxidation in a cellular perspective.J. Proteomics.7422282242. 10.1016/j.jprot.2011.05.004

  • 30

    MooreC. J.ShaoC. H.NagaiR.KuttyS.SinghJ.BidaseeK. R. (2013). Malondialdehyde and 4-hydroxynonenal adducts are not formed on cardiac ryanodine receptor (RyR2) and sarco(endo)plasmic reticulum Ca2+-ATPase (SERCA2) in diabetes.Mol. Cell. Biochem.376121135. 10.1007/s11010-013-1558-1

  • 31

    MüllerJ.SterkM.HemphillA.MüllerN. (2007). Characterization of Giardia lamblia WB C6 clones resistant to nitazoxanide and to metronidazole.J. Antimicrob. Chemother.60280287. 10.1093/jac/dkm205

  • 32

    NandiM.SarkarS. (2013). Albendazole-induced recurrent hepatitis.Indian Pediatr.501064. 10.1007/s13312-013-0285-8

  • 33

    NashT. E. (2013). Unraveling how Giardia infections cause disease.J. Clin. Invest.12323462347. 10.1172/JCI69956

  • 34

    Orozco-IbarraM.Medina-CamposO. N.Sánchez-GonzálezD. J.Martínez-MartínezC. M.Floriano-SánchezE.SantamaríaA.et al (2007). Evaluation of oxidative stress in D-serine induced nephrotoxicity.Toxicology229123135. 10.1016/j.tox.2006.10.008

  • 35

    OxberryM. E.ReynoldsonJ. A.ThompsonR. C. (2000). The binding and distribution of albendazole and its principal metabolites in Giardia duodenalis.J. Vet. Pharmacol. Ther.23113120. 10.1046/j.1365-2885.2000.00254.x

  • 36

    PalC.BandyopadhyayU. (2012). Redox-active antiparasitic drugs.Antioxid. Redox. Signal.17555582. 10.1089/ars.2011.4436

  • 37

    PalD.BanerjeeS.CuiJ.SchwartzA.GhoshS. K.SamuelsonJ. (2009). Giardia, Entamoeba, and Trichomonas enzymes activate metronidazole (nitroreductases) and inactivate metronidazole (nitroimidazole reductases).Antimicrob. Agents Chemother.53458464. 10.1128/AAC.00909-08

  • 38

    Paz-MaldonadoM. T.Argüello-GarcíaR.Cruz-SotoM.Mendoza-HernándezG.Ortega-PierresG. (2013). Proteomic and transcriptional analyses of genes differentially expressed in Giardia duodenalis clones resistant to albendazole.Infect. Genet. Evol.151017. 10.1016/j.meegid.2012.08.021

  • 39

    PlutzerJ.OngerthJ.KaranisP. (2010). Giardia taxonomy, phylogeny and epidemiology: facts and open questions.Int. J. Hyg. Environ. Health.213321333. 10.1016/j.ijheh.2010.06.005

  • 40

    PooleK. (2014). Stress responses as determinants of antimicrobial resistance in Pseudomonas aeruginosa: multidrug efflux and more.Can. J. Microbiol.60783791. 10.1139/cjm-2014-2666

  • 41

    RajD.GhoshE.MukherjeeA. K.NozakiT.GangulyS. (2013). Differential gene expression in Giardia lamblia under oxidative stress: significance in eukaryotic evolution.Gene.535131139. 10.1016/j.gene.2013.11.048

  • 42

    ReaumeC.MooreB.HernándezP.RuzziniA.ChlebusM.WassermanM.et al (2013). Evaluation of drugs and stationary growth on the cell cycle of Giardia intestinalis.Mol. Biochem. Parasitol.1877276. 10.1016/j.molbiopara.2012.11.005

  • 43

    RobinsonM. W.McFerranN.TrudgettA.HoeyL.FairweatherI. (2004). A possible model of benzimidazole binding to beta-tubulin disclosed by invoking an inter-domain movement.J. Mol. Graph. Model.23275284. 10.1016/j.jmgm.2004.08.001

  • 44

    RossignolJ. F. (2010). Cryptosporidium and Giardia: treatment options and prospects for new drugs.Exp. Parasitol.1244553. 10.1016/j.exppara.2009.07.005

  • 45

    RossignolJ. F.Lopez-ChegneN.JulcamoroL. M.CarrionM. E.BardinM. C. (2012). Nitazoxanide for the empiric treatment of pediatric infectious diarrhea.Trans. R. Soc. Trop. Med. Hyg.106167173. 10.1016/j.trstmh.2011.11.007

  • 46

    Solaymani-MohammadiS.GenkingerJ. M.LoffredoC. A.SingerS. M. (2010). A meta-analysis of the effectiveness of albendazole compared with metronidazole as treatments for infections with Giardia duodenalis.PLoS Negl. Trop. Dis.4:e682. 10.1371/journal.pntd.0000682

  • 47

    SuzukiK.OjimaM.KodamaS.WatanabeM. (2006). Delayed activation of DNA damage checkpoint and radiation-induced genomic instability.Mutat. Res.5977377. 10.1016/j.mrfmmm.2005.04.024

  • 48

    Tejman-YardenN.EckmannL. (2011). New approaches to the treatment of giardiasis.Curr. Opin. Infect. Dis.24451456. 10.1097/QCO.0b013e32834ad401

  • 49

    TianH. F.ChenB.WenJ. F. (2010). Giardiasis, drug resistance, and new target discovery.Infect. Disord. Drug Targets.10295302. 10.2174/187152610791591629

  • 50

    UpcroftJ.MitchellR.ChenN.UpcroftP. (1996). Albendazole resistance in Giardia is correlated with cytoskeletal changes but not with a mutation at amino acid 200 in beta-tubulin.Microb. Drug Resist.2303308. 10.1089/mdr.1996.2.303

  • 51

    UpcroftP.UpcroftJ. A. (2001). Drug targets and mechanisms of resistance in the anaerobic protozoa.Clin. Microbiol. Rev.14150164. 10.1128/CMR.14.1.150-164.2001

  • 52

    UzlikovaM.NohynkovaE. (2015). The effect of metronidazole on the cell cycle and DNA inmetronidazole-susceptible and –resistant Giardia cell lines.Mol. Biochem. Parasitol.1987581. 10.1016/j.molbiopara.2015.01.005

  • 53

    VonlaufenN.NaguleswaranA.CoppensI.SullivanW. J.Jr. (2010). MYST family lysine acetyltransferase facilitates ataxia telangiectasia mutated (ATM) kinase-mediated DNA damage response in Toxoplasma gondii.J. Biol. Chem.2851115411161. 10.1074/jbc.M109.066134

  • 54

    WatkinsR. R.EckmannL. (2014). Treatment of giardiasis: current status and future directions.Curr. Infect. Dis. Rep.16396. 10.1007/s11908-014-0396-y

Summary

Keywords

Giardia duodenalis, albendazole, oxidative stress, DNA damage, apoptosis

Citation

Martínez-Espinosa R, Argüello-García R, Saavedra E and Ortega-Pierres G (2015) Albendazole induces oxidative stress and DNA damage in the parasitic protozoan Giardia duodenalis. Front. Microbiol. 6:800. doi: 10.3389/fmicb.2015.00800

Received

13 March 2015

Accepted

22 July 2015

Published

06 August 2015

Volume

6 - 2015

Edited by

Anjan Debnath, University of California, San Diego, USA

Reviewed by

Nigel Yarlett, Pace University, USA; Tomoyoshi Nozaki, National Institute of Infectious Diseases, Japan

Copyright

*Correspondence: Guadalupe Ortega-Pierres, Departamento de Genética y Biología Molecular, Centro de Investigación y de Estudios Avanzados del Instituto Politécnico Nacional, Avenue Instituto Politécnico Nacional 2508, San Pedro Zacatenco, 07360 México City, Mexico,

This article was submitted to Antimicrobials, Resistance and Chemotherapy, a section of the journal Frontiers in Microbiology

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics