ORIGINAL RESEARCH article

Front. Plant Sci., 16 May 2017

Sec. Technical Advances in Plant Science

Volume 8 - 2017 | https://doi.org/10.3389/fpls.2017.00776

Validation of Suitable Reference Genes for RT-qPCR Data in Achyranthes bidentata Blume under Different Experimental Conditions

  • 1. College of Life Sciences, Henan Normal University Xinxiang, China

  • 2. Engineering Technology Research Center of Nursing and Utilization of Genuine Chinese Crude Drugs Xinxiang, China

Abstract

Real-time quantitative polymerase chain reaction (RT-qPCR) is a sensitive technique for gene expression studies. However, choosing the appropriate reference gene is essential to obtain reliable results for RT-qPCR assays. In the present work, the expression of eight candidate reference genes, EF1-α (elongation factor 1-α), GAPDH (glyceraldehyde 3-phosphate dehydrogenase), UBC (ubiquitin-conjugating enzyme), UBQ (polyubiquitin), ACT (actin), β-TUB (β-tubulin), APT1 (adenine phosphoribosyltransferase 1), and 18S rRNA (18S ribosomal RNA), was evaluated in Achyranthes bidentata samples using two algorithms, geNorm and NormFinder. The samples were classified into groups according to developmental stages, various tissues, stresses (cold, heat, drought, NaCl), and hormone treatments (MeJA, IBA, SA). Suitable combination of reference genes for RT-qPCR normalization should be applied according to different experimental conditions. In this study, EF1-α, UBC, and ACT genes were verified as the suitable reference genes across all tested samples. To validate the suitability of the reference genes, we evaluated the relative expression of CAS, which is a gene that may be involved in phytosterol synthesis. Our results provide the foundation for gene expression analysis in A. bidentata and other species of Amaranthaceae.

Introduction

Real-time quantitative polymerase chain reaction (RT-qPCR) has become one of the most efficient and powerful techniques to study molecular biology analysis of gene expression and is widely used because of its reproducibility, accuracy, quantity, and sensitivity in gene expression analysis. Although RT-qPCR is a powerful technique, the results of RT-qPCR data analysis are often affected by different variables, such as RNA purity, RNA quantity, DNA contamination, PCR amplification efficiency, and reverse transcription efficiency (Zhu et al., 2013). To control these variables, it is essential to select one or more suitable reference genes as the commonly applied method for normalizing RT-qPCR data (Guénin et al., 2009; Chen et al., 2011; Kundu et al., 2013).

Traditional housekeeping genes that are universally expressed in all cells are often used as reference genes (Xu et al., 2011), such as GAPDH, 18S rRNA, ACT, UBQ, EF1-α, β-TUB, and UBC (Wang et al., 2014; Xiao et al., 2014). However, these traditional housekeeping genes are not always stably expressed in all species or experiments. Therefore, it is need to select appropriate reference genes that has a consistent level of expression under specific experimental conditions. At present, several studies on the evaluation and validation of reference genes have been carried out for many plant species, such as Arabidopsis thaliana (Czechowski et al., 2005; Remans et al., 2008), potato (Nicot et al., 2005), coffee (Barsalobres-Cavallari et al., 2009; Cruz et al., 2009; de Carvalho et al., 2013), rice (Kim et al., 2003; Jain et al., 2006), tomato (Expósito-Rodríguez et al., 2008; Mascia et al., 2010), wheat (Paolacci et al., 2009), pearl millet (Shivhare and Lata, 2016), barley (Burton et al., 2004), Brassica napus (Wang et al., 2014), radish (Xu et al., 2012), apple (Perini et al., 2014), rose (Meng et al., 2013), soybean (Jian et al., 2008; Hu et al., 2009), sugarcane (Iskandar et al., 2004), peanut (Jiang et al., 2011), tobacco (Schmidt and Delaney, 2010), banana (Chen et al., 2011), Buchloe dactyloides (Li W. et al., 2015), Salicornia europaea (Xiao et al., 2014), flixweed (Xu et al., 2016), kiwifruit (Ferradás et al., 2016), pear (Xu et al., 2015), and Solanum lycopersicum L. (Fuentes et al., 2016). However, systematic evaluation of the selection of suitable reference genes for RT-qPCR data normalization in Achyranthes bidentata under various experiments has not been reported.

Achyranthes bidentata Blume (Amaranthaceae) is a perennial herbaceous plant. It grows mainly on the hillsides or roadsides, about 200–1750 m above sea level, and is widely distributed in China, India, Java, and Japan (Yang et al., 2012; Li Y. et al., 2015). A. bidentata is one of the most important Chinese traditional medicinal herbs (Liu et al., 2015). It has been frequently used as a diuretic, antipyretic, antirheumatic, and anti-inflammatory drug (Nikolov et al., 1996; Wattel et al., 2004; Li et al., 2005; Jin et al., 2007; Chen et al., 2009; Zhu et al., 2012). In view of its important medical value, the production of A. bidentata is gaining more attention. However, the yield of A. bidentata is seriously reduced because the growth is influenced by the biotic and abiotic treatment (Li Y. et al., 2015). Some researches on A. bidentata are focused at the molecular and biochemical levels. Understanding the expression patterns of some key genes involved in pathway of active components biosynthesis will help understand accumulation and dynamic trends of triterpenoid saponin and ecdysterone in vegetative organs of A. bidentata. Furthermore, studies of the molecular events associated with stress responses of A. bidentata to multifarious exogenous regulators may also help us understand what causes the loss of A. bidentata. At present, RT-qPCR studies in A. bidentata are still limited by the use of unsuitable reference genes. Therefore, the selection of the most stable reference genes for A. bidentata is essential.

In the present study, we evaluated the stability of eight candidate reference genes (GAPDH, 18S rRNA, UBQ, EF1-α, UBC, β-TUB, APT1, ACT) for normalization across set of biological samples representing A. bidentata under different experiments. Two statistical algorithms such as geNorm version 3.5 (Vandesompele et al., 2002) and NormFinder (Andersen et al., 2004) were used to evaluate the most suitable reference genes for a given set of biological samples (Ferradás et al., 2016). To the best of our knowledge, this is the first systematic screening of the appropriate reference gene under a variety of experimental conditions for normalizing gene expression analyses using RT-qPCR in A. bidentata. The results will benefit future gene expression analysis in A. bidentata and other species of Amaranthaceae.

Materials and Methods

Plant Materials and Treatments

This experiment was carried out using the seeds of A. bidentata, which were collected from the Wenxian Agricultural Science Institute of Henan Province in China. Seeds were grown in 1 L plastic pots filled with soil (50% nutrient soil, 50% vermiculite sand), and in a greenhouse under growth conditions of 25 ± 2°C, a photoperiod of 14 h, and 20–40% relative humidity. After germination, seedlings were irrigated weekly with Hoagland’s solution.

For samples of six different developmental stages, materials were sampled at the cotyledon, and 1, 2, 3, 4, 5 euphylla stage after germination. The cotyledon, stem, root, and euphylla of seedlings were separated and collected in triplicate, promptly frozen in liquid nitrogen, and finally stored at -80°C.

Material from five separate organs, including cotyledon, euphylla, branch, stem, and root were collected in three replicates, immediately frozen in liquid nitrogen, and stored at -80°C.

Four-week-old seedlings were used to various abiotic and biotic treatments. For cold and heat treatments, plants were grown at temperature of 4 and 42°C for 0, 1, 3, 6, 9, and 12 h, respectively. For drought treatment, plants seedlings were irrigated with 5, 10, and 15% PEG, and leaves were collected at 0, 6, 12, 24, 48 h. For NaCl treatment, seedlings were irrigated with 200 mM NaCl and leaves were collected at 0, 1, 3, 6, 12, 24 h. For hormone treatments, leaves were collected at 0, 1, 2, 3, and 4 days, after seedlings were sprayed with sufficient 1 mg/L MeJA, 1 mg/L IBA, and 3 mg/L SA solutions. The leaves of samples were collected in triplicate, immediately frozen in liquid nitrogen and stored at -80°C until further experiments.

Total RNA Isolation and cDNA Synthesis

Approximately 100 mg of frozen samples were ground in liquid nitrogen using a pestle and a mortar. Total RNA was extracted from different samples using Trizol reagent (Takara, Japan). A NanoDrop 2000 Spectrophotometer was used to determine the purity and concentration of total RNA. The integrity of the isolated RNA was verified by 1% agarose gel. Only the RNA samples with absorbance ratio at A260/A280 = 1.8∼2.2 and A260/A230 = 2.0 were used for further analysis. For each sample, 1 mg of total RNA was used for first strand cDNA synthesis according to the manufacturer’s instructions (HiScript® 1st Strand cDNA Synthesis Kit, Vazyme, China). The cDNA products diluted with nuclease-free water in the ratio 1:10 were used in RT-qPCR studies.

Selection of Candidate Genes and Primer Design

The eight common candidate housekeeping genes were selected based on the studies on other species (Czechowski et al., 2005; Jain et al., 2006; Lin and Lai, 2010; Chen et al., 2011; Perini et al., 2014; Wang et al., 2014; Xiao et al., 2014). In this experiment, these genes include: EF1-α, GAPDH, UBC, UBQ, ACT, β-TUB, APT1, 18S rRNA. Sequences of 18S rRNA was obtained from National Center for Biotechnology Information (NCBI, USA). The sequences of other selected genes were collected from the A. bidentata transcriptome database (PRJNA350183), which was obtained by high-throughput Illumina sequencing (Li et al., 2016b).

Specific primers for RT-qPCR analysis were designed using Primer Premier 5.0 software (Table 1). A standard curve was repeated in three dependent plates using a 10-fold dilution series ([1/1], [1/10], [1/100], [1/1000], [1/10000]) of the mixed cDNA from all tested samples as the template and it was used to calculate the correlation coefficient (R2) and gene specific PCR amplification efficiency (E = 10-1/slope) of each gene (Radonic et al., 2004) (Table 1). The specificity of the all primer pairs of candidate reference genes and target gene were verified by agarose gel electrophoresis (3%) and melting curve analysis.

Table 1

Gene symbolGene nameRNA-Seq numberPrimer sequence (5′–3′)Amplicon length (bp)Amplification efficiencyR2
EF1-αElongation factor 1-αUN011764GAGGCTGCTGAGATGAACAA1662.0480.981
TGATAAAGTCACGGTGTCCAG
β-TUBβ-tubulinUN053874GCTTACTTTCTCCGTGTTCC1371.9440.992
TGTCATAAAGAGCCTCATTGTC
ACTActinUN011760CCAAGGGCTGTCTTTCCA801.9070.988
TAGGCATCCTTCTGTCCCAT
18SrRNA18S ribosomal RNACAGAACATCTAAGGGCATCACA1.9310.996
TAGTTGGTGGAGCGATTTGTCT
GAPDHGlyceraldehyde 3-phosphate dehydrogenaseUN053070GGTCACAGGAACCCAGAGG1681.8070.980
AACGACAAACATTGGAGCATC
UBCUbiquitin-conjugating enzymeUN008343AGAGGTTGATGCGGGATTTC1012.080.981
GATAACGGCATTCCAGAGCA
UBQPolyubiquitinUN005599CGATTGATAATGTGAAGGCG1671.9640.998
CTGACCACCACGAAGACGA
APT1Adenine phosphoribosyltransferase 1UN001675GCATGTGGGTGCAGTAGAA1102.0130.995
GCACTCCTACACGCTCAAG
CASCycloartenol synthaseContig7815AGATGTTGAGGGAGAAGGCG1581.8650.993
GGTCTTCCACCCAACAACAAA

Candidate A. Bidentata reference genes and target genes, primer sequences and amplicon characteristics.

Real-Time Quantitative PCR

All reactions were carried out in 96-well optical plates with a LightCycler 96 (Roche, Switzerland) with SYBR®Green Master Mix (Vazyme, China). Each reaction mixture contained 0.4 μL of each primer, 10 μL of SYBR®Green Master Mix, 2 μL of diluted cDNA (1:10), and 7.2 μL of double distilled water to a final volume of 20 μL. Following cycling conditions were applied: 95°C for 5 min, 40 cycles at 95°C for 10 s and 60°C for 30 s in 96-well optical reaction plates. The melting curve was analyzed at 60–95°C after 40 cycles. All RT-qPCR reactions were carried out in biological triplicates with three technical replicates per experiment, and three no-template controls in every run were included to avoid possible DNA contamination.

Data Statistics

The expression stability of each reference gene through samples was statistically analyzed using geNorm version 3.5 (Vandesompele et al., 2002) and NormFinder (Andersen et al., 2004), which were used as described in their instructions manual. For these analyses, the mean of the Cq values were changed into relative quantities for genes. The relative quantities of gene were imported into NormFinder and geNorm for further analysis. All other statistical computations were performed in Microsoft Excel 2007.

Normalization of CAS

In order to validate the usefulness of the optimal reference genes in RT-qPCR, the relative expression levels of A. bidentata gene, CAS is not only a key enzyme gene involved in phytosterol synthesis, but also an important regulatory site for triterpenoid synthesis (Kim et al., 2005; Liang et al., 2009; Zhong et al., 2010). The CAS gene was analyzed using the one or two most stable reference genes and the most unstable reference gene. The primer pairs used for the RT-qPCR analysis of CAS gene are listed in Table 1. The relative expression levels of the CAS were assessed according to the 2-ΔΔCt method (Livak and Schmittgen, 2001) under heat treatment. The expression level of pre-treatment samples (controls) was set to a value of 1.

Results

Verification of Primer Specificity, PCR Efficiency Analysis

In order to verify the specificity of the all primer pairs for these candidate reference genes and one target genes, agarose gel electrophoresis (3%) and melting curve analysis were carried out using RT-qPCR. The results of agarose gel electrophoresis (Figure 1) showed that all the candidate reference genes were specifically amplified with a very single band of the anticipated fragment size, and primer dimmers or other non-specific amplification products could not be detected on the agarose gel electrophoresis (Figure 1). Melting curve analyses of the each internal reference gene after 40 cycles had a single peak (Figure 2). These indicated that the eight primer pairs were specific and could be used for the gene expression analysis of RT-qPCR. For each candidate gene, the efficiencies (E) of each primer pair ranged from 1.807 to 2.069 (Table 1) and the correlation coefficients (R2) had a range of 0.971∼0.998 over 104 fold of cDNA dilution (Table 1).

FIGURE 1

FIGURE 2

Expression Profile of Reference Genes

Analysis of the raw expression levels of each candidate reference gene (EF1-α, GAPDH, UBC, UBQ, ACT, APT1, 18S rRNA, β-TUB) was assessed across all samples (Figure 3). In order to obtain reliable results, all RT-qPCR experiments were performed in three technical replicates. The Cq (Bustin et al., 2009) values of the eight reference genes ranged from 10.44 to 28.41 in all tested samples, while the majority of these values were between 18.44 and 23.52 (Figure 3). The UBQ and UBC showed low variability than other candidate reference genes in all the tested samples, with their Cq values ranging from 17.38 to 23.86667 and 20.45 to 27.89667, respectively (Figure 3). In addition, GAPDH, APT1, β-TUB, and EF1-α showed medium variability, with Cq values of 16.88667–26.7, 18.78–28.045, 19.33–32.075, and 15.64333–26.07, respectively. β-TUB and 18S rRNA indicated high variability, with Cq values of 10.44–23.82 and 19.33-32.075, respectively, while this two genes presented a wider interquartile range than other candidate reference genes in all the tested samples. This indicated that none of the selected genes had a constant level of expression in various tested experiments. Therefore, it is necessary to select suitable reference genes for use in gene expression normalization under different experimental conditions.

FIGURE 3

Evaluative of the Expression Stability of Candidate Reference Genes

In order to obtain reliable dataset of the reference genes for 12 groups of samples, two software programs (geNorm and NormFinder) were used to evaluate gene stability. The stability values were determined only in the sample sets of different experimental conditions.

GeNorm Analysis

The gene expression stability measure (M) of the eight genes was the parameter that was assessed using geNorm software (Vandesompele et al., 2002). The Cq values for each cDNA sample was transformed to relative expression levels according to the formula Q = 2-ΔCt (ΔCt = Ct value of each sample – the minimum Ct value), where 2 stand for 100% efficiency (Livak and Schmittgen, 2001; Ramakers et al., 2003) and then evaluated on the basis of the manual. The average expression stability values (M) were calculated at stepwise exclusion of the gene with the least stable reference gene until two best genes were generated. For each group, the gene with the lowest M-value was regarded as the most stable expression. Among the eight candidate reference genes used in the analysis, not all the reference genes had constant expression in the different experimental conditions (Figures 4, 5). The UBC and EF1-α were the two most stable reference genes in all the tested samples. In the different organ sample sets, UBC and ACT were found to be the most stably expressed. The UBQ and β-TUB, β-TUB, and EF1-α, and UBC and ACT were the best reference genes for normalization in samples at the different developmental stages of roots, stems, and leaves, respectively. For salt treatment, EF1-α and APT1 were evaluated by geNorm as the top two reference genes. In the cold treatment, GAPDH and APT1 were recognized as the most stable genes. The ACT and EF1-α were suggested as the most stable genes among the eight reference genes in heat treatment. The UBC and EF1-α genes ranked the highest in the drought treatment. For the MeJA, SA, and IBA hormone treatments, UBC and APT1, APT1 and UBC, GAPDH and UBC were chosen as the optimal reference genes, respectively.

FIGURE 4

FIGURE 5

The geNorm software was also used to determine the optimal number of reference genes required for accurate normalization in the different experimental conditions. The Pairwise variation (Vn/Vn+1) is an index to determine the minimum number of reference genes required for accurate RT-qPCR normalization in gene expression studies. Vandesompele et al. (2002) recommended using 0.15 as a cutoff value for selecting a suitable number of reference genes, and the additional reference genes below the value of 0.15 are not required for normalization. In our study, the V2/3 values of cold, stem, drought, MeJA, SA, and IBA were less than 0.15, suggesting that the optimal number of reference genes for normalization in these groups was at least two. For different organs and salt stress, the pairwise variation value of V3/4 was 0.126 and 0.134, respectively, suggesting that three reference genes were needed. For the root of different stages, the V5/6 value was 0.147, recommending the selection of five reference genes. However, Pairwise variation analysis (Figure 6) indicated that 0.15 is not an absolute cutoff value, but rather an ideal value (Vandesompele et al., 2002; Guénin et al., 2009; Paolacci et al., 2009; Wan et al., 2010). Other studies have shown that Pairwise variation is above 0.15 (Vn/Vn+1) for the species under consideration (Silveira et al., 2009). In our study, pairwise variation was higher than 0.15 for all the samples and for different subgroups. Based on these values, we recommended the selection of the top three ranked genes as reference genes for normalization, which is more accurate and reliable than using only one single reference gene.

FIGURE 6

NormFinder Analysis

The NormFinder is an algorithm to select the optimal candidate reference gene. It ranks the full set of candidate genes according to their expression stability in each sample set. NormFinder provides a stability value for each candidate gene, which is a direct measure for evaluating the expression variation when using genes for normalization (Andersen et al., 2004). The lowest expression stability value is the most stable gene.

The results of our analysis using NormFinder program are represented in Table 2. Many of the results were consistent with the results of the geNorm analysis. In the samples from different organs and MeJA treatment, UBQ and EF1-α were the optimal reference gene. Under the cold treatment and developmental stage (leaves), GAPDH and ACT displayed the best stability value. In the development stages (root and stem), β-TUB and UBC had the most stable expression. Under NaCl treatment, EF1-α and APT1 showed the common and high stable expression. EF1-α and GAPDH, GAPDH and UBC, ACT and APT1 were the two most stable genes under IBA, SA, and heat treatments, respectively. EF1-α and UBC had the most stable expression in all the tested samples and drought treatment (Table 2).

Table 2

TotalIBASAColdHeatMeJA






RankingStabilityRankingStabilityRankingStabilityRankingStabilityRankingStabilityRankingStability
EF 1-a0.011EF 1-a0.004GAPDH0.010GAPDH0.008ACT0.009UBQ0.004
UBC0.015GAPDH0.007UBC0.012ACT0.008APT10.013EF 1-a0.004
ACT0.031UBC0.014APT10.013EF 1-a0.010EF 1-a0.013GAPDH0.008
UBQ0.035ACT0.018EF 1-a0.017UBC0.012UBC0.023β-TUB0.022
GAPDH0.052UBQ0.019ACT0.022APT10.014UBQ0.039ACT0.023
β-TUB0.059APT10.038UBQ0.026UBQ0.024β-TUB0.047APT10.030
APT10.078β-TUB0.062β-TUB0.029β-TUB0.069GAPDH0.104UBC0.032
18SrRNA0.12018S rRNA0.11818S rRNA0.07918S rRNA0.15918S rRNA0.13218S rRNA0.173

DroughtDifferent organsRootStemLeafNaCl






RankingStabilityRankingStabilityRankingStabilityRankingStabilityRankingStabilityRankingStability

EF 1-a0.007UBQ0.015UBC0.016UBC0.009GAPDH0.009EF 1-a0.007
UBC0.008EF 1-a0.015β-TUB0.016β-TUB0.011ACT0.011APT10.007
GAPDH0.020UBC0.023ACTIN0.027EF 1-a0.011UBC0.013UBC0.020
UBQ0.022ACTIN0.028EF 1-a0.029ACTIN0.017UBQ0.021UBQ0.025
ACT0.032β-TUB0.042UBQ0.044UBQ0.028EF 1-a0.025GAPDH0.039
β-TUB0.046GAPDH0.046GAPDH0.055GAPDH0.060β-TUB0.039β-TUB0.056
APT10.046APT10.07918s rRNA0.060APT10.100APT10.145ACT0.058
18S rRNA0.05318s rRNA0.124APT10.09318s rRNA0.10218s rRNA0.14818s rRNA0.093

Expression stability of the candidate reference genes calculated by NormFinder software.

Reference Gene Validation

In order to validate the selected reference gene for normalization, we analyzed the expression of CAS using RT-qPCR under the heat treatment. Our results showed that the expression level of CAS in leaf decreased obviously during heat treatment and there was only a slight difference between ACT and the combination of ACT+ EF1-α reference gene(s) for normalization (Figure 7). However, when 18S rRNA was used as the most unstable reference gene, the CAS gene change patterns were completely changed during normalization under heat treatment (Figure 7). These results clearly indicated that the use of improper reference gene could lead to misleading results for the normalization of target gene. Thus, the results of our analysis further emphasized the need of selecting appropriate reference gene stability prior to RT-qPCR study, to avoid low accuracy.

FIGURE 7

Discussion

Real-time quantitative PCR as a common technique has been widely used for gene expression analysis in plant species. However, increasing numbers of studies have shown that the selection of unsuitable reference genes could create deviation in results for the expression profile of genes (Gutierrez et al., 2008; Mascia et al., 2010; Wang et al., 2014; Li et al., 2016a; Zhao et al., 2016). Therefore, it is essential to select the appropriate reference gene with the stable expression levels in different experimental conditions in A. bidentata.

GeNorm and NormFinder are the two most commonly used software for analyzing the expression stability of candidate reference genes and selecting the most appropriate reference gene sets under certain cases. The two software analysis results are not entirely consistent, probably because of the different statistical algorithms (Hu et al., 2010). Recent studies have shown that analyses in geNorm and NormFinder softwares generate similar results, with only slight difference in ranking orders (Cruz et al., 2009; Lee et al., 2010; Zhao et al., 2016). Our study observed several relevant differences between the two methods as well. However, no matter how the ranking changed, the most unstable gene was the same in both geNorm and NormFinder analyses in all the sample sets, which had been identified based on other species (Artico et al., 2010; Lopez-Pardo et al., 2013; Wang et al., 2014; Li et al., 2016a; You et al., 2016). Therefore, the expression stability value of each gene and the suitable reference genes were obtained by two software packages. Combining the results of the two algorithms together is more reliable when determining the appropriate internal reference genes for normalization.

We evaluated the expression stability of eight candidate reference genes in different organs, during developmental stages and under seven treatments in A. bidentata. When all sample groups were evaluated in A. bidentata, the three top genes were selected for normalization of gene expression (Figure 5 and Table 2). EF1-α was ranked first in both the drought and salt groups. The stability of EF1-α in A. bidentata was consistent with previous findings in Solanumly copersicum L. (Fuentes et al., 2016); however, EF1-α is unsuitable for normalization in Salicornia europaea under drought stress (Xiao et al., 2014). UBC was stable in organ group and different in development stages in root group in A. bidentata. Similar stable results have been shown by another group using different tissues in Salicornia europaea (Xiao et al., 2014). However, the stability varies by species. For example, UBC expressions fluctuated in different organs of bamboo (Fan et al., 2013). ACT is satisfactory for RT-qPCR normalization in A. bidentata. ACT was highly stable in banana (Chen et al., 2011). However, this gene was not a suitable reference in potato (Nicot et al., 2005). Studies evaluating reference genes in different species have diverse results.

In this study, different sample sets had their own best appropriate internal reference genes (Figures 4, 5 and Table 2). For instance, GAPDH and ACT were ranked as the most stable genes in cold treatment, whereas EF1-α and APT1 did better than GAPDH and ACT under NaCl treatment. For hormone treatments (MeJA and SA), UBQ and EF1-α, APT1 and UBC were suggested as the most stable reference genes, respectively. For drought treatment in different organs, EF1-α and UBC were chosen as the most stable reference genes. Our results indicated that specific sets of reference genes are needed in different experimental conditions. Similar results have been obtained in other studies, such as sugarcane (Xue et al., 2014), Jute (Niu et al., 2015), Cichorium intybus (Delporte et al., 2015), Buchloe dactyloides (Li W. et al., 2015), perennial ryegrass (Lee et al., 2010), and carrot (Campos et al., 2015). It should be pointed out that the most stable internal reference genes were screened out by evaluating eight candidate reference genes that were not frequently used in other plants because there are many reports suggesting that the reference genes are regulated differently in different plants species and they might also show different expression patterns (Maroufi et al., 2010; Chen et al., 2011; Ye et al., 2015; Zhuang et al., 2015). These results highlight the importance of selecting suitable reference gene for each experiment conditions, especially when the samples are very different.

An increasing number of studies have shown that only one reference gene is unsuitable for accurate normalization of RT-qPCR data and the selection of more than one reference genes could get more accurate data in RT-qPCR analysis of plants (Gu et al., 2011). Therefore, the number of reference genes should be considered when a large number of samples need to be analyzed (Lin and Lai, 2010). It is recommended that the number of reference genes to be used, should be determined according to the experimental conditions (Hu et al., 2009). In this work, two or three reference genes were a valid normalization strategy in most experimental cases. For root, five reference genes were needed for normalization. For leaves and heat treatment, we recommend using three reference genes as reference genes for normalization. Our results suggested that selecting a suitable combination of reference genes is necessary according to the different experimental conditions.

To determine the suitability of the reference genes in the present study, we used different reference genes for CAS gene normalization. The results showed that the most unstable reference gene for normalization led to significant differences (Figure 7). When one gene or the combination genes were used for normalization, the expression pattern of target gene produced slight differences (Figure 7). These results suggested that appropriate reference genes are crucial to achieve accurate RT-qPCR results and it was emphasized by the expression analysis of CAS. This study provided a foundation for more accurate and widespread use of RT-qPCR in the analysis of gene expression in A. bidentata.

Conclusion

Our results showed that different suitable reference genes for normalization should be selected depending on different experimental conditions. For different sample groups including cold, drought, MeJA, IBA, SA, and the stem of different stages, our study suggested the selection of GAPDH and ACT, EF1-α and UBC, EF1-α and UBQ, UBC and GAPDH, APT1 and UBC, and β-TUB and UBC, respectively, for normalizing RT-qPCR data. The UBC, EF1-α and UBQ, and EF1-α, APT1 and UBQ were the three most stable reference genes in the different organs and under NaCl treatment, respectively. For heat treatment, the leaves of different stages and whole samples, ACT, EF1-α and UBC were, respectively, the best reference genes. ACT, EF1-α, UBC, UBQ, and β-TUB were considered to be the best combination for root of different stages. These results will benefit to the future studies of gene expression in A. bidentata using RT-qPCR.

Statements

Author contributions

JL and XZ designed the project and revised the manuscript. XH, CW, WQ, WZ, and LT were performed the sample collection, analyzed the data and wrote the manuscript. All authors have read and approved the final manuscript.

Acknowledgments

This work was financially supported by the National Nature Science Foundation of China (81274076) and the Key Projects of Henan Province Colleges and Universities (17A180026).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

  • 1

    AndersenC. L.JensenJ. L.ØrntoftT. F. (2004). Normalization of real-time quantitative reverse transcription-PCR data: a model-based variance estimation approach to identify genes suited for normalization, applied to bladder and colon cancer data sets.Cancer Res.645245–5250. 10.1158/0008-5472.CAN-04-0496

  • 2

    ArticoS.NardeliS. M.BrilhanteO.Grossi-de-SaM. F.Alves-FerreiraM. (2010). Identification and evaluation of new reference genes in Gossypium hirsutum for accurate normalization of real-time quantitative RT-PCR data.BMC Plant Biol.10:49. 10.1186/1471-2229-10-49

  • 3

    Barsalobres-CavallariC. F.SeverinoF. E.MalufM. P.MaiaI. G. (2009). Identification of suitable internal control genes for expression studies in Coffea arabica under different experimental conditions.BMC Mol. Biol.10:1. 10.1186/1471-2199-10-1

  • 4

    BurtonR. A.ShirleyN. J.KingB. J.HarveyA. J.FincherG. B. (2004). The CesA gene family of barley. Quantitative analysis of transcripts reveals two groups of co-expressed genes.Plant Physiol.134224–236. 10.1104/pp.103.032904

  • 5

    BustinS. A.BenesV.GarsonJ. A.HellemansJ.HuggettJ.KubistaM.et al (2009). The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments.Clin. Chem.55611–622. 10.1373/clinchem.2008.112797

  • 6

    CamposM. D.FredericoA. M.NothnagelT.Arnholdt-SchmittB.CardosoH. (2015). Selection of suitable reference genes for reverse transcription quantitative real-time PCR studies on different experimental systems from carrot (Daucus carota L.).Sci. Hortic.186115–123. 10.1016/j.scienta.2014.12.038

  • 7

    ChenL.ZhongH. Y.KuangJ. F.LiJ. G.LuW. J.ChenJ. Y. (2011). Validation of reference genes for RT-qPCR studies of gene expression in banana fruit under different experimental conditions.Planta234377. 10.1007/s00425-011-1410-3

  • 8

    ChenQ.LiuZ.HeJ. H. (2009). Achyranthes bidentata polysaccharide enhances immune response in weaned piglets.Immunopharmacol. Immunotoxicol.31253–260. 10.1080/08923970802439795

  • 9

    CruzF.KalaounS.NobileP.ColomboC.AlmeidaJ.BarrosL. M. G.et al (2009). Evaluation of coffee reference genes for relative expression studies by quantitative real-time RT-PCR.Mol. Breed.23607–616. 10.1007/s11032-009-9259-x

  • 10

    CzechowskiT.StittM.AltmannT.UdvardiM. K.ScheibleW. R. (2005). Genome-wide identification and testing of superior reference genes for transcript normalization in Arabidopsis.Plant Physiol.1395–17. 10.1104/pp.105.063743

  • 11

    de CarvalhoK.Bespalhok FilhoJ. C.Dos SantosT. B.de SouzaS. G. H.VieiraL. G. E.PereiraL. F. P.et al (2013). Nitrogen starvation, salt and heat stress in coffee (Coffea arabica L.): identification and validation of new genes for qPCR normalization.Mol. Biotechnol.53315–325. 10.1007/s12033-012-9529-4

  • 12

    DelporteM.LegrandG.HilbertJ. L.GagneulD. (2015). Selection and validation of reference genes for quantitative real-time PCR analysis of gene expression in Cichorium intybus.Front. Plant Sci.6:651. 10.3389/fpls.2015.00651

  • 13

    Expósito-RodríguezM.BorgesA. A.Borges-PérezA.PérezJ. A. (2008). Selection of internal control genes for quantitative real-time RT-PCR studies during tomato development process.BMC Plant Biol.8:131. 10.1186/1471-2229-8-131

  • 14

    FanC. J.MaJ. M.GuoQ. R.LiX. T.WangH.LuM. Z. (2013). Selection of reference genes for quantitative real-time PCR in bamboo (Phyllostachys edulis).PLoS ONE8:e56573. 10.1371/journal.pone.0056573

  • 15

    FerradásY.ReyL.MartínezÓReyM.GonzálezM. V. (2016). Identification and validation of reference genes for accurate normalization of real-time quantitative PCR data in kiwifruit.Plant Physiol. Biochem.10227–36. 10.1016/j.plaphy.2016.02.011

  • 16

    FuentesA.OrtizJ.SaavedraN.SalazarL. A.MenesesC.ArriagadaC. (2016). Reference gene selection for quantitative real-time PCR in Solanum lycopersicum L. inoculated with the mycorrhizal fungus Rhizophagus irregularis.Plant Physiol. Biochem.101124–131. 10.1016/j.plaphy.2016.01.022

  • 17

    GuC.ChenS.LiuZ.ShanH.LuoH.GuanZ.et al (2011). Reference gene selection for quantitative real-time PCR in Chrysanthemum subjected to biotic and abiotic stress.Mol. Biotechnol.49192–197. 10.1007/s12033-011-9394-6

  • 18

    GuéninS.MauriatM.PellouxJ.Van WuytswinkelO.BelliniC.GutierrezL. (2009). Normalization of qRT-PCR data: the necessity of adopting a systematic, experimental conditions-specific, validation of references.J. Exp. Bot.60487–493. 10.1093/jxb/ern305

  • 19

    GutierrezL.MauriatM.GueninS.PellouxJ.LefebvreJ. F.LouvetR.et al (2008). The lack of a systematic validation of reference genes: a serious pitfall undervalued in reverse transcription-polymerase chain reaction (RT-PCR) analysis in plants.Plant Biotechnol. J.6609–618. 10.1111/j.1467-7652.2008.00346.x

  • 20

    HuR.FanC.LiH.ZhangQ.FuY. F. (2009). Evaluation of putative reference genes for gene expression normalization in soybean by quantitative real-time RT-PCR.BMC Mol. Biol.10:93. 10.1186/1471-2199-10-93

  • 21

    HuR.QiG.KongY.KongD.GaoQ.ZhouG. (2010). Comprehensive analysis of NAC domain transcription factor gene family in Populus trichocarpa.BMC Plant Biol.10:145. 10.1186/1471-2229-10-145

  • 22

    IskandarH. M.SimpsonR. S.CasuR. E.BonnettG. D.MacleanD. J.MannersJ. M. (2004). Comparison of reference genes for quantitative real-time polymerase chain reaction analysis of gene expression in sugarcane.Plant Mol. Biol. Rep.22325–337. 10.1007/BF02772676

  • 23

    JainM.NijhawanA.TyagiA. K.KhuranaJ. P. (2006). Validation of housekeeping genes as internal control for studying gene expression in rice by quantitative real-time PCR.Biochem. Biophys. Res. Commun.345646–651. 10.1016/j.bbrc.2006.04.140

  • 24

    JianB.LiuB.BiY.HouW.WuC.HanT. (2008). Validation of internal control for gene expression study in soybean by quantitative real-time PCR.BMC Mol. Biol.9:59. 10.1186/1471-2199-9-59

  • 25

    JiangS. J.SunY. J.WangS. H. (2011). Selection of reference genes in peanut seed by real-time quantitative polymerase chain reaction.Int. J. Food Sci. Technol.462191–2196. 10.1111/j.1365-2621.2011.02735.x

  • 26

    JinL. Q.ZhengZ. J.PengY.LiW. X.ChenX. M.LuJ. X. (2007). Opposite effects on tumor growth depending on dose of Achyranthes bidentata polysaccharides in C57BL/6 mice.Int. Immunopharmacol.7568–577. 10.1016/j.intimp.2006.12.009

  • 27

    KimB. R.NamH. Y.KimS. U.KimS. I.ChangY. J. (2003). Normalization of revere transcription quantitative-PCR with housekeeping genes in rice.Biotechnol. Lett.251869–1872. 10.1023/A:1026298032009

  • 28

    KimO. T.KimM. Y.HwangS. J.AhnJ. C.HwangB. (2005). Cloning and molecular analysis of cDNA encoding cycloartenol synthase from Centella asiatica (L.) Urban.Biotechnol. Bioproc. Eng.1016–22. 10.1007/BF02931177

  • 29

    KunduA.PatelA.PalA. (2013). Defining reference genes for qPCR normalization to study biotic and abiotic stress responses in Vigna mungo.Plant Cell Rep.321647–1658. 10.1007/s00299-013-1478-2

  • 30

    LeeJ. M.RocheJ. R.DonaghyD. J.ThrushA.SathishP. (2010). Validation of reference genes for quantitative RT-PCR studies of gene expression in perennial ryegrass (Lolium perenne L.).BMC Mol. Biol.11:8. 10.1186/1471-2199-11-8

  • 31

    LiJ.JiaH. X.HanX. J.ZhangJ.SunP.LuM. Z.et al (2016a). Selection of reliable reference genes for gene expression analysis under abiotic stresses in the desert biomass willow, Salix psammophila.Front. Plant Sci.7:1505. 10.3389/fpls.2016.01505

  • 32

    LiJ.WangC.HanX.QiW.ChenY.WangT.et al (2016b). Transcriptome analysis to identify the putative biosynthesis and transport genes associated with the medicinal components of Achyranthes bidentata Bl.Front. Plant Sci.7:1860. 10.3389/fpls.2016.01860

  • 33

    LiJ. X.HareyamaT.TezukaY.ZhangY.MiyaharaT.KadotaS. (2005). Five new oleanolic acid glycosides from Achyranthes bidentata with inhibitory activity on osteoclast formation.Planta Med.71673–679. 10.1055/s-2005-871275

  • 34

    LiW.QianY. Q.HanL.LiuJ. X.LiZ. J.JuG. S.et al (2015). Validation of candidate reference genes for gene expression normalization in Buchloe dactyloides using quantitative real-time RT-PCR.Sci. Hortic.19799–106.

  • 35

    LiY.ZhangW.FuZ.WangW.LiY. (2015). Isolation and characterization of microsatellite markers for Achyranthes bidentata (Amaranthaceae) using next-generation sequencing platform.Biochem. Syst. Ecol.61437–440. 10.1016/j.bse.2015.06.032

  • 36

    LiangY. L.ZhaoS. J.ZhangX. (2009). Antisense suppression of cycloartenol synthase results in elevated ginsenoside levels in Panax ginseng hairy roots.Plant Mol. Biol. Rep.27298–304. 10.1007/s11105-008-0087-7

  • 37

    LinY. L.LaiZ. X. (2010). Reference gene selection for qPCR analysis during somatic embryogenesis in longan tree.Plant Sci.178359–365. 10.1016/j.plantsci.2010.02.005

  • 38

    LiuY.WangZ.ZhangJ. (2015). Dietary Chinese Herbs [M].Vienna: Springer.

  • 39

    LivakK. J.SchmittgenT. D. (2001). Analysis of relative gene expression data using real-time quantitative PCR and the 2-ΔΔCT method.Methods25402–408. 10.1006/meth.2001.1262

  • 40

    Lopez-PardoR.de GalarretaJ. I. R.RitterE. (2013). Selection of housekeeping genes for qRT-PCR analysis in potato tubers under cold stress.Mol. Breed.3139–45. 10.1007/s11032-012-9766-z

  • 41

    MaroufiA.BockstaeleE. V.LooseM. D. (2010). Validation of reference genes for gene expression analysis in chicory (Cichorium intybus) using quantitative real-time PCR.BMC Mol. Biol.11:15. 10.1186/1471-2199-11-15

  • 42

    MasciaT.SantovitoE.GallitelliD.CilloF. (2010). Evaluation of reference genes for quantitative reverse-transcription polymerase chain reaction normalization in infected tomato plants.Mol. Plant Pathol.11805–816. 10.1111/j.1364-3703.2010.00646.x

  • 43

    MengY. L.LiN.TianJ.GaoJ. P.ZhangC. Q. (2013). Identification and validation of reference genes for gene expression studies in postharvest rose flower (Rosa hybrida).Sci. Hortic.15816–21. 10.1016/j.scienta.2013.04.019

  • 44

    NicotN.HausmanJ. F.HoffmannL.EversD. (2005). Housekeeping gene selection for real-time RT-PCR normalization in potato during biotic and abiotic stress.J. Exp. Bot.562907–2914. 10.1093/jxb/eri285

  • 45

    NikolovS.ThuanN.ZheljazkovV. (1996). Flavonoids from Achyranthes bidentata BC.Acta Hortic.42675–78. 10.17660/ActaHortic.1996.426.7

  • 46

    NiuX.QiJ.ZhangG.XuJ.TaoA.FangP.et al (2015). Selection of reliable reference genes for quantitative real-time PCR gene expression analysis in Jute (Corchorus capsularis) under stress treatments.Front. Plant Sci.6:848. 10.3389/fpls.2015.00848

  • 47

    PaolacciA. R.TanzarellaO. A.PorcedduE.CiaffiM. (2009). Identification and validation of reference genes for quantitative RT-PCR normalization in wheat.BMC Mol. Biol.10:11. 10.1186/1471-2199-10-11

  • 48

    PeriniP.PasqualiG.Margis-PinheiroM.de OlivieraP. R. D.ReversL. F. (2014). Reference genes for transcriptional analysis of flowering and fruit ripening stages in apple (Malus x domestica Borkh.).Mol. Breed.34829–842. 10.1007/s11032-014-0099-y

  • 49

    RadonicA.ThulkeS.MackayI. M.LandtO.SiegertW.NitscheA. (2004). Guideline to reference gene selection for quantitative real-time PCR.Biochem. Biophys. Res. Commun.313856–862. 10.1016/j.bbrc.2003.11.177

  • 50

    RamakersC.RuijterJ. M.DeprezR. H. L.MoormanA. F. (2003). Assumption-free analysis of quantitative real-time polymerase chain reaction (PCR) data.Neurosci. Lett.33962–66. 10.1016/S0304-3940(02)01423-4

  • 51

    RemansT.SmeetsK.OpdenakkerK.MathijsenD.VangronsveldJ.CuypersA. (2008). Normalisation of real-time RT-PCR gene expression measurements in Arabidopsis thaliana exposed to increased metal concentrations.Planta2271343–1349. 10.1007/s00425-008-0706-4

  • 52

    SchmidtG. W.DelaneyS. K. (2010). Stable internal reference genes for normalization of real-time RT-PCR in tobacco (Nicotiana tabacum) during development and abiotic stress.Mol. Genet. Genomics283233–241. 10.1007/s00438-010-0511-1

  • 53

    ShivhareR.LataC. (2016). Selection of suitable reference genes for assessing gene expression in pearl millet under different abiotic stresses and their combinations.Sci. Rep.6:230360. 10.1038/srep23036

  • 54

    SilveiraÉD.Alves-FerreiraM.GuimarãesL. A.da SilvaF. R.de Campos CarneiroV. T. (2009). Selection of reference genes for quantitative real-time PCR expression studies in the apomictic and sexual grass Brachiaria brizantha.BMC Plant Biol.9:84. 10.1186/1471-2229-9-84

  • 55

    VandesompeleJ.De PreterK.PattynF.PoppeB.Van RoyN.De PaepeA.et al (2002). Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes.Genome Biol.3:RESEARCH0034. 10.1186/gb-2002-3-7-research0034

  • 56

    WanH.ZhaoZ.QianC.SuiY.MalikA. A.ChenJ. (2010). Selection of appropriate reference genes for gene expression studies by quantitative real-time polymerase chain reaction in cucumber.Anal. Biochem.399257–261. 10.1016/j.ab.2009.12.008

  • 57

    WangZ.ChenY.FangH. D.ShiH. F.ChenK. P.ZhangZ. Y.et al (2014). Selection of reference genes for quantitative reverse-transcription polymerase chain reaction normalization in Brassica napus under various stress conditions.Mol. Genet. Genomics2891023–1035. 10.1007/s00438-014-0853-1

  • 58

    WattelA.KamelS.ProuilletC.PetitJ. P.LorgetF.OffordE.et al (2004). Flavonoid quercetin decreases osteoclastic differentiation induced by RANKL via a mechanism involving NF kappa B and AP-1.J. Cell. Biochem.92285–295. 10.1002/jcb.20071

  • 59

    XiaoX.MaJ.WangJ.WuX.LiP.YaoY. (2014). Validation of suitable reference genes for gene expression analysis in the halophyte Salicornia europaea by real-time quantitative PCR.Front. Plant Sci.5:788. 10.3389/fpls.2014.00788

  • 60

    XuM.ZhangB.SuX.ZhangS.HuangM. (2011). Reference gene selection for quantitative real-time polymerase chain reaction in Populus.Anal. Biochem.408337–339. 10.1016/j.ab.2010.08.044

  • 61

    XuX.LiuX.ChenS.LiB.WangX.FanC.et al (2016). Selection of relatively exact reference genes for gene expression studies in flixweed (Descurainia sophia) by quantitative real-time polymerase chain reaction.Pestic. Biochem. Physiol.12759–66. 10.1016/j.pestbp.2015.09.007

  • 62

    XuY.LiH.LiX.LinJ.WangZ.YangQ.et al (2015). Systematic selection and validation of appropriate reference genes for gene expression studies by quantitative real-time PCR in pear.Acta Physiol. Plant.37:40. 10.1007/s11738-015-1784-0

  • 63

    XuY.ZhuX.GongY.XuL.WangY.LiuL. (2012). Evaluation of reference genes for gene expression studies in radish (Raphanus sativus L.) using quantitative real-time PCR.Biochem. Biophys. Res. Commun.424398–403. 10.1016/j.bbrc.2012.06.119

  • 64

    XueB.GuoJ.QueY.FuZ.WuL.XuL. (2014). Selection of suitable endogenous reference genes for relative copy number detection in sugarcane.Int. J. Mol. Sci.158846–8862. 10.3390/ijms15058846

  • 65

    YangL.JiangH.WangQ. H.YangB. Y.KuangH. X. (2012). A new feruloyl tyramine glycoside from the roots of Achyranthes bidentata.Chin. J. Nat. Med.1016–19. 10.1016/S1875-5364(12)60003-X

  • 66

    YeX.ZhangF. M.TaoY. H.SongS. W.FangJ. B. (2015). Reference gene selection for quantitative real-time PCR normalization in different cherry genotypes, developmental stages and organs.Sci. Hortic.181182–188.

  • 67

    YouY.ZhangL.LiP.YangC.MaF. (2016). Selection of reliable reference genes for quantitative real-time PCR analysis in plum (Prunus salicina Lindl.) under different postharvest treatments.Sci. Hortic.210285–293.

  • 68

    ZhaoX. T.ZhangX. L.GuoX. B.LiS. J.HanL. L.SongZ. H.et al (2016). Identification and validation of reference genes for qRT-PCR studies of gene expression in Dioscorea opposita.Biomed. Res. Int.2016:3089584. 10.1155/2016/3089584

  • 69

    ZhongH. W.TrevorY.HongH. (2010). Cloning and characterization of oxidosqualene cyclases from Kalanchoe daigremontiana.J. Biol. Chem.28529703–29712. 10.1074/jbc.M109.098871

  • 70

    ZhuJ.ZhangL.LiW.HanS.YangW.QiL. (2013). Reference gene selection for quantitative real-time PCR normalization in Caragana intermedia under different abiotic stress conditions.PLoS ONE8:e53196. 10.1371/journal.pone.0053196

  • 71

    ZhuX.PanY.ZhengL.CuiL.CaoY. (2012). Polysaccharides from the Chinese medicinal herb Achyranthes bidentata enhance anti-malarial immunity during Plasmodium yoelii 17XL infection in mice.Malar. J.11:49. 10.1186/1475-2875-11-49

  • 72

    ZhuangH. H.FuY. P.HeW.WangL.WeiY. H. (2015). Selection of appropriate reference genes for quantitative real-time PCR in Oxytropis ochrocephala Bunge using transcriptome datasets under abiotic stress treatments.Front. Plant Sci.6:475. 10.3389/fpls.2015.00475

Summary

Keywords

Achyranthes bidentata Bl., RT-qPCR data normalization, reference genes, selection, gene validation

Citation

Li J, Han X, Wang C, Qi W, Zhang W, Tang L and Zhao X (2017) Validation of Suitable Reference Genes for RT-qPCR Data in Achyranthes bidentata Blume under Different Experimental Conditions. Front. Plant Sci. 8:776. doi: 10.3389/fpls.2017.00776

Received

23 December 2016

Accepted

25 April 2017

Published

16 May 2017

Volume

8 - 2017

Edited by

Roger Deal, Emory University, USA

Reviewed by

Yuxin Hu, Institute of Botany, Chinese Academy of Sciences, China; Yuhui Chen, Samuel Roberts Noble Foundation, USA

Updates

Copyright

*Correspondence: Jinting Li,

This article was submitted to Technical Advances in Plant Science, a section of the journal Frontiers in Plant Science

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics