ORIGINAL RESEARCH article
Aromatase Derived Estradiol Within the Thalamus Modulates Pain Induced by Varicella Zoster Virus
- 1Department of Biomedical Science, Texas A&M University College of Dentistry, Dallas, TX, United States
- 2Department of Ophthalmology and of Molecular Microbiology and Genetics, Eye and Ear Foundation, School of Medicine, University of Pittsburgh, Pittsburgh, PA, United States
Herpes zoster or shingles is the result of varicella zoster virus (VZV) infection and often results in chronic pain that lasts for months after visible symptoms subside. Testosterone often attenuates pain in males. Previous work demonstrates ovarian estrogen effects γ-aminobutyric acid (GABA) signaling in the thalamus, reducing pain but the role of testosterone within the thalamus is currently unknown. Because aromatase affects pain and is present in the thalamus we tested a hypothesis that testosterone converted to estrogen in the thalamus attenuates herpes zoster induced pain. To address this hypothesis, male Sprague-Dawley rats received whisker pad injection of either MeWo cells or MeWo cells containing VZV. To reduce aromatase derived estrogen in these animals we injected aromatase inhibitor letrozole systemically or infused it into the thalamus. To test if estrogen was working through the estrogen receptor (ER) agonist, 4, 4′, 4″-(4-Propyl-[1H]-pyrazole-1,3,5-triyl)trisphenol (PPT) was infused concomitant with letrozole. Motivational and affective pain was measured after letrozole and/or PPT treatment. Vesicular GABA transporter (VGAT) is important in pain signaling. Because estrogen effects VGAT expression we measured its transcript and protein levels after letrozole treatment. Virus injection and letrozole significantly increased the pain response but thalamic infusion of PPT reduced zoster pain. Letrozole increased the number of thalamic neurons staining for phosphorylated ERK (pERK) but decreased VGAT expression. The results suggest in male rats aromatase derived estradiol interacts with the ER to increase VGAT expression and increase neuronal inhibition in the thalamus to attenuate VZV induced pain.
Herpes zoster is caused by infection of the varicella zoster virus (VZV). The virus results in chicken pox and remains latent in sensory nerve ganglia (Mahalingam et al., 1992). The virus reactivates and triggers herpes zoster, also known as shingles (Donahue et al., 1995; Jung et al., 2004). The clinical presentation of VZV infection usually involves neuronal inflammation, blisters and a dermatomal rash causing severe itching (Cohen, 2013). This outbreak of shingles is associated with pain during the early phase that then abates. Pain can return after a few months (>3 months), potentially due to inflammation and nerve damage (Gershon et al., 2015) along one or more sensory nerve roots (Soares and Provenzale, 2016).
Almost a million incidences of herpes zoster are reported annually in the US (Donahue et al., 1995; Johnson et al., 2015). The Advisory Committee on Immunization Practices mentioned in their report that one in every three persons develops herpes zoster during their life-time (Harpaz et al., 2008). In spite of immunity due to vaccination, about 20% of patients develop chronic pain (Harpaz et al., 2008). Although herpes zoster incidence increases after 50 years of age, it can affect all ages (Civen et al., 2009). Unfortunately, herpes zoster pain severely effects the quality of life for many patients suffering from this disease (Johnson et al., 2010).
Modulation of pain sensitivity by steroids, especially by estradiol, has been widely studied (Craft et al., 2004; Craft, 2007; Aloisi and Sorda, 2011; Palmeira et al., 2011; Amandusson and Blomqvist, 2013; Pieretti et al., 2016). Sex steroids like estrogen can increase activity in the thalamus of stressed rats (Ueyama et al., 2006). Our lab has demonstrated that proestrus estradiol alters γ-aminobutyric acid (GABA)ergic gene expression, for example increasing vesicular GABA transporter (VGAT), in the thalamic region resulting in altered pain responses (Umorin et al., 2016). Sex steroids influence the excitability of neurons by altering GABA amino decarboxylase (GAD) and GABAA receptor subunits expression (Jüptner et al., 1991; Noriega et al., 2010). Sex steroids can also act as a neurotransmitter, for example progesterone metabolites can bind the GABA receptor potentiating neuronal inhibition (Majewska et al., 1986). Testosterone reduces orofacial pain (Fischer et al., 2007) moreover, male rats show a reduced response to VZV induced pain (Stinson et al., 2017). Thus, sex steroids have a proven role in altering neurotransmission and show evidence of effecting pain that could involve genomic and non-genomic mechanisms within the thalamus.
Patients undergoing aromatase inhibitor therapy often discontinue their treatment due to pain in their joints and muscles (Henry et al., 2008, 2012). In animals pain increased after administering aromatase inhibitors; potentially through increased neuronal excitability (Robarge et al., 2016). Moreover, blockade of aromatase increases the pain responses in rats (Ghorbanpoor et al., 2014; Robarge et al., 2016). These results suggest estrogen derived from aromatase is important in controlling pain.
Previous work in our lab demonstrated that sex steroids and thalamic GABAergic signaling could have a role in controlling orofacial pain (Umorin et al., 2016; Stinson et al., 2017) but the role of testosterone within the thalamus has not been studied. Aromatase converts testosterone to estradiol in the thalamus (Biegon et al., 2010). Thus, it was hypothesized that thalamic testosterone once converted to estrogen attenuates herpes zoster induced pain. To address this question our lab modulated the level of aromatase in the thalamic region and then measured the pain response after VZV injection. Further, VGAT was quantitated within the thalamus to characterize the role of inhibitory neurons within the reticular thalamic nuclei (Rt). Thalamic infusion of an estrogen receptor (ER) agonist was completed to identify if aromatase derived estradiol was inducing its action on behavior through the ER.
Materials and Methods
This study was carried out in accordance with the recommendations of Institutional Animal Care and Use Committee Guidebook, Texas A&M University College of Dentistry Institutional Animal Care and Use Committee. The protocol was approved by the Texas A&M University College of Dentistry Institutional Animal Care and Use Committee. Adult male Sprague-Dawley rats (300 g) from Envigo (Huntingdon, UK) were kept on a 12:12 light/dark cycle. The rats were given food and water ad libitum.
Treatment and Experimental Groups
Table 1 summarizes the four experiments and each treatment group. Rats in the first experiment were divided so that half received a whisker pad injection of 100 μl of MeWo cells infected with VZV (>50,000–60,000 pfu/μl) or the same volume of control MeWo cells (human skin cell line) lacking virus. Starting 1 week after whisker pad injection the animals received a 120 μl subcutaneous injection of 5 mg/ml letrozole or vehicle each week 1 h before behavioral testing. Dimethyl sulfoxide (DMSO; 120 μl) was injected as a vehicle. Testing 1 to 3 h after administering drug produced the maximal behavioral response in preliminary studies. The groups were control/vehicle, control/letrozole, VZV/vehicle, VZV/letrozole (six animals per group).
Previous studies suggested a minimal dose of 2 mg/kg of letrozole will block signaling of the ER (Liu et al., 2015). In these studies rats weighing 300 g were injected with 120 μl of 5 mg/ml letrozole, equivalent to a 2 mg/kg dose. Letrozole is permeable to the blood brain barrier (Dave et al., 2013).
Rats in the second experiment received a whisker pad injection of VZV or control. One week after whisker pad injection these animals were divided so that they received thalamic infusion of letrozole or vehicle each week, 1 h before behavioral testing (nine animals per group). Of these nine animals four were used for real-time PCR (RT-PCR) and five for immunocytochemistry (ICC). Rats in the third experiment were injected with VZV or control and a week later received thalamic infusion of different doses of letrozole each week, 1 h before testing (five animals per group). In a fourth experiment the rats were injected with VZV or control and after 1 week the thalamus was infused with aromatase inhibitor letrozole and/or ER agonist (4, 4′, 4′′-(4-Propyl-[1H]-pyrazole-1,3,5-triyl)trisphenol, PPT) each week before testing. The groups were control/PPT; control/PPT and letrozole; VZV/PPT; and VZV/PPT and letrozole with eight animals per group. ICC was completed on 8 of the animals.
Thalamic Guide Cannula Surgery
In Experiments #2, 3 and 4 rats (300 g) underwent surgery to place a bilateral guide cannula into the thalamus 1 week after arrival to the vivarium. Rats were anesthetized with 2% isoflurane with an air flow of 2 liters per minute. Using sterile technique guide cannulas (C313G Plastics One, Roanoke, VA, USA) were placed bilaterally into the thalamus stereotaxically using the coordinates 3.6 mm posterior of Bregma, 3.0 mm from midline at a depth of 5.5 mm from the top of the skull. The guide cannulas were closed with obturators. Post-surgery the animals received nalbuphine (2 mg/kg) subcutaneously. This dose of analgesic given again after 24 h and the animals recovered for a week before whisker pad injection.
Thalamic Infusion Protocol
For thalamic infusion the obturators were removed and an injection syringe (that projected 0.5 mm below the guide cannula) was inserted. Bilateral infusions (50 nanoliters/min) included letrozole (500 nanoliters at a concentration of 1 mg/ml or 5 mg/ml) and/or PPT (1 μM) or vehicle DMSO (500 nanoliters; Sun et al., 2002; Dave et al., 2013). After infusion, the injector cannula was left in place for 5 min, removed and the obturator replaced. Previous reports demonstrate that 500 nanoliters injected at these coordinates spreads to the posterior thalamic nucleus (Po), ventral posteromedial (VPM) and ventral posterolateral thalamic nuclei (VPL) and the Rt (Kramer et al., 2017).
Place Escape/Avoidance Paradigm (PEAP) testing was performed to determine pain. To accomplish this, the rats were placed in a 30 cm × 30 cm × 30 cm acrylic box where half the box was covered in black cloth. This test chamber was modeled from the PEAP test performed by the Fuchs’s laboratory (LaBuda and Fuchs, 2000). This assay was used to measure the motivation/affective aspect of pain (LaBuda and Fuchs, 2000; Baastrup et al., 2011). The PEAP test is based on the assumption that if animals escape and/or avoid a noxious stimulus, then the stimulus is aversive to the animal. Rodents being nocturnal in nature preferred to stay on the dark side when placed into the test chamber that has a light and dark side. After placing the rat in the test chamber, the rat was immediately poked with a 60-g filament every 15 s on the injected side if the rat was on the dark side and on the non-injected side if it was on the light side. The target region for the poking was the area below the eye and caudal to the whisker pad. This region is innervated by the second branch of trigeminal ganglion (DaSilva and DosSantos, 2012), the nerve infected by VZV injection of the whisker pad. The time spent on the dark side of the box was recorded in 5-min bins and testing was performed for a total of 30 min. Testing was performed once a week. Testing was completed for 2 weeks. Thus, the theory behind the test is that if the rat is experiencing VZV induced pain when poked in the sensitive area it will not stay on it preferred dark side but will move to the non-preferred light side and stay there to avoid the pain poke.
Thalamic Tissue Punches
Fresh thalamic tissue (5–10 mg) was collected 1 h post PEAP testing. Animals were euthanized by exposure to CO2 followed by decapitation. The brain was removed using a rongeur and placed on a brain slicer (Zivic, Pittsburgh, PA, USA). After cooling 2 mm thick sections were cut between Bregma −3 to −5. These sections were placed on glass slides and kept on dry ice. Lateral thalamic tissue was collected with punches 2 mm in diameter centered on the injection site, punches included the Po, VPM, VPL and Rt. Tissue was stored in liquid nitrogen until use.
Real Time PCR
RNA was isolated from thalamic tissue punches obtained from four randomly selected animals per group in Experiment #2 (see Table 1). RNA extraction was performed using the RNA Lipid Tissue Kit from Qiagen (Valencia, CA, USA). The RNA concentration in the resulting sample was determined on a Nanodrop2000. A one-step reverse transcription polymerase chain reaction (PCR) reaction was performed on BioRAD C1000 Thermal Cycler using the SYBR-Green 1-Step RT-PCR kit and primers from Qiagen (Table 2). The thermal protocol was 30 min @ 50°C for the reverse transcription reaction, 15 min @ 95°C for DNA pol activation and 40× (15 s @ 94°C melting, 30 s @ 56°C annealing, 30 s @ 72°C extension). A melting curve was obtained thereafter for quality assurance. Sample amount was adjusted according to total RNA concentration to obtain 20 ng of total RNA per well in the final reaction mix. All reactions were run in triplicate. PCR runs that did not exhibit a proper amplification profile were discarded. For each sample, the threshold Ct value for glyceraldehyde-3-phosphate dehydrogenase (GAPDH) was subtracted from the Ct of value for VGAT or the genes in Table 2 to give a ΔCt. Values for decreased expression were calculate by using the formula (−1/ΔCt).
Enzyme-Linked Immunosorbent Assay (ELISA)
Fresh thalamic tissue punches from all five animals in Experiment #3 (Table 1) was stored in liquid nitrogen until analysis. Tissue was placed in 250 μl of T-Per tissue protein extraction reagent containing Halt Protease Inhibitor and ground (Thermo Scientific, Rockford, IL, USA). Ground samples were frozen and thawed, followed by centrifugation and decanting of the supernatant. Quantitation of VGAT in the supernatant was completed on duplicate 100 μl samples of supernatant using an SLC32A1 (VGAT) enzyme-linked immunosorbent assay (ELISA) following the manufacturer’s directions (Cusabio, catalog #CSB-EL021578MO). Total protein was determined in each sample using a BCA protein assay (Thermo Scientific, Waltham, WA, USA). Values represent the pg of VGAT per μg of total protein.
In Experiment #2, five animals were randomly selected from the nine animals and in Experiment #4, four animals were randomly selected from the eight animals (Table 1). After anesthesia with 100 mg/kg ketamine and 10 mg/kg xylazine the animals were perfused with 9% sucrose followed by 4% paraformaldehyde. Fixed tissues were stored in 25% sucrose, frozen, cryo-sectioned and the 32 μm sections placed on Histobond slides (VWR international, Radnor, PA, USA). The tissue was then blocked with a phosphate buffered saline (PBS) solution containing 5% normal goat serum (Sigma-Aldrich, St. Louis, MO, USA) and 0.3% Triton-X 100 for 2 h at room temperature. The slides were then incubated in a primary antibody solution overnight at 4°C. The primary antibody consisted of a mixture of the mouse monoclonal neuronal nuclei (NeuN) antibody (Millipore, Billerica, MA, USA, MAB377) 1:150 dilution or GAD 67 antibody (Millipore clone 1G10.2, MAB5406) 1:500 dilution and rabbit phosphorylated ERK (pERK) antibody (phosphorylated extracellular signal-regulated kinase, Cell Signaling Technology, Boston, MA, USA #4695) at 1:150 dilution. The primary antibody was diluted with PBS, 5% BSA and 0.3% Triton X-100. After incubation in primary antibody the slides were then rinsed three times in PBS and Triton-X 100 for a total of 45 min and placed for 2 h in secondary antibody and PBS and 0.3% Triton X-100. Secondary antibodies (1:500 dilution) included a mixture of goat anti-mouse 568 or goat anti-rabbit 488 (Invitrogen, Carlsbad, CA, USA). After rinsing the slides three times in PBS for a total of 45 min, the slides were mounted with Fluoromount-G mounting medium containing Hoechst 33342 stain (Electron Microscopy Sciences, Hatfield, PA, USA). The fluorescent signal was imaged using a Nikon fluorescent microscope and NIS-Elements imaging software and a Photometrics CoolSnap K4 CCD camera (Roper Scientific, Inc., Duluth, GA, USA).
GAD 67 expression is primarily in the cell body while GAD 65 is localized to nerve terminals (Kaufman et al., 1991). This lead to ease of identification of GABA positive cells and accurate counting of these cells. Moreover, GAD 67 expression is constitutive whereas GAD 65 expression changes with cellular activity (Fenalti et al., 2007). Thus, GAD 67 was used as a marker for counting the GABA cells.
Cell counts were completed by a blinded reviewer. The injection site was the center point from which sections were selected. Every other section was selected for staining. Typically, three sections were counted for each animal. The slides were analyzed using ImageJ software, the average background for the slides within a treatment group was subtracted from the image and a fluorescent signal associated with a cell nucleus was counted as a positive cell. Counts were completed for the number of GAD 67, NeuN, GAD 67/pERK and/or NeuN/pERK stained cells within a 0.125 mm2 field adjacent to the injection site. On each section two randomly selected fields near the tip of the injection site was counted. Counts were completed within the lateral thalamic nuclei (VMP, VPL and Rt) and cell counts from the two fields on each section were then averaged. This average count for the three sections was averaged for each animal. Values were given as a mean and standard error of the mean (SEM) representing an average of the values for the animals in each treatment group.
Data was tested with the KS normality test (α = 0.05). PEAP data passed the normality test and was analyzed by two-way ANOVA. The independent variables were the time spent on the light or dark side of the box (collected in six time bins i.e., 5, 10, 15, 20, 25 and 30 min) and the dependent variable was treatment (i.e., virus and drug). PEAP data was analyzed with repeated measures because data was collected multiple times over a 30-min period from each rat. When a significant effect was observed Bonferroni post hoc tests were completed. PCR, ELISA and cell count data was analyzed with the non-parametric Mann-Whitney test (Prizm 5.04, GraphPad Software, La Jolla, CA, USA or Abstat, Anderson Bell Corp., Arvada, CO, USA).
Enhanced Pain Response After Systemic Letrozole Treatment
PEAP data from Experiment #1 (Figure 1) shows that in the first week the animals which received virus, whether given letrozole or vehicle spent much less time on the dark side compared to the controls F(3,100) = 27.8, p < 0.0001. In week 2 there was also an effect of VZV treatment F(3,100) = 9.8, p < 0.001. Animals in the control group remained on the dark side almost throughout the testing period. When comparing the virus group injected with vehicle to the virus group injected with letrozole no significant effect for letrozole was observed over the 2-week testing period (Figures 1A,B). A significant interaction between time and treatment was observed in the animals injected with letrozole in week 1 F(15,100) = 2.6, p < 0.005 but not in week 2 F(15,100) = 0.83, p = 0.63.
Figure 1. Systemic injection of aromatase inhibitor letrozole 5 mg/ml did not alter the varicella zoster virus (VZV) induced pain response. The hashtag symbol indicates a significant difference between the control/vehicle and VZV/vehicle groups (p < 0.05). The asterisks indicate a significant difference between the control/letrozole and VZV/letrozole groups (p < 0.05). Panel (A) is week 1 data and panel (B) is week 2 data. There were six animals per group. Values are means and SEM.
Thalamic Infusion of Letrozole
Thalamic infusion of letrozole in Experiment #2 significantly increased the pain response in week 1 F(3,125) = 34.9, p < 0.0001. In week 2 there was also an effect of letrozole treatment F(3,125) = 109.2, p < 0.0001. VZV injection significantly increased the pain response in week 1 and 2 (Figures 2A,B). When comparing the virus group infused with vehicle to the virus group injected with letrozole a significant increase in pain was observed in week 1 and 2 (Figures 2A,B). A significant interaction between time and treatment was observed in the animals infused with letrozole in week 1 (F(15,125) = 3.1, p < 0.001) and in week 2 (F(15,125) = 1.9, p < 0.05).
Figure 2. Local thalamic infusion of the aromatase inhibitor letrozole significantly increased the VZV induced pain response. The hashtag symbol indicates a significant difference between the control/vehicle and VZV/vehicle groups (p < 0.05). The asterisks indicate a significant difference between the control/letrozole 5 mg/ml and VZV/letrozole 5 mg/ml groups (p < 0.05). The plus sign indicates a significant difference between the VZV/vehicle and VZV/letrozole 5 mg/ml groups (p < 0.05). The ampersand symbol indicates a significant difference between the VZV/letrozole 1 mg/ml and the VZV/letrozole 5 mg/ml groups (p < 0.05). Panel (A) is week 1 data and panel (B) is week 2 data, n = 9 per group. Values are means and SEM.
In Experiment #3 the pain response in the control/vehicle, control/letrozol 5 mg/ml, VZV/vehicle and VZV/letrozole 5 mg/ml groups was similar to Experiment #2 (data not shown). Infusing the thalamus with 1 mg/ml letrozole resulted in no significant increase in the pain response vs. the VZV/vehicle group (Figures 2A,B). In addition, the pain response in the VZV group treated with 5 mg/ml of letrozole was significantly increased vs. the VZV group treated with 1 mg/ml of letrozole in both week 1 and 2 (Figures 2A,B).
Gene Expression Analysis
Letrozole treatment decreased VGAT expression in the thalamus four-fold after VZV injection and six-fold in the control group. The change in expression was significant when analyzing the Ct values (Figure 3A). In these same animals no significant change in androgen receptor, aromatase CYP19a1, ER alpha (ERα), ER beta (ERβ) or G protein-coupled receptor 30 (GPR30) transcript was observed after letrozole treatment (data not shown). Protien content significantly decreased after letrozole treatment consistent with the transcript results (Figure 3B).
Figure 3. Vesicular GABA transporter (VGAT) expression in the thalamus was significantly reduced after infusing letrozole 5 mg/ml into the thalamus. Animals were sacrificed after the second week of place escape/avoidance paradigm (PEAP) testing. In panel (A), real time polymerase chain reaction (RT-PCR) was completed after isolating thalamic plugs (four animals per group) and in panel (B) VGAT protein was quantitated after isolating thalamic plugs by enzyme-linked immunosorbent assay (ELISA; five animals per group). The asterisks indicate a significant difference of p < 0.05. Values are means and SEM.
Neuronal Activity in the Thalamic Nuclei
pERK can be a marker for pain-induced neuronal activation (Gao and Ji, 2009). NeuN stained cells were present in the thalamic area around the infusion site (Figures 4B,F,J,N). Cells in the same area also stained for pERK (Figures 4C,G,K,O). NeuN stained cells co-localized with pERK staining (Figures 4A,E,I,M). A blue nuclear stain of the sections in Figure 4 is shown in panels Figures 4D,H,L,P. Quantitation of the NeuN stained cells indicated no significant difference between the treatment groups (Figure 5A) but the number of NeuN/pERK stained cells increased significantly in the lateral thalamic region after VZV injection (Figure 5B). Treatment with letrozole significantly increased the number of NeuN/pERK stained cells in rats infected with VZV (Figure 5B).
Figure 4. Neuronal nuclei (NeuN) and phosphorylated ERK (pERK) stained cells within the lateral thalamic region. NeuN stained cells (red, panels B,F,J,N, arrows) that co-localize with pERK (green, panels C,G,K,O, arrows) are shown as yellow cells (panels A,E,I,M in rats after whisker pad injection of VZV or control and then infusion (lateral thalamus) with letrozole (5 mg/ml) or vehicle. A representative animal injected with control and then infused with vehicle is shown in panels (A–D). Panels (E–H) shows a representative image from an animal injected with control and infused with letrozole, panels (I–L) are from an animal injected with VZV and infused with vehicle and panels (M–P) are from a rat injected with VZV and infused with letrozole. Nuclei are stained with Hoechst 33342 in panels (D,H,L,P). Bar = 100 micrometers.
Figure 5. Cell counts within the lateral thalamic region for cells stained for NeuN (A) or NeuN and pERK (B) after injecting VZV or control into the whisker pad and then infusing letrozole (5 mg/ml) or vehicle into the lateral thalamus. The asterisks indicate a significant difference of p < 0.05. There were five animals in each treatment group. Values are means and SEM.
Neuronal Activity Within Rt GABA Cells
GABA cells within the lateral thalamic region are primarily located in the Rt nucleus (Figure 6A). A few GAD 67 positive cells expressed pERK (Figures 6B–G). Counts of GAD 67 positive cells within the Rt indicated no change between treatment groups (Figure 6A). Interestingly, no change in pERK expression was observed in these cells (Figure 7) with exception of the control group, showing letrozole decreased the number of GAD 67/pERK positive cells (Figure 7B).
Figure 6. Gaba amino decarboxylase 67 (GAD 67) and pERK stained cells within the lateral thalamic region. Panel (A) shows a representative low magnification image of the ventral posteromedial (VPM), ventral posterolateral (VPL) and reticular thalamic nuclei (Rt) region from a VZV/letrozole (5 mg/ml) treated rat. The path of the injection needle (inj, dotted box) is within the VPM/VPL. GAD 67 stained cells (red) are localized within the Rt (dotted region). Panels (B,C,D) show a high magnification image of the Rt region from panel (A). Note the blood vessel (bv) for orientation. Red GAD 67 stained cells in panels (C,F; indicated by arrows and arrowheads) and pERK stained cells in panels (D,G; green cells, arrows) co-localize (yellow cells) in panels (B,E; arrows). Nuclei were stained with Hoechst 33342 (blue). Bar = 50 micrometers.
Figure 7. Cell counts within the lateral thalamic region for cells stained for GAD 67 only (A) or GAD 67 and pERK (B) after injecting VZV or control into the whisker pad and then infusing letrozole (5 mg/ml) or vehicle into the lateral thalamus. The asterisks indicate a significant difference of p < 0.05. There were five animals in each treatment group. Values are means and SEM.
Thalamic Infusion of ERα Agonist Attenuated the Pain Response
Because blocking local, thalamic production of estradiol increased the pain response we asked if the estradiol might be working through the ER. To test this idea, ER agonist PPT was infused in the lateral thalamic region. PPT significantly reduced (p < 0.05) the pain response following VZV injection (compare the VZV/vehicle group to the VZV/PPT group, Figures 8A,B). PPT also significantly reduced (p < 0.05) the response in the letrozole treated animals (compare VZV/letrozole to VZV/PPT and letrozole, Figures 8A,B).
Figure 8. Local thalamic infusion of the estrogen receptor (ER) agonist 4, 4′, 4″-(4-propyl-[1H]-pyrazole-1,3,5-triyl)trisphenol (PPT) concomitant with letrozole (5 mg/ml) significantly reduced the VZV induced pain response vs. letrozole treatment alone. Note that the data includes data from Figure 2. Hashtag symbol represents a significant difference (p < 0.05) between the VZV/vehicle group and the VZV/PPT group. The asterisks indicate a significant difference (p < 0.05) between the VZV/letrozole (red solid square symbols) and VZV/PPT & letrozole group (solid black diamond symbols) n = 8 per group. Panel (A) is week 1 data and panel (B) is week 2 data Values are means and SEM.
Letrozole Increased pERK Staining After PPT Treatment
The number of NeuN stained cells in the lateral thalamic region was not affected by treatment (Figure 9A). Infusion of PPT and letrozole significantly increased (p < 0.05) the number of NeuN/pERK stained cells in the lateral thalamic region 2 weeks after VZV injection (Figure 9B). Lateral thalamic infusion of ER agonist PPT significantly decreased (p < 0.05) the number of pERK stained neurons in the letrozole treated rats injected with VZV (compare the VZV/letrozole group in Figure 5B to the VZV/PPT and letrozole group in Figure 9B).
Figure 9. Cell counts within the lateral thalamic region for cells stained for NeuN (A) or NeuN and pERK (B) after injecting VZV or control into the whisker pad and then infusing letrozole (5 mg/ml) and/or PPT into the lateral thalamus. Asterisks indicate a significant difference between groups (p < 0.05). There were four animals counted in each treatment group. Values are means and SEM.
Injecting the whisker pad with VZV results in pain and letrozole increases the VZV associated pain. The thalamus has an active role in orofacial pain responses (Sessle, 1986; de Leeuw et al., 2005; Yen and Lu, 2013). Lesions of the thalamus increase the pain response (Saadé et al., 1999). In humans, aromatase levels are high in the thalamus, pons, hypothalamus, amygdala and hippocampus (Sasano et al., 1998; Azcoitia et al., 2011). Letrozole is an inhibitor of aromatase, the enzyme that catalyzes the formation of estradiol from testosterone, and this enzyme is active within the thalamus (Biegon et al., 2010). Letrozole increased the number of pERK positive neurons within the thalamus of VZV injected rats. Importantly, the number GAD 67 positive cells labeling with pERK remained unchanged after letrozole treatment suggesting GABA neurons within the Rt were not more active. This increase in pERK positive neurons after letrozole treatment was likely representing increased activity within the excitatory neuronal population.
One mechanism by which estradiol could alter neuronal activity would be GABA. A previous report from our lab demonstrated that estradiol can increase expression of GABA related genes in the thalamus (Umorin et al., 2016). Previous studies from our lab also suggested thalamic expression of VGAT attenuates pain in the orofacial region (Kramer and Bellinger, 2009; Kramer et al., 2015). Because GABA attenuates the pain response and estradiol reduces pain we surmised that estradiol could reduce pain by increasing GABA expression (Umorin et al., 2016). Letrozole treatment decreased VGAT transcript and protein within the thalamus. This decrease in VGAT would reduce GABA signaling and increase excitatory neuronal activity. Increasing excitatory activity in the thalamus should increase the pain response (Osikowicz et al., 2013; Acher and Goudet, 2015). Increased pain after letrozole treatment was consistent with the idea that inhibiting aromatase decreased GABA inhibition of excitatory neurons in the thalamus enhancing the pain response.
Changes in VGAT expression resulting from estradiol have been reported in the hypothalamic region (Ottem et al., 2004; Noriega et al., 2010) and our lab has reported changes in VGAT expression within the thalamus throughout the estrous cycle (Umorin et al., 2016). Multiple potential estrogen response element sites are present in the VGAT promoter (Hudgens et al., 2009). Although ERα is not expressed at significant levels within the Rt, ERβ has been observed in the rostral region of the Rt (Lein et al., 2007). PPT is highly selective for ERα but the agonist could have stimulated ERβ receptors to effect VGAT expression. The increased pain response after letrozole treatment was reversed after PPT treatment a result that could be explained by PPT signaling ERβ to increase VGAT production.
Estradiol can attenuate pain through several nuclear or membrane receptors (Perez et al., 2003; Brailoiu et al., 2007; Hazell et al., 2009). Estrogen effects pain transmission via membrane bound ERs (Zhang et al., 2012). 17β-estradiol, the most potent form of estrogen, regulates gene expression of voltage gated sodium channels via ERα and ERβ, which may play a vital role in modulation of pain (Hu et al., 2012). Thus, estrogen can modulate pain acting through any of its receptors in a genomic or non-genomic mechanism (Craft, 2007; Deliu et al., 2012; Amandusson and Blomqvist, 2013). We measured expression of androgen and ERs. There was no change in expression of these receptors after letrozole administration. Moreover, aromatase expression did not change. These results suggest that letrozole does not affect expression of these genes and that the mechanism increasing VZV associated pain does not include changes in expression of these genes.
Letrozole treatment often results in excacerbating the pain response after insult (Ghorbanpoor et al., 2014; Robarge et al., 2016). Consistent with these reports our results showed an increased VZV pain response after letrozole treatment. Humans report pain after taking aromatase inhibitors but we did not observe an increased response in non-VZV animals taking letrozole (Henry et al., 2008, 2012). Inhibition of aromatase increases mechanical hyperalgesia in animals but not thermal hyperalgesia suggesting aromatase effects are varied depending on the response being measured (Robarge et al., 2016). Thus, it is possible we did not see an increased pain response in the control/letrozole groups because letrozole by itself (i.e., without VZV pain) results in changes to mechanical hyperalgisia but not motivational/affective aspect of pain as measured in this study.
Because letrozole treatment increased the VZV induced pain response, we suggest estradiol in the thalamus inhibits orofacial pain. Previous studies have suggested that estradiol attenuates orofacial pain consistent with these results (Fischer et al., 2008; Kramer and Bellinger, 2009, 2013; Tashiro et al., 2012; Stinson et al., 2017) but this is the first study to demonstrate a role for estradiol in the lateral thalamic region attenuating VZV pain. Moreover, it was apparent that much of the estradiol was produced locally because local administration of an aromatase inhibitor resulted in a heightened pain response. This is an interesting result because increased systemic estradiol has also been associated with an attenuated pain response (Stinson et al., 2017). Thus, systemic estradiol and estradiol produced from testosterone in the thalamus both alter the pain response, but systemic estradiol possibly works through a different mechanism.
The Rt projects to regions such as the parafascicular and intralaminar nuclei (Clemente-Perez et al., 2017). Evidence suggests the parafascicular nucleus is important in motivational and effective pain (Weigel and Krauss, 2004) thus, altered VGAT expression in the Rt could alter the VZV pain response measured in this study. Alternatively, letrozole could have spread to the zona incerta (ZI) after infusion into the thalamus. The ZI contains ERs and aromatase (Jakab et al., 1993; Shughrue et al., 1997). The mediodorsal thalamus (MD) receives dense GABAergic inputs from the ZI (Bartho et al., 2002; Erickson et al., 2004) and is heavily connected to cortical areas involved in processing the affective aspects of pain (Cornwall and Phillipson, 1988; Groenewegen, 1988). Thus, changes in estradiol signaling within the ZI could alter the VZV pain response through modulation of GABAergic cells.
From the PEAP graphs, some difference was seen between the results from the systemic and cannulated groups. This difference may result from local administration of letrozole providing a higher concentration to the regulatory site vs. a systemic injection. To verify that a reduction in the letrozole concentration would reduce the behavioral response, we performed another experiment injecting the brain with a five-fold lower dose or 1 mg/ml; (2 mg/kg ÷ 5-fold lower) = 0.4 mg/kg dose. Note: a 0.5 mg/kg dose was not effective in blocking estrogen signaling in a prior study (Liu et al., 2015). Our results were consistent with the Liu study, such that, infusing a concentration of 1 mg/kg (0.4 mg/kg dose) did not elicit a significant behavioral response.
In summary, inhibiting aromatase activity increased pERK in the non-GABAergic neuronal population and increased the pain response in male rats. VGAT expression in the thalamus was reduced after letrozole treatment. PPT treatment reversed letrozole effects by decreasing pain and reducing the number of pERK positive neurons consistent with the idea that locally produced estrogen binds the ER, upregulating VGAT resulting in neuronal inhibition and attenuation of the pain response.
All authors contributed to the planning and devised the experiments.
This study was supported by NIDCR grant DE022129 (PKramer) and a grant from the 30, 300, 3000 Pain Research Challenge from the University of Pittsburgh Clinical and Translational Science Institute (PKinchington). PKinchington also acknowledges support from grant NS064022, NEI core grant EY08098 and unrestricted funds from Eye and Ear Foundation and Research to Prevent Blindness Inc.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We wish to thank Xiaoju Zou, Priscilla Hooks, Connie Tillberg and Gerald Hill for their excellent technical assistance.
DMSO, dimethyl sulfoxide; ELISA, Enzyme-linked immunosorbent assay; ERα, estrogen receptor alpha; ERβ, estrogen receptor beta; GABA, γ-aminobutyric acid; GAD 67, GABA amino decarboxylase 67; GAD 65, GABA amino decarboxylase 65; GAPDH, Glyceraldehyde-3-Phosphate Dehydrogenase; GPR30, G protein-coupled receptor 30; NeuN, neuronal nuclei; PBS, phosphate buffered saline; PEAP, Place Escape/Avoidance Paradigm; pERK, phosphorylated ERK; Po, posterior thalamic nucleus; PPT, ERα agonist 4, 4′,4″-(4-Propyl-[1H]-pyrazole-1,3,5-triyl)trisphenol; Rt, reticular thalamic nuclei; VGAT, vesicular GABA transporter; VPL, ventral posterolateral thalamic nuclei; VPM, ventral posteromedial; VZV, varicella zoster virus; ZI, zona incerta.
Baastrup, C., Jensen, T. S., and Finnerup, N. B. (2011). Pregabalin attenuates place escape/avoidance behavior in a rat model of spinal cord injury. Brain Res. 1370, 129–135. doi: 10.1016/j.brainres.2010.11.008
Biegon, A., Kim, S. W., Alexoff, D. L., Jayne, M., Carter, P., Hubbard, B., et al. (2010). Unique distribution of aromatase in the human brain: in vivo studies with PET and [N-methyl-11C]vorozole. Synapse 64, 801–807. doi: 10.1002/syn.20791
Brailoiu, E., Dun, S. L., Brailoiu, G. C., Mizuo, K., Sklar, L. A., Oprea, T. I., et al. (2007). Distribution and characterization of estrogen receptor G protein-coupled receptor 30 in the rat central nervous system. J. Endocrinol. 193, 311–321. doi: 10.1677/joe-07-0017
Civen, R., Chaves, S. S., Jumaan, A., Wu, H., Mascola, L., Gargiullo, P., et al. (2009). The incidence and clinical characteristics of herpes zoster among children and adolescents after implementation of varicella vaccination. Pediatr. Infect. Dis. J. 28, 954–959. doi: 10.1097/INF.0b013e3181a90b16
Clemente-Perez, A., Makinson, S. R., Higashikubo, B., Brovarney, S., Cho, F. S., Urry, A., et al. (2017). Distinct thalamic reticular cell types differentially modulate normal and pathological cortical rhythms. Cell Rep. 19, 2130–2142. doi: 10.1016/j.celrep.2017.05.044
Cornwall, J., and Phillipson, O. T. (1988). Afferent projections to the dorsal thalamus of the rat as shown by retrograde lectin transport—I. The mediodorsal nucleus. Neuroscience 24, 1035–1049. doi: 10.1016/0306-4522(88)90085-1
Dave, N., Gudelsky, G. A., and Desai, P. B. (2013). The pharmacokinetics of letrozole in brain and brain tumor in rats with orthotopically implanted C6 glioma, assessed using intracerebral microdialysis. Cancer Chemother. Pharmacol. 72, 349–357. doi: 10.1007/s00280-013-2205-y
de Leeuw, R., Albuquerque, R., Okeson, J., and Carlson, C. (2005). The contribution of neuroimaging techniques to the understanding of supraspinal pain circuits: implications for orofacial pain. Oral. Surg. Oral. Med. Oral. Pathol. Oral. Radiol. Endod. 100, 308–314. doi: 10.1016/j.tripleo.2004.11.014
Deliu, E., Brailoiu, G. C., Arterburn, J. B., Oprea, T. I., Benamar, K., Dun, N. J., et al. (2012). Mechanisms of G protein-coupled estrogen receptor-mediated spinal nociception. J. Pain 13, 742–754. doi: 10.1016/j.jpain.2012.05.011
Erickson, S. L., Melchitzky, D. S., and Lewis, D. A. (2004). Subcortical afferents to the lateral mediodorsal thalamus in cynomolgus monkeys. Neuroscience 129, 675–690. doi: 10.1016/j.neuroscience.2004.08.016
Fenalti, G., Law, R. H., Buckle, A. M., Langendorf, C., Tuck, K., Rosado, C. J., et al. (2007). GABA production by glutamic acid decarboxylase is regulated by a dynamic catalytic loop. Nat. Struct. Mol. Biol. 14, 280–286. doi: 10.1038/nsmb1228
Fischer, L., Torres-Chavez, K. E., Clemente-Napimoga, J. T., Jorge, D., Arsati, F., de, A., et al. (2008). The influence of sex and ovarian hormones on temporomandibular joint nociception in rats. J. Pain 9, 630–638. doi: 10.1016/j.jpain.2008.02.006
Gao, Y. J., and Ji, R. R. (2009). c-Fos and pERK, which is a better marker for neuronal activation and central sensitization after noxious stimulation and tissue injury? Open Pain J. 2, 11–17. doi: 10.2174/1876386300902010011
Ghorbanpoor, S., Garcia-Segura, L. M., Haeri-Rohani, A., Khodagholi, F., and Jorjani, M. (2014). Aromatase inhibition exacerbates pain and reactive gliosis in the dorsal horn of the spinal cord of female rats caused by spinothalamic tract injury. Endocrinology 155, 4341–4355. doi: 10.1210/en.2014-1158
Groenewegen, H. J. (1988). Organization of the afferent connections of the mediodorsal thalamic nucleus in the rat, related to the mediodorsal-prefrontal topography. Neuroscience 24, 379–431. doi: 10.1016/0306-4522(88)90339-9
Harpaz, R., Ortega-Sanchez, I. R., and Seward, J. F. (2008). Prevention of herpes zoster: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm. Rep. 57, 1–30; quiz CE2–4. Available online at: https://www.cdc.gov/mmwr/preview/mmwrhtml/rr57e0515a1.htm
Hazell, G. G., Yao, S. T., Roper, J. A., Prossnitz, E. R., O’Carroll, A. M., and Lolait, S. J. (2009). Localisation of GPR30, a novel G protein-coupled oestrogen receptor, suggests multiple functions in rodent brain and peripheral tissues. J. Endocrinol. 202, 223–236. doi: 10.1677/joe-09-0066
Henry, N. L., Azzouz, F., Desta, Z., Li, L., Nguyen, A. T., Lemler, S., et al. (2012). Predictors of aromatase inhibitor discontinuation as a result of treatment-emergent symptoms in early-stage breast cancer. J. Clin. Oncol. 30, 936–942. doi: 10.1200/JCO.2011.38.0261
Henry, N. L., Giles, J. T., Ang, D., Mohan, M., Dadabhoy, D., Robarge, J., et al. (2008). Prospective characterization of musculoskeletal symptoms in early stage breast cancer patients treated with aromatase inhibitors. Breast Cancer Res. Treat 111, 365–372. doi: 10.1007/s10549-007-9774-6
Hu, F., Wang, Q., Wang, P., Wang, W., Qian, W., Xiao, H., et al. (2012). 17β-Estradiol regulates the gene expression of voltage-gated sodium channels: role of estrogen receptor alpha and estrogen receptor β. Endocrine 41, 274–280. doi: 10.1007/s12020-011-9573-z
Hudgens, E. D., Ji, L., Carpenter, C. D., and Petersen, S. L. (2009). The gad2 promoter is a transcriptional target of estrogen receptor (ER)α and ER β: a unifying hypothesis to explain diverse effects of estradiol. J Neurosci. 29, 8790–8797. doi: 10.1523/jneurosci.1289-09.2009
Jakab, R. L., Horvath, T. L., Leranth, C., Harada, N., and Naftolin, F. (1993). Aromatase immunoreactivity in the rat brain: gonadectomy-sensitive hypothalamic neurons and an unresponsive “limbic ring” of the lateral septum-bed nucleus-amygdala complex. J. Steroid Biochem. Mol. Biol. 44, 481–498. doi: 10.1016/0960-0760(93)90253-s
Johnson, B. H., Palmer, L., Gatwood, J., Lenhart, G., Kawai, K., and Acosta, C. J. (2015). Annual incidence rates of herpes zoster among an immunocompetent population in the United States. BMC Infect Dis. 15:502. doi: 10.1186/s12879-015-1262-8
Johnson, R. W., Bouhassira, D., Kassianos, G., Leplege, A., Schmader, K. E., and Weinke, T. (2010). The impact of herpes zoster and post-herpetic neuralgia on quality-of-life. BMC Med. 8:37. doi: 10.1186/1741-7015-8-37
Jung, B. F., Johnson, R. W., Griffin, D. R., and Dworkin, R. H. (2004). Risk factors for postherpetic neuralgia in patients with herpes zoster. Neurology 62, 1545–1551. doi: 10.1212/01.WNL.0000123261.00004.29
Jüptner, M., Jussofie, A., and Hiemke, C. (1991). Effects of ovariectomy and steroid replacement on GABAA receptor binding in female rat brain. J. Steroid Biochem. Mol. Biol. 38, 141–147. doi: 10.1016/0960-0760(91)90119-p
Kaufman, D. L., Houser, C. R., and Tobin, A. J. (1991). Two forms of the gamma-aminobutyric acid synthetic enzyme glutamate decarboxylase have distinct intraneuronal distributions and cofactor interactions. J. Neurochem. 56, 720–723. doi: 10.1111/j.1471-4159.1991.tb08211.x
Kramer, P. R., and Bellinger, L. L. (2009). The effects of cycling levels of 17beta-estradiol and progesterone on the magnitude of temporomandibular joint-induced nociception. Endocrinology 150, 3680–3689. doi: 10.1210/en.2008-1707
Kramer, P. R., and Bellinger, L. L. (2013). Modulation of temporomandibular joint nociception and inflammation in male rats after administering a physiological concentration of 17β-oestradiol. Eur. J. Pain 17, 174–184. doi: 10.1002/j.1532-2149.2012.00183.x
Kramer, P. R., Stinson, C., Umorin, M., Deng, M., Rao, M., Bellinger, L. L., et al. (2017). Lateral thalamic control of nociceptive response after whisker pad injection of varicella zoster virus. Neuroscience 356, 207–216. doi: 10.1016/j.neuroscience.2017.05.030
Kramer, P. R., Umorin, M., and Bellinger, L. L. (2015). Attenuation of myogenic orofacial nociception and mechanical hypersensitivity by viral mediated enkephalin overproduction in male and female rats. BMC Neurol. 15:34. doi: 10.1186/s12883-015-0285-5
Lein, E. S., Hawrylycz, M. J., Ao, N., Ayres, M., Bensinger, A., Bernard, A., et al. (2007). Genome-wide atlas of gene expression in the adult mouse brain. Nature 445, 168–176. doi: 10.1038/nature05453
Liu, M., Huangfu, X., Zhao, Y., Zhang, D., and Zhang, J. (2015). Steroid receptor coactivator-1 mediates letrozole induced downregulation of postsynaptic protein PSD-95 in the hippocampus of adult female rats. J. Steroid Biochem. Mol. Biol. 154, 168–175. doi: 10.1016/j.jsbmb.2015.07.011
Mahalingam, R., Wellish, M. C., Dueland, A. N., Cohrs, R. J., and Gilden, D. H. (1992). Localization of herpes simplex virus and varicella zoster virus DNA in human ganglia. Ann. Neurol. 31, 444–448. doi: 10.1007/s11262-005-1799-5
Majewska, M. D., Harrison, N. L., Schwartz, R. D., Barker, J. L., and Paul, S. M. (1986). Steroid hormone metabolites are barbiturate-like modulators of the GABA receptor. Science 232, 1004–1007. doi: 10.1126/science.2422758
Noriega, N. C., Eghlidi, D. H., Garyfallou, V. T., Kohama, S. G., Kryger, S. G., and Urbanski, H. F. (2010). Influence of 17beta-estradiol and progesterone on GABAergic gene expression in the arcuate nucleus, amygdala and hippocampus of the rhesus macaque. Brain Res. 1307, 28–42. doi: 10.1016/j.brainres.2009.10.011
Ottem, E. N., Godwin, J. G., Krishnan, S., and Petersen, S. L. (2004). Dual-phenotype GABA/glutamate neurons in adult preoptic area: sexual dimorphism and function. J. Neurosci. 24, 8097–8105. doi: 10.1523/jneurosci.2267-04.2004
Perez, S. E., Chen, E. Y., and Mufson, E. J. (2003). Distribution of estrogen receptor alpha and beta immunoreactive profiles in the postnatal rat brain. Brain Res. Dev. 145, 117–139. doi: 10.1016/s0165-3806(03)00223-2
Pieretti, S., Di Giannuario, A., Di Giovannandrea, R., Marzoli, F., Piccaro, G., Minosi, P., et al. (2016). Gender differences in pain and its relief. Ann. Ist Super Sanita. 52, 184–189. doi: 10.4415/ann_16_02_09
Robarge, J. D., Duarte, D. B., Shariati, B., Wang, R., Flockhart, D. A., and Vasko, M. R. (2016). Aromatase inhibitors augment nociceptive behaviors in rats and enhance the excitability of sensory neurons. Exp. Neurol. 281, 53–65. doi: 10.1016/j.expneurol.2016.04.006
Shughrue, P. J., Lane, M. V., and Merchenthaler, I. (1997). Comparative distribution of estrogen receptor-alpha and -beta mRNA in the rat central nervous system. J. Comp. Neurol. 388, 507–525. doi: 10.1002/(sici)1096-9861(19971201)388:4<507::aid-cne1>3.0.co;2-6
Stinson, C., Deng, M., Yee, M. B., Bellinger, L. L., Kinchington, P. R., and Kramer, P. R. (2017). Sex differences underlying orofacial varicella zoster associated pain in rats. BMC Neurol. 17:95. doi: 10.1186/s12883-017-0882-6
Sun, J., Huang, Y. R., Harrington, W. R., Sheng, S., Katzenellenbogen, J. A., and Katzenellenbogen, B. S. (2002). Antagonists selective for estrogen receptor alpha. Endocrinology 143, 941–947. doi: 10.1210/endo.143.3.8704
Ueyama, T., Tanioku, T., Nuta, J., Kujira, K., Ito, T., Nakai, S., et al. (2006). Estrogen alters c-Fos response to immobilization stress in the brain of ovariectomized rats. Brain Res. 1084, 67–79. doi: 10.1016/j.brainres.2006.02.008
Umorin, M., Stinson, C., Bellinger, L. L., and Kramer, P. R. (2016). Genes in the GABA pathway increase in the lateral thalamus of Sprague Dawley rats during the proestrus/estrus phase. J. Cell Physiol. 231, 1057–1064. doi: 10.1002/jcp.25198
Keywords: orofacial, herpes zostr, neuralgia, shingles, pain, estrogen, aromatase, thalamus
Citation: Kramer P, Rao M, Stinson C, Bellinger LL, Kinchington PR and Yee MB (2018) Aromatase Derived Estradiol Within the Thalamus Modulates Pain Induced by Varicella Zoster Virus. Front. Integr. Neurosci. 12:46. doi: 10.3389/fnint.2018.00046
Received: 06 June 2018; Accepted: 14 September 2018;
Published: 12 October 2018.
Edited by:Vinay V. Parikh, Temple University, United States
Reviewed by:David A. Bereiter, University of Minnesota, United States
Angel Nunez, Universidad Autonoma de Madrid, Spain
Enza Palazzo, Università degli Studi della Campania “Luigi Vanvitelli” Naples, Italy
Copyright © 2018 Kramer, Rao, Stinson, Bellinger, Kinchington and Yee. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Phillip R. Kramer, firstname.lastname@example.org