ORIGINAL RESEARCH article

Front. Psychiatry, 20 December 2024

Sec. Behavioral and Psychiatric Genetics

Volume 15 - 2024 | https://doi.org/10.3389/fpsyt.2024.1505898

Sex and genetic background influence intravenous oxycodone self-administration in the hybrid rat diversity panel

  • 1. Department of Integrative Physiology, University of Colorado Boulder, Boulder, CO, United States

  • 2. Institute for Behavioral Genetics, University of Colorado Boulder, Boulder, CO, United States

  • 3. Department of Psychology and Neuroscience, University of Colorado Boulder, Boulder, CO, United States

  • 4. Department of Pharmaceutical Sciences, Skaggs School of Pharmacy and Pharmaceutical Sciences, University of Colorado Anschutz Medical Campus, Aurora, CO, United States

Article metrics

View details

3

Citations

1,9k

Views

434

Downloads

Abstract

Opioid Use Disorder (OUD) is an ongoing worldwide public health concern. Genetic factors contribute to multiple OUD-related phenotypes, such as opioid-induced analgesia, initiation of opioid use, and opioid dependence. Here, we present findings from a behavioral phenotyping protocol using male and female rats from 15 genetically diverse inbred strains from the Hybrid Rat Diversity Panel (HRDP). We used a self-administration paradigm to measure the acquisition of oxycodone intake during ten 2-hour sessions and escalation of oxycodone use during ten 12-hour sessions. During both the acquisition and escalation phases of self-administration, we observed that genetic background and sex influence oxycodone intake. The heritability of oxycodone intake phenotypes ranged between 0.26 to 0.54, indicating that genetic background plays a major role in the variability of oxycodone consumption. Genetic background and sex also influenced additional phenotypes recorded during oxycodone self-administration including lever discrimination and timeout responding. The genetic contribution to these traits was slightly more moderate, with heritability estimates ranging between 0.25 to 0.42. Measures of oxycodone intake were highly positively correlated between acquisition and escalation phases. Interestingly, the efficacy of oxycodone analgesia was positively correlated with oxycodone intake during the escalation phase, indicating that the initial behavioral responses to oxycodone may predict self-administration phenotypes. Together, these data demonstrate that sex and genetic background are major contributors to oxycodone self-administration phenotypes.

1 Introduction

Approximately 6.7-7.6 million individuals 12 years or older are estimated to have opioid use disorder (OUD) in the United States, and the opioid epidemic continues to pose a major public health issue (1). Prescription opioids have long been considered the gold standard for pain management (2, 3). However, long-term use of these drugs confers an increased risk of several adverse health outcomes including tolerance, OUD, and overdose (46). Not all individuals who use prescription opioids develop signs of misuse, physical dependence, or OUD, suggesting that some individuals may be more vulnerable to problematic use (7, 8). Examining how genetic variability contributes to differences in the initiation of recreational opioid use and the progression to compulsive opioid use will be essential for understanding the biological underpinnings of OUD.

Heritability estimates for OUD-related traits range between 0.31 and 0.54, suggesting that genetic factors contribute to the risk of developing OUD in humans (911). Genome-wide association studies (GWAS) have had limited success in identifying specific genetic variants that contribute to the liability for developing OUD (12). Several GWAS have implicated a single nucleotide polymorphism (SNP) in OPRM1 that confers a heightened risk of developing OUD, but few novel SNPs have been identified (13). The cross-sectional nature of most GWAS makes it difficult to study the genetic factors contributing to specific stages of OUD. Recent studies have tried to address this limitation by studying opioid misuse or problematic opioid use (POU), which may be analogous to the initial stages of OUD (14). POU is genetically correlated with OUD and opioid dependence, but there is little to no overlap in the genetic variants that confer heightened risk for POU or OUD (14). Although POU may contribute to the development of OUD, the progression between these phenotypes remains unclear. Rodent models can more precisely measure the initiation of opioid use and the shift to the compulsive-like escalation of opioid intake while also controlling for genetic and environmental factors.

Gender and sex also play a role in prescription opioid use and the development of OUD (1519). Men display higher rates of nonmedical prescription opioid use and are at higher risk of prescription opioid overdose mortality compared to women (16, 20). Human genetics studies have implicated candidate genes that may increase susceptibility to opioid dependence in a sex-specific manner (21, 22). Unfortunately, sex differences or gene-by-sex interactions are not commonly studied or reported in GWAS of opioid-related traits (2329). Many questions remain about how interactions between genetic background and sex affect opioid consumption and other related traits.

Rodent models can be effectively used to study how interactions between genetic background and sex influence opioid-related behaviors. The Hybrid Rat Diversity Panel (HRDP) is comprised of nearly 100 genetically divergent inbred rat strains, including two recombinant inbred panels (the HXB/BXH and FXLE/LEXF panels) and several divergent classic inbred strains (30). Due to the high genetic diversity between strains, the HRDP is especially well-suited for examining genetic contributions to complex physiological and behavioral traits. Previous work from our lab demonstrated that both sex and genetic background influence behavioral measures of somatosensation and oxycodone-induced analgesia in HRDP strains (31). Oral and intravenous (i.v.) oxycodone self-administration has been reported in select strains from the HRDP, and the occurrence of sex differences in oxycodone intake is dependent on genetic background (32, 33). Here, we used an i.v. self-administration paradigm to examine how interactions between genetic background and sex shape the acquisition and escalation of oxycodone self-administration phenotypes across 15 HRDP strains.

2 Methods

2.1 Subjects

Adult (PND 60+) male and female rats (n=266) from 15 HRDP strains were used for these experiments. Two strains (F344/NCrl and WKY/NCrl) were obtained from Charles River Laboratories, and the remaining 13 strains were obtained from the Medical College of Wisconsin (provided by Dr. Melinda Dwinell, R24OD024617). Strains and sample sizes are described in Table 1, and the attrition rate is depicted in Supplementary Figure 1. Upon arrival, rats were allowed to habituate for at least one week. Before intravenous surgery and self-administration procedures, all animals were tested for somatosensory and analgesia-related measures, as described in the Supplementary Methods and previously (31). Rats were single-housed in a temperature (22°C) and humidity (40%) controlled animal vivarium on a 12-h light/12-h dark cycle. Rats were provided with standard rat chow (Teklad 2918, Envigo, Indianapolis, IN) and water ad libitum. Animals were tested in 22 cohorts (n=15-24/cohort). The ACI/EurMcwi strain was used as a control strain in all batches obtained from the Medical College of Wisconsin to allow for the detection and minimization of batch effects. This strain was chosen due to preliminary studies identifying that the ACI/EurMcwi strain displays robust behavioral responses in all outcome measures. All procedures were conducted in accordance with institutional guidelines outlined by the Institutional Animal Care and Use Committee at the University of Colorado Boulder, an Association for Assessment and Accreditation of Laboratory Animal Care International accredited institution.

Table 1

StrainRRIDSexAcquisitionEscalation
ACI/EurMcwiRRRC_00284Female2116
Male1814
BN-Lx/CubRGD_61117Female55
Male41
BXH6/CubRGD_2307136Female107
Male127
F344/NCrlRGD_737926Female98
Male99
F344/StmRGD_1302686Female65
Male1110
HXB1/IpcvRGD_2307094Female75
Male87
HXB2/IpcvMcwiRGD_149735520Female77
Male87
HXB10/IpcvMcwiRGD_38549351Female75
Male98
HXB17/IpcvRGD_2307085Female54
Male88
HXB23/IpcvRGD_2307093Female1413
Male1110
HXB31/IpcvMcwiRGD_149735519Female84
Male76
LE/StmRGD_629485Female88
Male44
M520/NRRRC_00168Female1010
Male87
SHR/OlaIpcvRGD_631848Female64
Male74
WKY/NCrlRGD_1358112Female107
Male98
TotalFemale133103
Male133109

Sample size per strain and sex during the acquisition and escalation phases.

Due to the low sample size in BN-Lx/Cub males, this strain was eliminated from statistical analyses during the escalation phase.

2.2 Surgery

Chronic indwelling intra-jugular catheters were implanted using a modified procedure described previously (34). Animals were anesthetized (2-4% isoflurane), and intravenous catheters were implanted in the right jugular vein under aseptic conditions. Once the vein was isolated, it was punctured with a 22-gauge needle and the tubing was inserted and secured with suture thread. Sterile catheters (Access Technologies, Skokie, IL) consisted of 14 cm of polyurethane tubing (0.51 mm inner diameter, 1.12 mm outer diameter) secured to a 22-gauge back mount pedestal (Protech International). Immediately prior to surgery, animals were administered the analgesic carprofen (5 mg/kg, s.c.) and antibiotic enrofloxacin (5 mg/kg, s.c.). Animals received daily subcutaneous injections of carprofen (5 mg/kg) for two days following surgery. Catheters were flushed daily with 0.2 mL heparinized (20 IU/ml) bacteriostatic saline containing gentamicin sulfate (0.33 mg/ml; Hospira). Catheter patency was evaluated using 0.2 mL propofol (10 mg/mL propofol, Sagent) solution before the acquisition phase of oxycodone self-administration, before the escalation phase, and after the final session of the escalation phase.

2.3 Oxycodone self-administration

Self-administration procedures were conducted in operant chambers (Med Associates, St. Albans, VT) containing two retractable levers (a drug-paired left lever and an inactive right lever), stimulus cue lights above each lever, and a sound-attenuating fan. The acquisition and escalation of oxycodone intake was measured using a two-phase self-administration paradigm (Figure 1A). All self-administration sessions began at the start of the dark phase of the light/dark cycle. During the acquisition phase, rats were trained to self-administer oxycodone (Oxycodone HCl; B&B pharmaceutical, Englewood, CO) on a fixed-ratio 1 (FR1) reinforcement schedule in ten 2-hour “short-access” (ShA) sessions. Responses on the drug-paired lever resulted in an oxycodone infusion (0.15 mg/kg/infusion) delivered over 5-s and a cue light (7.5-W white light, 20-s). Each oxycodone infusion was followed by a 20-s timeout period (TO20). Responses on the inactive lever were recorded but had no consequences. After the acquisition phase, rats were tested under a progressive ratio (PR) schedule to evaluate motivation to obtain oxycodone. Due to a procedural error during the PR sessions, the data are unusable and not shown. Rats were then transitioned to the escalation phase that included ten 12-hour “long-access” (LgA) sessions under the same FR1:TO20 schedule of reinforcement (35).

Figure 1

2.4 Behavioral phenotypes

2.4.1 Average hourly intake

The average hourly intake was calculated by dividing the number of infusions within a session by the duration of that session (hr). This measure was used to normalize the oxycodone intake across the acquisition (ShA; 2-hr) and escalation (LgA; 12-hr) sessions and depict the overall pattern of self-administration across both phases of self-administration.

2.4.2 Oxycodone intake

Oxycodone intake was evaluated across different levels of detail. The most detailed and granular measure includes the number of oxycodone infusions per session. This was used to depict session-level data and describe the overall pattern of self-administration. Oxycodone intake was also evaluated by averaging oxycodone infusions across “early” (first three sessions) and “late” (last three sessions) time points. This measure was used to describe how oxycodone intake changes during the acquisition and escalation phases. Oxycodone intake at the early and late time points was also used to calculate a difference score for each rat as follows:

The broadest measure of oxycodone intake was the total oxycodone dose. This was calculated by adding the cumulative oxycodone dose received throughout acquisition or escalation.

2.4.3 Lever discrimination

This phenotype was used to evaluate the ability of the rats to learn to discriminate between the drug-paired and inactive levers across the acquisition and escalation phases. We calculated a lever discrimination score during the early and late time points for each phase as follows:

2.4.4 Normalized timeout responding

Timeout responding was evaluated as a measure of perseverative responding during periods when oxycodone is unavailable. Because animals that self-administer more oxycodone have more opportunities for timeout responding, the number of timeout responses was normalized to the number of drug infusions using the following equation:

2.5 Broad-sense heritability estimates

The coefficient of determination (R2) from a 2-way ANOVA with strain and sex as the predictors was used to estimate the broad-sense heritability (H2) for the following behavioral phenotypes during the acquisition and escalation phases: total oxycodone intake, early and late oxycodone intake, change in oxycodone intake, early and late lever discrimination, early and late normalized timeout responses.

2.6 Statistical analysis

All data are presented as mean ± SEM. Longitudinal data for hourly intake or intake per session was analyzed using a repeated measures ANOVA with session as the within-subject factor and strain and sex as the between-subject factors. Oxycodone intake, lever discrimination, and normalized timeout responding were analyzed with repeated measures ANOVAs with timepoint (early or late) as the within-subject factor and strain and sex as the between-subject factors. Results from repeated measures ANOVAs are reported in Supplementary Table 1. Two-way ANOVAs were run to test the effects of strain, sex, and their interaction for total oxycodone intake and the change in oxycodone intake. Results from two-way ANOVAs are presented in Supplementary Table 2. To examine sex differences in total oxycodone intake during acquisition and escalation, a simple main effects analysis was performed in which Student’s t-tests were used to test the significance of sex within each strain. Pearson correlations were used to evaluate the relationship between oxycodone analgesia and self-administration phenotypes, using strain means calculated within each sex for each behavioral phenotype. Pairwise correlations between oxycodone behavioral phenotypes are presented in Supplementary Table 3.

Outliers were identified and winsorized prior to statistical analysis, as described in the Supplementary Methods. Missing data (< 2% of self-administration session data) was imputed as described in the Supplementary Methods. Statistical significance was set as p < 0.05. For the sex differences analysis, a Bonferroni correction was applied based on the number of tests for 15 strains during acquisition (p < 0.003) and 14 strains during escalation (p < 0.004). All data analysis was conducted in R v4.3.2.

3 Results

3.1 Oxycodone self-administration in males and females

Male and female rats from 15 HRDP strains underwent a behavioral protocol designed to measure the acquisition and escalation of i.v. oxycodone self-administration (Figure 1A). The average hourly oxycodone intake was calculated to describe and compare the general pattern of oxycodone consumption in males and females during acquisition and escalation sessions collapsed across strains. We observed a general pattern of increasing oxycodone intake across the entire procedure (Figure 1B, F6.37,1368.52 = 45.55, p < 0.001). Both males and females increased their oxycodone intake throughout the procedure, with males generally showing higher intake across sessions (F1,215 = 9.82, p = 0.002). Next, we analyzed how the interaction between genetic background and sex influenced various aspects of self-administration.

3.2 Oxycodone intake

To assess strain and sex differences in the acquisition of oxycodone self-administration rats were trained to self-administer oxycodone in 10 daily short-access sessions. The general pattern of oxycodone intake per session during the acquisition phase (Figure 2) was shaped by a strain-sex interaction (F14,236 = 3.24, p < 0.001) and a strain-session interaction (F76.12,1283.21 = 3.11, p < 0.001). Males and females from a few strains (e.g., HXB2/IpcvMcwi) displayed divergent patterns of oxycodone consumption, with males having greater intake than females during acquisition. Strains also differed in the general pattern of self-administration over time. Some strains (e.g., HXB23/Ipcv and HXB31/IpcvMcwi) displayed relatively stable responding while others (e.g., HXB1/Ipcv) rapidly increased oxycodone intake across the acquisition phase. To simplify the strain and sex comparisons, we calculated the total oxycodone dose consumed during the acquisition phase. Figure 3 illustrates that total oxycodone intake was shaped by a strain-sex interaction (F14,236 = 3.24, p < 0.001). Males from the HXB2/IpcvMcwi strain consumed more oxycodone than females (t8.29 = -6.59, p < 0.001). Males from the ACI/EurMcwi (t29.71 = -2.89, p = 0.007) and WKY/NCrl (t15.73 = -2.56, p = 0.02) strains also displayed increased oxycodone intake compared to their female counterparts, but these sex differences did not survive multiple testing correction.

Figure 2

Figure 3

To further characterize how patterns of oxycodone consumption change across the acquisition period the mean intake during the first three acquisition sessions (“early”) and last three acquisition sessions (“late”) was calculated (Supplementary Figure 2). Within these windows, oxycodone intake was shaped by a strain-sex interaction (F14,236 = 3.66, p < 0.001) and a strain-timepoint interaction (F14,236 = 6.99, p < 0.001). To further explore these strain differences, the change in intake was calculated as the difference in intake between early and late acquisition (Figure 4). Genetic background influenced the change in oxycodone intake across acquisition, as indicated by a main effect of strain (F14,236 = 6.97, p < 0.001). Although most strains increased oxycodone intake, some strains (e.g., BXH6/Cub, HXB31/IpcvMcwi) showed a minimal change in intake during the acquisition phase.

Figure 4

Following acquisition, rats underwent 10 daily long-access sessions to measure the escalation of oxycodone self-administration. The BN-Lx/Cub strain is included in Figure 5 to qualitatively describe their pattern of self-administration but was excluded from statistical analysis due to the low sample size in the males (n=1). Throughout escalation, oxycodone intake (Figure 5) was influenced by a strain-sex (F13,184 = 4.44, p < 0.001) and a strain-session (F70.49,997.76 = 2.33, p < 0.001) interaction, suggesting that there is a complex interplay between how genetic background and sex influence the escalation of oxycodone intake. To simplify this interaction, the total oxycodone dose during the escalation phase was calculated (Figure 6). Here, we again see that sex and strain contribute to overall oxycodone intake during the escalation sessions as indicated by a strain-sex interaction (F13,184 = 4.44, p < 0.001). A striking difference was observed in HXB2/IpcvMcwi males that self-administered significantly more oxycodone than females (t11.33 = -5.74, p = 0.001). Nominal sex differences were observed in the WKY/NCrl strain (t7.32 = -2.73, p = 0.03) but did not survive multiple testing correction.

Figure 5

Figure 6

Similar to the analysis of acquisition of oxycodone intake, the mean intake during the first three escalation sessions (“early”) and last three escalation sessions (“late”) was calculated (Supplementary Figure 3). Oxycodone intake was influenced by a strain-sex (F13,184 = 3.83, p < 0.001) and a strain-timepoint (F13,184 = 3.46, p < 0.001) interaction suggesting that sex differences were not consistent across strains and the magnitude of escalation was not consistent across strains. To further describe strain differences the change in oxycodone intake during the escalation phase was calculated (Figure 7). A main effect of strain (F13,184 = 3.48, p < 0.001) highlights the significant variation between the strains in their propensity to increase oxycodone intake during the escalation phase.

Figure 7

3.3 Lever discrimination

As another measure of behavioral responding during the oxycodone self-administration procedure, we calculated each rat’s ability to discriminate between the lever paired with oxycodone delivery and the inactive lever. Lever discrimination was evaluated by calculating the ratio of correct responses to total responses for each rat within individual sessions. Therefore, a value close to one indicates that the rat is almost exclusively pressing the active lever. To evaluate how lever discrimination changes across sessions, we calculated the mean lever discrimination during the first three sessions (“early”) and last three sessions (“late”) of the acquisition and escalation phases. During acquisition (Figure 8A), lever discrimination was shaped by strain-sex (F14,236 = 2.31, p = 0.005) and strain-timepoint (F14,236 = 3.44, p < 0.001) interactions. During escalation (Figure 8B), lever discrimination was influenced by a strain-timepoint interaction (F13,184 = 2.08, p = 0.017). These findings suggest that learning to discriminate the outcomes between the two levers generally improves or stays the same throughout the procedure but is also dependent on the strain and sex of the animal. It is interesting that rats from the genetically related SHR/OlaIpcv and WKY/NCrl strains (36) displayed divergent patterns of lever discrimination across both phases of self-administration (Figure 8C). Lever discrimination in WKY/NCrl rats improved throughout both phases of self-administration while SHR/OlaIpcv rats show persistent deficits in lever discrimination hovering around 50% lever discrimination.

Figure 8

3.4 Normalized timeout responding

We also evaluated the persistence of responding during periods of drug unavailability by evaluating drug-paired lever responding during the 20-s timeout period following each oxycodone infusion. Because animals that self-administer more oxycodone have more opportunities for timeout responding, the number of timeout responses was normalized to the number of oxycodone infusions. Normalized timeout responding during acquisition (Figure 9A) was influenced by a strain-sex-timepoint interaction (F14,236 = 1.78, p = 0.043). Although most animals displayed low levels of timeout responding throughout acquisition, it was striking that some strains (e.g., HXB1/Ipcv) were more likely to engage in persistent responding during the timeout period, especially during the late timepoint. Normalized timeout responding during escalation (Figure 9B) was influenced by a strain-sex (F13,184 = 3.79, p < 0.001) and a strain-timepoint (F13,184 = 3.11, p < 0.001) interaction. Here, males from a few strains (e.g., HXB2/IpcvMcwi) displayed a robust increase in timeout responding.

Figure 9

3.5 Correlations between oxycodone-related phenotypes

To evaluate the relationships between oxycodone-related behavioral phenotypes, Pearson correlations were calculated using strain means within each sex (Figure 10). Phenotypes related to oxycodone-induced analgesia, as described previously in (31), were included to describe the relationship between oxycodone analgesia and self-administration phenotypes. The maximal possible efficacy (% MPE) was used as a measure of acute analgesia 15- and 30-minutes after oxycodone administration, where higher values represent a greater degree of oxycodone-induced analgesia (Supplementary Methods). All pairwise comparisons between phenotypes are included in Supplementary Table 3. Select correlations between phenotypes are displayed in Figure 11. The magnitude of oxycodone-induced analgesia at 30-minutes positively correlated with total oxycodone intake during escalation (r(26) = 0.39, p = 0.04) (Figure 11A). This suggests that drug-naïve animals that experience a greater degree of acute oxycodone-induced analgesia may go on to consume higher levels of oxycodone. The normalized timeout responding during early acquisition sessions negatively correlated with lever discrimination during late acquisition sessions (r(26) = -0.42, p = 0.02) (Figure 11B). This suggests that high levels of responding during a period of drug unavailability correlate with poor lever discrimination during the acquisition phase.

Figure 10

Figure 11

3.6 Heritability estimates

The broad-sense heritability (H2) of several behavioral phenotypes was calculated by a 2-way ANOVA using strain and sex as the independent variables (Table 2). Measures of oxycodone intake were highly heritable, ranging between H2 = 0.26-0.54. Other aspects of oxycodone self-administration, such as lever discrimination and normalized timeout responding, were more moderately heritable, ranging between H2 = 0.25-0.42.

Table 2

PhenotypeAcquisition HeritabilityEscalation Heritability
Total Oxycodone Intake0.500.54
Early Oxycodone Intake0.480.33
Late Oxycodone Intake0.420.48
Change in Intake0.320.26
Early Lever Discrimination0.290.31
Late Lever Discrimination0.270.25
Early Normalized Timeout Responses0.340.35
Late Normalized Timeout Responses0.330.42

Broad-sense heritability estimates for self-administration phenotypes during the acquisition and escalation phases.

Heritability estimates were calculated using the coefficient of determination (R2) from a 2-way ANOVA with strain and sex as the predictors.

4 Discussion

Individual genetic variation plays a major role in the risk of using and misusing opioids (12, 37). Using selected inbred rat strains from the HRDP, we demonstrated that sex and genetic background influence several specific features of oxycodone self-administration. We observed that all male and female rats reliably acquire oxycodone self-administration, and genetic background and sex contribute to variability in the escalation of oxycodone intake. Other measures observed during oxycodone self-administration, such as lever discrimination and timeout responding, were also mediated by interactions between strain and sex. Nearly all measures of oxycodone intake were highly heritable (H2 = 0.26-0.54), while the measures of learning (lever discrimination) and drug seeking (timeout responding) were slightly less heritable (H2 = 0.25-0.42).

We found that the interaction between genetic background and sex contributes to behavioral variance in oxycodone self-administration. This complements previous findings that oral oxycodone self-administration is highly heritable and that sex differences in self-administration are dependent on genetic background (32, 33). Sex differences have not consistently been observed in previous oxycodone self-administration studies in inbred and outbred rat strains (32, 3842). For example, females from the outbred Wistar strain self-administer more oxycodone than male counterparts (40). Under the same self-administration paradigm, inbred male Brown-Norway rats consume more oxycodone than females, while rats from the ACI, F344, and WKY strains do not display sex differences in oxycodone intake (32). Variation in the self-administration procedure can also lead to sex differences in oxycodone self-administration phenotypes. Under the FR1 reinforcement schedule, outbred male Sprague-Dawley rats administer more oxycodone than females but there are no sex differences in oxycodone intake under FR2 and FR5 schedules (41). Together, these findings indicate that sex differences in oxycodone self-administration are highly dependent on genetic background and the specific self-administration paradigm. We observed that WKY/NCrl males display nominally higher levels of oxycodone intake than females. Interestingly, the interaction between sex and genetic background influences oxycodone pharmacokinetics (32). WKY male rats display higher peak levels of plasma oxycodone after an intravenous infusion compared to WKY females, which may contribute to the nominal sex differences in oxycodone intake we observed. These sex differences in oxycodone intake and pharmacokinetics may also be mediated by hormonal signaling. Although we did not measure estrous phase, estradiol is a sex hormone that fluctuates throughout the estrous cycle and increases the concentration of cytochrome P450 2D in the brain, leading to enhanced oxycodone metabolism (43). It is possible that the observed lower intake in females from some strains results from this metabolic difference due to estradiol fluctuations. Given the dearth of research investigating the mechanisms of sex differences in the HRDP, these are exciting avenues for future research.

Our lab previously demonstrated that sex and genetic background contribute to the magnitude and duration of oxycodone-induced analgesia (31). In the current study, the efficacy of oxycodone-induced analgesia in drug-naïve animals was positively correlated with oxycodone intake during the escalation phase of self-administration. This suggests that animals having greater sensitivity to oxycodone-induced analgesia also consume higher amounts of oxycodone. Previous work in male Sprague-Dawley rats indicates that low sensitivity to morphine-induced analgesia is associated with the escalation of morphine intake (44). This discrepancy may be due to the pharmacokinetic and pharmacodynamic properties of the opioids being tested or genetic differences between strains. For example, it is well known that stimulation of the mu-receptor mediates analgesia and reward-related phenotypes (45, 46). Genetic variants in the Oprm1 gene that impact mu receptor function may underlie the relationship between these behavioral phenotypes. A single nucleotide polymorphism in the Oprm1 gene in mice alters both opioid-induced analgesia and self-administration (4750). Strain differences in mu-receptor polymorphisms, gene or protein expression, or alterations in protein function may modulate this variability in analgesia and self-administration phenotypes.

Genetic background contributed to variability in lever discrimination throughout the oxycodone self-administration procedure. Two genetically related strains, the Spontaneously Hypertensive Rats (SHR) and Wistar-Kyoto rats (WKY), displayed divergent patterns of lever discrimination throughout the self-administration period. The SHR strain has traditionally been used as a rodent model of attention deficit hyperactivity disorder and is often compared with the WKY strain when assessing learning and memory phenotypes (5154). In our experiment, WKY/NCrl rats increased lever discrimination throughout the acquisition phase and displayed stable, high levels of lever discrimination during the escalation phase. SHR/OlaIpcv rats, however, showed low levels of lever discrimination that did not improve over time. This may suggest that SHR rats display deficits in learning to distinguish the outcomes resulting from lever responding. Poor lever discrimination may also be influenced by other related and/or competing traits. Male SHR rats also display greater levels of locomotion than WKY rats in the locomotor, open field, and elevated plus maze tasks (55, 56). Thus, the poor lever discrimination in SHR rats may result from generalized psychomotor activation that causes indiscriminative responding at both levers. Oxycodone-induced locomotor activity and sensitization are heritable phenotypes, and these strains display may differ in these traits, further contributing to poor lever discrimination (57). Finally, SHR rats also display greater impulsivity in non-drug learning procedures, suggesting that higher impulsivity could contribute to deficits in lever discrimination (51, 54, 58, 59).

We observed that interactions between strain and sex influenced normalized timeout responding during the acquisition and escalation phases. During the escalation phase, males from several strains displayed higher levels of timeout responding than female counterparts. Interestingly, outbred Sprague-Dawley males also display high levels of timeout responding during oxycodone self-administration (38). Drug-seeking that continues during periods of drug unavailability has been associated with compulsive drug use patterns and may suggest that some strains are more prone to this behavioral phenotype (60). Responding during the timeout period may also indicate perseverative responding, with higher levels of timeout responding associated with an increased effort to try to obtain oxycodone (61, 62). Timeout responding may also represent a learning deficit, where animals fail to associate the activation of the cue light with the period of drug unavailability. It will be important to conduct more precise measurements to tease out these interpretations and more accurately interpret these findings.

Together, these results suggest that genetic variance between strains contributes to variability in several aspects of oxycodone self-administration. We next plan to use this population of rats for genetic mapping studies and to examine how the body and brain respond to long-term oxycodone use.

Statements

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The animal study was approved by Institutional Animal Care and Use Committee at the University of Colorado Boulder, an Association for Assessment and Accreditation of Laboratory Animal Care International accredited institution. The study was conducted in accordance with the local legislation and institutional requirements.

Author contributions

ED: Conceptualization, Data curation, Formal analysis, Investigation, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing, Methodology, Software. JW: Writing – review & editing, Investigation, Methodology. LH: Writing – review & editing, Investigation, Methodology. KB: Writing – review & editing, Investigation, Supervision, Methodology. AK: Writing – review & editing, Investigation, Supervision, Methodology. EM: Writing – review & editing, Formal analysis, Investigation, Software. LS: Writing – review & editing, Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Visualization, Data curation, Resources, Software. ME: Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review & editing, Visualization. RB: Writing – review & editing, Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Writing – original draft, Visualization.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was supported by the National Institutes of Health, National Institute on Drug Abuse U01 DA051937 (Ehringer, Bachtell, Saba). ED was supported by the National Institutes of Health, National Institute on Drug Abuse training grant (T32 DA017637). LS was supported by the National Institutes of Health, National Institute on Alcohol Abuse and Alcoholism R24 AA013162 (Tabakoff, Hoffman, Saba) and National Institutes of Health, National Institute on Drug Abuse P30 DA044223 (Williams, Saba).

Acknowledgments

The authors thank Melinda Dwinell PhD (Medical College of Wisconsin; R24OD024617) for providing several of the inbred strains studied in this article. We thank Caleb Hodges and Safa Vaseemuddin for assistance with collecting behavioral data.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declare that no Generative AI was used in the creation of this manuscript.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2024.1505898/full#supplementary-material

References

  • 1

    KeyesKMRutherfordCHamiltonABarocasJAGelbergKHMuellerPPet al. What is the prevalence of and trend in opioid use disorder in the United States from 2010 to 2019? Using multiplier approaches to estimate prevalence for an unknown population size. Drug Alcohol Depend Rep. (2022) 3:100052. doi: 10.1016/j.dadr.2022.100052

  • 2

    McQuayH. Opioids in pain management. Lancet. (1999) 353:2229–32. doi: 10.1016/S0140-6736(99)03528-X

  • 3

    VowlesKEMcEnteeMLJulnesPSFroheTNeyJPvan der GoesDN. Rates of opioid misuse, abuse, and addiction in chronic pain: a systematic review and data synthesis. PAIN. (2015) 156:569. doi: 10.1097/01.j.pain.0000460357.01998.f1

  • 4

    BallantyneJC. Opioid therapy in chronic pain. Phys Med Rehabil Clin N Am. (2015) 26:201–18. doi: 10.1016/j.pmr.2014.12.001

  • 5

    EdlundMJMartinBCRussoJEDeVriesABradenJBSullivanMD. The role of opioid prescription in incident opioid abuse and dependence among individuals with chronic noncancer pain: the role of opioid prescription. Clin J Pain. (2014) 30:557. doi: 10.1097/AJP.0000000000000021

  • 6

    GomesTCampbellTTadrousMMamdaniMMPatersonJMJuurlinkDN. Initial opioid prescription patterns and the risk of ongoing use and adverse outcomes. Pharmacoepidemiology Drug Safety. (2021) 30:379–89. doi: 10.1002/pds.v30.3

  • 7

    CiceroTJEllisMS. The prescription opioid epidemic: a review of qualitative studies on the progression from initial use to abuse. Dialogues Clin Neurosci. (2017) 19:259–69. doi: 10.31887/DCNS.2017.19.3/tcicero

  • 8

    KreekMJReedBButelmanER. Current status of opioid addiction treatment and related preclinical research. Sci Adv. (2019) 5:eaax9140. doi: 10.1126/sciadv.aax9140

  • 9

    KendlerKSKarkowskiLPrescottCA. Hallucinogen, opiate, sedative and stimulant use and abuse in a population-based sample of female twins. Acta Psychiatrica Scandinavica. (1999) 99:368–76. doi: 10.1111/j.1600-0447.1999.tb07243.x

  • 10

    KendlerKSKarkowskiLMNealeMCPrescottCA. Illicit psychoactive substance use, heavy use, abuse, and dependence in a US population-based sample of male twins. Arch Gen Psychiatry. (2000) 57:261–9. doi: 10.1001/archpsyc.57.3.261

  • 11

    TsuangMTLyonsMJMeyerJMDoyleTEisenSAGoldbergJet al. Co-occurrence of abuse of different drugs in men: the role of drug-specific and shared vulnerabilities. Arch Gen Psychiatry. (1998) 55:967–72. doi: 10.1001/archpsyc.55.11.967

  • 12

    CristRCReinerBCBerrettiniWH. A review of opioid addiction genetics. Curr Opin Psychol. (2019) 27:31–5. doi: 10.1016/j.copsyc.2018.07.014

  • 13

    DuffyEPBachtellRKEhringerMA. Opioid trail: Tracking contributions to opioid use disorder from host genetics to the gut microbiome. Neurosci Biobehav Rev. (2024) 156:105487. doi: 10.1016/j.neubiorev.2023.105487

  • 14

    Sanchez-RoigeSFontanillasPJenningsMVBianchiSBHuangYHatoumASet al. Genome-wide association study of problematic opioid prescription use in 132,113 23andMe research participants of European ancestry. Mol Psychiatry. (2021) 26:6209–17. doi: 10.1038/s41380-021-01335-3

  • 15

    GrazianiMNisticòR. Gender differences in pharmacokinetics and pharmacodynamics of methadone substitution therapy. Front Pharmacol. (2015) 6:122. doi: 10.3389/fphar.2015.00122

  • 16

    KerridgeBTSahaTDChouSPZhangHJungJRuanWJet al. Gender and nonmedical prescription opioid use and DSM-5 nonmedical prescription opioid use disorder: Results from the National Epidemiologic Survey on Alcohol and Related Conditions – III. Drug Alcohol Dependence. (2015) 156:4756. doi: 10.1016/j.drugalcdep.2015.08.026

  • 17

    McHughRKTaghianNRNguyenMD. Anxiety and opioid use disorder: potential targets for treatment and prevention. Curr Addict Rep. (2021) 8:136–43. doi: 10.1007/s40429-020-00350-8

  • 18

    RheeTGPeltierMRSofuogluMRosenheckRA. Do sex differences among adults with opioid use disorder reflect sex-specific vulnerabilities? A study of behavioral health comorbidities, pain, and quality of life. J Addict Med. (2020) 14:502. doi: 10.1097/ADM.0000000000000662

  • 19

    SerdarevicMStrileyCWCottlerLB. Gender differences in prescription opioid use. Curr Opin Psychiatry. (2017) 30:238–46. doi: 10.1097/YCO.0000000000000337

  • 20

    WilsonNKariisaMSethPSmithHDavisNL. Drug and opioid-involved overdose deaths - United States, 2017-2018. MMWR Morb Mortal Wkly Rep. (2020) 69:290–7. doi: 10.15585/mmwr.mm6911a4

  • 21

    YangBZHanSKranzlerHRPalmerAAGelernterJ. Sex-specific linkage scans in opioid dependence. Am J Med Genet B Neuropsychiatr Genet. (2017) 174:261–8. doi: 10.1002/ajmg.b.v174.3

  • 22

    YangBZZhouHChengZKranzlerHRGelernterJ. Genomewide gene-by-sex interaction scans identify ADGRV1 for sex differences in opioid dependent African Americans. Sci Rep. (2019) 9:18070. doi: 10.1038/s41598-019-53560-0

  • 23

    ChengZZhouHShervaRFarrerLAKranzlerHRGelernterJ. Genome-wide association study identifies a regulatory variant of RGMA associated with opioid dependence in European Americans. Biol Psychiatry. (2018) 84:762–70. doi: 10.1016/j.biopsych.2017.12.016

  • 24

    DeakJDZhouHGalimbertiMLeveyDFWendtFRSanchez-RoigeSet al. Genome-wide association study in individuals of European and African ancestry and multi-trait analysis of opioid use disorder identifies 19 independent genome-wide significant risk loci. Mol Psychiatry. (2022) 25:110. doi: 10.1038/s41380-022-01709-1

  • 25

    GaddisNMathurRMarksJZhouLQuachBWaldropAet al. Multi-trait genome-wide association study of opioid addiction: OPRM1 and beyond. Sci Rep. (2022) 12:16873. doi: 10.1038/s41598-022-21003-y

  • 26

    GelernterJKranzlerHRShervaRKoestererRAlmasyLZhaoHet al. Genome-wide association study of opioid dependence: multiple associations mapped to calcium and potassium pathways. Biol Psychiatry. (2014) 76:6674. doi: 10.1016/j.biopsych.2013.08.034

  • 27

    KemberRLVickers-SmithRXuHToikumoSNiarchouMZhouHet al. Cross-ancestry meta-analysis of opioid use disorder uncovers novel loci with predominant effects in brain regions associated with addiction. Nat Neurosci. (2022) 25:1279–87. doi: 10.1038/s41593-022-01160-z

  • 28

    NelsonECAgrawalAHeathACBogdanRShervaRZhangBet al. Evidence of CNIH3 involvement in opioid dependence. Mol Psychiatry. (2016) 21:608–14. doi: 10.1038/mp.2015.102

  • 29

    ZhouHRentschCTChengZKemberRLNunezYZShervaRMet al. Association of OPRM1 functional coding variant with opioid use disorder: A genome-wide association study. JAMA Psychiatry. (2020) 77:1072–80. doi: 10.1001/jamapsychiatry.2020.1206

  • 30

    TabakoffBSmithHVanderlindenLAHoffmanPLSabaLM. Networking in biology: the hybrid rat diversity panel. In: HaymanGTSmithJRDwinellMRShimoyamaM, editors. Methods in Molecular Biology. Springer, New York, NY (2019). p. 213–31. doi: 10.1007/978-1-4939-9581-3_10

  • 31

    DuffyEPWardJOHaleLHBrownKTKwilaszAJSabaLMet al. Genetic background and sex influence somatosensory sensitivity and oxycodone analgesia in the Hybrid Rat Diversity Panel. Genes Brain Behav. (2024) 23:e12894. doi: 10.1111/gbb.12894

  • 32

    DoyleMRMartinezARQiaoRDirikSDi OttavioFPascasioGet al. Strain and sex-related behavioral variability of oxycodone dependence in rats. Neuropharmacology. (2023) 237:109635. doi: 10.1016/j.neuropharm.2023.109635

  • 33

    SharpBMFanXRedeiEEMulliganMKChenH. Sex and heredity are determinants of drug intake in a novel model of rat oral oxycodone self-administration. Genes Brain Behavior. (2021) 20:e12770. doi: 10.1111/gbb.12770

  • 34

    O’NeillCELeTendreMLBachtellRK. Adenosine A 2A receptors in the nucleus accumbens bi-directionally alter cocaine seeking in rats. Neuropsychopharmacology. (2012) 37:1245–56. doi: 10.1038/npp.2011.312

  • 35

    WadeCLVendruscoloLFSchlosburgJEHernandezDOKoobGF. Compulsive-like responding for opioid analgesics in rats with extended access. Neuropsychopharmacology. (2015) 40:421–8. doi: 10.1038/npp.2014.188

  • 36

    LouisWJHowesLG. Genealogy of the spontaneously hypertensive rat and Wistar-Kyoto rat strains: implications for studies of inherited hypertension. J Cardiovasc Pharmacol. (1990) 16:S1. doi: 10.1097/00005344-199000167-00002

  • 37

    KuhnBNCannellaNCrowADRobertsATLunertiVAllenCet al. Novelty-induced locomotor behavior predicts heroin addiction vulnerability in male, but not female, rats. Psychopharmacology. (2022) 239:3605–20. doi: 10.1007/s00213-022-06235-0

  • 38

    GuhaSKAlonso-CaraballoYDriscollGSBabbJANealMConstantinoNJet al. Ranking the contribution of behavioral measures comprising oxycodone self-administration to reinstatement of drug-seeking in male and female rats. Front Behav Neurosci. (2022) 16:1035350. doi: 10.3389/fnbeh.2022.1035350

  • 39

    HindsNMWojtasIDGallagherCACorbettCMManvichDF. Effects of sex and estrous cycle on intravenous oxycodone self-administration and the reinstatement of oxycodone-seeking behavior in rats. Front Behav Neurosci. (2023) 17:1143373. doi: 10.3389/fnbeh.2023.1143373

  • 40

    KimbroughAKononoffJSimpsonSKallupiMSedighimSPalominoKet al. Oxycodone self-administration and withdrawal behaviors in male and female Wistar rats. Psychopharmacology. (2020) 237:1545–55. doi: 10.1007/s00213-020-05479-y

  • 41

    MavrikakiMPravetoniMPageSPotterDChartoffE. Oxycodone self-administration in male and female rats. Psychopharmacology. (2017) 234:977–87. doi: 10.1007/s00213-017-4536-6

  • 42

    MavrikakiMLintzTConstantinoNPageSChartoffE. Chronic opioid exposure differentially modulates oxycodone self-administration in male and female rats. Addict Biol. (2021) 26:e12973. doi: 10.1111/adb.12973

  • 43

    ArguellesNRichardsJEl-SherbeniAAMiksysSTyndaleRF. Sex, estrous cycle, and hormone regulation of CYP2D in the brain alters oxycodone metabolism and analgesia. Biochem Pharmacol. (2022) 198:114949. doi: 10.1016/j.bcp.2022.114949

  • 44

    NishidaKSParkTYLeeBHUrsanoRJChoiKH. Individual differences in initial morphine sensitivity as a predictor for the development of opiate addiction in rats. Behav Brain Res. (2016) 313:315–23. doi: 10.1016/j.bbr.2016.07.038

  • 45

    KalsoE. Oxycodone. J Pain Symptom Manage. (2005) 29:4756. doi: 10.1016/j.jpainsymman.2005.01.010

  • 46

    MatthesHWMaldonadoRSimoninFValverdeOSloweSKitchenIet al. Loss of morphine-induced analgesia, reward effect and withdrawal symptoms in mice lacking the mu-opioid-receptor gene. Nature. (1996) 383:819–23. doi: 10.1038/383819a0

  • 47

    BrowneCAEricksonRLBlendyJALuckiI. Genetic variation in the behavioral effects of buprenorphine in female mice derived from a murine model of the OPRM1 A118G polymorphism. Neuropharmacology. (2017) 117:401–7. doi: 10.1016/j.neuropharm.2017.02.005

  • 48

    CollinsDZhangYBlendyJKreekMJ. Murine model of OPRM1 A118G alters oxycodone self-administration and locomotor activation, but not conditioned place preference. Neuropharmacology. (2020) 167:107864. doi: 10.1016/j.neuropharm.2019.107864

  • 49

    MagueSDIsiegasCHuangPLiu-ChenLYLermanCBlendyJA. Mouse model of OPRM1 (A118G) polymorphism has sex-specific effects on drug-mediated behavior. Proc Natl Acad Sci. (2009) 106:10847–52. doi: 10.1073/pnas.0901800106

  • 50

    ZhangYPicettiRButelmanERHoABlendyJAKreekMJ. Mouse model of the OPRM1 (A118G) polymorphism: differential heroin self-administration behavior compared with wild-type mice. Neuropsychopharmacol. (2015) 40:1091–100. doi: 10.1038/npp.2014.286

  • 51

    AparicioCFHenniganPJMulliganLJAlonso-AlvarezB. Spontaneously hypertensive (SHR) rats choose more impulsively than Wistar-Kyoto (WKY) rats on a delay discounting task. Behav Brain Res. (2019) 364:480–93. doi: 10.1016/j.bbr.2017.09.040

  • 52

    MookDMJeffreyJNeuringerA. Spontaneously hypertensive rats (SHR) readily learn to vary but not repeat instrumental responses. Behav Neural Biol. (1993) 59:126–35. doi: 10.1016/0163-1047(93)90847-B

  • 53

    SagvoldenTJohansenEB. Rat models of ADHD. In: StanfordCTannockR, editors. Behavioral Neuroscience of Attention Deficit Hyperactivity Disorder and Its Treatment. Springer, Berlin, Heidelberg (2012). p. 301–15. doi: 10.1007/7854_2011_126

  • 54

    ThanosPKIvanovIRobinsonJKMichaelidesMWangGJSwansonJMet al. Dissociation between spontaneously hypertensive (SHR) and Wistar–Kyoto (WKY) rats in baseline performance and methylphenidate response on measures of attention, impulsivity and hyperactivity in a Visual Stimulus Position Discrimination Task. Pharmacol Biochem Behavior. (2010) 94:374–9. doi: 10.1016/j.pbb.2009.09.019

  • 55

    Diaz HeijtzRCastellanosFX. Differential effects of a selective dopamine D1-like receptor agonist on motor activity and c-fos expression in the frontal-striatal circuitry of SHR and Wistar-Kyoto rats. Behav Brain Funct. (2006) 2:18. doi: 10.1186/1744-9081-2-18

  • 56

    ZubcevicJWatkinsJPerezPDColon-PerezLMLongMTFeboMet al. MEMRI reveals altered activity in brain regions associated with anxiety, locomotion, and cardiovascular reactivity on the elevated plus maze in the WKY vs SHR rats. Brain Imaging Behavior. (2018) 12:1318–31. doi: 10.1007/s11682-017-9798-4

  • 57

    BryantCDGuidoMAKoleLAChengR. The heritability of oxycodone reward and concomitant phenotypes in a LG/J × SM/J mouse advanced intercross line. Addict Biol. (2014) 19:552–61. doi: 10.1111/adb.2014.19.issue-4

  • 58

    MenesesAPerez-GarciaGPonce-LopezTTellezRGallegos-CariACastilloC. Spontaneously hypertensive rat (SHR) as an animal model for ADHD: a short overview. Rev Neurosci. (2011) 22:365–71. doi: 10.1515/rns.2011.024

  • 59

    SanabriaFKilleenPR. Evidence for impulsivity in the Spontaneously Hypertensive Rat drawn from complementary response-withholding tasks. Behav Brain Funct. (2008) 4:7. doi: 10.1186/1744-9081-4-7

  • 60

    Deroche-GamonetVBelinDPiazzaPV. Evidence for addiction-like behavior in the rat. Science. (2004) 305:1014–7. doi: 10.1126/science.1099020

  • 61

    Bakhti-SurooshATowersEBLynchWJ. A buprenorphine-validated rat model of opioid use disorder optimized to study sex differences in vulnerability to relapse. Psychopharmacology. (2021) 238:1029–46. doi: 10.1007/s00213-020-05750-2

  • 62

    GannonBMRiceKCMurnaneKS. MDPV “high-responder” rats also self-administer more oxycodone than their “low-responder” counterparts under a fixed ratio schedule of reinforcement. Psychopharmacology. (2021) 238:1183–92. doi: 10.1007/s00213-021-05764-4

Summary

Keywords

behavioral genetics, opioid, addiction, sex differences, analgesia, operant conditioning, inbred rat, opioid use disorder

Citation

Duffy EP, Ward JO, Hale LH, Brown KT, Kwilasz AJ, Mehrhoff EA, Saba LM, Ehringer MA and Bachtell RK (2024) Sex and genetic background influence intravenous oxycodone self-administration in the hybrid rat diversity panel. Front. Psychiatry 15:1505898. doi: 10.3389/fpsyt.2024.1505898

Received

03 October 2024

Accepted

25 November 2024

Published

20 December 2024

Volume

15 - 2024

Edited by

Melloni Nicole Cook, University of Memphis, United States

Reviewed by

Elizabeth Doncheck, Medical University of South Carolina, United States

Le Wang, Rutgers, The State University of New Jersey, United States

Updates

Copyright

*Correspondence: Eamonn P. Duffy,

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics