ORIGINAL RESEARCH article

Front. Surg., 31 August 2022

Sec. Surgical Oncology

Volume 9 - 2022 | https://doi.org/10.3389/fsurg.2022.947218

Association of serum reproductive hormones changes after neoadjuvant chemotherapy with hormone receptors expression alterations and survival outcomes in breast cancer

  • Department of Breast and Thyroid Surgery, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China

Article metrics

View details

2

Citations

2k

Views

843

Downloads

Abstract

Purpose:

This study aimed to determine the effect of neoadjuvant chemotherapy (NAC) on circulating levels of reproductive hormones and evaluate the correlation of hormone changes after NAC with hormone receptors expression alterations and relapse-free survival (RFS) outcomes in breast cancer.

Methods:

Information from 181 breast cancer patients who received NAC was retrospectively analyzed. For hormones parameters, the median and interquartile range (IQR) were provided at baseline and the end of NAC then was compared by Wilcoxon signed-rank test. Categorical variables were represented as numbers and percentages and were compared via two-sided chi-square and Fisher's tests. The RFS outcomes were compared between patients according to hormone changes using the log-rank test. Univariate and multivariate survival analyses with hazard ratios (HR) and 95% confidence intervals (95% CI) were carried out using Cox regression.

Results:

Sex steroids including estradiol, progesterone, testosterone, and dehydroepiandrosterone sulfate (DHEAS) levels decreased significantly after NAC among both premenopausal and postmenopausal patients (all P < 0.05). Decreased estradiol levels were associated with reduced progesterone receptor (PR) expression (P = 0.030). In multivariate survival analysis, the non-decreased progesterone level was strongly associated with worse RFS (non-decreased vs. decreased, HR = 7.178, 95% CI 2.340–22.019, P = 0.001). Patients with decreased progesterone levels exhibited better 3-year RFS compared with those with non-decreased (87.6% vs. 58.3%, log-rank, P = 0.001).

Conclusion:

Multiple reproductive hormone levels were influenced by NAC. The change in estradiol level had a positive connection with PR expression alteration. Furthermore, an inverse association between the change in progesterone level and RFS outcomes was found. These findings may provide a theoretical basis for pre-operative endocrine therapy combined with NAC in breast cancer patients.

Introduction

Female breast cancer, as the leading cause of global cancer incidence in 2020, has been the fifth leading cause of cancer mortality worldwide, with an estimated 2.3 million new cases and 685,000 deaths (1). Neoadjuvant chemotherapy (NAC) as a standard of care for locally advanced breast cancer, is increasingly used for all breast cancer subtypes (2, 3), aiming to reduce tumor size before surgery. However, in young patients, chemotherapy-associated ovarian damage is a major limitation of NAC (4). Several mechanisms lead to chemotherapy-induced ovarian injury and reduction of the ovarian reserve (5, 6), directly affecting endogenous sex hormone concentrations such as estradiol, progesterone, follicle-stimulating hormone (FSH), and luteinizing hormone (LH) (7). Due to the benefit seen in some studies irrespective of the hormone receptors' status, a direct cytotoxic effect of chemotherapy on the ovary and an indirect endocrine effect have been postulated (8, 9).

It is well known that reproductive hormones play a critical role in breast carcinogenesis. Available evidence has demonstrated that endogenous reproductive hormones can sustain tumor growth and are associated with breast cancer risk (10). Our previous works (11) and other studies (12, 13) found an association between pre-treatment hormones and prognosis in patients who received NAC treatment. A recent study has described the association of chemotherapy-induced ovarian failure with the improved outcome regardless of hormone receptor status (14), highlighting the vital role of ovarian function suppression after neoadjuvant/adjuvant chemotherapy in inhibiting disease progression. Although this study reveals the potential role of reproductive hormones in cancer progression, it is not clear the exact effect of hormone changes after neoadjuvant/adjuvant chemotherapy on survival outcomes. To address this question, we evaluated serum reproductive hormone changes after NAC treatment in association with survival outcomes in breast cancer patients.

Most breast malignancies are hormone-dependent, and express hormone receptors such as estrogen receptor (ER) and progesterone receptor (PR). Many studies have suggested that the expression status of ER and PR may differ between the initial diagnostic core biopsies and excisional specimens after NAC (15, 16). The changes in these receptors reveal important clinical significance as clinicians need to make appropriate treatment adjustments according to the status of these biomarkers. However, the mechanisms mediating the changes in hormone receptor expression remain unknown. Although the effect of NAC on hormone receptor expression has been widely studied, the results were controversial.

In this context, we analyzed changes in estradiol, progesterone, testosterone, FSH, LH, dehydroepiandrosterone sulfate (DHEAS), sex hormone-binding globulin (SHBG) levels, and free androgen index (FAI) after NAC treatment in pre- and postmenopausal women diagnosed with invasive breast cancer. The correlation of hormone changes after NAC with hormone receptor expression alterations and relapse-free survival (RFS) outcomes have been investigated.

Methods

Patients

Details of the previous retrospective study on which this research is based have been posted (11). To investigate the relationship between changes in reproductive hormone levels after NAC treatment and survival outcomes, we included people with post-treatment hormone reports from previous study populations. This retrospective study included 181 female patients with breast cancer who were administered NAC between February 2013 and December 2019 at the First Affiliated Hospital of Chongqing Medical University (Chongqing, China). The inclusion criteria were as follows: (a) all enrolled breast cancer patients accepted NAC and subsequent surgery; (b) patients with serum reproductive hormones tests before NAC start and at the end of NAC; (c) patients received standard adjuvant therapy after surgery; (d) all included patients had complete clinical records. The exclusion criteria were as follows: (a) distant metastasis before NAC; (b) synchronous bilateral breast cancer; (c) administration of oral contraceptives or other hormones in the past 6 months; (d) pregnancy or lactation in the previous 6 months; (e) prior cancer diagnosis or serious organ disease; (f) endocrine therapy, radiotherapy or targeted therapy before NAC. Details related to the demographic and pathological characteristics were collected. Meanwhile, information on the serum reproductive hormones before initial NAC and after the last cycle of NAC, including estradiol, progesterone, testosterone, FSH, LH, DHEAS, FAI, and SHBG, was gathered. A total of 91 patients were enrolled in the follow-up group between February 2013 and December 2018, and each participant was followed from the baseline exam until death or February 1, 2021. The hospitalization information system was utilized to obtain the patients' in-hospital information, and outpatient information was obtained through the hospital outpatient system, face-to-face, or by telephone.

Measurements of serum reproductive hormones

Samples were collected at baseline and the end of NAC. Concentrations of estradiol, progesterone, testosterone, FSH, LH, DHEAS, and SHBG were determined using an electrochemiluminescence method on an immunoassay analyzer (DxI 800 Immunoassay System; Beckman Coulter, Brea, CA, United States). FAI was calculated as FAI = (testosterone/SHBG) × 100.

Immunohistochemical staining

All mammary gland malignant tumor specimens from core biopsies and surgical excisions were reviewed by two experienced pathologists. Immunohistochemistry (IHC) was utilized to measure ER, PR, the human epidermal growth factor receptor 2 (HER2) status, and the Ki67 index before and after NAC. The Ki67 was explained as the percentage of tumor cell nuclei between 400 and 500 cells.

Definitions

Menopause was defined as no spontaneous menses over the past 1 year or no menses for <1 year with FSH and estradiol levels in the postmenopausal range or post bilateral oophorectomy. The ER and PR status were defined positive if >1% of cancer cells were stained, and the HER2 status was defined positive if >10% of the cancer cells showed a 3+ score by IHC or a >2.2-fold change compared to the expression of chromosome enumeration probe 17 (CEP17) in cancer cells via fluorescence in situ Hybridization (FISH) (17). The hormone receptors positive was explained as ER and/or PR positive. In accordance with the expression of hormone receptors and HER2 status, the included patients were classified according to the following four subtypes: luminal (ER+ and/or PR+, HER2−), luminal/HER2 (ER+ and/or PR+, HER2+), HER2 (ER− and PR−, HER2+), and triple-negative (ER− and PR−, HER2−). Pathological complete response (pCR) was defined as no remaining invasive tumor lesions in any excised breast tissue and lymph node (ypT0/Tis ypN0) (18). The RFS was explained as the time from the baseline exam to the time of the first event (invasive local recurrence, regional recurrence, distant recurrence, invasive contralateral breast cancer, secondary malignancy, or death for any reason).

Evaluation of neoadjuvant chemotherapy response

The response of the tumor to NAC was evaluated by ultrasound and magnetic resonance imaging. Clinical response was assessed by making a comparison of the change of the primary site. The treatment response of NAC was assessed by imaging examinations based on the Response Evaluation Criteria in Solid Tumors (RECIST) guidelines version 1.1.

Statistical methods

For the non-normally distributed continuous parameters, the median and interquartile range (IQR) were provided at baseline and the end of NAC, then were compared by Wilcoxon signed-rank test. Categorical variables were represented as numbers and percentages and were compared via two-sided chi-square and Fisher's tests. The RFS outcomes were compared between patients according to hormone changes using the log-rank test. Univariate and multivariate survival analyses with hazard ratios (HR) and 95% confidence intervals (95% CI) were carried out using Cox regression. In line with the widely used recommendations (19), variables with a P-value lower than 0.25 in univariate analysis were selected as independent variables and analyzed by multivariate Cox regression. Cases with missing values for any of the variables in the model were excluded from the analysis. The 95% CI was utilized to express ranges within which true parameter values were likely to lie. All statistical tests were 2-sided, and P values less than 0.05 were considered statistically significant. Data analyses were performed using SPSS (version 26.0) software (SPSS Inc., Chicago, IL, United States).

Results

Population characteristics

The clinicopathological characteristics of the study population at enrollment are summarized in Table 1. A total of 181 patients (premenopausal group: 101; postmenopausal group: 80) with invasive breast cancer were included in the study (Figure 1). The median age of the premenopausal and the postmenopausal patients was 44 years (Range, 21–57 years) and 56 years (Range, 45–69 years) respectively. Most the premenopausal patients with a BMI < 24 kg/m2 (71.2%), while most of postmenopausal with a BMI ≥ 24 kg/m2 (62.5%). Most of premenopausal and postmenopausal patients had cT2 (70.3% vs. 72.5%) or cN1/N2 (65.3% vs. 53.8%) disease. In the IHC or FISH of the excised specimens, most of premenopausal and postmenopausal patients were ER-positive (58.4% vs. 57.5%) and HER2-negative (56.4% vs. 61.3%) and had a Ki67 index >14% (81.2% vs. 80.0%). Most patients received 4 chemotherapy cycles (85.1% vs. 78.8% in the premenopausal and the postmenopausal groups respectively). The pCR rate of the premenopausal and the postmenopausal patients was 9.9% and 8.8% respectively.

Figure 1

Figure 1

Flow chart of the patient selection. After exclusions, the final sample size was 181 patients, and a total of 91 patients were enrolled in the follow-up group. NAC, neoadjuvant chemotherapy.

Table 1

CharacteristicsPremenopausal (n = 101)
n (%)
Postmenopausal (n = 80)
n (%)
Age (years)
 Mean42.4 ± 7.356.7 ± 5.9
 Median4456
 Range21–5745–69
BMI (kg/m2)
 <18.56 (5.9%)3 (3.8%)
 18.5–2466 (65.3%)27 (33.8%)
 ≥2427 (26.7%)50 (62.5%)
 Not available2 (2.0%)0
Tumour size
 cT19 (8.9%)9 (11.3%)
 cT271 (70.3%)58 (72.5%)
 cT321 (20.8%)13 (16.3%)
Nodal involvement
 cN016 (15.8%)10 (12.5%)
 cN1/N266 (65.3%)43 (53.8%)
 cN319 (18.8%)27 (33.7%)
ER status
 Positive59 (58.4%)46 (57.5%)
 Negative39 (38.6%)33 (41.3%)
 Not available3 (3.0%)1 (1.2%)
PR status
 Positive49 (48.5%)34 (42.5%)
 Negative48 (47.5%)45 (56.3%)
 Not available4 (4.0%)1 (1.2%)
HER2 status
 Positive40 (39.6%)30 (37.5%)
 Negative57 (56.4%)49 (61.3%)
 Not available4 (4.0%)1 (1.2%)
Molecular subtype
 Luminal39 (38.6%)35 (43.8%)
 Luminal/HER217 (16.8%)11 (13.8%)
 HER222 (21.8%)18 (22.5%)
 Triple negative17 (16.8%)15 (18.8%)
 Not available6 (5.9%)1 (1.3%)
Ki67 status (%)
 ≤1415 (14.9%)15 (18.8%)
 14–3043 (42.6%)38 (47.5%)
 >3039 (38.6%)26 (32.5%)
 Not available4 (4.0%)1 (1.3%)
Regimen
 Anthracycline- and taxane-based98 (97.0%)74 (92.5%)
 Anthracycline-based only1 (1.0%)0
 Taxane-based only2 (2.0%)6 (7.5%)
Chemotherapy cycles
 <42 (2.0%)4 (5.0%)
 486 (85.1%)63 (78.8%)
 >413 (12.9%)13 (16.3%)
Responder
 pCR10 (9.9%)7 (8.8%)
 cCR4 (4.0%)3 (3.8%)
 cPR55 (54.5%)43 (53.8%)
 cSD30 (29.7%)26 (32.5%)
 cPD2 (2.0%)1 (1.2%)

Baseline clinicopathological characteristics of all patients.

BMI, body mass index; ER, estrogen receptor; PR, progesterone receptor; HER2, human epidermal growth factor receptor 2; pCR, pathological complete response; cCR, clinical complete response; cPR, clinical partial response; cSD, clinical stable disease; cPD, clinical progressive disease.

Serum reproductive hormones changes

Serum reproductive hormones changes after NAC in premenopausal and postmenopausal women with breast cancer as shown in Figure 2 and Table 2. In premenopausal women with breast cancer, a significant decrease in estradiol, progesterone, testosterone, DHEAS, and SHBG (all P < 0.001) levels was found. Meanwhile, we observed a significant increase in FSH and LH (both P < 0.001) levels. However, no significant changes were found in FAI (P > 0.05). In postmenopausal breast cancer patients, we found a significant reduction in progesterone, testosterone, DHEAS levels, and FAI (all P < 0.001). Concurrently, a slightly significant decrease in estradiol and FSH (both P < 0.05) levels was observed. No significant changes were found in LH and SHBG (both P > 0.05) levels.

Figure 2

Figure 2

Changes of various serum reproductive hormones after NAC treatment in premenopausal and postmenopausal women with breast cancer. (A) Estradiol, (B) progesterone, (C) testosterone, (D) FSH, (E) LH, (F) DHEAS, (G) FAI, and (H) SHBG. Values are expressed as medians, and 95% CI are shown by whiskers. *P < 0.05; **P < 0.01; ***P < 0.001 (P-value by Wilcoxon signed-rank test). NAC, neoadjuvant chemotherapy; FSH, follicle stimulating hormone; LH, luteinizing hormone; DHEAS, dehydroepiandrosterone sulfate; FAI, free androgen index; SHBG, sex hormone-binding globulin; 95% CI, 95% confidence intervals.

Table 2

FactorsPremenopausal (n = 101)
Postmenopausal (n = 80)
Pre-NAC
Median (IQR)
Post-NAC
Median (IQR)
P valueaPre-NAC
Median (IQR)
Post-NAC
Median (IQR)
P valuea
Estradiol (pg/ml)98 (57–172)20 (13–40)<0.00123 (16–34)20 (12–29)0.007
Progesterone (ng/ml)2.07 (1.33–9.43)0.85 (0.61–1.28)<0.0011.11 (0.88–1.60)0.83 (0.50–1.05)<0.001
Testosterone (ng/ml)0.42 (0.33–0.56)0.29 (0.17–0.36)<0.0010.38 (0.25–0.51)0.27 (0.15–0.38)<0.001
FSH (mIU/ml)6.53 (4.81–15.47)68.19 (55.57–87.47)<0.00169.54 (50.91–89.26)64.64 (51.08–83.71)0.013
LH (mIU/ml)6.90 (3.77–15.36)43.88 (28.86–56.51)<0.00134.85 (23.90–45.39)33.11 (21.16–47.16)0.093
DHEAS (ug/dl)156.1 (110.9–205.4)121.0 (82.5–163.0)<0.00199.3 (57.9–135.5)86.2 (50.0–117.9)<0.001
FAI %2.90 (1.66–4.86)2.69 (1.29–4.16)0.2833.28 (2.02–5.59)2.55 (1.50–4.14)<0.001
SHBG (nmol/l)47.6 (37.6–74.3)37.8 (22.7–60.0)<0.00140.6 (27.7–49.7)34.3 (27.5–48.1)0.112

Serum reproductive hormones changes after NAC treatment in premenopausal and postmenopausal women with breast cancer.

NAC, neoadjuvant chemotherapy; IQR, interquartile range; FSH, follicle stimulating hormone; LH, luteinizing hormone; DHEAS, dehydroepiandrosterone sulfate; FAI, free androgen index; SHBG, sex hormone-binding globulin.

a

P-value by Wilcoxon signed-rank test.

Association between serum reproductive hormones changes and alterations of hormone receptors expression

Table 3 summarized reproductive hormone changes with alterations in hormone receptors expression. Decreased estradiol levels associated with reduced PR expression were found (P = 0.030). Similar results were found among patients with hormone receptors positive (Table 4), decreased testosterone (P = 0.043), as well as estradiol (P = 0.042) levels, were associated with reduced PR expression. However, no significant connections between various reproductive hormone changes and alterations of ER expression were observed in all patients as well as patients with hormone receptors positive (all P > 0.05).

Table 3

Factors
Expression of ER
Expression of PR
Decrease
No decrease
P valueaDecrease
No decrease
P valuea
nValid %nValid %nValid %nValid %
EstradiolDecrease2218.89581.20.1893834.97165.10.030
No decrease830.81869.2312.02288.0
ProgesteroneDecrease2520.89579.21.0003531.87568.20.628
No decrease521.71878.3625.01875.0
TestosteroneDecrease2521.98978.10.5533533.07167.00.118
No decrease313.61986.4314.31885.7
FSHDecrease716.73583.30.5031025.03075.00.417
Increase2322.87877.23133.06367.0
LHDecrease1530.03570.00.0571326.53673.50.560
Increase1516.17883.92832.95767.1
DHEASDecrease1516.97483.10.3082632.15567.90.383
Increase926.52573.5823.52676.5
FAIDecrease1720.76579.30.8102431.65268.40.528
Increase717.13482.91025.62974.4
SHBGDecrease1820.76979.30.6322328.45871.60.823
Increase616.73083.31132.42367.6

Analysis of reproductive hormone changes associated with alterations of hormone receptors expression in all patients.

ER, estrogen receptor; PR, progesterone receptor; FSH, follicle stimulating hormone; LH, luteinizing hormone; DHEAS, dehydroepiandrosterone sulfate; FAI, free androgen index; SHBG, sex hormone-binding globulin.

a

P-value by two-sided chi-square and Fisher's tests.

Table 4

Factors
Expression of ER
Expression of PR
Decrease
No decrease
P valueaDecrease
No decrease
P valuea
nValid %nValid %nValid %nValid %
EstradiolDecrease2229.75270.30.0943852.83447.20.042
No decrease857.1642.9321.41178.6
ProgesteroneDecrease2533.35066.70.9663548.63751.40.775
No decrease538.5861.5642.9857.1
TestosteroneDecrease2536.24463.80.4483552.23247.80.043
No decrease321.41178.6321.41178.6
FSHDecrease726.91973.10.4621038.51661.50.348
Increase2337.13962.93151.72948.3
LHDecrease1546.91753.10.0651340.61959.40.375
Increase1526.84173.22851.92648.1
DHEASDecrease1528.83771.20.4162651.02549.00.311
Increase940.91359.1836.41463.6
FAIDecrease1734.03366.00.7932449.02551.00.623
Increase729.21770.81041.71458.3
SHBGDecrease1835.33364.70.5932345.12854.90.800
Increase626.11773.91150.01150.0

Analysis of reproductive hormone changes associated with alterations of hormone receptors expression in patients with hormone receptors positive.

ER, estrogen receptor; PR, progesterone receptor; FSH, follicle stimulating hormone; LH, luteinizing hormone; DHEAS, dehydroepiandrosterone sulfate; FAI, free androgen index; SHBG, sex hormone-binding globulin.

a

P-value by two-sided chi-square and Fisher's tests.

RFS outcomes and the association with serum reproductive hormones changes

As of Feb. 1, 2021, we conducted follow-ups among a total of 91 patients (the loss rate of follow-up was 4.4%), and the clinicopathological characteristics of the study population at baseline were summarized in Table 5. The median follow-up time was 33 months (95%CI 31.3–34.7). Among the retrieved variations of reproductive hormone parameters of all patients in the follow-up subgroup, changes in estradiol (P = 0.022) and progesterone (P = 0.001) levels were associated with RFS outcomes (Table 6). These factors were then included in the Cox regression and the results were displayed in Table 7. On univariate analysis the following factors associated with worse RFS outcomes were found: younger age, premenopausal, lower BMI, larger clinical tumor size, hormone receptors negative, higher Ki67 index, decreased estradiol levels, and non-decreased progesterone levels (all P < 0.25). On multivariate analysis, the change of progesterone level (no decrease vs. decrease, HR = 7.178, 95% CI 2.340–22.019, P = 0.001) was an independent significant factor of RFS outcomes rather than the change of estradiol level. Comparison of the 3-year RFS between the decreased and the non-decreased progesterone levels groups were 87.6% and 58.3% respectively (log-rank, P = 0.001; Figure 3A). Similar trends were found among patients with hormone receptors positive, the survival analysis plotted as Figure 3B showed that patients with decreased progesterone levels exhibited better 3-year RFS compared with those with non-decreased (91.1% vs. 72.9%, log-rank, P = 0.015).

Figure 3

Figure 3

Kaplan-Meier curves display RFS by changes in progesterone levels. (A) Survival curves for the follow-up subgroup of 91 patients. (B) Survival curves for 56 patients with hormone receptors positive. RFS, relapse-free survival.

Table 5

CharacteristicsNumber of cases (%)
Age (years)
 ≤5061 (67.0%)
 >5030 (33.0%)
Menstrual status
 Premenopausal60 (65.9%)
 Postmenopausal31 (34.1%)
BMI (kg/m2)
 <18.55 (5.5%)
 18.5–2445 (49.5%)
 ≥2439 (42.9%)
 Not available2 (2.2%)
Tumour size
 cT112 (13.2%)
 cT265 (71.4%)
 cT314 (15.4%)
Nodal involvement
 cN021 (23.0%)
 cN1/N261 (67.0%)
 cN39 (9.9%)
ER status
 Positive56 (61.5%)
 Negative34 (37.4%)
 Not available1 (1.1%)
PR status
 Positive41 (45.1%)
 Negative48 (52.7%)
 Not available2 (2.2%)
HER2 status
 Positive33 (36.3%)
 Negative58 (63.7%)
Molecular subtype
 Luminal41 (45.1%)
 Luminal/HER215 (16.5%)
 HER218 (19.8%)
 Triple negative16 (17.6%)
 Not available1 (1.1%)
Ki67 status (%)
 ≤1416 (17.6%)
 14–3042 (46.2%)
 >3031 (34.1%)
 Not available2 (2.2%)
Regimen
 Anthracycline- and taxane-based90 (98.9%)
 Anthracycline-based only1 (1.1%)
 Taxane-based only0
Chemotherapy cycles
 <41 (1.1%)
 487 (95.6%)
 >43 (3.3%)
Responder
 pCR8 (8.8%)
 cCR5 (5.5%)
 cPR47 (51.6%)
 cSD28 (30.8%)
 cPD3 (3.3%)

Baseline clinicopathological characteristics of 91 patients in the follow-up subgroup.

BMI, body mass index; ER, estrogen receptor; PR, progesterone receptor; HER2, human epidermal growth factor receptor 2; pCR, pathological complete response; cCR, clinical complete response; cPR, clinical partial response; cSD, clinical stable disease; cPD, clinical progressive disease.

Table 6

FactorsRFS
Pa
Estradiol (decrease vs. no decrease)0.022
Progesterone (decrease vs. no decrease)0.001
Testosterone (decrease vs. no decrease)0.801
FSH (decrease vs. increase)0.335
LH (decrease vs. increase)0.432
DHEAS (decrease vs. increase)0.976
FAI (decrease vs. increase)0.186
SHBG (decrease vs. increase)0.387

Kaplan–meier analysis of RFS by reproductive hormones changes.

RFS, recurrence-free survival; FSH, follicle-stimulating hormone; LH, luteinizing hormone; DHEAS, dehydroepiandrosterone sulfate; FAI, free androgen index; SHBG, sex hormone-binding globulin.

a

P-value by log-rank test.

Table 7

FactorsUnivariate analysis
Multivariate analysis
HR95% CIP valueHR95% CIP value
Age (year)0.9500.898–1.0060.0780.9880.900–1.0850.800
Menopausal status (pre vs. post)1.9920.643–6.1700.2321.3050.248–6.8630.753
BMI (kg/m2)0.8390.714–0.9860.0330.9310.774–1.1190.446
Clinical tumor size (cm)1.2691.000–1.6100.0501.1180.859–1.4550.405
Clinical axillary lymph node: pos vs. neg1.3780.439–4.3300.583–––
Hormone receptors status: pos vs. neg0.5120.203–1.2930.1570.5900.173–2.0050.398
HER2 status: pos vs. neg0.8930.335–2.3820.822–––
Ki671.0140.994–1.0350.1631.0110.980–1.0440.483
Chemotherapy cycle0.7620.267–2.1790.612–––
pCR: no vs. yes1.5100.200–11.3930.690–––
Change of estradiol level: no decrease vs. decrease0.0320.000–3.9600.162<0.0010.000– (1.526 × 10192)0.955
Change of progesterone level: no decrease vs. decrease4.5591.747–11.8980.0027.1782.340–22.0190.001

Univariate and multivariate analysis for RFS in the follow-up subgroup of 91 patients.

Age, BMI, clinical tumor size, Ki67 index and chemotherapy cycle were entered into the model as continuous variables.

RFS, recurrence-free survival; HR, hazard ratio; CI, confidence interval; BMI, body mass index; HER2, human epidermal growth factor receptor 2; pCR, pathological complete response.

Discussion

The main finding of this study was that reproductive hormone levels were influenced by NAC treatment, having connections with hormone receptor expression alterations and RFS outcomes in women diagnosed with invasive breast cancer. To our knowledge, this is the first study to explore the correlation of serum reproductive hormone changes after NAC with hormone receptor expression alterations and survival outcomes in breast cancer. Though our previous study revealed that pre-treatment hormones have a predicted effect (11), the dynamics of reproductive hormones may be a better predictor of survival than pre-treatment hormones.

The changes in estradiol, FSH, and LH levels in premenopausal patients observed in our study are consistent with published studies reporting that the majority of young women receiving (neo)adjuvant chemotherapy rendered postmenopausal after chemotherapy (8, 14), although these studies focus on menstrual status or ovarian function rather than hormones. In postmenopausal patients, a slightly significant decrease in FSH levels and no significant changes in LH levels were observed in our study, as previously reported (7). In addition, we found that sex steroids including estradiol, progesterone, testosterone, and DHEAS levels decreased significantly after NAC among both premenopausal and postmenopausal patients. These changes in the hormonal profile of pre- and postmenopausal patients may be due to the ovarian and adrenal dysfunction produced by the chemotherapy treatment.

In our study, nearly all patients received anthracycline–taxane combination chemotherapy. The impact of chemotherapeutic agents on reproductive hormones is different due to the mechanism of action of anticancer drugs being diverse. The mechanism by which NAC, particularly alkylating agents, which show the highest level of gonadotoxicity, contributes to ovarian damage is unclear, but it could be related to apoptotic oocyte death in primordial follicles entering the differentiation stage, which is especially susceptible to chemotherapeutic drugs effects (20, 21). Thus, cyclophosphamide can cause ovarian function impairment and leads to a decrease in sex steroids. Doxorubicin can destroy the endothelium of blood vessels and lead to a reduction in ovarian blood flow. Taxane can disrupt normal polymerization/depolymerization, causing cell cycle arrest and apoptosis (22). The previous meta-analysis indicated that the incidence of chemotherapy-induced amenorrhea was lower in anthracycline-based compared to anthracycline–taxane combination chemotherapy (23), showing that the combination of anthracycline and taxane has a greater effect on hormones.

Even if there is no report that a cytotoxic chemotherapeutic agent induces adrenal dysfunction, the not rare incidence of adrenal insufficiency in advanced gastric cancer patients who received chemotherapy was reported in a prospective study (24).

The two major sites of de novo steroid hormone biosynthesis in a woman are the ovaries and adrenals, and both these organs produce active estrogens, progestogens, and androgens (25). The major sex steroids produced by the ovaries are estrogens and progestogens, while the adrenals are androgens. The loss of adrenal function in the presence of intact ovaries has been shown to result in a > 90% loss of androgen production (26), highlighting the vital role of adrenals in androgen synthesis. It is well known that the production of estrogen by the ovary decreases drastically after menopause. Although it was initially thought that estrogen production ceased completely, it is now clear that postmenopausal ovaries continue to produce estrogen, albeit at significantly reduced levels (27). Other sites of estrogen synthesis become increasingly important in the postmenopausal state. Extragonadal sites such as adrenals become the main source of sex steroids during menopause (25). Thus, chemotherapy-induced ovarian and adrenal dysfunction may result in a decrease in estrogens, progestogens, and androgens in both pre- and postmenopausal patients.

Alterations of hormone receptor status in breast cancer after NAC treatment have been described in published studies (15, 16). Whether these changes are due to NAC treatment, hormones, tumor heterogeneity, sampling or technical issues need to be further clarified. We observed that decreased estradiol levels were associated with reduced PR expression, which was supported by several studies that indicated that PR decrease was more obvious in premenopausal patients (28, 29). Furthermore, PR was also found to have the highest conversion rates in NAC and adjuvant chemotherapy (30, 31). Previous studies showed that pre-operative endocrine therapy, pre-operative chemoendocrine therapy, and NAC induced a significant decrease in the expression of PR in breast cancer patients with hormone receptors positive (32, 33), highlighting the potential role of sex hormones in PR expression, which is consistent with our finding that decreased estradiol and testosterone levels were associated with reduced PR expression in patients with hormone receptors positive. Possible mechanisms involve the survival mechanism of malignant cells by changing the specific molecular pathways following the changes in hormone levels resulting in resistance to a specific treatment (28).

PR plays an important role in normal breast development and has been linked to breast cancer. Moreover, PR has generally been considered solely as an indicator of ER functionality and responsiveness to endocrine therapy (34). The expression pattern of the hormone receptors such as ER and PR has been used clinically to guide therapy and predict survival outcomes. However, discordant results have been reported regarding whether a changed receptor status will affect the predictive or prognostic parameters. Although some studies suggested that PR loss may reflect a relatively poor response to chemotherapy and may be associated with a poor prognosis (35, 36), no consensus has been drawn on this topic.

Progesterone and its receptor are increasingly gaining attention for their emerging role as critical regulators of breast malignancies. Their complex and tightly regulated actions have been challenging to determine. The role of endogenous progesterone in breast malignancy pathogenesis remains largely unexplored to date, and the proliferative/antiproliferative effects of progestins continue to be debated. Inconsistent evidence showed that progesterone can facilitate, restrain, or have no action on the invasion and migration of breast cancer cells (25).

Epidemiologic studies evaluating circulating levels of progesterone remain limited. Previous clinical studies reporting increased breast cancer risk with the use of contraceptives or menopausal hormone therapy have primarily evaluated exogenous synthetic progestogen (progestin) use, rather than endogenous progesterone (37). The potential role of endogenous progesterone in breast cancer cannot be inferred from these studies.

In what appears to be the only prior study of progesterone and survival outcomes published to date, pre-operative progesterone treatment resulted in greater than 10% absolute improvement in 5-year disease-free survival among node-positive breast cancer patients independent of their PR status (38). In contrast to this study, patients with decreased progesterone levels exhibited better 3-year RFS compared with those with non-decreased in our study. The explanation could be that non-decreased progesterone concentrations after NAC may reflect a relatively poor response to chemotherapy or resistance to later endocrine therapy. These inconsistent results could be mainly attributable to different sources of progesterone, considering that the previous study evaluated progesterone in an exogenous state while our study evaluated the circulating endogenous progesterone levels in a neoadjuvant setting. In addition, relative concentrations of progesterone metabolites may be the potential factors contributing to these discordant results. With the proliferative/antiproliferative effects of different progesterone metabolites in breast cancer having been gradually explored, the importance of progesterone metabolites in breast cancer is highlighted. However, much of the difficulty lies in defining which progesterone and its metabolites exert their effects on different pathological types of breast cancer. Limited available in vivo evidence suggested the effects of progesterone metabolites on breast physiology and carcinogenesis (39). A previous study reported that the cancer-promoting effects of administered progesterone were in fact due to the locally produced progesterone metabolite, but not progesterone itself (40).

Progesterone also works in hormone receptor-negative breast malignancies. A recent study reported that progesterone accelerated cell growth in vitro and tumorigenesis in vivo in a triple-negative model (41), which supported our view.

The present study undoubtedly has limitations. A single blood sample may provide an inexact measure of long-term average hormone levels; however, a separate reproducibility study manifested moderate to high stability over 2 years in average intraclass correlation coefficients of all hormones measured (39). Serum reproductive hormone levels wave motion during the menstrual cycle in premenopausal women. In addition, data on postoperative adjuvant therapy was not available, but all treatment options are recommended in accordance with current guidelines. All included HER2-positive patients did not receive pre-operative anti-HER2 targeted therapy due to financial and medical insurance reasons, hence the pCR rates of this cohort were lower than those reported in other literature (2). The major limitation of the study is that it was a retrospective study in one single center, with a not large sample size and a shorter follow-up time (most patients were included between January 2017 and December 2019); thus, it was also partly limited by selection bias. Because of the above limitations, we only conducted a preliminary correlation study between RFS outcomes as well as alterations of hormone receptors expression and reproductive hormones changes after NAC. Therefore, it is necessary to perform long-term clinical application of a large sample to make a more objective analysis and support our results.

Conclusion

In conclusion, our results showed that sex steroids (including estradiol, progesterone, testosterone, and DHEAS) are affected by NAC and their levels are significantly reduced among both premenopausal and postmenopausal patients. Decreased estradiol levels were associated with reduced PR expression. More importantly, patients with decreased progesterone levels after NAC exhibited better 3-year RFS. Reproductive hormone levels should be part of the routine workup for patients with newly diagnosed breast cancer.

Statements

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by The ethics committee of First Affiliated Hospital of Chongqing Medical University. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author contributions

SL and AL are the guarantors of integrity of the entire study; AL, YJ, YW and SL designed the study concepts/study design; AL, ND, YW, YHW, YJ, ZT, YP, YD, and LJ participated in the data acquisition or data analysis/interpretation; AL, YJ, YW and SL participated in the drafting or revising of manuscript for important intellectual content; all authors have approved the final version of submitted manuscript; AL and SL agreed to ensure any questions related to the work are appropriately resolved; AL and YW performed literature research; AL performed statistical analysis; AL participated in the manuscript editing. All authors contributed to the article and approved the submitted version.

Funding

This work was funded by the National Natural Science Foundation of China (No. 81772979 and 81472658). The funding source had no role in the study design, data collection, data analysis, data interpretation, or the writing of the report.

Acknowledgments

The authors thank Yinan Wu for her contribution to the data collection.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  • 1.

    SungHFerlayJSiegelRLLaversanneMSoerjomataramIJemalAet alGlobal cancer statistics 2020: gLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. (2021) 71(3):209–49. 10.3322/caac.21660

  • 2.

    van NesJGPutterHJulienJPTubiana-HulinMvan de VijverMBogaertsJet alPreoperative chemotherapy is safe in early breast cancer, even after 10 years of follow-up; clinical and translational results from the EORTC trial 10902. Breast Cancer Res Treat. (2009) 115(1):101–13. 10.1007/s10549-008-0050-1

  • 3.

    ChaudharyLNWilkinsonKHKongA. Triple-Negative breast cancer: who should receive neoadjuvant chemotherapy?Surg Oncol Clin N Am. (2018) 27(1):141–53. 10.1016/j.soc.2017.08.004

  • 4.

    LambertiniMMooreHCFLeonardRCFLoiblSMunsterPBruzzoneMet alGonadotropin-Releasing hormone agonists during chemotherapy for preservation of ovarian function and fertility in premenopausal patients with early breast cancer: a systematic review and meta-analysis of individual patient-level data. J Clin Oncol. (2018) 36(19):1981–90. 10.1200/JCO.2018.78.0858

  • 5.

    RosendahlMAndersenCYla Cour FreieslebenNJuulALøsslKAndersenAN. Dynamics and mechanisms of chemotherapy-induced ovarian follicular depletion in women of fertile age. Fertil Steril. (2010) 94(1):156–66. 10.1016/j.fertnstert.2009.02.043

  • 6.

    LambertiniMPeccatoriFADemeestereIAmantFWynsCStukenborgJBet alFertility preservation and post-treatment pregnancies in post-pubertal cancer patients: eSMO clinical practice guidelines(†). Ann Oncol. (2020) 31(12):1664–78. 10.1016/j.annonc.2020.09.006

  • 7.

    Ramírez-ExpósitoMJMartínez-MartosJMDueñas-RodríguezBNavarro-CeciliaJCarrera-GonzálezMP. Neoadjuvant chemotherapy modifies serum pyrrolidone carboxypeptidase specific activity in women with breast cancer and influences circulating levels of GnRH and gonadotropins. Breast Cancer Res Treat. (2020) 182(3):751–60. 10.1007/s10549-020-05723-1

  • 8.

    WalsheJMDenduluriNSwainSM. Amenorrhea in premenopausal women after adjuvant chemotherapy for breast cancer. J Clin Oncol. (2006) 24(36):5769–79. 10.1200/JCO.2006.07.2793

  • 9.

    ColleoniMGelberSGoldhirschAAebiSCastiglione-GertschMPriceKNet alTamoxifen after adjuvant chemotherapy for premenopausal women with lymph node-positive breast cancer: international breast cancer study group trial 13–93. J Clin Oncol. (2006) 24(9):1332–41. 10.1200/JCO.2005.03.0783

  • 10.

    HankinsonSEEliassenAH. Endogenous estrogen, testosterone and progesterone levels in relation to breast cancer risk. J Steroid Biochem Mol Biol. (2007) 106(1–5):24–30. 10.1016/j.jsbmb.2007.05.012

  • 11.

    LanAJinYWangYWangYDingNDaiYet alPre-treatment circulating reproductive hormones levels predict pathological and survival outcomes in breast cancer submitted to neoadjuvant chemotherapy. Int J Clin Oncol. (2022) 27(5):899–910. 10.1007/s10147-022-02141-9

  • 12.

    KenslerKHEliassenAHRosnerBAHankinsonSEBrownMTamimiRM. Pre-diagnostic sex hormone levels and survival among breast cancer patients. Breast Cancer Res Treat. (2019) 174(3):749–58. 10.1007/s10549-018-05121-8

  • 13.

    DugganCStanczykFCampbellKNeuhouserMLBaumgartnerRNBaumgartnerKBet alAssociations of sex steroid hormones with mortality in women with breast cancer. Breast Cancer Res Treat. (2016) 155(3):559–67. 10.1007/s10549-016-3704-4

  • 14.

    FurlanettoJMarméFSeilerSThodeCUntchMSchmatlochSet alChemotherapy-induced ovarian failure in young women with early breast cancer: prospective analysis of four randomised neoadjuvant/adjuvant breast cancer trials. Eur J Cancer. (2021) 152:193–203. 10.1016/j.ejca.2021.04.038

  • 15.

    ZhouXZhangJYunHShiRWangYWangWet alAlterations of biomarker profiles after neoadjuvant chemotherapy in breast cancer: tumor heterogeneity should be taken into consideration. Oncotarget. (2015) 6(34):36894–902. 10.18632/oncotarget.5050

  • 16.

    ZhangNMoranMSHuoQHafftyBGYangQ. The hormonal receptor status in breast cancer can be altered by neoadjuvant chemotherapy: a meta-analysis. Cancer Invest. (2011) 29(9):594–8. 10.3109/07357907.2011.621913

  • 17.

    GoldhirschAWoodWCCoatesASGelberRDThürlimannBSennHJ. Strategies for subtypes--dealing with the diversity of breast cancer: highlights of the st. Gallen international expert consensus on the primary therapy of early breast cancer 2011. Ann Oncol. (2011) 22(8):1736–47. 10.1093/annonc/mdr304

  • 18.

    CortazarPZhangLUntchMMehtaKCostantinoJPWolmarkNet alPathological complete response and long-term clinical benefit in breast cancer: the CTNeoBC pooled analysis. Lancet. (2014) 384(9938):164–72. 10.1016/S0140-6736(13)62422-8

  • 19.

    HosmerDWLemeshowS. Model-Building strategies and methods for logistic regression. In: ShewhartWAWilksSS, editors. Applied logistic regression, 2nd ed.New York: John Wiley & Sons (2000). p. 91–142.

  • 20.

    BlumenfeldZ. Fertility preservation by endocrine suppression of ovarian function using gonadotropin-releasing hormone agonists: the End of the controversy?J Clin Oncol. (2018) 36(19):1895–7. 10.1200/JCO.2018.78.9347

  • 21.

    BlumenfeldZ. Investigational and experimental GnRH analogs and associated neurotransmitters. Expert Opin Investig Drugs. (2017) 26(6):661–7. 10.1080/13543784.2017.1323869

  • 22.

    Ben-AharonIShalgiR. What lies behind chemotherapy-induced ovarian toxicity?Reproduction. (2012) 144(2):153–63. 10.1530/REP-12-0121

  • 23.

    ZhaoJLiuJChenKLiSWangYYangYet alWhat lies behind chemotherapy-induced amenorrhea for breast cancer patients: a meta-analysis. Breast Cancer Res Treat. (2014) 145(1):113–28. 10.1007/s10549-014-2914-x

  • 24.

    KimHRKimJHRheeYLeeHSongSEKimCet alAssessment of adrenal function and health-related quality of life in advanced gastric cancer patients who received first-line chemotherapy. Oncology. (2016) 90(5):248–54. 10.1159/000445010

  • 25.

    AfricanderDStorbeckKH. Steroid metabolism in breast cancer: where are we and what are we missing?Mol Cell Endocrinol. (2018) 466:86–97. 10.1016/j.mce.2017.05.016

  • 26.

    ArltWCalliesFvan VlijmenJCKoehlerIReinckeMBidlingmaierMet alDehydroepiandrosterone replacement in women with adrenal insufficiency. N Engl J Med. (1999) 341(14):1013–20. 10.1056/NEJM199909303411401

  • 27.

    FogleRHStanczykFZZhangXPaulsonRJ. Ovarian androgen production in postmenopausal women. J Clin Endocrinol Metab. (2007) 92(8):3040–3. 10.1210/jc.2007-0581

  • 28.

    XieLLiXWangQZhouJShenJLuoLet alEffects of core needle biopsy and subsequent neoadjuvant chemotherapy on molecular alterations and outcome in breast cancer. Onco Targets Ther. (2018) 11:677–85. 10.2147/OTT.S145715

  • 29.

    EnomotoYMorimotoTNishimukaiAHiguchiTYanaiAMiyagawaYet alImpact of biomarker changes during neoadjuvant chemotherapy for clinical response in patients with residual breast cancers. Int J Clin Oncol. (2016) 21(2):254–61. 10.1007/s10147-015-0897-1

  • 30.

    ZhaoWSunLDongGWangXJiaYTongZ. Receptor conversion impacts outcomes of different molecular subtypes of primary breast cancer. Ther Adv Med Oncol. (2021) 13:17588359211012982. 10.1177/17588359211012982.

  • 31.

    MohanSWalcott-SappSLeeMSrourMKimSAmersiFet alAlterations in breast cancer biomarkers following neoadjuvant therapy. Ann Surg Oncol. (2021) 28(11):5907–17. 10.1245/s10434-021-09814-1

  • 32.

    ShimizuDIshikawaTTanabeMSasakiTIchikawaYChishimaTet alPreoperative endocrine therapy with goserelin acetate and tamoxifen in hormone receptor-positive premenopausal breast cancer patients. Breast Cancer. (2014) 21(5):557–62. 10.1007/s12282-012-0429-z

  • 33.

    TorrisiRBagnardiVRotmenszNScaranoEIorfidaMVeronesiPet alLetrozole plus GnRH analogue as preoperative and adjuvant therapy in premenopausal women with ER positive locally advanced breast cancer. Breast Cancer Res Treat. (2011) 126(2):431–41. 10.1007/s10549-010-1340-y

  • 34.

    CarrollJSHickeyTETarulliGAWilliamsMTilleyWD. Deciphering the divergent roles of progestogens in breast cancer. Nat Rev Cancer. (2017) 17(1):54–64. 10.1038/nrc.2016.116

  • 35.

    CancelloGMaisonneuvePRotmenszNVialeGMastropasquaMGPruneriGet alProgesterone receptor loss identifies luminal B breast cancer subgroups at higher risk of relapse. Ann Oncol. (2013) 24(3):661–8. 10.1093/annonc/mds430

  • 36.

    ChenSHuangLChenCMShaoZM. Progesterone receptor loss identifies luminal-type local advanced breast cancer with poor survival in patients who fail to achieve a pathological complete response to neoadjuvant chemotherapy. Oncotarget. (2015) 6(20):18174–82. 10.18632/oncotarget.4225

  • 37.

    TrabertBShermanMEKannanNStanczykFZ. Progesterone and breast cancer. Endocr Rev. (2020) 41(2):320–44. 10.1210/endrev/bnz001

  • 38.

    BadweRHawaldarRParmarVNadkarniMShetTDesaiSet alSingle-injection depot progesterone before surgery and survival in women with operable breast cancer: a randomized controlled trial. J Clin Oncol. (2011) 29(21):2845–51. 10.1200/JCO.2010.33.0738

  • 39.

    TrabertBBauerDCBuistDSMCauleyJAFalkRTGeczikAMet alAssociation of circulating progesterone with breast cancer risk among postmenopausal women. JAMA Netw Open. (2020) 3(4):e203645. 10.1001/jamanetworkopen.2020.3645

  • 40.

    WiebeJPPawlakKJKwokA. Mechanism of action of the breast cancer-promoter hormone, 5α-dihydroprogesterone (5αP), involves plasma membrane-associated receptors and MAPK activation. J Steroid Biochem Mol Biol. (2016) 155(Pt A):166–76. 10.1016/j.jsbmb.2015.10.021

  • 41.

    AnWLinHMaLZhangCZhengYChengQet alProgesterone activates GPR126 to promote breast cancer development via the gi pathway. Proc Natl Acad Sci U S A. (2022) 119(15):e2117004119. 10.1073/pnas.2117004119

Summary

Keywords

breast cancer, reproductive hormones, neoadjuvant therapy, sex steroids, hormone receptors, progesterone

Citation

Lan A, Jin Y, Wang Y, Ding N, Wang Y, Dai Y, Jiang L, Tang Z, Peng Y and Liu S (2022) Association of serum reproductive hormones changes after neoadjuvant chemotherapy with hormone receptors expression alterations and survival outcomes in breast cancer. Front. Surg. 9:947218. doi: 10.3389/fsurg.2022.947218

Received

18 May 2022

Accepted

15 August 2022

Published

31 August 2022

Volume

9 - 2022

Edited by

Alba Di Leone, Agostino Gemelli University Polyclinic (IRCCS), Italy

Reviewed by

Xiaowei Qi, Army Medical University, China Rui Chen, Affiliated Hospital of Zunyi Medical College, China Wenjun Yi, Central South University, China

Updates

Copyright

*Correspondence: Shengchun Liu

Specialty Section: This article was submitted to Surgical Oncology, a section of the journal Frontiers in Surgery

Abbreviations NAC, neoadjuvant chemotherapy; RFS, relapse-free survival; IQR, interquartile range; HR, hazard ratios; CI, confidence interval; ER, estrogen receptor; PR, progesterone receptor; HER2, human epidermal growth factor receptor 2; FSH, follicle-stimulating hormone; LH, luteinizing hormone; DHEAS, dehydroepiandrosterone sulfate; SHBG, sex hormone-binding globulin; FAI, free androgen index; IHC, immunohistochemistry; CEP17, chromosome enumeration probe 17; FISH, fluorescence in situ Hybridization; pCR, pathological complete response; BMI, body mass index; cCR, clinical complete response; cPR, clinical partial response; cSD, clinical stable disease; cPD, clinical progressive disease; RECIST, response evaluation criteria in solid tumors.

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics