ORIGINAL RESEARCH article

Front. Oncol., 04 June 2025

Sec. Breast Cancer

Volume 15 - 2025 | https://doi.org/10.3389/fonc.2025.1561599

This article is part of the Research TopicAdvancing Breast Cancer Care Through Transparent AI and Federated Learning: Integrating Radiological, Histopathological, and Clinical Data for Diagnosis, Recurrence Prediction, and SurvivorshipView all 5 articles

Intra- and peritumoral radiomics nomogram based on DCE-MRI for the early prediction of pathological complete response to neoadjuvant chemotherapy in breast cancer

Yun ZhuYun Zhu1Shuni ZhangShuni Zhang1Wei WeiWei Wei2Li YangLi Yang1Lingling WangLingling Wang3Ying WangYing Wang1Ye FanYe Fan4Haitao Sun*Haitao Sun5*Zongyu Xie*Zongyu Xie1*
  • 1Department of Radiology, The First Affiliated Hospital of Bengbu Medical University, Bengbu, Anhui, China
  • 2Department of Radiology, Anhui No.2 Provincial People’s Hospital, Hefei, China
  • 3Department of Medical Imaging Diagnostics, Bengbu Medical University, Bengbu, China
  • 4Department of Clinical Medicine, Bengbu Medical University, Bengbu, Anhui, China
  • 5Zhongshan Hospital, Fudan University, Shanghai, China

Purpose: This study aimed to create a nomogram model (NM) that combines clinical-radiological factors with radiomics features of both intra- and peritumoral regions extracted from pretherapy dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) images, in order to establish a reliable method for early prediction of pathological complete response (pCR) to neoadjuvant chemotherapy (NAC) in patients with breast cancer.

Methods: A total of 214 patients were randomly divided into a training set (n=149) and a test set (n=65) in a ratio of 7:3. Radiomics features were extracted from intratumoral region and 2-mm, 4-mm, 6-mm, 8-mm peritumoral regions on DCE-MRI images, and selected the optimal peritumoral region. The intratumoral radiomics model (IRM), 2-mm, 4-mm, 6-mm, 8-mm peritumoral radiomics model (PRM), the combined intra- and the optimal peritumoral radiomics model (CIPRM) were constructed based on five machine learning algorithms, and then the radiomics scores (Rad-score) were obtained. Independent risk factors for clinical-radiological features were obtained by univariate and multivariate logistic regression analysis, and clinical model (CM) was constructed. Finally, the CIPRM Rad-score combined with clinical-radiological factors was used to construct a NM. The performance of different models were evaluated by receiver operating characteristic curve (ROC) analysis, calibration curve analysis, and decision curve analysis (DCA).

Results: In our study, the 6-mm peritumoral size was considered to be the optimal peritumoral region. The CM is constructed based on three independent risk factors: estrogen receptor (ER), Ki-67, and breast edema score (BES). Incorporating ER, Ki-67, BES, and CIPRM Rad-score (combined intra- and 6-mm peritumoral) into the nomogram achieved a reliable predictive performance. And the area under the curve (AUC), sensitivity, specificity, and accuracy of the NM was 0.911, 0.848, 0.831, 0.826 for the training set and 0.897, 0.893, 0.784, 0.815 for the test set, respectively.

Conclusion: The NM has a good value for early prediction of pCR after NAC in breast cancer patients.

Introduction

Breast cancer has become one of the most common cancers worldwide and the leading cause of cancer death in women (1). According to “Cancer Statistics, 2024” published by the American Cancer Society, there are expected to be 310,720 new cases and 42,250 deaths from breast cancer in women in the United States in 2024, accounting for 32% and 15% of all new cases and deaths from cancer in women, respectively (2).Neoadjuvant chemotherapy (NAC) is a commonly used clinical treatment for early and locally advanced breast cancer (3). It can reduce the size of primary tumor and metastatic axillary lymph node (ALN), reduce the clinical stage, improve the surgical resection rate and breast preservation rate, obtain the body’s drug sensitivity reaction, and mediate the immune microenvironment (4, 5). The efficacy endpoints for NAC include complete loss of tumor cells, partial regression, no response, or tumor progression during treatment. Achieving pathologic complete response (pCR) after NAC prolongs overall survival and disease-free survival in breast cancer patients (6). Due to the complexity and high heterogeneity of breast cancer, some patients do not benefit from NAC, in addition, NAC drugs may also produce certain toxic side effects during treatment (7, 8). And the clinical need to adjust the treatment regimen in time to avoid delayed treatment due to disease progression. The pathological results after surgery are the gold standard to evaluate the efficacy of NAC, but there is a certain lag in time. Therefore, early and accurate prediction of the efficacy of NAC in breast cancer patients is of great significance for clinical development of individualized treatment and prognosis assessment.

Dynamic contrast-enhanced MRI (DCE-MRI) has high sensitivity in the diagnosis of breast cancer, which can reflect the way and degree of tumor enhancement, evaluate the hemodynamic characteristics of the tumor, and provide guidance for predicting the efficacy of NAC in breast cancer patients. However, it is easy to ignore the microscopic information of tumor when evaluating the efficacy of NAC solely by imaging features, and it is highly dependent on the technical level and subjective experience of the radiologist, resulting in low accuracy and specificity.

Radiomics is a new method of image analysis, which can extract the microscopic features that cannot be observed by the naked eye and conduct quantitative analysis and model construction, indirectly reflecting the heterogeneity and biological behavior of tumors (911). Radiomics has been applied to the diagnosis and differentiation of breast cancer, prediction of lymph node metastasis, molecular subtypes, histological grades, biomarkers and evaluation of NAC efficacy (1216).

However, most of the previous studies focused on the intratumoral region and ignored the microscopic information contained in the peritumoral region. In recent years, some scholars have begun to study the value of peritumoral radiomics features in the diagnosis and treatment of breast cancer, and believe that the peritumoral radiomics features will affect the prediction performance of the model (1720). However, there have been no studies on the optimal peritumoral region size for using DCE-MRI radiomics to predict NAC efficacy in breast cancer patients. In this study, we first aimed to identify the optimal peritumoral region for predicting pCR status after NAC in breast cancer patients. In addition, the intratumoral and optimal peritumoral radiomics features extracted from DCE-MRI images combined with clinical-radiological factors to build a nomogram model (NM). To investigate the value of NM in predicting pCR status after NAC in breast cancer patients.

Materials and methods

Patients

This study was approved by the ethics committee of our hospital (no. [2023] 441), and the subject’s informed consent was exempted. A retrospective analysis was performed on 360 patients who underwent breast MRI examination and NAC in our hospital from March 2019 to September 2023.

The inclusion criteria for patients were as follows: (1) The breast mass was confirmed by biopsy as primary invasive breast cancer; (2) NAC was performed after breast MRI examination; and (3) Surgical resection was performed after all courses of NAC. The exclusion criteria for patients were as follows: (1) Clinical, pathological and imaging data were incomplete; (2) Adjuvant therapy such as surgery or chemoradiotherapy was performed before MRI examination; (3) Poor MRI image quality affects the observation of lesions; and (4) The boundary of the lesion is not clear, and it is difficult to delineate the region of interest (ROI). Finally, 214 female patients who met the criteria of this study were included. The training set (n=149) and the test set (n=65) were randomly divided in a ratio of 7:3. Figure 1 illustrates the patient selection workflow chart.

Figure 1
www.frontiersin.org

Figure 1. Workflow chart of the patients included in this study.

MRI examination

All patients underwent MRI examinations were performed using a 3.0-T MRI scanner (Philips Achieva) with a dedicated breast coil (7-element SENSE breast coil).

All patients were placed in a prone position with both breasts naturally hanging down in the coil. The MRI acquisition sequence includes T1-weighted imaging (T1WI), fat-suppressed T2 weighted imaging (FS-T2WI), diffusion-weighted imaging (DWI), pre-contrast-enhancement T1WI, and DCE-MRI. Pre-contrast-enhancement T1WI was obtained before the contrast agent was injected. Then contrast agent GD-DTPA (Beilu Pharmaceutical, Beijing, China) was injected intravenously at a dose of 0.2 mmol/kg and at an injection rate of 2 ml/s, followed by 20 ml of normal saline at the same rate. A total of six phases of images were collected, and the collection time of each phase was 60s. Detailed MRI parameters are shown in Supplementary Table S1.

Clinical-radiological features

Clinicopathological data included age, estrogen receptor (ER), progesterone receptor (PR), human epidermal growth factor receptor-2 (HER-2), Ki-67, molecular subtypes, neutrophil lymphocyte ratio (NLR), menopausal status, and NAC regimen. NAC treatment cycles and regimens are based on National Comprehensive Cancer Network (NCCN) guidelines (21), where patients typically receive 6-8 cycles of NAC, followed by surgical resection 2-3 weeks after completion of NAC. The NAC regimens mainly include three types: (1) taxane-based; (2) anthracycline-based, and (3) anthracycline-and taxane-based. In addition, patients with positive HER-2 may be treated with trastuzumab or pertuzumab.

By two radiologists (with 8 and 10 years of experience in breast radiology, respectively) who were blinded to clinicopathology of the patients, according to the 5th edition of the American College of Radiology’s Breast Imaging Reporting and Data System (BI-RADS), to analyze the characteristics of breast tumors on MRI images. In the event of disagreement, a third radiologist with 20 years of experience in breast radiology further analyzed the MRI images and made a final assessment.

The radiological features included: (1) background parenchymal enhancement (BPE); (2) tumor size (the maximum diameter of the tumor as observed on the DCE-T1WI image); (3) tumor shape; (4) tumor margin; (5) T2 intratumoral hyperintense; (6) lesion type, distinguished as mass or non-mass enhancement (NME); (7) time-signal intensity curve (TIC); (8) apparent diffusion coefficient (ADC); (9) breast edema score (BES), according to Harada et al. ‘s study (22), we evaluated breast edema on T2WI images and defined it as BES, which was divided into 1-4 points (BES1: no edema; BES2: peritumoral edema; BES3: prepectoral edema; BES4: subcutaneous edema) (10). short diameter of ALN; and (11) number of lesions. For patients with multiple lesions, only the largest lesions were evaluated for the study.

Pathological evaluation

Immunohistochemical (IHC) were performed on specimens obtained after each patient’s needle biopsy to determine the status of ER, PR, HER-2, and Ki-67. When at least 1% of carcinoma nuclei show ER or PR positive staining, this indicates a positive status for ER or PR, respectively (23). The expression status of HER-2 can be determined according to the IHC score. An IHC score of 3+ is defined as a positive HER-2 status, an IHC score of 0 or 1+ is defined as a negative HER-2 status. An IHC score of 2+ requires further by fluorescence in situ hybridization (FISH) to confirm the diagnosis, a positive result from FISH testing is defined as a positive HER-2 status (24). When the proliferation index of Ki-67 is equal to or more than 14%, it is considered to be high expression, and when it is lower than 14%, it is considered to be low expression (25). According to the expression status of ER, PR, HER-2 and Ki-67, breast cancer patients were divided into four molecular subtypes: Luminal A (ER+/PR+, HER-2-, and low expression of Ki-67), Luminal B (ER+/PR+, high expression of Ki-67 and/or HER-2 +), HER-2 overexpression (ER-, PR- and HER-2 +), and Triple-negative (ER-, PR-, and HER-2 -) (26). The postoperative pathological specimens were evaluated using the Miller-Payne grading system (27): grade 1, no change or some alteration to individual tumor cells, but no reduction in overall cellularity; grade 2, a minor loss of tumor cells but overall high cellularity (up to 30% loss of cellularity); grade 3, within 30 to 90% reduction in cancer cellularity; grade 4, a marked disappearance of tumor cells such that only small clusters or widely dispersed individual tumor cells remained (more than 90% loss of cellularity); and grade 5, no malignant cells identifiable in sections from the site of the tumor, or ductal carcinoma in situ might be present. Patients with Miller-Payne grade 5 were categorized achieving a pCR, and patients with grades 1-4 as achieving a non-pCR.

Image acquisition and segmentation

Since the contrast of signal intensity between breast cancer lesions and glandular background reaches its highest peak in the 60-120s after the injection of contrast agent, the lesion enhancement is the most obvious in this period, which contains more abundant tumor information. Therefore, we chose the second phase of the DCE-MRI sequence for the delineation of region of interest (ROI). Image segmentation was performed on the Darwin Intelligent Research Platform (Beijing Yizhun Medical AI, Beijing, China). The intratumoral ROI was segmented by two radiologists with 5 (radiologist 1) and 7 years (radiologist 2) of experience in breast radiology, respectively. They were blinded to the patients’ clinicopathological and radiological information. The two radiologists unified the delineation standard, and manually delineated layer by layer along the boundary of the lesion on the second phase of axial DCE-MRI images. Two weeks later, 10% of the patients were randomly selected and the segmentation process was repeated independently by radiologist 1 and radiologist 2, and the inter-/intraclass correlation coefficient (ICC) was calculated to evaluate the reproducibility of manual segmentation. The regions surrounding the tumor (i.e., 2-,4-,6- and 8-mm radius) were defined as the peritumoral regions in our study. The corresponding peritumoral ROIs were obtained by automatically expanding the intratumoral ROIs by 2-mm, 4-mm, 6-mm and 8-mm. Schematic illustration of intratumoral and peritumoral ROIs segmentation are shown in Figure 2. If the contour of the peritumoral region extends beyond the parenchyma of the breast, manual adjustments were made to the ROI to exclude these excess parts. Finally, the three dimensional (3D) ROIs of the intratumoral and 2-,4-,6- and 8-mm peritumoral regions were obtained.

Figure 2
www.frontiersin.org

Figure 2. Schematic illustration of intratumoral and peritumoral ROI segmentation. The subject, a 49-year-old female diagnosed with invasive carcinoma in the right breast, exhibited non-pCR following NAC. (A) Maximal cross-sectional of tumor as observed on the second phase DCE-MRI image. (B-E) The red area is the intratumoral ROI, and the corresponding peritumoral ROIs were obtained by intratumoral ROI (red) automatic expansions by 2-mm (yellow), 4-mm (blue), 6-mm (purple) and 8-mm (green). (F) The 3D visualization intratumoral ROI with layer-by-layer delineation.

Radiomics feature extraction

The radiomics features of six different 3D-ROIs for each patient were extracted from the Darwin Intelligent research platform, including intratumoral, 2-, 4-, 6-, 8-mm peritumoral regions, intratumoral and optimal peritumoral regions. To further amplify the abundance of features, a variety of filters are used in our study, including exponential, logarithm, Laplacian of Gaussian (LoG), gradient, Local Binary Pattern 3D (LBP-3D), and wavelet filter. Finally, radiomics features were extracted from the original images and the images after various filters. The extracted radiomics features were normalized, and preprocessed to between (0,1) by using the maximum minimum value normalization method. The ICCs were calculated to quantify the consistency between the radiomics features extracted by two radiologists, retaining the radiomics features with ICCs > 0.75. Then we use the “Select K Best” method and select the f_calssif function to reduce the dimension of the features, and retaining the radiomics features with the sample variance F-values ranked in the top K%. Finally, using the least absolute shrinkage and selection operator (LASSO) logistic regression to reduce the dimensions of the remaining features, the optimal radiomics features for predicting pCR were finally selected.

Model construction and validation

The intratumoral radiomics model (IRM) and the 2-, 4-, 6- and 8-mm peritumoral radiomics model (PRM) were established based on five machine learning algorithms, and the corresponding radiomics score (Rad-score) was obtained according to the coefficient weighting of the selected optimal radiomics features in the respective models. Five machine learning algorithms include logistic regression (LR), random forest (RF), support vector machine (SVM), k nearest neighbors (KNN), and extreme gradient boosting (XGBoost), and compare the predictive performance of different machine learning algorithms. The area under the curve (AUC) of the receiver operating characteristic (ROC) was used to determine the optimal peritumoral region size for predicting pCR. Then based on the intratumoral and optimal peritumoral Rad-score, the combined intra- and peritumoral radiomics model (CIPRM) was established, and the confusion matrix was drawn to describe the performance of the model. In the training set, the clinical-radiological features highly correlated with pCR were selected as independent risk factors by uni- and multi-variate logistic regressions, and the clinical model (CM) was constructed. Finally, the CIPRM Rad-score combined with clinical-radiological factors was used to construct a nomogram model (NM).The ROC curves were drawn to evaluate the predictive performance of each model. DeLong test was used to compare the differences between the ROC curves of various models. The stability of the model was evaluated by tenfold cross-validation. The calibration curve and decision curve analysis (DCA) were used to evaluate the consistency and clinical practicability of the model. The workflow of radiomics analysis is shown in Figure 3.

Figure 3
www.frontiersin.org

Figure 3. The workflow for the radiomics analysis.

Statistical analysis

All statistical analyses were conducted using SPSS 26.0 software (SPSS, Chicago, IL), Medcalc software (Version 19.1.3), and R software (Version 4.4.1).

Kolmogorov-Smirnov was used to test the normality of the measurement data.The measurement data conforming to the normal distribution were represented with (mean ± standard deviation) and independent sample t-test was used. The measurement data that did not conform to normal distribution were represented by median (lower quartile-upper quartile) and Mann-Whitney U test was used. Counting data were expressed as frequency (constituent ratio), and using χ2 test, continuity correction test or Fisher exact probability method. Significant clinicopathological indicators and radiological features were screened by uni- and multi-variate logistic regressions. The ROC curves were plotted by Medcalc 19.1.3 software, and AUC, sensitivity, specificity and accuracy were calculated to evaluate the prediction performance of different models. Use R 4.4.1 software to draw nomogram, calibration curves and decision curves. When P < 0.05, the difference was considered statistically significant.

Results

Clinical-radiological features and construction of CM

In our study, 94 cases of the 214 patients achieved pCR, accounting for 43.9% (94/214), including 66 cases in the training set and 28 cases in the test set. 120 patients were non-pCR, accounting for 56.1% (120/214), including 83 cases in the training set and 37 cases in the test set. The clinical-radiological baseline features of breast cancer in the training and test sets are shown in Table 1.There were no significant differences in clinical-radiological features between the training set and the test set (p>0.05).

Table 1
www.frontiersin.org

Table 1. Clinical-radiological baseline features of breast cancer in the training and test sets.

The univariate logistic regression analysis was performed on the data in the training set, and there were statistically significant differences in ER, PR, HER-2, Ki-67, molecular subtype, NAC regimen, tumor size, shape, lesion type and BES between non-pCR and pCR groups (p<0.05). The multivariate logistic regression analysis showed that ER (95% confidence interval [CI]:0.003-0.804; P=0.035), Ki-67 (95%CI: 1.011-1.059; P=0.004) and BES (P=0.043) were independent risk factors for pCR status, as shown in Table 2 and Supplementary Figure S1. These three independent predictors were used to construct a CM.

Table 2
www.frontiersin.org

Table 2. Uni- and multivariate logistic regression analysis of pCR status in breast cancer in the training set.

Optimal peritumoral region

In this study, we compared the predictive performance of pCR status based on radiomics features of four different peritumoral regions (2-, 4-, 6-, and 8-mm) (Supplementary Table S2). The results showed that 6-mm PRM had the highest maximum AUC (0.794 and 0.779) in both the training set and the test set. Therefore, we selected 6-mm as the optimal peritumoral region to predict pCR status for subsequent studies.

Radiomics feature selection and construction of radiomics models

A total of 1781, 1781 and 3562 radiomics features were extracted from each patient’s intratumoral region, 6-mm peritumoral region, and intratumoral + 6-mm peritumoral region, respectively. The features of ICCs > 0.75 were retained, and the features dimensionality were reduced by screening threshold percentage and f_classif function. Finally, after LASSO regression, a total of 10, 11 and 10 optimal radiomics features highly correlated with pCR status were obtained. The IRM, 6-mm PRM and CIPRM were constructed, and calculate the Rad-Score. Supplementary Table S3 illustrates the radiomics features and their respective coefficients of the three radiomics models. Among the three radiomics models, CIPRM had a maximum AUC of 0.851 and 0.840 in the training and test set, respectively, and its predictive performance was better than IRM and 6-mm PRM (Supplementary Table S2). According to the confusion matrix results, the sensitivity, specificity, and accuracy of the CIPRM were 0.788, 0.771 and 0.779 in the training set, and 0.750, 0.757 and 0.754 in the test set, respectively (Supplementary Figure S2). The Rad-Score of CIPRM is as follows:

Rad-Score=+2.339×wavelet-LHH_gldm_LargeDependenceLowGrayLevelEmphasis+ 2.184×exponential_firstorder_Kurtosis+1.763×gradient_glszm_SmallAreaLowGrayLevelEmphasis+1.751×wavelet-HLL_glcm_ClusterTendency-1.520×wavelet-HHL_glcm_Idmn-1.439×wavelet-LHH_firstorder_Kurtosis+1.205×wavelet-HHH_glcm_MCC+1.112×wavelet-HLH_gldm_LargeDependenceHighGrayLevelEmphasis+0.702×logarithm_glcm_Imc2-0.631×wavelet-LLH_ngtdm_Busyness-1.834

The comparison of prediction performance of different machine learning algorithms is shown in Supplementary Table S2. In the CIPRM, the AUC of the five machine learning algorithms in the training set ranged from 0.755 to 0.851, and the AUC in the test set ranged from 0.704 to 0.840. Compared with other machine learning algorithms, SVM obtained the largest AUC values in both the training set (0.851) and the test set (0.840), and the difference of AUC values in these two datasets was small, indicating that SVM had the best and most stable performance.

Development and validation of NM

The CIPRM Rad-score combined with clinical-radiological factors (ER, Ki-67, and BES) was used to construct a NM. The nomogram shows that the CIPRM Rad-score has the greatest weight in the construction of the model, followed by Ki-67 (Figure 4). We finally constructed five models for predicting pCR states, including IRM, 6-mm PRM, CIPRM, CM and NM. Figure 5 shows the ROC curves of these five models in the training set and the test set. ROC curve showed that the AUCs of the NM in the training set and the test set were 0.911and 0.897 respectively, which were higher than 0.795 and 0.776 for the IRM, 0.794 and 0.779 for the 6-mm PRM, 0.851 and 0.840 for the CIPRM, and 0.764 and 0.778 for the CM (Figure 5; Table 3).

Figure 4
www.frontiersin.org

Figure 4. The nomogram was developed based on ER, Ki-67, BES and CIPRM Rad-score.

Figure 5
www.frontiersin.org

Figure 5. ROC curves of five models in the training set (A) and test sets (B). IRM, intratumoral radiomics model; PRM, 6-mm peritumoral radiomics model; CIPRM, combined intra- and 6-mm peritumoral radiomics model; CM, clinical-radiological model; NM, nomogram model.

Table 3
www.frontiersin.org

Table 3. Performance of five models in the training and test sets.

DeLong test showed that there were statistically significant differences between the NM and the other four models in the training set (p<0.05), and the NM had better predictive performance (Table 4). The 10-fold cross-validation shows that the NM exhibits excellent stability (Supplementary Figure S3). The calibration curve shows that the trend of the predicted curve of the pCR status by the NM is basically consistent with the actual curve (Figure 6). DCA shows that the NM has the greatest clinical net benefit in predicting pCR status after NAC in breast cancer patients (Figure 7).

Table 4
www.frontiersin.org

Table 4. DeLong test for the comparison of ROC curves between different models in the training and test sets.

Figure 6
www.frontiersin.org

Figure 6. Calibration curves of the nomogram model in the training (A) and test sets (B).

Figure 7
www.frontiersin.org

Figure 7. Decision curves of five models in the training set (A) and test sets (B).IRM, intratumoral radiomics model; PRM, 6-mm peritumoral radiomics model; CIPRM, combined intra- and 6-mm peritumoral radiomics model; CM, clinical-radiological model; NM, nomogram model.

Discussion

In this study, we discussed the value of intratumoral combined peritumoral radiomics model based on pretherapy DCE-MRI images for early prediction of pCR. On this basis, we added clinical-radiological factors to construct a NM. The NM has better predictive performance, and has the potential to become a tool for early prediction of the post-NAC pCR status of breast cancer patients, contributing to the clinical formulation of precise treatment strategies, and helping patients avoid unnecessary surgery or reduce the toxic side effects of chemotherapy drugs.

Several clinical-radiological factors were significantly correlated with pCR, including Ki-67, ER and BES, indicating their potential value in predicting pCR status. This study found that patients with high expression of Ki-67 were more likely to achieve pCR, which is consistent with Kim et al. (28). The high expression of Ki-67 indicates that tumor cells are proliferating more actively, and chemotherapy drugs have strong lethality to cells with active proliferation. Therefore, patients with high expression of Ki-67 are more sensitive to chemotherapy drugs. This study showed that ER negative is an independent predictor of pCR, mainly because ER negative patients are more aggressive, have higher proliferation index and malignancy degree, are more sensitive to chemotherapy. Therefore, ER negative patients are more likely to obtain pCR than ER positive patients (29).BES is a key factor affecting the prognosis of breast cancer, which may be related to lymphovascular invasion (LVI) (30). Peritumoral edema is the mildest form of edema, prepectoral edema often indicates significant LVI, and subcutaneous edema often indicates more extensive LVI. This study found that BES was an independent predictor of pCR, and the incidence of BES was negatively correlated with that of pCR. Patients with no edema were more likely to achieve pCR than patients with peritumoral edema, prepectoral edema, or subcutaneous edema. This may be because LVI will make the tumor develop a certain resistance to chemotherapy drugs, thus affecting the efficacy of NAC, resulting in difficult to achieve pCR (31).

The peritumoral region often contains important biological information and is closely related to the development, metastasis and prognosis of the tumor. Xu et al. (32) extracted the intratumoral and 4-mm peritumoral regions radiomics features from digital breast tomosynthesis (DBT) to predict the LVI status of breast cancer patients, and found that the combined intratumoral and peritumoral radiomics models produced higher AUC. Zhang et al. (33) extracted the 2-mm, 4-mm, 6-mm, 8-mm peritumoral regions radiomics features from DCE-MRI images to predict the molecular subtypes of invasive ductal carcinoma. It is found that the optimal peritumoral region size is different for different prediction tasks. In recent years, there have been more and more studies on the prediction of pCR after NAC in breast cancer patients (3436), but there are few studies on the optimal peritumoral region size. In the existing studies to predict pCR, different scholars set the size of the peritumoral region differently. Li et al. set 10-mm around the tumor as the peritumoral region (37), while Braman et al. set 2.5-5 mm around the tumor as the peritumoral region (38). These studies did not explore the optimal peritumoral region size. Mao et al. (39) extracted the intratumoral and 5-mm,10-mm peritumoral regions radiomics features from contrast-enhanced spectral mammography (CESM) to predict the effect of the NAC of breast cancers. The results showed that 5-mm around the tumor was the optimal peritumoral region. The combined intratumoral and 5-mm peritumoral radiomics model achieved a maximum AUC of 0.85 (95% CI, 0.72-0.98) in the test set. In this study, the radiomics features of 2-mm, 4-mm, 6-mm, 8-mm peritumoral regions were extracted from pretherapy DCE-MRI images to predict the pCR status of breast cancer patients after NAC, and the results showed that the 6-mm around the tumor was the optimal peritumoral region, the maximum AUC of the combined intratumoral and 6-mm peritumoral radiomics model in the training set and test set were 0.851 and 0.840, respectively, showing high predictive performance. Compared with previous research results, the model established in our study significantly improves the prediction performance, which may be related to the size of the selected peritumoral region. The peritumoral region reflects stromal involvement, immune infiltration, and angiogenesis, which are critical for neoadjuvant chemotherapy response. A 6-mm region may optimally capture these dynamics, as smaller regions (2-4 mm) might miss extended stromal interactions, while larger regions (8-mm) could introduce noise from normal tissues. Different peritumoral region sizes contain different tumor microenvironments, so we should determine the optimal peritumoral region size according to the actual prediction task, so as to improve the prediction performance of the model and obtain more valuable information.

In this study, five kinds of machine learning algorithms were used to establish the radiomics model. Among these radiomics models, CIPRM has the best predictive performance. In the CIPRM, SVM showed the best and stable performance. The SVM is often used to solve classification problems, which can deal with high-dimensional data sets and nonlinear relations between variables well, and is not easy to overfit, and has strong robustness and generalization. The CIPRM was established by SVM algorithm, and 10 radiomics features were extracted. The radiomics features were extracted from images after wavelet transform account for 70.0%(7/10), which may be due to the existence of pCR-related fine features in images after wavelet transform, whose details and complexity are higher than those of original images. Among the 10 radiomics features, there are 8 texture features and 2 first-order statistics. Texture features accounted for 80.0% (8/10), including 4 GLCM, 2 GLDM, 1 NGTDM and 1 GLSZM. Texture features can reflect the heterogeneity and complexity of breast cancer, and can indirectly predict the invasion ability, malignancy degree and prognosis of the tumor. The 10 radiomics features include 5 intratumoral and 5 peritumoral features. The coefficient of intratumoral feature (wavelet-LHH_gldm_LargeDependenceLowGrayLevelEmphasis) was the largest and positively correlated with the pCR rate, which was consistent with the results of Mao et al. (39). The coefficient of peritumoral feature (exponential_firstorder_Kurtosis) was second, which also reflects the importance of peritumoral radiomics features and can provide more supplementary information about the tumor microenvironment.

This study finally constructed five models for predicting pCR status after NAC in breast cancer patients, including IRM, 6-mm PRM, CIPRM, CM and NM. Among the five models, the NM has the best predictive performance. The AUC, sensitivity, specificity and accuracy of the NM was 0.911, 0.848, 0.831 and 0.826 in the training set, respectively, and 0.897, 0.893, 0.784 and 0.815 in the test set, respectively, which was superior to the single CM and three radiomics models. The CIPRM based on intratumoral and 6-mm peritumoral regions also showed better predictive performance, with the training set and test set AUC of 0.851 and 0.840, respectively, which was superior to the IRM, 6-mm PRM and CM. Different from Mao et al. (39), this study was based on DCE-MRI radiomics and clinical-radiological features to build a NM, which further improved the predictive performance of pCR. The nomogram shows that the CIPRM Rad-score has the greatest weight in the construction of the model, which reflects the importance of radiomics and can dig out more pathophysiological information of tumors.

This study has some limitations. First, it was a retrospective, single-center study that lacked external validation. The limited sample size raises concerns about potential overfitting risks. In future work, we will adopt multi-center and large-sample data to validate the model in order to further mitigate overfitting risks. Secondly, the evaluation of MRI radiological features may be influenced by the subjective factors of the radiologist. Finally, this study only constructed the model based on five machine learning algorithms. In our follow-up study, we plan to evaluate several deep learning architectures including: artificial neural networks (ANN), 3D convolutional neural networks (3D-CNN) for volumetric feature extraction, Hybrid radiomics-deep learning fusion models, Vision transformers (ViT) adapted for DCE-MRI analysis, etc. We will compare the performance between the NM and the deep learning-based model. In the future, we will utilize some XAI techniques such as Shapley Additive explanations (SHAP) or Local interpretable model-agnostic explanations (LIME) to enhance the explainability of both the machine learning- and deep learning-based models, thereby improving the clinical applicability of the models.

In summary, the NM established by combining intratumoral and peritumoral radiomics features and clinical-radiological factors has high performance, and can predict the pCR status of breast cancer patients after NAC in an early stage, providing an important information for clinical selection of appropriate treatment plan, timely adjustment of treatment strategy and prognosis assessment.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding authors.

Ethics statement

The studies involving humans were approved by the ethics committee of Bengbu Medical University. The studies were conducted in accordance with the local legislation and institutional requirements. This study was approved by the ethics committee of our hospital (no. [2023] 441), and the subject’s informed consent was exempted.

Author contributions

YZ: Data curation, Funding acquisition, Writing – original draft, Writing – review & editing. SZ: Data curation, Investigation, Writing – original draft. WW: Conceptualization, Methodology, Writing – original draft. LY: Data curation, Formal analysis, Writing – original draft. LW: Data curation, Formal analysis, Writing – original draft. YW: Conceptualization, Formal analysis, Writing – original draft. YF: Data curation, Writing – original draft, Funding acquisition. HS: Writing – review & editing, Funding acquisition. ZX: Funding acquisition, Writing – review & editing, Supervision.

Funding

The author(s) declare that financial support was received for the research and/or publication of this article. This study was supported by Key Project of Natural Science Research in Anhui Universities (2022AH051473); Key Project of Natural Science of Bengbu Medical University (2020byzd145); Discipline leader training project of Anhui Provincial Department of Education (DTR2024028); Clinical research project, Bengbu Medical University (2022byflc008); “Science and Technology Innovation Action Plan” Star Cultivation (Sailing Program) (22YF1443600); the China Postdoctoral Science Foundation (2023M732230); and Anhui Provincial university students innovation and entrepreneurship Plan Project (S202310367047).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declare that no Generative AI was used in the creation of this manuscript.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2025.1561599/full#supplementary-material

References

1. Giaquinto AN, Sung H, Newman LA, Freedman RA, Smith RA, Star J, et al. Breast cancer statistics 2024. CA Cancer J Clin (2024) 74:477–95. doi: 10.3322/caac.21863

PubMed Abstract | Crossref Full Text | Google Scholar

2. Siegel RL, Giaquinto AN, and Jemal A. Cancer statistics, 2024. CA Cancer J Clin. (2024) 74:12–49. doi: 10.3322/caac.21820

PubMed Abstract | Crossref Full Text | Google Scholar

3. Zhang J, Wu Q, Yin W, Yang L, Xiao B, Wang J, et al. Development and validation of a radiopathomic model for predicting pathologic complete response to neoadjuvant chemotherapy in breast cancer patients. BMC Cancer. (2023) 23:431. doi: 10.1186/s12885-023-10817-2

PubMed Abstract | Crossref Full Text | Google Scholar

4. Guarneri V, Griguolo G, Miglietta F, Conte PF, Dieci MV, and Girardi F. Survival after neoadjuvant therapy with trastuzumab-lapatinib and chemotherapy in patients with HER2-positive early breast cancer: a meta-analysis of randomized trials. ESMO Open. (2022) 7:100433. doi: 10.1016/j.esmoop.2022.100433

PubMed Abstract | Crossref Full Text | Google Scholar

5. Korde LA, Somerfield MR, Carey LA, Crews JR, Denduluri N, Hwang ES, et al. Neoadjuvant chemotherapy, endocrine therapy, and targeted therapy for breast cancer: ASCO guideline. J Clin Oncol. (2021) 39:1485–505. doi: 10.1200/JCO.20.03399

PubMed Abstract | Crossref Full Text | Google Scholar

6. Yau C, Osdoit M, van der Noordaa M, Shad S, Wei J, de Croze D, et al. Residual cancer burden after neoadjuvant chemotherapy and long-term survival outcomes in breast cancer: a multicentre pooled analysis of 5161 patients. Lancet Oncol. (2022) 23:149–60. doi: 10.1016/S1470-2045(21)00589-1

PubMed Abstract | Crossref Full Text | Google Scholar

7. Jang MK, Park S, Park C, Doorenbos AZ, Go J, and Kim S. Body composition change during neoadjuvant chemotherapy for breast cancer. Front Oncol. (2022) 12:941496. doi: 10.3389/fonc.2022.941496

PubMed Abstract | Crossref Full Text | Google Scholar

8. Geyer CE, Sikov WM, Huober J, Rugo HS, Wolmark N, O'Shaughnessy J, et al. Long-term efficacy and safety of addition of carboplatin with or without veliparib to standard neoadjuvant chemotherapy in triple-negative breast cancer: 4-year follow-up data from BrighTNess, a randomized phase III trial. Ann Oncol. (2022) 33:384–94. doi: 10.1016/j.annonc.2022.01.009

PubMed Abstract | Crossref Full Text | Google Scholar

9. Wu J, Ge L, Guo Y, Xu D, and Wang Z. Utilizing multiclassifier radiomics analysis of ultrasound to predict high axillary lymph node tumour burden in node-positive breast cancer patients: a multicentre study. Ann Med. (2024) 56:2395061. doi: 10.1080/07853890.2024.2395061

PubMed Abstract | Crossref Full Text | Google Scholar

10. Xu M, Yang H, Yang Q, Teng P, Hao H, Liu C, et al. Radiomics nomogram based on digital breast tomosynthesis: preoperative evaluation of axillary lymph node metastasis in breast carcinoma. J Cancer Res Clin Oncol. (2023) 149:9317–28. doi: 10.1007/s00432-023-04859-z

PubMed Abstract | Crossref Full Text | Google Scholar

11. Mo S, Luo H, Wang M, Li G, Kong Y, Tian H, et al. Machine learning radiomics based on intra and peri tumor PA/US images distinguish between luminal and non-luminal tumors in breast cancers. Photoacoustics. (2024) 40:100653. doi: 10.1016/j.pacs.2024.100653

PubMed Abstract | Crossref Full Text | Google Scholar

12. Wang L, Ding Y, Yang W, Wang H, Shen J, Liu W, et al. A radiomics nomogram for distinguishing benign from Malignant round-like breast tumors. Front Oncol. (2022) 12:677803. doi: 10.3389/fonc.2022.677803

PubMed Abstract | Crossref Full Text | Google Scholar

13. Mao N, Bao Y, Dong C, Zhou H, Zhang H, Ma H, et al. Delta radiomics based on MRI for predicting axillary lymph node pathologic complete response after neoadjuvant chemotherapy in breast cancer patients. Acad Radiol 32:37–49. (2024). doi: 10.1016/j.acra.2024.07.052

PubMed Abstract | Crossref Full Text | Google Scholar

14. Zhu S, Wang S, Guo S, Wu R, Zhang J, Kong M, et al. Contrast-enhanced mammography radiomics analysis for preoperative prediction of breast cancer molecular subtypes. Acad Radiol. (2024) 31:2228–38. doi: 10.1016/j.acra.2023.12.005

PubMed Abstract | Crossref Full Text | Google Scholar

15. Ramtohul T, Djerroudi L, Lissavalid E, Nhy C, Redon L, Ikni L, et al. Multiparametric MRI and radiomics for the prediction of HER2-zero, -low, and -positive breast cancers. Radiology. (2023) 308:e222646. doi: 10.1148/radiol.222646

PubMed Abstract | Crossref Full Text | Google Scholar

16. Wang X, Hua H, Han J, Zhong X, Liu J, and Chen J. Evaluation of multiparametric MRI radiomics-based nomogram in prediction of response to neoadjuvant chemotherapy in breast cancer: A two-center study. Clin Breast Cancer. (2023) 23:e331–44. doi: 10.1016/j.clbc.2023.05.010

PubMed Abstract | Crossref Full Text | Google Scholar

17. Zhang S, Shao H, Li W, Zhang H, Lin F, Zhang Q, et al. Intra- and peritumoral radiomics for predicting Malignant BiRADS category 4 breast lesions on contrast-enhanced spectral mammography: a multicenter study. Eur Radiol. (2023) 33:5411–22. doi: 10.1007/s00330-023-09513-3

PubMed Abstract | Crossref Full Text | Google Scholar

18. Niu S, Jiang W, Zhao N, Jiang T, Dong Y, Luo Y, et al. Intra- and peritumoral radiomics on assessment of breast cancer molecular subtypes based on mammography and MRI. J Cancer Res Clin Oncol. (2022) 148:97–106. doi: 10.1007/s00432-021-03822-0

PubMed Abstract | Crossref Full Text | Google Scholar

19. Wu Z, Lin Q, Wang H, Chen J, Wang G, Fu G, et al. Intratumoral and peritumoral radiomics based on preoperative MRI for evaluation of programmed cell death ligand-1 expression in breast cancer. J Magn Reson Imaging. (2024) 60:588–99. doi: 10.1002/jmri.29109

PubMed Abstract | Crossref Full Text | Google Scholar

20. Jiang W, Meng R, Cheng Y, Wang H, Han T, Qu N, et al. Intra- and peritumoral based radiomics for assessment of lymphovascular invasion in invasive breast cancer. J Magn Reson Imaging. (2024) 59:613–25. doi: 10.1002/jmri.28776

PubMed Abstract | Crossref Full Text | Google Scholar

21. Gradishar WJ, Moran MS, Abraham J, Abramson V, Aft R, Agnese D, et al. NCCN guidelines® Insights: breast cancer, version 4.2023. J Natl Compr Canc Netw. (2023) 21:594–608. doi: 10.6004/jnccn.2023.0031

PubMed Abstract | Crossref Full Text | Google Scholar

22. Harada TL, Uematsu T, Nakashima K, Kawabata T, Nishimura S, Takahashi K, et al. Evaluation of Breast Edema Findings at T2-weighted Breast MRI Is Useful for Diagnosing Occult Inflammatory Breast Cancer and Can Predict Prognosis after Neoadjuvant Chemotherapy. Radiology. (2021) 299:53–62. doi: 10.1148/radiol.2021202604

PubMed Abstract | Crossref Full Text | Google Scholar

23. Hammond ME, Hayes DF, Dowsett M, Allred DC, Hagerty KL, Badve S, et al. American Society of Clinical Oncology/College Of American Pathologists guideline recommendations for immunohistochemical testing of estrogen and progesterone receptors in breast cancer. J Clin Oncol. (2010) 28:2784–95. doi: 10.1200/JCO.2009.25.6529

PubMed Abstract | Crossref Full Text | Google Scholar

24. Wolff AC, Hammond ME, Hicks DG, Dowsett M, McShane LM, Allison KH, et al. Recommendations for human epidermal growth factor receptor 2 testing in breast cancer: American Society of Clinical Oncology/College of American Pathologists clinical practice guideline update. J Clin Oncol. (2013) 31:3997–4013. doi: 10.1200/JCO.2013.50.9984

PubMed Abstract | Crossref Full Text | Google Scholar

25. Xu ML, Zeng SE, Li F, Cui XW, and Liu GF. Preoperative prediction of lymphovascular invasion in patients with T1 breast invasive ductal carcinoma based on radiomics nomogram using grayscale ultrasound. Front Oncol. (2022) 12:1071677. doi: 10.3389/fonc.2022.1071677

PubMed Abstract | Crossref Full Text | Google Scholar

26. Li Q, Liu J, Jiang Z, and Liu Q. CSCO breast cancer guideline: precise, economical and oriental. Sci China Life Sci. (2020) 63:1410–2. doi: 10.1007/s11427-020-1701-5

PubMed Abstract | Crossref Full Text | Google Scholar

27. Ogston KN, Miller ID, Payne S, Hutcheon AW, Sarkar TK, Smith I, et al. A new histological grading system to assess response of breast cancers to primary chemotherapy: prognostic significance and survival. Breast. (2003) 12:320–7. doi: 10.1016/S0960-9776(03)00106-1

PubMed Abstract | Crossref Full Text | Google Scholar

28. Kim SY, Cho N, Choi Y, Lee SH, Ha SM, Kim ES, et al. Factors affecting pathologic complete response following neoadjuvant chemotherapy in breast cancer: development and validation of a predictive nomogram. Radiology. (2021) 299:290–300. doi: 10.1148/radiol.2021203871

PubMed Abstract | Crossref Full Text | Google Scholar

29. Collins PM, Brennan MJ, Elliott JA, Abd Elwahab S, Barry K, Sweeney K, et al. Neoadjuvant chemotherapy for luminal a breast cancer: Factors predictive of histopathologic response and oncologic outcome. Am J Surg. (2021) 222:368–76. doi: 10.1016/j.amjsurg.2020.11.053

PubMed Abstract | Crossref Full Text | Google Scholar

30. Cheon H, Kim HJ, Kim TH, Ryeom HK, Lee J, Kim GC, et al. Invasive breast cancer: prognostic value of peritumoral edema identified at preoperative MR imaging. Radiology. (2018) 287:68–75. doi: 10.1148/radiol.2017171157

PubMed Abstract | Crossref Full Text | Google Scholar

31. Pu S, Wang K, Liu Y, Liao X, Chen H, He J, et al. Nomogram-derived prediction of pathologic complete response (pCR) in breast cancer patients treated with neoadjuvant chemotherapy (NCT). BMC Cancer. (2020) 20:1120. doi: 10.1186/s12885-020-07621-7

PubMed Abstract | Crossref Full Text | Google Scholar

32. Xu M, Yang H, Sun J, Hao H, Li X, and Liu G. Development of an intratumoral and peritumoral radiomics nomogram using digital breast tomosynthesis for preoperative assessment of lymphovascular invasion in invasive breast cancer. Acad Radiol. (2024) 31:1748–61. doi: 10.1016/j.acra.2023.11.010

PubMed Abstract | Crossref Full Text | Google Scholar

33. Zhang S, Wang X, Yang Z, Zhu Y, Zhao N, Li Y, et al. Intra- and peritumoral radiomics model based on early DCE-MRI for preoperative prediction of molecular subtypes in invasive ductal breast carcinoma: A multitask machine learning study. Front Oncol. (2022) 12:905551. doi: 10.3389/fonc.2022.905551

PubMed Abstract | Crossref Full Text | Google Scholar

34. Zeng Q, Xiong F, Liu L, Zhong L, Cai F, and Zeng X. Radiomics based on DCE-MRI for predicting response to neoadjuvant therapy in breast cancer. Acad Radiol. (2023) 30 Suppl 2:S38–49. doi: 10.1016/j.acra.2023.04.009

PubMed Abstract | Crossref Full Text | Google Scholar

35. Ramtohul T, Lepagney V, Bonneau C, Jin M, Menet E, Sauge J, et al. Use of pretreatment perfusion MRI-based intratumoral heterogeneity to predict pathologic response of triple-negative breast cancer to neoadjuvant chemoimmunotherapy. Radiology. (2024) 312:e240575. doi: 10.1148/radiol.240575

PubMed Abstract | Crossref Full Text | Google Scholar

36. Zhang X, Teng X, Zhang J, Lai Q, and Cai J. Enhancing pathological complete response prediction in breast cancer: the role of dynamic characterization of DCE-MRI and its association with tumor heterogeneity. Breast Cancer Res. (2024) 26:77. doi: 10.1186/s13058-024-01836-3

PubMed Abstract | Crossref Full Text | Google Scholar

37. Li C, Lu N, He Z, Tan Y, Liu Y, Chen Y, et al. A noninvasive tool based on magnetic resonance imaging radiomics for the preoperative prediction of pathological complete response to neoadjuvant chemotherapy in breast cancer. Ann Surg Oncol. (2022) 29:7685–93. doi: 10.1245/s10434-022-12034-w

PubMed Abstract | Crossref Full Text | Google Scholar

38. Braman NM, Etesami M, Prasanna P, Dubchuk C, Gilmore H, Tiwari P, et al. Intratumoral and peritumoral radiomics for the pretreatment prediction of pathological complete response to neoadjuvant chemotherapy based on breast DCE-MRI. Breast Cancer Res. (2017) 19:57. doi: 10.1186/s13058-017-0846-1

PubMed Abstract | Crossref Full Text | Google Scholar

39. Mao N, Shi Y, Lian C, Wang Z, Zhang K, Xie H, et al. Intratumoral and peritumoral radiomics for preoperative prediction of neoadjuvant chemotherapy effect in breast cancer based on contrast-enhanced spectral mammography. Eur Radiol. (2022) 32:3207–19. doi: 10.1007/s00330-021-08414-7

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: breast cancer, neoadjuvant chemotherapy, pathological complete response, intratumoral, peritumoral, radiomics, nomogram

Citation: Zhu Y, Zhang S, Wei W, Yang L, Wang L, Wang Y, Fan Y, Sun H and Xie Z (2025) Intra- and peritumoral radiomics nomogram based on DCE-MRI for the early prediction of pathological complete response to neoadjuvant chemotherapy in breast cancer. Front. Oncol. 15:1561599. doi: 10.3389/fonc.2025.1561599

Received: 16 January 2025; Accepted: 15 May 2025;
Published: 04 June 2025.

Edited by:

Hatem A. Rashwan, University of Rovira i Virgili, Spain

Reviewed by:

Haiyan Li, The Sixth Affiliated Hospital of Sun Yat-sen University, China
Alexandru Ciobotaru, Technical University of Cluj-Napoca, Romania

Copyright © 2025 Zhu, Zhang, Wei, Yang, Wang, Wang, Fan, Sun and Xie. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Haitao Sun, c2h0MTcyMEAxNjMuY29t; Zongyu Xie, em9uZ3l1eGllQHNpbmEuY29t

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.