Your new experience awaits. Try the new design now and help us make it even better

ORIGINAL RESEARCH article

Front. Oncol., 16 January 2026

Sec. Breast Cancer

Volume 15 - 2025 | https://doi.org/10.3389/fonc.2025.1680160

Ultrasound radiomics predicts preoperative axillary lymph node metastasis status in early-stage breast cancer to support surgical decisions: a machine learning, monocenter study

Zhi-Liang Hong,,Zhi-Liang Hong1,2,3Xiao-Rui PengXiao-Rui Peng4Xia Liang,,Xia Liang1,2,3Xian-Tao Zeng,,Xian-Tao Zeng1,2,3Jian-Chuan Yang,,Jian-Chuan Yang1,2,3Song-Song Wu,,*Song-Song Wu1,2,3*
  • 1Shengli Clinical Medical College of Fujian Medical University, Fuzhou, China
  • 2Department of Ultrasound, Fujian Provincial Hospital, Fuzhou, China
  • 3Fuzhou University Affiliated Provincial Hospital, Fuzhou, China
  • 4Fujian Medical University, Fuzhou, China

Background: The usual assessment for axillary lymph node (ALN) status in breast cancer (BC) in current clinical practice is based on an invasive procedure that has a low efficiency rate and frequently results in operative-associated problems for patients. Therefore, our goal was to create an effective preoperative ultrasound (US) radiomics evaluation method for ALN status in patients with clinical stages T1–2 invasive BC using machine learning (ML) approaches.

Methods: Between January 2020 and January 2024, we retrospectively analyzed the medical records of 671 patients with histologically proven malignant breast tumors in our hospital.The data set was divided into model training group and validation testing group with a 75/25 split.There were two categories for ALN tumor burden: low (1–2 metastatic ALNs) and high (≥ 3 metastatic ALNs). The PyRadiomics package was used to obtain radiomic features (RF), and a support vector machine (SVM) with the LASSO approach was used to create a radiomic signature (RS).The training group’s multivariate logistic regression results were used to create a nomogram that combined the BC US radiomics score with a clinical parameter.Additionally, the area under the operating characteristic curve (AUC) was used to evaluate their prediction performance.

Results: With an AUC of 0.920 (95% CI: 0.901, 0.943) in the test cohort, clinical parameter coupled RS provides the greatest diagnostic performance in predicting ALN status between disease-free axilla and any axillary metastases.In the testing cohort, the sensitivity, specificity, accuracy, positive predictive value (PPV), and negative predictive value (NPV) were 90%, 82%, 83%, 89%, and 86%, respectively. With an AUC of 0.939 (95% CI: 0.892, 0.970) in the test cohort, this clinical measure paired with RS can also distinguish between a low and a substantial metastatic burden of axillary illness.

Conclusions: For patients with early-stage BC, our work provides a noninvasive imaging biomarker to forecast the extent of ALN metastases.The imaging biomarker demonstrated strong predictive value and the potential for extended application to customize surgical care.

Introduction

Globally, female breast cancer (BC) is the main cause of cancer-related mortality for women and has overtaken lung cancer as the most often diagnosed malignancy (1). One of the key prognostic variables for BC that influences treatment choices is axillary lymph node metastasis (ALNM) (2). The first node to drain the main malignancy is the sentinel lymph node (SLN).To anticipate ALN status, SLN dissection (SLND) is advised, particularly for patients with clinically negative nodes (3). According to the American College of Surgeons Oncology Group Z0011 (ACOSOG Z0011) trial, SLND by itself would not result in a lower survival rate than ALND in patients with clinical T1/T2 BC if there were two or less SLN metastases (4, 5). Although SLND has fewer difficulties than ALND, it is still a risky procedure with several serious drawbacks, such as a significant increase in anesthetic time and cost and the possibility of complications such upper limb edema or arm numbness in 3.5% to 10.9% of patients (6, 7).Additionally, radiopharmaceuticals and the methods of injecting radiocolloid limit its accuracy (8, 9). Additionally, the frozen segment of SLNB takes a long time, which prolongs the duration of the procedure.According to some research, 43–65% of patients with positive SLNs had needless axillary surgery because there was no nonSLN metastases, which led to a high rate of morbidity (10, 11). Because the majority of patients with early-stage BC (cT1-2N0M0) have disease-free axilla, SLN biopsy may be avoided if there was a trustworthy and effective preoperative assessment of ALN status (12).

To assess ALN status and describe breast lesions preoperatively, ultrasound (US) has been employed extensively (13). In patients with early-stage BC, a study found that preoperative axillary US results and clinical T stage were related to the ALN status (12). However, axillary US had poor diagnostic performance in determining the ALN status, with an area under the receiver operating characteristic curve (AUC) of 0.585–0.719 (14). Numerous investigations aimed to predict the ALN status using clinicopathological information, including hormone receptor status, tumor grade, histological tumor size, lymphovascular invasion, and Ki-67 proliferation index (15, 16). However, with an AUC of 0.66–0.74 in earlier research, relying solely on clinicopathological data is insufficiently accurate (17). Furthermore, preoperative information of ALN status is crucial for choosing the best axillary treatment options, even though some data, such as lymphovascular invasion and histological tumor size, may not be available (6).

Many quantitative picture elements that are typically difficult for the human eye to identify can be automatically extracted from medical images using radiomics (18, 19). Subsequent examination of these characteristics may reveal intratumor heterogeneity and offer prospective noninvasive biomarkers to aid in clinical decision-making (18, 20).Clinical oncology CT or MRI image analysis was the first application of this technique that showed promise (21, 22). Radiomics based on US image analysis has recently outperformed other standard techniques (23). Through supervised learning, a recently developed technique called deep learning radiomics (DLR) can extract quantitative and high-throughput features from medical images (18, 19). When DLR is used to evaluate medical images, it usually has small-sample learning problems.In order to improve model performance, clinical parameter combined DLR, which combines clinical information with network characteristics, can assist in providing complementary information for image features and working together to create the model using clinical information and US image features (24).To date, radiomics and deep learning have been used less frequently to forecast ALNM in BC.

The objective of this study was to develop a novel preoperative strategy based on US radiomics that focuses on tumor regions for ALNM prediction in patients with early-stage invasive BC. The ultimate goal is to assist in customizing surgical management and minimizing needless SLNB or ALND, which will lower the incidence of related postoperative complications and enhance patients’ quality of life.

Methods

Patients

The Fujian Provincial Hospital review committee gave their approval to this study. All participants provided informed consent to participate in the study.The study adhered to the Declaration of Helsinki and relevant national guidelines.All experiments were performed in accordance with relevant guidelines and regulations.We constantly gathered female patients having US findings of breast lesions from January 2020 to January 2024.The following were among the requirements for inclusion: (a) women with US-suspected breast masses; (b) clinical data availability; (c) patients who had breast surgery and SLNB or ALND with the goal of curing their condition; and (d) each patient only had a lesion with a diameter of less than or equal to 5 cm (stages T1 and T2), as determined by pathological results and US imaging. The following conditions were excluded: (a) preoperative treatment (chemotherapy, neoadjuvant radiation, or resection biopsy); (b) individuals with bilateral disease or multifocal lesions; (c) the region of interest (ROI) was not fully apparent on the US images;(d) benign breast lesions or cancer in situ; (e) missing significant histopathological results (immunohistochemical or LN results); (f) insufficient information or images. In accordance with the NCCN guideline, imaging (MRI, ultrasound, or positron emission tomography) or clinical examination were used to assess the clinical T and clinical N stages (25). SLNB or ALND was used to pathologically determine the ALN state, which was the main conclusion.Lastly, 671 lesions from 671 patients with invasive BC in its early stages were included.The data were divided 75/25 using SPSS version 20.0’s random sample techniques (SPSS, Chicago, IL, USA); 75% of the cases were allocated to the training group. which was used to establish the evaluation system, and 25% of the cases formed the validation group, which was used to test the accuracy of the model prediction.

Conventional US examinations

All of the preoperative breast and axillary US were examined and assessed by the same radiologist (W.SS) with over 20 years of experience of breast US examination. The radiologist performed with Philips EPIQ7 equipped with a L12–5 linear array probe. The target breast mass was measured at maximal-diameter plane to determine US size and classified by using US BI-RADS (26).The radiologist recorded worrisome US findings of ALN and performed routine axillary US after doing whole-breast US. The following are suspicious US features of ALN: nonhilar cortical blood flow on color Doppler images; rounded hypoechoic node; complete or partial effacement of the fatty hilum; diffuse cortical thickening>3 mm; focal cortical bulge>3 mm; eccentric cortical thickening>3 mm; complete or partial replacement of the node with an ill-defined or irregular mass; and microcalcifications in the node (27). As long as at least one questionable US finding was discovered, the skilled radiologist’s evaluation of the axillary US was considered positive. When there were no worrisome ALN results, the axillary US test was considered negative (12).

Clinical characteristics

After SLN biopsy and initial tumor resection, all patients had ALND on anatomic levels I and II with at least 10 nodes removed (4, 28). After undergoing histological analysis, all of the removed ALNs were categorized as either metastatic or nonmetastatic nodes (29). The pathology reports of the patients were reviewed in order to obtain clinical characteristics such as the number of metastatic LNs, the status of human epidermal growth factor receptor 2 (HER2), the estrogen receptor (ER), the progesterone receptor (PR), the KI-67 levels, the histological tumor type, and the LN status (LN with macrometastasis or micrometastasis was considered positive).If 10% or more of the tumor’s cells were immunostained, the tumor was deemed ER or PR positive. At least 3+ hematoxylin-eosin (HE) staining indicates HER2 positivity, while at least 14% of immunostained cells indicate KI-67 positivity. The expression of ER, PR, and HER-2 status were used to categorize the molecular subtype of BC (30). Each patient’s pathologic SLN (pSLN) load was divided into two groups: those with ≥3 metastatic SLNs and those with 1–2 metastatic SLNs.Clinical information from patient medical records, including age and physical examination results, was gathered.

US data processing and analysis

Image segmentation, high-throughput feature extraction, feature selection, predictive model building, model evaluation, validation, and clinical application comprised the flowchart (Figure 1) that depicted the radiomic approach for predicting LN metastasis.

Figure 1
Flowchart of radiomics process: Image Segmentation with grayscale images highlighting regions. Feature Extraction includes graphs showing First Order and Shape Features. Feature Selection involves LASSO Regression and SVM plots. Analysis displays Radiomics Signature and an ROC Curve. Clinical Use includes Nomogram, Calibration Curve, and Decision Curve Analysis.

Figure 1. The workflow of the critical steps. Tumors are segmented manually on Two-dimensional ultrasound image. Radiomic features are extracted to quantify tumor intensity, shape, and texture within the defined tumor contours. The least absolute shrinkage and selection operator (LASSO) method and Support vector machine are jointly applied to feature selection. The radiomics signature is constructed by a linear combination of selected features, and the performance of related radiomics nomogram is assessed by the area under the receiver operating characteristic (ROC) and calibration curves, followed by a decision curve analysis.

Definition of the ROI

Two radiologists, H.ZL, who had over 7 years of experience with breast US examinations, and W.SS, who had 25 years of expertise with breast US, chose the US images and were in charge of defining the ROI. The clinical and pathological details of the patients were concealed from the two radiologists. The ROI should, to the greatest extent feasible, include the whole lesion and was drawn along the BC’s edge on a few representative pictures of each patient. At last, a picture of the entire tumor was acquired.The radiologist (H.ZL) drew the ROIs using ITK-SNAP software (http://www.itksnap.Org/pmwiki//pmwiki.php). Another radiologist (W.SS) drew the ROIs in 100 randomly chosen lesions in order to assess inter-observer variability. A week later, H.ZL. performed the second delineation of ROIs from 100 randomly selected photos using the same process in order to evaluate intraobserver reliability. The intraclass correlation coefficient (ICC) was used to quantify the intraobserver agreement and interobserver consistency of ROI as depicted by two radiologists. ICC > 0.75 is seen as a sign of strong consistency.

Radiomics feature extraction and selection

To extract RF from the US photos, we used an open-source Python tool named “PyRadiomics” (31), and all of the outcomes were compiled into a form. The training cohort underwent a two-stage feature selection process to eliminate redundant and unnecessary information. Features with p < 0.1 were chosen as potentially informative features after Mann-Whitney U tests were conducted.The best features were then chosen using two selection models. The first model, a least absolute shrinkage and selection operator (LASSO) regression model, uses the regulation parameter λ in the training cohort to reduce the coefficients of irrelevant features to zero. To determine the ideal regulation parameter for λ using the 1-SE rule, a second model (the leave-one-out cross-validation (LOOCV) approach) was employed. Therefore, the most representative features were those that had a non-zero coefficient in the model with an ideal regulation parameter for λ. A minimum of 15 observations were needed for each predictor variable in order to construct a suitably stable model. Furthermore, the most valuable predictive features were chosen using a recursive feature elimination (RFE) estimator that gives features weights. Sequential forward selection (SFS) was used when models chose too many features in order to prevent over-fitting. Python software called “scklearn” (Python Foundation for Statistical Computing), Version 2.7, was used to create selection models.

Prediction nomogram construction

Radiomic signature

The support vector machine (SVM) algorithm was used to create the signature using radiomics features chosen using the LASSO approach. The ideal regulation parameter “C,” which was intended to strike a balance between the requirement for diagnostic accuracy and avoiding an unduly complex model in the training cohort, was found using sixfold validation. The RS based on the chosen features was fitted to the training cohort and then further validated in the validation cohort after the ideal value for C was determined.

Clinical model

Univariate analysis were used to evaluate the relationship between LN metastases and traditional clinical risk variables. Multivariate analysis employed forward selection logistic regression (LR) to construct the clinical model in the training cohort based on the clinical characteristics with p < 0.05 in the univariate analyses. The validation set was then used to confirm the clinical model’s performance.

Combined model

The LR approach was used to build the combined model, which included the clinical components in the clinical model and the RF in the best RS. The validation cohort was then used to confirm the combined model’s performance. The performance of the aforementioned models was assessed using the receiver operating characteristic (ROC) curve and AUC. The combined model and the clinical model were compared using the Delong test based on AUC values.

Nomogram establishment

A nomogram for the clinical and combination models was generated in order to give patients and physicians a personalized and user-friendly tool for predicting LN metastases. A calibration curve was used to evaluate how well the LN metastasis projections and the actual results agreed. Additionally, the clinical and combined nomogram’s performance was evaluated using the Hosmer–Lemeshow test.

By measuring the net benefits at various threshold probabilities, decision curve analysis (DCA) was used to assess the RF’s clinical utility.

Statistical analysis

The statistical analysis was conducted using SPSS 22.0 (IBM Corp., Armonk, NY) and R software (version 4.2.1; https://www.r-project.org/). Radiomics analysis was performed using Python 2.7.Continuous variables having a normal distribution were compared using the Student’s t-test. When comparing continuous variables with an uncertain or aberrant distribution, the Mann-Whitney U test was employed. Categorical variables were compared using the χ² test. Statistical significance was defined as P values below 5%.According to the ICC, the two radiologists’ intra-observer agreement and inter-observer consistency in ROI delineation were rated as very good (0.80 to 1.00), good (0.60 to 0.80), fair (0.40 to 0.60), moderate (0.20 to 0.40), or poor (< 0.20).ROC analysis was used to evaluate the signatures’ prediction accuracy. The sensitivity and specificity of each signature were assessed using the area under the ROC curve (AUC). Furthermore, DCA was used to quantify the net benefits when various threshold probabilities were taken into account in order to evaluate the prediction model’s clinical utility.

Results

Baseline characters

938 of the 4,551 women who were recruited in the research received a BC diagnosis following surgery. 671 women were ultimately included following a thorough screening process based on our inclusion and exclusion criteria. 503 people were chosen at random to be in the training group. The patient recruitment process is depicted in Figure 2. 256 had disease-free axilla (N0), 75 had mild metastatic burden of axillary disease (N+(1–2)), and 172 had heavy metastatic burden of axillary disease (N+(≥3)), based on the results of SLND or ALN dissection. Table 1 provides a summary of each patient’s clinicopathologic features. There is no statistically significant difference in the clinical characteristics of the patients in the training and validation sets.It was shown that the radiologists’ judgments of US, US size, and Ki-67 status were independent predictors of BC (P<0.001).An ICC of 0.799 ± 0.022 indicated significant inter-observer consistency in the RF extraction between the two radiologists, whereas an ICC of 0.839 ± 0.019 indicated strong intra-observer reliability.

Figure 2
Flowchart illustrating a patient selection and analysis process for predicting axillary lymph node metastasis (ALNM) in early-stage breast cancer (BC). Starting with 4,551 patients, 3,880 are excluded, leaving 671 for enrollment. A training cohort of 503 patients is used to construct a radiomic signature via the SVM algorithm and LASSO method, and a combined model and nomogram are created. A validation cohort includes 168 patients. Outcomes assist clinicians with axilla treatment decisions: no SLN biopsy or dissection for negative; SLND only for N+ (1-2); ALN dissection for N+ (≥3).

Figure 2. Patient recruitment workflow. In total, 671 out of 4551 patients were included according to the selection criteria. The included patients were examined by conventional US, and had complete clinical information needed for the study.

Table 1
www.frontiersin.org

Table 1. Clinicopathologic characteristics between axillary lymph node positive and negative groups in the training and validation cohorts.

Construction of the radiomics signature and radiomic nomogram

The training cohort’s overall distribution of important radiomic markers between patients with and without ALNM is shown in Figure 3, clearly highlighting the differences between the two groups. The formula for the radiomics score took these characteristics into account.Both the training (P < 0.0001) and testing (P < 0.001) cohorts showed a statistically significant difference in rad score between the LNM group (N+(≥1)) and the non-LNM group (N0). Figure 1 displays the radiomics signatures of patients with and without ALNM.With an AUC of 0.878 in the training cohort and 0.876 in the testing cohort, the RS demonstrated strong predictive efficacy.

Figure 3
Heatmap comparing no lymph node metastasis versus lymph node metastasis. Blue represents low values, and yellow high values, with a gradient scale from negative two to positive two.

Figure 3. Overall distribution of key radiomic features from US image among patients with and without ALN metastasis in the training cohort.

Based on the RS, the radiologists’ assessments of the US, and the Ki-67 status, we created a nomogram (Figure 1). The Hosmer-Lemeshow test was used to examine the nomogram’s calibration curve, and the results showed that it was well calibrated (Figure 1) with non-significant results (p = 0.21 and 0.35 in training and validation cohorts, respectively).

Prediction of ALN status between N0 and N+(≥1).

Using N0 as the negative reference standard, 168 lesions were designated as the test cohort and 503 lesions as the training cohort at random. Table 2 provided an example of the specific attributes. An expert radiologist reviewed the axillary US data, which showed an AUC of 0.765, accuracy of 0.756, sensitivity of 0.745, and specificity of 0.776. For axillary US, the intra-observer agreement was 0.977 and the inter-observer agreement was 0.924 (both P < 0.001, Kappa test).We discovered that the RS outperformed radiologists’ diagnoses on the same US in terms of accuracy, AUC, and sensitivity when comparing the performance of the ALN status prediction between N0 and N+(≥1) between the RS and radiologists’ assessments on US in the training and the validation cohorts. (Table 3).

Table 2
www.frontiersin.org

Table 2. The prediction of ALN status results (N0 v.s. N+(≥1)).

Table 3
www.frontiersin.org

Table 3. Comparison of the performance for ALNM prediction between the RS and radiologists’ judgments on US.

Additionally, we gathered data on radiologists’ assessments of 400 patients’ US and MRI pictures from the Jinshan branch of Fujian Provincial Hospital. We then contrasted the performance of the RS and radiologists’ assessments based on both US and MRI images. The findings showed that the RS had improved accuracy, specificity, and sensitivity. The RS’s clinical value outperformed that of conventional clinical practice. (Table 4).

Table 4
www.frontiersin.org

Table 4. Comparison of the performance for ALNM prediction between ALN RS and radiologists’ judgments on both MRI and US.

While RS based solely on pictures and classification by clinicopathologic data only obtained AUCs of 0.878 and 0.759, respectively, clinical parameter combination RS attained the highest AUC of 0.921 in the training cohort. AUCs for predicting ALNM in the independent test cohort decreased little, but they remained consistent with the training cohort’s performance. The maximum AUC of 0.938 was still attained by the clinical parameter combination RS, surpassing the AUC of other approaches such as classification by clinicopathologic data (AUC:0.741) and RS (AUC:0.875). Additionally, the clinical parameter combined RS’s accuracy, sensitivity, specificity, PPV, and NPV were consistently superior to those of other techniques. Table 2 provided a summary of the comprehensive statistical findings, and Figure 4 displayed the associated ROCs.

Figure 4
Two receiver operating characteristic (ROC) curves comparing diagnostic models. Chart (a) shows four models: RS on images only (blue line), Radiologists’ judgments on US (green dots), Clinical parameter combined RS (orange crosses), and Classification by clinicopathologic data (green squares). Chart (b) shows RS on images only (blue crosses), Radiologists’ judgments on US (green pluses), Clinical parameter combined RS (orange crosses), and Classification by clinicopathologic data (green dots). Both charts plot sensitivity against 100-specificity, with each model demonstrating varying levels of accuracy and area under the curve (AUC).

Figure 4. Comparison of receiver operating characteristic (ROC) curves between different models for predicting disease-free axilla (N0) and any axillary metastasis (N+(≥1)). (A) The ROC of training group. (B) The ROC of validation group.

Prediction of ALN status between N+(1–2) and N+(≥3)

In this experiment, 247 lesions were assigned as the training cohort and 81 as the test cohort, using N+(1–2) as the negative reference standard. In the training cohort, the AUCs for RS based solely on pictures and classification using clinicopathologic data were 0.848 and 0.722, respectively, but the AUC for clinical parameter combination RS was 0.854. The AUC of clinical parameter combination RS increased marginally to 0.873 in the independent test cohort, surpassing both the AUC of categorization by clinicopathologic data (AUC: 0.779) and the AUC of RS (AUC: 0.822). Table 5 provided a summary of the comprehensive statistical findings. The comparisons were shown by the matching ROCs (Figure 5).

Table 5
www.frontiersin.org

Table 5. The prediction of ALN status results (N+(1–2) v.s. N+(≥3)).

Figure 5
Two ROC curve graphs comparing diagnostic tests. Panel (a) shows curves for “RS on images only” in blue, “Classification by clinicopathologic data” in green, and “Clinical parameter combined RS” in orange. Panel (b) displays similar curves with varied performance. Axes are labeled specificity and sensitivity, and the diagonal line indicates random chance.

Figure 5. Comparison of receiver operating characteristic (ROC) curves between different models for predicting low ALN burden (N+(12))and heavy ALN burden (N+(≥3)). (A) The ROC of training group. (B) The ROC of validation group.

Prediction of ALN status among N0, N+(1–2) and N+(≥3)

In order to forecast ALN status, this model was expanded to work with three different task groups. N0, N+(1–2), and N+(≥3) were the three categories into which the clinical endpoints were divided, as previously mentioned. There are 256 (N0), 75 (N+(1–2)), and 172 (N+(≥3)) lesions in each of the three groups.Breast standard US photos served as the foundation for the RS model. The confusion matrix was displayed in Figure 6, and the overall accuracy of distinguishing the three groups was 0.807. While the model did a good job of differentiating the N0 group, it did a worse job in the other two groups.

Figure 6
Confusion matrix displaying predicted vs. true labels. N0: 223 correct, 33 incorrect; N1-2: 49 correct, 26 incorrect; N greater than or equal to 3: 9 correct, 2 incorrect. Color intensity represents value magnitude.

Figure 6. The confusion matrix of predicting ALNM among (N0), [low-load ALNM (N+ (1–2)] and heavy-load ALNM [N+ (≥3)]. ALNM, axillary lymph node metastasis.

Subgroup analysis of the RS for ALNM prediction

Additionally, we performed a subgroup study among patients with varying BI-RADS categories in order to evaluate the RS’s added value to the ALN status. (Table 6). The RS was able to detect ALNM patients in the training and validation cohorts’ subgroups of the BI-RADS 4A category (AUC, 0.87, 0.81, respectively), 4B category (AUC, 0.88, 0.87, respectively), 4C category (AUC, 0.85, 0.91, respectively), and 5 category (AUC, 0.92, 0.92, respectively).Additionally, the AUC value of the RS stayed at 0.86-0.92 in these subgroups when stratified by additional variables such US size, Ki67 expression level, and radiologists’ assessments of US.

Table 6
www.frontiersin.org

Table 6. Subgroup analysis of the RS for ALNM prediction.

RS for clinical decision-making

Decision curve analysis, which measured the net benefits at different threshold probabilities, was used to evaluate the therapeutic value of the RS. The decision curve showed that the use of the RS to predict ALNM offered more benefits than the clinical risk variables at any threshold probability (Figure 1). Because the pathologic ALN state and the clinical ALN status as established by the preoperative US are often different, even senior radiologists can make mistakes in clinical practice. The RS successfully recognized ALNM in patients in both the training and validation groups.

Discussion

When BC patients are first diagnosed, their ALN state is varied, and their treatment options also vary based on their ALN condition. Patients with positive ALN status have been shown to have worse outcomes than those with negative ALN status (32). According to NCCN guidelines, patients with a positive ALN status are deemed high-risk and require adjuvant chemotherapy, which is crucial for clinicians’ decision-making (25). Neoadjuvant treatment is also being evaluated for certain triple-negative BC patients who have a higher tumor burden and a clinically positive ALN status. It should be mentioned that patients are overtreated and medical resources are wasted when the ALN status is miscalculated. Endocrine therapy alone can be used to treat patients with negative ALN status and no additional risk factors, which results in less expensive and more comfortable treatment.For patients with early-stage BC, it is crucial to correctly and unambiguously distinguish the ALN status.

In order to predict the ALN status prior to surgery in patients with clinical T1 or T2 BC, we created and validated an RS mixed clinical parameter technique based on breast conventional US.Compared to any single method, our approach demonstrated noticeably improved diagnostic results in differentiating between patients with a negative axilla (N0) and those with any axillary metastases (N+(≥1)). Motivatingly, our model demonstrated a good ability to distinguish between individuals with a low axillary disease metastatic load (N+(1–2)) and those with a high burden (N+(≥3)). For patients with early-stage BC, this clinical parameter paired with RS may be able to replace SLND as a noninvasive imaging biomarker with a false-negative rate comparable to SLND. With no requirement for SLN biopsy or ALN dissection in patients with N0, SLND only for patients with N+(1-2), and ALN dissection for patients with N+(≥3), our model demonstrated the potential to help breast doctors make decisions regarding the best axillary treatment (Figure 1).Furthermore, in patients with inconsistent clinical and pathologic ALN status, the RS increased the accuracy of ALN status evaluation. Additionally, it correctly identified ALNM in patients with varying BI-RADS categories, US sizes, Ki67 expression levels, and radiologists’ assessments of US. The results showed that the RS is a good tool for ALNM prediction, offering helpful preoperative messages for diagnosis and treatment choices.In individuals with early-stage invasive BC, it can also avoid needless ALND and even SLNB.

Currently, the overall diagnostic effect of preoperative axillary US is low. The axillary US AUC in this study was 0.77, which is in line with findings from earlier research (12, 33, 34).Even senior radiologists can make mistakes in clinical practice, as the pathologic ALN status and the clinical ALN status determined by the preoperative US are frequently not the same. Tumor size, grade, and other tumor-related characteristics have been used to predict LNM in order to minimize the error. The RF obtained from tumor regions for ALNM prediction was investigated in this study because other researchers have demonstrated that the RF derived from tumors with a wealth of biological information may also predict LNM. The “seed and soil” idea states that the synergy between the tumor cells (seed) and the ALN milieu (soil) is what initiates ALNM, and that the LN diagnostic model’s efficacy can be enhanced by the US profiles of the tumor or ALN regions.

Certain lesions’ US features, including tumor size, internal blood supply, lesion boundary, infiltration of subcutaneous adipose tissues, and infiltration of the interstitial adipose tissue breach, have been shown to be independent risk factors for ALNM (35, 36). Furthermore, histological information such as lymphatic vascular invasion, ER, and PR has been found in several research to be a possible risk factor for ALNM (36, 37). Nevertheless, certain histopathological information, such the size of the histological tumor and lymphovascular penetration, could only be assessed following surgical resection and could not inform preoperative choices for axillary surgery. Prior studies have revealed poor concordant rates between core needle biopsy and surgical excision, ranging from 67% to 75%, despite the fact that tumor grade may be determined from core biopsy samples prior to surgery (38, 39).In contrast to the majority of earlier research, all histopathology data included in this study were acquired prior to surgery. Prior to surgery, comprehensive US characteristics of the lesions were gathered. In order to build prediction models that could be fully utilized as non-invasive prediction techniques for determining the ALN status, some preoperative clinical data were kept as candidate factors.

Clinical parameter combined RS was fully developed by combining axillary US findings, clinicopathologic data, and images of breast conventional US. In order to forecast regional LNMs, the Radiomics method was also used in other imaging modalities, such as CT or MRI pictures of several primary cancers, such as bladder or colon cancer, proving that it was a practical approach (4042). By focusing on the clinical parameter combined RS technique, which can enhance image features with additional information and strengthen the model by restricting the features extracted from pictures, our study produced a superior diagnostic performance than the previous one (24). Furthermore, as compared to other imaging modalities, breast and axillary ultrasounds are routinely used to describe breast lesions and ALN status in patients with suspected breast lesions. They are also less expensive and emit no ionizing radiation (12).

Furthermore, this study demonstrated that the RS was better than radiologists’ assessments in identifying ALNM from both MRI and US scans. There are certain ALNs that are invisible or not picked up by US or breast MRIs. As a remedy for the shortcomings in rural hospitals with limited medical resources, RS of US images is particularly helpful in raising the standard of diagnosis and care.

This study has certain shortcomings that need to be addressed. This is a single-center study, to start. Further multicenter data is required to validate this paradigm prior to future clinical implementation. Second, because it is challenging to identify which lesion will induce ALN metastases and should be entered into the model, individuals with bilateral disease and multifocal breast lesions are not included. Therefore, the level of ALN involvement in patients with solitary breast cancer could only be predicted using the current clinical parameter combination DLR model. Additional research is required to develop alternative models for predicting ALN status in patients with bilateral disease and multifocal breast lesions. Third, individuals are categorized according to their risk of developing breast cancer using gene markers such as BRCA1 and BRCA2 (43). Despite being an intriguing attempt, radiogenomics—which focuses on the connection between genomics and imaging phenotypes—is not yet available. Fourth, the image segmentation technique employed in this study relied on manual delineation; to increase the consistency of our model going forward, automatic delineation of ROIs utilizing DL techniques could take its place. Fifth, we will build a model for SLNM and extra-SLNM prediction, respectively, in the future to address the ambiguity and variability in SLN diagnoses that the current study design is unable to handle.

To sum up, this study demonstrated the clinical use of machine learning methods and introduced the RS that combines important radiomic elements of US images with clinicopathologic traits. In early-stage invasive BC, it can easily and practically identify ALNM patients among several BI-RADS categories and other classifications. It may ultimately lead to a preoperative strategy that directs future clinical therapy.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

This study was conducted in accordance with the Declaration of Helsinki and approved by the Fujian Provincial Hospital Review Committee. Written informed consent was obtained from all participants before their inclusion in the study.

Author contributions

Z-LH: Conceptualization, Data curation, Formal Analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. X-RP: Conceptualization, Data curation, Formal Analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. XL: Conceptualization, Data curation, Writing – review & editing. X-TZ: Data curation, Methodology, Writing – review & editing. J-CY: Supervision, Validation, Writing – review & editing. S-SW: Data curation, Formal Analysis, Writing – original draft, Writing – review & editing.

Funding

The author(s) declared that financial support was received for work and/or its publication. Fujian Science and Technology Innovation Joint Fund project climbing project (2023Y9332).

Acknowledgments

The authors are thankful to Fujian Provincial Hospital and Fujian Medical University for their management of our patient database. The authors are thankful to Song-Song Wu for helping critically revise the manuscript for important intellectual content and helping collect data and design the study.

Conflict of interest

The authors declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declared that generative AI was not used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. (2021) 71:209–49. doi: 10.3322/caac.21660

PubMed Abstract | Crossref Full Text | Google Scholar

2. Tirada N, Aujero M, Khorjekar G, Richards S, Chopra J, and Dromi S. Ioffe O: breast cancer tissue markers, genomic profiling, and other prognostic factors: A primer for radiologists. Radiographics. (2018) 38:1902–20. doi: 10.1148/rg.2018180047

PubMed Abstract | Crossref Full Text | Google Scholar

3. Lyman GH, Somerfield MR, Bosserman LD, Perkins CL, Weaver DL, Giuliano AE, et al. Sentinel lymph node biopsy for patients with early-stage breast cancer: american society of clinical oncology clinical practice guideline update. J Clin Oncol. (2017) 35:561–4. doi: 10.1200/JCO.2016.71.0947

PubMed Abstract | Crossref Full Text | Google Scholar

4. Giuliano AE, Ballman KV, McCall L, Beitsch PD, Brennan MB, Kelemen PR, et al. Effect of axillary dissection vs no axillary dissection on 10-year overall survival among women with invasive breast cancer and sentinel node metastasis: The ACOSOG Z0011 (Alliance) Randomized Clinical Trial. JAMA. (2017) 318:918–26. doi: 10.1001/jama.2017.11470

PubMed Abstract | Crossref Full Text | Google Scholar

5. Giuliano AE, Hunt KK, Ballman KV, Beitsch PD, Whitworth PW, Blumencranz PW, et al. Axillary dissection vs no axillary dissection in women with invasive breast cancer and sentinel node metastasis: a randomized clinical trial. JAMA. (2011) 305:569–75. doi: 10.1001/jama.2011.90

PubMed Abstract | Crossref Full Text | Google Scholar

6. Boughey JC, Moriarty JP, Degnim AC, Gregg MS, Egginton JS, Long KH, et al. Cost modeling of preoperative axillary ultrasound and fine-needle aspiration to guide surgery for invasive breast cancer. Ann Surg Oncol. (2010) 17:953–8. doi: 10.1245/s10434-010-0919-1

PubMed Abstract | Crossref Full Text | Google Scholar

7. Langer I, Guller U, Berclaz G, Koechli OR, Schaer G, Fehr MK, et al. Morbidity of sentinel lymph node biopsy (SLN) alone versus SLN and completion axillary lymph node dissection after breast cancer surgery: a prospective Swiss multicenter study on 659 patients. Ann Surg. (2007) 245:452–61. doi: 10.1097/01.sla.0000245472.47748.ec

PubMed Abstract | Crossref Full Text | Google Scholar

8. Giammarile F, Alazraki N, Aarsvold JN, Audisio RA, Glass E, Grant SF, et al. The EANM and SNMMI practice guideline for lymphoscintigraphy and sentinel node localization in breast cancer. Eur J Nucl Med Mol Imaging. (2013) 40:1932–47. doi: 10.1007/s00259-013-2544-2

PubMed Abstract | Crossref Full Text | Google Scholar

9. George E, Roberts S, Cheryl L, Shui AM, Salama L, Daniell K, et al. Quantifying the impact of axillary surgery and nodal irradiation on breast cancer-related lymphedema and local tumor control: long-term results from a prospective screening trial. J Clin Oncol. (2020) 38:3430–8. doi: 10.1200/JCO.20.00459

PubMed Abstract | Crossref Full Text | Google Scholar

10. Chu KU, Turner RR, Hansen NM, Brennan MB, and Giuliano AE. Sentinel node metastasis in patients with breast carcinoma accurately predicts immunohistochemically detectable nonsentinel node metastasis. Ann Surg Oncol. (1999) 6:756–61. doi: 10.1007/s10434-999-0756-2

PubMed Abstract | Crossref Full Text | Google Scholar

11. Kamath VJ, Giuliano R, Dauway EL, Cantor A, Berman C, Ku NN, et al. Characteristics of the sentinel lymph node in breast cancer predict further involvement of higher-echelon nodes in the axilla: a study to evaluate the need for complete axillary lymph node dissection. Arch Surg. (2001) 136:688–92. doi: 10.1001/archsurg.136.6.688

PubMed Abstract | Crossref Full Text | Google Scholar

12. Kim GR, Choi JS, Han BK, Lee JE, Nam SJ, Ko EY, et al. Preoperative axillary US in early-stage breast cancer: potential to prevent unnecessary axillary lymph node dissection. Radiology. (2018) 288:55–63. doi: 10.1148/radiol.2018171987

PubMed Abstract | Crossref Full Text | Google Scholar

13. Cools-Lartigue J and Meterissian S. Accuracy of axillary ultrasound in the diagnosis of nodal metastasis in invasive breast cancer: a review. World J Surg. (2012) 36:46–54. doi: 10.1007/s00268-011-1319-9

PubMed Abstract | Crossref Full Text | Google Scholar

14. Youk JH, Son EJ, Kim JA, and Gweon HM. Pre-operative evaluation of axillary lymph node status in patients with suspected breast cancer using shear wave elastography. Ultrasound Med Biol. (2017) 43:1581–6. doi: 10.1016/j.ultrasmedbio.2017.03.016

PubMed Abstract | Crossref Full Text | Google Scholar

15. Viale G, Zurrida S, Maiorano E, Mazzarol G, Pruneri G, Paganelli G, et al. Predicting the status of axillary sentinel lymph nodes in 4351 patients with invasive breast carcinoma treated in a single institution. Cancer. (2005) 103:492–500. doi: 10.1002/cncr.20809

PubMed Abstract | Crossref Full Text | Google Scholar

16. La Verde N, Biagioli E, Gerardi C, Cordovana A, Casiraghi C, Floriani I, et al. Role of patient and tumor characteristics in sentinel lymph node metastasis in patients with luminal early breast cancer: an observational study. Springerplus. (2016) 5:114. doi: 10.1186/s40064-016-1720-9

PubMed Abstract | Crossref Full Text | Google Scholar

17. Tapia G, Ying V, Di Re A, Stellin A, Cai TY, Warrier S, et al. Predicting non-sentinel lymph node metastasis in Australian breast cancer patients: are the nomograms still useful in the post-Z0011 era? Anz J Surg. (2019) 89:712–7. doi: 10.1111/ans.15173

PubMed Abstract | Crossref Full Text | Google Scholar

18. Gillies RJ and Kinahan PE. & Hricak, H. Radiomics: images are more than pictures, they are data. Radiology. (2016) 278:563–77. doi: 10.1148/radiol.2015151169

PubMed Abstract | Crossref Full Text | Google Scholar

19. Wang K, Lu X, Zhou H, Gao YY, Zheng J, Tong MH, et al. Deep learning Radiomics of shear wave elastography significantly improved diagnostic performance for assessing liver fibrosis in chronic hepatitis B: a prospective multicentre study. Gut. (2019) 68:729–41. doi: 10.1136/gutjnl-2018-316204

PubMed Abstract | Crossref Full Text | Google Scholar

20. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. (2012) 48:441–6. doi: 10.1016/j.ejca.2011.11.036

PubMed Abstract | Crossref Full Text | Google Scholar

21. Huang YQ, Liang CH, He L, Tian J, Liang CS, Chen X, et al. Development and validation of a radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal cancer. J Clin Oncol. (2016) 34:2157–64. doi: 10.1200/JCO.2015.65.9128

PubMed Abstract | Crossref Full Text | Google Scholar

22. Wu S, Zheng J, Li Y, Wu Z, Shi S, Huang M, et al. Development and validation of an MRI-based radiomics signature for the preoperative prediction of lymph node metastasis in bladder cancer. EBioMedicine. (2018) 34:76–84. doi: 10.1016/j.ebiom.2018.07.029

PubMed Abstract | Crossref Full Text | Google Scholar

23. Liang J, Huang X, Hu H, Liu Y, Zhou Q, Cao Q, et al. Predicting Malignancy in thyroid nodules: radiomics score versus 2017 American College of Radiology thyroid imaging, reporting and data system. Thyroid. (2018) 28:1024–33. doi: 10.1089/thy.2017.0525

PubMed Abstract | Crossref Full Text | Google Scholar

24. Xie YT, Zhang JP, Xia Y, Fulham M, and Zhang YN. Fusing texture, shape and deep model-learned information at decision level for automated classification of lung nodules on chest CT. Inf Fusion. (2018) 42:102–10. doi: 10.1016/j.inffus.2017.10.005

Crossref Full Text | Google Scholar

25. William JG, Meena SM, Jame A, Rebecca A, Doreen A, Kimberly H, et al. ANCCN clinical practice guidelines in oncology breast cancer version 3. J Natl Compr Canc Netw. (2022) 20:691–722. doi: 10.6004/jnccn.2022.0030

PubMed Abstract | Crossref Full Text | Google Scholar

26. Berg WA, Cosgrove DO, Doré CJ, Schäfer FKW, Svensson WE, Hooley RJ, et al. Shear-wave elastography improves the specificity of breast US: the BE1 multinational study of 939 masses. Radiology. (2012) 262:435–49. doi: 10.1148/radiol.11110640

PubMed Abstract | Crossref Full Text | Google Scholar

27. Ecanow JS, Abe H, Newstead GM, Ecanow DB, and Jeske JM. Axillary staging of breast cancer: what the radiologist should know. Radiographics. (2013) 33:1589–612. doi: 10.1148/rg.336125060

PubMed Abstract | Crossref Full Text | Google Scholar

28. Giuliano AE, Ballman K, McCall L, Beitsch P, Whitworth PW, Blumencranz P, et al. Locoregional recurrence after sentinel lymph node dissection with or without axillary dissection in patients with sentinel lymph node metastases:long-term follow-up from the American College of Surgeons Oncology Group (Alliance) ACOSOG Z0011 randomized trial. Ann Surg. (2016) 264:413–20. doi: 10.1097/SLA.0000000000001863

PubMed Abstract | Crossref Full Text | Google Scholar

29. Lester SC, Bose S, Chen YY, Connolly JL, de Baca ME, Fitzgibbons PL, et al. Protocol for the examination of specimens from patients with invasive carcinoma of the breast. Arch Pathol Lab Med. (2009) 133:1515–38. doi: 10.5858/133.10.1515

PubMed Abstract | Crossref Full Text | Google Scholar

30. Cancer Genome Atlas Network. Comprehensive molecular portraits of human breast tumours. Nature. (2012) 490:61–70. doi: 10.1038/nature11412

PubMed Abstract | Crossref Full Text | Google Scholar

31. van Griethuysen JJM, Fedorov A, Parmar C, Hosny A, Aucoin N, Narayan V, et al. Computational radiomics system to decode the radiographic phenotype. Cancer Res. (2017) 77:e104–7. doi: 10.1158/0008-5472.CAN-17-0339

PubMed Abstract | Crossref Full Text | Google Scholar

32. Tausch C, Taucher S, Dubsky P, Seifert M, Reitsamer R, Kwasny W, et al. Prognostic value of number of removed lymph nodes, number of involved lymph nodes, and lymph node ratio in 7502 breast cancer patients enrolled onto trials of the Austrian Breast and colorectal cancer study group (ABCSG). Ann Surg Oncol. (2012) 19:1808–17. doi: 10.1245/s10434-011-2189-y

PubMed Abstract | Crossref Full Text | Google Scholar

33. Neal CH, Daly CP, Nees AV, and Helvie MA. Can preoperative axillary US help exclude N2 and N3 metastatic breast cancer? Radiology. (2010) 257:335–41. doi: 10.1148/radiol.10100296

PubMed Abstract | Crossref Full Text | Google Scholar

34. Chen X, Li X, Fan Z, Li J, Xie Y, Wang T, et al. Ultrasound as a replacement for physical examination in clinical staging of axillary lymph nodes in breast cancer patients. Thorac Cancer. (2020) 11:48–54. doi: 10.1111/1759-7714.13224

PubMed Abstract | Crossref Full Text | Google Scholar

35. Guo Q, Dong Z, Zhang L, Ning C, Li Z, Wang D, et al. Ultrasound features of breast cancer for predicting axillary lymph node metastasis. J Ultrasound Med. (2018) 37:1354–3. doi: 10.1002/jum.14469

PubMed Abstract | Crossref Full Text | Google Scholar

36. Luo Y, Zhao C, Gao Y, Xiao M, Li W, Zhang J, et al. Predicting axillary lymph node status with a nomogram based on breast lesion ultrasound features: performance in N1 breast cancer patients. Front Oncol. (2020) 10:581321. doi: 10.3389/fonc.2020.581321

PubMed Abstract | Crossref Full Text | Google Scholar

37. Liu L, Tang C, Li L, Chen P, Tan Y, Hu X, et al. Deep learning radiomics for focal liver lesions diagnosis on long-range contrast-enhanced ultrasound and clinical factors. Quant Imaging Med Surg. (2022) 12:3213–26. doi: 10.21037/qims-21-1004

PubMed Abstract | Crossref Full Text | Google Scholar

38. Sharifi S, Peterson MK, Baum JK, Raza S, and Schnitt SJ. Assessment of pathologic prognostic factors in breast core needle biopsies. Mod Pathol. (1999) 12:941–5.

Google Scholar

39. Harris GC, Denley HE, Pinder SE, Lee AHS, Ellis IO, Elston CW, et al. Correlation of histologic prognostic factors in core biopsies and therapeutic excisions of invasive breast carcinoma. Am J Surg Pathol. (2003) 27:11–5. doi: 10.1097/00000478-200301000-00002

PubMed Abstract | Crossref Full Text | Google Scholar

40. Zhong Y, Yuan M, Zhang T, Zhang YD, and Li H. Radiomics approach to prediction of occult mediastinal lymph node metastasis of lung adenocarcinoma. AJR Am J Roentgenol. (2018) 211:109–13. doi: 10.2214/AJR.17.19074

PubMed Abstract | Crossref Full Text | Google Scholar

41. Dong Y, Feng Q, Yang W, Lu Z, Deng C, Zhang L, et al. Preoperative prediction of sentinel lymph node metastasis in breast cancer based on radiomics of T2-weighted fat-suppression and diffusion-weighted MRI. Eur Radiol. (2018) 28:582–91. doi: 10.1007/s00330-017-5005-7

PubMed Abstract | Crossref Full Text | Google Scholar

42. Wang S, Zhang H, Wang X, Yu J, Zhang Q, Zheng Y, et al. Development and validation of a nomogram for axillary lymph node metastasis risk in breast cancer. J Cancer. (2024) 15:6122–34. doi: 10.7150/jca.100651

PubMed Abstract | Crossref Full Text | Google Scholar

43. Pinker K, Chin J, Melsaether AN, Morris EA, and Moy L. Precision medicine and radiogenomics in breast cancer: new approaches toward diagnosis and treatment. Radiology. (2018) 287:732–47. doi: 10.1148/radiol.2018172171

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: axillary lymphnode metastasis (ALNM), breast cancer (BC), clinical parameters, clinical stages T1–2, machine learning(ML), radiomics

Citation: Hong Z-L, Peng X-R, Liang X, Zeng X-T, Yang J-C and Wu S-S (2026) Ultrasound radiomics predicts preoperative axillary lymph node metastasis status in early-stage breast cancer to support surgical decisions: a machine learning, monocenter study. Front. Oncol. 15:1680160. doi: 10.3389/fonc.2025.1680160

Received: 05 August 2025; Accepted: 10 December 2025; Revised: 09 December 2025;
Published: 16 January 2026.

Edited by:

Sharon R Pine, University of Colorado Anschutz Medical Campus, United States

Reviewed by:

Shijing Wang, China Medical University, China
Kevin Varian Marcevianto, RSUPN Dr. Cipto Mangunkusumo, Indonesia

Copyright © 2026 Hong, Peng, Liang, Zeng, Yang and Wu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Song-Song Wu, d3Vfc29uZ3NvbmdAMTI2LmNvbQ==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.