Your new experience awaits. Try the new design now and help us make it even better

ORIGINAL RESEARCH article

Front. Endocrinol., 29 July 2025

Sec. Thyroid Endocrinology

Volume 16 - 2025 | https://doi.org/10.3389/fendo.2025.1639639

XGBoost-based machine learning model combining clinical and ultrasound data for personalized prediction of thyroid nodule malignancy

Wenhan Li,&#x;Wenhan Li1,2†Yajing Zhou&#x;Yajing Zhou3†Ziyu Luo,Ziyu Luo1,2Miao Tan,Miao Tan1,2Rui YinRui Yin4Jianhui Li,*Jianhui Li1,2*
  • 1Department of Surgical Oncology, Shaanxi Provincial People’s Hospital, Xi’an, Shaanxi, China
  • 2The Third Affiliated Hospital, School of Medicine, Xi’an Jiaotong University, Xi’an, Shaanxi, China
  • 3Department of Thyroid and Breast Surgery, The First Affiliated Hospital of Henan Polytechnic University (The Second People’s Hospital of Jiaozuo City), Jiaozuo, Henan, China
  • 4Department of General Surgery Ward 1, Hospital of Ningshan County, Ankang, Shaanxi, China

Purpose: Thyroid ultrasound is a primary tool for screening thyroid nodules (TNs), but existing risk stratification systems have limitations. Nowadays, machine learning (ML) offers advanced capabilities to handle high-dimensional data and complex patterns. This study aimed to develop an ML model integrating clinical data and ultrasound features to improve personalized prediction of TN malignancy.

Methods: Data from 2,014 patients with TNs (2018.01–2024.01) were retrospectively analyzed, with 1,612 in the training set and 402 in the test set. Features included demographic, ultrasound, and thyroid function indices. Random Forest (RF) and Lasso regression were used for feature selection. Furthermore, six ML models (KNN, Logistic Regression, RF, Classification Tree, SVM, and XGBoost) were developed and validated via 10-fold cross-validation, evaluating performance using area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, calibration curves, and decision curve analysis (DCA).

Results: 17 variables were influential factors for diagnosing TNs. All six models exhibited satisfactory predictive performance, with their accuracy ranging from 0.761 to 0.851 and AUC from 0.755 to 0.928. Among them, the XGBoost model demonstrated the best performance, achieving an AUC of 0.928, accuracy of 0.851, sensitivity of 0.933, and specificity of 0.650. Calibration curves showed strong agreement between predicted and observed malignancy probabilities, and DCA indicated net clinical benefit across a wide risk threshold range (0.2–0.9). Additionally, we have developed the model as a web-based calculator to facilitate its practical application.

Conclusions: The XGBoost model effectively integrates multi-modal data to predict TN malignancy, offering improved accuracy and clinical utility.

1 Introduction

In recent years, the increasing adoption of high-resolution imaging systems has led to a steady annual rise in the diagnosis of thyroid tumors. Thyroid ultrasound is regarded as the optimal screening method for thyroid nodules (TNs) due to its cost-effectiveness, non-radiative property, and high-resolution capability (1, 2). Many ultrasound-based risk stratification systems have been widely applied in clinical practice, which are designed to quantify the probability of malignancy and thereby guide clinicians in subsequent treatment decisions (35). Nonetheless, these systems have notable limitations: they provide broad estimates of malignancy risk (e.g., ACR-TIRADS 4 defines a malignancy risk spanning 2% to 90%) and exhibit inter-system variability when classifying identical TNs—which should not be ignored (6, 7). Previously, we have constructed a nomogram diagnostic model based on the ultrasonic features and patients’ clinical data, which has achieved good predictive performance (area under the receiver operating characteristic curve (AUC): 0.882, Accuracy: 0.815) (8). However, like traditional statistical models, this nomogram relies on strict assumptions (e.g., linearity, low dimensionality), limiting its ability to capture complex feature interactions and high-dimensional data patterns.

As artificial intelligence (AI) advances, machine learning (ML) has emerged as a pivotal technique for analyzing large-scale, high-dimensional datasets, addressing limitations of traditional statistical methods in capturing complex patterns (911). The primary superiority of ML compared to traditional statistical approaches is its capacity to independently discover and learn intricate patterns embedded within datasets, a process that operates without reliance on pre-established model assumptions. Unlike conventional approaches, which rely on pre-established assumptions, ML algorithms independently identify intricate patterns within data through iterative learning and optimization. This process enhances a model’s generalization ability, enabling it to adapt effectively to unseen data and real-world clinical complexities (12). Although radiomics-based TN diagnostic models have been reported, their biological interpretability remains poor (13, 14). Moreover, patient-specific factors such as age, gender, and thyroid function significantly influence diagnostic outcomes. Against this backdrop, we developed an ML model that integrates preoperative clinical data and ultrasonographic features to predict individual TN malignancy probabilities, aiming to facilitate more accurate, non-invasive, and personalized clinical management.

2 Materials and methods

2.1 Data collection

A total of 2,783 consecutive patients with suspicious TNs were enrolled between January 2018 and January 2024. In accordance with the ethical guidelines of the Declaration of Helsinki and the local regulations on medical research involving human subjects, our institutional ethics committee explicitly granted a waiver of informed consent for this study. (Approval No.: 2024-013). All subjects underwent fine-needle aspiration (FNA) and thyroid function tests before any treatment initiation. Ultrasonography was performed by an experienced radiologist (with ≥10 years of thyroid imaging expertise). Patients were excluded if they had a history of thyroid surgery, indeterminate pathological diagnosis, or incomplete clinical data.

2.2 Data pre-processing and feature selection

To enhance predictive performance and mitigate overfitting, we employed random forest (RF) for feature selection to identify key predictors of malignant nodules. The process was as follows: (I) Suppose the RF consists of K trees. Each tree requires a specific number of sample sets for training. These sample sets are randomly generated through the Bagging method. (II) M is used to represent the number of features. For each tree node, m features are randomly chosen, where m should be significantly smaller than M. The optimal splitting approach is computed based on these m features using the Gini coefficient. (III) Through Bagging, we used out-of-bag (OOB) error evaluate the model’s generalization ability. 500 decision trees were constructed, and 3 variables were randomly selected at each decision tree node. Following the above - mentioned method, RF was used to screen variables based on feature importance. In addition, given the outstanding feature selection capabilities of the least absolute shrinkage and selection operator (Lasso), we also performed Lasso regression and compared its results with RF. Lasso uses an L1 norm penalty to shrink irrelevant feature coefficients to zero, with the optimal λ (0.0261) determined via cross-validation at 1 standard error from the minimum error.

2.3 Development of ML-based models

Six ML algorithms—K-nearest neighbor (KNN), logistic regression (LR), random forest (RF), classification tree (CT), support vector machine (SVM), and extreme gradient boosting (XGBoost)—were developed to predict TNs malignancy. These models underwent internal validation via 10-fold cross-validation. Subsequently, their discriminative ability was evaluated using metrics including AUC, accuracy, sensitivity, specificity, F1 score, positive predictive value (PPV), negative predictive value (NPV), DeLong test, and. Furthermore, calibration curves and decision curve analysis (DCA) were applied to assess the models’ clinical utility. Finally, we developed a web-based calculator using the optimal model. This calculator is developed using the R Shiny framework. Its core computational logic is encapsulated into standalone functions, which are rigorously tested through unit tests implemented with the ‘testthat’ package. Additionally, automated interactive testing is performed using ‘shinytest2’ to validate the correct responses to user inputs and outputs. Finally, the application is deployed in a controlled environment to ensure reliable and consistent results.

2.4 Statistical analysis

Statistical analyses were performed using SPSS (Version 26.0) and R software (Version 4.3.2). T-tests and chi-square tests were used to analyze demographic and clinical characteristics of all included patients. R packages—”Boruta”, “caret”, “calibrate”, “class”, “e1071”, “ggplot2”, “glmnet”, “kknn”, “kernlab”, “partykit”, “pROC”, “randomforest”, “reshape2”, “rms”, “rpart”, and “xgboost”—were utilized for model development and validation. Performance metrics including AUC, accuracy, sensitivity, specificity, F1 score, positive predictive value (PPV), and negative predictive value (NPV) were calculated to evaluate and compare models. Finally, discriminative ability was quantified via calibration curves and decision curve analysis (DCA). A two-sided p < 0.05 was considered statistically significant.

3 Results

3.1 Clinical and ultrasound characteristics

In total, 2783 patients with FNA results were included in our study. After data screening, a total of 2,014 cases (mean age 46.89 ± 12.55, 527 male) with complete information were included. Those research subjects were randomly divided into the training set (1612 cases with 468 benign nodules and 1144 malignant nodules) and the test set (402 cases with 117 benign nodule and 285 malignant nodules). The flowchart depicting the study is presented in Figure 1. Table 1 summarized characteristics of those patients. Overall, demographics analysis showed that the proportion of male patients and the BMI index with malignant TNs are significantly higher than those of patients with benign TNs, while the age of onset is significantly lower than that of patients with benign TNs (All p < 0.05). Laboratory test demonstrated that compared with patients with benign TNs, patients with malignant nodules have lower levels of TPO Ab, while their levels of fT4 and fT3 are relatively higher (All p < 0.05). Regarding the ultrasonic characteristics, the results of our analysis showed that there are significant differences in nodule size, margin, extrathyroidal extension, halo, composition, echogenicity, calcification pattern, suspicious LNM, and aspect ratio between benign and malignant thyroid tumors (All p < 0.05).

Figure 1
Flowchart depicting patient selection for a study. It starts with 2783 patients with FNA histological results. 137 patients are excluded due to no further management after undetermined pathology or follicular neoplasm results. This leaves 2646 patients. Another 632 are excluded due to incomplete demographic or clinicopathology data. The remaining 2014 patients have 585 benign nodules and 1429 malignant nodules. These are split into a training dataset of 1612 patients and a test dataset of 402 patients in a 4:1 ratio.

Figure 1. Data processing flowchart.

Table 1
www.frontiersin.org

Table 1. Baseline characteristics of included patients.

3.2 Screening of risk factors for thyroid cancer

The process and results of feature selection by RF are shown in Figure 2A. There are a total of 17 variables that serve as indicators for judging the benignity and malignancy of TNs: margin, extrathyroidal extension, age, aspect ratio, fT3, calcification pattern, nodule size, suspicious LNM, echogenicity, composition, Tg, TPO Ab, halo, fT4, TSH, BMI, Tg Ab. To further validate the outcomes of feature selection via RF, we conducted a Lasso regression analysis, as illustrated in Figures 2B, C. Unsurprisingly, 13 variables exactly overlapped with those confirmed in the RF analysis (margin, extrathyroidal extension, age, aspect ratio, fT3, calcification pattern, nodule size, suspicious LNM, echogenicity, composition, TPO Ab, halo, fT4). Meanwhile, Lasso regression also included variables such as nodule location 1, nodule location 2, vascular distribution pattern, and gender—all of which were excluded in RF—while excluding variables like BMI, TSH, Tg Ab, and Tg that were included in RF. Subsequently, we assessed data multicollinearity using the variance inflation factor (VIF) method. The results indicated that most variables in the model exhibited low levels of multicollinearity, with only composition and echogenicity showing mild collinearity (Supplementary Table S1). The above analysis indicates that the results of RF and Lasso regression were largely consistent. Given that the primary objective of subsequent model construction was to enhance prediction accuracy rather than interpretability, we selected the variables screened by RF to develop the subsequent model.

Figure 2
Panel A shows a box plot of feature importance with various attributes on the x-axis and importance on the y-axis. Higher importance is indicated by a larger value. Panel B is a plot of coefficient value against the logarithm of lambda, showing how coefficients vary with regularization. Two dashed lines indicate lambda.min and lambda.1se. Panel C displays the binomial deviance versus log(lambda) with a focus on error rates and two vertical lines marking selected values of lambda.

Figure 2. Feature selection and ranking by Random Forest and the least absolute shrinkage and selection operator (Lasso) regression analysis. (A) The plot shows boxplot of all the attributes plus minimum, average and maximum shadow score. Variables having boxplot in green are important variables confirmed by Random Forest. If boxplots are in red, it indicates that they were rejected. Yellow color of boxplot indicates they are tentative; (B) Coefficients of all variables are shrunk to 0 via Lasso regression, with stability increasing as lambda increases; (C) The model coefficient of λ value that minimizes the model deviation by cross-validation curve in lasso regression analysis.

3.3 Development and validation of ML models

Using the selected features, we developed six models (CT, KNN, LR, XGBoost, SVM, and RF) to assess the malignant risk of TNs. The ROC curves (Figure 3A) and Table 2 show that in the training set, the six models exhibited good performance, with AUC values ranging from 0.802 (CT) to 0.997 (RF), sensitivity from 0.861 to 0.978, and specificity from 0.596 to 0.966. When applied to the test data, the AUCs of the CT, KNN, RF, and SVM models dropped significantly compared to those in the training data (All p < 0.05 by DeLong test). In contrast, the AUCs of XGBoost (achieving an AUC of 0.928, accuracy of 0.851, sensitivity of 0.933, and specificity of 0.650) and LR remained relatively stable, indicating that these two models maintain strong robustness in internal validation (Figure 3B). Notably, although the AUC of RF in the test set was lower than that in the training set, it still ranked second only to XGBoost and higher than that of LR.

Figure 3
Two ROC curve charts labeled A and B compare different algorithms: CT, KNN, LR, RF, SVM, and XGBoost. Panel A shows training data, with RF having the highest AUC of 0.997. Panel B shows test data, with XGBoost having the highest AUC of 0.928. The curves display sensitivity versus specificity. A diagonal line represents random performance in each graph.

Figure 3. The mixed ROC curves of the six machine learning models for prediction of TNs. (A) The mixed ROC curves in the training cohort; (B) The mixed ROC curves in the test cohort. CT, classification tree; KNN, K-nearest neighbor; LR, logistic regression; RF, random forest; ROC receiver operating characteristic; SVM, support vector machine; XGB, extreme gradient boosting.

Table 2
www.frontiersin.org

Table 2. Predictive performance comparison of the six types of machine learning algorithms in the training and test dataset.

In the calibration assessment, except for the CT model, the calibration plots for both the training (Figures 4A–F) and test (Figures 5A–F) groups showed a high degree of consistency between predicted probabilities and observed outcomes, with deviations consistently within a 10% margin of error. Analysis of the DCA plots in Figures 6A, B revealed that across lower risk probability thresholds, all models yielded a greater net benefit for treatment decision-making compared to the no-intervention strategy. In the 0.2 to 0.9 threshold range, all models except SVM yielded a greater net benefit compared to the reference strategy, thus providing valuable clinical insights to assist clinicians in treatment decision-making.

Figure 4
Six calibration plots labeled A to F, each showing observed probability versus predicted probability. The plots include three lines: “Ideal” (dashed), “Apparent” (pink), and “Bias-corrected” (green). The x-axis represents predicted probability from 0 to 1, and the y-axis represents observed probability from 0 to 1. All plots illustrate model calibration quality.

Figure 4. The calibration curves of the six machine learning models for prediction of TNs in the training cohort. (A) CT, classification tree; (B) KNN, K-nearest neighbor; (C) LR, logistic regression; (D) RF, random forest; (E) SVM, support vector machine; (F) XGBoost, extreme gradient boosting.

Figure 5
Calibration plots (A to F) comparing predicted probabilities with observed probabilities. Each graph shows a dashed black line representing the ideal calibration, a red line for apparent values, and a green line for bias-corrected values. Variations in calibration accuracy are depicted across different graphs, highlighting discrepancies between predicted and observed results.

Figure 5. The calibration curves of the six machine learning models for prediction of TNs in the test cohort. (A) CT, classification tree; (B) KNN, K-nearest neighbor; (C) LR, logistic regression; (D) RF, random forest; (E) SVM, support vector machine; (F) XGBoost, extreme gradient boosting.

Figure 6
Two line graphs labeled A and B compare net benefit versus threshold probability across different models: CT, KNN, LR, RF, SVM, XGBoost, and baselines. Each model is represented by a distinct dashed line, shown in multiple colors. The horizontal axis represents threshold probability ranging from zero to one, while the vertical axis depicts net benefit from zero to one. The graphs show varied model performance at different thresholds.

Figure 6. The mixed decision curves of the six machine learning models for prediction of TNs. (A) The mixed decision curves in the training cohort; (B) The mixed decision curves in the test cohort. CT, classification tree; KNN, K-nearest neighbor; LR, logistic regression; RF, random forest; ROC receiver operating characteristic; SVM, support vector machine; XGB, extreme gradient boosting.

Next, we compared the diagnostic performance of the RF and XGBoost models in TNs. First, the Youden index was used to determine the optimal thresholds for each model (RF: 0.739; XGBoost: 0.79). After integrating all performance metrics, the Friedman test revealed a significant difference in performance between the two models (p = 0.0082), with the XGBoost model exhibiting superior average performance (XGBoost mean = 0.852; RF mean = 0.8052). Furthermore, the robustness of the XGBoost model was assessed by merging the training and validation set data, followed by five-fold cross-validation, which yielded an average AUC of 0.983. Lastly, the calibration and DCA curves were plotted (Supplementary Figure S1). Based on these results, we selected the XGBoost model as the optimal predictive model.

Furthermore, the SHapley Additive exPlanations (SHAP) method was employed to interpret the importance of variables in the model. The results, as shown in Supplementary Figure S2, indicate the following ranking of the top variables: margin, age, TSH, and extrathyroidal extension. Additionally, we compared the predictive performance of our XGBoost model with that of the existing ACR-TIRADS model. Compared with the XGBoost model, the ACR scoring model demonstrated inferior predictive efficacy (validation set: AUC, 0.764; Accuracy, 0.754; Sensitivity, 0.823; Specificity, 0.583; DeLong test, p < 0.01). Finally, to facilitate practical application, we developed a web-based calculator (accessible at https://pres-app.shinyapps.io/XGBoost/), enabling seamless integration of our findings into clinical decision-making.

4 Discussion

In the present study, we collected 22 common clinical indicators obtained from 2014 patients with TNs. Using Lasso regression and RF for variable screening, we found largely consistent results. The observed differences of those two methods can be attributed to Lasso prioritizing linear independent effects versus random forest modeling nonlinear interactions. As a result, 17 key feature variables were identified, which encompassed demographic data, blood biochemical indicators, and ultrasound feature outcomes. We then developed and compared six ML models, all achieving test-set accuracy and AUC above 0.75. RF and XGBoost performed best, with statistical analyses confirming XGBoost as the optimal model. Finally, to facilitate clinical translation, a web-based calculator was developed to generate personalized risk stratification (low/high risk) based on input parameters. For low-risk patients, this tool supports clinical decisions to skip FNA and adopt active surveillance, potentially optimizing patient management workflows.

Current ultrasound-based classification systems allow for more precise malignancy risk stratification in TNs (35). Notably, accumulating evidence shows that integrating clinical, biological, ultrasonic, and cytological features can further enhance prediction accuracy (8, 1517). Nomograms, as visual derivatives of logistic regression, have been widely used in disease prediction to facilitate individualized risk assessment for clinicians. However, these models suffer from inherent limitations: strict assumptions (e.g., linearity, low dimensionality), challenges in capturing complex nonlinear relationships and feature interactions, poor handling of high-dimensional/multi-modal data, and suboptimal generalization ability. In contrast, ML models such as RF and XGBoost offer distinct advantages: strong nonlinear modeling capacity, adaptability to diverse data types, and the ability to automatically identify high-order feature interactions. These strengths enable them to process high-dimensional/unstructured data (e.g., images, text) and enhance generalization and robustness through ensemble strategies—key advantages for complex disease prediction and multimodal data fusion. As an open-source package, XGBoost has demonstrated exceptional and consistent performance in recent ML challenges involving disease prediction and data mining—such as predicting COVID-19 mortality risk (18) and oropharyngeal cancer recurrence risk (19), etc. In this study, the XGBoost model outperformed traditional ACR-TIRADS model in diagnostic efficacy (AUC: 0.928 vs. 0.764), highlighting its potential to enable precise TN risk stratification, reduce unnecessary invasive procedures, and serve as a scalable framework for integrating multimodal data in complex disease prediction.

Genetic testing kits (e.g., ThyroSeq V3, RosettaGXReveal) have been applied in clinical practice and exhibit excellent diagnostic value (20). However, due to their high cost and limited accessibility in many healthcare settings, genetic testing remains underutilized (21, 22). In contrast, this study exclusively incorporated readily available clinical data—achieving diagnostic performance comparable to genetic testing through AI algorithms. Of the 17 selected features, 8 were ultrasonographic characteristics, 3 were clinical demographics, and 6 were thyroid function tests. Most of these features are widely recognized by clinicians as key indicators for TN diagnosis, with nodule margin being the most influential factor, followed by extrathyroidal extension, patient age, and aspect ratio—findings consistent with our prior research (8). Notably, our ML models included thyroid function biomarkers (fT3, fT4, Tg, Tg Ab, TPO Ab, TSH), whose roles in thyroid pathology diagnosis have long been debated. While Tg and Tg Ab are traditionally used to monitor postoperative thyroid cancer recurrence, Yuxin Zheng et al. first demonstrated their utility in differentiating benign and malignant thyroid follicular tumors (23). Additionally, our previous nomogram model integrated TPO Ab as a key serological marker for TN diagnosis, underscoring the clinical value of incorporating these biomarkers into risk stratification frameworks.

In parallel, Krzysztof et al. reported that among patients with cytologically indeterminate TNs, those with malignant histopathology had significantly higher serum TSH levels than benign cases within the same cytological category (24). This finding was reinforced by a meta-analysis by Xiao-Yu Fan et al., which demonstrated that serum TSH measurement exhibits high sensitivity and specificity for diagnosing differentiated thyroid cancer (25). In contrast, Shumei Miao et al. emphasized the role of additional thyroid function parameters (Tg, fT4, fT3) in predicting malignant nodule incidence (25), while other studies argue that standard thyroid function tests lack discriminatory power for nodule malignancy (2628).

These conflicting conclusions likely stem from heterogeneous study populations—for example, cohorts including individuals with metabolic comorbidities (e.g., insulin resistance), which may independently elevate thyroid cancer risk (29, 30). Against this context, the current study’s findings are notable: by leveraging ML, we demonstrated the ability to unravel complex data relationships through large-scale analysis—a capability unmatched by traditional statistical models. Given the ongoing complexities of thyroid disease biomarkers and potential confounding variables, further research is essential to clarify the nuanced interplay between thyroid function and cancer risk.

Several limitations must be considered when interpreting the study’s findings. First, the retrospective design inherently introduces selection bias, as historical data may lack completeness or include unmeasured confounders. Second, ultrasound features were manually extracted by sonographers rather than automatically derived from images, a process that could introduce observer variability and subjective bias during feature interpretation. Finally, training-set AUCs were higher than test-set values, indicating potential overfitting—likely due to model complexity and limited training data generalizability. To address this, we plan multicenter prospective trials to expand the sample size and simplify the model architecture, enhancing validity and external generalizability.

5 Conclusions

In summary, we developed six ML models integrating clinical characteristics, ultrasonographic features, and thyroid function data to predict the malignancy of TNs. Among these, the XGBoost model exhibited superior diagnostic performance, thus leading to the development of a web-based calculator—a practical tool enabling clinicians to assess the probability of TN malignancy. However, the performance of the model should be further investigated using aprospective dataset.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

Ethical approval was not required for the study involving humans in accordance with the local legislation and institutional requirements. Written informed consent to participate in this study was not required from the participants or the participants’ legal guardians/next of kin in accordance with the national legislation and the institutional requirements.

Author contributions

WL: Data curation, Formal Analysis, Software, Writing – original draft. YZ: Data curation, Formal Analysis, Software, Writing – review & editing. ZL: Data curation, Formal Analysis, Visualization, Writing – review & editing. MT: Data curation, Validation, Writing – review & editing. RY: Software, Writing – review & editing. JL: Conceptualization, Funding acquisition, Project administration, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research and/or publication of this article. This research was funded by grants from the Shaanxi Province Health Scientific Research and Innovation Capacity Enhancement Plan (2024TD-01) and the Shaanxi Provincial People’s Hospital (2021LJ‐07).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declare that no Generative AI was used in the creation of this manuscript.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fendo.2025.1639639/full#supplementary-material

References

1. Rago T and Vitti P. Risk stratification of thyroid nodules: from ultrasound features to TIRADS. Cancers. (2022) 14. doi: 10.3390/cancers14030717

PubMed Abstract | Crossref Full Text | Google Scholar

2. Li M, Dal Maso L, and Vaccarella S. Global trends in thyroid cancer incidence and the impact of overdiagnosis. Lancet Diabetes endocrinol. (2020) 8:468–70. doi: 10.1016/S2213-8587(20)30115-7

PubMed Abstract | Crossref Full Text | Google Scholar

3. Russ G, Bonnema SJ, Erdogan MF, Durante C, Ngu R, and Leenhardt L. European thyroid association guidelines for ultrasound Malignancy risk stratification of thyroid nodules in adults: the EU-TIRADS. Eur Thyroid J. (2017) 6:225–37. doi: 10.1159/000478927

PubMed Abstract | Crossref Full Text | Google Scholar

4. Grant EG, Tessler FN, Hoang JK, Langer JE, Beland MD, Berland LL, et al. Thyroid ultrasound reporting lexicon: white paper of the ACR thyroid imaging, reporting and data system (TIRADS) committee. J Am Coll Radiol: JACR. (2015) 12:1272–9. doi: 10.1016/j.jacr.2015.07.011

PubMed Abstract | Crossref Full Text | Google Scholar

5. Zhou J, Yin L, Wei X, Zhang S, Song Y, Luo B, et al. 2020 Chinese guidelines for ultrasound Malignancy risk stratification of thyroid nodules: the C-TIRADS. Endocrine. (2020) 70:256–79. doi: 10.1007/s12020-020-02441-y

PubMed Abstract | Crossref Full Text | Google Scholar

6. Grani G, Lamartina L, Ascoli V, Bosco D, Biffoni M, Giacomelli L, et al. Reducing the number of unnecessary thyroid biopsies while improving diagnostic accuracy: toward the “Right” TIRADS. J Clin Endocrinol Metab. (2019) 104:95–102. doi: 10.1210/jc.2018-01674

PubMed Abstract | Crossref Full Text | Google Scholar

7. Huang BL, Ebner SA, Makkar JS, Bentley-Hibbert S, McConnell RJ, Lee JA, et al. A multidisciplinary head-to-head comparison of American college of radiology thyroid imaging and reporting data system and American thyroid association ultrasound risk stratification systems. oncologist. (2020) 25:398–403. doi: 10.1634/theoncologist.2019-0362

PubMed Abstract | Crossref Full Text | Google Scholar

8. Wang Y, Tang Y, Luo Z, Li J, and Li W. Diagnostic nomogram model for ACR TI-RADS 4 nodules based on clinical, biochemical data and sonographic patterns. Clin endocrinol. (2025) 102:79–90. doi: 10.1111/cen.15130

PubMed Abstract | Crossref Full Text | Google Scholar

9. Ali SZ, Siperstein A, Sadow PM, Golding AC, Kennedy GC, Kloos RT, et al. Extending expressed RNA genomics from surgical decision making for cytologically indeterminate thyroid nodules to targeting therapies for metastatic thyroid cancer. Cancer cytopathol. (2019) 127:362–9. doi: 10.1002/cncy.22132

PubMed Abstract | Crossref Full Text | Google Scholar

10. Swan KZ, Thomas J, Nielsen VE, Jespersen ML, and Bonnema SJ. External validation of AIBx, an artificial intelligence model for risk stratification, in thyroid nodules. Eur Thyroid J. (2022) 11. doi: 10.1530/ETJ-21-0129

PubMed Abstract | Crossref Full Text | Google Scholar

11. Lee CS and Lee AY. Clinical applications of continual learning machine learning. Lancet Digital Health. (2020) 2:e279–e81. doi: 10.1016/S2589-7500(20)30102-3

PubMed Abstract | Crossref Full Text | Google Scholar

12. Weng S, Ding C, Hu D, Chen J, Liu Y, Liu W, et al. Utilizing machine learning for early screening of thyroid nodules: a dual-center cross-sectional study in China. Front endocrinol. (2024) 15:1385167. doi: 10.3389/fendo.2024.1385167

PubMed Abstract | Crossref Full Text | Google Scholar

13. Ko WS and Kim SJ. Prediction of Malignant thyroid nodules using 18 F-FDG PET/CT-based radiomics features in thyroid incidentalomas. Clin Nucl Med. (2023) 48:497–504. doi: 10.1097/RLU.0000000000004637

PubMed Abstract | Crossref Full Text | Google Scholar

14. Yoon J, Lee E, Kang SW, Han K, Park VY, and Kwak JY. Implications of US radiomics signature for predicting Malignancy in thyroid nodules with indeterminate cytology. Eur radiol. (2021) 31:5059–67. doi: 10.1007/s00330-020-07670-3

PubMed Abstract | Crossref Full Text | Google Scholar

15. Yi D, Fan L, Zhu J, Yao J, Peng C, and Xu D. The diagnostic value of a nomogram based on multimodal ultrasonography for thyroid-nodule differentiation: A multicenter study. Front Oncol. (2022) 12:970758. doi: 10.3389/fonc.2022.970758

PubMed Abstract | Crossref Full Text | Google Scholar

16. Haymart MR, Reyes-Gastelum D, Caoili E, Norton EC, and Banerjee M. The relationship between imaging and thyroid cancer diagnosis and survival. oncologist. (2020) 25:765–71. doi: 10.1634/theoncologist.2020-0159

PubMed Abstract | Crossref Full Text | Google Scholar

17. Lu W, Zhang D, Zhang Y, Qian X, Qian C, Wei Y, et al. Ultrasound radiomics nomogram to diagnose sub-centimeter thyroid nodules based on ACR TI-RADS. Cancers. (2022) 14. doi: 10.3390/cancers14194826

PubMed Abstract | Crossref Full Text | Google Scholar

18. Guan X, Zhang B, Fu M, Li M, Yuan X, Zhu Y, et al. Clinical and inflammatory features based machine learning model for fatal risk prediction of hospitalized COVID-19 patients: results from a retrospective cohort study. Ann Med. (2021) 53:257–66. doi: 10.1080/07853890.2020.1868564

PubMed Abstract | Crossref Full Text | Google Scholar

19. Giraud P, Giraud P, Nicolas E, Boisselier P, Alfonsi M, Rives M, et al. Interpretable machine learning model for locoregional relapse prediction in oropharyngeal cancers. Cancers. (2020) 13. doi: 10.3390/cancers13010057

PubMed Abstract | Crossref Full Text | Google Scholar

20. Rossi ED, Pantanowitz L, and Faquin WC. The role of molecular testing for the indeterminate thyroid FNA. Genes. (2019) 10. doi: 10.3390/genes10100736

PubMed Abstract | Crossref Full Text | Google Scholar

21. Stewardson P, Eszlinger M, Wu J, Khalil M, Box A, Perizzolo M, et al. Prospective validation of thyroSPEC molecular testing of indeterminate thyroid nodule cytology following diagnostic pathway optimization. Thyroid. (2023) 33:1423–33. doi: 10.1089/thy.2023.0255

PubMed Abstract | Crossref Full Text | Google Scholar

22. Valderrabano P, Eszlinger M, Stewardson P, and Paschke R. Clinical value of molecular markers as diagnostic and prognostic tools to guide treatment of thyroid cancer. Clin endocrinol. (2023) 98:753–62. doi: 10.1111/cen.14882

PubMed Abstract | Crossref Full Text | Google Scholar

23. Zheng Y, Zhang Y, Lu K, Wang J, Li L, Xu D, et al. Diagnostic value of an interpretable machine learning model based on clinical ultrasound features for follicular thyroid carcinoma. Quantitative Imaging Med surg. (2024) 14:6311–24. doi: 10.21037/qims-24-601

PubMed Abstract | Crossref Full Text | Google Scholar

24. Kaliszewski K, Diakowska D, Rzeszutko M, Nowak Ł, Wojtczak B, Sutkowski K, et al. Assessment of preoperative TSH serum level and thyroid cancer occurrence in patients with AUS/FLUS thyroid nodule diagnosis. Biomedicines. (2022) 10. doi: 10.3390/biomedicines10081916

PubMed Abstract | Crossref Full Text | Google Scholar

25. Fan XY, You W, Chen Y, Nie CC, Wang XL, Lei C, et al. A meta-analysis of the value of serum TSH concentration in the diagnosis of differentiated thyroid cancer in patients with thyroid nodules. Heliyon. (2024) 10:e24391. doi: 10.1016/j.heliyon.2024.e24391

PubMed Abstract | Crossref Full Text | Google Scholar

26. Liang L, Xie J, Li S, Yang J, Chen D, Wang N, et al. Nomogram for the diagnosis of suspected papillary thyroid carcinomas based on sonographic patterns: a retrospective study. Gland surg. (2019) 8:362–9. doi: 10.21037/gs.2019.07.09

PubMed Abstract | Crossref Full Text | Google Scholar

27. Xu S, Ni X, Zhou W, Zhan W, and Zhang H. Development and validation of a novel diagnostic tool for predicting the Malignancy probability of thyroid nodules: A retrospective study based on clinical, B-mode, color doppler and elastographic ultrasonographic characteristics. Front endocrinol. (2022) 13:966572. doi: 10.3389/fendo.2022.966572

PubMed Abstract | Crossref Full Text | Google Scholar

28. Yang Z, Gao X, and Yang L. Predictors and a prediction model for positive fine needle aspiration biopsy in C-TIRADS 4 thyroid nodules. Front endocrinol. (2023) 14:1154984. doi: 10.3389/fendo.2023.1154984

PubMed Abstract | Crossref Full Text | Google Scholar

29. Brenta G and Di Fermo F. Thyroid cancer and insulin resistance. Rev endocrine Metab Disord. (2024) 25:19–34. doi: 10.1007/s11154-023-09849-7

PubMed Abstract | Crossref Full Text | Google Scholar

30. Malaguarnera R, Ledda C, Filippello A, Frasca F, Francavilla VC, Ramaci T, et al. Thyroid cancer and circadian clock disruption. Cancers. (2020) 12. doi: 10.3390/cancers12113109

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: thyroid nodules, machine learning, XGBoost, diagnosis, web-based calculator

Citation: Li W, Zhou Y, Luo Z, Tan M, Yin R and Li J (2025) XGBoost-based machine learning model combining clinical and ultrasound data for personalized prediction of thyroid nodule malignancy. Front. Endocrinol. 16:1639639. doi: 10.3389/fendo.2025.1639639

Received: 04 June 2025; Accepted: 11 July 2025;
Published: 29 July 2025.

Edited by:

Sandeep Kumar Mishra, Yale University, United States

Reviewed by:

Jiayu Ren, Seventh Medical Center of Chinese People’s Liberation Army General Hospital, China
Ednan Ayvaz, Kocaeli University, Türkiye

Copyright © 2025 Li, Zhou, Luo, Tan, Yin and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jianhui Li, RHJfamlhbmh1aWxpQGhvdG1haWwuY29t

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.