- 1Department of Breast and Thyroid Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
- 2Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
Purpose: Current guidelines provide a recognized yet broad framework for stratifying recurrence risk in differentiated thyroid cancer (DTC) patients. More precise tools are needed for intermediate- and high-risk groups. This study aims to identify recurrence-associated risk factors and develop a machine learning-based predictive model.
Methods: In this retrospective analysis, 2,388 DTC patients were randomly assigned to a training group (1,910 cases) and a validation group (478 cases). Predictive factors were identified using univariate and multivariate analyses. Six machine learning models were trained and validated, with performance evaluated through accuracy, area under the curve, and clinical utility via decision curve analysis.
Results: Independent risk factors for recurrence included intraglandular dissemination, total tumor size, bilateral cervical lymph node involvement, and Hashimoto’s thyroiditis, while normal/elevated TSH and multifocal nodules were protective. The random forest model demonstrated the best performance (training accuracy: 0.801; validation accuracy: 0.808). A random forest-based online calculator was developed to facilitate individualized risk assessment in clinical settings.
Conclusions: The random forest model effectively predicts DTC recurrence, offering a practical tool for individualized risk assessment and aiding clinical decision-making.
1 Introduction
Differentiated thyroid cancer (DTC), primarily comprising papillary and follicular subtypes, is the most common endocrine malignancy, accounting for approximately 90% of thyroid cancer cases (1). Despite its generally favorable prognosis, with a five-year survival rate exceeding 95%, a subset of DTC patients experiences a higher probability of recurrence, which significantly impacts long-term health outcomes (2).
The 2015 American Thyroid Association (ATA) guidelines offer a widely recognized framework for stratifying the risk of recurrence in DTC patients based on factors such as tumor size, histopathological characteristics, and the presence of metastases. Patients are classified into low-, intermediate-, and high-risk groups, with recurrence rates ranging from 3–13% in low-risk, 21–36% in intermediate-risk, and approximately 68% in high-risk patients (3). While these guidelines are broadly effective, their ability to accurately predict individual recurrence risks remains limited, especially for intermediate- and high-risk groups (4). This limitation is primarily due to the limited number of factors included and the equal weighting assigned to each, thereby hindering personalized clinical management.
In recent years, machine learning (ML) has emerged as a powerful tool for analyzing large, complex healthcare datasets (5). Unlike traditional statistical methods, ML algorithms excel at processing high-dimensional data and identifying intricate non-linear relationships, thereby enhancing predictive accuracy in oncology (6). Numerous studies have demonstrated the efficacy of ML models in survival prediction and recurrence monitoring in various cancer types, promoting a more personalized and data-driven approach to patient management (7). However, their application in refining risk stratification for DTC, particularly within intermediate- and high-risk cohorts, remains underexplored.
Addressing this gap, our study aims to develop and validate an ML-based recurrence prediction model tailored for intermediate- and high-risk DTC patients. Utilizing a robust retrospective cohort of 2,388 DTC patients from our center, we trained and validated multiple ML algorithms on demographic, clinical, and pathological features to predict recurrence. Model performance was assessed through metrics such as the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity. By enhancing the precision of recurrence risk assessment, the proposed model facilitates more individualized and effective clinical management for intermediate- and high-risk DTC patients.
2 Materials and methods
2.1 Population and data collection
We retrospectively retrieved clinical records of DTC patients treated between 2009 and 2021 at the Department of Breast and Thyroid Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology (WHUH). The data were used to establish training and validation cohorts. Patients were included if they met the following criteria: (1) pathologically confirmed DTC; (2) underwent total thyroidectomy or lobectomy; and (3) classified as having intermediate or high recurrence risk according to the 2015 ATA guidelines (3). Exclusion criteria were: (1) history of other malignancies and (2) incomplete clinical records. Only patients who underwent reoperation and had DTC recurrence confirmed by pathology was defined as recurrence. Our study adopted pathologically confirmed thyroid carcinoma as the objective criterion for reoperation grouping, primarily due to inherent limitations in postoperative surveillance completeness within retrospective data - specifically, the absence of consecutive ultrasound or thyroglobulin monitoring records in some patients precluded precise definition of a ‘disease-free interval’.
Our database retrospectively collected demographic information, ultrasound (US) findings, biochemical test results, and pathological characteristics of the enrolled patients. Preoperative US identified the size, location, number, echogenicity, calcifications, cervical lymph nodes (LNs), and extrathyroidal extension (ETE) of nodules. Clinically evident metastatic lymph nodes (cN1) were defined by features such as calcifications, loss of fatty hilum, disrupted medullary architecture, and cystic changes on US (3, 8, 9). Bilateral and multifocal lesions, as confirmed by US and intraoperative findings, referred to disease affecting both thyroid lobes and the presence of two or more foci in one or both lobes, respectively. Palpable nodules and LNs were those detectable on preoperative physical examination.
Hashimoto’s thyroiditis (HT) was confirmed by intraoperative frozen sections characterized by diffuse infiltration of lymphocytes and plasma cells, the formation of lymphoid follicles with germinal centers within the gland, fibrosis, and atrophy of thyroid parenchyma (10, 11). Postoperative pathology determined the number, size, distribution, subtype, invasiveness of cancer foci, as well as the number and location of metastatic LNs. The total tumor size was calculated as the sum of the maximum diameters of all excised cancer foci.
2.2 Statistical analysis
Missing values were handled using the Multiple Imputation by Chained Equations (MICE) method, with appropriate imputation algorithms selected based on variable type (12, 13). Predictive mean matching (PMM) was applied for continuous variables, logistic regression (LogReg) for binary variables (14), and polynomial regression (PolyReg) for categorical variables with more than two levels (15). The imputed datasets were used for subsequent analyses.
For continuous variables, the Shapiro-Wilk test was employed to assess their normality. Variables following a normal distribution were analyzed using independent-sample t-tests to evaluate their associations with the outcome variable, while non-normally distributed variables were assessed with the Mann-Whitney U test. Categorical variables were analyzed using the chi-squared test or Fisher’s exact test, depending on cell frequencies in contingency tables.
Multivariate analysis was conducted using stepwise logistic regression based on the Akaike Information Criterion (AIC) to identify the optimal model for evaluating factors associated with the outcome variable. Model fit was assessed using the Hosmer-Lemeshow test, while discriminatory performance was evaluated with Receiver Operating Characteristic (ROC) curves and AUC values.
The final multivariate model included the following predictors: total tumor size, HT, lateral cervical lymph node metastasis (LLNM), intraglandular dissemination, the number of nodules >1 cm identified on preoperative US, palpable nodules, nodule texture, nodule calcification on US, multifocality on US, size of lymph node area with suspicion of metastasis identified preoperatively, preoperative TSH levels, and central LN metastasis (CLNM).
Odds ratios (OR) and their corresponding 95% confidence intervals (CI) were calculated for both categorical and continuous variables using logistic regression. Data analyses were performed using R software (version 4.4.1).
2.3 Development and comparison of ML-based models
The use of the Random Over-Sampling Examples (ROSE) method was necessitated by the severe class imbalance in the dataset, where recurrence cases (minority class) were underrepresented. Traditional models trained on such data often prioritize majority-class accuracy, leading to poor sensitivity for recurrence prediction—a critical shortcoming in clinical settings. ROSE was chosen over alternatives like SMOTE due to its ability to generate synthetic minority samples using bootstrapping and kernel density estimation, introducing controlled noise to simulate realistic feature variations. This approach avoids deterministic interpolation, which risks overfitting by creating artificial linear patterns, while expanding the diversity of the minority class.We used cross-validation to avoid the problem of overfitting.
For model development and validation, the dataset was randomly split into a training cohort (80%) and a validation cohort (20%). Six popular ML models—K-nearest neighbors (KNN), decision trees (DT), support vector machines (SVM), extreme gradient boosting (XGBoost), logistic regression (LR), and random forest (RF)—were trained using significant predictors identified in multivariate analyses.
The models’ performance was evaluated using multidimensional metrics, including accuracy, AUC, sensitivity, specificity, false positive rate (FPR), and false negative rate (FNR). Higher values for accuracy, AUC, sensitivity, and specificity indicate better performance, while lower FPR and FNR are desirable. Decision curve analysis (DCA) was conducted to assess the clinical utility of the models by estimating net benefits at various threshold probabilities. DCA calculates the net benefit of treating patients within a specific threshold probability, balancing true-positive benefits against false-positive harms (16).
To enhance interpretability, feature importance analysis was performed to evaluate the contribution of variables to the models. Feature importance quantifies the impact of individual predictors by measuring the increase in model prediction error after permuting each feature. This approach helps identify variables with the greatest influence on predictive outcomes.
2.4 Model validation and web development
Following the selection of the best-performing model, internal validation was conducted using the reserved validation cohort. The same evaluation metrics employed for model comparison were applied to assess performance, including accuracy, AUC, sensitivity, specificity, FPR, and FNR. A confusion matrix was generated to illustrate discrepancies between actual and predicted outcomes. Calibration curves were constructed to evaluate the agreement between predicted probabilities and observed outcomes, providing insight into the model’s reliability.
To facilitate clinical application, a web-based calculator was developed using the R package Shiny. This tool allows clinicians to input patient-specific data and obtain individualized recurrence risk predictions based on the developed ML model.
3 Results
3.1 Clinical characteristics
A total of 2,388 patients were included in this study, selected from the WHUH database comprising 12,362 individuals who underwent thyroid surgery (Figure 1). Among the cohort, 139 patients (5.82%) experienced recurrence during follow-up, while 2,249 (94.18%) did not. Table 1 summarizes of the demographic and clinicopathological characteristics of the cohort.

Figure 1. Flowchart of patient selection. A total of 12,362 individuals who underwent thyroid surgery were identified from the WHUH database. After applying inclusion and exclusion criteria, 2,388 DTC patients were included in the study. DTC, differentiated thyroid cancer; WHUH, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology.
3.2 Feature selection
Univariate analysis identified significant associations between recurrence and several variables, including maximum tumor size, total tumor size, HT, ETE, LLNM, intraglandular dissemination, US-detected >1cm nodule count, palpable nodules, nodule texture, US-detected calcified nodule, mixed echogenicity nodules on US, US- detected mutifocality, size of lymph node area with suspicion of metastasis on US, fine-needle aspiration (FNA), preoperative TSH levels, and CLNM (P < 0.05) (Figure 2A).

Figure 2. Feature selection. Forest plot of univariate (A) and multivariate (B) analyses identifying factors predicting recurrence. (C) Correlation analysis of selected factors. FNA, Fine-Needle Aspiration; HT, Hashimoto’s thyroiditis; ETE, extrathyroidal extension; LLNM, lateral cervical lymph node metastasis; CLNM, central lymph node metastasis.
In multivariate analysis, independent risk factors for recurrence included intraglandular dissemination (OR = 4.347, 95% CI: 2.894–6.529, P < 0.001), total tumor size (OR = 1.012, 95% CI: 1.000–1.025, P < 0.05), suspicious LNs in the central and bilateral cervical regions on US (OR = 2.919, 95% CI: 1.504–5.668, P < 0.001), US-detected >1cm nodule count (OR = 1.275, 95% CI: 1.004–1.620, P < 0.05), and HT (OR = 9.575, 95% CI: 2.819–32.525, P < 0.001).
Protective factors included soft nodule texture (OR = 0.460, 95% CI: 0.237–0.893, P < 0.05) and medium texture (OR = 0.401, 95% CI: 0.238–0.678, P < 0.001), normal (OR = 0.172, 95% CI: 0.098–0.303, P < 0.001) or elevated preoperative TSH levels (OR = 0.055, 95% CI: 0.012–0.258, P < 0.001), CLNM (OR = 0.463, 95% CI: 0.293–0.730, P < 0.001), and US-detected mutifocality (OR = 0.659, 95% CI: 0.435–0.999, P < 0.05) (Figure 2B; Supplementary Table S1).
The correlation analysis (Figure 2C) demonstrated that none of the features had a significant correlation with one another (<0.3). Considering their clinical relevance, all the above factors were included in the ML model.
3.3 Machine Learning Model Performance
Using the identified features, six ML models—KNN, DT, SVM, XGBoost, LR, and RF—were developed to predict recurrence. These models were evaluated in the training cohort (Figures 3A, B). Supplementary Table S2 detailed the models. All demonstrated satisfactory performance, with RF achieving the highest accuracy (0.801) and the largest AUC.

Figure 3. Machine Learning model performance. (A) Comparison of sensitivity, specificity, accuracy, and AUC across six ML models. (B) ROC curves for each ML model. (C) Decision curve analysis (DCA) illustrating clinical benefit of the models. (D) Feature importance of models built with recurrence for the six models. ROC, receiver operating characteristic; KNN, K-nearest neighbors; DT, decision trees; SVM, support vector machines; XGBoost, extreme gradient boosting; LR, logistic regression; RF, random forest; AUC, area under the curve.
DCA (Figure 3C) demonstrated that RF and KNN provided the greatest net clinical benefit across threshold probabilities. Feature importance analysis (Figure 3D) highlighted the preoperative TSH levels and intraglandular dissemination as the most influential predictors across all models.
3.4 RF model validation
The RF model was validated in the test cohort, where it achieved an accuracy of 0.808, an AUC of 0.893, a sensitivity of 0.776, and a specificity of 0.841. The confusion matrix (Figure 4A) demonstrated the model’s performance, and the ROC curve (Figure 4B) confirmed its strong discriminative ability. The calibration curve (Figure 4C) indicated good agreement between the predicted and observed recurrence probabilities.

Figure 4. Performance of the Random Forest (RF) model on validation cohorts. (A) Confusion matrix for the internal validation cohort. (B) ROC curve for the internal validation cohort. (C) Calibration curve for the internal validation cohort.
3.5 Web-based calculator
An interactive web calculator (https://leekeeee.shinyapps.io/DTC_Reccurence_Prediction_Model/) was developed using the R Shiny package to facilitate clinical application of the RF model. The calculator allows clinicians to input eight variables, including HT, US-detected mutifocality, intraglandular dissemination, regions of lymph node with suspicion of metastasis on US, nodule texture, US-detected >1cm nodule count, total tumor size, and preoperative TSH levels, to estimate recurrence risk (Figure 5). This tool provides an accessible means of supporting personalized management of patients with DTC.

Figure 5. Web-based calculator for recurrence prediction. An interactive tool developed using the R Shiny package allows clinicians to input eight variables to estimate DTC recurrence risk. Accessible at https://leekeeee.shinyapps.io/DTC_Recurrence_Prediction_Model/. DTC, differentiated thyroid cancer; TSH, thyroid-stimulating hormone; LN, lymph node.
4 Discussion
This study, based on a comprehensive retrospective analysis of 2,388 DTC patients, identifies and validates risk and protective factors for recurrence. Guided by two criteria—(1) low multicollinearity (pairwise correlation coefficients <0.3, ensuring statistical independence) and (2) clinical relevance rooted in thyroid pathology evidence—our findings reaffirm established predictors (e.g., intraglandular dissemination) while uncovering novel associations (e.g., CLNM as a protective factor). Despite initial counterintuitive trends, these inclusions minimized redundancy and enhanced model robustness, ultimately enriching mechanistic insights into DTC recurrence.
Among the risk factors, intraglandular dissemination emerged as the most significant, reflecting the heightened invasive and metastatic potential associated with tumor cell spread within thyroid tissues. This finding highlights the necessity of meticulous surgical and pathological evaluations to identify and manage these disseminated foci (17–19). Moreover, the association between HT and recurrence risk supports the hypothesis that chronic inflammation fosters a pro-tumorigenic microenvironment (11, 20–26), likely mediated by inflammatory cytokines and immune cell infiltration (24, 27). Such mechanisms may promote tumor proliferation and invasion, warranting further exploration of inflammatory biomarkers in recurrence prediction. Total tumor size, as an indicator of tumor burden, underscores the increased likelihood of residual disease and metastasis, corroborating prior findings (28–30). Conversely, the appearance of softer or moderately textured nodules was observed to confer a protective effect, which may indicate less aggressive tumor behavior or benign pathological characteristics.
Additionally, imaging features played a pivotal role in recurrence prediction. Parameters such as the number of nodules >1 cm (3, 31, 32) and the size of suspicious metastatic LN regions highlight the relevance of comprehensive preoperative evaluation. These findings underscore the complex relationship between US characteristics and recurrence risk assessment (33, 34), suggesting the potential for US data to enhance the precision of imaging-based scoring systems. Notably, patients with US-detected multifocality were significantly more likely to undergo total thyroidectomy (90.23% vs. 84.49% in unifocal cases, P < 0.001)—an aggressive surgical approach that likely reduced residual disease risk. This clinical decision may have artifactually contributed to the observed “protective” association of multifocality in our model, illustrating how treatment patterns can indirectly shape predictive outcomes.
A particularly novel finding of this study is the protective role of normal or elevated preoperative TSH levels against recurrence. While this observation establishes a relationship between TSH levels and recurrence risk, it is inconsistent with most existing studies (21, 35–37), which often associate higher TSH levels with increased tumor aggressiveness or recurrence likelihood. The discrepancy in findings may be attributed to variations in study design, patient population characteristics, or other factors. Specifically, patients with lower baseline TSH might not have received more aggressive TSH suppression therapy (e.g., high-dose thyroid hormone replacement or targeted pharmacological interventions), potentially reflecting a clinical preference for conservative management in perceived low-risk cohorts rather than an intrinsic biological effect of TSH levels.
Another intriguing result is the identification of CLNM as a protective variable. This may be attributed to the extensive surgical clearance often performed in cases with central LN involvement, thereby reducing the residual tumor burden and potentially lowering recurrence risk. Alternatively, it could reflect a bias introduced by the closer postoperative monitoring and tailored treatment strategies these patients may receive. However, given that this finding contradicts the usual understanding of LN metastasis as a risk factor (38–41), it underscores the need for further investigation through larger, multicentric datasets to confirm its validity and clarify its clinical implications. The biological mechanisms underlying these paradoxical associations remain uncertain, highlighting the imperative for mechanistic investigations to differentiate between treatment-driven biases and authentic disease prognosis pathways.
From a methodological standpoint, the RF model demonstrated superior predictive performance compared to other ML algorithms. With AUC values of 0.875 and 0.893 in the training and validation cohorts, respectively, the RF model proved highly effective in recurrence prediction. Notably, clinical utility analysis further highlighted RF’s superiority across various decision thresholds. Among the features contributing most significantly to the model’s performance, preoperative TSH levels and intraglandular dissemination stood out, reflecting their clinical relevance and potential as actionable targets in recurrence prevention strategies.
Despite its strengths, this study has several limitations. As a single-center retrospective analysis, it is susceptible to selection bias, limiting the generalizability of the findings. Due to retrospective data limitations, detailed post-surgical management variables (e.g., RAI dosage, TSH suppression intensity) were not available for analysis, which may confound the interpretation of recurrence predictors. Additionally, while data resampling techniques were employed to address class imbalance, external validation in multicentric cohorts is essential to confirm these results. Moreover, the absence of molecular biomarkers (e.g., BRAF, TERT) and advanced radiomic data in the current analysis limits the model’s precision and applicability. Future research should integrate these dimensions to enhance predictive accuracy and uncover deeper biological insights into recurrence mechanisms.
Another notable limitation of this study lies in our exclusive inclusion of surgically confirmed recurrence cases, which may introduce potential selection bias. While such rigorous criteria enhance diagnostic specificity, they may systematically exclude subclinical recurrence patients who did not undergo reoperation (e.g., those opting for conservative management or with surgical contraindications), potentially leading to underestimation of true recurrence rates and associated risk factors. Furthermore, reliance on surgical confirmation might obscure the heterogeneous biological characteristics of different recurrence patterns (e.g., local infiltration versus distant metastasis). To address this constraint, we propose that future investigations adopt multimodal diagnostic frameworks integrating dynamic imaging assessments (e.g., contrast-enhanced MRI/PET-CT), liquid biopsy technologies (e.g., ctDNA monitoring), standardized clinical symptom scoring systems, and AI-assisted thyroid nodule diagnosis models, which have demonstrated superior performance in analyzing ultrasound images by identifying subtle morphological features and echogenic patterns often overlooked by human observers (42–44). Such multidimensional validation strategies would not only improve recurrence detection sensitivity but also facilitate the deciphering of molecular evolution patterns in micrometastatic lesions, thereby informing more precise timing for personalized interventions.
In conclusion, this study identifies key recurrence risk factors in DTC using advanced machine learning, enabling personalized clinical strategies. While the ROSE method effectively mitigated class imbalance through synthetic data generation, its use highlights limitations in single-institution datasets with low recurrence rates. To enhance clinical applicability, future work must prioritize larger, multi-institutional cohorts with higher recurrence incidence, reducing reliance on synthetic augmentation and strengthening model generalizability. Cross-institutional collaboration and standardized recurrence monitoring protocols will be critical to validate these models across diverse populations, ensuring equitable integration into global healthcare systems. This approach bridges ML-driven insights with real-world data, advancing precision in DTC management.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving humans were approved by This study was approved by the Ethics Committee of WHUH (No.2020-0340-01). The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required from the participants or the participants’ legal guardians/next of kin in accordance with the national legislation and institutional requirements.
Author contributions
YL: Data curation, Formal analysis, Methodology, Writing – original draft, Writing – review & editing. ZT: Data curation, Methodology, Writing – original draft. AR: Formal analysis, Methodology, Software, Validation, Writing – review & editing. GT: Data curation, Methodology, Writing – review & editing. JZ: Software, Writing – review & editing. YW: Data curation, Formal analysis, Investigation, Resources, Writing – review & editing. JL: Data curation, Formal analysis, Validation, Writing – review & editing. JM: Conceptualization, Project administration, Supervision, Writing – review & editing, Software.
Funding
The author(s) declare that financial support was received for the research and/or publication of this article. This work was supported by grants from the National Natural Science Foundation of China (No. 82270830).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declare that no Generative AI was used in the creation of this manuscript.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fendo.2025.1552479/full#supplementary-material
References
1. Mazzaferri EL and Jhiang SM. Long-term impact of initial surgical and medical therapy on papillary and follicular thyroid cancer. Am J Med. (1994) 97:418–28. doi: 10.1016/0002-9343(94)90321-2
2. Schlumberger M and Leboulleux S. Current practice in patients with differentiated thyroid cancer. Nat Rev Endocrinol. (2021) 17:176–88. doi: 10.1038/s41574-020-00448-z
3. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, et al. 2015 American thyroid association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the american thyroid association guidelines task force on thyroid nodules and differentiated thyroid cancer. Thyroid Off J Am Thyroid Assoc. (2016) 26:1–133. doi: 10.1089/thy.2015.0020
4. Kheng M, Manzella A, Chao JC, Laird AM, and Beninato T. Reoperation rates after initial thyroid lobectomy for patients with thyroid cancer: A national cohort study. Thyroid Off J Am Thyroid Assoc. (2024) 34:1007–16. doi: 10.1089/thy.2024.0128
5. Ngiam KY and Khor IW. Big data and machine learning algorithms for health-care delivery. Lancet Oncol. (2019) 20:e262–73. doi: 10.1016/S1470-2045(19)30149-4
6. Swanson K, Wu E, Zhang A, Alizadeh AA, and Zou J. From patterns to patients: Advances in clinical machine learning for cancer diagnosis, prognosis, and treatment. Cell. (2023) 186:1772–91. doi: 10.1016/j.cell.2023.01.035
7. Tran KA, Kondrashova O, Bradley A, Williams ED, Pearson JV, and Waddell N. Deep learning in cancer diagnosis, prognosis and treatment selection. Genome Med. (2021) 13:152. doi: 10.1186/s13073-021-00968-x
8. Liu Z, Zeng W, Liu C, Wang S, Xiong Y, Guo Y, et al. Diagnostic accuracy of ultrasonographic features for lymph node metastasis in papillary thyroid microcarcinoma: a single-center retrospective study. World J Surg Oncol. (2017) 15:32. doi: 10.1186/s12957-017-1099-2
9. Sohn Y-M, Kwak JY, Kim E-K, Moon HJ, Kim SJ, and Kim MJ. Diagnostic approach for evaluation of lymph node metastasis from thyroid cancer using ultrasound and fine-needle aspiration biopsy. AJR Am J Roentgenol. (2010) 194:38–43. doi: 10.2214/AJR.09.3128
10. Kim EY, Kim WG, Kim WB, Kim TY, Kim JM, Ryu J-S, et al. Coexistence of chronic lymphocytic thyroiditis is associated with lower recurrence rates in patients with papillary thyroid carcinoma. Clin Endocrinol (Oxf). (2009) 71:581–6. doi: 10.1111/j.1365-2265.2009.03537.x
11. Liu Y, Lv H, Zhang S, Shi B, and Sun Y. The impact of coexistent hashimoto’s thyroiditis on central compartment lymph node metastasis in papillary thyroid carcinoma. Front Endocrinol. (2021) 12:772071. doi: 10.3389/fendo.2021.772071
12. Azur MJ, Stuart EA, Frangakis C, and Leaf PJ. Multiple imputation by chained equations: what is it and how does it work? Int J Methods Psychiatr Res. (2011) 20:40–9. doi: 10.1002/mpr.329
13. White IR, Royston P, and Wood AM. Multiple imputation using chained equations: Issues and guidance for practice. Stat Med. (2011) 30:377–99. doi: 10.1002/sim.4067
14. Austin PC and van Buuren S. Logistic regression vs. predictive mean matching for imputing binary covariates. Stat Methods Med Res. (2023) 32:2172–83. doi: 10.1177/09622802231198795
15. Wang Y, Li L, and Dang C. Calibrating classification probabilities with shape-restricted polynomial regression. IEEE Trans Pattern Anal Mach Intell. (2019) 41:1813–27. doi: 10.1109/TPAMI.2019.2895794
16. Vickers AJ and Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak Int J Soc Med Decis Mak. (2006) 26:565–74. doi: 10.1177/0272989X06295361
17. Can N, Tastekin E, Ozyilmaz F, Sezer YA, Guldiken S, Sut N, et al. Histopathological evidence of lymph node metastasis in papillary thyroid carcinoma. Endocr Pathol. (2015) 26:218–28. doi: 10.1007/s12022-015-9382-7
18. Zhang Y, Deng Y, Zhou M, Wu B, and Zhou J. Intraglandular dissemination: a special pathological feature. Front Oncol. (2024) 14:1428274. doi: 10.3389/fonc.2024.1428274
19. Lim H, Devesa SS, Sosa JA, Check D, and Kitahara CM. Trends in thyroid cancer incidence and mortality in the United States, 1974-2013. JAMA. (2017) 317:1338–48. doi: 10.1001/jama.2017.2719
20. Vargas-Uricoechea H. Autoimmune thyroid disease and differentiated thyroid carcinoma: A review of the mechanisms that explain an intriguing and exciting relationship. World J Oncol. (2024) 15:14–27. doi: 10.14740/wjon1728
21. Boi F, Minerba L, Lai ML, Marziani B, Figus B, Spanu F, et al. Both thyroid autoimmunity and increased serum TSH are independent risk factors for Malignancy in patients with thyroid nodules. J Endocrinol Invest. (2013) 36:313–20. doi: 10.3275/8579
22. Feldt-Rasmussen U. Hashimoto’s thyroiditis as a risk factor for thyroid cancer. Curr Opin Endocrinol Diabetes Obes. (2020) 27:364–71. doi: 10.1097/MED.0000000000000570
23. Ferrari SM, Fallahi P, Elia G, Ragusa F, Ruffilli I, Paparo SR, et al. Thyroid autoimmune disorders and cancer. Semin Cancer Biol. (2020) 64:135–46. doi: 10.1016/j.semcancer.2019.05.019
24. Guarino V, Castellone MD, Avilla E, and Melillo RM. Thyroid cancer and inflammation. Mol Cell Endocrinol. (2010) 321:94–102. doi: 10.1016/j.mce.2009.10.003
25. Regua AT, Najjar M, and Lo H-W. RET signaling pathway and RET inhibitors in human cancer. Front Oncol. (2022) 12:932353. doi: 10.3389/fonc.2022.932353
26. Rhoden KJ, Unger K, Salvatore G, Yilmaz Y, Vovk V, Chiappetta G, et al. RET/papillary thyroid cancer rearrangement in nonneoplastic thyrocytes: follicular cells of Hashimoto’s thyroiditis share low-level recombination events with a subset of papillary carcinoma. J Clin Endocrinol Metab. (2006) 91:2414–23. doi: 10.1210/jc.2006-0240
27. Park SK, Ryoo J-H, Kim M-H, Jung JY, Jung Y-S, Kim K-N, et al. Association between eight autoimmune diseases and thyroid cancer: A nationwide cohort study. Thyroid Off J Am Thyroid Assoc. (2024) 34:206–14. doi: 10.1089/thy.2023.0353
28. Liu C, Wang S, Zeng W, Guo Y, Liu Z, and Huang T. Total tumour diameter is superior to unifocal diameter as a predictor of papillary thyroid microcarcinoma prognosis. Sci Rep. (2017) 7:1846. doi: 10.1038/s41598-017-02165-6
29. Feng J-W, Pan H, Wang L, Ye J, Jiang Y, and Qu Z. Total tumor diameter: the neglected value in papillary thyroid microcarcinoma. J Endocrinol Invest. (2020) 43:601–13. doi: 10.1007/s40618-019-01147-x
30. Zhao Q, Ming J, Liu C, Shi L, Xu X, Nie X, et al. Multifocality and total tumor diameter predict central neck lymph node metastases in papillary thyroid microcarcinoma. Ann Surg Oncol. (2013) 20:746–52. doi: 10.1245/s10434-012-2654-2
31. Xue T, Liu C, Liu J-J, Hao Y-H, Shi Y-P, Zhang X-X, et al. Analysis of the relevance of the ultrasonographic features of papillary thyroid carcinoma and cervical lymph node metastasis on conventional and contrast-enhanced ultrasonography. Front Oncol. (2021) 11:794399. doi: 10.3389/fonc.2021.794399
32. Levine RA. History of thyroid ultrasound. Thyroid Off J Am Thyroid Assoc. (2023) 33:894–902. doi: 10.1089/thy.2022.0346
33. Fish SA, Langer JE, and Mandel SJ. Sonographic imaging of thyroid nodules and cervical lymph nodes. Endocrinol Metab Clin North Am. (2008) 37:401–17. doi: 10.1016/j.ecl.2007.12.003
34. Senchenkov A and Staren ED. Ultrasound in head and neck surgery: thyroid, parathyroid, and cervical lymph nodes. Surg Clin North Am. (2004) 84:973–1000. doi: 10.1016/j.suc.2004.04.007
35. Fröhlich E and Wahl R. The forgotten effects of thyrotropin-releasing hormone: Metabolic functions and medical applications. Front Neuroendocrinol. (2019) 52:29–43. doi: 10.1016/j.yfrne.2018.06.006
36. Nieto H and Boelaert K. WOMEN IN CANCER THEMATIC REVIEW: Thyroid-stimulating hormone in thyroid cancer: does it matter? Endocr Relat Cancer. (2016) 23:T109–21. doi: 10.1530/ERC-16-0328
37. Liu Y, Huang Y, Mo G, Zhou T, Hou Q, Shi C, et al. Combined prognostic value of preoperative serum thyrotrophin and thyroid hormone concentration in papillary thyroid cancer. J Clin Lab Anal. (2022) 36:e24503. doi: 10.1002/jcla.24503
38. Kim S-Y, Kwak JY, Kim E-K, Yoon JH, and Moon HJ. Association of preoperative US features and recurrence in patients with classic papillary thyroid carcinoma. Radiology. (2015) 277:574–83. doi: 10.1148/radiol.2015142470
39. Grønlund MP, Jensen JS, Hahn CH, Grønhøj C, and Buchwald Cv. Risk factors for recurrence of follicular thyroid cancer: A systematic review. Thyroid Off J Am Thyroid Assoc. (2021) 31:1523–30. doi: 10.1089/thy.2020.0921
40. Bardet S, Malville E, Rame J-P, Babin E, Samama G, De Raucourt D, et al. Macroscopic lymph-node involvement and neck dissection predict lymph-node recurrence in papillary thyroid carcinoma. Eur J Endocrinol. (2008) 158:551–60. doi: 10.1530/EJE-07-0603
41. Lee YM, Sung TY, Kim WB, Chung KW, Yoon JH, and Hong SJ. Risk factors for recurrence in patients with papillary thyroid carcinoma undergoing modified radical neck dissection. Br J Surg. (2016) 103:1020–5. doi: 10.1002/bjs.10144
42. Yao J, Wang Y, Lei Z, Wang K, Li X, Zhou J, et al. AI-generated content enhanced computer-aided diagnosis model for thyroid nodules: A chatGPT-style assistant. (2024). doi: 10.48550/arXiv.2402.02401
43. Liu Y, Chen C, Wang K, Zhang M, Yan Y, Sui L, et al. The auxiliary diagnosis of thyroid echogenic foci based on a deep learning segmentation model: A two-center study. Eur J Radiol. (2023) 167:111033. doi: 10.1016/j.ejrad.2023.111033
Keywords: differentiated thyroid cancer (DTC), cancer recurrence, predictive models, machine learning, risk factors, random forest
Citation: Li Y, Tang Z, Ren A, Tian G, Zhang J, Wang Y, Liu J and Ming J (2025) A machine learning-based model for predicting recurrence in intermediate- and high-risk differentiated thyroid cancer: insights from a retrospective single-center study of 2388 patients. Front. Endocrinol. 16:1552479. doi: 10.3389/fendo.2025.1552479
Received: 28 December 2024; Accepted: 21 May 2025;
Published: 17 June 2025.
Edited by:
Angeliki Chorti, Aristotle University of Thessaloniki, GreeceReviewed by:
Jincao Yao, University of Chinese Academy of Sciences, ChinaGeorgios Markantes, University of Patras, Patras, Greece
Selen Soylu, Istanbul University-Cerrahpasa, Türkiye
Copyright © 2025 Li, Tang, Ren, Tian, Zhang, Wang, Liu and Ming. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jie Ming, bWluZ2ppZXdoQDEyNi5jb20=
†These authors have contributed equally to this work