Integrating Deep Learning Features from Mammography with SHAP Values for a Machine Learning Model Predicting Over 5-Year Recurrence of Breast Ductal Carcinoma In Situ Post-Lumpectomy

Yupeng Sha¹Yuan Quan¹Yi Du¹Shuqi Yang²Ming Niu¹Xiaoshuan Liang¹Shanshan Sun¹Tong Li¹Shu Gong¹Jiguang Han^1*

• ¹Third Affiliated Hospital of Harbin Medical University, Harbin, China
• ²Fujian Medical University Affiliated First Quanzhou Hospital, Quanzhou, China

Background In women with ductal carcinoma in situ (DCIS) undergoing breast-conserving surgery, recurrence rates within 5 years are 18-25%. Mammograms offer rich tumor data for patient stratification, but current prediction methods focus on clinicopathological factors, overlooking imaging insights. Methods We retrospectively analyzed 140 DCIS patients from Harbin Medical University Cancer Hospital (2011-2020, followed up to 2025). Preoperative digital mammograms and clinicopathological data were collected, with mammographic features extracted using pyradiomics and supervised by a senior radiologist. Feature selection employed 10-fold cross-validated LASSO regression. The dataset was split into training (n=100) and validation (n=40) sets (10:4 ratio). Sixteen machine learning algorithms combining mammographic deep learning features and clinicopathological variables were developed and compared for predicting DCIS recurrence. Model performance was assessed using ROC, sensitivity, specificity, PPV, NPV, and SHAP values for interpretation. Results Of the 140 patients, 34 (24.3%) experienced recurrence. The Gradient Boosting Machine (GBM) algorithm had the best predictive performance, with an AUC of 0.918 (95% CI 0.873-0.963) in the test set. SHAP values indicated that the mammographic signature (MS) was the most significant predictor, followed by Ki-67 index and histological grade. Patients not receiving radiotherapy had higher recurrence rates (41.2%) than those who did (17.9%, p<0.05). Decision curve analysis validated the model's clinical utility across various risk thresholds. Conclusion Our study developed an interpretable GBM model incorporating mammographic and clinical data to predict DCIS recurrence (AUC=0.918). Key predictors were mammographic signature, Ki-67, and tumor grade, offering clinicians a practical tool for personalized postoperative management.