ORIGINAL RESEARCH article

Front. Oncol., 15 May 2025

Sec. Gastrointestinal Cancers: Colorectal Cancer

Volume 15 - 2025 | https://doi.org/10.3389/fonc.2025.1508455

Early prediction of colorectal adenoma risk: leveraging large-language model for clinical electronic medical record data

Xiaoyu YangXiaoyu Yang1Jinjian Xu*Jinjian Xu1*Hong JiHong Ji1Jun LiJun Li2Bingqing YangBingqing Yang3Liye WangLiye Wang3
  • 1Information Management and Big Data Center, Peking University Third Hospital, Beijing, China
  • 2Department of Gastroenterology, Peking University Third Hospital, Beijing, China
  • 3Goodwill Hessian Health Technology Co. Ltd, Beijing, China

Objective: To develop a non-invasive, radiation-free model for early colorectal adenoma prediction using clinical electronic medical record (EMR) data, addressing limitations in current diagnostic approaches for large-scale screening.

Design: Retrospective analysis utilized 92,681 cases with EMR, spanning from 2012 to 2022, as the training cohort. Testing was performed on an independent test cohort of 19,265 cases from 2023. Several classical machine learning algorithms were applied in combination with the BGE-M3 large-language model (LLM) for enhanced semantic feature extraction. Area under the receiver operating characteristic curve (AUC) is the major metric for evaluating model performance. The Shapley additive explanations (SHAP) method was employed to identify the most influential risk factors.

Results: XGBoost algorithm, integrated with BGE-M3, demonstrated superior performance (AUC = 0.9847) in the validation cohort. Notably, when applied to the independent test cohort, XGBoost maintained its strong predictive ability with an AUC of 0.9839 and an average advance prediction time of 6.88 hours, underscoring the effectiveness of the BGE-M3 model. The SHAP analysis further identified 16 high-impact risk factors, highlighting the interplay of genetic, lifestyle, and environmental influences on colorectal adenoma risk.

Conclusion: This study developed a robust machine learning-based model for colorectal adenoma risk prediction, leveraging clinical EMR and LLM. The proposed model demonstrates high predictive accuracy and has the potential to enhance early detection, making it well-suited for large-scale screening programs. By facilitating early identification of individuals at risk, this approach may contribute to reducing the incidence and mortality associated with colorectal cancer.

1 Introduction

Colorectal adenoma, the primary precancerous lesion in colorectal cancer (1), poses a significant health concern. It is estimated that 70-90% of colorectal cancers originate from these adenomas, underscoring the critical importance of early risk prediction and screening (24). However, current screening methods, including fecal examination, endoscopy, and CT colonography (5, 6), have limitations that hinder their widespread application. Fecal examination, while preferred for its comfort and safety, has limited specificity. Endoscopy, the gold standard, is invasive, technically demanding, and requires bowel preparation, limiting its application for large-scale screening (7). CT colonography, a non-invasive and highly sensitive alternative, necessitates specialized equipment, technical expertise, and rigorous patient preparation, along with radiation exposure (8).

To address these challenges, we proposed an innovative approach that leverages the power of machine learning and electronic medical record (EMR) data for accurate and widespread colorectal adenoma prediction. Machine learning techniques have shown promising results in identifying adenomas from colonoscopy or pathology images (911). Additionally, researchers have identified significant risk factors, such as smoking, alcohol consumption, and obesity-related indicators, through various analyses (1214). However, existing studies lack individualized risk classification, limiting their clinical application.

EMR data presents a valuable and suitable alternative for large-scale screening, and researchers have developed risk prediction models to guide high-risk patients towards colonoscopy, optimizing resource allocation (1520). Nevertheless, previous studies have been limited by small sample sizes and insufficient EMR data. Traditional One-Hot coding of EMR data fails to capture semantic information and is sensitive to missing data. In contrast, recently popular pre-trained large language models (LLMs) have emerged as a promising solution, demonstrating superior performance in extracting and encoding semantic information for disease diagnosis and prognosis (2123).

Building upon these advancements, this study leverages comprehensive EMR data, including medical history, symptoms, tests, and examinations. By utilizing a semantic vector model based on the BGE-M3 coding approach, we aim to improve data comprehension, reduce sparsity, and improve generalization. This study aims to develop a robust risk prediction model for colorectal adenoma, providing real-time risk assessments to support informed clinical decision-making and ultimately improve patient outcomes.

2 Materials and methods

2.1 Dataset

This retrospective study utilized EMR data from January 2012 to December 2023 at a high-performing hospital with an annual outpatient volume of approximately 4.5 million. The study was approved by the Medical Science Research Ethics Committee of **** hospital, and the requirement for patient informed consent was waived due to the retrospective nature of this study. The data collection process yielded a total of 2,951 positive and 108,995 negative samples. Figure 1 provides a detailed overview of the enrollment and data collection process.

Figure 1
www.frontiersin.org

Figure 1. Patient enrollment for colorectal adenoma.

2.1.1 Data inclusion and exclusion

Inclusion criteria for the study were as follows: (1) patients aged 18 years or older at their initial visit; (2) pathology reports confirming the presence of colorectal adenoma; (3) visits to the gastroenterology department with relevant diagnoses or pathology reports excluding colorectal adenoma.

Exclusion criteria were defined as follows: (1) patients with a history of colectomy or partial colectomy; (2) medical histories or current complaints involving conditions that could influence inflammation assessment, including but not limited to colorectal adenoma, colorectal cancer, colon cancer, cecum cancer, rectal cancer, rectosigmoid junction cancer, inflammatory bowel disease, diverticulitis, cirrhosis of the liver, abnormal liver function, acute pancreatitis, pancreatic cancer, neuroendocrine tumor, capillary dilatation, lipoma, jaundice.

2.1.2 Data splitting

The data from 2012 to 2022 was divided into the training cohort, consisting of a total of 2,469 positive samples and 90,212 negative samples. More recent data from 2023 was reserved as an independent test cohort, comprising 482 positive samples and 18,783 negative samples. The training cohort was utilized for model development and hyperparameter tuning using five-fold cross-validation, and the independent test cohort served to evaluate the generalizability of the developed model.

2.1.3 EMR feature inclusion

Clinical EMR data (Table 1) comprises both structured and unstructured formats. Structured data, directly extracted from the EMR, included demographic information such as gender, age and laboratory results. Laboratory items analyzed in this study encompassed glycated hemoglobin, total cholesterol, fecal occult blood test, complete blood count, biochemical profile, and tumor markers.

Table 1
www.frontiersin.org

Table 1. Sources and content of feature extraction.

Unstructured data, such as the chief complaint, history of present illness (HPI), and family history, required initial information extraction followed by content extraction to transform them into a structured format. In this paper, a multilevel entity-relationship extraction scheme was implemented to process free text data in EMR, consisting of two key steps: (1) we distinguished medical record instruments and chapters by “instrument category prediction” and “chapter prediction”; (2) we applied a Bidirectional Long Short-Term Memory-Conditional Random Field (BiLSTM-CRF) network combined with rule matching – a method that has been demonstrated as an effective approach for extracting information from unstructured data (24, 25) - to extract the information from the Chinese clinical report. These steps guarantee the extraction of clinically relevant information essential for subsequent predictive modeling. For this study, we utilized the earliest available laboratory and examination data prior to the diagnosis of colorectal adenoma. Meanwhile, we excluded the pathological examination items to prevent potential data leakage during the model development process.

2.1.4 Entity unification

To ensure feature consistency, entity unification was implemented on the raw clinical records, with data quality control assured by semantic validation protocols. To avoid the various descriptions of entities such as signs, symptoms, and disease names among physicians, we utilized the British Medical Journal (BMJ) Best Practice knowledge base (26). This resource unifies different aliases of each entity to a uniform name. Subsequently, these diverse descriptions are mapped to their standardized entities, effectively reducing data fragmentation caused by alias discrepancies. For example, terms like “dry stools” and “increased bowel movements” were unified under the category of “abnormal stools”. Additionally, features with a missing rate of ≥99% were excluded to mitigate the risks of model overfitting and to improve the stability and accuracy of the model.

The examination items within unstructured data predominantly comprise imaging studies, whose non-textual characteristics hinder structured dataset conversion. Therefore, this study restricted analysis to text-based components of examination reports, specifically the “examination observation” and “examination conclusion”. In order to ensure the objectivity of the results of the study, exclusion criteria were established: (1) Examination items directly related to the pathological diagnosis of colorectal adenomas (including but not limited to colonoscopy, pathological analysis, and tissue biopsy) were excluded; (2) Examination items retained were further excluded from the records whose text descriptions explicitly contained diagnostic information of colorectal adenomas.

2.2 Prediction model development

The development of the colorectal adenoma risk prediction model is depicted in Figure 2. This process begins with the collection of comprehensive EMR data, including basic patient information, chief complaints, current and past medical histories, examination reports, and laboratory test results. During the feature extraction stage, we employed the BGE-M3 semantic vector encoding and traditional one-hot vector encoding for comparison.

Figure 2
www.frontiersin.org

Figure 2. Process of developing the risk prediction model for colorectal adenoma.

For model training, several widely used machine learning models for binary classification tasks are employed, including logistic regression, random forest, support vector machine (SVM), LightGBM, XGBoost, and feed-forward neural networks. To optimize model performance, we utilized cross-validation and grid search on the training and validation cohort to fine-tune model parameters and achieve optimal predictive accuracy.

2.3 Feature extraction

2.3.1 One-hot vector coding

One-hot encoding is a traditional technique used to represent categorical features in machine learning algorithms. Each category is converted into a binary feature for model integration. For continuous features, outlier handling methods are applied depend on the distribution of the data. Normal distribution data is evaluated using the 3σ criterion, while non-normal distribution data uses the interquartile range (IQR) criterion for outlier identification. The detected outliers are removed, and missing values are imputed with the mean to maintain data integrity. Feature scaling is then performed by dividing each value by the maximum absolute value in the feature, standardizing the feature values within the range of (–1, 1). This scaling benefits to model stability.

However, one-hot encoding can generate high-dimensional feature vectors, especially with our large EMR data, and not all features are pertinent to the prediction task. To address this, feature selection is crucial to reducing dimensionality, enhancing model efficiency, and mitigating overfitting. Random Forest, a robust machine learning algorithm, provides an effective feature selection method. It measures the importance of each feature by assessing its contribution to the reduction of Gini impurity in decision tree nodes. Features with higher importance scores are retained, streamlining data dimensionality and boosting computational efficiency.

2.3.2 BGE-M3 vector coding

The Smart Source General Semantic Vector Model BGE-M3 (BAAI General Embedding M3), introduced in 2024 (27), offers significant advantages over traditional One-Hot Encoding, particularly for analyzing clinical EMR data with diverse semantic information. BGE-M3 simplifies preprocessing and effectively captures insightful semantic features, enhancing the understanding of complex clinical report, which is crucial in clinical diagnosis. It integrates semantic, syntactic, and knowledge graph data to provide detailed representation of sentence semantics. This comprehensive approach improves the accuracy and richness of sentence vectors, addressing the challenge of using complex clinical report.

BGE-M3 incorporates advanced attention mechanisms and context modeling techniques, dynamically adjusting word importance and capturing contextual information. These features improve the precision of feature vector for representing sentences, making BGE-M3 effective for extracting meaningful insights from clinical report. Additionally, BGE-M3’s optimized structure and parameter tuning ensure high computational efficiency and scalability, facilitating rapid and accurate sentence representations for handling large-scale clinical datasets.

2.4 Model training

Colorectal adenoma risk prediction involves a binary classification task. This study evaluates the effectiveness of several machine learning algorithms, including the feedforward neural network (FNN) (28), Light Gradient Boosting Machine (LightGBM) (29), Logistic Regression (LR) (30), Random Forest (RF) (31), Support Vector Machine (SVM) (32), and eXtreme Gradient Boosting (XGBoost) (33). Further details on the algorithms and their implementations can be found in the Section 2.4 of the Supplementary Material.

Optimal model parameters were selected through a systematic process involving grid search and five-fold cross-validation. This method entailed exploring predefined parameter ranges and randomly combining parameters across various model algorithms. Detailed descriptions of the optimal parameters and their respective ranges throughout the tuning process are provided in Supplementary Table S1 of the Supplementary Material.

2.5 Model evaluation

2.5.1 Evaluation metrics

The performance of the risk prediction model was evaluated using multiple metrics in both the validation cohort and the independent test cohort, including Sensitivity/Recall, Specificity, Positive Predictive Value (PPV), Negative Predictive Value (NPV), F1-Score, AUC, and Receiver Operating Characteristic (ROC) analysis. Detailed descriptions of the evaluation metrics are provided in Supplementary Table S2 of the Supplementary Material.

2.5.2 Evaluation on the independent test cohort

We evaluated the model’s ability to predict colorectal adenoma in advance on the independent test cohort. Starting from patient admission, the model predicted risk based on changes in EMR data, including health status or new laboratory test results. Predictions continued until a high risk of colorectal adenoma was indicated, and subsequent pathology diagnosis was used to verify the accuracy of the predictions. Successful predictions were defined as those matching the actual outcomes. To quantify predictive lead time, we computed the average interval between the model’s high-risk prediction and the actual diagnosis for successful predictions.

We employed Kaplan-Meier analysis to demonstrate the change in model-predicted outcomes and clinical actual diagnoses with increasing time of admission. The horizontal coordinate is the time of admission, the vertical coordinate survival rate indicates the ratio of positive samples remained incorrectly diagnosed, which means 0% indicates that all positive samples were correctly diagnosed. This method provides a graphical representation of predictive accuracy and effectiveness over time.

2.6 Model interpretation

We utilized the SHAP (Shapley Additive exPlanations) method to interpret the relationship between features and model predictions (34). SHAP employs an additive feature attribution approach to calculate values for each feature, quantifying both the magnitude and direction of their impact on model predictions. The absolute value of each feature’s SHAP score indicates the degree of influence on the model’s predictions. Positive SHAP values suggest support for a higher risk prediction of colorectal adenoma, while negative values indicate the opposite. This method provides insight into the model’s decision-making process and offers opportunities for further model optimization.

2.7 Statistical analysis

In this study, we employed TableOne, a powerful R language package, for comprehensive statistical analysis (35). Specific statistical methods were selected based on the distributional properties of the variables. For normally distributed continuous variables, quantitative results are presented as mean ± standard deviation (SD), with significance assessed using the t-test. For non-normally distributed continuous variables, the data was reported as median (Q1, Q3), and differences between groups were evaluated using the Mann-Whitney U test, a non-parametric alternative. Categorical variables were analyzed using the chi-square test to determine significant differences between categorical levels.

2.8 Patient and public involvement

This study was a retrospective analysis, thus patients were not involved. We have provided relevant content following the TRIPOD reporting guidelines (36).

3 Results

3.1 Data distribution of different departments

This study examines the distribution of colorectal adenoma patients across various departments at their initial consultation. Figure 3 illustrates the distribution of the top 8 departments based on patient numbers. Notably, the gastroenterology department exhibits a high prevalence, with approximately 1,200 cases of colorectal adenoma, indicating a significantly higher incidence compared to other departments. Interestingly, the general surgery department also demonstrates a substantial proportion of cases, suggesting that colorectal adenoma is prevalent among patients seeking care in non-gastroenterology departments. This observation underscores the relevance and potential impact of the risk prediction model proposed in this study. By extending beyond gastroenterology, our model aims to facilitate screening and preventive strategies across multiple departments. Early identification of colorectal adenoma risks can contribute to reducing the incidence of colorectal cancer and enhancing comprehensive patient care and safety.

Figure 3
www.frontiersin.org

Figure 3. Distribution of patients with colorectal adenoma across departments.

3.2 Clinical characteristics analysis

Statistical analysis was performed on the clinical characteristics of patients enrolled between 2012 and 2022, as shown in Table 2. Since there are so many characteristics in this study, we only present those that are statistically different and clinically important. Within the present characteristics, Cholesterol, Triglycerides and CA19–9 did not show statistical differences between groups.

Table 2
www.frontiersin.org

Table 2. Statistical analysis of clinical characteristics.

3.3 Model performance evaluation

As shown in Tables 3, 4, the BGE-M3 vectors achieved significant improvement compared to One-Hot vectors. Within the models using BGE-M3 vectors, XGBoost obtained the best performance in terms of AUC. As shown in Figure 4, the FNN obtain reasonable performance by using BGE-M3. These results demonstrated that the BGE-M3 vectors can show better performance on EMR data encoding than traditional One-Hot vectors.

Table 3
www.frontiersin.org

Table 3. Performance of different models using one-hot vectors on the test set of training cohort.

Table 4
www.frontiersin.org

Table 4. Performance of different models using BGE-M3 vectors on the test set of training cohort.

Figure 4
www.frontiersin.org

Figure 4. Radar plot and ROC curve of different models’ performance on the test set of the training cohort.

3.4 Independent test cohort validation

To assess the model’s generalization ability, this study employed 2023 data as an independent test cohort for validating the BGE-M3-based XGBoost model, which achieved the highest AUC on test set. The experimental results are summarized in Table 5, these results verified the robust generalization capability of our developed model.

Table 5
www.frontiersin.org

Table 5. Results on the independent test cohort of the XGBoost model with the BGE-M3 vectors.

This study evaluated the model’s ability to predict colorectal adenomas in advance using 431 hospitalized patients out of 482 positive samples from the independent test cohort. As shown in Table 6, the model achieved a prediction accuracy of 0.9141 for positive samples, with an average advance prediction time of 6.88 hours. Meanwhile, as shown in Figure 5, Kaplan-Meier analysis demonstrated that our proposed model predicted the high risk in advances (p<0.05) by an average of 6.88 hours compared to the actual clinical diagnosis time and maintained a reasonable accuracy.

Table 6
www.frontiersin.org

Table 6. Average model prediction lead time.

Figure 5
www.frontiersin.org

Figure 5. Kaplan-Meier analysis of the developed model and clinical actual diagnosis for evaluating the prediction time in advance.

3.5 Assessment of model feature importance

We utilized the SHAP method to interpret features’ contribution in the XGBoost model based on one-hot vectors. Figure 6 illustrates the top 16 features ranked by SHAP importance, indicating their respective influence on model predictions. The vertical color gradient in Figure 6 represents the magnitude of each feature’s SHAP value, with warmer colors indicating higher values and cooler colors indicating lower values. The horizontal SHAP values indicate whether each feature positively or negatively impacts predictions. Positive SHAP values support colorectal adenoma predictions, while negative values suggest non-colorectal adenoma predictions. Integrating the horizontal SHAP values with the vertical gradient provides a comprehensive understanding of the direction and strength of each feature’s influence on prediction outcomes.

Figure 6
www.frontiersin.org

Figure 6. Contribution and directional influence of top 16 features on XGBoost Model predictions using SHAP analysis.

Figure 6 highlights the critical role of laboratory items in diagnosing colorectal adenoma, with eight out of the top 16 features belonging to this category. Notably, Lipoprotein A emerges as the most influential predictive feature. Additionally, symptomatic features prominently appear among the top 16, underscoring the importance of unstructured clinical EMR data in predictive modeling.

4 Discussion

This study successfully developed a highly accurate and generalizable risk prediction model for colorectal adenoma leveraging the strengths of LLM and comprehensive EMR data, providing a robust scientific foundation for early detection and intervention strategies. Furthermore, this study analyzed extensive clinical EMR of patients with colorectal adenoma, revealing distinct characteristics compared to non-colorectal adenoma patients.

Retrospective statistical analysis (Table 2) of the dataset identified typical clinical features associated with colorectal adenoma, including higher average age and male predominance, consistent with prior research (3739). Symptoms such as blood in stool, abdominal pain, and stool abnormalities were prevalent among colorectal adenoma patients. Interestingly, nausea, less commonly associated with colorectal adenoma, exhibited significant inter-group differences, possibly reflecting variations in data collection across healthcare providers (40). Comorbidity analysis revealed significant associations with colon cancer, colon polyps, hypertension, and family history of diabetes mellitus, aligning with existing literature (4144). The analysis also highlighted variations in biomarkers including hemoglobin, fecal occult blood test, lipoprotein A, serum uric acid, creatinine, glycated hemoglobin, and carcinoembryonic antigen (CEA) (4549), underscoring their relevance in predicting colorectal adenoma risk.

The comparison (Table 3, 4) between BGE-M3 and one-hot vector coding demonstrated the superior performance of BGE-M3 dense representation, dimensional reduction, semantic information capture, context sensitivity, and adaptive learning. This enhanced the model’s ability to handle complex clinical EMR data, resulting in improved performance across various machine learning algorithms. XGBoost emerged as the top performer, demonstrating robust sensitivity and AUC values of 0.9251, 0.9413, and 0.9847, respectively, leveraging advantages in boosting framework, feature engineering, regularization, pruning, and parallel computing (33).

The model’s generalizability was validated on an independent test cohort (Table 5), utilizing the BGE-M3 semantic vector model and diverse data sources from several departments (Figure 3) (50). Our model facilitated earlier detection of colorectal adenoma (Table 5, Figure 5), providing a potential opportunity to optimize clinical workflows and improve patient outcomes. SHAP analysis (Figure 6) identified key predictors such as age, symptoms, family history, biomarkers, and cardiovascular risk factors (51). Notably, examination-related features did not appear in the TOP16 list, which may be attributed to two factors: (1) The study focused on early-stage prediction of colorectal adenomas in patients with subtle symptoms that might not manifest distinctly in imaging data; (2) To ensure objectivity, the research protocol specifically excluded examination methods directly associated with pathological confirmation (including but not limited to colonoscopy, histopathological analysis, and tissue biopsy). This lack of significant contribution from imaging features compared to other predictors could therefore be explained by the inherent limitations of early disease detection and the deliberate exclusion of gold-standard diagnostic procedures.

Our exclusion of patients with a history of colectomy or conditions potentially affecting inflammation assessment is methodologically appropriate and preserves the generalizability of the model within its intended screening population. These individuals are excluded because their underlying conditions (e.g., post-colectomy anatomical alterations, inflammatory comorbidities) may confound adenoma-specific biomarker profiles critical for early-stage colorectal cancer screening (5255). This exclusion aligns with standard clinical practice, where such patients are typically diverted from routine adenoma screening protocols and instead undergo dedicated surveillance pathways tailored to their specific risk profiles (5658). Consequently, the exclusion criteria do not compromise the model’s applicability to its target population—asymptomatic individuals eligible for primary screening.

However, it is important to acknowledge the limitations of this study, which do not affect the conclusions of this study. Firstly, the single-center nature of the study may limit the generalizability of the results to diverse healthcare settings. While multi-center validation was precluded by privacy regulations governing EMR sharing, we implemented prospective temporal validation (isolated 2023 test cohort) to approximate external generalizability, ensuring no data leakage between training (2012–2022) and testing phases. Secondly, the retrospective design does not allow for direct assessment of the model’s impact on clinical practice. Future research should focus on integrating the model into clinical support systems for prospective validation.

Furthermore, practical challenges persist in translating this model into clinical practice: (1) Workflow Integration Framework: To operationalize the 6.88-hour predictive lead time, a dual-phase implementation strategy is proposed. First, standardized application programming interfaces (APIs) will bridge heterogeneous EMR systems, generating context-aware alerts (e.g., prioritized task flags or pop-up notifications) for high-risk patients. Second, an interpretable clinician dashboard will dynamically display risk stratification, highlighting SHAP-identified predictors (e.g., lipoprotein A >100 mg/L) and evidence-based escalation protocols (e.g., “urgent colonoscopy ≤48 hours”) to align with clinical workflows without imposing cognitive burdens. (2) Strategic Value of Temporal Advantage: The 6.88-hour window holds distinct clinical implications across care settings. In acute care, it enables time-sensitive interventions (e.g., accelerating endoscopic evaluation for occult bleeding), mitigating risks of obstruction or hemorrhagic complications. For ambulatory care, it streamlines triage prioritization, reducing diagnostic latency through early risk stratification. (3) Adoption Barrier Mitigation: To overcome implementation inertia, three evidence-driven solutions are prioritized: (i) Prospective multicenter trials evaluating clinical endpoints (adenoma detection rate, interval-to-diagnosis); (ii) Adaptive alert thresholds informed by clinician feedback (e.g., muting redundant alerts for patients under diagnostic workup); (iii) Privacy-preserving federated learning architectures to enhance cross-institutional generalizability. Standardized validation protocols are being finalized to ensure translational fidelity across diverse healthcare ecosystems.

5 Conclusion

This study presents a novel approach to colorectal adenoma risk prediction leveraging clinical EMR data and LLM. The proposed model demonstrates superior performance in identifying high-risk individuals, providing a valuable tool for early screening. By leveraging the BGE-M3 semantic vector model, the algorithm enhances data comprehension and captures nuanced semantic information. With an average lead time of 6.88 hours and outstanding classification performance, the model has the potential to revolutionize clinical workflows and improve patient care.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.

Ethics statement

The study was approved by the Medical Science Research Ethics Committee of Peking University Third Hospital (serial number: IRB00006761-M2022121). The studies were conducted in accordance with the local legislation and institutional requirements. Informed consent from the patients was exempt due to the study’s retrospective nature. All methods were performed under the relevant guidelines and regulations.

Author contributions

XY: Writing – original draft, Writing – review & editing. JX: Funding acquisition, Writing – review & editing. HJ: Writing – review & editing. JL: Validation, Writing – review & editing. BY: Data curation, Visualization, Writing – original draft. LW: Data curation, Visualization, Writing – original draft.

Funding

The author(s) declare that financial support was received for the research and/or publication of this article. This study was supported by the Beijing Municipal Natural Science Foundation (Z210003).

Conflict of interest

Authors BY and LW were employed by the company Goodwill Hessian Health Technology Co. Ltd.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declare that no Generative AI was used in the creation of this manuscript.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2025.1508455/full#supplementary-material

References

1. Morson BC. Evolution of cancer of the colon and rectum. Cancer. (1974) 34:845–9. doi: 10.1002/1097-0142(197409)34:3+<845::AID-CNCR2820340710>3.0.CO;2-H

Crossref Full Text | Google Scholar

2. Inadomi John M. Screening for colorectal neoplasia. New Engl J Med. (2017) 376:149–56. doi: 10.1056/NEJMcp1512286

PubMed Abstract | Crossref Full Text | Google Scholar

3. Han B, Zheng R, Zeng H, Wang S, Sun K, Chen R, et al. Cancer incidence and mortality in China, 2022. J Natl Cancer Center. (2024) 4:47–53. doi: 10.1016/j.jncc.2024.01.006

PubMed Abstract | Crossref Full Text | Google Scholar

4. Siegel RL, Miller KD, Wagle NS, and Jemal A. Cancer statistics, 2023. CA: A Cancer J Clin. (2023) 73:17–48. doi: 10.3322/caac.21763

PubMed Abstract | Crossref Full Text | Google Scholar

5. Li JN and Yuan SY. Fecal occult blood test in colorectal cancer screening. J Digestive Dis. (2019) 20:62–4. doi: 10.1111/cdd.2019.20.issue-2

Crossref Full Text | Google Scholar

6. Kato T, Nagata K, Yamamichi J, Tanaka S, Honda T, Shimizu N, et al. Preference and experience of colonic examination for participants presenting to hospitals with a positive fecal immunochemical test result. Patient Prefer Adherence. (2020) 14:2017–25. doi: 10.2147/PPA.S267354

PubMed Abstract | Crossref Full Text | Google Scholar

7. Jodal HC, Klotz D, Herfindal M, Barua I, Tag P, Helsingen LM, et al. Long-term colorectal cancer incidence and mortality after adenoma removal in women and men. Aliment Pharmacol Ther. (2022) 55:412–21. doi: 10.1111/apt.16686

PubMed Abstract | Crossref Full Text | Google Scholar

8. Pickhardt PJ. CT colonography for population screening: ready for prime time? Dig Dis Sci. (2015) 60:647–59. doi: 10.1007/s10620-014-3454-2

PubMed Abstract | Crossref Full Text | Google Scholar

9. Younas F, Usman M, and Yan WQ. A deep ensemble learning method for colorectal polyp classification with optimized network parameters. Appl Intell. (2023) 53:2410–33. doi: 10.1007/s10489-022-03689-9

Crossref Full Text | Google Scholar

10. Song Z, Yu C, Zou S, Wang W, Huang Y, Ding X, et al. Automatic deep learning-based colorectal adenoma detection system and its similarities with pathologists. BMJ Open. (2020) 10:e036423. doi: 10.1136/bmjopen-2019-036423

PubMed Abstract | Crossref Full Text | Google Scholar

11. Hsu C-M, Hsu C-C, Hsu Z-M, Shih F-Y, Chang M-L, Chen T-H, et al. Colorectal polyp image detection and classification through grayscale images and deep learning. Sensors. (2021) 21(18). doi: 10.3390/s21185995

PubMed Abstract | Crossref Full Text | Google Scholar

12. Breau G and Ellis U. Risk factors associated with young-onset colorectal adenomas and cancer: A systematic review and meta-analysis of observational research. Cancer control: J Moffitt Cancer Center. (2020) 27:1073274820976670. doi: 10.1177/1073274820976670

PubMed Abstract | Crossref Full Text | Google Scholar

13. Chao G, Zhu Y, and Fang L. Retrospective study of risk factors for colorectal adenomas and non-adenomatous polyps. Transl Cancer Res. (2020) 9:1670–7. doi: 10.21037/tcr.2020.01.69

PubMed Abstract | Crossref Full Text | Google Scholar

14. Im JP, Kim D, Chung SJ, Jin EH, Han YM, Park MJv, et al. Visceral obesity as a risk factor for colorectal adenoma occurrence in surveillance colonoscopy. Gastrointestinal Endoscopy. (2018) 88:119–27.e4. doi: 10.1016/j.gie.2018.02.040

PubMed Abstract | Crossref Full Text | Google Scholar

15. Gao J, Zhang L, Yu G, Qu G, Li Y, and Yang X-q. Model with the GBDT for colorectal adenoma risk diagnosis. Curr Bioinf. (2019) 14.

Google Scholar

16. Wang H, Liu X, Long J, Huang J, Lyu S, Zhao X, et al. Development and validation of a nomogram predictive model for colorectal adenoma with low-grade intraepithelial neoplasia using routine laboratory tests: A single-center case-control study in China. Heliyon. (2023) 9:e20996. doi: 10.1016/j.heliyon.2023.e20996

PubMed Abstract | Crossref Full Text | Google Scholar

17. Min JK, Yang HJ, Kwak MS, Cho CW, Kim S, Ahn KS, et al. Deep neural network-based prediction of the risk of advanced colorectal neoplasia. Gut Liver. (2021) 15:85–91. doi: 10.5009/gnl19334

PubMed Abstract | Crossref Full Text | Google Scholar

18. Ukashi O, Pflantzer B, Barash Y, Klang E, Segev S, Yablecovitch D, et al. Risk factors and prediction algorithm for advanced neoplasia on screening colonoscopy for average-risk individuals. Therap Adv Gastroenterol. (2022) 15:17562848221101291. doi: 10.1177/17562848221101291

PubMed Abstract | Crossref Full Text | Google Scholar

19. Tokutake K, Morelos-Gomez A, Hoshi KI, Katouda M, Tejima S, and Endo M. Artificial intelligence for the prevention and prediction of colorectal neoplasms. J Transl Med. (2023) 21:431. doi: 10.1186/s12967-023-04258-5

PubMed Abstract | Crossref Full Text | Google Scholar

20. Pan Y, Zhang L, Zhang R, Han J, Qin W, Gu Y, et al. Screening and diagnosis of colorectal cancer and advanced adenoma by Bionic Glycome method and machine learning. Am J Cancer Res. (2021) 11:3002–20.

PubMed Abstract | Google Scholar

21. Devlin J, Chang M-W, Lee K, and Toutanova K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. North American Chapter of the Association for Computational Linguistics (2019).

Google Scholar

22. Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, et al. RoBERTa: A robustly optimized BERT pretraining approach. ArXiv. (2019), abs/1907.11692.

Google Scholar

23. Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov R, and Le QV. XLNet: generalized autoregressive pretraining for language understanding. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems. Curran Associates Inc (2019). p. Article 517.

Google Scholar

24. Yin M, Mou C, Xiong K, and Ren J. Chinese clinical named entity recognition with radical-level feature and self-attention mechanism. J Biomed Inf. (2019) 98:103289. doi: 10.1016/j.jbi.2019.103289

PubMed Abstract | Crossref Full Text | Google Scholar

25. Wang X, Xi H, Geng X, Li Y, Zhao M, Li F, et al. Artificial Intelligence-Based Prediction of Lower Extremity Deep Vein Thrombosis Risk After Knee/Hip Arthroplasty. Clin Appl Thromb Hemost. (2023) 29:10760296221139263. doi: 10.1177/10760296221139263

PubMed Abstract | Crossref Full Text | Google Scholar

26. Kwag KH, González-Lorenzo M, Banzi R, Bonovas S, and Moja L. Providing doctors with high-quality information: an updated evaluation of web-based point-of-care information summaries. J Med Internet Res. (2016) 18:e15. doi: 10.2196/jmir.5234

PubMed Abstract | Crossref Full Text | Google Scholar

27. Chen J, Xiao S, Zhang P, Luo K, Lian D, and Liu Z. BGE M3-embedding: multi-lingual, multi-functionality, multi-granularity text embeddings through self-knowledge distillation. ArXiv. (2024), abs/2402.03216.

Google Scholar

28. Zhang H, Zhou T, Xu T, Wang Y, and Hu H. FNN-based prediction of wireless channel with atmospheric duct. In: ICC 2021 - IEEE International Conference on Communications (2021).

Google Scholar

29. Ke G, Meng Q, Finley T, Wang T, Chen W, Ma W, et al. LightGBM: a highly efficient gradient boosting decision tree. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. Curran Associates Inc, Long Beach, California, USA (2017). p. 3149–57.

Google Scholar

30. Bewick V, Cheek L, and Ball J. Statistics review 14: Logistic regression. Crit Care. (2005) 9:112–8. doi: 10.1186/cc3045

PubMed Abstract | Crossref Full Text | Google Scholar

31. Schonlau M and Zou RY. The random forest algorithm for statistical learning. Stata J. (2020) 20:3–29. doi: 10.1177/1536867X20909688

Crossref Full Text | Google Scholar

32. Hearst MA, Dumais ST, Osuna E, Platt J, and Scholkopf B. Support vector machines. IEEE Intelligent Syst their Appl. (1998) 13:18–28. doi: 10.1109/5254.708428

Crossref Full Text | Google Scholar

33. Chen T and Guestrin C. XGBoost: A scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco, California, USA: Association for Computing Machinery (2016). p. 785–94.

Google Scholar

34. Lundberg SM and Lee S-I. A unified approach to interpreting model predictions. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. Curran Associates Inc, Long Beach, California, USA (2017). p. 4768–77.

Google Scholar

35. Pollard TJ, Johnson AEW, Raffa JD, and Mark RG. tableone: An open source Python package for producing summary statistics for research papers. JAMIA Open. (2018) 1:26–31. doi: 10.1093/jamiaopen/ooy012

PubMed Abstract | Crossref Full Text | Google Scholar

36. Collins GS, Reitsma JB, Altman DG, and Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) the TRIPOD statement. Circulation. (2015) 131:211–9. doi: 10.1161/CIRCULATIONAHA.114.014508

PubMed Abstract | Crossref Full Text | Google Scholar

37. Brenner H, Hoffmeister M, Arndt V, and Haug U. Gender differences in colorectal cancer: implications for age at initiation of screening. Br J Cancer. (2007) 96:828–31. doi: 10.1038/sj.bjc.6603628

PubMed Abstract | Crossref Full Text | Google Scholar

38. Rex DK, Johnson DA, Anderson JC, Schoenfeld PS, Burke CA, and Inadomi JM. American College of Gastroenterology guidelines for colorectal cancer screening 2009 [corrected. Am J Gastroenterol. (2009) 104:739–50. doi: 10.1038/ajg.2009.104

PubMed Abstract | Crossref Full Text | Google Scholar

39. Lieberman David A, Weiss David G, Bond John H, Ahnen Dennis J, Garewal H, Harford William V, et al. Use of colonoscopy to screen asymptomatic adults for colorectal cancer. New Engl J Med. (2000) 343:162–8. doi: 10.1056/NEJM200007203430301

PubMed Abstract | Crossref Full Text | Google Scholar

40. Stracci F, Zorzi M, and Grazzini G. Colorectal cancer screening: tests, strategies, and perspectives. Front Public Health. (2014) 2:210. doi: 10.3389/fpubh.2014.00210

PubMed Abstract | Crossref Full Text | Google Scholar

41. Butterworth AS, Higgins JP, and Pharoah P. Relative and absolute risk of colorectal cancer for individuals with a family history: a meta-analysis. Eur J Cancer. (2006) 42:216–27. doi: 10.1016/j.ejca.2005.09.023

PubMed Abstract | Crossref Full Text | Google Scholar

42. Jasperson KW, Tuohy TM, Neklason DW, and Burt RW. Hereditary and familial colon cancer. Gastroenterology. (2010) 138:2044–58. doi: 10.1053/j.gastro.2010.01.054

PubMed Abstract | Crossref Full Text | Google Scholar

43. Lawes CM, Vander Hoorn S, and Rodgers A. Global burden of blood-pressure-related disease, 2001. Lancet. (2008) 371:1513–8. doi: 10.1016/S0140-6736(08)60655-8

PubMed Abstract | Crossref Full Text | Google Scholar

44. Hemminki K and Chen B. Familial risks for colorectal cancer show evidence on recessive inheritance. Int J Cancer. (2005) 115:835–8. doi: 10.1002/ijc.v115:5

PubMed Abstract | Crossref Full Text | Google Scholar

45. Soltani G, Poursheikhani A, Yassi M, Hayatbakhsh A, Kerachian M, and Kerachian MA. Obesity, diabetes and the risk of colorectal adenoma and cancer. BMC Endocr Disord. (2019) 19:113. doi: 10.1186/s12902-019-0444-6

PubMed Abstract | Crossref Full Text | Google Scholar

46. Terry MB, Neugut AI, Bostick RM, Sandler RS, Haile RW, Jacobson JS, et al. Risk factors for advanced colorectal adenomas: a pooled analysis. Cancer Epidemiol Biomarkers Prev. (2002) 11:622–9.

Google Scholar

47. Vidal AC, Lund PK, Hoyo C, Galanko J, Burcal L, Holston R, et al. Elevated C-peptide and insulin predict increased risk of colorectal adenomas in normal mucosa. BMC Cancer. (2012) 12:389. doi: 10.1186/1471-2407-12-389

PubMed Abstract | Crossref Full Text | Google Scholar

48. Wang H, Zheng H, Meng P, Cao X, Liu J, Zhang T, et al. Relationship between lipoprotein(a) and colorectal cancer among inpatients: a retrospective study. Front Oncol. (2023) 13:1181508. doi: 10.3389/fonc.2023.1181508

PubMed Abstract | Crossref Full Text | Google Scholar

49. Budzynska K, Passerman D, White-Perkins D, Rees DA, Xu J, Lamerato L, et al. Diabetes mellitus and hyperglycemia control on the risk of colorectal adenomatous polyps: a retrospective cohort study. BMC Fam Pract. (2018) 19:145. doi: 10.1186/s12875-018-0835-1

PubMed Abstract | Crossref Full Text | Google Scholar

50. Recht B, Roelofs R, Schmidt L, and Shankar V. Do imageNet classifiers generalize to imageNet? In: International Conference on Machine Learning (2019).

Google Scholar

51. Katz PO, Dunbar KB, Schnoll-Sussman FH, Greer KB, Yadlapati R, and Spechler SJ. ACG clinical guideline for the diagnosis and management of gastroesophageal reflux disease. Am J Gastroenterol. (2022) 117:27–56. doi: 10.14309/ajg.0000000000001538

PubMed Abstract | Crossref Full Text | Google Scholar

52. Liu Z, Zhang Y, Niu Y, Li K, Liu X, Chen H, et al. A systematic review and meta-analysis of diagnostic and prognostic serum biomarkers of colorectal cancer. PLoS One. (2014) 9(8):e103910. doi: 10.1371/journal.pone.0103910

PubMed Abstract | Crossref Full Text | Google Scholar

53. Yang Z, Wang L, Kang L, Xiang J, Peng J, Cui J, et al. Clinicopathologic characteristics and outcomes of patients with obstructive colorectal cancer. J Gastrointest Surg. (2011) 15(7):1213–22. doi: 10.1007/s11605-011-1563-1

PubMed Abstract | Crossref Full Text | Google Scholar

54. Xu XR, Liu CQ, Feng BS, and Liu ZJ. Dysregulation of mucosal immune response in pathogenesis of inflammatory bowel disease. World J Gastroenterol. (2014) 20(12):3255–64.

Google Scholar

55. Noor MT and Manoria P. Immune Dysfunction Cirrhosis., 2225–0719 (Print).

Google Scholar

56. Benson AB, Venook AP, Al-Hawary MM, Arain MA, Chen YJ, Ciombor KK, et al. Colon Cancer, Version 2.2021, NCCN Clinical Practice Guidelines in Oncology. pp. 1540–1413 (Electronic).

Google Scholar

57. Dolatkhah R, Dastgiri S, Jafarabadi MA, Abdolahi HM, and Somi MH. Diagnostic accuracy of multitarget stool DNA testing for colorectal cancer screening: A systematic review and meta-analysis. pp. 0210–5705 (Print).

Google Scholar

58. Yamashina T, Takeuchi Y, Uedo N, Aoi K, Matsuura N, Nagai K, et al. Diagnostic features of sessile serrated adenoma/polyps on magnifying narrow band imaging: a prospective study of diagnostic accuracy. pp. 1440–1746 (Electronic).

Google Scholar

Keywords: adenoma, colorectal adenoma, large language model, early prediction, electronic medical record, colorectal cancer

Citation: Yang X, Xu J, Ji H, Li J, Yang B and Wang L (2025) Early prediction of colorectal adenoma risk: leveraging large-language model for clinical electronic medical record data. Front. Oncol. 15:1508455. doi: 10.3389/fonc.2025.1508455

Received: 09 October 2024; Accepted: 22 April 2025;
Published: 15 May 2025.

Edited by:

Sharon R. Pine, University of Colorado Anschutz Medical Campus, United States

Reviewed by:

Akira Umemura, Iwate Medical University, Japan
Yanbing Ding, Yangzhou University, China
Shuai Shao, Capital Medical University, China

Copyright © 2025 Yang, Xu, Ji, Li, Yang and Wang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jinjian Xu, eGpqOTcyMjRAMTI2LmNvbQ==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.