- 1Key Laboratory of Veterinary Pharmaceutical Development, Ministry of Agricultural and Rural Affairs, Lanzhou Institute of Husbandry and Pharmaceutical Sciences of Chinese Academy of Agricultural Sciences, Lanzhou, China
- 2The First Clinical Medical College of Gansu University of Chinese Medicine, Gansu Provincial Hospital, Lanzhou, China
- 3Department of Thoracic Surgery, Gansu Province Hospital, Lanzhou, China
Introduction: This study aimed to systematically evaluate the diagnostic performance of radiomics-based models in predicting KRAS gene mutations in lung cancer and quantitatively analyze the methodological quality and reporting standardization of related studies.
Methods: Original studies evaluating radiomics models for predicting KRAS mutation status in lung cancer patients were identified through systematic searches of databases including PubMed, Embase, China National Knowledge Infrastructure (CNKI), Web of Science, and the Cochrane Library (from inception to June 2025). The Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool was used to assess diagnostic bias risk, the Radiomics Quality Score (RQS, comprising 16 items with a total score of 36) was employed to quantify methodological quality, and the METRICS (10 criteria, 100-point scale) was applied to evaluate reporting standardization. A single-arm meta-analysis was conducted on 20 eligible studies (total sample size: 4,953 cases) to calculate pooled sensitivity, specificity, and the area under the summary receiver operating characteristic curve (SROC AUC). External validation was performed using validation cohorts from 12 studies.
Results: The mean RQS score of included studies was 9.86 ± 3.7 (range: 4–15, representing 27.4% ± 10.3% of the maximum score), with a mean METRICS score of 59.95 ± 13.5%. The primary analysis revealed pooled sensitivity of 0.80 (95% CI: 0.76–0.83), specificity of 0.78 (95% CI: 0.75–0.82), and AUC of 0.85 (95% CI: 0.82–0.88). Validation cohort results were consistent: sensitivity 0.79 (95% CI: 0.73–0.84), specificity 0.77 (95% CI: 0.71–0.82), and AUC 0.85 (95% CI: 0.81–0.88). Significant heterogeneity was observed among studies, but meta-regression and subgroup analyses (based on key methodological variables such as modeling algorithms, imaging modalities, RQS scores, and validation methods) confirmed stable results across subgroups, demonstrating clinical applicability.
Conclusion: Radiomics models exhibit moderate diagnostic performance in predicting KRAS mutations in lung cancer. Future efforts should strictly adhere to relevant guidelines, strengthen model validation, and standardize workflows to enhance the practical value of radiomics in precision oncology.
Systematic review registration: https://www.crd.york.ac.uk/PROSPERO/view/CRD420251148699, identifier CRD420251148699.
Introduction
Lung cancer, the malignancy with the highest cancer-related mortality, accounts for approximately 1.8 million deaths annually, representing 18.4% of all cancer-related fatalities. Among these cases, non-small cell lung cancer (NSCLC) constitutes 85% of all lung cancer diagnoses, with approximately 30% of NSCLC patients presenting at advanced stages (III or IV) upon initial diagnosis (1–3). For patients ineligible for surgical intervention, targeted therapy has emerged as the standard treatment modality (4, 5). The progressive development and clinical implementation of driver gene-based targeted therapies have revolutionized therapeutic paradigms for lung cancer patients (6–8).
Sotorasib and Adagrasib have demonstrated efficacy in prolonging survival and improving safety profiles among patients with KRAS-mutated lung cancer. Furthermore, following treatment with KRAS inhibitors, the tumor immune microenvironment transiently shifts to a less immunosuppressive state, exhibiting heightened sensitivity to therapies that promote antitumor immune responses. This observation underscores the potential for combining KRAS inhibitors with immunotherapy to achieve greater clinical benefits (9, 10).
Traditional KRAS mutation detection relies on needle biopsy, which is associated with limitations such as sampling bias, high costs, prolonged processing times, and inaccurate results due to difficulties in obtaining adequate tissue samples (11). Radiomics, a high-throughput approach, transforms medical imaging into mineable data (12, 13), encompassing both quantitative and visual features (14, 15). Its underlying hypothesis posits that tumor microstructural changes and heterogeneity can be reflected through imaging (16), thereby offering potential for predicting KRAS status and enabling personalized treatment strategies.
In recent years, research on radiomics-based prediction of KRAS mutations in lung cancer has surged. Given the critical importance of developing reliable predictive tools for clinical diagnosis and treatment, there is an urgent need to systematically summarize the predictive performance and clinical translational potential of radiomics models. Therefore, this systematic review and meta-analysis aim to clarify the value of radiomics in predicting KRAS mutation status in lung cancer.
Methods
The Preferred Reporting Items for a Systematic Review and meta-analysis of Diagnostic Test Accuracy Studies (PRISMA-DTA) were used to guide the research. The research has been registered to the PROSPERO database (CRD420251148699) for systematic reviews.
Literature retrieving
We conducted a computerized search across PubMed, Scopus, Embase, CNKI, Web of Science, and Cochrane Library databases to identify original studies that employed imaging radiomics analysis for predicting KRAS mutation status in lung cancer. The search strategy was formulated in accordance with the PICO (Population, Intervention, Comparison, Outcome) principle to enable sensitive screening of relevant studies. The search terms included “lung cancer or non-small cell lung cancer,” “radiology or radiomics,” and “KRAS.” All clinical original studies reported and published up to June 2025 were included. Detailed search criteria are provided in Supplementary Table 1.
Study inclusion
After removing duplicate references, studies meeting the following criteria were selected: (1) Patients with lung cancer diagnosed by pathological examination; (2) Prediction of KRAS status using artificial intelligence algorithms based on preoperative imaging data, namely positron emission tomography/computed tomography (PET/CT), computed tomography (CT), and magnetic resonance imaging (MRI); (3) Any study design, including retrospective and prospective observational studies. The following criteria were employed to exclude relevant studies: (1) Duplicate studies using the same patients and data; (2) Case reports, review articles, letters, conference reports, and editorials; (3) Studies not relevant to the topic. Initially, the titles and abstracts of all retrieved papers were reviewed, followed by a full-text review of potentially eligible papers. A double-blind screening mechanism was adopted: two reviewers (XDL, ZQW) with four years of experience in lung radiomics analysis independently conducted the initial screening of titles/abstracts and subsequent full-text screening. Disagreements were resolved through arbitration by a third party (YJG, a senior researcher with fifteen years of experience in lung cancer diagnosis and treatment as well as meta-analysis). In cases of missing data, the corresponding authors were contacted via email to obtain the original data; studies were excluded if no response was received after three attempts.
Data extraction
The following data were extracted from the included studies: (1) Study characteristics: author (publication year), country of the institution to which the corresponding author belongs, and type of study design; (2) Patient sample size; (3) Characteristics of radiomics model construction, including imaging modality, image segmentation method, feature extraction method, and modeling algorithm; (4) Diagnostic performance metrics of artificial intelligence models: area under the curve (AUC), sensitivity, and specificity.
If a study reported accuracy data for multiple models, we selected the 2×2 contingency table corresponding to the model with a medium Youden’s index. If the study provided both internal and external validation results, only the 2×2 contingency table corresponding to the external validation accuracy data was extracted. When necessary, Supplementary Files of the included studies were also screened to obtain the required data.
Quality assessment
Three tools were employed to evaluate the quality of included studies:(1) Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2): This tool assessed the risk of bias across four domains: patient selection, index test, reference standard, and flow and timing.
(2) Radiomics Quality Score (RQS) Criteria: Comprising 16 dimensions (e.g., imaging acquisition, feature extraction, modeling methodology, model validation, clinical applicability), this scoring system assigns a total possible score of 36 points. Based on international consensus, studies with an RQS ≤ 5 are classified as “very low quality,” while those with an RQS ≥ 9 are deemed “adequate quality” (17). (3) Methodological Radiomics Score (METRICS): A structured assessment tool developed through international consensus, METRICS employs a hierarchical classification framework to grade methodological variations and allocate weights accordingly.
Operational procedures
Data extraction and quality assessment adhered to a standardized protocol:
Training Phase: Three authors (XDL, ZQW, JLZ) independently reviewed three included studies to reach consensus on interpreting data extraction and quality assessment forms, with final definitions confirmed by the senior author (YJG).Independent Execution: Two authors (XDL, ZQW) independently performed data extraction and quality assessment tasks, with METRICS scores facilitated by a user-friendly online tool (https://metricsscore.github.io/metrics/METRICS.html).Data Integration: Consensus-confirmed information from both reviewers was consolidated into a final electronic data spreadsheet.
Statistical analysis
The κ statistic quantified inter-reviewer agreement during full-text manuscript evaluations. Agreement levels were categorized into six grades based on κ values: almost perfect (0.81–1.0), substantial (0.61–0.80), moderate (0.41–0.60), fair (0.21–0.40), slight (0.0–0.20), and poor (<0.0) (18).
Data processing
Training and validation datasets were independently extracted from relevant studies. Extracted data (sample size, sensitivity, specificity) were input into Review Manager 5.4 (https://community.cochrane.org/revman) to calculate true positives, true negatives, false positives, and false negatives. Paired forest plots displaying sensitivity, specificity, and their 95% confidence intervals (CIs) were generated using the “midas” command in Stata 17.0. Receiver operating characteristic (ROC) curves were plotted with sensitivity on the x-axis and specificity on the y-axis. Additionally, the Pearson correlation coefficient was used to examine the relationship between RQS and METRICS scores.
Heterogeneity assessment
Initial heterogeneity evaluation involved visual inspection of ROC plots and forest plots. For precise quantification, the I² statistic was employed—values >75% indicated substantial heterogeneity, with bilateral P < 0.05 as the threshold for statistical significance. Meta-regression and subgroup analyses were conducted to explore associations between methodological factors and inter-study heterogeneity.
Publication bias evaluation
With >10 studies included, publication bias was assessed. Initial evaluation involved visual inspection of funnel plot asymmetry (generated by plotting effect size against precision), followed by formal assessment using Deeks’ test, with the diagnostic odds ratio (DOR) serving as the accuracy metric.
Results
Study selection
We conducted searches across the PubMed, Scopus, Embase, CNKI, and Web of Science databases, identifying a total of 437 relevant articles. Subsequently, 203 duplicate articles were removed, leaving 234 studies. After screening the titles and abstracts of these 234 studies, 197 articles that did not meet the preset criteria regarding language, study type, and PICO (Population, Intervention, Comparison, Outcome) standards for this study were excluded. Following full-text review, an additional 18 articles were excluded, ultimately resulting in the inclusion of 20 articles (Figure 1).
Study characteristics
The summarized information of the 20 included studies is presented in Table 1, encompassing a total of 4,953 patients. The majority of the literature originated from China (12 articles, accounting for 60%). The research time span extended from January 2014 to June 2025, with the number of published articles showing an increasing trend year by year, reaching a peak between 2023 and 2025 (10 studies). All studies employed a retrospective design. Among them, 12 studies divided their cohorts into training and validation sets, while the remaining studies only established training sets. In terms of imaging examinations, 13 studies utilized CT-based radiomics analysis, 6 were based on PET/CT, and 1 on MRI imaging. Fifteen studies adopted three-dimensional (3D) segmentation. Regarding model algorithms, 5 studies constructed models using deep learning algorithms, 8 studies established diagnostic models by integrating clinical parameters, and 7 studies conducted modeling based on traditional radiomics methods. Cohen’s κ was used to evaluate the agreement between the two raters throughout the review process, and the results demonstrated good agreement (κ = 0.87).
Quality assessment
The quality of the included studies was assessed using the QUADAS-2 tool, with the results presented in Figure 2A. Overall, the methodological quality of the selected studies was moderate, with a prevalent risk of bias primarily stemming from the patient selection process. This was manifested in the lack of transparency in inclusion/exclusion criteria (e.g., failure to specify whether all consecutive patients were included), the absence of clear criteria for setting decision thresholds in diagnostic models, and the failure to validate established models in independent datasets. The latter two factors—lack of model validation criteria and lack of external validation—were critical issues affecting the applicability of the studies.
Figure 2. Quality assessment of included articles. (A) The bias risk assessment of included studies utilizing the QUADAS-2 scale. (B) RQS and METRICS scores of included articles. (C) Relationship between METRICS and RQS for each included study, illustrated by scatter plot.
A summary of study quality based on the Radiomics Quality Score (RQS, with a maximum score of 36) and the Methodological Radiomics Score (METRICS) is shown in Figures 2B and C. The average total RQS score across all 20 studies was 9.86 ± 3.7 (equivalent to 27.4% ± 10.3% of the maximum score). A significant positive correlation was observed between METRICS scores and RQS scores (Pearson correlation coefficient r = 0.836, p < 0.0001, Figure 2C), with an average METRICS score of 59.95 ± 13.5%. In terms of specific quality dimensions, most studies met the criteria for implementing model validation, disclosing radiomics features, evaluating discrimination/calibration, reporting imaging acquisition strategies, and integrating non-radiomics clinical variables. According to the METRICS assessment criteria, the quality grades of the 20 studies were distributed as follows: excellent (3 studies), good (11 studies), fair (5 studies), and poor (1 study).
Data analysis
A total of 20 studies were included in the meta-analysis. In the training cohorts of all the studies, the pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), and diagnostic odds ratio (DOR) of radiomics for evaluating the KRAS status in lung cancer patients were 0.80 (95% CI: 0.76 - 0.83), 0.78 (95% CI: 0.75 - 0.82), 3.6 (95% CI: 3.0 - 4.3), 0.27 (95% CI: 0.22 - 0.33), and 13 (95% CI: 9 - 19), respectively. Among the 12 validation cohorts, the pooled sensitivity, specificity, PLR, NLR, and DOR were 0.79 (95% CI: 0.73 - 0.84), 0.77 (95% CI: 0.71 - 0.82), 3.4 (95% CI: 2.6 - 4.4), 0.27 (95% CI: 0.21 - 0.36), and 12 (95% CI: 7 - 20), respectively (see the Table 2). Forest plots for the training and validation cohorts are presented in Figures 3 and 4, respectively. As shown in Figures 5A and B, the areas under the curve (AUCs) for the training and validation cohorts were 0.85 (95% CI: 0.82 - 0.88) and 0.85 (95% CI: 0.81 - 0.88), respectively.
Figure 3. Coupled forest plots of pooled sensitivity and specificity of diagnostic performance of predicting KRAS mutations in lung cancer patients for training cohort. The numbers are pooled estimates with 95% CIs in parentheses; horizontal lines indicate 95% CIs.
Figure 4. Coupled forest plots of pooled sensitivity and specificity of diagnostic performance of predicting KRAS mutations in lung cancer patients for validation cohort. The numbers are pooled estimates with 95% CIs in parentheses; horizontal lines indicate 95% CIs.
Figure 5. Coupled SROC curves for diagnostic performance of AI in predicting KRAS mutations in lung cancer patients: (A) training cohort SROC curve (95% CI: solid line; 95% prediction region: shaded area) and (B) validation cohort SROC curve. Significant discrepancy between 95% confidence intervals and prediction regions indicates substantial heterogeneity across studies.
Meta-regression and subgroup analysis
To identify sources of heterogeneity, we conducted meta-regression and subgroup analyses, taking into account four variables: the inclusion of clinical parameters, the Radiomics Quality Score (RQS), imaging modality, validation method (internal cross-validation versus external validation), and the application of deep learning methods. The meta-regression results indicated that the use of different imaging modalities (P = 0.032), the application of deep learning algorithms (P = 0.014), RQS scores (P = 0.021), and differences in validation methods (P = 0.028) might be factors contributing to significant variations in diagnostic performance among studies and generating heterogeneity. However, the inclusion of clinical features in model construction did not appear to be a source of heterogeneity (P = 0.63). Detailed results of the subgroup analyses are presented in Table 3.
There was no significant difference in the diagnostic performance of the models, regardless of whether clinical parameters were included, with corresponding areas under the curve (AUCs) of 0.85 and 0.86, respectively. Among the six studies that constructed radiomics models using PET/CT image features, the diagnostic performance was the best (AUC = 0.91), while the AUC for models based on CT images was 0.85. Both the PET/CT subgroup and the CT subgroup exhibited low heterogeneity, at 36.1% and 46.2%, respectively.
The diagnostic performance of the subgroup using deep learning algorithms was superior to that of the subgroup using traditional machine learning algorithms (AUC 0.88 versus 0.84), and the deep learning subgroup had lower heterogeneity (I² = 45.0%), while the traditional algorithm subgroup had moderate heterogeneity (I² = 57.8%). Meta-regression using RQS as a continuous covariate did not reveal an association with the pooled results. Re-analysis based on RQS classification (very low ≤ 5 versus appropriate ≥ 9) showed that the low RQS subgroup had better diagnostic performance (AUC = 0.90 versus 0.85), and both the low RQS subgroup and the appropriate RQS subgroup had low heterogeneity, at 37.1% and 48.11%, respectively.
The diagnostic efficacy of the internal cross-validation group was superior to that of the independent external validation group. The internal cross-validation group had moderate heterogeneity (I² = 67.3%), while the external validation group had low heterogeneity (I² = 39.2%). The P-value for Deeks’ funnel plot asymmetry test was 0.71, indicating no significant evidence of publication bias among the included studies (Figure 6).
Figure 6. Effective sample size (ESS) funnel plots and the associated regression test of asymmetry, as reported by Deeks et al. A p value < 0.10 was considered evidence of asymmetry and potential publication bias.
Discussion
To the best of our knowledge, this is the first comprehensive study that conducts a systematic assessment of the methodological quality and a meta-analysis of current clinical studies on radiomics-based prediction of KRAS status in lung cancer. This meta-analysis represents the first attempt to quantitatively summarize and interpret data from different independent studies, potentially providing critical insights into its clinical applications and future research directions.
A total of 20 studies involving 4,953 patients were included in this meta-analysis. These studies exhibited significant geographical disparities, with 12 studies (60%) originating from China and encompassing 3,736 Chinese patients. This phenomenon aligns with the high incidence of lung cancer in China (39) and the relatively elevated KRAS mutation rate in the Asian region (40).
We further conducted an exploratory bibliometric analysis by searching the PubMed core database. The data revealed that in fields related to “radiomics,” a substantial 43.1% of the papers originated from China; in the realm of “lung cancer” research, Chinese researchers contributed 34.2% of the studies. These figures underscore the emergence of China as a key research force in these two domains. Notably, there has been a significant surge in research output in this field since 2018.
Meanwhile, most radiomics studies demonstrate a high degree of methodological consistency, reflecting the gradual maturation of the field and a positive trend towards standardization (41, 42).
Previous systematic reviews and meta-analyses have confirmed the effectiveness of radiomics in multiple areas, such as predicting the progression and recurrence of hepatocellular carcinoma (43), the occurrence of radiation pneumonitis in lung cancer (44), the overall survival of lung cancer patients (45, 46), the response to neoadjuvant chemotherapy in early-stage breast cancer (47), and lymph node metastasis in esophageal cancer (48). Unlike previous studies, to comprehensively explore the generalization ability of radiomics models, we independently analyzed the results from model training sets and independent validation sets. Compared to the results from the training sets, the validation sets did not show a decline in model performance. Compared to cross-validation methods, using independent validation cohorts can reduce the risk of overfitting, more accurately assess actual performance, achieve a more comprehensive evaluation of model performance, and provide broader generalization capabilities. Independent validation cohorts ensure that models are validated in entirely new datasets, reducing bias and enhancing the accuracy of performance evaluations.
It is noteworthy that the utilization of public datasets for external testing, as employed by Dong et al. (22, 24, 28–30, 34), is an effective strategy for enhancing the generalization ability of radiomics models. Regarding the specific task explored in this meta-analysis, the non-small cell lung cancer (NSCLC) radiogenomics dataset from The Cancer Imaging Archive (TCIA) (49) could serve as a suitable external validation cohort, a point worthy of in-depth exploration in future research.
This systematic review employed the QUADAS-2 (50), RQS (20), and METRICS (42) tools to evaluate the quality of radiomics studies. Overall, the included studies demonstrated a moderate to good quality level. A 2023 review by Tabnak et al. (51) on MRI prediction of Ki-67 expression in breast cancer incorporated 31 studies, with an average RQS of only 5.9 points. In contrast, this systematic review included 20 studies with an average RQS of 9.86 ± 3.7 points, significantly higher than the former, reflecting notable advancements in the field in recent years.
Further analysis of the 16 rating dimensions of the Radiomics Quality Score (RQS) revealed that the “validation” category exhibited the most significant score disparities, while the following five areas scored the lowest: “prospective studies registered in a trial database,” “phantom studies conducted on all scanners,” “multi-time-point imaging,” “biological correlation testing and discussion,” and “cost-effectiveness analysis.” These score differences partly stem from the specific inclusion criteria set in this study. Although prospective study designs are crucial for establishing associations between radiomic features and clinical outcomes in specific patient populations, none of the current included studies adopted such a design framework due to the complex heterogeneity of treatment indications.
The core value of phantom studies lies in validating the consistency of feature extraction across scanning devices from different manufacturers, which is particularly important given that actual evaluation cohorts often involve multi-center collaborations and the use of imaging equipment across different models. Multi-time-point imaging, considering variations in radiomic features due to organ motion or changes in target volume, requires stable image sets obtained through short-term repeated measurement data (two or more image datasets from patients). Biological correlation analysis can reveal the association pathways between imaging phenotypes and underlying molecular mechanisms, providing a critical dimension for understanding disease heterogeneity.
At the level of economic benefit verification, cost-effectiveness analysis necessitates a systematic comparison of the input-output ratios between radiomics techniques and traditional diagnostic and treatment pathways. Its comprehensive application not only relates to the clinical translation value of the model but also provides quantitative evidence for key methodological parameters in subsequent validation stages, including labor costs for image segmentation, resource allocation efficiency for multi-phase scans, and net benefit increments of new technologies relative to existing examination methods. However, accomplishing these tasks in retrospective studies poses significant challenges (52, 53).
Additionally, we evaluated the METRICS scores adopted in the studies. As an emerging evaluation tool, METRICS provides more detailed and balanced evaluation dimensions compared to RQS. For most included studies, there is still room for optimization in handling clinical confounding factors, the rational use of machine learning algorithms, precise selection of imaging stages, independent validation of research results, and ensuring scientific data transparency and reproducibility. We advocate that future radiomics studies should incorporate these key points into their analysis and reporting processes.
Radiomics demonstrates high potential value in predicting the KRAS status in lung cancer. In the training group, the overall sensitivity, specificity, and area under the curve (AUC) were 0.80 (95% CI: 0.76 - 0.83), 0.78 (95% CI: 0.75 - 0.82), and 0.85 (95% CI: 0.82 - 0.88), respectively. The corresponding values in the validation group were 0.79 (95% CI: 0.73 - 0.84), 0.77 (95% CI: 0.71 - 0.82), and 0.85 (95% CI: 0.81 - 0.88). This indicates that radiomics models can effectively distinguish the KRAS status in lung cancer patients. Furthermore, although the Deeks’ test result showed a P-value of 0.71, it is essential to emphasize the limitations of this conclusion. With only 20 included studies and significant regional concentration (60% of the studies originating from China), the insufficient sample size and uneven geographical distribution result in inadequate statistical power for the test, potentially masking potential biases. Future studies should strive to include studies from more regions and expand the sample size of included studies as much as possible to enhance the generalizability and reliability of the results.
The included studies exhibited significant heterogeneity, a result consistent with the conclusions of previous meta-analyses in the field of radiomics (54–57) and in line with the pre-established cognitive framework of this study. Given that all current studies adopted a retrospective research paradigm, the presence of such heterogeneity is methodologically inevitable. Although most studies followed convergent standard operating procedures, multiple methodological decision points exist throughout the analysis chain, including image data preprocessing, feature selection strategies, and model construction algorithms, all of which may influence the results. The cumulative effect of these variables ultimately leads to significant differences among studies, essentially reflecting the inherent methodological vulnerability of the current highly personalized modeling approach.
Nevertheless, the comprehensive statistical results of the current models still hold significant value. Through meta-regression analysis, we delved into the sources of heterogeneity and found that several key methodological factors, including RQS, imaging modality, and modeling algorithms, may be the primary reasons for the heterogeneity among studies. Similar to the study by Spadarella et al. (58), we found that the overall RQS was low and speculated that methodological quality might introduce bias into the pooled results. In the absence of RQS threshold standards, we classified the study cohort based on data-driven hypotheses and found that studies with an RQS ≤ 5 (very low-quality subgroup) had higher predicted specificity, suggesting a possible overestimation. This may be because these studies often failed to perform independent validation or only used internal data for validation while not implementing feature dimensionality reduction, leading to the inclusion of redundant features in the model and overfitting on the training set. This also indicates that different RQS levels can affect research results, confirming an association between RQS and result heterogeneity.
Radiomic features are closely related to the imaging modalities used. Texture features, morphological features, and other features extracted from CT and PET/CT images may not be entirely consistent. Differences in radiomic features generated by different imaging modalities can lead to significant variations in model performance with imaging methods, thereby exacerbating heterogeneity. Compared to traditional radiomic methods, deep learning methods typically have more complex architectures and more parameters. Differences in training strategies, hyperparameter selection, network architectures, and other factors among different studies can also lead to heterogeneity (59).
In summary, we believe that radiomics demonstrates good diagnostic efficacy in predicting the KRAS mutation status in lung cancer. In our subgroup analysis, we found that modeling using PET/CT exhibited superior diagnostic accuracy compared to CT. Previous studies (60, 61) have discovered intriguing associations between PET-derived radiomic features (such as SUVmax and SUVak) and key genetic variations, including KRAS, EGFR, and TP53 mutations. For example, SUVPeak is associated with mutations in the transforming growth factor-β pathway in adenocarcinoma, highlighting the potential of radiogenomics to capture tumor heterogeneity and guide treatment decisions (62). Unlike anatomical imaging techniques that provide static structural information, PET imaging can dynamically reflect metabolic activity, revealing underlying tumor physiological characteristics, which is advantageous for subsequent machine learning analysis. We found that constructing radiomics models using deep learning algorithms can enhance the model’s diagnostic performance. This finding is consistent with previous studies (63–65). Many scholars believe that constructing radiomics models using deep learning algorithms is superior to traditional machine learning algorithms. Deep learning models possess the capability to handle high-dimensional data and complex tasks, and their performance often improves with an increase in data volume. Especially in the case of large datasets, deep learning can fully exploit the value of training data (66).
This study has several limitations. Firstly, all the included studies adopted a retrospective design. Prospective studies are generally considered superior to retrospective ones due to the use of standardized imaging protocols, timely extraction of relevant radiomic features, implementation of standardized blinded data collection, and optimized study designs. Therefore, caution is warranted when directly applying these research findings, as there may be concerns regarding generalizability. Secondly, during the data extraction process, if a study presented multiple models, we selected the one with the best diagnostic performance. This approach may have overestimated the sensitivity and specificity of radiomics models in distinguishing the KRAS status in lung cancer. Thirdly, the codes used for feature extraction and model construction in the studies were not publicly available, which hinders the validation of the research results. Finally, not all included datasets met the ideal sample size criterion (i.e., a sample size ten times the number of model features), highlighting the necessity for future studies to establish larger-scale clinical cohorts or reduce the number of model features.
Conclusion
In conclusion, this meta-analysis indicates that radiomics is a promising tool for determining the KRAS mutation status in lung cancer. However, the quality of radiomics research still needs improvement. Strictly adhering to relevant guidelines for radiomics research is crucial. Additionally, prospective clinical trials should be designed to validate the practical applicability of the models and promote their clinical application.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding authors.
Author contributions
XDL: Conceptualization, Data curation, Formal analysis, Writing – original draft, Writing – review & editing. ZQW: Conceptualization, Writing – original draft. DL: Conceptualization, Writing – original draft. YPW: Conceptualization, Writing – original draft. WLW: Conceptualization, Writing – original draft. PCD: Conceptualization, Writing – original draft. YJG: Conceptualization, Writing – original draft. YYY: Conceptualization, Writing – original draft.
Funding
The author(s) declared that financial support was received for this work and/or its publication. National Key R&D Plan (grant no. 2021YFF0702405), General Program of National Natural Science Foundation of China -Mechanism of Hepcidin-Induced Activation of the CGAS-STING Pathway in Regulating Antioxidant Stress during Adipose Tissue Browning in Plateau Pikas (Project Number: 32470569). Lanzhou Science and Technology Plan Project -Isolation and Identification of Intestinal Probiotics from Plateau Pikas and Their Development and Utilization for the Treatment of Intestinal Inflammation (Project Number: 2023-1-34). Gansu Provincial Science and Technology Program Project (24YFWA005).
Conflict of interest
The authors declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declared that generative AI was not used in the creation of this manuscript.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2025.1701122/full#supplementary-material
References
1. Ferlay J, Ervik M, Lam F, Colombet M, Mery L, Piñeros M, et al. Global cancer observatory: cancer today. Lyon: International Agency for Research on Cancer (2020) p. 2018–20.
2. Thai AA, Solomon BJ, Sequist LV, Gainor JF, and Heist RS. Lung cancer. Lancet. (2021) 398:535–54. doi: 10.1016/S0140-6736(21)00312-3
3. Remon J, Ahn MJ, Girard N, Johnson M, Kim DW, Lopes G, et al. Advanced-stage non-small cell lung cancer: advances in thoracic oncology 2018. J Thorac Oncol. (2019) 14:1134–55. doi: 10.1016/j.jtho.2019.03.022
4. Chen P, Liu Y, Wen Y, and Zhou C. Non-small cell lung cancer in China. Cancer Commun (Lond). (2022) 42:937–70. doi: 10.1002/cac2.12359
5. Alexander M, Kim SY, and Cheng H. Update 2020: management of non-small cell lung cancer. Lung. (2020) 198:897–907. doi: 10.1007/s00408-020-00407-5
6. Planchard D, Jänne PA, Cheng Y, Yang JCH, Yanagitani N, Kim SW, et al. Osimertinib with or without chemotherapy in EGFR-mutated advanced NSCLC. New Engl J Med. (2023) 389:1935–48. doi: 10.1056/NEJMoa2306434
7. Drilon A, Camidge DR, Lin JJ, Kim SW, Solomon BJ, Dziadziuszko R, et al. Repotrectinib in ROS1 Fusion–positive non–small-Cell lung cancer. New Engl J Med. (2024) 390:118–31. doi: 10.1056/NEJMoa2302299
8. Shaw AT, Felip E, Bauer TM, Besse B, Navarro A, Postel-Vinay S, et al. Lorlatinib in non-small-cell lung cancer with ALK or ROS1 rearrangement: an international, multicentre, open-label, single-arm first-in-man phase 1 trial. Lancet Oncol. (2017) 18:1590–9. doi: 10.1016/S1470-2045(17)30680-0
9. Hallin J, Engstrom LD, Hargis L, Calinisan A, Aranda R, Briere DM, et al. The KRASG12C inhibitor MRTX849 provides insight toward therapeutic susceptibility of KRAS-mutant cancers in mouse models and patients. Cancer Discov. (2020) 10:54–71. doi: 10.1158/2159-8290.CD-19-1167
10. Wu HH, Eaton JP, Jones KJ, Cramer HM, Randolph ML, Post K, et al. Utilization of cell-transferred cytologic smears in detection of EGFR and KRAS mutation on adenocarcinoma of lung. Modern Pathol. (2014) 27:930–5. doi: 10.1038/modpathol.2013.220
11. Ellison G, Zhu G, Moulis A, Dearden S, Speake G, McCormack R, et al. EGFR mutation testing in lung cancer: a review of available methods and their use for analysis of tumour tissue and cytology samples. J Clin Pathol. (2013) 66:79–89. doi: 10.1136/jclinpath-2012-201194
12. Gillies RJ, Kinahan PE, and Hricak H. Radiomics: images are more than pictures, they are data. Radiology. (2016) 278:563–77. doi: 10.1148/radiol.2015151169
13. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RGPM, Granton P, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. (2012) 48:441–6. doi: 10.1016/j.ejca.2011.11.036
14. Mori M, Hayashi H, Fukuda M, Honda S, Kitazaki T, Shigematsu K, et al. Clinical and computed tomography characteristics of non-small cell lung cancer with ALK gene rearrangement: Comparison with EGFR mutation and ALK/EGFR-negative lung cancer. Thorac Cancer. (2019) 10:872–9. doi: 10.1111/1759-7714.13017
15. Hawkins S, Wang H, Liu Y, Garcia A, Stringfield O, Krewer H, et al. Predicting Malignant nodules from screening CT scans. J Thorac Oncol. (2016) 11:2120–8. doi: 10.1016/j.jtho.2016.07.002
16. Liu Z, Wang S, Dong D, Wei J, Fang C, Zhou X, et al. The applications of radiomics in precision diagnosis and treatment of oncology: opportunities and challenges. Theranostics. (2019) 9:1303. doi: 10.7150/thno.30309
17. Di Salle G, Tumminello L, Laino ME, Shalaby S, Aghakhanyan G, Fanni SC, et al. Accuracy of radiomics in predicting IDH mutation status in diffuse gliomas: a bivariate meta-analysis. Radiology: Artif Intell. (2023) 6:e220257. doi: 10.1148/ryai.220257
18. McHugh ML. Interrater reliability: the kappa statistic. Biochemia Med. (2012) 22:276–82. doi: 10.11613/BM.2012.031
19. Rizzo S, Petrella F, Buscarino V, De Maria F, Raimondi S, Barberis M, et al. CT radiogenomic characterization of EGFR, K-RAS, and ALK mutations in non-small cell lung cancer. Eur Radiol. (2016) 26:32–42. doi: 10.1007/s00330-015-3814-0
20. Rios Velazquez E, Parmar C, Liu Y, Coroller TP, Cruz G, Stringfield O, et al. Somatic mutations drive distinct imaging phenotypes in lung cancer. Cancer Res. (2018) 77:3922–30. doi: 10.1158/0008-5472.CAN-17-0122
21. Rizzo S, Raimondi S, de Jong EEC, van Elmpt W, De Piano F, Petrella F, et al. Genomics of non-small cell lung cancer (NSCLC): Association between CT-based imaging features and EGFR and K-RAS mutations in 122 patients—An external validation. Eur J Radiol. (2019) 110:148–55. doi: 10.1016/j.ejrad.2018.11.032
22. Dong Y, Hou L, Yang W, Han J, Wang J, Qiang Y, et al. Multi-channel multi-task deep learning for predicting EGFR and KRAS mutations of non-small cell lung cancer on CT images. Quantitative Imaging Med Surg. (2020) 11:2354. doi: 10.21037/qims-20-600
23. Moreno S, Bonfante M, Zurek E, Cherezov D, Goldgof D, Hall L, et al. A radiogenomics ensemble to predict EGFR and KRAS mutations in NSCLC. Tomography. (2021) 7:154–68. doi: 10.3390/tomography7020014
24. Le NQK, Kha QH, Nguyen VH, Chen YC, Cheng SJ, Chen CY, et al. Machine learning-based radiomics signatures for EGFR and KRAS mutations prediction in non-small-cell lung cancer. Int J Mol Sci. (2021) 22:9254. doi: 10.3390/ijms22179254
25. Zhang T, Xu Z, Liu G, Jiang B, de Bock GH, Groen HJM, et al. Simultaneous identification of EGFR, KRAS, ERBB2, and TP53 mutations in patients with non-small cell lung cancer by machine learning-derived three-dimensional radiomics. Cancers. (2021) 13:1814. doi: 10.3390/cancers13081814
26. Shiri I, Amini M, Nazari M, Hajianfar G, Haddadi Avval A, Abdollahi H, et al. Impact of feature harmonization on radiogenomics analysis: Prediction of EGFR and KRAS mutations from non-small cell lung cancer PET/CT images. Comput Biol Med. (2022) 142:105230. doi: 10.1016/j.compbiomed.2022.105230
27. Wang JY, Lv X, Huang W, Quan Z, Li G, Wu S, et al. Establishment and optimization of radiomics algorithms for prediction of KRAS gene mutation by integration of NSCLC gene mutation mutual exclusion information. Front Pharmacol. (2022) 13:862581. doi: 10.3389/fphar.2022.862581
28. Chen Z, Gao S, Ding C, Luo T, Xu J, Xu S, et al. CT-based non-invasive identification of the most common gene mutation status in patients with non-small cell lung cancer. Med Phys. (2024) 51:1872–82. doi: 10.1002/mp.16744
29. Prencipe B, Delprete C, Garolla E, Corallo F, Gravina M, Natalicchio MI, et al. An explainable radiogenomic framework to predict mutational status of KRAS and EGFR in lung adenocarcinoma patients. Bioengineering. (2023) 10:747. doi: 10.3390/bioengineering10070747
30. Zhang R, Shi K, Hohenforst-Schmidt W, Steppert C, Sziklavari Z, Schmidkonz C, et al. Ability of 18F-FDG positron emission tomography radiomics and machine learning in predicting KRAS mutation status in therapy-naive lung adenocarcinoma. Cancers. (2023) 15:3684. doi: 10.3390/cancers15143684
31. Kohan A, Hinzpeter R, Kulanthaivelu R, Mirshahvalad SA, Avery L, Tsao M, et al. Contrast enhanced CT radiogenomics in a retrospective NSCLC cohort: models, attempted validation of a published model and the relevance of the clinical context. Acad Radiol. (2024) 31:2953–61. doi: 10.1016/j.acra.2024.01.031
32. Li Y, Zhu XX, and Wei N. Predictive value of 18F-FDG PET/CT imaging for KRAS mutation in lung adenocarcinoma. Chin J CT MRI. (2024) 22:59–62.
33. Lv X, Li Y, Wang B, Wang Y, Xu Z, Hou D, et al. Multisequence MRI-based radiomics signature as potential biomarkers for differentiating KRAS mutations in non-small cell lung cancer with brain metastases. Eur J Radiol Open. (2024) 12:100548. doi: 10.1016/j.ejro.2024.100548
34. Xue Y, Zhang D, Jia L, Yang W, Zhao J, Qiang Y, et al. Integrating image and gene-data with a semi-supervised attention model for prediction of KRAS gene mutation status in non-small cell lung cancer. PloS One. (2024) 19:e0297331. doi: 10.1371/journal.pone.0297331
35. Xu JQ, et al. Predicting KRAS and EGFR gene mutations in non-small cell carcinoma patients based on radiogenomics. J Cent South Univ Med Sci. (2025) 50:805X. doi: 10.11817/j.issn.1672-7347.2025.250026
36. Hanwen F, et al. Feasibility study on predicting KRAS gene mutations in small cell lung cancer based on CT plain scan texture features. Imaging Res Med Appl. (2025) 9:67–9. doi: 10.20267/j.issn.2096-3807.2025.02.021
37. Mahmoud MA, Wu S, Su R, Liufu Y, Wen Y, Pan X, et al. CT-based radiomics: A potential indicator of KRAS mutation in pulmonary adenocarcinoma. Tumori J. (2025) 111:147–57. doi: 10.1177/03008916251314659
38. Schöneck M, Rehbach N, Lotter-Becker L, Persigehl T, Lennartz S, Caldeira LL, et al. Machine learning-based radiomics analysis for identifying kras mutations in non-small-cell lung cancer from ct images: Challenges, insights and implications. Life. (2025) 15:83. doi: 10.3390/life15010083
39. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality world-wide for 36 cancers in 185 countries. Cancer J Clin. (2021) 71:209249. doi: 10.3322/caac.21660
40. Zhou J, Sun H, Wang Z, Cong W, Zeng M, Zhou W, et al. Guidelines for the diagnosis and treatment of primary liver cancer (2022 edition). Liver Cancer. (2023) 12:405–44. doi: 10.1159/000530495
41. Lambin P, Leijenaar RTH, Deist TM, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol. (2017) 14:749–62. doi: 10.1038/nrclinonc.2017.141
42. Kocak B, Akinci D’Antonoli T, Mercaldo N, Alberich-Bayarri A, Baessler B, Ambrosini I, et al. METhodological radiomICs score (METRICS): A quality scoring tool for radiomics research endorsed by euSoMII. Insights Imaging. (2024) 15:8. doi: 10.1186/s13244-023-01572-w
43. Ivanics T, Salinas-Miranda E, Abreu P, Khalvati F, Namdar K, Dong X, et al. A pre-TACE radiomics model to predict HCC progression and recurrence in liver transplantation: A pilot study on a novel biomarker. Transplantation. (2021) 105:2435–44. doi: 10.1097/TP.0000000000003605
44. Chen Z, Yi G, Li X, Yi B, Bao X, Zhang Y, et al. Predicting radiation pneumonitis in lung cancer using machine learning and multimodal features: A systematic review and meta-analysis of diagnostic accuracy. BMC Cancer. (2024) 24:1355. doi: 10.1186/s12885-024-13098-5
45. Le V-H, Kha QH, Hung TNKH, and Le NQK. Risk score generated from CT-based radiomics signatures for overall survival prediction in non-small cell lung cancer. Cancers. (2021) 13:3616. doi: 10.3390/cancers13143616
46. Le VH, Kha QH, Minh TNT, Nguyen VH, Le VL, Le NQK, et al. Development and validation of CT-based radiomics signature for overall survival prediction in multi-organ cancer. J Digital Imaging. (2023) 36:911–22. doi: 10.1007/s10278-023-00778-0
47. Li Z, Liu X, Gao Y, Lu X, Lei J, et al. Ultrasound-based radiomics for early predicting response to neoadjuvant chemotherapy in patients with breast cancer: A systematic review with meta-analysis. La Radiologia Med. (2024) 129:934–44. doi: 10.1007/s11547-024-01783-1
48. Ma D, Zhou T, Chen J, and Chen J. Radiomics diagnostic performance for predicting lymph node metastasis in esophageal cancer: A systematic review and meta-analysis. BMC Med Imaging. (2024) 24:144. doi: 10.1186/s12880-024-01278-5
49. Bakr S, Gevaert O, Echegaray S, Ayers K, Zhou M, Shafiq M, et al. A radiogenomic dataset of non-small cell lung cancer. Sci Data. (2018) 5:180202. doi: 10.1038/sdata.2018.202
50. Whiting PF, Rutjes AW, Westwood ME, Mallett S, and QUADAS-2 Steering Group. QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. (2011) 155:529–36. doi: 10.7326/0003-4819-155-8-201110180-00009
51. Tabnak P, et al. MRI-based radiomics methods for predicting ki-67 expression in breast cancer: A systematic review and meta-analysis. Acad Radiol. (2024) 31:763–87. doi: 10.1016/j.acra.2023.10.010
52. Jia LL, Zheng QY, Tian JH, He DL, Zhao JX, Zhao LP, et al. Artificial intelligence with magnetic resonance imaging for prediction of pathological complete response to neoadjuvant chemoradiotherapy in rectal cancer: A systematic review and meta-analysis. Front Oncol. (2022) 12:1026216. doi: 10.3389/fonc.2022.1026216
53. Zhang H, Lei H, and Pang J. Diagnostic performance of radiomics in adrenal masses: A systematic review and meta-analysis. Front Oncol. (2022) 12:975183. doi: 10.3389/fonc.2022.975183
54. Huang J, Tian W, Zhang L, Huang Q, Lin S, Ding Y, et al. Preoperative prediction power of imaging methods for microvascular invasion in hepatocellular carcinoma: a systemic review and meta-analysis. Front Oncol. (2020) 10:887. doi: 10.3389/fonc.2020.00887
55. Hong SB, Choi SH, Kim SY, Shim JH, Lee SS, Byun JH, et al. MRI features for predicting microvascular invasion of hepatocellular carcinoma: A systematic review and meta-analysis. Liver Cancer. (2021) 10:94–106. doi: 10.1159/000513704
56. Kothari G, Korte J, Lehrer EJ, Zaorsky NG, Lazarakis S, Kron T, et al. A systematic review and meta-analysis of the prognostic value of radiomics based models in non-small cell lung cancer treated with curative radiotherapy. Radiother Oncol. (2021) 155:188–203. doi: 10.1016/j.radonc.2020.10.023
57. Ursprung S, Beer L, Bruining A, Woitek R, Stewart GD, Gallagher FA, et al. Radiomics of computed tomography and magnetic resonance imaging in renal cell carcinoma - A systematic review and meta-analysis. Eur Radiol. (2020) 30:3558–66. doi: 10.1007/s00330-020-06666-3
58. Spadarella G, Stanzione A, Akinci D’Antonoli T, Andreychenko A, Fanni SC, Ugga L, et al. Systematic review of the radiomics quality score applications: an euSoMII radiomics auditing group initiative. Eur Radiol. (2023) 33:1884–94. doi: 10.1007/s00330-022-09187-3
59. Avanzo M, Wei L, Stancanello J, Vallières M, Rao A, Morin O, et al. Machine and deep learning methods for radiomics. Med Phys. (2020) 47:e185–202. doi: 10.1002/mp.13678
60. Liu Z, Duan T, Zhang Y, Weng S, Xu H, Ren Y, et al. Radiogenomics: A key component of precision cancer medicine. Br J Cancer. (2023) 129:741–53. doi: 10.1038/s41416-023-02317-8
61. Sukhadia SS, Sadee C, Gevaert O, and Nagaraj SH. Machine learning-enabled prediction of biologically relevant gene expression using CT-based radiomic features in non-small cell lung cancer. Cancer Med. (2024) 13:e70509. doi: 10.1002/cam4.70509
62. Kim G, Kim J, Cha H, Park WY, Ahn JS, Ahn MJ, et al. Metabolic radiogenomics in lung cancer: associations between FDG PET image features and oncogenic signaling pathway alterations. Sci Rep. (2020) 10:13231. doi: 10.1038/s41598-020-70168-x
63. Sun Q, Lin X, Zhao Y, Li L, Yan K, Liang D, et al. Deep learning vs. Radiomics for predicting axillary lymph node metastasis of breast cancer using ultrasound images: don’t forget the peritumoral region. Front Oncol. (2020) 10:53. doi: 10.3389/fonc.2020.00053
64. Truhn D, Schrading S, Haarburger C, Schneider H, Merhof D, Kuhl C, et al. Radiomic versus Convolutional Neural Networks Analysis for Classification of Contrast-Enhancing Lesions at Multiparametric Breast MRI. Radiology. (2018) 290:290–7. doi: 10.1148/radiol.2018181352
65. Kooi T, Litjens G, van Ginneken B, Gubern-Mérida A, Sánchez CIS, Mann R, et al. Large scale deep learning for computer aided detection of mammographic lesions. Med Image Anal. (2017) 35:303–12. doi: 10.1016/j.media.2016.07.007
Keywords: KRAS gene mutation, lung cancer, cancer, radiomics, non-small cell lung cancer, deep learning
Citation: Luo X, Wang Z, Lu D, Wang Y, Wang W, Dong P, Gou Y and Yang Y (2026) Quality and accuracy of radiomics models in predicting KRAS status in lung cancer: a systematic review and meta-analysis. Front. Oncol. 15:1701122. doi: 10.3389/fonc.2025.1701122
Received: 08 September 2025; Accepted: 05 December 2025; Revised: 25 November 2025;
Published: 09 January 2026.
Edited by:
Sunyi Zheng, Tianjin Medical University Cancer Institute and Hospital, ChinaReviewed by:
Nguyen Quoc Khanh Le, Taipei Medical University, TaiwanLiliana Caldeira, University Hospital of Cologne, Germany
Copyright © 2026 Luo, Wang, Lu, Wang, Wang, Dong, Gou and Yang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Pengcheng Dong, ZG9uZ3BlbmdjaGVuZ0BjYWFzLmNu; Yunjiu Gou, Z291eXVuaml1QDE2My5jb20=; Yayuan Yang, eWFuY3l5YW5nenhsQDE2My5jb20=
Ziqiang Wang2,3