Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 12 July 2022
Sec. Head and Neck Cancer
This article is part of the Research Topic Insights in Head and Neck Cancer: 2021 View all 6 articles

Comparison of Different Machine Models Based on Multi-Phase Computed Tomography Radiomic Analysis to Differentiate Parotid Basal Cell Adenoma From Pleomorphic Adenoma

Yun-lin Zheng&#x;Yun-lin Zheng1†Yi-neng Zheng&#x;Yi-neng Zheng1†Chuan-fei LiChuan-fei Li2Jue-ni GaoJue-ni Gao1Xin-yu ZhangXin-yu Zhang1Xin-yi LiXin-yi Li1Di Zhou*Di Zhou1*Ming Wen*Ming Wen1*
  • 1Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
  • 2Department of Gastroenterology, The Second Affiliated Hospital, Chongqing Medical University, Chongqing, China

Objective: This study explored the value of different radiomic models based on multiphase computed tomography in differentiating parotid pleomorphic adenoma (PA) and basal cell tumor (BCA) concerning the predominant phase and the optimal radiomic model.

Methods: This study enrolled 173 patients with pathologically confirmed parotid tumors (training cohort: n=121; testing cohort: n=52). Radiomic features were extracted from the nonenhanced, arterial, venous, and delayed phases CT images. After dimensionality reduction and screening, logistic regression (LR), K-nearest neighbor (KNN) and support vector machine (SVM) were applied to develop radiomic models. The optimal radiomic model was selected by using ROC curve analysis. Univariate and multivariable logistic regression was performed to analyze clinical-radiological characteristics and to identify variables for developing a clinical model. A combined model was constructed by integrating clinical and radiomic features. Model performances were assessed by ROC curve analysis.

Results: A total of 1036 radiomic features were extracted from each phase of CT images. Sixteen radiomic features were considered valuable by dimensionality reduction and screening. Among radiomic models, the SVM model of the arterial and delayed phases showed superior predictive efficiency and robustness (AUC, training cohort: 0.822, 0.838; testing cohort: 0.752, 0.751). The discriminatory capability of the combined model was the best (AUC, training cohort: 0.885; testing cohort: 0.834).

Conclusions: The diagnostic performance of the arterial and delayed phases contributed more than other phases. However, the combined model demonstrated excellent ability to distinguish BCA from PA, which may provide a non-invasive and efficient method for clinical decision-making.

Introduction

Parotid gland tumors are the predominant salivary gland tumors, more than 80% of which are benign (1). According to the 5th Edition of the World Health Organization (WHO) classification of Head and Neck Tumors, there were 15 histological types of benign parotid tumors, of which the most common type was pleomorphic adenoma (PA), followed by Warthin tumor (WT) and basal cell adenoma (BCA) (2, 3). Most patients with benign parotid tumors present as a painless mass, frequently asymptomatic and incidentally detected (4). While BCA is a rare benign tumor, the incidence rises each year (5). Due to physicians’ lack of a more detailed awareness, it is commonly mistaken for a similar PA. Although both are benign tumors, the biology and surgical procedures are entirely different, such as PA has a higher recurrence and malignancy rate and a more comprehensive surgical range than BCA (68). To optimize the individualized surgical approach, reduce the incidence of postoperative complications, and inform preoperative patient counseling it is essential to distinguish preoperatively between PA and BCA (8, 9).

Fine needle aspiration biopsy (FNAB) is commonly utilized in the preoperative qualitative diagnosis of parotid tumors, but its effectiveness is controversial (10, 11). Therefore, preoperative imaging, especially CT and MRI, has a crucial role in assessing the location, nature, and relationship to surrounding structures of parotid tumors (12, 13). While MRI has high contrast soft-tissue resolution, its drawbacks are high cost, prolonged image acquisition time, and susceptibility to motion artifacts (14). In contrast, multiphase enhanced CT has the advantages of being convenient to operate, cheaper, and widely available for identifying parotid tumors (6, 15). The radiological features of BCA and PA overlap, thus accurately differentiating the two remains a challenge for most physicians, and their diagnostic accuracy depends strongly on observer expertise and experience (16).

Radiomics, an emerging and rapidly developing field, integrates radiology, oncology, and machine learning to perform an essential role in precision diagnosis, tumor treatment, and prognosis through high-throughput extraction and mining of a large number of image features (17). In recent years, with the advancement of artificial intelligence, the application of radiomics to identify parotid tumors has made significant progress (1820). The high accuracy, effectiveness, and reliability of prediction models are critical factors in facilitating the success of radiomics; thus, it is essential to compare different machine learning models based on radiomics (21). To our knowledge, nevertheless, no studies have investigated the different radiomic models applied to distinguish BCA from PA.

This study first investigated the performance of different radiomic models and the dominant scan phase from multiphasic CT in differentiating BCA from PA. In particular, clinical-radiological features and radiomics were combined to differentiate BCA from PA.

Materials and Methods

The Patient Cohort and CT Image Acquisition

This retrospective analysis included eligible patients in our hospital from January 2018 to October 2021, was approved by the Ethics Review Committee of our institution (approval number 2022-K34), and exempted from informed consent requirements. In this study, the patient selection and exclusion criteria were illustrated in Figure 1. Overall, 173 eligible patients were enrolled, including 121 cases of PA (50 males and 71 females; age 45.3 ± 15.9 years) and 52 cases of BCA (20 males and 32 females; age 54.4 ± 11.8 years). These patients were randomized in a 7:3 ratio into a training and testing cohort.

FIGURE 1
www.frontiersin.org

Figure 1 Workflow for patient enrollment.

CT scans were conducted with two 64 multidetector CT scanners (Discovery 750, GE Healthcare, Milwaukee, WI, USA; Somatom Sensation 64, Siemens Healthcare, Erlangen, Germany) with the following parameters: 120 kV; tube current modulation (150–240mAs); matrix, 512 × 512; section thickness, 5 mm; section interval, 5 mm. Non-ionic iodinated contrast medium (Ultravist 350 mg/ml, Bayer Schering Pharma, Berlin, Germany) was injected into the anterior cubital vein (dose 1.5 ml/kg) at a flow rate of 3.5 ml/s for all contrast-enhanced scans. All images were acquired from the skull base to the thorax inlet. Multiphase scans were collected for each patient: non-enhanced scan, arterial phase scan (40 seconds after intravenous contrast injection), venous phase scan (after 100 seconds), and delayed phase scan (after 4 or 5 minutes).

Image Segmentation, Radiomic Features Extraction and Selection

Multiphase CT images were stored in Digital Imaging and Communications in Medicine (DICOM) format and imported into ITK-SNAP software (version 3.8.0; http://www.itksnap.org/) for three-dimensional manual segmentation of regions of interest (ROIs). The ROIs were sketched along boundaries layer-by-layer on axial images by a radiologist with 5 years of experience and reviewed by another radiologist with 12 years of experience, blinded to the clinical information.

To extract robust features and assure model reproducibility, intra-observer intraclass correlation coefficients (ICC) were assessed. Fifty-two patients (36 PA and 16 BCA) were randomly selected for ROI segmentation again 1 month later by the same radiologist, and an ICC greater than 0.75 suggested good consistency (20). Image preprocessing was performed on the images and ROIs to counteract the potential effects of different imaging parameters on the extracted features, including resampling, normalizing, and discretizing the gray level of images (18). The package py-radiomics 3.0 in python software (version 3.7.6; https://www.python.org/) was employed for feature extraction. For each phase of CT images, 1036 radiomic features were extracted, including the shape, histogram, gray-level co-occurrence matrix (GLCM), gray-level dependence matrix (GLDM), gray-level run-length matrix (GLRLM), gray-level size zone matrix (GLSZM), and filter features (Laplacian of Gaussian and wavelet filters).

The feature dimensionality reduction and selection in the training cohort were as follows: first, the student’s t-test was used to select features that differed significantly between groups. Second, correlation analysis was applied to eliminate redundant parameters from advancement to model construction. If there was a high correlation (>0.8), the parameter with the high area under the receiver operating curve (ROC) was selected. Third, a least absolute shrinkage and selection operator (LASSO) regression model with 10-fold cross-validation was performed to select radiomic features with nonzero coefficients (Figure 2). All feature selection processes were performed on the training cohort and executed on the testing cohort. The final selected features were utilized for modeling.

FIGURE 2
www.frontiersin.org

Figure 2 Feature selection with the least absolute shrinkage and selection operator (LASSO) regression method. (A) Variation of tuning parameter (λ) for LASSO model, using 10-fold cross-validation. The vertical dotted lines indicate the best λ=0.028 was selected with a least binomial deviation. (B) The LASSO coefficient profiles with radiomic features of different log (λ). The vertical dotted line was the best λ with 10 radiomic features with non-zero coefficients.

Different Radiomic Models Developing and Validation

In machine learning, classifiers were considered supervised learning tasks that deduced functions from training data and analyzed the training data to predict unobserved groups (21). To select a classifier model with the higher capability to identify tumor data, our study chose three mainstream classifier models, including logistic regression (LR), K-nearest neighbors (KNN), and support vector machine (SVM) (22). The diagnostic performance of the three models was estimated by the area under the curve (AUC) of the receiver operating characteristic (ROC) curve, accuracy, sensitivity, and specificity. Then, the dominant phase and radiomic model were screened based on our study data.

Clinical and Radiological Data Analysis

Patients’ images and clinical data were taken from our institution’s routine clinical records and picture archiving and communication systems (PACS). We retrospectively analyzed the clinical parameters of age, disease duration, symptoms, gender, smoking/drinking status, inpatient number, and postoperative biopsy results. All CT images were assessed and deliberated upon separately by two radiologists with 5 and 34 years of head and neck experience, who were blinded to clinical results. The following parameters were evaluated: maximum diameter, tumor number, distribution, shape, boundary, tumor location, density, calcification, cystic degeneration, enhanced peak phase, enhancement degree, enhanced uniformity, and lymph node enlargement. Some radiological features were explained in the Supplementary Material. If there were multiple lesions in the parotid gland, the largest biopsy-confirmed lesion was chosen for analysis.

Clinical and Combined Models Construction and Validation

Univariate logistic regression analysis was conducted for each predictor variable in the training cohort, including clinical and radiological features, followed by multivariate logistic regression on statistically significant features to obtain final predictors for model development. Calculate the odds ratio (OR) and 95% confidence interval (CI) for each feature. We selected the optimal radiomic model to construct a combined model integrating clinical-radiological and four-phasic radiomic features for differentiating BCA from PA. The performances of different models were assessed and validated by training and testing cohorts, including AUC, accuracy, sensitivity, and specificity. A complete schematic was shown in Figure 3.

FIGURE 3
www.frontiersin.org

Figure 3 Flowchart of the present research protocol.

Statistical Analysis

Statistical analysis was performed with SPSS 26.0 software (IBM, Chicago, IL, USA) and R software (version 3.6.3; https://www.r-project.org/). Normally distributed continuous variables were expressed as mean value ± standard deviation using the student t-test. Categorical variables, presented as ratios, were applied to the chi-square or likelihood ratio test. The LASSO, LR, KNN, and SVM models were conducted based on ‘glmnet’, ‘glmnet’, ‘kknn’, and ‘e1071’ for R software packages or sklearn package for python software, respectively (23). All models were fitted with the caret R package (24). Statistical comparisons of AUCs among different classifiers with the DeLong test were used. A two-tailed p < 0.05 considered statistical significance.

Results

Radiomic Features, Different Radiomic Models Construction and Validation

A total of 4144 radiomic features were extracted from the four-phase CT image radiomic features. To ensure extraction stability, we eliminated features with ICC values below 0.75 and retained 841, 893, 908, and 859 radiomic features in non-enhanced, arterial, venous, and delayed phases, respectively. Then, 527, 379, 475, and 391 features were removed by t-test and correlation analysis from each phase, respectively. LASSO was applied to the rest features, and16 features with non-zero coefficients were kept after feature dimensionality reduction and selection (see Table 1 for details). These features were applied to construct three models of LR, KNN, and SVM in the training cohort. The performance of three models in distinguishing BCA from PA was evaluated in the testing cohort.

TABLE 1
www.frontiersin.org

Table 1 Radiomic features selection results.

The diagnostic performances of the three radiomic models (including LR, KNN, and SVM) are summarized in Table 2. In the training and testing cohorts, the preoperative predictive performances of the arterial phase and the delayed phase were the highest, followed by the other two phases. The AUCs of arterial and delayed phases in the training cohorts were respectively 0.822 (95% CI 0.674-0.935) and 0.838 (95% CI 0.724-0.943) with the SVM model, 0.703 (95% CI 0.597-0.855) and 0.711 (95% CI 0.627-0.854) with the KNN model, and finally 0.751 (95% CI 0.642-0.889) and 0.742 (95% CI 0.645-0.857) with the LR model. Based on our study data, Table 2 demonstrates that the SVM model attained the best performance. The AUCs of ROC curves of three models in the training and testing cohorts are presented in Figure 4. The Delong test showed no statistical difference between the arterial phase and the delayed phase, and between the venous phase and the plain scan (p=0.471, 0.685), but there were statistical differences between the arterial and delayed phases and the other two phases (p=0.017-0.047).

TABLE 2
www.frontiersin.org

Table 2 ROC curve analysis of different machine models in the training and testing cohorts.

FIGURE 4
www.frontiersin.org

Figure 4 The area under the curves (AUCs) of receiver operating characteristics (ROC) curve analysis for three models of LR, KNN, SVM in the training (A) and testing (B) cohorts. LR, logistic regression; KNN, K-nearest neighbor; SVM, support vector machine. NP, non-enhanced phase; AP, arterial phase; VP, venous phase; DP, delayed phase.

Clinical Features

A total of 173 patients (70 men and 103 women) were recruited for our study, including 121 patients in the training cohort and 52 patients in the testing cohort. Table 3 provides detailed information on the clinical and radiological characteristics of the patients. Figure 5 presents a case analysis of the radiological characteristics of PA and BCA, respectively. As shown in Table 3 and Table 4, univariate and multivariate logistic regression analyses indicated that age and enhanced-peak phase were independent predictors that differentiated PA from BCA. These clinical features were employed to construct a clinical model.

TABLE 3
www.frontiersin.org

Table 3 Clinical and radiological characteristics in the training and testing cohorts.

FIGURE 5
www.frontiersin.org

Figure 5 Example images of four-phase CT scans of PA and BCA. (A-D) Axial CT images of a 68-year-old female patient with a right-sided painless neck mass in the plain, arterial, venous, and delayed phases, separately. After CT examination, surgical pathology confirmed that the mass was BCA. (E-H) Axial CT images of a 23-year-old female patient with a right-sided painless neck mass in the order of plain, arterial, venous, and delayed phases. It was confirmed as PA by surgical pathology.

TABLE 4
www.frontiersin.org

Table 4 Univariate and Multivariable logistic regression analysis for selecting clinical features of model development.

Combined Model Construction and Validation

By integrating clinical predictors (age, enhanced-peak phase) with 16 radiomic features, we developed a combined model. Table 2 and Table 5 demonstrate that the combined model of the SVM classifier had the best predictive performance through comprehensively comparing the AUCs, specificity, and sensitivity of different models. The combined model had the greatest AUCs (0.885 and 0.834), accuracy (0.847 and 0.813), sensitivity (0.797 and 0.755), and specificity (0.953 and 0.904) in both the training and testing cohorts. Figure 6 depicts the ROC curves of the different models in the training and testing cohorts.

TABLE 5
www.frontiersin.org

Table 5 ROC curve analysis of the clinical model and the combined model with support vector machine in the training and testing cohorts.

FIGURE 6
www.frontiersin.org

Figure 6 The receiver operating characteristics (ROC) curve analysis of clinical, radiomics and combined models with support vector machine in training (A) and testing (B) cohorts.

Discussion

This study provided a detailed analysis of the advantageous scan phases and different radiomic models that differentiate PA and BCA. Our results revealed that the arterial and delayed phases were superior for differentiating parotid PA and BCA, and radiomics might help distinguish PA from BCA. In particular, the combined model, including clinical predictors and radiomic features, showed the best diagnostic performance in this study.

There were numerous parallels between PA and BCA. For instance, both were more common in females, were painless masses, were located in the parotid superficial lobe, were mostly unilateral, round or oval, with clear boundaries, and possible malignant transformations (6, 7, 25). Some studies indicated that the average age of BCA was about 10 years older than PA (6, 26). In our study, PA and BCA patients’ mean age was 45.3 ± 15.9 years and 54.4 ± 11.8 years, which was similar to the results of previous studies. In previous reports (6, 13), the average diameter of BCA was generally smaller than that of PA. This trend was also present in the current study, but there was no statistical difference, which might correlate with the uneven samples. Mukai et al. (25) reported that cystic components were observed more frequently in BCA than in PA, and were comparatively larger in BCA. In this study, 14 of 52 BCAs (26.9%) had cystic components, while 18 of 121 PAs (14.9%) had, although the difference was not statistically significant. Nevertheless, the overlapping features of BCA and PA may make preoperative diagnosis challenging, and there is no consensus to date to distinguish between the two. Therefore, a new, non-invasive, objective method is urgently required to differentiate BCA from PA.

Radiomics is a non-invasive, promising field that provides valuable information on diagnosis, prognosis, and individualized therapy through objective, quantitative assessments based on tumor heterogeneity (27). Our results indicated that several GLCM features were robust among radiomic signatures and participated in constructing predictive models. GLCM features capture comprehensive information about the direction, adjacent interval, and change amplitude of the image gray level, analyze the local patterns of the image and the basis of their arrangement rules; and reflect the relevant intra-tumor heterogeneity (28). This may be related to the tumor pathology types. PA contains mixed components such as mucus, parotid gland, and cartilage-like tissue, while BCA consists of basaloid cells, with a large number of vascular networks (capillaries and veins) arranged along the endothelium (7).

Several studies demonstrated that multiphase CT offered valuable information for tumor characterization, such as enhancement patterns, vascular structures, and tumor relationships to surrounding structures (29, 30). There were four histological subtypes of BCA, including solid, trabecular, tubular, and membranous, of which the solid subtype was the most common, while the membranous subtype had a high recurrence rate and malignant transformation (25, 26). Enhancement patterns vary by BCA histological type, with solid types displaying substantial early enhancement and a washout pattern like WT, while other types exhibit weaker early enhancement and the gradual enhancement pattern observed in PA (31). Consistent with the results of this study, we found that the diagnostic efficacy of differentiating BCA from PA in CT plain and three-phase CT-enhanced scans was best in the arterial and delayed phases. We speculated that it might be related to the different tissue components in PA and BCA.

It is crucial to develop robust predictive models to select valid indicators and appropriate modeling approaches (32). In this study, we investigated three frequently utilized machine learning classifiers, including linear LR, nonlinear KNN, and SVM. KNN primarily relied on the limited adjacent samples around the undetermined samples to determine the samples, which applied to handling the pending sample sets with class domain crossovers or more overlaps, but when the sample numbers were uneven, it would cause biased judgment results (33). With satisfactory robustness and effectiveness, SVM achieved almost the same performance as a large number of training samples with small training samples (34, 35). The combined model integrating clinical and radiomic features, with AUC and accuracy of 0.873 and 0.856 in the training cohort and 0.819 and 0.802 in the test cohort, exhibited the optimal discrimination performance among all predictive models. It suggested that although radiomic features of parotid tumors provide better discrimination than radiological features, clinic-radiological information was also valuable; only when combined with these features could the model accurately assess the entire tumor and facilitate precision medicine.

This study still had several limitations. First, it was a retrospective single-center study with potential selection bias. Second, several controversies connected with subjectivity in delineating the boundaries of manual segmentation (36) required further investigation of semiautomatic or completely automatic methods for tumor segmentation. Third, with an uneven ratio of patients between PA and BCA in this study, it was unclear whether this affected the modeling, and further large-sample, multicenter, and prospective studies would be required.

Conclusion

The present study demonstrated that the SVM model of the arterial and delayed phases contributed to distinguishing BCA from PA. Significantly, the combined model integrating clinical and radiomic features exhibited the best diagnostic performance. Before actual clinical application, multicenter and prospective studies with larger datasets should be conducted to validate the combined model.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by The First Affiliated Hospital of Chongqing Medical University. Written informed consent from the participants’ was waived, the legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.

Author Contributions

Study design and conception, Y-LZ, Y-NZ, DZ, and MW. Data collection, Y-LZ, J-NG, X-YZ, and X-YL. Radiomics data analysis, Y-NZ. Data analysis and discussion, Y-LZ, Y-NZ, C-F L, DZ, and MW. Manuscript writing, Y-LZ. Supervision and Revision, DZ and MW. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by the National Natural Science Foundation of China (81801717 and 82103206) and the Chongqing basic research and frontier exploration project of Chongqing Science & Technology Commission (cstc2021jcyj-msxmX0018). We thank the funders supporting this study.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

During the study process, our hospital provided a lot of support and convenience, for which we are very grateful.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2022.889833/full#supplementary-material

References

1. Bussu F, Parrilla C, Rizzo D, Almadori G, Paludetti G, Galli J. Clinical Approach and Treatment of Benign and Malignant Parotid Masses, Personal Experience. Acta Otorhinolaryngol Ital (2011) 31(3):135–43.

PubMed Abstract | Google Scholar

2. WHO. Classification of Tumours Editorial Board. In: Head and Neck Tumours, 5th, vol. 9. . Lyon (France: International Agency for Research on Cancer (2022). Available at: https://publications.iarc.fr/. WHO classification of tumours series.

Google Scholar

3. Skálová A, Hyrcza MD, Leivo I. Update From the 5th Edition of the World Health Organization Classification of Head and Neck Tumors: Salivary Glands. Head Neck Pathol (2022) 16(1):40–53. doi: 10.1007/s12105-022-01420-1

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Choi SY, Lee E, Kim E, Chung MK, Son YI, Baek CH, et al. Clinical Outcomes of Bulky Parotid Gland Cancers: Need for Self-Examination and Screening Program for Early Diagnosis of Parotid Tumors. BMC Cancer (2021) 21(1):178. doi: 10.1186/s12885-021-07902-9

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Louie KS, Mehanna H, Sasieni P. Trends in Head and Neck Cancers in England From 1995 to 2011 and Projections Up to 2025. Oral Oncol (2015) 51(4):341–8. doi: 10.1016/j.oraloncology.2015.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Zhan KY, Khaja SF, Flack AB, Day TA. Benisubgn Parotid Tumors. Otolaryngol Clin North Am (2016) 49(2):327–42. doi: 10.1016/j.otc.2015.10.005

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Hellquist H, Paiva-Correia A, Vander Poorten V, Quer M, Hernandez-Prera JC, Andreasen S, et al. Analysis of the Clinical Relevance of Histological Classification of Benign Epithelial Salivary Gland Tumours. Adv Ther (2019) 36(8):1950–74. doi: 10.1007/s12325-019-01007-3

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Quer M, Vander Poorten V, Takes RP, Silver CE, Boedeker CC, de Bree R, et al. Surgical Options in Benign Parotid Tumors: A Proposal for Classification. Eur Arch Otorhinolaryngol (2017) 274(11):3825–36. doi: 10.1007/s00405-017-4650-4

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Mantsopoulos K, Koch M, Klintworth N, Zenk J, Iro H. Evolution and Changing Trends in Surgery for Benign Parotid Tumors. Laryngoscope (2015) 125(1):122–7. doi: 10.1002/lary.24837

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Liu CC, Jethwa AR, Khariwala SS, Johnson J, Shin JJ. Sensitivity, Specificity, and Posttest Probability of Parotid Fine-Needle Aspiration: A Systematic Review and Meta-Analysis. Otolaryngol Head Neck Surg (2016) 154(1):9–23. doi: 10.1177/0194599815607841

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Stanek JJ, Khariwala SS. What Is the Utility of Fine-Needle Aspiration in Parotid Gland Neoplasms? Laryngoscope (2019) 129(6):1255–6. doi: 10.1002/lary.27549

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Xu Z, Zheng S, Pan A, Cheng X, Gao M. A Multiparametric Analysis Based on DCE-MRI to Improve the Accuracy of Parotid Tumor Discrimination. Eur J Nucl Med Mol Imaging (2019) 46(11):2228–34. doi: 10.1007/s00259-019-04447-9

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Shi L, Wang YX, Yu C, Zhao F, Kuang PD, Shao GL. CT and Ultrasound Features of Basal Cell Adenoma of the Parotid Gland: A Report of 22 Cases With Pathologic Correlation. AJNR Am J Neuroradiol (2012) 33(3):434–8. doi: 10.3174/ajnr

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Prasad RS. Parotid Gland Imaging. Otolaryngol Clin North Am (2016) 49(2):285–312. doi: 10.1016/j.otc.2015.10.003

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Liu Y, Li J, Tan YR, Xiong P, Zhong LP. Accuracy of Diagnosis of Salivary Gland Tumors With the Use of Ultrasonography, Computed Tomography, and Magnetic Resonance Imaging: A Meta-Analysis. Oral Surg Oral Med Oral Pathol Oral Radiol (2015) 119(2):238–245.e2. doi: 10.1016/j.oooo.2014.10.020

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Vogl TJ, Albrecht MH, Nour-Eldin NA, Ackermann H, Maataoui A, Stöver T, et al. Assessment of Salivary Gland Tumors Using MRI and CT: Impact of Experience on Diagnostic Accuracy. Radiol Med (2018) 123(2):105–16. doi: 10.1007/s11547-017-0813-z

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Liu Z, Wang S, Dong D, Wei J, Fang C, Zhou X, et al. The Applications of Radiomics in Precision Diagnosis and Treatment of Oncology: Opportunities and Challenges. Theranostics (2019) 9(5):1303–22. doi: 10.7150/thno.30309

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Xu Y, Shu Z, Song G, Liu Y, Pang P, Wen X, et al. The Role of Preoperative Computed Tomography Radiomics in Distinguishing Benign and Malignant Tumors of the Parotid Gland. Front Oncol (2021) 11:634452. doi: 10.3389/fonc.2021.634452

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Xia X, Feng B, Wang J, Hua Q, Yang Y, Sheng L, et al. Deep Learning for Differentiating Benign From Malignant Parotid Lesions on MR Images. Front Oncol (2021) 11:632104. doi: 10.3389/fonc.2021.632104

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Zheng YM, Li J, Liu S, Cui JF, Zhan JF, Pang J, et al. MRI-Based Radiomics Nomogram for Differentiation of Benign and Malignant Lesions of the Parotid Gland. Eur Radiol (2021) 31(6):4042–52. doi: 10.1007/s00330-020-07483-4

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Parmar C, Grossmann P, Bussink J, Lambin P, Aerts HJWL. Machine Learning Methods for Quantitative Radiomic Biomarkers. Sci Rep (2015) 5:13087. doi: 10.1038/srep13087

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Delzell DAP, Magnuson S, Peter T, Smith M, Smith BJ. Machine Learning and Feature Selection Methods for Disease Classification With Application to Lung Cancer Screening Image Data. Front Oncol (2019) 9:1393. doi: 10.3389/fonc.2019.01393

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Feng Z, Rong P, Cao P, Zhou Q, Zhu W, Yan Z, et al. Machine Learning-Based Quantitative Texture Analysis of CT Images of Small Renal Masses: Differentiation of Angiomyolipoma Without Visible Fat From Renal Cell Carcinoma. Eur Radiol (2018) 28:1625–33. doi: 10.1007/s00330-017-5118-z

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Kuhn M, Weston S, Williams A, Keefer C, Engelhardt A, Cooper T, et al. Caret: Classification and Regression Training. R Package Version 6.0-80 (2018). Available at: https://CRAN.R-project.org/package=caret.

Google Scholar

25. Mukai H, Motoori K, Horikoshi T, Takishima H, Nagai Y, Okamoto Y, et al. Basal Cell Adenoma of the Parotid Gland; MR Features and Differentiation From Pleomorphic Adenoma. Dentomaxillofac Radiol (2016) 45(4):20150322. doi: 10.1259/dmfr.20150322

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Xu ZF, Yong F, Yu T, Chen YY, Gao Q, Zhou T, et al. Different Histological Subtypes of Parotid Gland Tumors: CT Findings and Diagnostic Strategy. World J Radiol (2013) 5(8):313–20. doi: 10.4329/wjr

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More Than Pictures, They Are Data. Radiology (2016) 278(2):563–77. doi: 10.1148/radiol.2015151169

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, et al. Decoding Tumour Phenotype by Noninvasive Imaging Using a Quantitative Radiomics Approach. Nat Commun (2014) 5:4006. doi: 10.1038/ncomms5006

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Reginelli A, Clemente A, Renzulli M, Maggialetti N, Santagata M, Colella G, et al. Delayed Enhancement in Differential Diagnosis of Salivary Gland Neoplasm. Gland Surg (2019) 8(Suppl 3):S130–5. doi: 10.21037/gs.2019.03.03

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Jin GQ, Su DK, Xie D, Zhao W, Liu LD, Zhu XN. Distinguishing Benign From Malignant Parotid Gland Tumours: Low-Dose Multi-Phasic CT Protocol With 5-Minute Delay. Eur Radiol (2011) 21(8):1692–8. doi: 10.1007/s00330-011-2101-y

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Murayama Y, Kamitani T, Sagiyama K, Yamasaki Y, Hida T, Matsuura Y, et al. Evaluation of MR Imaging Findings Differentiating Parotid Basal Cell Adenomas From Other Parotid Tumors. Eur J Radiol (2021) 144:109980. doi: 10.1016/j.ejrad.2021.109980

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Xu Z, Jin Y, Wu W, Wu J, Luo B, Zeng C, et al. Machine Learning-Based Multiparametric Traditional Multislice Computed Tomography Radiomics for Improving the Discrimination of Parotid Neoplasms. Mol Clin Oncol (2021) 15(5):245. doi: 10.3892/mco.2021.2407

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Nazari M, Shiri I, Zaidi H. Radiomics-Based Machine Learning Model to Predict Risk of Death Within 5-Years in Clear Cell Renal Cell Carcinoma Patients. Comput Biol Med (2021) 129:104135. doi: 10.1016/j.compbiomed.2020.104135

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Huang S, Cai N, Pacheco PP, Narrandes S, Wang Y, Xu W. Applications of Support Vector Machine (SVM) Learning in Cancer Genomics. Cancer Genomics Proteomics (2018) 15(1):41–51. doi: 10.21873/cgp.20063

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Sanz H, Valim C, Vegas E, Oller JM, Reverter F. SVM-RFE: Selection and Visualization of the Most Relevant Features Through non-Linear Kernels. BMC Bioinform (2018) 19(1):432. doi: 10.1186/s12859-018-2451-4

CrossRef Full Text | Google Scholar

36. Lohmann P, Bousabarah K, Hoevels M, Treuer H. Radiomics in Radiation Oncology-Basics, Methods, and Limitations. Strahlenther Onkol (2020) 196(10):848–55. doi: 10.1007/s00066-020-01663-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: radiomic analysis, machine learning, computed tomography, parotid pleomorphic adenoma, basal cell adenoma

Citation: Zheng Y-l, Zheng Y-n, Li C-f, Gao J-n, Zhang X-y, Li X-y, Zhou D and Wen M (2022) Comparison of Different Machine Models Based on Multi-Phase Computed Tomography Radiomic Analysis to Differentiate Parotid Basal Cell Adenoma From Pleomorphic Adenoma. Front. Oncol. 12:889833. doi: 10.3389/fonc.2022.889833

Received: 04 March 2022; Accepted: 13 June 2022;
Published: 12 July 2022.

Edited by:

Krishnakumar Thankappan, Amrita Institute of Medical Sciences and Research Centre, India

Reviewed by:

Tao Yu, China Medical University, China
Karolina Markiet, Medical University of Gdansk, Poland

Copyright © 2022 Zheng, Zheng, Li, Gao, Zhang, Li, Zhou and Wen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Di Zhou, zhoudi@cqmu.edu.cn; Ming Wen, liuyucun65@163.com

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.