ORIGINAL RESEARCH article

Front. Oncol., 20 March 2020

Sec. Cancer Imaging and Image-directed Interventions

Volume 10 - 2020 | https://doi.org/10.3389/fonc.2020.00369

Clinical, Conventional CT and Radiomic Feature-Based Machine Learning Models for Predicting ALK Rearrangement Status in Lung Adenocarcinoma Patients

  • 1. Department of Radiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China

  • 2. 4+4 MD Program, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China

  • 3. Deepwise AI Lab, Deepwise Inc., Beijing, China

  • 4. Department of Epidemiology and Biostatistics, Institute of Basic Medicine Sciences, Chinese Academy of Medical Sciences and School of Basic Medicine, Peking Union Medical College, Beijing, China

  • 5. Department of Pathology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China

Abstract

Objectives: To predict the anaplastic lymphoma kinase (ALK) mutations in lung adenocarcinoma patients non-invasively with machine learning models that combine clinical, conventional CT and radiomic features.

Methods: This retrospective study included 335 lung adenocarcinoma patients who were randomly divided into a primary cohort (268 patients; 90 ALK-rearranged; and 178 ALK wild-type) and a test cohort (67 patients; 22 ALK-rearranged; and 45 ALK wild-type). One thousand two hundred and eighteen quantitative radiomic features were extracted from the semi-automatically delineated volume of interest (VOI) of the entire tumor using both the original and the pre-processed non-enhanced CT images. Twelve conventional CT features and seven clinical features were also collected. Normalized features were selected using a sequential of the F-test-based method, the density-based spatial clustering of applications with noise (DBSCAN) method, and the recursive feature elimination (RFE) method. Selected features were then used to build three predictive models (radiomic, radiological, and integrated models) for the ALK-rearranged phenotype by a soft voting classifier. Models were evaluated in the test cohort using the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity, and specificity, and the performances of three models were compared using the DeLong test.

Results: Our results showed that the addition of clinical information and conventional CT features significantly enhanced the validation performance of the radiomic model in the primary cohort (AUC = 0.83–0.88, P = 0.01), but not in the test cohort (AUC = 0.80–0.88, P = 0.29). The majority of radiomic features associated with ALK mutations reflected information around and within the high-intensity voxels of lesions. The presence of the cavity and left lower lobe location were new imaging phenotypic patterns in association with ALK-rearranged tumors. Current smoking was strongly correlated with non-ALK-mutated lung adenocarcinoma.

Conclusions: Our study demonstrates that radiomics-derived machine learning models can potentially serve as a non-invasive tool to identify ALK mutation of lung adenocarcinoma.

Introduction

Non-small cell lung cancer (NSCLC), especially lung adenocarcinoma, is the leading cause of cancer-related deaths worldwide (, ). The occurrence of fused anaplastic lymphoma kinase (ALK) gene in NSCLC patients is ~5% in western countries, but ALK mutations have become the second most significant molecular mutations in the regimen of NSCLC treatment following epidermal growth factor receptor (EGFR) mutations (–). The positivity rate of ALK is similar in the Asian population with NSCLC (4.9%) and is higher in those with lung adenocarcinomas (6.03%) (). The accurately screening of ALK mutation patients has thus become a pivotal step in treating NSCLC.

Traditional molecular tests for detecting ALK rearrangements including fluorescence in situ hybridization (FISH) and immunohistochemistry (IHC) are limited in the detection of genetic mutations and monitoring of therapeutic effects. Firstly, the required biopsies or surgical resection may not be attainable for vulnerable and advanced cancer patients. In addition, recent studies have reported a 30–87.5% intra-tumoural genetic heterogeneity rate for ALK fusions in NSCLCs, which challenges the accuracy of traditional ALK fusion tests based on tissues from a routine biopsy procedure (–). Moreover, given the low occurrence of ALK mutations among NSCLCs, the purchasing of the devices and antibodies required for such molecular tests were cost-inefficient for both hospitals and patients. Therefore, a non-invasive, convenient, and more reliable procedure for detecting ALK mutations is necessary.

Computed tomography (CT) is widely used to diagnose lung cancer. Recent studies have identified some CT imaging features that are associated with ALK gene rearrangements, including central tumor location, lobulated margin, solidity, pleural effusion, and distant metastasis (–). However, the evaluation of these conventional CT features depends heavily on the radiologist's experience and is time-consuming. Radiomics is a computer-based approach that has been widely applied in the diagnosis of lung neoplasm as well as the prediction of survival and gene mutations in lung cancer (–). It could help radiologists to identify additional information about tumor phenotype that is distinct from conventional findings of CT images (, , –). So far, the efficacy of radiomics in predicting the ALK gene in lung adenocarcinoma is still unknown. Therefore, the aim of our study is to (1) investigate the role of radiomic features in the prediction of ALK rearrangement status in lung adenocarcinomas, and (2) examine whether or not the addition of conventional CT characteristics and clinical data can improve the performance of the predictive model.

Materials and Methods

Patient Population

This retrospective study reviewed a total of 1,370 consecutive patients with pathologically confirmed lung adenocarcinoma by surgery or biopsy at our hospital from November 2015 to October 2018. The inclusion criteria were as follows: (1) availability of complete clinical data; (2) complete ALK mutation gene test results; (3) availability of complete thin-slice chest CT images (≤ 1 mm) reconstructed in Digital Imaging and Communications in Medicine (DICOM) format. The exclusion criteria were as follows: (1) CT images with severe artifacts; (2) patients receiving treatment before CT examinations; (3) interval between CT examination and surgery or biopsy >1 month; (4) multiple primary lung cancers. According to these criteria, 1,004 patients (112 ALK-positive and 892 ALK-negative) were eligible for the investigation. We randomly sampled 25% of the ALK-negative patients for enrolment in our study. Finally, 335 patients (112 ALK+ patients and 223 ALK– patients) were enrolled in this study. Twenty percent of the cases were randomly selected from the ALK+ and ALK– patients, respectively, to build an independent test cohort (67 cases, 22 ALK+ and 45 ALK–; median age, 57 years; range, 34–78 years) while the remaining being the primary cohort (268 cases, 90 ALK+ and 178 ALK–; median age, 58 years; range, 26–83 years). The flowchart of the eligibility and exclusion criteria is shown in Figure 1. The tumor lesions were all solitary. This retrospective study was approved by our institutional review board, and the need for informed patient consent was waived.

Figure 1

In regards to molecular profiles, the Ventana ALK (D5F3) CDx assay (the antibody clone D5F3 with OptiView amplification and OptiView detection, Ventana Medical Systems Inc.) coupled to a BenchMark XT automated staining instrument (Roche/Ventana Medical Systems Inc.) was used to test ALK fusion genes on the formalin-fixed paraffin-embedded tissues. Tissues were from either biopsy or surgical procedures. Specimens were scored binarily as positive if strong granular cytoplasmic brown staining was present in tumor cells. The international consensus guideline has now regarded the Ventana IHC method as an alternative to the conventional FISH test (). For the IHC score for ALK that was near the borderline, FISH tests were conducted to make the final decision.

Image Acquisition and Lesion Segmentation

Non-enhanced chest CT scans of 335 patients were carried out from the lung apex to the lung base using multi-detector CT (MDCT) scanners from Siemens (Somatom Definition Flash or Somatom Force; Forchheim, Germany), General Electric (Discovery CT750 HD; Milwaukee, WI), Philips (IQon CT; The Netherlands) or Toshiba (Aquilion 64; Tokyo, Japan) at the end of inspiration. Breath-hold training was carried out before each examination. The following scanning parameters were used: slice thickness/slice increment 1 mm (Somatom Definition Flash, Somatom Force and IQon CT) or 0.625 mm (Discovery CT750 HD) or 0.5 mm (Aquilion 64); rotation time 0.5 s (Somatom Definition Flash, Somatom Force, Aquilion 64, IQon CT) or 0.6 s (Discovery CT750 HD); pitch 0.984 (Aquilion 64, Discovery CT750 HD) or 1.2 (Somatom Definition Flash, Somatom Force, IQon CT); matrix 512 × 512; high and standard resolution algorithms; tube voltage 120 kVp, tube current adjusted automatically.

The anonymized thin-slice DICOM format non-enhanced CT images were imported into the Dr. Wise research platform, on which the lesions were automatically delineated with automatic pulmonary nodule detection and segmentation algorithms (). The detection model was a two-stage network that integrated both image and feature pyramids for nodule detection. The segmentation model was built based on the recurrent convolutional neural networks, and the attention map was used to improve model performance. Both the detection model and segmentation model were trained on a combination of public and in-house datasets (details in Supplementary Information 1.1). The results were confirmed and modified on axial images slice by slice with lung window settings (width, 1,200 HU, level, −500 HU) by two thoracic radiologists with 3 and 14 years of diagnostic imaging experience, without knowledge of pathological report information or other information. The volume of interest (VOI) was drawn according to the tumor-lung interface, excluding vascular, bronchus, atelectasis, and other adjacent normal tissues as much as possible. The whole process of the data analysis workflow is depicted in Figure 2.

Figure 2

Collection of Clinical Data and Evaluation of Conventional CT Features

Clinical data were collected through electronic medical records, including the following seven characteristics: age, sex, smoking history, smoking index, clinical stage, distal metastasis, and pathological invasiveness of the tumor. The clinical stage was determined according to the eighth edition of the American Cancer Society guidelines for NSCLC staging (). The pathological subtypes of adenocarcinoma in situ (AIS), minimally invasive adenocarcinoma (MIA) and invasive adenocarcinoma (IAC) were assessed according to the latest International Multidisciplinary Classification of Lung Adenocarcinoma guidelines ().

All thin-slice CT images were evaluated by 2 radiologists (with 14 and 3 years of chest CT interpretation experiences) who were blinded to each subject's clinical data. Decisions on CT findings were reached by consensus. Twelve CT morphological features were assessed, including maximum diameter, mean CT attenuation, lesion location, involved lobe, density, margin, cavity, calcification, pleural retraction sign, pleural effusion, pericardial effusion, and local lymphadenopathy. The definitions and scoring rules of the clinical features and conventional CT features are described in Supplementary Table 1.

Radiomic Feature Extraction

The images were resampled to a pixel spacing of 1.0 mm in three anatomical directions to offset the interference caused by the inconsistent spatial resolution. Then high-pass and low-pass wavelet filters or Laplacian of Gaussian (LoG) filters with different σ parameters were employed to pre-process the original image. The results of the pre-processed images from one ALK+ case and one ALK– case after each pre-processing technique are illustrated in Figure 3. A total of 1,218 radiomic features were extracted from the segmented three-dimensional VOIs of the tumor on non-enhanced CT images and the pre-processed images. The features quantified the phenotypic characteristics of the tumors and were divided into three groups: first-order features, shape features, and texture features. The texture features included gray level co-occurrence matrix (GLCM), gray level size zone matrix (GLSZM), gray level run length matrix (GLRLM), and gray level dependence matrix (GLDM) features. All steps above were performed using the PyRadiomics tool (version 2.1.0). The demonstration of filtering and the detailed explanations of all radiomic features can be found in the Supplementary Informations 1.2, 1.3.

Figure 3

Feature Selection and Development of Predictive Models

We grouped the features into three sets—the radiomic set (radiomic features), the radiological set (radiomic features + conventional CT features), and the integrated set (radiomic features + conventional CT features + clinical features). Each of the three sets was selected and then used to develop the radiomic model, radiological model and the integrated model in the primary cohort individually. To maximize the generalization ability of our model and to reduce the bias of the performance evaluation, the entire feature selection and model training procedure was fed into a repetitive (10 runs) 10-fold cross-validation using the primary cohort. The discriminative score for each patient was obtained from averaging the final predictive probabilities of the classifiers. The area under the curve (AUC) was calculated from the assembled probability. The optimized hyper-parameters of the feature selection and model training procedure were obtained by a grid search that maximized the AUC of the repetitive 10-fold cross-validation. After the hyper-parameters were determined, the model was re-trained using the entire primary dataset and the performance on the test cohort was viewed as the estimation of the true performance of our model. The above procedures were performed by the Scikit-learn software package (Version: 0.20.3) on the Dr. Wise research platform.

Before the feature selection procedure, the features were pre-processed to fit the machine-learning algorithm, including Min–Max scaling for all numerical features and one-hot encoding for categorical features. We used a three-step sequential procedure that was consisted of the F-test-based method, the density-based spatial clustering of applications with noise (DBSCAN) method (), and the recursive feature elimination (RFE) method (). The F-test-based method examined the difference of means of each feature between the ALK-rearranged group and the wild-type group, and features with smaller P-values were retained. In the unsupervised DBSCAN method, the paired features with high Pearson correlation coefficients were clustered. The border of the cluster was defined by the radius of the cluster (eps) and the minimum number of points within the cluster (min sample size). Within each cluster, only the feature with the smallest P-value in the previous method was remained at this step. Besides, non-clustered features were also retained. The logistic regression (LR) based RFE method was used as the last selection process, in which we set the regularization intensity to 0.5 and penalty as L1. For each iteration, two features with the least coefficients were pruned until the desired number of features to select was eventually reached.

A soft voting classifier was used to build the predictive model. In this classifier, the average of the predicted probabilities of being ALK+ trained with the LR model and that trained with the decision tree (DT) model was used as the final predictive probability of the predictive model.

Statistical Analysis

The differences in all variables between ALK-positive group and ALK-negative group were assessed using Mann-Whitney U-test or independent samples t-test for continuous variables, and chi-square test or Fisher's exact test for categorical variables as appropriate. This step was performed with SPSS Statistics 20.0 (IBM Corporation, NY, USA). The predictive models were analyzed using the receiver operating characteristics (ROC) curve. The AUC, 95% confidence interval (CI) for AUC, accuracy, sensitivity, and specificity were calculated. The cut-off discriminative score to differentiate ALK-mutated patients and ALK wild-type patients was determined by maximizing the Youden index in the training process. The above analyses were performed by the Scikit-learn software package (Version: 0.20.3) and the Matplotlib package (Version 3.1.0) on the Dr. Wise research platform. Lastly, the DeLong test was used for pairwise comparisons among the three models using MedCalc software (Version 19.0.2). A two-sided P < 0.05 was considered statistically significant throughout the study.

Results

Clinical and Conventional CT Features

Among the entire cohort, 269 (80.3%) patients underwent surgical procedures and 66 (19.7%) underwent diagnostic biopsies. The results of clinical features in the primary and the test cohort are listed in Table 1. The rates for the number of ALK-mutated patients vs. ALK-negative patients in the primary and the test cohort were both close to 1:2. All clinical characteristics but the smoking history (P = 0.028) for patients in the primary and the test cohort showed no statistical difference.

Table 1

CharacteristicsPrimary cohortIndependent test cohort
Total/%ALK–/%ALK+/%P-valuebTotal/%ALK–/%ALK+/%P-valueb
Age (yearsa)57 ± 10 (26–83)59 ± 10 (28–83)54 ± 10 (26–73)<0.001*57 ± 11 (34–78)59 ± 10 (40–78)54 ± 10 (34–76)0.116
Sex
 Male113/42.276/42.737/41.10.80426/38.819/42.27/31.80.412
 Female155/57.8102/57.353/58.941/61.226/57.815/68.2
Smoking history
 Never182/67.9111/62.471/78.9<0.001*50/74.633/73.317/77.30.578
 Current74/27.665/36.59/10.010/14.98/17.82/9.1
 Former12/4.52/1.110/11.17/10.44/8.93/13.6
SI (pack-years)
 SI ≤ 10208/77.6127/71.381/90.00.002*55/82.136/8019/86.40.581
 10 <SI < 209/3.48/4.51/1.12/3.02/4.40/0
 SI ≥ 2051/19.043/24.28/8.910/14.97/15.63/13.6
Pathology
 AIS12/4.510/5.62/2.20.1091/1.51/2.20/00.410
 MIA22/8.218/10.14/4.47/10.46/13.31/4.5
 IAC234/87.3150/84.384/93.359/88.138/84.421/95.5
DM (−)244/91.0174/97.870/77.8<0.001*58/86.643/95.615/68.20.004*
DM (+)24/9.04/2.220/22.2(Fisher)9/13.42/4.47/31.8(Fisher)
Clinical stage
 I176/65.7141/79.235/38.9<0.001*46/68.736/8010/45.50.002*
 II32/11.916/9.016/17.84/6.03/6.71/4.5
 III15/5.67/3.98/8.96/9.04/8.92/9.1
 IV45/16.814/7.931/34.411/16.42/4.49/40.9

Clinical characteristics of ALK– and ALK+ lung adenocarcinoma patients in the primary and test cohort.

The data are displayed as n/%, except where otherwise noted. No significant difference exists between the primary and test cohort for all demographic characteristics (P > 0.05) but the smoking history (P = 0.028).

a

Mean ± standard deviation (range).

b

ALK– group vs. ALK+ group.

*

P < 0.05.

ALK, anaplastic lymphoma kinase; AIS, adenocarcinoma in situ; MIA, minimally invasive adenocarcinoma; IAC, invasive adenocarcinoma; SI, smoking index; DM, distant metastasis; Fisher, Fisher's exact test.

In the primary cohort, the patients in the ALK-positive group were significantly younger than those in the ALK-negative group (P < 0.001). In addition, more patients in the ALK mutation group had advanced lung cancers (stages III and IV), distant metastases and no smoking history than those in the ALK wild-type group. In terms of conventional CT features (see Table 2), ALK mutated lesions were found to have larger size and hyper-attenuation, and tended to be solid, lobulated, with more prevalence of pleural effusion, pericardial effusion, and local lymphadenopathy (P < 0.01). There was a higher percentage of central tumors in the ALK+ group than in the ALK– group (P = 0.008), although the peripheral lesions were more common within each group. Cavities were slightly more frequent in lesions with ALK mutations (P = 0.039).

Table 2

FeaturesPrimary cohortIndependent test cohort
Total/%ALK–/%ALK+/%P-valuebTotal/%ALK–/%ALK+/%P-valueb
mDia. (mm)a19 ± 1618 ± 1521 ± 230.007*22 ± 1918 ± 1526 ± 220.089
CT attenuation (HU)a−214 ± 476−397 ± 455−7 ± 197<0.001*5 ± 289−35 ± 40926 ± 380.001*
Location
 Central43/16.021/11.822/24.40.008*12/17.94/8.98/36.40.014*
 Peripheral225/84.0157/88.268/75.655/82.141/91.114/63.6(Fisher)
Lobe
 RUL78/29.157/32.021/23.30.28016/23.912/26.74/18.20.274
 RML14/5.210/5.64/4.40/00/00/0
 RLL58/21.640/22.518/20.017/25.411/24.46/27.3
 LUL65/24.343/24.222/24.419/28.414/31.15/22.7
 LLL51/19.027/15.224/26.713/19.48/17.85/22.7
 Mixed2/0.71/0.61/1.12/3.00/02/9.1
Density
 pGGO83/31.074/41.69/10.0<0.001*10/14.910/22.20/0<0.001*
 pSolid69/25.751/28.718/20.025/37.322/48.93/13.6
 Solid116/43.353/29.863/70.032/47.813/28.919/86.4
Margin
 Spiculated115/42.986/48.329/32.20.004*35/52.229/64.46/27.30.009*
 Lobulated120/44.867/37.653/58.928/41.813/28.915/68.2
 Smooth33/12.325/14.08/8.94/6.03/6.71/4.5
Cavity (–)244/91.0167/93.877/85.60.039*63/94.042/93.321/95.51.000
Cavity (+)24/9.011/6.213/14.44/6.03/6.71/4.5(Fisher)
Calcification (–)256/95.5170/95.586/95.61.00060/89.641/91.119/86.40.675
Calcification (+)12/4.58/4.54/4.4(Fisher)7/10.44/8.93/13.6(Fisher)
Plu. retraction (–)133/49.685/47.848/53.30.38826/38.818/40.08/36.40.774
Plu. retraction (+)135/50.493/52.242/46.741/61.227/60.014/63.6
Plu. effusion (–)237/88.4168/94.469/76.7<0.001*57/85.144/97.813/59.1<0.001*
Plu. effusion (+)31/11.610/5.621/23.410/14.91/2.29/40.9(Fisher)
Per. effusion (–)258/96.3178/10080/88.9<0.001*58/86.643/95.615/68.20.004*
Per. effusion (+)10/3.70/010/11.1(Fisher)9/13.42/4.47/31.8(Fisher)
Lymph. (–)205/76.5158/88.847/52.2<0.001*48/71.638/84.410/45.50.001*
Lymph. (+)63/23.520/11.243/47.819/28.47/15.612/54.5

Conventional CT features of ALK– and ALK+ lung adenocarcinoma patients in the primary and test cohort.

The data are displayed as n/%, except where otherwise noted.

a

Median ± interquartile interval.

b

ALK– group vs. ALK+ group.

*

P < 0.05.

ALK, anaplastic lymphoma kinase; mDia., maximum diameter; RUL, right upper lobe; RML, right middle lobe; RLL, right lower lobe; LUL, left upper lobe; LLL, left lower lobe; pGGO, pure ground-glass opacity; pSolid, partial solid; Plu., pleural; Per., pericardial; Lymph., lymphadenopathy; Fisher, Fisher's exact test.

Features Selection and Model Construction

Figure 4 depicts the procedure of feature selection sequences. The final models contained 30, 20, and 30 features in the radiomic, radiological, and integrated models, respectively. The hyper-parameters associated with each selection method in each predictive model are displayed in Supplementary Table 2. The majority of selected radiomic features throughout the three prediction models were first-order features and texture features. The only shape-based feature (Original_Shape_MajorAxisLength) was used in the integrated model. In the radiomic model, features that had positive non-zeros coefficients in both DT and LR model were Original_Firstorder_90Percentile, Original_Firstorder_Maximum, and Wavelet-LHH_GLDM_LDHGLE. For conventional CT features, pericardial effusion, local lymphadenopathy, lobulated margin, and the absence of pleural retraction sign were selected in both the radiological and integrated model as being correlated with ALK-rearranged status. The integrated model also adopted no cavity and left lower lobe lesions, as shown in Figure 5. The favorable clinical features for ALK-negative status (negative LR coefficients) were current smoking, early clinical stage (stage I) and male sex. The list of the selected features and their associated coefficients in DT and LR model are illustrated in Supplementary Tables 3–5.

Figure 4

Figure 5

Evaluation of Models and Comparison of Predictive Model Performance

The diagnostic performance of each model is shown in Table 3 and the results of ROC curve analysis are shown in Figure 6. The optimal thresholds that maximized the Youden index for the radiomic model, radiological model, and integrated model were 0.40, 0.33, and 0.34, respectively. The prediction results of each model when validating the cross-validation cohort and in the test cohort are shown in Figure 7. We predicted the lesion as ALK-positive if the discriminative score for that lesion was higher than the threshold in each model, and as ALK-negative if otherwise.

Table 3

Model namePrimary cohortIndependent test cohort
AUC (95% CI)ACCSENSPEAUC (95% CI)ACCSENSPE
RadiomicTrain1.00 (0.99–1.00)1.001.000.990.80 (0.69–0.89)0.730.730.73
Validation0.83 (0.79–0.88)0.760.700.80
RadiologicalTrain1.00 (0.99–1.00)1.001.001.000.86 (0.75–0.93)0.750.680.78
Validation0.85 (0.80–0.89)0.780.780.78
IntegratedTrain1.00 (0.99–1.00)1.001.000.990.88 (0.77–0.94)0.790.820.78
Validation0.88 (0.83–0.91)0.790.780.80

Diagnostic performance of each model in the primary cohort and test cohort.

In the primary cohort, the performance index of each model in the training and the validation set were displayed separately. The radiomic model contained the selected radiomic features only. The radiological model contained the selected conventional CT features in addition to the radiomic features. The integrated model contained the selected radiomic features, conventional CT features and clinical characteristics. AUC, area under the receiver operating characteristic curve; ACC, accuracy; SEN, sensitivity; SPE, specificity.

Figure 6

Figure 7

In the primary cohort, the performances of the three predictive models in the training set were close to perfect. In the validation set, the integrated model achieved the best performance (AUC = 0.88). A statistically significant difference in AUC was found between the integrated model and the radiomic model with the DeLong test (P = 0.01), but not between the integrated model and the radiological model (P = 0.1) or the radiological model and radiomic model (P = 0.25). In the test cohort, although the integrated model also showed the highest AUC (0.88) among the three predictive models, no statistical difference was found between any of the two models using DeLong test (P = 0.35 for radiomic vs. radiological; P = 0.29 for radiomic vs. integrated; P = 0.66 for radiological vs. integrated).

Discussion

In this study, we developed an integrated model that combined radiomic features, clinical data and conventional CT features (AUC = 0.88, accuracy = 0.79, sensitivity = 0.82, and specificity = 0.78 in the independent test cohort) for differentiating ALK mutations in lung adenocarcinoma patients. During this process, we identified that Original_Firstorder_90Percentile, Original_Firstorder_Maximum, and Wavelet-LHH_GLDM_LDHGLE were significant and robust radiomic features associated with ALK mutation. These features reflect abstract information from the distribution of pixel intensity and the texture morphology that cannot be detected with the naked eyes. We also found that the addition of conventional CT features to the radiomic model did not increase the model's efficacy, yet the clinical data, in combination with conventional CT features were able to significantly enhance the performance of the prediction model in the cross-validation set. Among the clinical features, smoking history was the most powerful factor to differentiate ALK mutated lung adenocarcinomas from the non-ALK mutated ones. Moreover, our study optimized the performance of models by using the automatic lesion segmentation techniques, involving features from filtered images, and adopting a soft voting classifier.

The model with radiomic features alone in our study reached an AUC of 0.83, which is not inferior to other previously established clinical models that were based on conventional CT features (also named as morphological or semantic CT features) and patients' clinical information (, , ). This suggests the strong efficacy of radiomics as tools to identify ALK-mutated tumours' phenotypic patterns on CT scans in lung adenocarcinoma patients. The construction of the radiomic model was purely based on features within the first-order and texture categories, which suggests that the intensity distribution of tumors was a strong predictive factor for ALK genetic mutation. This is consistent with findings in other radiomic studies (, , ). Among the selected radiomic features, Original_Firstorder_90Percentile, Original_Firstorder_Maximum, and Wavelet-LHH_GLDM_LDHGLE were the most significant and robust features associated with ALK mutations, which reflect tumour's intensity and textural features surrounding and within the high-intensity CT voxels. This finding could be related to the revelation that ALK+ lung tumors were more likely to be solid mass (, , , ).

In our study, conventional CT evaluations contained tumour's surrounding information that was typically not represented by radiomic features of tumor itself. In our radiological model, three out of the four selected conventional CT features reflected the relationship between tumor and its surrounding tissue. They were pericardial effusion, local lymphadenopathy, and no pleural retraction sign. These features and their correlations with ALK mutations have been identified in previous literature (, , ). These pathological changes around the ALK-mutated tumor may result from the infiltration of tumor cells, suggesting the more invasiveness nature of ALK-rearranged tumors (, ). In spite of this, the performance of the radiological model for predicting ALK status was not significantly enhanced with the addition of these conventional CT features. This phenomenon may be attributed to the inclusion of the LoG-processed features in our model. The LoG is a spatial filtering technique that enhances the marginal features from surrounding regions, which provides more information concerning tumour's surroundings. Dou et al.'s study revealed that radiomic features extracted from rims of tumors were able to predict distant metastases in locally advanced NSCLC (Concordance Index = 0.64) (), which suggests that radiomic features can reflect the invasiveness of the tumors. In fact, radiomic features and conventional CT features were highly correlated. Stephen et al.'s study illustrated that one radiologist-defined imaging feature was associated with multiple radiomic features (). In other words, radiomic features were expansions of the conventional CT features in detail to some degree. The finding in Stephen et al.'s study also explains another result that our radiological model had a much fewer number of features compared to the radiomic one at the final selection step.

In addition to the conventional CT features discussed above, we identified the intra-tumoural cavity and left lower lobe location were associated with the ALK mutation status. Previous studies found no difference in the prevalence of cavity between the ALK-mutated group and the control group, yet they either excluded both EGFR and ALK mutations in the ALK-negative group (, , ) or generalized the definition of cavity by including bubble lucence (, ). The lobar location preference for ALK mutations was only mentioned in Yoon's study (). More studies are warranted to establish a tight connection between these two features and ALK mutations status in lung adenocarcinomas.

The integrated model contained radiomic, conventional CT and clinical features, and showed the highest AUC score (0.88) in both the primary and the test cohorts. The enhancement was statistically significant in the primary cohort but not in the test cohort. We found that the standard errors of the discriminative scores for patients with different ALK mutation statuses in the test cohort were higher than those in the primary cohort in the corresponding mutation group. It was also reflected by a wider range of confidence interval for AUC in the test cohort. The relatively large variance of discriminative scores for patients was partly due to the limited sample size in the test cohort. In spite of this, the improved efficacy of the integrated model by adding clinical characteristics for lesions in the primary cohort suggests that clinical information was effective to improve the radiomic-based model for detecting ALK-mutated status. Adding more ALK-associated clinical variables such as carcinoembryonic antigen (CEA) level and histological growth pattern may further enhance the performance of the model (, ). Previously, the best predictive model for the detection of ALK mutations was from Yamamoto's study (AUC = 0.846), in which it contained age as the only selected clinical feature and several conventional CT features (). However, their work was based on enhanced CT images. The promising performance of the radiomic model in our study indicates that radiomic features extracted from non-enhanced CT images are adequate for establishing a convincing predictive model for ALK mutations in lung adenocarcinomas.

For the identified clinical features in our integrated model, smoking history had the highest discriminatory power (high weighting coefficient in both DT and LR), which is consistent with previous studies that observed more non-smokers in the ALK+ population (, ). Nonetheless, some integrated models for predicting ALK mutations did not remain smoking status as a significant index after their selection procedures (, ). This discrepancy may be caused by different model construction strategies and smoking cultures. Furthermore, we identified clinical stage I as an important clinical feature that was inversely associated with ALK rearrangements. This coincides with the finding that ALK mutations were more common in lung adenocarcinoma of stages III and IV in the univariate analysis. Similar results were found in Choi et al.'s study, in which ALK gene fusion was more likely to occur in lung cancer with a more advanced stage (). We also noticed that the only shape-based radiomic feature—Major_Axis_Length was picked in the integrated model. It measures the largest axis length in a three-dimensional VOI. Most early studies measured the maximal diameter of tumors on a 2D plane and did not find a correlation between tumor size and ALK mutation (, , , ), while others found smaller diameters in ALK mutated tumors (). Our study yielded a contradictory result that ALK-mutated tumors had a significantly larger diameter. These findings altogether suggest that the measurement of maximum diameter on a 2D plane is not representative of the real size of the tumor. Future studies should use the 3D axis length of tumors when building prediction models for better accuracy.

However, there are several limitations in our study. First, it is a retrospective study with patients from a single medical center. In the current study, we repeated the 10-fold cross-validation process 10 times to avoid overfitting and to minimize the optimism bias. Furthermore, an independent test cohort was used to validate the performance of our models. Despite, our model's generalizability should be further examined on data from a different medical center in the future. Second, we did not evaluate the effects of CEA and the maximum SUV value from PET/CT examination because such data were missing in approximately one-third of the patients. Third, we only examined radiomic and conventional features from the non-contrast enhanced CT images in this study due to the retrospective nature of the study. We can perform a prospective study to include features based on contrast-enhanced CT data of dual-energy scanning mode using dual-energy CT scanners to explore whether this can further improve the effectiveness of the predictive model in the future.

In conclusion, our findings highlight the feasibility of non-invasively predicting the ALK genetic status in lung adenocarcinomas using an integrated model that combines clinical, conventional CT, and radiomic features.

Statements

Data availability statement

All datasets generated for this study are included in the article/Supplementary Material.

Ethics statement

The studies involving human participants were reviewed and approved by Ethics Review Committee of Peking Union Medical College Hospital, Chinese Academy of Medical Sciences. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author contributions

LS, ZJ, and WS: study conceive and design. LS and ZZ: literature research. LS, ZZ, HW, and HD: data acquisition. LS, ZZ, LM, XL, and WH: data analysis and interpretation. LS and HD: evaluation the conventional thin-slice CT images. LS and ZZ: manuscript drafting. All authors manuscript revision for important intellectual content, approval of final version of submitted manuscript, manuscript editing, and had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Funding

This work was supported by grants from the National Public Welfare Basic Scientific Research Program of Chinese Academy of Medical Sciences (2019PT320008 and 2018PT32003). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Conflict of interest

LM and XL were employed by the company Deepwise Inc. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2020.00369/full#supplementary-material

    Abbreviations

  • ROC

    receiver operating characteristic

  • AUC

    area under the curve

  • CT

    computed tomography

  • DICOM

    digital imaging and communications in medicine

  • GGO

    ground-glass opacity

  • GLCM

    gray level co-occurrence matrix

  • GLSZM

    gray level size zone matrix

  • GLRLM

    gray level run-length matrix

  • GLDM

    gray level dependence matrix

  • AIS

    adenocarcinoma in situ

  • MIA

    minimally invasive adenocarcinoma

  • IAC

    invasive adenocarcinoma

  • NCCN

    National Comprehensive Cancer Network

  • NSCLC

    non-small cell lung cancer

  • CEA

    carcinoembryonic antigen

  • DBSCAN

    density-based spatial clustering of applications with noise

  • RFE

    recursive feature elimination

  • LR

    logistic regression

  • DT

    decision tree

References

Summary

Keywords

lung neoplasms, radiomics, tomography, X-ray computed, anaplastic lymphoma kinase, gene mutation

Citation

Song L, Zhu Z, Mao L, Li X, Han W, Du H, Wu H, Song W and Jin Z (2020) Clinical, Conventional CT and Radiomic Feature-Based Machine Learning Models for Predicting ALK Rearrangement Status in Lung Adenocarcinoma Patients. Front. Oncol. 10:369. doi: 10.3389/fonc.2020.00369

Received

02 February 2020

Accepted

03 March 2020

Published

20 March 2020

Volume

10 - 2020

Edited by

Huimao Zhang, First Affiliated Hospital of Jilin University, China

Reviewed by

Di Dong, Chinese Academy of Sciences, China; Zhuoli Zhang, Northwest University, United States

Updates

Copyright

*Correspondence: Wei Song Zhengyu Jin

This article was submitted to Cancer Imaging and Image-directed Interventions, a section of the journal Frontiers in Oncology

†These authors have contributed equally to this work

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics