AUTHOR=Zhen Shi-hui , Cheng Ming , Tao Yu-bo , Wang Yi-fan , Juengpanich Sarun , Jiang Zhi-yu , Jiang Yan-kai , Yan Yu-yu , Lu Wei , Lue Jie-min , Qian Jia-hong , Wu Zhong-yu , Sun Ji-hong , Lin Hai , Cai Xiu-jun 

TITLE=Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

JOURNAL=Frontiers in Oncology

VOLUME=Volume 10 - 2020

YEAR=2020

URL=https://www.frontiersin.org/journals/oncology/articles/10.3389/fonc.2020.00680

DOI=10.3389/fonc.2020.00680

ISSN=2234-943X

ABSTRACT=Background: Early-stage diagnosis and treatment can improve survivals of liver cancer patients. Dynamic contrast-enhanced MRI provides the most comprehensive information for differential diagnosis of liver tumors. However, MRI diagnosis is affected by subjective experience, deep learning may supply a new diagnostic strategy. We used convolutional neural networks(CNNs) to develop a deep learning system(DLS) to classify liver tumors basing-on enhanced MR images, unenhanced MR images, and clinical data including text and laboratory test results.2 This is a provisional file, not the final typeset article Methods: Using data from 1210 patients with liver tumors(N = 31608 images), we trained CNNs to get seven-way classifiers, binary classifiers and three-way malignancy-classifiers (Model A-Model G). Models were validated in an external independent extended cohort of 201 patients( N = 6816 images). Area under receiver operating characteristic (ROC) curve (AUC) were compared across different models. We also compared the sensitivity and specificity of models with the performance of three experienced radiologists.Results: Deep learning achieves performance on par with three experienced radiologists on classifying liver tumors to seven categories. Using only un-enhanced images, CNN performs well to distinguish malignant from benign liver tumors (AUC of 0·946(95% CI 0·914-0·979) vs 0·951 (0·919-0·982), P=0.664). New CNN combining unenhanced images with clinical data greatly improved the performance of classifying malignancy as hepatocellular carcinoma(AUC of 0.985 (0.960-1.000)),metastatic tumors(0.998 (0.989-1.000)) and other primary malignancy(0.963 (0.896-1.000)), and the agreement with pathology was 91.9%.These models mined diagnostic information in unenhanced images and clinical data by deep-neural-network, which were different with previous method that utilized enhanced images. The sensitivity and specificity of almost every category in these models reached the same high level compared to three experienced radiologists.Trained with data in various acquisition condition, DLS that integrated these models could be served as an accurate and time-saving assisted-diagnostic strategy for liver tumors in clinical setting even in absence of contrast agents. DLS therefore has the potential to avoid contrast-related side effects and reduce economic costs associated with current standard MRI inspection practices for liver tumor patients.