Impact Factor 3.707 | CiteScore 5.1
More on impact ›

Original Research ARTICLE

Front. Neurosci., 23 August 2019 | https://doi.org/10.3389/fnins.2019.00874

A Fully Automatic Framework for Parkinson’s Disease Diagnosis by Multi-Modality Images

  • 1School of Data Science, Fudan University, Shanghai, China
  • 2Fudan-Xinzailing Joint Research Center for Big Data, Fudan University, Shanghai, China
  • 3Department of Nuclear Medicine, Daping Hospital, Army Medical University, Chongqing, China
  • 4Department of Nuclear Medicine, North Huashan Hospital, Fudan University, Shanghai, China
  • 5PET Center, Huashan Hospital, Fudan University, Shanghai, China
  • 6Department of Radiology, Huashan Hospital, Fudan University, Shanghai, China

Background: Parkinson’s disease (PD) is a prevalent long-term neurodegenerative disease. Though the criteria of PD diagnosis are relatively well defined, current diagnostic procedures using medical images are labor-intensive and expertise-demanding. Hence, highly integrated automatic diagnostic algorithms are desirable.

Methods: In this work, we propose an end-to-end multi-modality diagnostic framework, including segmentation, registration, feature extraction and machine learning, to analyze the features of striatum for PD diagnosis. Multi-modality images, including T1-weighted MRI and 11C-CFT PET, are integrated into the proposed framework. The reliability of this method is validated on a dataset with the paired images from 49 PD subjects and 18 Normal (NL) subjects.

Results: We obtained a promising diagnostic accuracy in the PD/NL classification task. Meanwhile, several comparative experiments were conducted to validate the performance of the proposed framework.

Conclusion: We demonstrated that (1) the automatic segmentation provides accurate results for the diagnostic framework, (2) the method combining multi-modality images generates a better prediction accuracy than the method with single-modality PET images, and (3) the volume of the striatum is proved to be irrelevant to PD diagnosis.

Introduction

Parkinson’s disease (PD) is the second-most prevalent long-term neurodegenerative disease characterized by bradykinesia, rigidity and rest tremor (Postuma et al., 2015). At present, PD is responsible for about 346,000 deaths per year and is thus one of the major concerns of neuroscience community (Roth et al., 2018). The diagnosis of PD mainly refers to the Movement Disorder Society Clinical Diagnostic Criteria for Parkinson’s disease (MDS-PD Criteria) (Postuma et al., 2015). According to the MDS-PD criteria, the motor symptoms of PD are linked with the loss of dopaminergic neurons, which mainly affects the anatomical regions of the striatum (SARs). Therefore, SARs, which include the caudate nucleus, the putamen and the pallidum, are commonly explored (Strafella et al., 2017).

Functional neuroimaging of the presynaptic dopaminergic system is highlighted according to the MDS-PD criteria (Liu et al., 2018). Positron-emission tomography (PET) is one of the neuroimaging modalities that indicate the regional activity of the tissues. Accordingly, PET tracers are developed to observe the activity of the dopamine transporter (DAT) in early stage of PD, such as 11C-CFT, which is a biomarker of the presynaptic dopaminergic system with high sensitivity (Kazumata et al., 1998; Ilgin et al., 1999; Wang et al., 2013). However, due to the low resolution of the PET images, the anatomical and structural information related to the brain that PET can provide is limited. Therefore, the structural neuroimaging methods, such as T1-weighted magnetic resonance imaging (T1-MRI), are introduced to assist the multi-modality diagnosis of PD (Ibarretxe-Bilbao et al., 2011). Bu et al. (2018) worked on the subtypes of multiple system atrophy (MSA) utilizing T1-MRI and 11C-CFT PET. Huang et al. (2019) combined these two modalities with 18F-FDG PET and analyzed Rapid Eye Movement (REM) Sleep Behavior Disorder research. In both of their studies, T1-MR images were registered to PET images to identify the region of interest (ROIs) in the PET images.

Recently, researchers attempt to improve the accuracy in diagnostic methods with the help of machine learning algorithms, for example, the support vector machine (SVM) has been widely used. Long et al. (2012) used SVM to distinguish early PD patients from NL subjects utilizing resting-state functional MRI, and obtained an accuracy of 86.96%. Haller et al. (2012) used SVM and reached an accuracy of 97% when classifying PD from other atypical forms of Parkinsonism by combining Diffusion Tensor Imaging (DTI) and 123I ioflupane Single-Photon Emission Computed Tomography (SPECT). These works combining multi-modality imaging have proved the reliability of artificial intelligence (AI)-assisted PD diagnosis, while few works are reported including 11C-CFT PET, to the best of our knowledge.

In this work, we proposed an end-to-end multi-modality diagnostic framework for PD combining T1-MR and 11C-CFT PET images. In the framework, MR images were segmented by a U-Net (Ronneberger et al., 2015; Wong et al., 2018). The resulting segmentation was then used to locate the SARs of the PET images by registration. Finally, features extracted from these SARs were used to diagnose PD. Our main contributions include:

(1) We have shown that the automatic segmentation provides accurate results for the proposed diagnostic framework of PD.

(2) We have shown that MR images provide important information to obtain the SAR information in the PET images.

(3) We have demonstrated that the volume feature of the striatum is irrelevant to PD diagnosis.

Methodology

The proposed framework is shown in Figure 1. It contains three major steps: (1) segmentation, (2) registration, and (3) feature extraction and prediction. In the first two steps, MRI-assisted PET segmentation is performed by MRI segmentation and MRI-PET registration, and in the subsequent step, only information of PET images is considered for PD diagnosis.

FIGURE 1
www.frontiersin.org

Figure 1. The architecture of the proposed framework.

Striatum Segmentation via Deep Neural Network

To obtain the fine structure of the brain tissues, a 3D deep neural network, i.e., U-Net (Ronneberger et al., 2015; Wong et al., 2018), is implemented to segment the striatum in the MR images. The obtained segmentation is used as a reference for SAR localization and extraction in the subsequent procedures.

Figure 2 shows the network architecture for the segmentation, which outputs a mask indicating the segmented labels of the input image. The network further incorporates the idea of deep supervision introduced by Mehta and Sivaswamy (2017) for faster training convergence. Specifically, the network comprises encoding and decoding paths. The encoding path captures contextual information by residual blocks and max-pooling operations at different resolutions, while the decoding path sequentially recovers the spatial resolution and object boundaries. Besides, skip connections between the upsampled feature maps in the decoder and the corresponding feature maps in the encoder are employed for the combination of local and contextual information. Moreover, the deep supervision scheme is adopted to allow more direct backpropagation to the hidden layers for faster convergence. A final 1 × 1 × 1 convolution layer with a softmax function produces the segmentation probabilities. Gaussian blurring and dropout operations are adopted to avoid overfitting. A loss function is defined to handle the relatively small anatomical structures of labels for accurate segmentation, i.e.,

L = w D L D i c e + w C L C r o s s , (1)
FIGURE 2
www.frontiersin.org

Figure 2. The proposed segmentation network architecture. Each block is represented by (n,k,r), where n, k, and r denote number of channels, number of layers, and the dropout probability, respectively.

where, wD and wC denote the weights of LDice and LCross, respectively; LDice denotes the Dice-related loss, and LCross denotes the cross-entropy. They are respectively, given by

L D i c e = E i [ ( - ln D i c e i ) γ ] , (2)

with

D i c e i = 2 ( x δ i l ( x ) p i ( x ) ) x ( δ i l ( x ) + p i ( x ) ) , (3)

and

L C r o s s = E x [ - ln p l ( x ) ] . (4)

In Eq. (3), δil (x) is the Kronecker delta, which equals to 1 if the segmentation label i (x) equals to the ground-truth label l (x) at the voxel position x, and 0 otherwise; pi (x) is the probability of voxel x being labeled as i. In our implementations, we chose wD = 0.8, wC = 0.2 and γ = 0.3 for the loss function and pretrained the model using an Adam optimizer with a learning rate of 1× 10−3 for 10 epochs (Kingma and Ba, 2014). Due to the computational limitations, an ROI of MR images with a size of 96 × 96 × 96 voxels was cropped, which contains the whole structure of SARs.

We employ T1-MR brain images from the Alzheimer’s Disease Neuroimaging Initiative (ADNI1) database for pretraining, for the size of the clinical data used in this work is far from being enough for the U-Net training. Note that the information related to AD or other modality data is not used in this study, namely we solely employ the 1859 brain T1-MR images to assist the U-Net training. The ADNI MR images are segmented by the multi-atlas label propagation with the expectation-maximization (MALP-EM2) framework (Ledig et al., 2015). The manual segmentation of the caudate nucleus, the putamen and the pallidum are chosen to be the gold standards in the pretraining stage.

Combining Two-Modality Images via Image Registration

We propose to combine two-modality images for the automatic diagnosis of PD, where T1-MRI provides the morphological information of SARs, and 11C-CFT offers pathological information related to PD. The extraction of the SAR information from the MR images is achieved by the DNN segmentation method, as described in Section “Striatum Segmentation via Deep Neural Network.” With this information, one can extract the shape or substructure features from each of anatomical regions. For the combination of the two-modality images, we propose to use image registration, which propagates the anatomical and structural information of SARs in the MRI to the PET.

The registration in the multi-modality diagnostic framework is achieved via the zxhproj3 platform (Zhuang et al., 2011). Firstly, the image with prior label information is registered to the target PET image. The resulting transformation is then used to propagate the prior label information to the PET, which results in the automatic localization of the SARs for the target PET image. Since the MRI and PET images are from the same subject at the same acquisition session, we propose to use a rigid registration. By registration, the caudate nucleus, the putamen and the pallidum, as well as the parieto-occipital regions are labeled.

For comparisons, we propose a single-modality diagnostic framework using solely PET images. To achieve the fully automated diagnosis, we propose to achieve the anatomical information in the PET images via the same registration method used for the multi-modality scheme. In this scenario, the image with prior label information is defined using a pre-labeled PET template, and the registration between the template and the target PET is achieve via an affine registration following a pre-rigid registration.

Feature Extraction and Prediction

To extract adequate features from the SARs, the caudate nucleus and the putamen are further divided into three substructures using a k-means algorithm (Ng et al., 2006). After clustering, statistics of image intensity are calculated to represent the feature information in each region, including maximum, minimum, median, 1st and 3rd quantile, and mean of PET intensity. Several studies characterize radioactive uptake by the striatal-to-occipital ratio (SOR), as the parieto-occipital region is widely considered of lacking CFT uptake (Ma et al., 2002; Carbon et al., 2004; Huang et al., 2007). In this work, the SOR, which is defined as (striatum-occipital)/occipital, is calculated with each kind of intensity value. Meanwhile, the volumes of the six anatomical SARs are included into the feature set. In all, 90 features are generated (for a list of specific features, see Supplementary Table S1).

After feature extraction, a t-test is performed to analyze the significance of each feature. Setting significance level α = 0.01, features with a p-value less than 0.01 are considered as being statistically significant. Only significant features would be regarded as the arguments of the machine learning models.

Consequently, the SVM classifier is trained to classify the subjects (Haller et al., 2012; Long et al., 2012). Furthermore, to estimate the generalization ability and stability of the method, the leave-n-out cross-validation strategy is employed to evaluate the performance of the models. In addition, we implement the random forest algorithm to calculate the importance of the features (Gray et al., 2013).

Experiments

The following parts in this section are organized as follows. Section “Data Acquisition” describes the data used in this work; Section “Evaluation of Automatic Striatum Segmentation” validates the reliability of the automatic segmentation method; Section “Advantages of Multi-Modality Images” investigates the advantages of combining multi-modality images; and Section “Efficacy of Volume Features” explores the efficacy of the volume features of SARs for the diagnostic of PD.

Data Acquisition

Data used in this study was collected from the Department of Neurology, Huashan Hospital, Fudan University. It contains paired 11C-CFT PET and T1-MR images of PD patients and healthy participants. MR images were acquired by a 3.0-T MR scanner (DiscoveryTM MR750, GE Healthcare, Milwaukee, WI, United States). Each MR image was visually inspected to rule out motion artifacts (Bu et al., 2018; Huang et al., 2019). PET images were acquired by a Siemens Biograph 64 PET/CT scanner (Siemens, Munich, Germany) in three-dimensional (3D) mode. A CT transmission scan was first performed for attenuation correction. Static emission data were acquired 60 min after the intravenous injection of 370 MBq of 11C-CFT and lasted for 15 min. All subjects were scanned in a supine position with a dimly lighted and noise-free surrounding (Bu et al., 2018; Huang et al., 2019). The synchronous MRI data were acquired using a T1-weighted 3D inversion recovery spoiled gradient recalled acquisition (IR-SPGR) with the following parameters: TE/TR = 2.8/6.6 ms, inversion time = 400 ms, flip angle = 15°, matrix = 256 × 256 × 170, field-of-view = 24 cm, and slice thickness = 1 mm. MR and PET images acquisition for each subject had a time interval of no more than 3 months.

Forty-nine patients with PD and 18 age-matched normal control (NL) subjects were recruited. All subjects were screened and clinically examined by a senior investigator of movement disorders before entering the study and were followed up for at least 1 year. The diagnosis of PD was made referring to the MDS-PD Criteria. The Unified Parkinson’s Disease Rating Scale (UPDRS) and Hoehn and Yahr scale (HY) were assessed after the cessation of oral anti-parkinsonian medications (if used) for at least 12 h. The following exclusion criteria were used for the NL subjects’ recruitment: (1) being tested positive by the REM Sleep Behavior Disorder Single-Question Screen (Postuma et al., 2012), (2) a history of neurological or psychiatric illness, (3) a prior exposure to neuroleptic agents or drugs, (4) an abnormal neurological examination. The data are summarized in Table 1. In this study, gender proportion differences between groups could be ignored, as previous studies have shown no significant difference in DAT bindings between genders (Eshuis et al., 2009). The research was approved by the Ethics Committee of Huashan Hospital. All subjects or legally responsible relatives signed written informed consent in accordance with the Declaration of Helsinki before the study.

TABLE 1
www.frontiersin.org

Table 1. Summary for the studied dataset.

After data acquisition, both sides of the caudate nucleus, the putamen and the pallidum of each MR image were manually labeled by an experienced clinician from the Department of Neurology, Huashan Hospital. To ensure the qualities of the segmentation results, boundaries of these anatomical structures were double-checked by another clinician from the same department.

Evaluation of Automatic Striatum Segmentation

To test the performance of the segmentation network, three-fold cross-validation was performed. The whole dataset was split into three disjoint parts, and the model was fine-tuned for 5 epochs on the union of every two disjoint subsets. Table 2 illustrates the average Dice Similarity Coefficient (DSC) of each anatomical region, and Figure 3 provides a visualization of the segmentation results of five example cases. One can find that the left pallidum (colored goldenrod in Figure 3) is worst segmented with the maximal standard deviation while the right putamen (colored olive drab in Figure 3) is best segmented with the minimal standard deviation.

TABLE 2
www.frontiersin.org

Table 2. Average DSCs of the segmentation of each anatomy.

FIGURE 3
www.frontiersin.org

Figure 3. Visualization of the segmentation results with slices of the axial view (top row) and the coronal view (bottom row). Case 1 and case 2 are two worst segmentation results, and case 3, case 4 and case 5 are three median results. Values in the parentheses refer to the corresponding dice similarity coefficients. As for the legends, the colored contours represent the automatic segmentation boundaries while the colored blocks are the corresponding ground truth masks.

Figure 4 shows the average accuracy (ACC) and the number of wrong predictions with leave-n-out cross-validation of the different segmentation methods, i.e., automatically and manually. Both accuracies reached 100% when n = 1, and the accuracies and the numbers of wrong predictions of the two experiments result in no significant difference in a pairwise t-test (p-value = 0.1017). Furthermore, when training classifiers using features of manually segmented images and testing it using features of automatically segmented images, we still obtained 100% accuracy. All results indicate that the automatic segmentation provides accurate results for the proposed diagnostic framework of PD.

FIGURE 4
www.frontiersin.org

Figure 4. The results for the leave-n-out cross-validation of the classification with automatic segmentation and manual segmentation. Panel (A) presents the average ACC, and panel (B) presents the average number of wrong predictions. The horizontal axes in the two panels represent subjects numbers of the test set, i.e., the n in the leave-n-out cross-validation.

Advantages of Multi-Modality Images

To evaluate the influence of multi-modality images, the single-modality method using solely PET images was compared. In the multi-modality scheme, the MR images provides accurate anatomical and structural SAR information of the subject. By contrast, in the single-modality method this information is achieved by registering the PET images to a pre-labeled Automated Anatomical Labeling (AAL) PET template. We conducted the rest of the pipeline in the same way for the two methods.

Figure 5 shows the results of the comparative experiments with leave-n-out cross-validation. The results demonstrate that with the assistance of MR images, the performance of the multi-modality group is better than the single-modality PET group in the PD/NL task. When n = 1, the accuracy of the multi-modality group reached 100% in the PD/NL task, while the accuracy of the single-modality PET group was 98.51%.

FIGURE 5
www.frontiersin.org

Figure 5. The results for the leave-n-out cross-validation of the classification by the multi-modality diagnostic method and the single-modality method. Panel (A) presents the average ACC, and panel (B) presents the average number of wrong predictions. The horizontal axes in the two panels represent subjects numbers of the test set, i.e., the n in the leave-n-out cross-validation.

To test the uniformity of the classifiers based on the different groups, we also trained the classifier using features of multi-modality images and tested it using features of single-modality PET, and the accuracy dropped to 88.05%, with 8 subjects misclassified.

Efficacy of Volume Features

In the feature extraction step, t-tests were performed to evaluate the significances of all feature, and results indicated that the features of the volume are not statistically significant with α = 0.01 (see Supplementary Table S1 for more details). To further evaluate the effects of the volume of SARs, we compared the importance of different features based on groups with and without volume, as Table 3 shows. One can see that the importance values of the two groups are similar. Hence, the effect of volume to the model is negligible. Note that the volume is calculated based on the original MR images without downsampling.

TABLE 3
www.frontiersin.org

Table 3. Feature importance of groups with/without volume.

Discussion and Conclusion

In this work, we proposed a fully automatic framework for PD diagnosis. This method utilized two modalities, i.e., 11C-CFT PET and T1-MR imaging, performed MRI-assisted PET segmentation, selected features and employed SVM to give the predictions. To validate the performance of the framework, we applied the proposed method on the clinical data from Huashan Hospital.

One of the major differences between the proposed method and the traditional methods is that the SARs are located according to the labels of the automatic segmentation by U-Net. To evaluate the performance of the U-Net, we calculated the DSCs between automatic and manual segmentation. In addition, we compared the proposed pipeline, whose SARs were located according to the automatic segmentation, to the method whose SARs were manually segmented. The leave-n-out experiment shows the two methods performed comparably, indicating that the automatic segmentation could provide accurate results for the proposed diagnostic framework of PD. Further investigation of the feature importance of the two groups is illustrated in Table 4. It indicates that the minimum has lower importance than the first five features. Given that the striatum region has a higher uptake value compared with its adjacent areas, voxels with minimal intensity value are more likely to appear on the edge of the SARs. Therefore, the inaccurate delineation of the anatomical boundary as a potential result of the automatic segmentation could not cause a significant decline in the performance of the overall diagnostic framework.

TABLE 4
www.frontiersin.org

Table 4. Feature importance of groups with manual segmentation results and automatic segmentation results.

An alternative way to locate SARs for subsequent feature extraction is to apply a pre-labeled PET template by registration. In Section “Advantages of Multi-Modality Images,” AAL PET template was used as the PET template, and was registered to PET images for the localization of SARs. Experiments show that the diagnostic capability of this single-modality PET group is worse than the proposed multi-modality framework. Though the single-modality PET approach gives a favorable prediction, the multi-modality approach performs better. This is because the localization of the SARs occupies a significant place in the diagnostic framework, and the additional structural information from MR images can better locate SARs. Figure 6 demonstrates that the single-modality PET approach might be affected by the erroneous delineation of the SARs. The error could be attributed to the ignored inter-subject variations in brain structures when defining SARs from a PET template.

FIGURE 6
www.frontiersin.org

Figure 6. The comparison of gold standard and wrongly placed SARs of the wrongly predicted subject. Panel (A) shows the segmentation result in gold standard, and panel (B) shows the segmentation in the wrongly predicted subject. Images are in sagittal plane and have the same cursor position.

To test the uniformity of the classifiers based on different segmentation approaches, we trained classifiers using features of manually segmented multi-modality images, and tested it using features of other methods. When testing with features of multi-modality automatic segmentation method, we still obtained 100% accuracy, indicating that the features of manual and automatic segmentation are highly consistent. However, testing with the single-modality method resulted in an accuracy of 88.05%. The lower accuracy might be explained by the lack of adequate extracted features due to the falsely located SARs. Hence, compared with the multi-modality group, single-modality PET group naturally needs more feature engineering and better-designed algorithms.

In the feature extraction, features of volume were rejected according to the t-test. This could be the reason why the volume of SARs does not change significantly with the progression of PD, as concluded from the literature (Ibarretxe-Bilbao et al., 2011). Figure 7 shows the heatmaps of feature distribution on the SARs, displaying the influence of each subregion for the classification in the PD/NL task. The difference of influence is expressed by the color scale. One can find that the most relevant region influencing the separation of PD/NL is localized in the middle and rear of the putamen, then the pallidum, and the caudate nucleus reveals the least significance on this task.

FIGURE 7
www.frontiersin.org

Figure 7. The importance of the SARs in the proposed framework. One axial slice, one coronal slice and two sagittal slices (right and left side of the regions, respectively) of three subjects are chosen to show the importance of the SARs.

Several future studies could be completed explored based on the current pipeline. Firstly, the classifiers can be trained with Parkinsonian disorders (PDS) dataset to classify PD and atypical PDS, such as MSA and Progressive Supranuclear Palsy (PSP), which has important clinical values but is with great challenges. Secondly, this framework only contains medical imaging information currently, while other aspects of information, such as age, gender, motor ratings and other biomarkers are not included, which may further improve the diagnostic accuracy. Future research could be undertaken to incorporate additional multimodal data for better disease prediction. Finally, the sample size of subjects in this work is relatively small, and a bigger dataset is expected to validate our experiment results and improve the performance of the framework.

To conclude, we proposed a fully automatic framework combining the two modalities for PD diagnosis. This framework obtained a promising diagnostic accuracy in the PD/NL task. In addition, this work also emphasized the high value of the 11C-CFT PET in the PD diagnosis.

Data Availability

The datasets generated for this study are available on request to the corresponding author.

Ethics Statement

All data were collected from Department of Neurology, Huashan Hospital, Fudan University, and the study was approved by the Ethics Committee of Huashan Hospital. All subjects or a legally responsible relative were given written informed consent before the study.

Author Contributions

XZ is the principle investigator of this work, designed the experiments, and supervised and revised the manuscript. PW co-investigated the research and revised the manuscript. CZ co-investigated the research. JX led the implementation and experiments and wrote the manuscript. YH co-led the work and wrote the manuscript. XiL provided support to the work of coding, experiments, and manuscript writing. FJ, QX, and LL collected the data. XuL collected the data and segmented the striatum of the subjects.

Funding

This work was funded by the Science and Technology Commission of Shanghai Municipality Grant (17JC1401600), and the National Natural Science Foundation of China (NSFC) Grant (61971142). Collection of the PD data was supported by the National Natural Science Foundation of China (81671239 and 81361120393).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We thank Lei Li and Yuncheng Zhou, whose dedicated comments helped us to modify the organization of the manuscript and improve its quality.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnins.2019.00874/full#supplementary-material

Footnotes

  1. ^ adni.loni.usc.edu
  2. ^ https://biomedia.doc.ic.ac.uk/software/malp-em/
  3. ^ http://www.sdspeople.fudan.edu.cn/zhuangxiahai/0/zxhproj/

References

Bu, L., Liu, F. T., Jiang, C. F., Guo, S. S., Yu, H., Zuo, C. T., et al. (2018). Patterns of dopamine transporter imaging in subtypes of multiple system atrophy. Acta Neurol. Scand. 138, 170–176. doi: 10.1111/ane.12932

PubMed Abstract | CrossRef Full Text | Google Scholar

Carbon, M., Ma, Y., Barnes, A., Dhawan, V., Chaly, T., Ghilardi, M. F., et al. (2004). Caudate nucleus: influence of dopaminergic input on sequence learning and brain activation in Parkinsonism. Neuroimage 21, 1497–1507. doi: 10.1016/j.neuroimage.2003.12.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Eshuis, S. A., Jager, P. L., Maguire, R. P., Jonkman, S., Dierckx, R. A., and Leenders, K. L. (2009). Direct comparison of FP-CIT SPECT and F-DOPA PET in patients with Parkinson’s disease and healthy controls. Eur. J. Nucl. Med. Mol. Imaging 36, 454. doi: 10.1007/s00259-008-0989-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Gray, K. R., Aljabar, P., Heckemann, R. A., Hammers, A., Rueckert, D., and Alzheimer’s Disease Neuroimaging Initiative, (2013). Random forest-based similarity measures for multi-modal classification of Alzheimer’s disease. Neuroimage 65, 167–175. doi: 10.1016/j.neuroimage.2012.09.065

PubMed Abstract | CrossRef Full Text | Google Scholar

Haller, S., Badoud, S., Nguyen, D., Garibotto, V., Lovblad, K. O., and Burkhard, P. R. (2012). Individual detection of patients with Parkinson disease using support vector machine analysis of diffusion tensor imaging data: initial results. Am. J. Neuroradiol. 33, 2123–2128. doi: 10.3174/ajnr.A3126

PubMed Abstract | CrossRef Full Text | Google Scholar

Huang, C., Tang, C., Feigin, A., Lesser, M., Ma, Y., Pourfar, M., et al. (2007). Changes in network activity with the progression of Parkinson’s disease. Brain 130, 1834–1846. doi: 10.1093/brain/awm086

PubMed Abstract | CrossRef Full Text | Google Scholar

Huang, Z. M., Li, L., Xu, Q., Xu, Q., Ge, J., Li, M., et al. (2019). Correlations between dopaminergic dysfunction and abnormal metabolic network activity in REM sleep behavior disorder. J. Cereb. Blood Flow Metab. doi: 10.1177/0271678X19828916 [Epub ahead of print].

CrossRef Full Text | PubMed Abstract | Google Scholar

Ibarretxe-Bilbao, N., Junque, C., Marti, M. J., and Tolosa, E. (2011). Brain structural MRI correlates of cognitive dysfunctions in Parkinson’s disease. J. Neurol. Sci. 310, 70–74. doi: 10.1016/j.jns.2011.07.054

PubMed Abstract | CrossRef Full Text | Google Scholar

Ilgin, N., Zubieta, J., Reich, S. G., Dannals, R. F., Ravert, H. T., and Frost, J. J. (1999). PET imaging of the dopamine transporter in progressive supranuclear palsy and Parkinson’s disease. Neurology 52, 1221–1226.

PubMed Abstract | Google Scholar

Kazumata, K., Dhawan, V., Chaly, T., Antonini, A., Margouleff, C., Belakhlef, A., et al. (1998). Dopamine transporter imaging with fluorine-18-FPCIT and PET. J. Nucl. Med. 39, 1521.

PubMed Abstract | Google Scholar

Kingma, D. P., and Ba, J. (2014). Adam: a method for Stochastic optimization. arXiv

PubMed Abstract | Google Scholar

Ledig, C., Heckemann, R. A., Hammers, A., Lopez, J. C., Newcombe, V. F. J., Makropoulos, A., et al. (2015). Robust whole-brain segmentation: application to traumatic brain injury. Med. Image Anal. 21, 40–58. doi: 10.1016/j.media.2014.12.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, F. T., Ge, J., Wu, J. J., Wu, P., Ma, Y., Zuo, C. T., et al. (2018). Clinical, dopaminergic, and metabolic correlations in Parkinson disease: a dual-tracer PET study. Clin. Nucl. Med. 43, 562–571. doi: 10.1097/RLU.0000000000002148

PubMed Abstract | CrossRef Full Text | Google Scholar

Long, D., Wang, J., Xuan, M., Gu, Q., Xu, X., Kong, D., et al. (2012). Automatic classification of early Parkinson’s disease with multi-modal MR imaging. PLoS One 7:e47714. doi: 10.1371/journal.pone.0047714

PubMed Abstract | CrossRef Full Text | Google Scholar

Ma, Y., Dhawan, V., Mentis, M., Chaly, T., Spetsieris, P. G., and Eidelberg, D. (2002). Parametric mapping of [18F] FPCIT binding in early stage Parkinson’s disease: a PET study. Synapse 45, 125–133. doi: 10.1002/syn.10090

PubMed Abstract | CrossRef Full Text | Google Scholar

Mehta, R., and Sivaswamy, J. (2017). “M-net: a convolutional neural network for deep brain structure segmentation,” in Proceedings of the 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), (Melbourne, VIC: IEEE), 437–440.

Google Scholar

Ng, H. P., Ong, S. H., Foong, K. W. C., and Nowinski, W. L. (2006). “Medical image segmentation using k-means clustering and improved watershed algorithm,” in Proceedings of the 2006 IEEE Southwest Symposium on Image Analysis and Interpretation, (Denver, CO: IEEE), 61–65.

Google Scholar

Postuma, R. B., Arnulf, I., Hogl, B., Iranzo, A., Miyamoto, T., Dauvilliers, Y., et al. (2012). A single-question screen for rapid eye movement sleep behavior disorder: a multicenter validation study. Mov. Disord. 27, 913–916. doi: 10.1002/mds.25037

PubMed Abstract | CrossRef Full Text | Google Scholar

Postuma, R. B., Berg, D., Stern, M., Poewe, W., Olanow, C. W., Oertel, W., et al. (2015). MDS clinical diagnostic criteria for Parkinson’s disease. Mov. Disord. 30, 1591–1601. doi: 10.1002/mds.26424

PubMed Abstract | CrossRef Full Text | Google Scholar

Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation[C]//International Conference on Medical image computing and computer-assisted intervention. Cham: Springer, 234–241.

Google Scholar

Roth, G. A., Abate, D., Abate, K. H., Abay, S. M., Abbafati, C., Abbasi, N., et al. (2018). Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980-2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 392, 1736–1788. doi: 10.1016/S0140-6736(18)32203-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Strafella, A. P., Bohnen, N. I., Perlmutter, J. S., Eidelberg, D., Pavese, N., Van Eimeren, T., et al. (2017). Molecular imaging to track Parkinson’s disease and atypical parkinsonisms: new imaging frontiers. Mov. Disord. 32, 181–192. doi: 10.1002/mds.26907

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, J., Hoekstra, J. G., Zuo, C., Cook, T. J., and Zhang, J. (2013). Biomarkers of Parkinson’s disease: current status and future perspectives. Drug Discov. Today 18, 155–162. doi: 10.1016/j.drudis.2012.09.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Wong, K. C. L., Moradi, M., Tang, H., and Syeda-Mahmood, T. (2018). 3D segmentation with exponential logarithmic loss for highly unbalanced object sizes[C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer, 612–619.

Google Scholar

Zhuang, X., Arridge, S., Hawkes, D. J., and Ourselin, S. (2011). A nonrigid registration framework using spatially encoded mutual information and free-form deformations. IEEE Trans. Med. Imaging 30, 1819–1828. doi: 10.1109/TMI.2011.2150240

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: Parkinson’s disease, multi-modality, image classification, U-Net, striatum

Citation: Xu J, Jiao F, Huang Y, Luo X, Xu Q, Li L, Liu X, Zuo C, Wu P and Zhuang X (2019) A Fully Automatic Framework for Parkinson’s Disease Diagnosis by Multi-Modality Images. Front. Neurosci. 13:874. doi: 10.3389/fnins.2019.00874

Received: 14 February 2019; Accepted: 05 August 2019;
Published: 23 August 2019.

Edited by:

Siyang Zuo, Tianjin University, China

Reviewed by:

Delia Cabrera DeBuc, University of Miami, United States
Danny J. J. Wang, University of Southern California, United States

Copyright © 2019 Xu, Jiao, Huang, Luo, Xu, Li, Liu, Zuo, Wu and Zhuang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Xiahai Zhuang, zxh@fudan.edu.cn; Ping Wu, wupingpet@fudan.edu.cn