Abstract
Alzheimer’s disease (AD) is the most common form of dementia. Currently, only symptomatic management is available, and early diagnosis and intervention are crucial for AD treatment. As a recent deep learning strategy, generative adversarial networks (GANs) are expected to benefit AD diagnosis, but their performance remains to be verified. This study provided a systematic review on the application of the GAN-based deep learning method in the diagnosis of AD and conducted a meta-analysis to evaluate its diagnostic performance. A search of the following electronic databases was performed by two researchers independently in August 2021: MEDLINE (PubMed), Cochrane Library, EMBASE, and Web of Science. The Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool was applied to assess the quality of the included studies. The accuracy of the model applied in the diagnosis of AD was determined by calculating odds ratios (ORs) with 95% confidence intervals (CIs). A bivariate random-effects model was used to calculate the pooled sensitivity and specificity with their 95% CIs. Fourteen studies were included, 11 of which were included in the meta-analysis. The overall quality of the included studies was high according to the QUADAS-2 assessment. For the AD vs. cognitively normal (CN) classification, the GAN-based deep learning method exhibited better performance than the non-GAN method, with significantly higher accuracy (OR 1.425, 95% CI: 1.150–1.766, P = 0.001), pooled sensitivity (0.88 vs. 0.83), pooled specificity (0.93 vs. 0.89), and area under the curve (AUC) of the summary receiver operating characteristic curve (SROC) (0.96 vs. 0.93). For the progressing MCI (pMCI) vs. stable MCI (sMCI) classification, the GAN method exhibited no significant increase in the accuracy (OR 1.149, 95% CI: 0.878–1.505, P = 0.310) or the pooled sensitivity (0.66 vs. 0.66). The pooled specificity and AUC of the SROC in the GAN group were slightly higher than those in the non-GAN group (0.81 vs. 0.78 and 0.81 vs. 0.80, respectively). The present results suggested that the GAN-based deep learning method performed well in the task of AD vs. CN classification. However, the diagnostic performance of GAN in the task of pMCI vs. sMCI classification needs to be improved.
Systematic Review Registration: [PROSPERO], Identifier: [CRD42021275294].
Introduction
Alzheimer’s disease (AD) is the most common form of dementia and is characterized by a progressive decline in memory and other cognitive functions. Notably, the pathophysiological processes of AD begin decades before clinical symptoms appear (; ; ); thus, early diagnosis and intervention are particularly important in AD management (; ). Mild cognitive impairment (MCI) is the prodromal stage, with symptoms occurring up to decades before dementia onset (; ). Approximately 10–15% of patients with MCI may progress to AD (pMCI) each year (), while the remaining patients may remain stable in the MCI stage (sMCI) (; ). Studies examining the difference between AD and cognitively normal groups and between patients with pMCI and sMCI might facilitate the prediction of disease progression and help to provide the time window for administering potential disease-modifying therapy.
Neuroimaging biomarkers have been widely used in studies of AD to explain the underlying pathophysiological processes (; ). According to the National Institute on Aging and the Alzheimer’s Association (NIA-AA) research framework, biomarkers for the AD continuum were classified as AT(N) for amyloid, tau and neurodegeneration (). A indicates amyloid-beta (Aβ) protein deposition, as reflected on amyloid positron emission tomography (PET) images (). T indicates tau protein accumulation, as reflected by tau PET imaging (). N indicates biomarkers of neurodegeneration or injury, including a reduction in glucose metabolism in the temporoparietal region, as reflected by fluorodeoxyglucose positron emission tomography (FDG-PET) imaging, and hippocampal atrophy observed using structural magnetic resonance imaging (MRI) (; ; ). The development of diagnostic methods based on these neuroimaging biomarkers is important to improve the diagnosis of AD, especially in the prodromal stage ().
Artificial intelligence (AI) has been increasingly important in clinical diagnosis for the past few years. Psychoradiology with AI are emerging research directions for brain disorders (). As one of the most important AI techniques, deep learning performs well in image processing for image detection, classification, and segmentation (; ). It has been applied in some studies to achieve an accurate diagnosis of AD based on features extracted from AD-related images. Multiple deep learning models are being applied for the early detection and prediction of AD, such as convolutional neural networks (CNNs) (), autoencoders (AEs) (), and deep belief networks (DBNs) (; ).
The generative adversarial network (GAN) is a recent model first proposed by . It is a generative model mainly used for image processing based on the adversarial training of two components: the generative network (G) and the discriminative network (D). Fake images generated by this model, which highly resemble the real images, might exercise the same function as real images in disease diagnosis. In recent years, GAN has shown application value in diagnosing AD by providing image processing support, including quality improvement for low-dose PET images or 1.5-T MRIs (; ; ), predicting brain images at a future time point (; ), data augmentation for network training (; ), and interconversion of PET and MRI data (; ). With the GAN-based deep-learning classification framework, a more accurate diagnosis of AD is promising and may be achieved.
Some recent reviews reported the application of GAN in AD predictions and image classification. reported the application value of GAN in improving image quality and converting the modality. However, only two studies were included, and the results for the AD diagnosis were not reported. reported the application of GAN in a mouse model of AD with genomic data. Both studies were not comprehensive and did not include any data analysis for the AD diagnosis. To our knowledge, a gap exists in the meta-analysis for GAN application in the diagnosis of AD. This study systemically reviewed studies examining the application of GAN-based deep learning methods in the diagnosis of AD and subsequently performed a meta-analysis evaluating their diagnostic performance to fill this gap.
Materials and Methods
This study was conducted according to the Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies (PRISMA-DTA) statement ().
Protocol and Registration
This study was registered on PROSPERO with the registration number CRD42021275294.
Focused Question
The focused question of this study is what is the performance of GAN in the diagnosis of AD?
Patients, Intervention, Comparison, Outcome and Study Design Criteria
This study followed the Patients, Intervention, Comparison, Outcome and Study design (PICOS) criteria:
Patients (P): patients with AD or MCI.
Intervention (I): GAN-based deep learning methods for the diagnosis of AD. Specifically, the task of AD diagnosis referred to the AD vs. CN classification and pMCI vs. sMCI classification.
Comparison (C): the deep learning methods without GAN.
Outcome (O): the performance for the diagnosis of AD, including accuracy, sensitivity, specificity, and the area under the curve (AUC) of the summary receiver operating characteristic curve (SROC).
Study design (S): studies using neuroimaging data.
Literature Search
A search of the following electronic databases was performed by two researchers (CQ and YZ) independently in August 2021: MEDLINE (PubMed), Cochrane Library, EMBASE, and Web of Science. The database coverage was up to August 2021. In addition, a manual search was conducted of references of the initially included articles and relevant reviews. The detailed search strategy is displayed in Supplementary Material.
Inclusion and Exclusion Criteria
The inclusion and exclusion criteria followed the PICOS criteria.
Inclusion criteria: (1) participants who were clinically diagnosed with AD or MCI; (2) the application of GAN in the deep learning models; (3) report of the performance for diagnosis; and (4) diagnosis based on neuroimaging data (PET, MRI, etc.).
Exclusion criteria: (1) participants diagnosed with other brain disorders, such as brain tumors; (2) report of an assessment of generated image quality only, such as the peak signal to noise ratio (PSNR) and structural similarity (SSIM); (3) diagnosis based on other subjects rather than images; (4) conference abstracts (published abstracts of papers participating in academic conferences without the full text), editorials, letters, or review articles.
Article Screening
Two researchers (CQ and YZ) independently performed the screen according to the PICOS criteria. The initial screen was performed by reading titles and abstracts. The full text was then read for further screening. A consensus was finally reached through negotiation in cases of any divergence between the two researchers.
Data Extraction
A self-developed data extraction form was used by two researchers (CQ and YZ) independently. The following data were collected: author, year, country, data, participants, structure of the model, type of GAN, function of GAN, classification task, and performance.
Quality Assessment
The quality of the included studies was assessed by two researchers independently with the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool. Assessment domains were as follows: risk of bias (patient selection, index test, reference standard, and flow and timing) and applicability concerns (patient selection, index test, and reference standard).
Data Analysis
Stata 15 and MetaDiSc 1.4 software were used to analyze the data. For the accuracy analysis, researchers calculated the odds ratio (OR) with a 95% confidence interval (CI). Cochran’s Q-test and Higgins inconsistency index (I2)-test were performed to test heterogeneity. A fixed-effects model was used when non-significant heterogeneity was observed (P > 0.05 and I2 < 50%); otherwise (P < 0.05 or I2 > 50%), a random-effects model was applied.
The true positive (TP), false negative (FN), false-positive (FP), and true negative (TN) were calculated, and 2 × 2 tables were plotted based on the performance for diagnosis (accuracy, sensitivity, specificity, and other parameters) reported. Based on the data calculated above, researchers adopted a bivariate random-effects model to calculate the pooled sensitivity and specificity with their 95% CIs. An SROC curve was constructed, and the AUC was calculated. The Spearman correlation coefficient was obtained, and a value greater than 0.5 with P < 0.05 indicated the presence of threshold effects. Heterogeneity was assessed using the same method described for accuracy. The narrative analysis was adopted for the studies excluded from the meta-analysis.
According to the pooled sensitivity and specificity of neuroimaging biomarkers for diagnosis reported in some meta-analyses and rules for evaluating the AUC of classification models (; ), we proposed that a method with great potential for clinical application should meet the following criteria: the pooled sensitivity or specificity was greater than 0.90 and the AUC was greater than 0.90.
Results
Study Selection
In total, 364 articles were obtained by performing electronic and manual searches. Two hundred two articles were excluded during the initial screen, and 21 articles were selected after reading the full text. Eventually, 14 articles were included in this study. Researchers conducted a meta-analysis on 11 of these studies. The study selection process is displayed in Figure 1.
FIGURE 1
Characteristics of the Included Studies
A detailed description of the study characteristics is provided in Table 1 and Figure 2. Regarding the publication year, all the included articles were published between 2018 and 2021, and more than half of them (8/14) were published in 2021 (Figure 2A; ; ; ; ; ; ; ; ). Regarding the data source, neuroimaging data analyzed in 13 studies were mainly from the Alzheimer’s Disease Neuroimaging Initiative (ADNI) (; ; ; ; ; ; ; ; ; ; ; ; ), and some data were from the Open Access Series of Imaging Studies (OASIS) (; ), the Australian Imaging, Biomarker and Lifestyle Flagship Study of Aging (AIBL) and the National Alzheimer’s Coordinating Center (NACC) databases (Figure 2B; ). Two studies established a test set from the collection of clinical data (; ). Regarding the data modality, 36 percent (5/14) of studies used data from two modalities (Figure 2C; ; ; ; ; ). One study used MRI and other clinical data (age, sex, education level, and other parameters) (). A deep convolutional GAN (DCGAN) was applied in 3 studies (; ; ), and conditional GAN (CGAN) was applied in 2 studies (Figure 2E; ; ). The type of GAN in the remaining studies varied. For the diagnostic task, 11 studies focused on the AD vs. CN classification (; ; ; ; ; ; ; ; ; ; ), and 7 studies were devoted to the pMCI vs. sMCI classification (Figure 2D; ; ; ; ; ; ; ). For the assessment of the diagnostic performance, accuracy was reported in all studies, while sensitivity and specificity were reported in 6 studies examining the AD vs. CN classification (; ; ; ; ; ) and 4 studies examining the pMCI vs. sMCI classification (; ; ; ).
TABLE 1
| Authors | Year | Country | Data | Participants | Structure of the model | Type of GAN | Function of GAN | Task of classification | Performance | |||||||||||
| Source | Modality | AD | MCI | pMCI | sMCI | CN | Accuracy | Sensitivity | Specificity | F1-score | Recall | Precision | AUC | |||||||
| 2018 | China | ADNIa | MRI+PET | 358 | − | 205 | 465 | 429 | Two-stage: GAN+ LM3ILb | cycleGAN | Modality conversion | AD vs. CN; pMCI vs. sMCI | 0.92; 0.79 | 0.90; 0.55 | 0.94; 0.83 | 0.91; 0.41 | − | − | 0.96; 0.76 | |
| 2020 | United States | ADNI | PET | 98 | − | − | − | 105 | Two-stage: GAN+CNNc | DCGANd | Data augmentation | AD vs. CN | 0.71 | − | − | − | − | − | − | |
| 2020 | Korea | ADNI; clinical | PET | 139 | − | − | − | 347 | Two-stage: GAN+SVMe | BEGANf | Feature extraction | AD vs. CN | 0.94 | 0.92 | 0.97 | − | − | − | 0.98 | |
| 2019 | Switzerland | ADNI; clinical | MRI | − | − | 89 | 116 | − | Two-stage: GAN+CNN | WGANg | Aging simulation | pMCI vs. sMCI | 0.73 | − | − | 0.71 | 0.75 | 0.68 | − | |
| 2018 | United Kingdom | ADNI | MRI+PET | − | − | 58 | 50 | − | Two-stage: GAN+ Resnet | cGANh | Modality conversion | pMCI vs. sMCI | 0.82 | − | − | − | − | − | 0.81 | |
| 2021 | Korea | ADNI | PET | 25 | − | − | − | 148 | GAN only | GAN | Anomaly detection | AD vs. CN | − | − | − | − | − | − | 0.75 | |
| 2021 | China | ADNI | MRI+PET | 352 | − | 234 | 342 | 427 | Two-stage: GAN+ DCNi | TPA-GANj | Modality conversion | AD vs. CN; pMCI vs. sMCI | 0.93; 0.75 | 0.92; 0.71 | 0.94; 0.78 | 0.92; 0.70 | − | − | 0.96; 0.78 | |
| 2021 | Japan | OASISk | MRI | 96 | 152 | − | − | 576 | GAN only | SAGANl | Anomaly detection | AD vs. CN | − | − | − | − | − | − | 0.89 | |
| 2021 | China | ADNI | MRI | 187 | − | 138 | 181 | 229 | Ensemble learning: discriminator of GAN+VGG16+ ResNet50 | DCGAN | Transfer learning | AD vs. CN; pMCI vs. sMCI | 0.90; 0.63 | 0.94; 0.58 | 0.84; 0.64 | − | − | − | 0.90; 0.62 | |
| 2021 | China | ADNI | MRI+PET | 362 | − | 183 | 233 | 308 | Two-stage: GAN+CNN | revGANm | Modality conversion | AD vs. CN; pMCI vs. sMCI | 0.89; 0.71 | 0.90; 0.74 | 0.88; 0.68 | − | − | − | 0.88; 0.74 | |
| 2021 | Pakistan | ADNI | PET | 30 | − | − | − | 42 | Two-stage: GAN+VGG16 | DCGAN | Data augmentation | AD vs. CN | 0.83 | − | − | 0.88 | 0.86 | 0.91 | − | |
| 2021 | United States | ADNI; AIBLn; NACCo | MRI | 411 | − | − | − | 678 | Two-stage: GAN+FCNp | GAN | Quality improvement | AD vs. CN | 0.82 | 0.74 | 0.89 | 0.79 | − | − | − | |
| 2020 | Korea | ADNI | MRI+PET | 162 | 675 | − | − | 428 | GAN only | cGAN | Modality conversion; classification | AD vs. CN | 0.85 | − | − | − | 0.84 | 0.84 | − | |
| 2021 | China | ADNI; OASIS | MRI+other information | 151 | 341 | − | − | 113 | Two-stage: GAN+DenseNet | mi-GANq | Aging simulation | pMCI vs. sMCI | 0.78 | − | − | 0.74 | 0.71 | 0.78 | − | |
Characteristics of the included studies.
aAlzheimer’s Disease Neuroimaging Initiative;
bandmark-based Multimodal Multi-Instance Learning;
cConvolutional Neural Network;
dDeep Convolutional Generative Adversarial Network;
e Support Vector Machine;
fBoundary Equilibrium Generative Adversarial Network;
gWasserstein Generative Adversarial Network;
hConditional Generative Adversarial Network;
iDense Convolution Network;
jTask-induced Pyramid and Attention Generative Adversarial Network;
kOpen Access Series of Imaging Studies;
lSelf Attention Generative Adversarial Network;
mReversible Generative Adversarial Network;
nAustralian Imaging, Biomarker and Lifestyle Flagship Study of Aging;
oNational Alzheimer’s Coordinating Center;
pFully Convolutional Network;
qMulti-information Generative Adversarial Network.
FIGURE 2
Regarding the function of image processing, one study applied GAN to generate higher-quality MRI data. Two studies stimulated the process of brain aging observed in MRI images (; ). Two studies used GAN to augment imaging data and improve the training effects of the classifiers (; ). Five studies achieved conversion between PET and MRI data to provide supplementary data (; ; ; ; ).
Generative Adversarial Networks
GAN is composed of a G and a D. The goal of the GAN is to generate the image most similar to the real image through G-D competitions. As a random vector input, G generates a fake image. The goal of G is to make it as close as possible to the real image. As the generated and corresponding real image input, D provides a probability for the generated image being real (1 indicates real and 0 indicates fake). The goal of D is to identify fake images as accurately as possible. With the continuous adversarial training on G and D, the similarity between the image generated by G and the real image is maximized, and concurrently, the accuracy of D in identifying fake images is maximized. When G and D reach a Nash equilibrium state through training (the probability output by D is 1/2 each time), the model reaches the optimum. At this time, GAN outputs an image closest to the real image.
Except for the function of image processing, GANs have high structural flexibility. This property allows any differential function to be applied in G and D construction and cooperates with other recognized deep learning networks (such as CNN) to constitute the deep generative model. and built the G based on U-net, and and established the Markovian-based D (PatchGAN). Additionally, the GAN framework embraces all types of loss functions and constraints, which provides individualized methods according to different tasks. The modified GAN was applied in the included studies and contributed to an improved diagnosis of AD. Some improvements in the structure of GAN and their contributions are shown in Figure 3. For the generator, proposed a parallel structure, with CNN extracting local features and DCN extracting global features. The generator produces images that are close to the real images using comprehensive features. and added the self-attention module to focus the attention of the algorithm on specific regions instead of focusing indiscriminately on the whole image, reducing redundant information extraction. For the discriminator, added the task-induced mechanism. The task-induced discriminator focused not only on the quality of the generated images but also on whether AD pathological information was retained. In addition, the results of the downstream classification task were fed back to the generator and discriminator during training in the study by . This training may ensure the classification performance of the generated images.
FIGURE 3
Quality Assessment
The quality assessment is described in detail in Figure 2F. Two studies had high concerns regarding the applicability (; ). In these studies, GAN was developed for anomaly detection, which is a screen for AD, while diagnosis is the main focus of our study. Applicability concerns of reference standard were low in the study by because they clearly indicate that the diagnostic criteria for AD were the clinical dementia rating (CDR). In addition, the risk of bias in flow and timing was low in this study, as the authors ensured that the interval between CDR and MRI acquisition was as short as possible ().
Diagnostic Performance of Generative Adversarial Network-Based Deep Learning Methods
The Task of Alzheimer’s Disease vs. Cognitively Normal Classification
Eleven studies focused on the application of GAN to the task of AD vs. CN classification (; ; ; ; ; ; ; ; ; ; ). Meta-analyses were performed on 6 studies reporting the accuracy, sensitivity, and specificity (; ; ; ; ; ). The results of the meta-analyses are shown in Table 2. For the accuracy assessment, the pooled OR was 1.425 (95% CI: 1.150–1.766; P = 0.001). Heterogeneity among the studies was not significant (I2 = 37.4, P = 0.157), and the fixed-effects model was applied. This result revealed that GAN-based deep learning methods efficiently increased the accuracy of the task of AD vs. CN classification (Figure 4).
TABLE 2
| Task | Method | ORa of accuracy | SENb | SPEc | AUCd of the SROCe | Spearman correlation coefficient |
| AD vs. NC | w/f GAN | 1.425* (1.150–1.766) | 0.88 (0.82–0.93) | 0.93 (0.90–0.95) | 0.96 (0.94–0.97) | −0.029 |
| w/og GAN | 0.83 (0.76–0.88) | 0.89 (0.86–0.92) | 0.93 (0.90–0.95) | 0.257 | ||
| pMCI vs. sMCI | w/GAN | 1.149 (0.878–1.505) | 0.66 (0.57, 0.75) | 0.81 (0.76, 0.85) | 0.81 (0.72–0.89) | 1.000* |
| w/o GAN | 0.66 (0.57, 0.75) | 0.78 (0.74, 0.82) | 0.80 (0.74–0.87) | 1.000* |
The results of meta-analyses of the diagnosis of AD.
*Statistically significant, p≤ 0.05. aOdds ratio; bsensitivity; cspecificity; darea under the curve; esummary receiver operating characteristic curve; f with; gwithout.
FIGURE 4
In the group with GAN, the pooled sensitivity was 0.88 (95% CI: 0.82–0.93), the pooled specificity was 0.93 (95% CI: 0.90–0.95), and the AUC of the SROC was 0.96 (95% CI: 0.94–0.97). Significant heterogeneity was observed in both sensitivity (I2 = 87.27, P = 0) and specificity (I2 = 61.30, P = 0.02). These values were much higher than those in the group without GAN (Figures 5, 6). Threshold effects were absent in both groups according to Spearman’s correlation coefficients (−0.029, P = 0.957; 0.257, P = 0.623). Generally, GAN-based deep learning methods were superior to the method without GAN and had great potential for clinical application based on the criteria described above.
FIGURE 5
FIGURE 6
The advantage of GAN was also observed in studies not included in the meta-analysis. reported that the AUC for the GAN-based method was 0.7, which was significantly higher than that of other methods. reported the medical anomaly detection GAN (MAGAN) with an AUC of 0.89. Three studies showed higher accuracy of GAN-based methods (0.71, 0.85, and 0.83) (; ; ).
The Task of Progressing MCI vs. Stable MCI Classification
Seven studies focused on the application of GAN to the task of pMCI vs. sMCI classification (; ; ; ; ; ; ). A meta-analysis was performed on 5 studies reporting the accuracy (; ; ; ; ), and another was performed on 3 studies reporting sensitivity and specificity (; ; ). For accuracy, the pooled OR was 1.149 (95% CI: 0.878–1.505; P = 0.310). Heterogeneity among the studies was not significant (I2 = 0, P = 0.884), and the fixed-effects model was applied (Figure 7).
FIGURE 7
In the group with GAN, the pooled sensitivity was 0.66 (95% CI: 0.57–0.75), the pooled specificity was 0.81 (95% CI: 0.76–0.85), and the AUC of the SROC was 0.81 (95% CI: 0.72–0.89) (Figure 8). Low heterogeneity was observed in both sensitivity (I2 = 33.50, P = 0.22) and specificity (I2 = 25.10, P = 0.26). The specificity and AUC of the SROC were slightly higher than those in the group without GAN (Figure 9). Threshold effects were strong on both groups according to Spearman’s correlation coefficients. Overall, in the task of pMCI vs. sMCI classification, the differences between the group with GAN and the group without GAN were not significant.
FIGURE 8
FIGURE 9
Discussion
In this study, we analyzed the performance of GAN in diagnosing AD. GAN-based deep learning methods significantly increased the accuracy, sensitivity, and specificity in the task of AD vs. CN classification. However, their diagnostic performance in the task of pMCI vs. sMCI classification was not remarkable.
Performance of Generative Adversarial Network-Based Deep Learning Methods in the Task of Alzheimer’s Disease vs. Cognitively Normal Classification
Developments in disease-modifying therapy for AD have slowly progressed, with a failure rate of 99.6% in clinical trials (; ). Based on this information, identifying patients with early AD has become a focus in current studies (; ). Effective discrimination between AD and CN might help identify patients with AD in a timely manner and implement targeted interventions to delay disease progression.
Our study showed that GAN-based deep learning methods with different data modalities and different structures of the model all showed good performance in the task of AD vs. CN classification.
Regarding the data modality, some studies used MRI data, while others used PET data. developed a GAN model to generate 3-T MRI scans from 1.5-T scans. Then, researchers trained a fully convolutional network (FCN) using generated 3-T MRI as inputs to complete the task of AD vs. CN classification. The classification efficiency was ensured by the concurrent training of the GAN and FCN. In that study, the FCN trained on the generated 3-T MRI data performed better than that trained on 1.5-T MRI data, with higher accuracy (0.84 vs. 0.82), sensitivity (0.74 vs. 0.67), and specificity (0.9037 vs. 0.8989). trained a VGG16 classifier on DCGAN-amplified PET data. Good performance of this classifier was reported in the task of AD vs. CN classification (accuracy: 0.83; recall: 0.86; precision: 0.91; F1-score: 0.88). reported an accuracy of 71.45% when using GAN-augmented PET data in the AD vs. CN classification, a 10% increase compared to the classifier trained on data without GAN augmentation.
Regarding the structure of the model, some researchers constructed anomaly detection models based on GAN to identify patients with AD. established a deep-learning model based on adversarial training for diagnosing AD. The G was an encoder-decoder network with the encoder a parallel feature extractor consisting of CNN and DCN, which were used for extracting local and global features from the real PET images, respectively. The G reconstructed a PET image based on these feature vectors and then input it to the encoder-type D for AD diagnosis. This study finally reported that the AUC of this method was 0.75. proposed a medical anomaly detection GAN (MADGAN) using multiple adjacent brain MRI slice reconstruction to detect patients with AD by considering that AD is composed of the accumulation of subtle anomalies (AUC = 0.89).
Moreover, some researchers trained the classifier based on features extracted or images processed using GAN to complete the task of pMCI vs. sMCI classification. extracted features of two brain PET slices with the encoder-decoder D in GAN and trained an SVM classifier on these features to achieve accurate classification of AD and CN. Compared with the 2D-CNN model, the SVM classifier exhibited a 12.77% increase in accuracy, a 6.82% increase in sensitivity, and a 19.37% increase in specificity. constructed an end-to-end network based on the GAN model, with G for MRI-PET conversion and D for AD classification. The structure of this network is different from the conventional two-step structure, which starts from PET data generation based on MRI data to AD diagnosis with the generated PET data, leading to 0.85 accuracy and 0.84 precision and recall in the task of AD vs. CN classification.
All included studies used data of AD patients through clinical diagnosis rather than neuropathological examination. Although neuropathological diagnosis at autopsy serves as the gold standard for diagnosing AD (), data of AD diagnosed through it are sparse and difficult to obtain. Researchers may consider that small data sizes could limit the adequate training of deep learning networks and chose to use data of clinically diagnosed AD from large publicly available databases, such as ADNI, OASIS, AIBL, and so on. However, clinical diagnosis may be less accurate compared to neuropathological examination currently. One study reported that sensitivity for AD clinical diagnosis based on the NINCDS-ADRDA guidelines ranged from 70.9 to 87.3% and specificity ranged from 44.3 to 70.8% compared to the golden standard (). This could affect the evaluation of the diagnostic performance of GAN-based deep learning methods.
Performance of Generative Adversarial Network-Based Deep Learning Methods in the Task of Progressing MCI vs. Stable MCI Classification
MCI is a transition between CN and AD (). Patients with MCI who progress to AD are classified as having pMCI, while those who maintain stable disease conditions and even return to normal are classified as having sMCI (; ). Efficient discrimination between pMCI and sMCI groups is beneficial for the early identification of patients at high risk of developing AD and helps further detect the high-risk factors responsible for disease progression. Using this approach, corresponding interventions might be scheduled, in turn delaying disease progression and decreasing the occurrence of AD.
In our study, GAN-based deep learning methods showed no remarkable classification performance in the task of pMCI vs. sMCI classification compared to the task of AD vs. CN classification. This difference is mainly attributed to the subtle pathological differences between patients with pMCI and sMCI (). Compared to CN patients, significant hippocampal atrophy has been observed in both patients with pMCI and sMCI (). In this setting, the result is generally negative if the deep learning model only uses the whole hippocampal volume as the input feature in the task of pMCI vs. sMCI classification. A recent cohort study revealed that the volume of the bilateral subiculum and molecular layer in patients with pMCI was smaller than that in patients with sMCI, along with more rapid atrophy (). The volume of the hippocampal subregion is the main source of the difference between these two types. However, the volume of these subregions is very small, especially in 2D images. The difference in volume is difficult to capture using the deep learning method due to the floor effect and might provide an interpretation of the lack of remarkable performance in the task of pMCI vs. sMCI classification.
The included studies have attempted to overcome this limitation and achieve better performance in the task of pMCI vs. sMCI classification.
Some studies applied multimodal data to improve the performance. first developed a GAN with reversible blocks to achieve PET-MRI conversion. Then, they trained a 3D-CNN classifier (4 layers) by generating images of the hippocampus using these 2 modalities (PET and MRI) to complete the tasks of AD vs. CN and pMCI vs. sMCI classification. In this study, the hippocampus was set as the region of interest (ROI), which decreased unnecessary calculations and contributed to 89.05% accuracy in the AD vs. CN classification and 71.23% accuracy in the pMCI vs. sMCI classification. proposed a DCN classifier trained on MRI data and the corresponding PET data by GAN conversion. Pathwise transfer blocks were adopted to allow information communication across two paths of PET and MRI data. This approach enabled the classifier to make full use of complementary information of these images and improve the classification performance. Researchers performed a comparative analysis with the method without GAN and found that the GAN-based model exhibited better performance in both AD vs. CN and pMCI vs. sMCI classification tasks. and also used GAN to perform MRI-PET data conversion to compensate for insufficient training due to missing PET data. With classifiers trained on MRI data and the generated PET data, obtained a 7% increase in classification accuracy compared to the classifier trained on PET data with traditional augmentation. also reported better performance in both AD vs. CN and pMCI vs. sMCI classification tasks.
Some researchers applied the ensemble learning strategy to increase the accuracy and stability in the pMCI vs. sMCI classification task. devised a multimodal ensemble learning model for AD diagnosis based on three classifiers (GAN-D, VGG16, and ResNet50) trained on 11 MRI slices with the best diagnostic performance selected by the VGG16 classifier. The introduction of multiple slices and the multimodal classifier increased the accuracy and stability of the ensemble learning model in classification. Their result showed a 5.8% increase in accuracy of the ensemble learning model in the AD vs. CN classification compared to the single VGG16 classifier. Meanwhile, the three classifiers were separately analyzed, and the GAN-D was reported to be superior to VGG16 and ResNet50 classifiers in both AD vs. CN and pMCI vs. sMCI classification tasks, indicating the advantage of GAN to some extent. The differences in pathological changes between patients with pMCI and sMCI increases with aging. Based on this information, some studies simulated the process of aging observed in MRI data to predict disease progression. constructed a 3D patch-based multi-information GAN (MI-GAN) model to generate aging-related MRI images based on baseline MRI image data and related clinical information. Then, they trained a 3D Multi-Classification Model on these aging images to perform the pMCI vs. sMCI classification. The results showed 78.45% accuracy, a 3.01% increase compared to the deep neural networks and ensemble learning models. also simulated the aging process of patients (as evidenced by MRI data) using time as the variable and then established a pMCI-sMCI classifier trained on aging images to identify patients at high risk of developing AD. The authors found that the classifier trained on aging images displayed a higher accuracy (0.73 vs. 0.70) and F1-score (0.71 vs. 0.61) than the classifier trained on baseline images.
The Function of Generative Adversarial Network in the Diagnostic Model
The excellent performance of GAN-based deep learning methods in diagnosing AD is attributed to the powerful functions of image processing by GAN and the model structure. In most of the included studies, the diagnostic model included 2 stage: the first was image processing by GAN and the second was the classifier established with other algorithms (primarily CNN) and training on images processed in stage one. Stage 1, instead of stage 2, is recognized as the critical stage for good performance in diagnosing AD (). Therefore, the function of GAN determines the final effects of the entire diagnostic model. In the GAN, D provides a self-adaptive loss function based on different tasks and data, which is known as GAN-loss for G. The GAN-loss function might become powerful with the discriminative ability of D strengthening during training. This powerful loss function might promote image processing by G. In contrast, in other generative models, the image processing ability is limited, as their training is confined to the loss function preset. GAN, therefore, might provide images of higher quality for the diagnostic model and increase the diagnostic performance.
Specifically, the GAN provided image processing from four aspects in the included studies: quality improvement, aging simulation, data augmentation, and modality conversion (shown in Figure 10). The next section provides a description of the four functions and their effects on the AD diagnosis.
FIGURE 10
Quality Improvement
A GAN generates MRI data at high magnetic field strength from data collected at a low strength. constructed a diagnostic model for AD based on 3-T MRI data generated by GAN, whose image quality was significantly higher than that of 1.5-T MRI scans based on SNR, BRISQUE, and NIQE metrics. The clear presentation of the diagnostic features by improving quality is the cause for the excellent performance of this deep learning method in disease diagnosis. Hippocampal atrophy on MRI is considered as potential neuroimaging markers for neurodegeneration in patients with AD. It might be presented much more clearly with a more accurate segmentation boundary in 3-T MRI than in 1.5-T MRI (). A study also reported a much more widespread pattern of significant atrophy in the temporal lobe when scanned at 3-T vs. 1.5-T in the AD vs. CN classification. Due to the quality improvement function of GAN, the classifier easily obtained more accurate diagnostic features and detected differences between the AD and CN cohorts in these target areas, contributing to better classification performance.
Moreover, the increase in the quality of low-dose PET images obtained using GAN was reported in some studies. obtained full-dose PET images from low-dose images using the CGAN with a 3D U-net-like generator. The skip connections strategy was applied to combine hierarchical features. The authors obtained imaging data from healthy subjects and patients with MCI with the highest PSNR and the lowest NMSE compared to the methods based on the sparse representation and CNN. Additionally, the difference in the SUV between the PET images generated using GAN and the real full-dose PET images was the smallest. added an amyloid status classifier to GAN to ensure the preservation of pathological features in the generated image, which was superior to the CNN-based method, with a 1.87 dB PSNR, 2.04% SSIM, and 24.75% RMSE. The reductions in glucose metabolism in the parietal lobe, posterior cingulate, and temporal regions observed using FDG-PET are known as potential biomarkers reflecting the pathophysiological process of neuronal degeneration and injury in patients with AD (). High-dose PET images contain less noise than low-dose images, preserving more details of these diagnostic regions and more disease features that could be used in the classification. This finding also supports the good diagnostic performance of GAN-based deep learning methods.
Aging Simulation
In some studies, GAN was applied to predict disease progression by simulating cerebral aging with time as the variable. generated aging MRI data based on baseline MRI scans and other clinical information. The generated images at year 1 and year 4 were highly similar to the real images (SSIM: 0.945 ± 0.038, 0.943 ± 0.028). also built a model to simulate cerebral aging based on WGAN. These generated aging images had the same role as real images in the pMCI vs. sMCI classification (accuracy: 0.73, F1-score: 0.71). Some longitudinal pathological changes were observed using the aging simulation. In patients with pMCI, atrophy of the temporal lobe may extend forward to the parietal lobe, frontal lobe, lateral occipital cortex, and subsequent anterior cingulate cortex during the aging process (). Meanwhile, losses in the hippocampal and whole-brain volumes along with increasing ventricular volume have been reported (; ). The larger differences between patients with pMCI and sMCI observed in the aging images compared to those observed in baseline images were shown, and the classifier performed better in the classification. The aging simulation function of GAN contributes to excellent performance in the task of pMCI vs. sMCI classification.
Data Augmentation
Large datasets with labels are commonly the basis of the construction and training of deep learning frameworks, especially for supervised learning. However, the medical images are labeled largely based on the subjective experience and professional level of experts and might be affected by the image quality. Notably, labeling images from patients with different stages of AD is more challenging. Sparse labeled medical images might limit the application of deep learning in the diagnosis of AD (). The GAN can compensate for data insufficiency during the development of AD-related deep learning frameworks through the augmentation of PET and MRI data. performed augmentation on PET data with the DCGAN model. They reported high levels of PSNR (0.82, 0.73) and SSIM (25.66, 22.85) in generated images for patients with AD and MCI. Additionally, the corresponding classifier exhibited good performance in the task of AD vs. CN classification with an accuracy of 0.78. reported mean PSNR and SSIM values of 32.83 and 77.48, respectively, on the generated PET image data. The accuracy of the classifier based on these augmented data was 71.45% in the AD vs. CN classification, which was evidently higher than the value of 10% obtained using the classifier without data augmentation.
Modality Conversion
The type of data is also a vital factor contributing to diagnostic performance. In our study, 36% (5/14) of the included studies used multimodal data (PET and MRI) for analysis. PET data commonly provide metabolic information that is helpful in determining the diagnosis. For example, the reduction in glucose metabolism in the bilateral parietal lobes (involving the posterior cingulate gyrus and the precuneus) detected using 18F-FDG-PET and the Aβ protein and Tau protein deposition detected in the corresponding PET images are regarded as one of the most potential biomarkers for AD (; ; ; ). MRI data, especially sMRI, mainly provide structural information for diagnosis. Cerebral neurodegenerative structural changes in sMRI, such as a reduction in hippocampal volume and atrophy of some specific cerebral regions (parahippocampal gyrus, amygdala, temporal gyrus, upper parietal lobe, and posterior cingulate gyrus), have been detected in patients with AD (). The combination of PET and MRI data provides complementary features for AD diagnosis and obtains more promising results than data obtained with a single modality (; ). This superiority might be more prominent between two cohorts with small differences, such as patients with pMCI and sMCI. Deep learning methods based on multimodal data have become increasingly popular in diagnosing AD. A GAN can provide Supplementary Data for multimodality studies, as it facilitates the conversion between PET and MRI data. achieved PET and MRI data conversion using a GAN model with reversible blocks. The addition of these blocks improved the non-linear fitting ability of the model and provided images of higher quality. The authors showed high similarity between the generated images of the hippocampal region (as the ROI) and the ground truth (PSNR: 29.34, SSIM: 0.8034 on PET and PSNR: 29.81, SSIM: 0.9389 on MRI). proposed a GAN model with two pyramid convolution blocks and a self-attention mechanism to achieve MRI-PET data conversion. They also applied the task-induced mechanism in D to preserve important pathological information. The result revealed a high SSIM (0.915 ± 0.04) and PSNR (29.0 ± 2.99) of the generated PET image.
Researchers have also focused on biomarkers detected using different MRI modalities, including sMRI, functional magnetic resonance imaging (fMRI), and diffusion tensor imaging (DTI). For sMRI, alterations in anatomy reflected by T1-weighted MRI, such as atrophy of the hippocampus and rates of brain atrophy, have been extensively investigated (). In addition, T2 heterogeneity is a potential biomarker reflecting changes in the integrity of brain microstructure and predicting cognitive decline (). Changes in the microstructure and integrity of white matter are observed on DTI (). One study showed that a decrease in fractional anisotropy is detected in multiple posterior white matter regions in patients with AD (). For fMRI, changes in the functional connectivity of different brain regions also have the potential for AD diagnosis (). All included studies used T1-weighted MRI data, without GAN based on multimodal MRI data. Except for the potential biomarkers reflected by T1-weighted MRI, those reflected by other MRI modalities are emerging. Although some studies reported the excellent diagnostic performance of multimodal MRI deep learning methods (; ), we propose that caution must be exercised in the development of this type of method until these emerging biomarkers are confirmed further.
Some risk factors for AD have been identified, such as the presence of apolipoprotein E (APOE) ε4ε4, depression, diabetes, hypertension, older age, female sex, and lower Mini-Mental State Examination (MMSE) scores (; ). Therefore, clinical information may also be considered an important part of multimodal studies. considered the function of this information, such as baseline age, sex, education level, and APOE ε4 allele, in the aging simulation process to generate more realistic aging images and obtain accurate predictions for AD progression.
In contrast to the two-stage structure, networks in some studies were established based only on the GAN structure. and only applied a GAN without any other classifiers in anomaly detection for AD, as the D of GAN is actually a classifier. In their study, the G of GAN was run to reconstruct images of subjects based on features learned from images of CN individuals, while the D of GAN was operated to identify patients with AD based on the difference between the reconstructed images and the images of CN individuals. The advantage of this structure over the two-stage structure is that the result of the classification will be fed back to G, ensuring that the generated images have a good classification effect, not simply high quality based on PSNR and SSIM metrics.
Some studies have considered both the two-stage structure and the feedback from the classifier. applied a GAN to obtain 3-T MRI data from 1.5-T MRI data and further used the generated 3-T imaging data to train an FCN classifier for AD classification. The G of GAN obtained feedback from the FCN and subsequently generate images with good classification effects. They found that the entire diagnostic model exhibited better diagnostic performance.
However, GANs still have some disadvantages when used in practical applications. First, concurrent training of G and D without making a certain network more powerful is a substantial challenge (). Second, the function of GAN is difficult to interpret. It operates as a black box with visible input and output sides and invisible functions of G and D. The internal logic is difficult to clearly explain.
Our study showed the potential of GAN-based deep learning methods for diagnosing AD and MCI. The following criteria were applied to ensure the diagnosis if possible for the use of this method in clinical practice in the future: (1) diagnoses of other possible brain disorders were excluded; (2) at least one type of neuroimaging data was available, such as sMRI and PET; and (3) the conclusive diagnosis should be based on a combination of the results from GAN methods with those from neuropsychological tests, history analysis, and other clinical diagnoses.
Limitations and Future Research Directions
Limitations: (1) All included studies used data of AD patients through clinical diagnosis rather than neuropathological examination. Currently, there is still a certain gap between their diagnostic accuracy (). Therefore, the diagnostic performance of GAN methods should be validated further on AD patients diagnosed through neuropathology, even though it is not easy to achieve this goal in the near future. (2) The number of studies included in the meta-analysis of the task of pMCI vs. sMCI classification is relatively small. (3) Due to the limited number of studies, this study only investigated the tasks of AD vs. CN and pMCI vs. sMCI classification. The classification performance of GAN-based deep learning methods must be explored in other tasks, such as the AD vs. MCI vs. CN classification. (3) The lack of subgroup analysis based on the type of data and the method of image processing by GAN is also a limitation of the study.
Some suggestions are provided for future research. First, studies on the task of pMCI vs. sMCI classification and other tasks are needed to further explore the performance of GAN-based deep learning methods. Second, researchers should conduct studies to analyze the roles of the type of data, the type of GAN, and the method of image processing in the diagnostic model. Third, GAN application in other fields (non-medical imaging) may also be considered, such as AD molecular data (). Data insufficiency in bioinformatics may be resolved with data augmentation by GAN (). Fourth, using data from patients definitively diagnosed with AD through a neuropathological examination at autopsy rather than a clinical diagnosis would result in methods with more clinical application value.
Conclusion
This systematic review and meta-analysis reported the good performance of GAN-based deep learning methods in the task of AD vs. CN classification. This good performance is largely attributed to its powerful functions in image processing, including quality improvement, aging simulation, data augmentation, and modality conversion. However, their diagnostic performance in the task of pMCI vs. sMCI classification was not remarkable. Studies using large datasets must be conducted to further explore these methods.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Statements
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.
Author contributions
CQ, YZ, and TC: conceptualization, methodology, and writing original draft preparation. CQ and YM: software and formal analysis. YZ, QC, YM, HF, and JL: validation. CQ, YZ, YM, QC, JL, ZJ, TC, and QG: writing—review and editing. TC and QG: supervision and funding acquisition. All authors contributed to the article and approved the submitted version.
Funding
This research was funded by the National Natural Science Foundation of China (Grant Nos. 81820108018 and 81401398), the National Key Research and Development Project (Grant No. 2018YFC1704605), the Sichuan Science and Technology Program (Grant No. 2019YJ0049), the Sichuan Provincial Health and Family Planning Commission (Grant No. 19PJ080), the National College Students’ Innovation and Entrepreneurship Training Program (Grant No. C2021116624), and the Chinese Postdoctoral Science Foundation (Grant No. 2013M530401).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnagi.2022.841696/full#supplementary-material
References
1
AnsartM.EpelbaumS.BassignanaG.BôneA.BottaniS.CattaiT.et al (2021). Predicting the progression of mild cognitive impairment using machine learning: a systematic, quantitative and critical review.Med. Image Anal.67:101848. 10.1016/j.media.2020.101848
2
ArbizuJ.FestariC.AltomareD.WalkerZ.BouwmanF.RivoltaJ.et al (2018). Clinical utility of FDG-PET for the clinical diagnosis in MCI.Eur. J. Nuclear Med. Mol. Imaging451497–1508. 10.1007/s00259-018-4039-7
3
AtriA. (2019). The Alzheimer’s disease clinical spectrum diagnosis and management.Med. Clin. North Am.103263–293. 10.1016/j.mcna.2018.10.009
4
BaydargilH. B.ParkJ.-S.KangD.-Y. (2021). Anomaly analysis of Alzheimer’s disease in PET images using an unsupervised adversarial deep learning model.Appl. Sci.11:2187. 10.3390/app11052187
5
BeachT. G.MonsellS. E.PhillipsL. E.KukullW. (2012). Accuracy of the clinical diagnosis of Alzheimer disease at National Institute on Aging Alzheimer Disease Centers, 2005-2010.J. Neuropathol. Exp. Neurol.71266–273. 10.1097/NEN.0b013e31824b211b
6
BloudekL. M.SpackmanD. E.BlankenburgM.SullivanS. D. (2011). Review and meta-analysis of biomarkers and diagnostic imaging in Alzheimer’s disease.J. Alzheimers Dis.26627–645. 10.3233/jad-2011-110458
7
ChetelatG. (2018). Multimodal neuroimaging in Alzheimer’s disease: early diagnosis, physiopathological mechanisms, and impact of lifestyle.J. Alzheimers Dis.64S199–S211. 10.3233/jad-179920
8
ChoH.ChoiJ. Y.HwangM. S.LeeJ. H.KimY. J.LeeH. M.et al (2016). Tau PET in Alzheimer disease and mild cognitive impairment.Neurology87375–383. 10.1212/wnl.0000000000002892
9
ChongM. S.SahadevanS. (2005). Preclinical Alzheimer’s disease: diagnosis and prediction of progression.Lancet Neurol.4576–579. 10.1016/s1474-4422(05)70168-x
10
ClarkC. M.PontecorvoM. J.BeachT. G.BedellB. J.ColemanR. E.DoraiswamyP. M.et al (2012). Cerebral PET with florbetapir compared with neuropathology at autopsy for detection of neuritic amyloid-β plaques: a prospective cohort study.Lancet Neurol.11669–678. 10.1016/s1474-4422(12)70142-4
11
CummingsJ. L.MorstorfT.ZhongK. (2014). Alzheimer’s disease drug-development pipeline: few candidates, frequent failures.Alzheimers Res. Ther.6:37. 10.1186/alzrt269
12
DavisM.ConnellT. O.JohnsonS.ClineS.MerikleE.MartenyiF.et al (2018). Estimating Alzheimer’s disease progression rates from normal cognition through mild cognitive impairment and stages of dementia.Curr. Alzheimer Res.15777–788. 10.2174/1567205015666180119092427
13
ForouzannezhadP.AbbaspourA.FangC.CabrerizoM.LoewensteinD.DuaraR.et al (2019). A survey on applications and analysis methods of functional magnetic resonance imaging for Alzheimer’s disease.J. Neurosci. Methods317121–140. 10.1016/j.jneumeth.2018.12.012
14
GaoX.ShiF.ShenD.LiuM. (2021). Task-induced pyramid and attention GAN for multimodal brain image imputation and classification in Alzheimers disease.IEEE J. biomed. Health Inform.2636–43. 10.1109/jbhi.2021.3097721
15
GoodfellowI. J.Pouget-AbadieJ.MirzaM.XuB.Warde-FarleyD.OzairS.et al (2014). Generative adversarial networks.Adv. Neural Inform. Process. Syst.32672–2680.
16
HanC.RundoL.MuraoK.NoguchiT.ShimaharaY.MilacskiZ. Áet al (2021). MADGAN: unsupervised medical anomaly detection GAN using multiple adjacent brain MRI slice reconstruction.BMC Bioinformatics22(Suppl. 2):31. 10.1186/s12859-020-03936-1
17
HersiM.IrvineB.GuptaP.GomesJ.BirkettN.KrewskiD. (2017). Risk factors associated with the onset and progression of Alzheimer’s disease: a systematic review of the evidence.Neurotoxicology61143–187. 10.1016/j.neuro.2017.03.006
18
HoA. J.HuaX.LeeS.LeowA. D.YanovskyI.GutmanB.et al (2010). Comparing 3 T and 1.5 T MRI for tracking Alzheimer’s disease progression with tensor-based morphometry.Hum. Brain Mapp.31499–514. 10.1002/hbm.20882
19
HojjatiS. H.EbrahimzadehA.KhazaeeA.Babajani-FeremiA., and Alzheimer’s Disease Neuroimaging Initiative (2018). Predicting conversion from MCI to AD by integrating rs-fMRI and structural MRI.Comput. Biol. Med.10230–39. 10.1016/j.compbiomed.2018.09.004
20
HuZ.WuL.JiaJ.HanY. (2014). Advances in longitudinal studies of amnestic mild cognitive impairment and Alzheimer’s disease based on multi-modal MRI techniques.Neurosci. Bull.30198–206. 10.1007/s12264-013-1407-y
21
HymanB. T.PhelpsC. H.BeachT. G.BigioE. H.CairnsN. J.CarrilloM. C.et al (2012). National Institute on Aging-Alzheimer’s association guidelines for the neuropathologic assessment of Alzheimer’s disease.Alzheimers Dement.81–13. 10.1016/j.jalz.2011.10.007
22
IslamJ.ZhangY. (2020). GAN-based synthetic brain PET image generation.Brain Inform.7:3. 10.1186/s40708-020-00104-2
23
JackC. R.Jr. (2011). Alliance for aging research AD biomarkers work group: structural MRI.Neurobiol. Aging32S48–S57. 10.1016/j.neurobiolaging.2011.09.011
24
JackC. R.Jr.BennettD. A.BlennowK.CarrilloM. C.FeldmanH. H.FrisoniG. B.et al (2016). A/T/N: an unbiased descriptive classification scheme for Alzheimer disease biomarkers.Neurology87539–547. 10.1212/wnl.0000000000002923
25
JackC. R.Jr.LoweV. J.SenjemM. L.WeigandS. D.KempB. J.ShiungM. M.et al (2008). 11C PiB and structural MRI provide complementary information in imaging of Alzheimer’s disease and amnestic mild cognitive impairment.Brain131(Pt 3)665–680. 10.1093/brain/awm336
26
JackC. R.Jr.ShiungM. M.WeigandS. D.O’BrienP. C.GunterJ. L.BoeveB. F.et al (2005). Brain atrophy rates predict subsequent clinical conversion in normal elderly and amnestic MCI.Neurology651227–1231. 10.1212/01.wnl.0000180958.22678.91
27
JagustW.ReedB.MungasD.EllisW.DeCarliC. (2007). What does fluorodeoxyglucose PET imaging add to a clinical diagnosis of dementia?Neurology69871–877. 10.1212/01.wnl.0000269790.05105.16
28
JuR.HuC.ZhouP.LiQ. (2019). Early diagnosis of Alzheimer’s disease based on resting-state brain networks and deep learning.IEEE Trans. Comput. Biol. Bioinform.16244–257. 10.1109/tcbb.2017.2776910
29
KangW.LinL.ZhangB.ShenX.WuS. (2021). Multi-model and multi-slice ensemble learning architecture based on 2D convolutional neural networks for Alzheimer’s disease diagnosis.Comput. Biol. Med.136:104678. 10.1016/j.compbiomed.2021.104678
30
KimH. W.LeeH. E.LeeS.OhK. T.YunM.YooS. K. (2020). Slice-selective learning for Alzheimer’s disease classification using a generative adversarial network: a feasibility study of external validation.Eur. J. Nuclear Med. Mol. Imaging472197–2206. 10.1007/s00259-019-04676-y
31
LanL.YouL.ZhangZ.FanZ.ZhaoW.ZengN.et al (2020). Generative adversarial networks and its applications in biomedical informatics.Front. Public Health8:164. 10.3389/fpubh.2020.00164
32
LeeJ. G.JunS.ChoY. W.LeeH.KimG. B.SeoJ. B.et al (2017). Deep learning in medical imaging: general overview.Korean J. Radiol.18570–584. 10.3348/kjr.2017.18.4.570
33
LiJ. Q.TanL.WangH. F.TanM. S.TanL.XuW.et al (2016). Risk factors for predicting progression from mild cognitive impairment to Alzheimer’s disease: a systematic review and meta-analysis of cohort studies.J. Neurol. Neurosurg. Psychiatry87476–484. 10.1136/jnnp-2014-310095
34
LinE.LinC. H.LaneH. Y. (2021). Deep learning with neuroimaging and genomics in Alzheimer’s disease.Int. J. Mol. Sci.22:7911. 10.3390/ijms22157911
35
LinW.LinW.ChenG.ZhangH.GaoQ.HuangY.et al (2021). Bidirectional mapping of brain MRI and PET with 3D reversible GAN for the diagnosis of Alzheimer’s disease.Front. Neurosci.15:646013. 10.3389/fnins.2021.646013
36
LiuX.ChenK.WuT.WeidmanD.LureF.LiJ. (2018). Use of multimodality imaging and artificial intelligence for diagnosis and prognosis of early stages of Alzheimer’s disease.Transl. Res.19456–67. 10.1016/j.trsl.2018.01.001
37
LoganR.WilliamsB. G.Ferreira da SilvaM.IndaniA.SchcolnicovN.GangulyA.et al (2021). Deep convolutional neural networks with ensemble learning and generative adversarial networks for Alzheimer’s disease image data classification.Front. Aging Neurosci.13:720226. 10.3389/fnagi.2021.720226
38
LuiS.ZhouX. J.SweeneyJ. A.GongQ. (2016). Psychoradiology: the frontier of neuroimaging in psychiatry. Radiology281, 357–372. 10.1148/radiol.2016152149
39
MallikA.DrzezgaA.MinoshimaS. (2017). Clinical amyloid imaging.Semin. Nucl. Med.4731–43. 10.1053/j.semnuclmed.2016.09.005
40
MarinescuR. V.OxtobyN. P.YoungA. L.BronE. E.TogaA. W.WeinerM. W.et al (2019). TADPOLE challenge: accurate Alzheimer’s disease prediction through crowdsourced forecasting of future data.Predict. Intell. Med.118431–10. 10.1007/978-3-030-32281-6_1
41
Martí-JuanG.Sanroma-GuellG.PiellaG. (2020). A survey on machine and statistical learning for longitudinal analysis of neuroimaging data in Alzheimer’s disease.Comput. Methods Programs Biomed.189:105348. 10.1016/j.cmpb.2020.105348
42
MarzbanE. N.EldeibA. M.YassineI. A.KadahY. M., and Alzheimer’s Disease Neurodegenerative Initiative (2020). Alzheimer’s disease diagnosis from diffusion tensor images using convolutional neural networks.PLoS One15:e0230409. 10.1371/journal.pone.0230409
43
MatsudaH.ShigemotoY.SatoN. (2019). Neuroimaging of Alzheimer’s disease: focus on amyloid and tau PET.Jpn. J. Radiol.37735–749. 10.1007/s11604-019-00867-7
44
McDonaldC. R.McEvoyL. K.GharapetianL.Fennema-NotestineC.HaglerD. J.Jr.HollandD.et al (2009). Regional rates of neocortical atrophy from normal aging to early Alzheimer disease.Neurology73457–465. 10.1212/WNL.0b013e3181b16431
45
McInnesM. D. F.MoherD.ThombsB. D.McGrathT. A.BossuytP. M.CliffordT.et al (2018). Preferred reporting items for a systematic review and meta-analysis of diagnostic test accuracy studies: the PRISMA-DTA statement.JAMA319388–396. 10.1001/jama.2017.19163
46
McKhannG. M.KnopmanD. S.ChertkowH.HymanB. T.JackC. R.Jr.KawasC. H.et al (2011). The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease.Alzheimers Dement.7263–269. 10.1016/j.jalz.2011.03.005
47
MedinaD.DeToledo-MorrellL.UrrestaF.GabrieliJ. D. E.MoseleyM.FleischmanD.et al (2006). White matter changes in mild cognitive impairment and AD: a diffusion tensor imaging study.Neurobiol. Aging27663–672. 10.1016/j.neurobiolaging.2005.03.026
48
MirzaeiG.AdeliA.AdeliH. (2016). Imaging and machine learning techniques for diagnosis of Alzheimer’s disease.Rev. Neurosci.27857–870. 10.1515/revneuro-2016-0029
49
MisraC.FanY.DavatzikosC. (2009). Baseline and longitudinal patterns of brain atrophy in MCI patients, and their use in prediction of short-term conversion to AD: results from ADNI.Neuroimage441415–1422. 10.1016/j.neuroimage.2008.10.031
50
MorrisE.ChalkidouA.HammersA.PeacockJ.SummersJ.KeevilS. (2016). Diagnostic accuracy of F-18 amyloid PET tracers for the diagnosis of Alzheimer’s disease: a systematic review and meta-analysis.Eur. J. Nuclear Med. Mol. Imaging43374–385. 10.1007/s00259-015-3228-x
51
OuyangJ.ChenK. T.GongE.PaulyJ.ZaharchukG. (2019). Ultra-low-dose PET reconstruction using generative adversarial network with feature matching and task-specific perceptual loss.Med. Phys.463555–3564. 10.1002/mp.13626
52
PanY.LiuM.LianC.ZhouT.XiaY.ShenD. (2018). Synthesizing missing PET from MRI with cycle-consistent generative adversarial networks for Alzheimer’s disease diagnosis.Med. Image Comput. Comput. Assist. Interv.11072455–463. 10.1007/978-3-030-00931-1_52
53
PanegyresP. K.RogersJ. M.McCarthyM.CampbellA.WuJ. S. (2009). Fluorodeoxyglucose-positron emission tomography in the differential diagnosis of early-onset dementia: a prospective, community-based study.BMC Neurol.9:41. 10.1186/1471-2377-9-41
54
ParkJ.KimH.KimJ.CheonM. (2020). A practical application of generative adversarial networks for RNA-seq analysis to predict the molecular progress of Alzheimer’s disease.PLoS Comput. Biol.16:e1008099. 10.1371/journal.pcbi.1008099
55
PetersenR. C. (2004). Mild cognitive impairment as a diagnostic entity.J. Intern. Med.256183–194. 10.1111/j.1365-2796.2004.01388.x
56
PetersenR. C.DoodyR.KurzA.MohsR. C.MorrisJ. C.RabinsP. V.et al (2001). Current concepts in mild cognitive impairment.Arch. Neurol.581985–1992. 10.1001/archneur.58.12.1985
57
ReitzC.BrayneC.MayeuxR. (2011). Epidemiology of Alzheimer disease.Nat. Rev. Neurol.7137–152. 10.1038/nrneurol.2011.2
58
SabuncuM. R.KonukogluE. (2015). Clinical prediction from structural brain MRI scans: a large-scale empirical study.Neuroinformatics1331–46. 10.1007/s12021-014-9238-1
59
SajjadM.RamzanF.KhanM. U. G.RehmanA.KolivandM.FatiS. M.et al (2021). Deep convolutional generative adversarial network for Alzheimer’s disease classification using positron emission tomography (PET) and synthetic data augmentation.Microsc. Res. Tech.843023–3034. 10.1002/jemt.23861
60
ShenT.JiangJ.LuJ.WangM.ZuoC.YuZ.et al (2019). Predicting Alzheimer disease from mild cognitive impairment with a deep belief network based on 18F-FDG-PET images.Mol. Imaging18:1536012119877285. 10.1177/1536012119877285
61
ShinH.-C.IhsaniA.XuZ.MandavaS.SreenivasS. T.ForsterC.et al (2020). “GANDALF: generative adversarial networks with discriminator-adaptive loss fine-tuning for Alzheimer’s disease diagnosis from MRI,” in Proceedings of the Conference on Medical Image Computing and Computer Assisted Intervention, Lima.
62
SorinV.BarashY.KonenE.KlangE. (2020). Creating artificial images for radiology applications using generative adversarial networks (GANs) – a systematic review.Acad. Radiol.271175–1185. 10.1016/j.acra.2019.12.024
63
SpasovS.PassamontiL.DuggentoA.LiòP.ToschiN. (2019). A parameter-efficient deep learning approach to predict conversion from mild cognitive impairment to Alzheimer’s disease.Neuroimage189276–287. 10.1016/j.neuroimage.2019.01.031
64
SperlingR. A.AisenP. S.BeckettL. A.BennettD. A.CraftS.FaganA. M.et al (2011). Toward defining the preclinical stages of Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s association workgroups on diagnostic guidelines for Alzheimer’s disease.Alzheimers Dement.7280–292. 10.1016/j.jalz.2011.03.003
65
SundgrenP. C.DongQ.Gomez-HassanD.MukherjiS. K.MalyP.WelshR. (2004). Diffusion tensor imaging of the brain: review of clinical applications.Neuroradiology46339–350. 10.1007/s00234-003-1114-x
66
SuzukiK. (2017). Overview of deep learning in medical imaging.Radiol. Phys. Technol.10257–273. 10.1007/s12194-017-0406-5
67
TajbakhshN.JeyaseelanL.LiQ.ChiangJ. N.WuZ.DingX. (2020). Embracing imperfect datasets: a review of deep learning solutions for medical image segmentation.Med. Image Anal.63:101693. 10.1016/j.media.2020.101693
68
WangY.YuB.WangL.ZuC.LalushD. S.LinW.et al (2018). 3D conditional generative adversarial networks for high-quality PET image estimation at low dose.Neuroimage174550–562. 10.1016/j.neuroimage.2018.03.045
69
WearnA. R.NurdalV.Saunders-JenningsE.KnightM. J.IsotalusH. K.DillonS.et al (2020). T2 heterogeneity: a novel marker of microstructural integrity associated with cognitive decline in people with mild cognitive impairment.Alzheimers Res. Ther.12:105. 10.1186/s13195-020-00672-9
70
WegmayrV.HoroldM.BuhmannJ. M. (2019). “Generative aging of brain MRI for early prediction of MCI-AD conversion,” in Proceedings of the 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019) (Venice: IEEE), 1042–1046.
71
XiaC.DickersonB. C. (2017). Multimodal PET imaging of amyloid and tau pathology in Alzheimer disease and non-Alzheimer disease dementias.PET Clin.12351–359. 10.1016/j.cpet.2017.02.005
72
YanY.LeeH.SomerE.GrauV. (2018). “Generation of amyloid PET images via conditional adversarial training for predicting progression to Alzheimer’s disease,” in PRedictive Intelligence in MEdicine, edsRekikI.UnalG.AdeliE.ParkS. H. (Cham: Springer International Publishing), 26–33. 10.1007/978-3-030-00320-3_4
73
ZengQ.LiK.LuoX.WangS.XuX.LiZ.et al (2021). Distinct atrophy pattern of hippocampal subfields in patients with progressive and stable mild cognitive impairment: a longitudinal MRI study.J. Alzheimers Dis.79237–247. 10.3233/jad-200775
74
ZhangD.WangY.ZhouL.YuanH.ShenD. (2011). Multimodal classification of Alzheimer’s disease and mild cognitive impairment.Neuroimage55856–867. 10.1016/j.neuroimage.2011.01.008
75
ZhaoY.MaB.JiangP.ZengD.WangX.LiS. (2021). Prediction of Alzheimer’s disease progression with multi-information generative adversarial network.IEEE J. Biomed. Health Inform.25711–719. 10.1109/jbhi.2020.3006925
76
ZhouJ.HuL.JiangY.LiuL. (2021). A correlation analysis between SNPs and ROIs of Alzheimer’s disease based on deep learning.Biomed. Res. Int.2021:8890513. 10.1155/2021/8890513
77
ZhouX.QiuS.JoshiP. S.XueC.KillianyR. J.MianA. Z.et al (2021). Enhancing magnetic resonance imaging-driven Alzheimer’s disease classification performance using generative adversarial learning.Alzheimers Res. Ther.13:60. 10.1186/s13195-021-00797-5
Summary
Keywords
generative adversarial networks (GANs), Alzheimer’s disease, mild cognitive impairment (MCI), diagnosis, psychoradiology, systematic review, meta-analysis
Citation
Qu C, Zou Y, Ma Y, Chen Q, Luo J, Fan H, Jia Z, Gong Q and Chen T (2022) Diagnostic Performance of Generative Adversarial Network-Based Deep Learning Methods for Alzheimer’s Disease: A Systematic Review and Meta-Analysis. Front. Aging Neurosci. 14:841696. doi: 10.3389/fnagi.2022.841696
Received
22 December 2021
Accepted
03 March 2022
Published
21 April 2022
Volume
14 - 2022
Edited by
Wei Cheng, Fudan University, China
Reviewed by
Yi Su, Banner Alzheimer’s Institute, United States; Jiyang Jiang, University of New South Wales, Australia
Updates
Copyright
© 2022 Qu, Zou, Ma, Chen, Luo, Fan, Jia, Gong and Chen.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Taolin Chen, tlchen@scu.edu.cnQiyong Gong, qiyonggong@hmrrc.org.cn
†These authors share first authorship
This article was submitted to Alzheimer’s Disease and Related Dementias, a section of the journal Frontiers in Aging Neuroscience
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.