Adding Recognition Discriminability Index to the Delayed Recall Is Useful to Predict Conversion from Mild Cognitive Impairment to Alzheimer's Disease in the Alzheimer's Disease Neuroimaging Initiative

Introduction

Mild Cognitive Impairment (MCI) is a common condition defined as transitional state between normal cognition and dementia (Petersen et al., 2001). In general, subjects with MCI convert to dementia at an annual rate in the range of 10–15% (Farias et al., 2009). Predicting who among a group of MCI patients are more likely to further decline in cognition would be essential to ensure an early intervention and appropriate treatment as well as future preventive and treatment trials.

Of the MCI subtypes, patients with amnestic MCI (a-MCI) are at greatest risk. Poor delayed recall and recognition memory is a well-established pattern in the Alzheimer's disease (AD) literature, which is considered to reflect deficits in storage caused by deficient consolidation of new memory traces (Weintraub et al., 2012). Abundant evidence indicates delayed recall scores in word-list learning tasks such as the Rey Auditory Verbal Learning Test (RAVLT) (Rey, 1941, 1964) are perhaps the most challenging and accurate measures of episodic memory when used to accurately predict diagnostic conversion to AD (Estévez-González et al., 2003; Maruff et al., 2004; Griffith et al., 2006). It should be noted that other memory tests have shown predictive validity for clinical progression from MCI to AD, including Free and Cued Selective Reminding Test (FCSRT-FR) (Derby et al., 2013), delayed recall of story memory and verbal paired associates (Guarch et al., 2008) and visuospatial paired associate learning (Ahmed et al., 2008). Some authors (Dubois and Albert, 2004; Dubois et al., 2007) proposed using memory tests that provide encoding and retrieval facilities, such as the free and cued recall test (Grober and Buschke, 1987; Gainotti et al., 2014) to improve the prediction of MCI-AD conversion. However, a recently review showed inconclusive results (Grober and Buschke, 1987; Carlesimo et al., 2011; Gainotti et al., 2014). It is mandatory to have adequate and well-controlled studies to determine whether that test paradigms can improve the prediction of conversion from MCI to AD.

Thus, most clinical studies assume that memory is a single entity and extrapolate the results of a single memory measure (e.g., delayed recall or recognition task, verbal, or visual memory test) to the global memory functioning. Episodic memory can be subdivided according to the different stages on the reproduction process (e.g., free recall, cued recall, or recognition) and this multicomponent analysis may be used to describe the real risk of MCI to AD conversion. To our knowledge, it is not clear whether measurement of recognition task adds benefit for measuring conversion over time in a clinical cohort.

In the present study, we investigated whether recognition memory tasks in combination with delayed recall measure of episodic memory and CSF biomarkers can predict MCI to AD conversion at 24-month follow-up. We chose to examine this issue using ADNI, a public data set with a large sample and prospective nature. Delayed recall is the most important predictor for MCI to AD conversion. In addition, AD's patient deficits are evident in recognition tasks, with the presence of many false alarms errors. Most studies simplify recognition task by only registering the number of correct identifications (hits), without the inclusion of false alarms in their interpretation. Based on the signal detection theory, a discriminability recognition index (d-prime) can be calculated including both hits and false alarms (Russo et al., 2016). In addition, d-prime has been shown to distinguish healthy older adults from those with a-MCI or mild AD. We hypothesized that the addition of the d-prime measure to the delayed recall task would be good predictor of conversion from a-MCI to AD at 24-month follow-up in combination with CSF biomarkers related to AD, which were significant discriminators in other studies (Tabert et al., 2006; Lanari and Parnetti, 2009; Gomar et al., 2011) and were independently associated with future cognitive decline compared to other surrogate of neurodegeneration as MRI (Vemuri et al., 2009). We also thought that the addition of the traditional recognition score would be not a good predictor in combination with the same markers.

With the concepts explained in these paragraphs, we measured:

(i) The main effect of the cognitive measures: RAVLT delayed recall, traditional RAVLT recognition, and d-prime.

(ii) The main effect of the known risk factors such as age, sex, education, and APOE genotype.

(iii) The main effect of the CSF biomarkers related to AD: Aβ1-42, P-tau181, and total tau.

(iv) The interaction between RAVLT delayed recall and recognition measures (traditional score and d-prime), which represents the influence of the delayed recall on the magnitude of the recognition task.

Many papers have looked at specific clinical markers and biomarkers in isolation but never set up a study to compare the added effect to predict conversion to dementia. We believed that this analysis would help to interpret the MCI-AD transition in this sample and to propose the d-prime as an early useful cognitive marker to predict AD conversion.

Materials and Methods

Subjects

Data used in the preparation of this article were obtained from the Alzheimer's disease Neuroimaging Initiative (ADNI) database (adni.loni.usc.edu). The ADNI was launched in 2003 by the National Institute on Aging (NIA), the National Institute of Biomedical Imaging and Bioengineering (NIBIB), the Food and Drug Administration (FDA), private pharmaceutical companies and non-profit organizations, as a $60 million, 5-year public-private partnership. The primary goal of ADNI has been to test whether serial magnetic resonance imaging (MRI), positron emission tomography (PET), other biological markers, and clinical and neuropsychological assessment can be combined to measure the progression of mild cognitive impairment (MCI) and early Alzheimer's disease (AD). Determination of sensitive and specific markers of very early AD progression is intended to aid researchers and clinicians to develop new treatments and monitor their effectiveness, as well as lessen the time and cost of clinical trials.

The Principal Investigator of this initiative is Michael W. Weiner, MD, VA Medical Center, and University of California—San Francisco. ADNI is the result of efforts of many co-investigators from a broad range of academic institutions and private corporations, and subjects have been recruited from over 50 sites across the U.S. and Canada. The initial goal of ADNI was to recruit 800 subjects but ADNI has been followed by ADNI-GO and ADNI-2. To date these three protocols have recruited over 1,500 adults, ages 55–90, to participate in the research, consisting of cognitively normal older individuals, people with early or late MCI, and people with early AD. The follow up duration of each group is specified in the protocols for ADNI-1, ADNI-2, and ADNI-GO. Subjects originally recruited for ADNI-1 and ADNI-GO had the option to be followed in ADNI-2. For up-to-date information, see http://www.adni-info.org (Mueller et al., 2005; Petersen et al., 2010).

A total of 397 subjects with a-MCI from the ADNI study were included in the current analysis. MCI subjects fulfilled criteria for a-MCI (Petersen, 2004): nondemented subjects with memory complaint (global CDR score = 0.5, with a Memory Box score ≥ 0.5), MMSE score of 24–30, a Modified Hachinski Ischemic Score (Rosen et al., 1980) ≤4, a Geriatric Depression Score short form (Sheikh and Yesavage, 1986) <6, and preserved instrumental activities of daily living. Subjects performed at an objective cut-off of 1.5 standard deviations (SD) below education-adjusted cut-off scores on the Logical Memory IIa of the Weschler Memory Scale-Revised (Wechsler, 1987). The summary of the baseline characteristics of the ADNI subjects indicated that the subjects with MCI presented memory-only deficits (Petersen et al., 2010).

The subjects with a-MCI were divided into two groups for the comparison between those who convert to AD dementia during 24-month follow-up and those who did not.

Psychometric Testing

The baseline characteristics of the subjects from ADNI cohort relevant to describe their neuropsychological profile were the Mini Mental State Examination (MMSE) (Folstein et al., 1975); Logical memory test of immediate and delayed recognition, Wechsler Memory Scale III (Wechsler, 1987); Boston Naming Test (Kaplan et al., 1983); Categorical and Phonological Verbal Fluency test (Morris et al., 1989); Digit Span Forward and Backward (Wechsler, 1997); Trail Making Test A and B (Reitan, 1958); GDS short form (Sheikh and Yesavage, 1986); and RAVLT (Rey, 1941, 1964).

The RAVLT consists of five learning trials in which a list of 15 words is read and the subject is asked to immediately recall orally as many items as possible. After an interference list of 15 novel words is read and recalled, subjects are then asked to recall words from the initial list (5-min delayed recall). A 30-min delayed recall trial and recognition test follow. For the recognition test, subjects are presented with a list of the 15 studied words and 15 non-studied foils and are asked to circle all words previously learned.

Discriminability refers to the ability to distinguish target words from distractor words, and is widely considered the best measure of recognition memory accuracy. Discriminability index (d-prime = Z hits rate – Z false alarms rate) is adapted from signal detection theory (Snodgrass and Corwin, 1988) and is analogous to a contrast z score, reflecting the absolute difference in standard deviation units between subject hit rate and false alarm rate (Donaldson, 1992).

CSF Analysis

CSF was available from 198 (49.80%) patients. Methods for cerebrospinal fluid (CSF) acquisition and biomarker measurement using the ADNI cohort has been reported previously (Shaw et al., 2009). In brief, CSF was collected and stored at −80°C at the University of Pennsylvania ADNI Biomarker Core Laboratory. Amyloid-β from peptides 1-42 (Aβ1-42), tau phosphorylated at threonine 181 (P-tau181), and total tau was measured using the multiplex xMAP Luminex platform (Luminex Corp, Austin TX) with Innogenetics (INNOBIA AlzBio3, Ghent, Belgium) immunoassay kit–based reagents.

APOE ε4 Status

APOE ε4 status was considered as a binary variable (i.e., at least one ε4 allele vs. none).

Statistical Analyses

Statistical analysis was performed with SPSS∗ Version 19.0 software for Windows. Independent sample t-tests were used to assess differences in clinical, cognitive and biomarkers CSF variables. The χ²-test was used for the analysis of gender and APOEε4 carrier status differences between groups. The Pearson's test of correlation was used to measure the degree of relationship between conversion status at 24-month follow-up and the predictive factors. Logistic regression modeling was done to assess the predictive value of all RAVLT measures (Delayed Recall, Recognition, and d-prime), risk factors such as age (in years), sex (male/female), education (in years), APOEε4 carrier status (at least 1 allele vs. none allele, MMSE score, and CSF biomarkers levels for progression to AD. Estimating adjusted odds ratios was used to determine which variables would produce an optimal predictive model, and whether adding tests of interaction between the RAVLT Delayed Recall and RAVLT recognition measures (traditional score and d-prime) would improve prediction of the conversion from a-MCI to AD by including the main effects and two interaction terms (RAVLT Delayed Recall∗RAVLT Recognition; RAVLT Delayed Recall∗d-prime).

Results

The clinical and demographic characteristics of the subjects as well as CSF biomarkers are listed by conversion status in Table 1. At the 24-month follow-up, 112 (28.2%) subjects developed AD dementia (converters) and 285 (71.8%) subjects did not (nonconverters). Those who developed AD dementia had worse performance on baseline MMSE (t = 3.35, p = 0.001), Delayed Recall Logical Memory (t = 5.17, p < 0.001), RAVLT Delayed Recall (t = 5.28, p < 0.001), RAVLT Recognition (t = 3.98, p < 0.001), and d-prime (t = 3.53, p = 0.001), but were not significantly different with respect to sex, age, education, and other neuropsychological tests. The proportion of the individuals with APOEε4 was also significantly higher in those who developed AD dementia than those who did not (χ² = 11.81, p = 0.003). CSF Aβ 11-42, tau, and P-tau181 levels were available in 198 subjects from two groups (58 vs. 140) for those who developed AD dementia and those who did not respectively. The group of a-MCI patients who progressed to AD dementia had lower levels of CSF Aβ42 (t = 3.71, p < 0.001) and CSF AD profile (t = 3.78, p < 0.001) than the group of non- progressive a-MCI patients.

TABLE 1

Table 1. Demographic characteristics, cognitive tests scores, and CSF biomarker profile on the MCI sample at baseline, split according to progression status at 24-month follow-up.

Results of logistic regression analyses are shown in Table 2. Of the variables entered into the first step, only RAVLT Delayed Recall and CSF Aβ42 levels reached significance with the odds of 0.79 (95% CI 0.66–0.94) and 0.99 (95% CI 0.98–0.99), respectively. The overall model was statistically significant (χ² = 32.03, df = 12, p = 0.001). When both interactions (RAVLT Delayed Recall∗RAVLT Recognition; RAVLT Delayed Recall∗d-prime) were entered to evaluate the impact of both recognition measures in predicting conversion, only CSF Aβ42 levels and RAVLT Delayed Recall∗d-prime interaction remained significant in the model with the odds of 0.98 (95% CI 0.97–0.99) and 0.75 (95% CI 0.58–0.97), respectively. Also, the overall model was statistically significant (χ² = 38.23, df = 14, p < 0.001). The area under the curve was.75, and the percentage of cases classified correctly was 77.4% at c = 0.50. Sensitivity was 0.41 and specificity was 0.93 at c = 0.50. The decrease in deviance was the largest for the second step including CSF Aβ42 levels and RAVLT Delayed Recall∗d-prime interaction, indicating that adding d-prime to delayed recall increased the predictive accuracy compared to delayed recall alone (205.354 – 199.149 = 6.205). The drop in deviance was significant (t = −52.79, df = 196, p < 0.001). CSF markers by each potential effect modifier (age, gender, MMSE, RAVLT delayed recall, RAVLT recognition memory, d-prime, or APOE ε4) interaction term was added to model; there was no change in the results.

TABLE 2

Table 2. Results of logistic regression analysis.

There were weak positive correlations between conversion ratio to AD dementia and MMSE, RAVLT Delayed Recall, RAVLT Recognition, and d-prime (r = 0.207, 0.299, −0.215, 0.254, respectively, n = 397, p < 0.05) (Table 3). There was also a significant but negative correlation between conversion ratio to AD dementia and CSF Aβ42 levels (r = −0.659, n = 198, p < 0.001). There were also a significant but positive correlation between conversion ratio to AD dementia and APOEε4 carrier status, (r = 0.355, n = 397, p < 0.001), and CSF P-tau181 levels (r = 0.429, n = 198, p < 0.001).

TABLE 3

Table 3. Correlations between conversion status at 24-month follow-up and the predictive factors.

Discussion

In this study, we demonstrated that baseline CSF Aβ1-42 levels, RAVLT Delayed Recall, and the combination of RAVLT Delayed Recall and Recognition Discriminability Index (d-prime) were the strongest predictors of conversion from a-MCI to AD at 24-month follow-up in patients in the ADNI sample. These results were independent of other factors known to increase the risk of developing dementia, such as age, gender, education level, and APOEε4 status (Tabert et al., 2006; Lanari and Parnetti, 2009; Gomar et al., 2011). We also showed that the combination of RAVLT Delayed Recall and traditional recognition measure may not predict MCI-AD conversion.

One might argue that the use of verbal episodic memory markers in this context is redundant. However, this may not be correct because the RAVLT memory measures examined as a predictor in this paper was not part of the study inclusion criteria in ADNI cohort (WMS-R logical memory was used). Nevertheless, evaluation of different components of verbal episodic memory deficit as a predictor in patients with a-MCI may be an advantage to interpret our patients in clinical practice or to improve their recruitment in clinical trials. Other important issue is that the diagnostic conversions over the 24-month period should be viewed with some caution. A 24-month change period is not a sufficient amount of time to draw conclusions regarding the likelihood of clinical change. However, we preferred not include the 36- or 48-month period due to partially missing baseline data.

Numerous studies that characterized the episodic memory deficit in AD have used word list learning tasks such as those from the Consortium to Establish a Registry for Alzheimer Disease (CERAD) (Welsh et al., 1992), the RAVLT (Rey, 1941, 1964), and the California Verbal Learning Test (CVLT) (Delis et al., 1991). These studies consistently showed that AD patients are equally impaired (relative to age-matched controls) on recognition and free recall components of the tasks. This pattern of performance is consistent with impaired consolidation rather than ineffective retrieval of new information (Delis et al., 1991). This memory profile is a useful measure for a clinical diagnosis and classification MCI subjects.

However, MCI in general and a-MCI in particular are heterogeneous clinical constructs, and the reported literature that investigated the role of different verbal episodic memory task as a predictor of cognitive decline in MCI is variable, with inhomogeneous results. Explicit measures of delayed recall have been reported the best predictors of the development of AD in MCI subjects (Gainotti et al., 2014). With respect to the recognition memory task, we found few studies that assessed their predictive value. Rabin et al. (2009) revealed that logical memory recognition best predicted the progression to AD followed closely by the delayed recall condition of CVLT-II. Yang et al. (2012) subdivided a-MCI sample from ADNI cohort into two subtypes, encoding failure (a-MCI-E) vs. retrieval deficit (a-MCI-R) but did not find that a-MCI-E was an independent prognostic factor to predict the progression to AD. In addition to the neuropsychological predictors, current criteria and recommendations (Dubois et al., 2007; Albert et al., 2011) proposed that incorporation of distinctive and reliable biomarkers of underlying AD to predict MCI-AD conversion. Most prior studies of CSF biomarkers have showed only modest prognostic accuracy for prediction of conversion from MCI to AD (Vemuri et al., 2009). On the other hand, most of these studies aimed to identify the predictive value of a set of commonly measured variables, with classification accuracies reaching up to 80%. However, none of these prior studies have investigated the predictive value when combining different related variables to homogenize the group of subjects with higher risk of conversion.

We have found that delayed recall can make important influence to recognition task in patients who convert to dementia, when the hits and false alarms are considered. Considering that memory is not a unitary concept, the strategy of combining recall and recognition memory measures might provide a more accurate assessment of MCI individuals who perform poorly on list learning tasks or allow to develop an empirical perspective of subtyping within a-MCI that may identify more homogenous subgroups reflecting common etiology and better predictors of decline. We considered that the simultaneous analysis of CSF biomarkers or the combination of different assessment yielded a better prediction of conversion from MCI to AD.

Future research should more closely examine which memory processes are tapped by specific tasks and the nature and extent of decline in these processes during the insidious transition from healthy aging to MCI to AD. This suggested subdivision within a-MCI based on recall and recognition performance need to be assessed using traditional delayed recall and recognition measures, but with inclusion of additional variables (e.g. d-prime). We also expect that future prediction studies consider the co-occurrence effects of different variables (interactions), and not only traditional additive (main effects) models.

Ethics Statement

The study was approved by the Institute of Neurological Research FLENI Ethics and Research Committee. The paper was reviewed and was acceptable for submission by the Alzheimer's Disease Neuroimaging Initiative Data and Publications Committee (ADNI DPC).

Author Contributions

All authors contributed extensively to the work presented in this paper. MR designed the study. JC and SV helped to evaluate and edit the manuscript. GS helped in the interpretation of data related to biomarkers. RA supervised development or research work and helped in data interpretation and manuscript evaluation.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

Data collection and sharing for this project was funded by the Alzheimer's Disease Neuroimaging Initiative (ADNI) (National Institutes of Health Grant U01 AG024904) and DOD ADNI (Department of Defense award number W81XWH-12-2-0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: Alzheimer's Association; Alzheimer's Drug Discovery Foundation; BioClinica, Inc.; Biogen Idec Inc.; Bristol-Myers Squibb Company; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; GE Healthcare; Innogenetics, N.V.; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Medpace, Inc.; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Synarc Inc.; and Takeda Pharmaceutical Company. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimer's Disease Cooperative Study at the University of California, San Diego. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California. The other authors report no conflicts of interest and have nothing to disclose.

References

Ahmed, S., Mitchell, J., Arnold, R., Nestor, P. J., and Hodges, J. R. (2008). Predicting rapid clinical progression in amnestic mild cognitive impairment. Dement. Geriatr. Cogn. Disord. 25, 170–177. doi: 10.1159/000113014

PubMed Abstract | CrossRef Full Text | Google Scholar

Albert, M. S., DeKosky, S. T., Dickson, D., Dubois, B., Feldman, H. H., Fox, N. C., et al. (2011). The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the national institute on aging-Alzheimer's association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. 7, 270–279. doi: 10.1016/j.jalz.2011.03.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Carlesimo, G. A., Perri, R., and Caltagirone, C. (2011). Category cued recall following controlled encoding as a neuropsychological tool in the diagnosis of Alzheimer's disease: a review of the evidence. Neuropsychol. Rev. 21, 54–65. doi: 10.1007/s11065-010-9153-7

CrossRef Full Text | Google Scholar

Delis, D. C., Massman, P. J., Butters, N., Salmon, D. P., Cermak, L. S., and Kramer, J. H. (1991). Profiles of demented and amnesic patients on the California verbal learning test: implications for the assessment of memory disorders. Psychol. Assess. 3, 19–26. doi: 10.1037/1040-3590.3.1.19

CrossRef Full Text | Google Scholar

Derby, C. A., Burns, L. C., Wang, C., Katz, M. J., Zimmerman, M. E., L'italien, G., et al. (2013). Screening for predementia AD: time-dependent operating characteristics of episodic memory tests. Neurology 80, 1307–1314. doi: 10.1212/WNL.0b013e31828ab2c9

PubMed Abstract | CrossRef Full Text | Google Scholar

Donaldson, W. (1992). Measuring recognition memory. J. Exp. Psychol. Gen. 121, 275–277. doi: 10.1037/0096-3445.121.3.275

PubMed Abstract | CrossRef Full Text | Google Scholar

Dubois, B., and Albert, M. L. (2004). Amnestic MCI or prodromal Alzheimer's disease? Lancet Neurol. 3, 246–248. doi: 10.1016/S1474-4422(04)00710-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Dubois, B., Feldman, H. H., Jacova, C., Dekosky, S. T., Barberger-Gateau, P., Cummings, J., et al. (2007). Research criteria for the diagnosis of Alzheimer's disease: revising the NINCDS-ADRDA criteria. Lancet Neurol. 6, 734–746. doi: 10.1016/S1474-4422(07)70178-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Estévez-González, A., Kulisevsky, J., Boltes, A., Otermín, P., and García-Sánchez, C. (2003). Rey verbal learning test is a useful tool for differential diagnosis in the preclinical phase of Alzheimer's disease: comparison with mild cognitive impairment and normal aging. Int. J. Geriatr. Psychiatry 18, 1021–1028. doi: 10.1002/gps.1010

PubMed Abstract | CrossRef Full Text | Google Scholar

Farias, S. T., Mungas, D., Reed, B. R., Harvey, D., and DeCarli, C. (2009). Progression of mild cognitive impairment to dementia in clinic- vs community-based cohorts. Arch. Neurol. 66, 1151–1157. doi: 10.1001/archneurol.2009.106

PubMed Abstract | CrossRef Full Text | Google Scholar

Folstein, M. F., Folstein, S. E., and McHugh, P. R. (1975). Mini mental state” A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12, 189–198. doi: 10.1016/0022-3956(75)90026-6

PubMed Abstract | CrossRef Full Text

Gainotti, G., Quaranta, D., Vita, M. G., and Marra, C. (2014). Neuropsychological predictors of conversion from mild cognitive impairment to Alzheimer's disease. J. Alzheimers Dis. 38, 481–495. doi: 10.3233/JAD-130881

PubMed Abstract | CrossRef Full Text | Google Scholar

Gomar, J. J., Bobes-Bascaran, M. T., Conejero-Goldberg, C., Davies, P., and Goldberg, T. E. (2011). Utility of combinations of biomarkers, cognitive markers, and risk factors to predict conversion from mild cognitive impairment to Alzheimer disease in patients in the Alzheimer's disease neuroimaging initiative. Arch. Gen. Psychiatry 68, 961–969. doi: 10.1001/archgenpsychiatry.2011.96

PubMed Abstract | CrossRef Full Text | Google Scholar

Griffith, H. R., Netson, K. L., Harrell, L. E., Zamrini, E. Y., Brockington, J. C., and Marson, D. C. (2006). Amnestic mild cognitive impairment: diagnostic outcomes and clinical prediction over a two-year time period. J. Int. Neuropsychol. Soc. 12, 166–175. doi: 10.1017/S1355617706060267

PubMed Abstract | CrossRef Full Text | Google Scholar

Grober, E., and Buschke, H. (1987). Genuine memory deficits in dementia. Dev. Neuropsychol. 3, 13–36. doi: 10.1080/87565648709540361

CrossRef Full Text | Google Scholar

Guarch, J., Marcos, T., Salamero, M., Gastó, C., and Blesa, R. (2008). Mild cognitive impairment: a risk indicator of later dementia, or a preclinical phase of the disease? Int. J. Geriatr. Psychiatry 23, 257–65. doi: 10.1002/gps.1871

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaplan, E., Goodglass, H., and Weintraub, S. (1983). The Boston Naming Test. Philadelphia: Lea & Febiger.

Lanari, A., and Parnetti, L. (2009). Cerebrospinal fluid biomarkers and prediction of conversion in patients with mild cognitive impairment: 4-year follow-up in a routine clinical setting. Sci. World J. 9, 961–966. doi: 10.1100/tsw.2009.106

PubMed Abstract | CrossRef Full Text | Google Scholar

Maruff, P., Collie, A., Darby, D., Weaver-Cargin, J., Masters, C., and Currie, J. (2004). Subtle memory decline over 12 months in mild cognitive impairment. Dement Geriatr. Cogn. Disord. 18, 342–348. doi: 10.1159/000080229

PubMed Abstract | CrossRef Full Text | Google Scholar

Morris, J. C., Heyman, A., Mohs, R. C., Hughes, J. P., van Belle, G., Fillenbaum, G., et al. (1989). The consortium to establish a registry for Alzheimer's disease (CERAD). Part, I. clinical and neuropsychological assessment of Alzheimer's disease. Neurology 39, 1159–1165. doi: 10.1212/WNL.39.9.1159

PubMed Abstract | CrossRef Full Text

Mueller, S. G., Weiner, M. W., Thal, L. J., Petersen, R. C., Jack, C. R., Jagust, W., et al. (2005). Ways toward an early diagnosis in Alzheimer's disease: the Alzheimer's Disease Neuroimaging Initiative (ADNI). Alzheimers Dement. 1, 55–66. doi: 10.1016/j.jalz.2005.06.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Petersen, R. C. (2004). Mild cognitive impairment as a diagnostic entity. J. Intern. Med. 256, 183–194. doi: 10.1111/j.1365-2796.2004.01388.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Petersen, R. C., Aisen, P. S., Beckett, L. A., Donohue, M. C., Gamst, A. C., Harvey, D. J., et al. (2010). Alzheimer's Disease Neuroimaging Initiative (ADNI): clinical characterization. Neurology 74, 201–209. doi: 10.1212/WNL.0b013e3181cb3e25

PubMed Abstract | CrossRef Full Text | Google Scholar

Petersen, R. C., Stevens, J. C., Ganguli, M., Tangalos, E. G., Cummings, J. L., and DeKosky, S. T. (2001). Practice parameter: early detection of dementia: mild cognitive impairment (an evidence-based review). Report of the Quality Standards Subcommittee of the American Academy of Neurology. Neurology 56, 1133–1142. doi: 10.1212/WNL.56.9.1133

PubMed Abstract | CrossRef Full Text | Google Scholar

Rabin, L. A., Paré, N., Saykin, A. J., Brown, M. J., Wishart, H. A., Flashman, L. A., et al. (2009). Differential memory test sensitivity for diagnosing amnestic mild cognitive impairment and predicting conversion to Alzheimer's disease. Neuropsychol. Dev. Cogn. B Aging Neuropsychol. Cogn. 16, 357–376. doi: 10.1080/13825580902825220

PubMed Abstract | CrossRef Full Text | Google Scholar

Reitan, R. M. (1958). Validity of the trail making test as an indicator of organic brain damage. Percept. Mot. Skills 8, 271–276. doi: 10.2466/pms.1958.8.3.271

CrossRef Full Text

Rey, A. (1941). Psychological examination of traumatic encephalopathy. Arch. Psychol. 28, 286–340.

Google Scholar

Rey, A. (1964). L'examen Clinique En Psychologie. Paris: Presses Universitaires de France.

Google Scholar

Rosen, W. G., Terry, R. D., Fuld, P. A., Katzman, R., and Peck, A. (1980). Pathological verification of ischemic score in differentiation of dementias. Ann. Neurol. 7, 486–488. doi: 10.1002/ana.410070516

PubMed Abstract | CrossRef Full Text | Google Scholar

Russo, M. J., Cohen, G., Campos, J., Martin, M. E., Clarens, M. F., Sabe, L., et al. (2016). Usefulness of discriminability and response bias indices for the evaluation of recognition memory in mild cognitive impairment and Alzheimer disease. Dement. Geriatr. Cogn. Disord. 43, 1–14. doi: 10.1159/000452255

PubMed Abstract | CrossRef Full Text | Google Scholar

Shaw, L. M., Vanderstichele, H., Knapik-Czajka, M., Clark, C. M., Aisen, P. S., Petersen, R. C., et al. (2009). Cerebrospinal fluid biomarker signature in Alzheimer's disease neuroimaging initiative subjects. Ann. Neurol. 65, 403–413. doi: 10.1002/ana.21610

PubMed Abstract | CrossRef Full Text | Google Scholar

Sheikh, J., and Yesavage, J. (1986). “Recent evidence and development of a shorter version,” in Clinical Gerontology: A Guide to Assessment and Intervention, ed T. L. Brink (New York, NY: The Haworth Press), 165–173.

Google Scholar

Snodgrass, J. G., and Corwin, J. (1988). Pragmatics of measuring recognition memory: applications to dementia and amnesia. J. Exp. Psychol. Gen. 117, 34–50. doi: 10.1037/0096-3445.117.1.34

PubMed Abstract | CrossRef Full Text | Google Scholar

Tabert, M. H., Manly, J. J., Liu, X., Pelton, G. H., Rosenblum, S., Jacobs, M., et al. (2006). Neuropsychological prediction of conversion to Alzheimer disease in patients with mild cognitive impairment. Arch. Gen. Psychiatry 63, 916–924. doi: 10.1001/archpsyc.63.8.916

PubMed Abstract | CrossRef Full Text | Google Scholar

Vemuri, P., Wiste, H. J., Weigand, S. D., Shaw, L. M., Trojanowski, J. Q., Weiner, M. W., et al. (2009). MRI and CSF biomarkers in normal, MCI, and AD subjects: diagnostic discrimination and cognitive correlations. Neurology 73, 287–293. doi: 10.1212/wnl.0b013e3181af79e5

PubMed Abstract | CrossRef Full Text | Google Scholar

Wechsler, D. (1987). WMS-R Wechsler Memory Scale - Revised Manual. New York; NY: The Psychological Corporation, Harcourt Brace Jovanovich, Inc.

Wechsler, D. (1997). Wechsler Memory Scale, 3rd Edn. San Antonio, TX: The Psychological Corporation.

Weintraub, S., Wicklund, A. H., and Salmon, D. P. (2012). The neuropsychological profile of Alzheimer disease. Cold Spring Harb. Perspect. Med. 2:a006171. doi: 10.1101/cshperspect.a006171

PubMed Abstract | CrossRef Full Text | Google Scholar

Welsh, K. A., Butters, N., Hughes, J. P., Mohs, R. C., and Heyman, A. (1992). Detection and staging of dementia in Alzheimer's disease. Use of the neuropsychological measures developed for the consortium to establish a registry for Alzheimer's Disease. Arch. Neurol. 49, 448–452. doi: 10.1001/archneur.1992.00530290030008

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, H. D., Yang, Y. S., Legesse, B. T., and Kim, S. Y. (2012). Subtypes of amnestic mild cognitive impairment based on memory impairment pattern and its potential clinical significance. Dement. Neurocognitive Disord. 11, 59–66. doi: 10.12779/dnd.2012.11.2.59

CrossRef Full Text | Google Scholar