How to become twice more precise in detecting neuropsychological impairments
-
1
University of Milano-Bicocca, Department of Psychology, Italy
-
2
University of Milano, Department of Biotechnology and Translational Medicine, Italy
-
3
Humanitas Research Hospital, Unit of Neurosurgical Oncology, Italy
-
4
Maggiore Policlinico Hospital, Department of Neuroscience and Sense Organs, Italy
-
5
University of Milano-Bicocca, Department of Psychology, Italy
Introduction
Although it was a giant leap forward when it was introduced, the classic approach to the norming of neuropsychological tests (Capitani, 1987) has two main limitations: (i) it doesn’t consider possible interactions between covariates (e.g., age and education); (ii) working on by–subject percentages of correct responses, it cannot consider item covariates (e.g., frequency, length, imageability) that are known to affect performance substantially. Here we show how to overcome these limitations, and how this improves our diagnosis.
Methods
As a test case, we used the action–naming task devised by Crepaldi et al. (2006). 290 healthy Italian speakers (148 F and 142 M) made up our norming sample. They ranged 18 to 98 years in age (M=54.1) and 3 to 23 years in education (M=12.3).
The test was standardized: (i) following the classic Capitani approach, based on regressing by–subject mean accuracy on gender, age and education; (ii) adding interactions between gender, age and education to the classic approach; (iii) using raw correct/incorrect scores thanks to mixed–effect models, thus being able to take under control also item variables (e.g., frequency, imageability) and any additional item– or subject–specific random variability (mixed–effects norming; Jaeger, 2008).
Results
We first contrasted the three approaches in terms of their amount of explained variance in the computation of expected scores, that is, their ability to “wash out” unwanted effects from expected scores. The classic Capitani norming explained 34.7% of the total variance; interaction norming went up to 43.7%; and mixed–effects norming ensured 73% of explained variance.
A comparison between expected scores according to Capitani and mixed–effects norming in 2,600 combinations of age (20–85) and education values (3-22) revealed an overall correlation of .81. Differences were generally bigger with young age and low education, and with old age and high education; and typically showed higher expected scores by mixed–effects than Capitani norming (see Figure 1).
Equivalent Scores (ES) were then computed for a simulated sample of around 80,000 patients ranging in age (20–85 years), education (3–22 years), gender (M–F) and raw scores (20–50 correct responses). They disagree 28% of the times according to the two approaches. The difference (in either direction) is 1.28 in mean, and ranges from 1 to 4. Mixed–effects ES is lower than Capitani ES in 61% of the cases. Among the 45070 simulated patients that would be classified as impaired at naming verbs (ES=0) according to Capitani norming, 5% would not be classified as such (ES>0) according to mixed–effects norming. These figures are closely replicated in a sample of 69 unselected aphasic patients.
Discussion
The data indicate that using a better statistical model to calculate expected scores is highly beneficial in terms of amount of explained variance, that is, we can gauge the true effects of subject (e.g., age) and item variables (e.g., frequency) much more precisely, thus enjoying higher–quality corrected scores. Critically, this reflects substantially into how (simulated and actual) patients are classified.
References
Capitani, E. (1987). Statistical methods. In Spinnler, H. and Tognoni, G. (Eds.), Italian Normative Values and standardization of neuropsychological tests. Italian Journal of Neurological Sciences, 6 (suppl. 8).
Crepaldi, D., Aggujaro, S., Arduino, L. S., Zonca, G., Ghirardi, G., Inzaghi, M., Chierchia, G., and Luzzatti, C. (2006). Noun–verb dissociation in aphasia: The role of imageability and functional locus of the lesion Neuropsychologia, 44, 73–89.
Jaeger, F. T. (2008). Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models. Journal of Memory and Language, 59, 434-446.
Keywords:
Neuropsychological Tests,
standardization,
mixed-effects models,
action naming,
neuropsychological assessment
Conference:
Academy of Aphasia -- 52nd Annual Meeting, Miami, FL, United States, 5 Oct - 7 Oct, 2014.
Presentation Type:
Platform presentation ONLY
Topic:
Not student
Citation:
Crepaldi
D,
Casarotti
A,
Zarino
B and
Papagno
C
(2014). How to become twice more precise in detecting neuropsychological impairments.
Front. Psychol.
Conference Abstract:
Academy of Aphasia -- 52nd Annual Meeting.
doi: 10.3389/conf.fpsyg.2014.64.00065
Copyright:
The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers.
They are made available through the Frontiers publishing platform as a service to conference organizers and presenters.
The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated.
Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed.
For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions.
Received:
25 Apr 2014;
Published Online:
04 Aug 2014.
*
Correspondence:
Dr. Davide Crepaldi, University of Milano-Bicocca, Department of Psychology, Milano, 20126, Italy, davide.crepaldi@sissa.it