Original Research ARTICLE
Do manual and voxel-based morphometry measure the same? A proof of concept study
- 1Department of Neurology/Epileptology and Hertie Institute of Clinical Brain Research, University Medical Center, Eberhard Karls University, Tuebingen, Germany
- 2Department of Clinical Neurophysiology, University Medical Center, Georg August University, Goettingen, Germany
- 3Department of Psychiatry and Psychotherapy, Center for Translational Research in Systems Neuroscience and Clinical Psychiatry, Georg August University, Goettingen, Germany
- 4Department of Psychiatry and Psychotherapy, Ludwig-Maximilians-University, Munich, Germany
Voxel-based morphometry (VBM) is a commonly used method to study volumetric variations on a whole brain basis. However, it is often criticized for potential confounds, mainly based on imperfect spatial registration. We therefore aimed to evaluate if VBM and “gold standard” manual volumetry are measuring the same effects with respect to subcortical gray matter volumes. Manual regions-of-interest were drawn in the hippocampus, amygdala, nucleus accumbens, thalamus, putamen, pallidum, and caudate nucleus bilaterally. Resulting volumes were used for a whole brain VBM correlation analysis with Statistical Parametric Mapping (SPM8). The hippocampus, amygdala, putamen, and caudate nucleus were correctly identified by SPM using the contemporary high-dimensional normalization (DARTEL toolbox). This strongly suggests that VBM and manual volumetry both are indeed measuring the same effects with regard to subcortical brain structures.
Since its first description in the late 1990s (1, 2) voxel-based morphometry (VBM) has gained much attention in the neuroscience community and has been applied to pathological and physiological conditions alike. However, from the very beginning there was a general discussion about the validity of the underlying spatial normalization process with the notion that anatomical localization could not be trusted (3). It was hypothesized that global volumetric alterations can be mistaken for local effects. There are several reports in the literature that VBM findings could not be replicated by repeat studies or manual validation, e.g., in schizophrenia (4), which can be regarded as lack of robustness of the method. In the last years, however, revised segmentation (5) and spatial normalization techniques (6) have been described that have improved registration accuracy and thus statistical power (7, 8). To measure volumetric alterations, manual region of interest (ROI)-based methods are still regarded as gold standard by many authors but these are much more time-consuming, subject to operator biased, and require a priori anatomical constraints. So far systematic comparisons of automated VBM and manual ROI-based methods have shown conflicting results. One study has reported a superiority of ROI volumetry in physiological aging with an overestimation of age-related differences in regional brain volumes by VBM (9); another study found VBM to be equally specific in detecting local volumetric alterations in expected regions but also capable of detecting remote volume loss in Huntington disease patients (10).
Although VBM- and ROI-based methods are, in principle, measuring similar effects (usually gray volume alterations), the underlying principle is quite different. In the present study, we aimed to investigate whether ROI-based manual volumetry of subcortical brain structures and contemporary VBM in SPM8 (DARTEL toolbox) provide directly correlated results and if these results show anatomical specificity in a large sample of psychiatric patients and healthy controls recruited for different, in part diagnosis-specific, projects of our group. To this end, we obtained manual ROI-derived absolute volumes of subcortical gray matter structures and used these as main effect regressors in a VBM analysis. It was expected that VBM would show significant correlations anatomically associated to the subcortical structure in question.
Materials and Methods
One hundred and sixty-three subjects participated in the study. The study sample comprised healthy controls (N = 54) and psychiatric patients diagnosed with schizophrenia (N = 41), bipolar affective disorder (N = 41), or obsessive–compulsive disorder (N = 27). The mean age was 36.9 ± 12.1 years (range 16–65), 80 subjects were female (see Table 1). The groups were not matched for age and gender; therefore these parameters were included into the voxel-based analysis as covariates of no interest. All subjects gave informed consent and the investigations were approved by the local ethics committee.
Structural magnetic resonance imaging (MRI) was carried out using a 1.5 T scanner (Siemens Sonata, Erlangen, Germany). A T1-weighted MPRAGE sequence (TE = 4.42 ms, TR = 1900 ms, TI = 700 ms, flip angle = 15°, FOV 256 mm × 256 mm) of 176 consecutive slices was acquired with a voxel size of 1 mm × 1 mm × 1 mm. Manual ROIs were drawn using the software packages Analyze (1999; Mayo Foundation, Rochester, MN, USA), MRIcro (http://www.cabiatl.com/mricro/) as well as in-house IDL applications as previously described (11–14). First, the magnetic resonance images were realigned in parallel to the anterior commissure–posterior commissure plane. Trained single operators, blinded to the diagnosis, drew outlines of the ROI. These outlines were evaluated for accuracy in the perpendicular cutplanes. The ROI volumes were determined using automatic algorithms programed in MATLAB. ROIs were drawn for the hippocampus, amygdala, nucleus accumbens, thalamus, putamen, pallidum, and caudate nucleus separately for both sides. ROI delineation was done step by step in subsamples by trained single operators. All ROI analyses were initially realized in subsamples over a recruitment period of 4 years in order to answer other scientific, in part diagnosis-specific, questions in the context of different projects of our group. As recruitment was continued after some subsamples had been analyzed by manual morphometry, ROI data was not available for all MRI data sets. The current approach has the advantage that manual volumetry was performed by only one single, trained operator for each ROI without any bias by adding post hoc ROI data. Details of the available ROIs per group are given in Table 2.
Protocol for Region of Interest Delineation
Caudate nucleus (caput): ROIs were drawn on the coronal sections including all gray matter voxels. The tail was not included since this encompasses only very few voxels and is difficult to trace unambiguously. Putamen: this region was drawn on the axial sections with a lateral border at the external capsule, the anterior–medial border at the internal capsule and the posterior–medial border defined by the white matter voxels between putamen and pallidum. Pallidum: this region was also drawn on the axial sections and included all gray matter voxels between the putamen as lateral border and the internal capsule as medial border. The ROI included the lateral and medial parts of the structure as a whole. Nucleus accumbens: this region was drawn on the coronal sections. It was delimited by the inferior border of the head of the caudate nucleus, the internal capsule, and the anterior–medial border of the putamen. Thalamus: this structure was outlined as a whole on the coronal sections and was defined by the posterior aspects of the internal capsule and the third and lateral ventricles as medial and posterior margins, see also Radenbach et al. (13). Hippocampus: this region was drawn on sagittal sections and checked in the other coronal and horizontal views, see Pajonk et al. (11). Amygdala: this region was drawn in the coronal sections. The anterior border was defined by the point when the amygdala became too diffuse to be resolved from the temporo-polar cortex. The superior and lateral borders were defined by the temporal lobe white matter and the inferior border by the white matter of the parahippocampal gyrus as previously described (12, 14, 15).
Images were converted to NIFTI format and processed on an offline Linux workstation using SPM8. The images were segmented into gray and white matter tissue classes and spatially normalized according to the SPM8 DARTEL procedure with default settings in 1.5 mm cubic resolution and MNI space using a custom, sample-derived template (6). The normalized gray matter maps were modulated with the resulting Jacobian determinant maps and smoothed with an 8-mm FWHM Gaussian kernel. Total intracranial volume (TIV) was estimated by adding up the native space volumes of the gray matter, white matter, and CSF maps in MATLAB. The GLM analysis was in turn set up for each ROI in a multiple regressions design with the absolute, manually measured ROI volume as main effect and including diagnosis group, age, gender, and TIV as covariates of no interest (Figure 1). One-tailed t contrasts were then generated using family wise error rate (FWE) correction with a p < 0.05 and, additionally (as exploratory test), with an uncorrected p < 0.0001 threshold.
Figure 1. Example SPM design matrix. A typical SPM design matrix is shown. The volume column is the main effect contrast, total intracranial volume (TIV), age, diagnostic group (SZ, schizophrenia; BPD, bipolar affective disorder; OCD, obsessive compulsive disorder), and sex are included as covariates of no interest.
There was a strong positive and significant right–left correlation between all manually drawn ROI volumes (Pearson correlation coefficients were calculated between all right and left subcortical volumes: hippocampus r = 0.361, p < 0.001; amygdala r = 0.813, p < 0.001; nucleus accumbens r = 0.695, p < 0.001; caudate r = 0.927, p < 0.001; pallidum r = 0.687, p < 0.001; putamen r = 0.938, p < 0.001; thalamus r = 0.754, p < 0.001; all two-sided significant).
Figure 2. SPM results in glass brain projection. SPM glass brains for different regions and thresholds [p < 0.05 (FWE corrected) and p < 0.0001 (uncorrected)] are shown. Images are in neurological convention (left in the image is left in the subject). FWE, family-wise error correction; DARTEL, normalization done with DARTEL-toobox; HC, hippocampus; AM, amygdala; CN, caudate nucleus; PU, putamen.
Figure 3. Superimposed SPM results. Thresholded SPM results (uncorrected p < 0.0001) superimposed on the averaged T1-weighted images of all subjects are shown. The color scale represents SPM t-scores, images are in radiological convention (left in image is right in the subject). Rows are different seed regions: (A) left hippocampus, (B) right hippocampus, (C) left amygdala, (D) right amygdala, (E) left caudate nucleus, (F) left putamen.
SPM detected significant correlations (p < 0.05 FWE-corrected) of the manually measured ROI volumes and the anatomically corresponding gray matter volume as measured by VBM in both hippocampi, both caudate nuclei, and both putamina. Interestingly, in all these analyses the structure in question was detected bilaterally, sometimes with slightly higher T-scores on the contralateral side. For the amygdala ROI, only the respective contralateral structure survived the error correction; however, with the exploratory threshold both amygdalae were detected. For the pallidum and nucleus accumbens ROIs, no suprathreshold clusters could be found both with the conservative FWE-corrected analysis as well as with the uncorrected p < 0.0001 threshold. The thalamus ROI volumes also showed no suprathreshold correlations within the structures in question. With an even lower significance threshold of p < 0.001 (uncorrected), the left pallidum and both thalami could be identified, but with this threshold 20 (left pallidum), 19 (left thalamus), or 46 (right thalamus) suprathreshold clusters outside the ROI would also be detected (data not shown).
In this study, we assessed whether voxel-based morphometric analyses using SPM8 (DARTEL) and manual volumetry would show results consistent with each other in a mixed sample of patients with schizophrenia, bipolar affective disorder, and obsessive–compulsive disorder and healthy controls. In particular, we performed GLM analyses by entering the manually determined volumes of different ROIs in a (multiple) regression design. From a theoretical point of view, the observed variations of the ROI-measured subcortical volumes should be closely correlated to the VBM-measured local gray matter volume in the corresponding voxels. This design, thus, allowed for clear a priori hypotheses where significant correlations should be localized.
In fact, these hypotheses were confirmed in the DARTEL processing stream for both hippocampi, amygdalae, caudate nuclei, and putamina, but not for the nucleus accumbens, thalamus, and pallidum. These would have required even lower significance thresholds (p < 0.001 and less) that are usually not acceptable in a whole brain analysis. Several possible explanations may account for the partially negative results in these regions. The nucleus accumbens is difficult to outline in manual volumetry due to proximity to the caudate nucleus and putamen. Thalamus and pallidum on the other hand are structures that are not homogenously segmented as gray matter by SPM: the thalamus is divided into multiple subnuclei with intersecting white matter tracts, whereas the manual ROI tracing was done following the outer boundaries of the structure as a whole. The pallidum is iron rich causing susceptibility effects and automated standard methods based on T1-weighted images often fail to segment this structure correctly (16). Also for these regions, the available N was lower in comparison to the hippocampus and amygdala. Nevertheless, as the same N was sufficient to show strong correlations in the caudate and putamen, it is unlikely that this effect was purely power-dependent. Another interesting finding is the strong bilaterality of correlations in the VBM results. As the manually measured volumes were also strongly right–left correlated, the contralateral structure in question was always detected in the VBM analysis as well, sometimes even with slightly higher significance levels. This highlights that, in a mixed sample of psychiatric patients and controls, volume alterations are not strongly lateralized. This is in keeping with a large meta-analysis of hippocampus volumes in schizophrenic patients that found a highly significant volume loss without any side preference (4). Also in depression, amygdala volumes were affected bilaterally although the direction of alterations seems to be influenced by drug effects (17). Another MRI study reported reduced thalamic volumes in major depressive disorder, which was also symmetric (18).
With a clear hypothesis or with an exploratory intention, it can be useful and justified to apply a more liberal significance threshold, e.g., p < 0.0001 (uncorrected). In our sample, this was necessary to detect the ipsilateral amygdala that would not have survived full-brain FWE correction. This approach did, however, impact on specificity as additional clusters occurred outside the principal ROI (Table 3). Of note, covariance in homotopic, but also ipsilateral and heterotopic gray matter densities measured by VBM has been reported (19) and is seen, for example, in age-related decline (20). Therefore, these additional clusters may be explained by structural covariance, although it cannot be excluded that some are spurious. In summary, we could demonstrate that VBM, particularly the contemporary DARTEL-based variant, is in fact measuring the same effect as manual volumetry in most subcortical regions and shows high anatomical specificity. Further studies, however, are needed to evaluate the impact of VBM for cortical regions.
All authors and co-authors contributed substantially to this work. Niels K. Focke, Oliver Gruber, Peter Falkai, and Walter Paulus initiated and designed the study. Oliver Gruber and Peter Falkai were involved in data acquisition. Niels K. Focke, Oliver Gruber, and Sarah Trost analyzed and interpreted the data. Niels K. Focke, Oliver Gruber, and Sarah Trost critically discussed the results. Niels K. Focke and Sarah Trost wrote the manuscript. Oliver Gruber, Peter Falkai, and Walter Paulus critically revised the manuscript. Sarah Trost finalized the manuscript. All authors and co-authors approved the final version of the manuscript.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
2. Wright IC, McGuire PK, Poline JB, Travere JM, Murray RM, Frith CD, et al. A voxel-based method for the statistical analysis of gray and white matter density applied to schizophrenia. Neuroimage (1995) 2(4):244–52. doi:10.1006/nimg.1995.1032
4. Steen RG, Mull C, McClure R, Hamer RM, Lieberman JA. Brain volume in first-episode schizophrenia: systematic review and meta-analysis of magnetic resonance imaging studies. Br J Psychiatry (2006) 188:510–8. doi:10.1192/bjp.188.6.510
7. Bergouignan L, Chupin M, Czechowska Y, Kinkingnéhun S, Lemogne C, Le Bastard G, et al. Can voxel based morphometry, manual segmentation and automated segmentation equally detect hippocampal volume differences in acute depression? Neuroimage (2009) 45(1):29–37. doi:10.1016/j.neuroimage.2008.11.006
8. Klein A, Andersson J, Ardekani BA, Ashburner J, Avants B, Chiang M-C, et al. Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration. Neuroimage (2009) 46(3):786–802. doi:10.1016/j.neuroimage.2008.12.037
9. Kennedy KM, Erickson KI, Rodrigue KM, Voss MW, Colcombe SJ, Kramer AF, et al. Age-related differences in regional brain volumes: a comparison of optimized voxel-based morphometry to manual volumetry. Neurobiol Aging (2009) 30(10):1657–76. doi:10.1016/j.neurobiolaging.2007.12.020
10. Douaud G, Gaura V, Ribeiro M-J, Lethimonnier F, Maroy R, Verny C, et al. Distribution of grey matter atrophy in Huntington’s disease patients: a combined ROI-based and voxel-based morphometric study. Neuroimage (2006) 32(4):1562–75. doi:10.1016/j.neuroimage.2006.05.057
11. Pajonk F-G, Wobrock T, Gruber O, Scherk H, Berner D, Kaizl I, et al. Hippocampal plasticity in response to exercise in schizophrenia. Arch Gen Psychiatry (2010) 67(2):133–43. doi:10.1001/archgenpsychiatry.2009.193
12. Scherk H, Gruber O, Menzel P, Schneider-Axmann T, Kemmer C, Usher J, et al. 5-HTTLPR genotype influences amygdala volume. Eur Arch Psychiatry Clin Neurosci (2009) 259(4):212–7. doi:10.1007/s00406-008-0853-4
13. Radenbach K, Flaig V, Schneider-Axmann T, Usher J, Reith W, Falkai P, et al. Thalamic volumes in patients with bipolar disorder. Eur Arch Psychiatry Clin Neurosci (2010) 260(8):601–7. doi:10.1007/s00406-010-0100-7
14. Wolf C, Mohr H, Schneider-Axmann T, Reif A, Wobrock T, Scherk H, et al. CACNA1C genotype explains interindividual differences in amygdala volume among patients with schizophrenia. Eur Arch Psychiatry Clin Neurosci (2014) 264(2):93–102. doi:10.1007/s00406-013-0427-y
15. Brambilla P, Harenski K, Nicoletti M, Sassi RB, Mallinger AG, Frank E, et al. MRI investigation of temporal lobe structures in bipolar patients. J Psychiatr Res (2003) 37(4):287–95. doi:10.1016/S0022-3956(03)00024-4
16. Helms G, Draganski B, Frackowiak R, Ashburner J, Weiskopf N. Improved segmentation of deep brain grey matter structures using magnetization transfer (MT) parameter maps. Neuroimage (2009) 47(1):194–8. doi:10.1016/j.neuroimage.2009.03.053
17. Hamilton JP, Siemer M, Gotlib IH. Amygdala volume in major depressive disorder: a meta-analysis of magnetic resonance imaging studies. Mol Psychiatry (2008) 13(11):993–1000. doi:10.1038/mp.2008.57
20. Raz N, Lindenberger U, Rodrigue KM, Kennedy KM, Head D, Williamson A, et al. Regional brain changes in aging healthy adults: general trends, individual differences and modifiers. Cereb Cortex (2005) 15(11):1676–89. doi:10.1093/cercor/bhi044
Keywords: voxel-based morphometry, manual volumetry, validation, DARTEL, mixed psychiatric sample
Citation: Focke NK, Trost S, Paulus W, Falkai P and Gruber O (2014) Do manual and voxel-based morphometry measure the same? A proof of concept study. Front. Psychiatry 5:39. doi: 10.3389/fpsyt.2014.00039
Received: 31 December 2013; Accepted: 25 March 2014;
Published online: 08 April 2014.
Edited by:Christoph Mulert, Universitätsklinikum Hamburg-Eppendorf, Germany
Reviewed by:Bhavani Shankara Bagepally, National Institute of Mental Health and Neuroscience, India
Kiyotaka Nemoto, University of Tsukuba, Japan
Hiroshi Matsuda, National Center of Neurology and Psychiatry, Japan
Copyright: © 2014 Focke, Trost, Paulus, Falkai and Gruber. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Oliver Gruber, Department of Psychiatry and Psychotherapy, Center for Translational Research in Systems Neuroscience and Clinical Psychiatry, Georg August University Goettingen, Von-Siebold-Str. 5, Goettingen 37075, Germany e-mail: firstname.lastname@example.org
†Niels K. Focke and Sarah Trost have contributed equally to this work.