Event Abstract

Does Parametric fMRI Analysis with SPM Yield Valid Results? –
An Empirical Study of 1484 Rest Datasets

  • 1 Linköping University, Economics, Sweden

‘Statistical Parametric Mapping’ SPM is one of the most popular software packages used for analyzing neuroimaging data in Neuroscience as well as in Neuroeconomics. Yet it has been debated for a long time if the assumptions that are required for standard parametric approaches to analyze neuroimaging data really are appropriate for functional magnetic resonance imaging (fMRI) data. It has also been debated how the problem of multiple testing should be solved. In 2010 when Bennett et. al. found significant brain activity in a dead salmon when using the SPM software, the debate escalated. Our research group analyzed 1484 rest datasets in SPM8 to estimate true family wise error rates (see Eklund et. al. Neuroimage, 2012). Results showed that for a family wise significance threshold of 5%, significant activity was found in 1% - 70% of the 1484 rest datasets, depending on repetition time, paradigm and parameter settings. This means that parametric significance thresholds in SPM can be both conservative and very liberal. The main reason for the high family wise error rates seems to be that the global AR(1) auto correlation correction in SPM fails to model the spectra of the residuals, especially for short repetition times. These findings speak to the need for a better model of temporal correlations in fMRI time series. This poster aims to start a discussion on pre-processing and analyzing neuroimaging data, repetition times and alternative models for temporal correlations.

Acknowledgements

Anders Eklunda,b,∗, Mats Anderssona,b, Camilla Josephsonb,c, Magnus Johannessonc,d, Hans Knutssona,b
aDivision of Medical Informatics, Department of Biomedical Engineering, Linko ̈ping University, Linko ̈ping, Sweden bCenter for Medical Image Science and Visualization (CMIV), Linko ̈ping University, Linko ̈ping, Sweden cDepartment of Management and Engineering, Linko ̈ping University, Linko ̈ping, Sweden dDepartment of Economics, Stockholm School of Economics, Stockholm, Sweden

References

A. R. Ferreira da Silva, 2010. cudaBayesreg: Bayesian Computation in CUDA. The R Journal 2/2, 48–55.
A. R. Ferreira da Silva, 2011. A Bayesian multilevel model for fMRI data analysis. Computer Methods and Programs in Biomedicine 102, 238–252.
Bennett, C.M., Baird, A.A., Miller, M.B., Wolford, G.L., 2010. Neural corre- lates of interspecies perspective taking in the post-mortem atlantic salmon: An argument for multiple comparisons correction. Journal of Serendipitous and Unexpected Results 1, 1–5.
Bianciardi, M., Cerasa, A., Patria, F., Hagberg, G., 2004. Evaluation of mixed effects in event-related fMRI studies: Impact of first-level design and filter- ing. NeuroImage 22, 1351–1370.
Biswal, B., Mennes, M., Zuo, X.N., Gohel, S., Kelly, C., Smith, S.M., Beck- mann, C.F., Adelstein, J.S., Buckner, R.L., Colcombe, S., Dogonowski, A.M., Ernst, M., Fair, D., Hampson, M., Hoptman, M.J., Hyde, J.S., Kiviniemi, V.J., Ko ̈tter, R., Li, S.J., Lin, C.P., Lowe, M.J., Mackay, C., Mad- den, D.J., Madsen, K.H., Margulies, D.S., Mayberg, H.S., McMahon, K., Monk, C.S., Mostofsky, S.H., Nagel, B.J., Pekar, J.J., Peltier, S.J., Petersen, S.E., Riedl, V., Rombouts, S.A., Rypma, B., Schlaggar, B.L., Schmidt, S., Seidler, R.D., Siegle, G.J., Sorg, C., Teng, G.J., Veijola, J., Villringer, A., Walter, M., Wang, L., Weng, X.C., Whitfield-Gabrieli, S., Williamson, P., Windischberger, C., Zang, Y.F., Zhang, H.Y., Castellanos, F.X., Milham, M.P., 2010. Toward discovery science of human brain function. PNAS 107, 4734–4739.
Biswal, B., Yetkin, F., Haughton, V., Hyde, J., 1995. Functional connectivity in the motor cortex of resting state human brain using echo-planar MRI. Magnetic Resonance in Medicine 34, 537–541.
Bjo ̈rnsdotter, M., Rylander, K., Wessberg, J., 2011. A Monte Carlo method for locally multivariate brain mapping. NeuroImage 56, 508–516.
Brammer, M.J., Bullmore, E.T., Simmons, A., Williams, S.C.R., Grasby, P.M., Howard, R.J., R.Woodruff, P., Rabe-Hesketh, S., 1997. Generic brain activa- tion mapping in functional magnetic resonance imaging: A nonparametric approach. Magnetic Resonance Imaging 15, 763–770.
Bullmore, E., Long, C., Suckling, J., Fadili, J., Calvert, G., Zelaya, F., Carpen- ter, T., Brammer, M., 2001. Colored noise and computational inference in neurophysiological fMRI time series analysis: resampling methods in time and wavelet domains. Human Brain Mapping 12, 61–78.
Dagli, M., Ingeholm, J., Haxby, J., 1999. Localization of cardiac induced signal change in fMRI. NeuroImage 9, 407–415.
Das, S., Sen, P., 1994. Restricted canonical correlations. Linear Algebra and its Applications 210, 29–47.
Dwass, M., 1957. Modified randomization tests for nonparametric hypotheses. The Annals of Mathematical Statistics 28, 181–187.
Eklund, A., Andersson, M., Knutsson, H., 2010. Phase based volume registra- tion using CUDA, in: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2010, pp. 658–661.
Eklund, A., Andersson, M., Knutsson, H., 2011a. Fast random permutation tests enable objective evaluation of methods for single subject fMRI analy- sis. International Journal of Biomedical Imaging, Article ID 627947 .
Eklund, A., Andersson, M., Knutsson, H., 2012. fMRI analysis on the GPU - possibilities and challenges. Computer Methods and Programs in Biomedicine 105, 145–161.
Eklund, A., Friman, O., Andersson, M., Knutsson, H., 2011b. A GPU acceler- ated interactive interface for exploratory functional connectivity analysis of fMRI data, in: IEEE International Conference on Image Processing (ICIP), pp. 1621–1624.
Feinberg, D.A., Moeller, S., Smith, S.M., Auerbach, E., Ramanna, S., Glasser, M.F., Miller, K.L., Ugurbil, K., Yacoub, E., 2010. Multiplexed echo planar imaging for sub-second whole brain FMRI and fast diffusion imaging. PloS ONE 5, e15710.
Friman, O., Borga, M., Lundberg, P., Knutsson, H., 2003. Adaptive analysis of fMRI data. NeuroImage 19, 837–845.
Friman, O., Carlsson, J., Lundberg, P., Borga, M., Knutsson, H., 2001. Detec- tion of neural activity in functional MRI using canonical correlation analy- sis. Magnetic Resonance in Medicine 45, 323–330.
Friman, O., Morocz, I., Westin, C.F., 2005. Examining the whiteness of fMRI noise, in: Proceedings of the Annual Meeting of the International Society of Magnetic Resonance in Medicine (ISMRM), p. 699.
Friman, O., Westin, C.F., 2005. Resampling fMRI time series. NeuroImage 25, 859–867.
Friston, K., Josephs, O., Zarahn, E., Holmes, A., Rouquette, S., Poline, J., 2000. To smooth or not to smooth - bias and efficiency in fMRI time-series analysis. Neuroimage 12, 196–208.
Friston, K., Worsley, K., Frackowiak, R., Mazziotta, J., Evans, A., 1994. As- sessing the significance of focal activations using their spatial extent. Human Brain Mapping 1, 210–220.
Gembris, D., Neeb, M., Gipp, M., Kugel, A., Ma ̈nner, R., 2011. Correlation analysis on GPU systems using NVIDIA’s CUDA. Journal of real-time im- age processing 6, 275–280.
Hayasaka, S., Nichols, T., 2003a. Validating cluster size inference: random field and permutation methods. NeuroImage 20, 2343–2356.
Hayasaka, S., Nichols, T., 2003b. Validation of the random field theory-based cluster size test in single-subject fMRI analyses, in: Proceedings of Interna- tional Society of Magnetic Resonance in Medicine (ISMRM), p. 493.
Holmes, A., Blair, R., Watson, J., Ford, I., 1996. Nonparametric analysis of statistic images from functional mapping experiments. Journal of Cerebral Blood Flow & Metabolism 16, 7–22.
Inselberg, A., 1985. The plane with parallel coordinates. Visual Computer 1, 69–91.
Kriegeskorte, N., Goebel, R., Bandettini, P., 2006. Information-based func- tional brain mapping. PNAS 103, 3863–3868.
Locascio, J.J., Jennings, P.J., Moore, C.I., Corkin, S., 1997. Time series anal- ysis in the time domain and resampling methods for studies of functional magnetic resonance brain imaging. Human Brain Mapping 5, 168–193.
Long, C., Brown, E., Triantafyllou, C., Aharon, I., Wald, L., Solo, V., 2005. Nonstationary noise estimation in functional MRI. NeuroImage 28, 890– 903.
Lund, T.E., Madsen, K.H., Sidaros, K., Luo, W.L., Nichols, T.E., 2006. Non- white noise in fMRI: Does modelling have an impact? NeuroImage 29, 54–66.
Luo, H., Puthusserypady, S., 2007. fMRI data analysis with nonstationary noise models: A bayesian approach. IEEE Transactions on Biomedical Engineer- ing 54, 1621–1630.
Martino, F.D., Valente, G., Staeren, N., Ashburner, J., Goebel, R., Formisano, E., 2008. Combining multivariate voxel selection and support vector ma- chines for mapping and classification of fMRI spatial patterns. NeuroImage 43, 44–58.
Milosavljevic, M.M., Veinovic, M.D., Kovacevic, B.D., 1995. Estimation of nonstationary AR model using the weighted recursive least square algo- rithm, in: IEEE International Conference on Acoustics, Speech and Signal

Keywords: functional magnetic resonance imaging (fMRI), Familywise error rate, random field theory, Non-parametric statistics, Random permutation test, Graphics processing unit (GPU)

Conference: ACNS-2012 Australasian Cognitive Neuroscience Conference, Brisbane, Australia, 29 Nov - 2 Dec, 2012.

Presentation Type: Poster Presentation

Topic: Other

Citation: Josephson C (2012). Does Parametric fMRI Analysis with SPM Yield Valid Results? –
An Empirical Study of 1484 Rest Datasets. Conference Abstract: ACNS-2012 Australasian Cognitive Neuroscience Conference. doi: 10.3389/conf.fnhum.2012.208.00054

Copyright: The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers. They are made available through the Frontiers publishing platform as a service to conference organizers and presenters.

The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated.

Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed.

For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions.

Received: 23 Sep 2012; Published Online: 07 Nov 2012.

* Correspondence: Dr. Camilla Josephson, Linköping University, Economics, Linköping, 581 83, Sweden, camilla.josephson@liu.se