Event Abstract

Distinct reinstatement of multi-voxel patterns predicts memory for complex audio-visual stimuli

  • 1 Macquarie University, ARC Centre of Excellence in Cognition and its Disorders (CCD), Australia
  • 2 Medical Research Council, Cognition and Brain Sciences Unit, United Kingdom

The extent to which the pattern of neural response over voxels is repeated across different viewings of the same stimulus (‘pattern reinstatement’) has been suggested to predict subsequent memory performance. Previous studies used relatively simple stimuli and only one or a few characteristics of multi-voxel patterns. We investigate the properties of spatiotemporal multi-voxel patterns that predict memory performance in 36 people watching short audiovisual clips during fMRI. In several regions, including occipital, inferior temporal and frontoparietal cortices, the degree of spatiotemporal activity pattern reinstatement on repeated viewing predicted participants’ memory. The more similar the spatiotemporal patterns across viewings, the more accurately participants recalled the clip details. However, reinstatement is only one potentially informative feature of multi-voxel patterns. We characterised a number of other pattern properties, finding that both pattern reinstatement and the similarity of the pattern to the mean pattern across clips predict memory performance. This changes the interpretation of the original result and calls for the definition of another property, “distinct reinstatement”, which indexes both how well a pattern is reinstated on subsequent exposure and how uniquely the pattern is associated with the particular stimulus. Distinct reinstatement predicted memory performance in a smaller subset of visual and frontoparietal regions. We conclude that distinct reinstatement of multi-voxel spatiotemporal patterns is predictive of memory for complex audio-visual stimuli. Exploration of multi-voxel pattern properties is an exciting avenue for correlating neural activity and behaviour.

Acknowledgements

Data acquisition was funded by a Medical Research Council (UK) intramural program grant to NK. A Woolgar was supported by an Australian Research Council (ARC) Discovery Early Career Researcher Award (DECRA, DE120100898) and an internal project grant from Macquarie University (9201002057) to A Woolgar and ANR. We also acknowledge support from ARC Discovery Project grant DP12102835 to A Woolgar, ANR and MAW.

Keywords: fMRI, MVPA, pattern analysis, Memory, audiovisual, movies, TV advertisements, frontoparietal, Visual Perception

Conference: ACNS-2012 Australasian Cognitive Neuroscience Conference, Brisbane, Australia, 29 Nov - 2 Dec, 2012.

Presentation Type: Oral Presentation

Topic: Memory

Citation: Woolgar A, Walther A, Williams MA, Rich AN and Kriegeskorte N (2012). Distinct reinstatement of multi-voxel patterns predicts memory for complex audio-visual stimuli. Front. Hum. Neurosci. Conference Abstract: ACNS-2012 Australasian Cognitive Neuroscience Conference. doi: 10.3389/conf.fnhum.2012.208.00161

Received: 25 Oct 2012; Published Online: 17 Nov 2012.

* Correspondence: Dr. Alexandra Woolgar, Macquarie University, ARC Centre of Excellence in Cognition and its Disorders (CCD), Sydney, Australia, alexandra.woolgar@mq.edu.au

© 2007 - 2018 Frontiers Media S.A. All Rights Reserved