Distinct reinstatement of multi-voxel patterns predicts memory for complex audio-visual stimuli
-
1
Macquarie University, ARC Centre of Excellence in Cognition and its Disorders (CCD), Australia
-
2
Medical Research Council, Cognition and Brain Sciences Unit, United Kingdom
The extent to which the pattern of neural response over voxels is repeated across different viewings of the same stimulus (‘pattern reinstatement’) has been suggested to predict subsequent memory performance. Previous studies used relatively simple stimuli and only one or a few characteristics of multi-voxel patterns. We investigate the properties of spatiotemporal multi-voxel patterns that predict memory performance in 36 people watching short audiovisual clips during fMRI. In several regions, including occipital, inferior temporal and frontoparietal cortices, the degree of spatiotemporal activity pattern reinstatement on repeated viewing predicted participants’ memory. The more similar the spatiotemporal patterns across viewings, the more accurately participants recalled the clip details. However, reinstatement is only one potentially informative feature of multi-voxel patterns. We characterised a number of other pattern properties, finding that both pattern reinstatement and the similarity of the pattern to the mean pattern across clips predict memory performance. This changes the interpretation of the original result and calls for the definition of another property, “distinct reinstatement”, which indexes both how well a pattern is reinstated on subsequent exposure and how uniquely the pattern is associated with the particular stimulus. Distinct reinstatement predicted memory performance in a smaller subset of visual and frontoparietal regions. We conclude that distinct reinstatement of multi-voxel spatiotemporal patterns is predictive of memory for complex audio-visual stimuli. Exploration of multi-voxel pattern properties is an exciting avenue for correlating neural activity and behaviour.
Acknowledgements
Data acquisition was funded by a Medical Research Council (UK) intramural program grant to NK. A Woolgar was supported by an Australian Research Council (ARC) Discovery Early Career Researcher Award (DECRA, DE120100898) and an internal project grant from Macquarie University (9201002057) to A Woolgar and ANR. We also acknowledge support from ARC Discovery Project grant DP12102835 to A Woolgar, ANR and MAW.
Keywords:
fMRI,
MVPA,
pattern analysis,
Memory,
audiovisual,
movies,
TV advertisements,
frontoparietal,
Visual Perception
Conference:
ACNS-2012 Australasian Cognitive Neuroscience Conference, Brisbane, Australia, 29 Nov - 2 Dec, 2012.
Presentation Type:
Oral Presentation
Topic:
Memory
Citation:
Woolgar
A,
Walther
A,
Williams
MA,
Rich
AN and
Kriegeskorte
N
(2012). Distinct reinstatement of multi-voxel patterns predicts memory for complex audio-visual stimuli.
Conference Abstract:
ACNS-2012 Australasian Cognitive Neuroscience Conference.
doi: 10.3389/conf.fnhum.2012.208.00161
Copyright:
The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers.
They are made available through the Frontiers publishing platform as a service to conference organizers and presenters.
The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated.
Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed.
For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions.
Received:
25 Oct 2012;
Published Online:
17 Nov 2012.
*
Correspondence:
Dr. Alexandra Woolgar, Macquarie University, ARC Centre of Excellence in Cognition and its Disorders (CCD), Sydney, Australia, alexandra.woolgar@mrc-cbu.cam.ac.uk