What Makes a Pattern? Matching Decoding Methods to Data in Multivariate Pattern Analysis

Abstract

Research in neuroscience faces the challenge of integrating information across different spatial scales of brain function. A promising technique for harnessing information at a range of spatial scales is multivariate pattern analysis (MVPA) of functional magnetic resonance imaging (fMRI) data. While the prevalence of MVPA has increased dramatically in recent years, its typical implementations for classification of mental states utilize only a subset of the information encoded in local fMRI signals. We review published studies employing multivariate pattern classification since the technique’s introduction, which reveal an extensive focus on the improved detection power that linear classifiers provide over traditional analysis techniques. We demonstrate using simulations and a searchlight approach, however, that non-linear classifiers are capable of extracting distinct information about interactions within a local region. We conclude that for spatially localized analyses, such as searchlight and region of interest, multiple classification approaches should be compared in order to match fMRI analyses to the properties of local circuits.

Introduction

Our ability to understand brain function is limited by the scale and accuracy with which we can quantify neural activity. Knowledge about brain function comes from different research methods, depending on the spatial scale: individual neurons (Koch, 1997; Dayan and Abbott, 2001; Gerstner and Kistler, 2002), cortical columns, larger brain regions (Rolls and Treves, 1998; Frackowiak, 2004), and functional networks spanning the whole brain (Fox et al., 2005). As one example, recording from single neurons provides exquisitely detailed temporal records of action potentials (up to the millisecond scale) but limits our coverage of the brain to a small volume surrounding the electrode a cross-section of about three square micrometers (Boulton et al., 1990). Conversely, functional magnetic resonance imaging (fMRI) provides information about neural metabolic changes, not neuronal activity, but allows an unparalleled combination of spatial resolution (down to sub-millimeter resolution) and whole brain coverage (Huettel et al., 2008). In spite of this, the spatial resolution of fMRI in typical experiments is still inadequate to describe even columnar structures (Mountcastle, 1997). Gaps between levels of description present barriers both to integrated basic science research and to a more refined treatment of mental disorders.

Recent technological, methodological, and analytical innovations have promised to bridge knowledge across levels of spatial resolution (Kim et al., 2000; Logothetis et al., 2001; Kamitani and Tong, 2005; Kriegeskorte and Bandettini, 2007; Kriegeskorte et al., 2008). Here we inspect the recent introduction of statistical learning techniques to fMRI, often grouped under the term multivariate pattern analysis (MVPA; Haynes and Rees, 2006; Norman et al., 2006; Pereira et al., 2009; Weil and Rees, 2010). MVPA simultaneously examines the disparate signals carried within a set of voxels rather than examining individual voxels in parallel, as is done in the univariate approaches that are used in the vast majority of fMRI studies. By considering multiple responses jointly, MVPA can reveal signal components that are independent of the average regional response. Extending this principle to whole brain fMRI data, MVPA can be used to provide an information-theoretic framework for the isolation of regions that uniquely represent a behavior (Hampton and O’doherty, 2007; Carter et al., 2012). In principle, MVPA also holds the capability to describe brain function at sub-voxel levels (Kriegeskorte et al., 2010), filling the glaring gap between our knowledge of small groups of neurons and the body of research describing functional characteristics of the brain.

While a number of techniques from statistical learning have been applied to fMRI data, here we focus on the use of multivariate pattern classification (MVPC) to decode mental states. Due to the poor generalization of models that utilize whole brain data, most analyses apply some form of feature selection to limit model complexity and improve generalizability. Here we utilize a common MVPC feature selection method which isolates local spheres of voxels and generates a separate model for each sphere, commonly referred to as the searchlight approach (Kriegeskorte et al., 2006). The use of searchlights focuses inference on patterning of information within a given localized area, meeting our goal of bridging voxel-wise information and regional coding.

The classification algorithms used in MVPC can generally be divided into two categories. Linear classification algorithms (Figure 1A, top) use a weighted combination of signals from voxels within a feature set (e.g., a brain region) to decode perceptual or cognitive states. These methods show a measurable benefit in signal detection beyond using a univariate general linear model. However, each individual voxel must still contain information that can separate the stimuli of interest (see Mangasarian, 1965 for a mathematical description). In contrast, non-linear classification algorithms (Figure 1A, bottom) use a complex combination of information across voxels (e.g., a polynomial, sinusoid, or Gaussian function) so that even voxels that contain no useful information by themselves may still improve the classification performance of a larger set of voxels. Thus, linear and non-linear classifiers are capable of characterizing different types of neural representations (Rasmussen et al., 2011).

Figure 1

In addition to characterizing the type of information encoded within a brain region, comparing linear and non-linear classifiers may offer insight into how activation may be read out or manipulated through subsequent processing steps. For example, if the activation of a region can be decoded using linear classification, functionally connected regions could make use of the identified differences directly; without additional processing (for further discussion, see Norman et al., 2006; Misaki et al., 2010). Conversely, a significant non-linear classification (in the absence of linear decoding) suggests any information represented in that region will require further processing in order to be utilized (Kouh and Poggio, 2008). An example of the distinction is present in work by Kamitani and Tong (2005), where linear ensemble classifiers are sufficient to decode the orientation of perceived lines from patterns of fMRI activity in early visual cortex. Orientation information has been identified, and is being utilized immediately without extended processing. Using a non-linear classifier could allow decoding of face representations in these same voxels, even though their underlying neuronal activity would not be explicitly coding for those representations (i.e., the integration process would happen at a later stage in processing). In this regard, contrasting the decoding capability of linear and non-linear classification may give insight into whether multivariate information is at an early or late stage of a processing stream.

The capacity of non-linear classification algorithms to decode complex patterns comes with a cost. As the complexity of a classifier is increased relative to the quality and amount of data available (e.g., by increasing the number of features or by using algorithms with more parameters), the possibility of overfitting is more likely (Duda and Hart, 1973). Measures of complexity, such as the Vapnik–Chervonenkis dimension (Vapnik and Chervonenkis, 1971) or Rademacher complexity (Bartlett and Mendelson, 2001), are useful in constructing classifiers because they allow one to assess the feasibility of learning on out of sample data (Blumer et al., 1989). For example, non-linear classifiers may estimate an overly complex decision boundary, resulting in poor performance in tests of generalization. Overfitting a complex function may obscure linear relationships that are present in the data, although methods such as regularization and cross-validation have been developed to mitigate this problem (Mitchell, 1997). One such approach is the use of spatial regularization, whereby prior information about the spatial relationships of voxels is used to guide classification (Martinez-Ramon et al., 2006; Meyer and Xilin, 2008; Xiang et al., 2009). While the potential for overfitting is high in the case of fMRI (Misaki et al., 2010; Pereira and Botvinick, 2011), several studies (e.g., Hanson et al., 2004; Rasmussen et al., 2011) have demonstrated that pattern classifiers are capable of decoding information bound in non-linear relationships across multivariate samples. Thus, while overfitting is conventionally considered a drawback it can also serve as a marker for excessive model complexity.

Accordingly, the complexity of decoding algorithms should ideally reflect the way in which information is encoded. For example, the neural coding of motion in the occipital gyrus has been investigated at multiple levels of analysis. Brain structures responsible for encoding visual motion (Zeki et al., 1991; Tootell et al., 1995) have been identified using univariate approaches, while more specific information such as the direction of perceived motion has been successfully decoded using linear pattern classification (Kamitani and Tong, 2006). Indeed, the use of pattern analysis is redefining the limits of fMRI, revealing information encoded at spatial scales thought to be beyond the resolution afforded by current technology (Kamitani and Sawahata, 2010; Kriegeskorte et al., 2010), although the origin of this information is debated (Op De Beeck, 2010a,b; Shmuel et al., 2010; Freeman et al., 2011). These findings demonstrate that the improved sensitivity and use of spatial information by multivariate classifiers permit the decoding of more complex information than standard univariate approaches.

Linear and non-linear classifiers are capable of solving different types of classification problems and therefore can provide differential insight into brain function – yet, in practice they are applied to similar research questions. To characterize the usage of these two classes of decoding methods in the literature, we conducted a meta-analysis of fMRI studies employing MVPA methods. Strikingly, 110 of 115 studies (95.7%) used linear algorithms while only 16 (13.9%) utilized a non-linear approach and 11 studies implemented both methods. Although interpretability and resilience to overfitting in high dimensional datasets warrants the utilization of linear algorithms, their disproportionate use critically limits the types of information that can be decoded from patterns of neural activity. As MVPC is capable of decoding information at multiple levels of complexity and is being used at a rapidly increasing rate (Figure 1B), understanding what information is extracted by these different methods can guide future research.

Encoding and Decoding Signals

To examine how a focus on linear classifiers limits the scope of MVPC, we created simulated data with different spatial distributions of information and attempted to decode them using standard univariate, linear multivariate, and non-linear multivariate models. The simulations were tailored to demonstrate how different schemes of information encoding are decoded with markedly different performance depending on the classification method applied. For the sake of simplicity, the data contained properties similar to those from a single slice acquisition of blood-oxygen-level-dependent (BOLD) fMRI. We crafted four datasets where embedded signals differentiated between an alternating sequences of time (referred to as states A and B), as is common to experimental tasks with a blocked design (Figure 2; MATLAB code for constructing and analyzing the datasets is available online at http://www.duke.edu/~pak5/). Each dataset consisted of a 12-by-12 matrix sampled at 240 time points in which consecutive blocks of 10 time points alternate between states A and B. Signal discriminating the two states was incorporated within a circle of radius 3 voxels above 10 dB white Gaussian noise. Finally, a spatial filter (Gaussian kernel with FWHM of 3 voxels) was applied to reflect the inherent smoothness of fMRI data.

Figure 2

In particular, we were interested in the relative sensitivity of each analytical approach to information with particular spatiotemporal properties. In the case of univariate analyses, we compared the mean of each voxel during state A and B using a two tailed paired t-test. Classification was performed using linear and radial basis function support vector machines implemented in libSVM (Chang and Lin, 2011). We implemented a searchlight approach (Kriegeskorte et al., 2006) constructing multiple classifiers using data from each sample and its four nearest neighbors. This approach highlights how spatial smoothing inherent in fMRI acquisition may impact detection of information of nearby sources. To produce a generalized estimate of accuracy, twelve-fold leave-one-out cross-validation was performed (i.e., the analyses were repeated twelve times, each time partitioning a different block of data for an independent test). The statistical significance of accuracy estimates were then computed using binomial tests against chance levels of performance. Statistical maps produced from univariate and MVPC analyses were then thresholded at a family wise error corrected level of p < 0.05. Additionally, to compare the relative sensitivity and specificity of different signal detection methods, the area under the receiver operating characteristic curve was computed for all analyses. The hit rate was calculated as the proportion of significant voxels above threshold within the source of information. The false positive rate was similarly calculated using the same procedure, only on data containing smooth noise – no informative signal was added.

In our first example (univariate encoding), we simulated a dataset whose spatial properties were well-matched to the strengths of univariate statistics. We focused on two key properties in constructing this simulation. First, spatial location is not relevant to the information contained in the signal, so independent random sampling from the circle should yield consistent results. Second, the voxels do not interact and can be considered one at a time without a loss of information. Thus, performing a statistical test on each sample separately should be sufficient to identify where the signal is contained. To meet these requirements, we made each sample within the circle deactivated during state A and activated state B, resulting in a square waveform. We found that all statistical approaches correctly identified the majority of voxels within the circle. The enhanced sensitivity of MVPC was evident around the boundary of the activated region, where spatial smoothing decreased the information content of voxels. While the univariate approach only identified voxels within the circle, the pattern classifiers could identify voxels just outside the boundary where only a small amount of information was present due to the smoothness of the data. Thus, for this simplest case, the advantage of MVPC was that of increased sensitivity compared to univariate techniques.

For our second exemplar dataset (sparse encoding), we simulated a sparsely distributed signal within an activated region by randomly retaining one quarter of the voxels within the circle and increasing their amplitude four fold, ensuring the total amount of signal within the source remained constant. In this case, only some spatial locations provide information that differentiates the two states. For this reason, univariate tests may fail to identify a sample with low or intermediate amplitude, whereas multivariate methods can utilize spatial information to successfully classify the data. Statistical analysis on this dataset revealed that while all three methods could successfully identify that task-related signal was present in the dataset, the univariate analysis failed to identify some regions within the circle.

In the third example (inverted encoding), our goal was to demonstrate a less conventional dependence on spatial location. To accomplish this, we made every sample contain signal but reversed its sign in half the voxels selected at random. By reversing the sign of activity in half of the voxels, both the sign of the signal and its spatial location are required to decode the current state. Consistent with the previous example, multivariate pattern classifiers excelled at decoding spatial information while univariate analysis failed to detect the majority of voxels within the source. Taken together, the results from examples two and three demonstrate the increased sensitivity of MVPC over univariate approaches, with linear and non-linear classifiers exhibiting similar performance.

For the fourth example (interactive encoding), we created a source in which information is carried exclusively through the interaction of voxels. This was accomplished by randomly distributing two signals throughout the circle in a fashion similar to example three, but allowing the direction of activation to vary over time. In state A the regions alternate between being positive or negative with opposite signs, whereas in state B neither region is active. Classifying the current state requires creating a model that incorporates the interactions between voxels, because the overall activation of any voxel (or the region as a whole) carries no information. As expected, statistical analysis revealed that non-linear classification was the only approach that successfully identified the source of information in the data.

Expanding the Use of Pattern Classification

Consistent with its increasing prevalence in the literature, MVPC has several distinct advantages over conventional univariate approaches. It has greater sensitivity for identifying small effects, especially when the spatial distribution of activity is heterogeneous. This result is consistent with studies finding functional organization in brain structures, such as visual cortex (Kamitani and Tong, 2005) and the hippocampus (Hassabis et al., 2009), that had been previously missed using univariate methods. Studies using linear classifiers to extract unexpected effects have popularized pattern analysis. We found, however, that the benefits of MVPC go well beyond a simple increase in detection power. Linear classifiers provide access to spatial information on top of that carried in the mean level of activity, while non-linear classifiers reveal information likely to be carried in complex computational maps.

The defining properties of linear MVPC are its use of spatial information and focus on individual voxels. Because the distribution of neurons sampled in a voxel can vary with spatial location, spatially sparse fMRI activity is likely a result of heterogeneity in underlying neural populations. While univariate methods gloss over these distinctions by examining each voxel separately, linear classification carries intuitive advantages. As has been commonly noted (Kamitani and Tong, 2005; Norman et al., 2006; Pereira et al., 2009), linear classifiers pool the information contained within individual voxels. This is a useful property when the goal of classification is to leverage fine scale spatial organization in studying brain function because the location of voxels, rather than interactions between them, will drive performance of classification. The combination of these two properties allows the method to reveal information beyond univariate approaches (Jimura and Poldrack, 2012) in a manner that is straightforward to interpret. Thus, linear classification should be employed when neural signals do not interact and are expected to be in a fixed spatial configuration, as in the sparse encoding and inverted encoding simulations.

Non-linear classification, on the other hand, should be harnessed when cognitive states do not necessarily correspond to the activation of individual voxels, but instead have differential effects depending on the functional properties of those voxels. Because non-linear algorithms treat the activity of a voxel as part of a combinatorial code rather than a unitary piece of information, they are better served to decode more complex representations across association cortex (Hanson et al., 2004) that build upon basic features in primary sensory cortex (e.g., Kamitani and Tong, 2005).This capacity may prove critical in representing multiple different categories from more basic properties in a robust, efficient manner (Op De Beeck et al., 2008). Further, our results demonstrated that non-linear algorithms can identify combinatorial patterns that are not time invariant, but drastically change over time despite containing the same information content. These findings suggest that non-linear classification is an advantageous methodological choice when neural signals are highly intricate and vary over time, for example in interactive encoding.

Despite their benefits and unique capacities, both linear and non-linear classifiers utilize information contained in the activity and spatial location of a sample, which can lead them to show similar results in many cases. The performance of MVPC methods must be compared to univariate results before claims about spatial information can be made. More specifically, a linear classifier must reveal information beyond that which is detectable by univariate methods before the spatial location of inputs can be considered important. Similarly, non-linear classifiers do not only decode pattern activity; mean levels of activity or spatial location can also drive the performance of these learning algorithms. We found comparisons between analysis methods to be infrequent in our meta-analysis, with comparisons to univariate methods being made in 16 (13.9%) studies and comparisons between non-linear and linear algorithms in only 11 (9.6%) studies. This is especially important since sensitivity in MVPC varies with signal amplitude (Smith et al., 2011). Additionally, given that non-linear classifiers can properly model decision boundaries that linear classifiers are incapable of solving (e.g., the XOR problem or our related interactive encoding example), the application of non-linear classifiers may lead to refinement of models already established with linear approaches. Model comparisons are essential in revealing information contained in non-linear relationships above and beyond the capacity of linear classifiers. While linear classifiers can be successfully applied to improve the sensitivity of fMRI in cases of functionally organized neural activity, they need to be complemented with non-linear algorithms to be a true advance over traditional approaches.

References

• 1

  AbramsD. A.BhataraA.RyaliS.BalabanE.LevitinD. J.MenonV. (2011). Decoding temporal structure in music and speech relies on shared brain resources but elicits different fine-scale spatial patterns. Cereb. Cortex21, 1507–1518.10.1093/cercor/bhq198

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 2

  AlinkA.EulerF.KriegeskorteN.SingerW.KohlerA. (2011). Auditory motion direction encoding in auditory cortex and high-level visual cortex. Hum. Brain Mapp.33, 969–978.10.1002/hbm.21263

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 3

  BachD. R.WeiskopfN.DolanR. J. (2011). A stable sparse fear memory trace in human amygdala. J. Neurosci.31, 9383–9389.10.1523/JNEUROSCI.1452-10.2011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 4

  BaucomL. B.WedellD. H.WangJ.BlitzerD. N.ShinkarevaS. V. (2011). Decoding the neural representation of affective states. Neuroimage59, 718–727.10.1016/j.neuroimage.2011.07.037

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 5

  BeauchampM. S.LaconteS.YasarN. (2009). Distributed representation of single touches in somatosensory and visual cortex. Hum. Brain Mapp.30, 3163–3171.10.1002/hbm.20735

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 6

  BodeS.HaynesJ. D. (2009). Decoding sequential stages of task preparation in the human brain. Neuroimage45, 606–613.10.1016/j.neuroimage.2008.11.031

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 7

  BodeS.HeA. H.SoonC. S.TrampelR.TurnerR.HaynesJ. D. (2011). Tracking the unconscious generation of free decisions using uitra-high field fMRI. PLoS ONE6, e21612.10.1371/journal.pone.0021612

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 8

  BonniciH. M.KumaranD.ChadwickM. J.WeiskopfN.HassabisD.MaguireE. A. (2011). Decoding representations of scenes in the medial temporal lobes. Hippocampus22, 1143–1153.10.1002/hipo.20960

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 9

  BrouwerG. J.HeegerD. J. (2009). Decoding and reconstructing color from responses in human visual cortex. J. Neurosci.29, 13992–14003.10.1523/JNEUROSCI.3577-09.2009

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 10

  CarlsonT.HogendoornH.FonteijnH.VerstratenF. A. (2011). Spatial coding and invariance in object-selective cortex. Cortex47, 14–22.10.1016/j.cortex.2009.08.015

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 11

  CarlsonT. A.SchraterP.HeS. (2003). Patterns of activity in the categorical representations of objects. J. Cogn. Neurosci.15, 704–717.10.1162/jocn.2003.15.5.704

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 12

  ChadwickM. J.HassabisD.WeiskopfN.MaguireE. A. (2010). Decoding individual episodic memory traces in the human hippocampus. Curr. Biol.20, 544–547.10.1016/j.cub.2010.06.045

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 13

  ChaimowD.YacoubE.UgurbilK.ShmuelA. (2011). Modeling and analysis of mechanisms underlying fMRI-based decoding of information conveyed in cortical columns. Neuroimage56, 627–642.10.1016/j.neuroimage.2010.09.037

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 14

  ChangK. M.MitchellT.JustM. A. (2011). Quantitative modeling of the neural representation of objects: how semantic feature norms can account for fMRI activation. Neuroimage56, 716–727.10.1016/j.neuroimage.2010.04.271

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 15

  CichyR. M.ChenY.HaynesJ. D. (2011a). Encoding the identity and location of objects in human LOC. Neuroimage54, 2297–2307.10.1016/j.neuroimage.2010.09.044

  • CrossRef
  • Google Scholar

• 16

  CichyR. M.HeinzleJ.HaynesJ. D. (2011b). Imagery and perception share cortical representations of content and location. Cereb. Cortex.

  • Google Scholar

• 17

  ClitheroJ. A.CarterR. M.HuettelS. A. (2009). Local pattern classification differentiates processes of economic valuation. Neuroimage45, 1329–1338.10.1016/j.neuroimage.2008.12.074

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 18

  ClitheroJ. A.SmithD. V.CarterR. M.HuettelS. A. (2011). Within- and cross-participant classifiers reveal different neural coding of information. Neuroimage56, 699–708.10.1016/j.neuroimage.2010.03.057

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 19

  CostafredaS. G.FuC. H.PicchioniM.ToulopoulouT.McdonaldC.KravaritiE.et al (2011). Pattern of neural responses to verbal fluency shows diagnostic specificity for schizophrenia and bipolar disorder. BMC Psychiatry11, 18.10.1186/1471-244X-11-18

  • CrossRef
  • Google Scholar

• 20

  CoutancheM. N.Thompson-SchillS. L.SchultzR. T. (2011). Multi-voxel pattern analysis of fMRI data predicts clinical symptom severity. Neuroimage57, 113–123.10.1016/j.neuroimage.2011.04.016

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 21

  CoxD. D.SavoyR. L. (2003). Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage19, 261–270.10.1016/S1053-8119(03)00049-1

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 22

  CraddockR. C.HoltzheimerP. E.III.HuX. P.MaybergH. S. (2009). Disease state prediction from resting state functional connectivity. Magn. Reson. Med.62, 1619–1628.10.1002/mrm.22159

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 23

  DavatzikosC.RuparelK.FanY.ShenD. G.AcharyyaM.LougheadJ. W.et al (2005). Classifying spatial patterns of brain activity with machine learning methods: application to lie detection. Neuroimage28, 663–668.10.1016/j.neuroimage.2005.08.009

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 24

  DinsteinI.GardnerJ. L.JazayeriM.HeegerD. J. (2008). Executed and observed movements have different distributed representations in human aIPS. J. Neurosci.28, 11231–11239.10.1523/JNEUROSCI.3585-08.2008

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 25

  EgerE.AshburnerJ.HaynesJ. D.DolanR. J.ReesG. (2008). fMRI activity patterns in human LOC carry information about object exemplars within category. J. Cogn. Neurosci.20, 356–370.10.1162/jocn.2008.20019

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 26

  EstermanM.ChiuY. C.Tamber-RosenauB. J.YantisS. (2009). Decoding cognitive control in human parietal cortex. Proc. Natl. Acad. Sci. U.S.A.106, 17974–17979.10.1073/pnas.0903593106

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 27

  EthoferT.Van De VilleD.SchererK.VuilleumierP. (2009). Decoding of emotional information in voice-sensitive cortices. Curr. Biol.19, 1028–1033.10.1016/j.cub.2009.10.030

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 28

  EtzelJ. A.GazzolaV.KeysersC. (2008). Testing simulation theory with cross-modal multivariate classification of fMRI data. PLoS ONE3, e3690.10.1371/journal.pone.0003690

  • CrossRef
  • Google Scholar

• 29

  FormisanoE.De MartinoF.BonteM.GoebelR. (2008). “Who” is saying “what”? Brain-based decoding of human voice and speech. Science322, 970–973.10.1126/science.1164318

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 30

  FreemanJ.BrouwerG. J.HeegerD. J.MerriamE. P. (2011). Orientation decoding depends on maps, not columns. J. Neurosci.31, 4792–4804.10.1523/JNEUROSCI.5160-10.2011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 31

  FuC. H.Mourao-MirandaJ.CostafredaS. G.KhannaA.MarquandA. F.WilliamsS. C.BrammerM. J. (2008). Pattern classification of sad facial processing: toward the development of neurobiological markers in depression. Biol. Psychiatry63, 656–662.10.1016/j.biopsych.2007.08.020

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 32

  GallivanJ. P.McleanD. A.ValyearK. F.PettypieceC. E.CulhamJ. C. (2011). Decoding action intentions from preparatory brain activity in human parieto-frontal networks. J. Neurosci.31, 9599–9610.10.1523/JNEUROSCI.1058-11.2011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 33

  GilbertS. J. (2011). Decoding the content of delayed intentions. J. Neurosci.31, 2888–2894.10.1523/JNEUROSCI.5336-10.2011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 34

  GilbertS. J.MeuweseJ. D.TowgoodK. J.FrithC. D.BurgessP. W. (2009). Abnormal functional specialization within medial prefrontal cortex in high-functioning autism: a multi-voxel similarity analysis. Brain132, 869–878.10.1093/brain/awn365

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 35

  GreenbergA. S.EstermanM.WilsonD.SerencesJ. T.YantisS. (2010). Control of spatial and feature-based attention in frontoparietal cortex. J. Neurosci.30, 14330–14339.10.1523/JNEUROSCI.4248-09.2010

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 36

  HahnT.MarquandA. F.EhlisA. C.DreslerT.Kittel-SchneiderS.JarczokT. A.et al (2011). Integrating neurobiological markers of depression. Arch. Gen. Psychiatry68, 361–368.10.1001/archgenpsychiatry.2010.178

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 37

  HamptonA. N.O’doherty JP. (2007). Decoding the neural substrates of reward-related decision making with functional MRI. Proc. Natl. Acad. Sci. U.S.A.104, 1377–1382.10.1073/pnas.0703402104

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 38

  HansonS. J.MatsukaT.HaxbyJ. V. (2004). Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a “face” area?Neuroimage23, 156–166.10.1016/j.neuroimage.2004.05.020

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 39

  HarrisonS. A.TongF. (2009). Decoding reveals the contents of visual working memory in early visual areas. Nature458, 632–635.10.1038/nature07832

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 40

  HassabisD.ChuC.ReesG.WeiskopfN.MolyneuxP. D.MaguireE. A. (2009). Decoding neuronal ensembles in the human hippocampus. Curr. Biol.19, 546–554.10.1016/j.cub.2009.02.033

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 41

  HaxbyJ. V.GobbiniM. I.FureyM. L.IshaiA.SchoutenJ. L.PietriniP. (2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science293, 2425–2430.10.1126/science.1063736

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 42

  HaynesJ. D.SakaiK.ReesG.GilbertS.FrithC.PassinghamR. E. (2007). Reading hidden intentions in the human brain. Curr. Biol.17, 323–328.10.1016/j.cub.2006.11.072

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 43

  HerrmannB.ObleserJ.KalberlahC.HaynesJ. D.FriedericiA. D. (2011). Dissociable neural imprints of perception and grammar in auditory functional imaging. Hum. Brain Mapp.33, 584–595.10.1002/hbm.21235

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 44

  HoeftF.MccandlissB. D.BlackJ. M.GantmanA.ZakeraniN.HulmeC.et al (2011). Neural systems predicting long-term outcome in dyslexia. Proc. Natl. Acad. Sci. U.S.A.108, 361–366.10.1073/pnas.1008950108

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 45

  JeheeJ. F.BradyD. K.TongF. (2011). Attention improves encoding of task-relevant features in the human visual cortex. J. Neurosci.31, 8210–8219.10.1523/JNEUROSCI.6153-09.2011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 46

  JohnsonJ. D.McduffS. G.RuggM. D.NormanK. A. (2009). Recollection, familiarity, and cortical reinstatement: a multivoxel pattern analysis. Neuron63, 697–708.10.1016/j.neuron.2009.08.011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 47

  KamitaniY.TongF. (2005). Decoding the visual and subjective contents of the human brain. Nat. Neurosci.8, 679–685.10.1038/nn1444

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 48

  KamitaniY.TongF. (2006). Decoding seen and attended motion directions from activity in the human visual cortex. Curr. Biol.16, 1096–1102.10.1016/j.cub.2006.04.003

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 49

  KahntT.HeinzleJ.ParkS. Q.HaynesJ. D. (2010). The neural code of reward anticipation in human orbitofrontal cortex. Proc. Natl. Acad. Sci. U.S.A.107, 6010–6015.10.1073/pnas.0912838107

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 50

  KahntT.HeinzleJ.ParkS. Q.HaynesJ. D. (2011). Decoding different roles for vmPFC and dlPFC in multi-attribute decision making. Neuroimage56, 709–715.10.1016/j.neuroimage.2010.05.058

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 51

  KaulC.ReesG.IshaiA. (2011). The gender of face stimuli is represented in multiple regions in the human brain. Front. Hum. Neurosci.4:238.10.3389/fnhum.2010.00238

  • CrossRef
  • Google Scholar

• 52

  KayK. N.NaselarisT.PrengerR. J.GallantJ. L. (2008). Identifying natural images from human brain activity. Nature452, 352–355.10.1038/nature06713

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 53

  KrajbichI.CamererC.LedyardJ.RangelA. (2009). Using neural measures of economic value to solve the public goods free-rider problem. Science326, 596–599.10.1126/science.1177302

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 54

  KuhnS.BodammerN. C.BrassM. (2010). Dissociating mental states related to doing nothing by means of fMRI pattern classification. Neuroimage53, 1294–1300.10.1016/j.neuroimage.2010.07.006

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 55

  LanglebenD. D.LougheadJ. W.BilkerW. B.RuparelK.ChildressA. R.BuschS. I.et al (2005). Telling truth from lie in individual subjects with fast event-related fMRI. Hum. Brain Mapp.26, 262–272.10.1002/hbm.20191

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 56

  LeeY. S.JanataP.FrostC.HankeM.GrangerR. (2011). Investigation of melodic contour processing in the brain using multivariate pattern-based fMRI. Neuroimage57, 293–300.10.1016/j.neuroimage.2011.02.006

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 57

  Lewis-PeacockJ. A.PostleB. R. (2008). Temporary activation of long-term memory supports working memory. J. Neurosci.28, 8765–8771.10.1523/JNEUROSCI.1953-08.2008

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 58

  LiL.QinW.BaiL.TianJ. (2010). Exploring vision-related acupuncture point specificity with multivoxel pattern analysis. Magn. Reson. Imaging28, 380–387.10.1016/j.mri.2009.11.009

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 59

  LiS.OstwaldD.GieseM.KourtziZ. (2007). Flexible coding for categorical decisions in the human brain. J. Neurosci.27, 12321–12330.10.1523/JNEUROSCI.2152-07.2007

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 60

  LiY.WangG.LongJ.YuZ.HuangB.LiX.et al (2011). Reproducibility and discriminability of brain patterns of semantic categories enhanced by congruent audiovisual stimuli. PLoS ONE6, e20801.10.1371/journal.pone.0020801

  • CrossRef
  • Google Scholar

• 61

  MacevoyS. P.EpsteinR. A. (2009). Decoding the representation of multiple simultaneous objects in human occipitotemporal cortex. Curr. Biol.19, 943–947.10.1016/j.cub.2009.04.020

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 62

  MahonB. Z.CaramazzaA. (2010). Judging semantic similarity: an event-related fMRI study with auditory word stimuli. Neuroscience169, 279–286.10.1016/j.neuroscience.2010.04.029

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 63

  ManelisA.HansonC.HansonS. J. (2011a). Implicit memory for object locations depends on reactivation of encoding-related brain regions. Hum. Brain Mapp.32, 32–50.10.1002/hbm.20992

  • CrossRef
  • Google Scholar

• 64

  ManelisA.RederL. M.HansonS. J. (2011b). Dynamic changes in the medial temporal lobe during incidental learning of object-location associations. Cereb. Cortex22, 828–837.10.1093/cercor/bhr151

  • CrossRef
  • Google Scholar

• 65

  MarquandA.HowardM.BrammerM.ChuC.CoenS.Mourao-MirandaJ. (2010). Quantitative prediction of subjective pain intensity from whole-brain fMRI data using Gaussian processes. Neuroimage49, 2178–2189.10.1016/j.neuroimage.2009.10.072

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 66

  MarquandA. F.De SimoniS.O’dalyO. G.WilliamsS. C.Mourao-MirandaJ.MehtaM. A. (2011). Pattern classification of working memory networks reveals differential effects of methylphenidate, atomoxetine, and placebo in healthy volunteers. Neuropsychopharmacology36, 1237–1247.10.1038/npp.2011.9

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 67

  McduffS. G.FrankelH. C.NormanK. A. (2009). Multivoxel pattern analysis reveals increased memory targeting and reduced use of retrieved details during single-agenda source monitoring. J. Neurosci.29, 508–516.10.1523/JNEUROSCI.3587-08.2009

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 68

  NatuV.RaboyD.O’tooleA. J. (2011). Neural correlates of own- and other-race face perception: spatial and temporal response differences. Neuroimage54, 2547–2555.10.1016/j.neuroimage.2010.10.006

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 69

  NestorA.PlautD. C.BehrmannM. (2011). Unraveling the distributed neural code of facial identity through spatiotemporal pattern analysis. Proc. Natl. Acad. Sci. U.S.A.108, 9998–10003.10.1073/pnas.1102433108

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 70

  NicholsD. F.BettsL. R.WilsonH. R. (2010). Decoding of faces and face components in face-sensitive human visual cortex. Front. Psychol.1:28.10.3389/fpsyg.2010.00028

  • CrossRef
  • Google Scholar

• 71

  O’tooleA. J.JiangF.AbdiH.HaxbyJ. V. (2005). Partially distributed representations of objects and faces in ventral temporal cortex. J. Cogn. Neurosci.17, 580–590.10.1162/0898929053467550

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 72

  OgawaK.InuiT. (2011). Neural representation of observed actions in the parietal and premotor cortex. Neuroimage56, 728–735.10.1016/j.neuroimage.2010.10.043

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 73

  OosterhofN. N.WiggettA. J.DiedrichsenJ.TipperS. P.DowningP. E. (2010). Surface-based information mapping reveals crossmodal vision-action representations in human parietal and occipitotemporal cortex. J. Neurophysiol.104, 1077–1089.10.1152/jn.00326.2010

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 74

  OztekinI.BadreD. (2011). Distributed patterns of brain activity that lead to forgetting. Front. Hum. Neurosci.5:86.10.3389/fnhum.2011.00086

  • CrossRef
  • Google Scholar

• 75

  ParkS.BradyT. F.GreeneM. R.OlivaA. (2011). Disentangling scene content from spatial boundary: complementary roles for the parahippocampal place area and lateral occipital complex in representing real-world scenes. J. Neurosci.31, 1333–1340.10.1523/JNEUROSCI.4973-10.2011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 76

  ParkesL. M.MarsmanJ. B.OxleyD. C.GoulermasJ. Y.WuergerS. M. (2009). Multivoxel fMRI analysis of color tuning in human primary visual cortex. J. Vis.9, 1 1–13.10.1167/9.1.1

  • CrossRef
  • Google Scholar

• 77

  PeelenM. V.AtkinsonA. P.VuilleumierP. (2010). Supramodal representations of perceived emotions in the human brain. J. Neurosci.30, 10127–10134.10.1523/JNEUROSCI.2161-10.2010

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 78

  PessoaL.PadmalaS. (2007). Decoding near-threshold perception of fear from distributed single-trial brain activation. Cereb. Cortex17, 691–701.10.1093/cercor/bhk020

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 79

  PoldrackR. A.HalchenkoY. O.HansonS. J. (2009). Decoding the large-scale structure of brain function by classifying mental States across individuals. Psychol. Sci.20, 1364–1372.10.1111/j.1467-9280.2009.02460.x

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 80

  PolynS. M.NatuV. S.CohenJ. D.NormanK. A. (2005). Category-specific cortical activity precedes retrieval during memory search. Science310, 1963–1966.10.1126/science.1117645

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 81

  PonsetiJ.GranertO.JansenO.WolffS.MehdornH.BosinskiH.et al (2009). Assessment of sexual orientation using the hemodynamic brain response to visual sexual stimuli. J. Sex. Med.6, 1628–1634.10.1111/j.1743-6109.2009.01233.x

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 82

  PrestonT. J.LiS.KourtziZ.WelchmanA. E. (2008). Multivoxel pattern selectivity for perceptually relevant binocular disparities in the human brain. J. Neurosci.28, 11315–11327.10.1523/JNEUROSCI.2728-08.2008

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 83

  ReddyL.TsuchiyaN.SerreT. (2010). Reading the mind’s eye: decoding category information during mental imagery. Neuroimage50, 818–825.10.1016/j.neuroimage.2009.11.084

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 84

  ReverberiC.GorgenK.HaynesJ. D. (2011). Compositionality of rule representations in human prefrontal cortex. Cereb. Cortex22, 1237–1246.10.1093/cercor/bhr200

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 85

  RissmanJ.GreelyH. T.WagnerA. D. (2010). Detecting individual memories through the neural decoding of memory states and past experience. Proc. Natl. Acad. Sci. U.S.A.107, 9849–9854.10.1073/pnas.1001028107

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 86

  RodriguezP. F. (2010). Neural decoding of goal locations in spatial navigation in humans with fMRI. Hum. Brain Mapp.31, 391–397.

  • Pubmed Abstract
  • Google Scholar

• 87

  RogalskyC.RongF.SaberiK.HickokG. (2011). Functional anatomy of language and music perception: temporal and structural factors investigated using functional magnetic resonance imaging. J. Neurosci.31, 3843–3852.10.1523/JNEUROSCI.4515-10.2011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 88

  RollsE. T.GrabenhorstF.FrancoL. (2009). Prediction of subjective affective state from brain activations. J. Neurophysiol.101, 1294–1308.10.1152/jn.91049.2008

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 89

  RussM. O.CleffU.LanfermannH.SchalnusR.EnzensbergerW.KleinschmidtA. (2002). Functional magnetic resonance imaging in acute unilateral optic neuritis. J. Neuroimaging12, 339–350.10.1111/j.1552-6569.2002.tb00142.x

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 90

  SaidC. P.MooreC. D.EngellA. D.TodorovA.HaxbyJ. V. (2010). Distributed representations of dynamic facial expressions in the superior temporal sulcus. J. Vis.10, 11.10.1167/10.7.11

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 91

  SatoJ. R.De Oliveira-SouzaR.ThomazC. E.BasilioR.BramatiI. E.AmaroE.Jr.et al (2011). Identification of psychopathic individuals using pattern classification of MRI images. Soc. Neurosci.1–13.

  • Google Scholar

• 92

  SchwarzkopfD. S.SchindlerA.ReesG. (2010). Knowing with which eye we see: utrocular discrimination and eye-specific signals in human visual cortex. PLoS ONE5, e13775.10.1371/journal.pone.0013775

  • CrossRef
  • Google Scholar

• 93

  SchwarzkopfD. S.SterzerP.ReesG. (2011). Decoding of coherent but not incoherent motion signals in early dorsal visual cortex. Neuroimage56, 688–698.10.1016/j.neuroimage.2010.04.011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 94

  SerencesJ. T.BoyntonG. M. (2007). Feature-based attentional modulations in the absence of direct visual stimulation. Neuron55, 301–312.10.1016/j.neuron.2007.06.015

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 95

  SeymourK.CliffordC. W.LogothetisN. K.BartelsA. (2010). Coding and binding of color and form in visual cortex. Cereb. Cortex20, 1946–1954.10.1093/cercor/bhp265

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 96

  ShenL.QiY.KimS.NhoK.WanJ.RisacherS. L.et al (2010). Sparse bayesian learning for identifying imaging biomarkers in AD prediction. Med. Image Comput. Comput. Assist. Interv.13, 611–618.

  • Pubmed Abstract
  • Google Scholar

• 97

  ShmuelA.ChaimowD.RaddatzG.UgurbilK.YacoubE. (2010). Mechanisms underlying decoding at 7 T: ocular dominance columns, broad structures, and macroscopic blood vessels in V1 convey information on the stimulated eye. Neuroimage49, 1957–1964.10.1016/j.neuroimage.2009.08.040

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 98

  SitaramR.LeeS.RuizS.RanaM.VeitR.BirbaumerN. (2011). Real-time support vector classification and feedback of multiple emotional brain states. Neuroimage56, 753–765.10.1016/j.neuroimage.2010.08.007

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 99

  SmithF. W.MuckliL. (2010). Non-stimulated early visual areas carry information about surrounding context. Proc. Natl. Acad. Sci. U.S.A.107, 20099–20103.10.1073/pnas.1000233107

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 100

  Tamber-RosenauB. J.EstermanM.ChiuY. C.YantisS. (2011). Cortical mechanisms of cognitive control for shifting attention in vision and working memory. J. Cogn. Neurosci.23, 2905–2919.10.1162/jocn.2011.21608

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 101

  ThirionB.DuchesnayE.HubbardE.DuboisJ.PolineJ. B.LebihanD.et al (2006). Inverse retinotopy: inferring the visual content of images from brain activation patterns. Neuroimage33, 1104–1116.10.1016/j.neuroimage.2006.06.062

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 102

  ThompsonJ. C.BaccusW. (2011). Form and motion make independent contributions to the response to biological motion in occipitotemporal cortex. Neuroimage59, 625–634.10.1016/j.neuroimage.2011.07.051

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 103

  TuscheA.BodeS.HaynesJ. D. (2010). Neural responses to unattended products predict later consumer choices. J. Neurosci.30, 8024–8031.10.1523/JNEUROSCI.0064-10.2010

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 104

  VisserR. M.ScholteH. S.KindtM. (2011). Associative learning increases trial-by-trial similarity of BOLD-MRI patterns. J. Neurosci.31, 12021–12028.10.1523/JNEUROSCI.2178-11.2011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 105

  WaltherD. B.CaddiganE.Fei-FeiL.BeckD. M. (2009). Natural scene categories revealed in distributed patterns of activity in the human brain. J. Neurosci.29, 10573–10581.10.1523/JNEUROSCI.0559-09.2009

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 106

  WaltherD. B.ChaiB.CaddiganE.BeckD. M.Fei-FeiL. (2011). Simple line drawings suffice for functional MRI decoding of natural scene categories. Proc. Natl. Acad. Sci. U.S.A.108, 9661–9666.10.1073/pnas.1015666108

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 107

  WangK.JiangT.LiangM.WangL.TianL.ZhangX.et al (2006). Discriminative analysis of early Alzheimer’s disease based on two intrinsically anti-correlated networks with resting-state fMRI. Med. Image Comput. Comput. Assist. Interv.9, 340–347.

  • Pubmed Abstract
  • Google Scholar

• 108

  WatanabeT.HiroseS.WadaH.KatsuraM.ChikazoeJ.JimuraK.et al (2011). Prediction of subsequent recognition performance using brain activity in the medial temporal lobe. Neuroimage54, 3085–3092.10.1016/j.neuroimage.2010.10.066

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 109

  WilliamsA. L.SmithA. T. (2010). Representation of eye position in the human parietal cortex. J. Neurophysiol.104, 2169–2177.10.1152/jn.00713.2009

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 110

  WolbersT.ZahorikP.GiudiceN. A. (2011). Decoding the direction of auditory motion in blind humans. Neuroimage56, 681–687.10.1016/j.neuroimage.2010.04.266

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 111

  WoolgarA.ThompsonR.BorD.DuncanJ. (2011). Multi-voxel coding of stimuli, rules, and responses in human frontoparietal cortex. Neuroimage56, 744–752.10.1016/j.neuroimage.2010.04.035

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 112

  YoonJ. H.TamirD.MinzenbergM. J.RaglandJ. D.UrsuS.CarterC. S. (2008). Multivariate pattern analysis of functional magnetic resonance imaging data reveals deficits in distributed representations in schizophrenia. Biol. Psychiatry64, 1035–1041.10.1016/j.biopsych.2008.07.025

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 113

  ZhangJ.MeesonA.WelchmanA. E.KourtziZ. (2010). Learning alters the tuning of functional magnetic resonance imaging patterns for visual forms. J. Neurosci.30, 14127–14133.10.1523/JNEUROSCI.5168-09.2010

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 114

  ZhangY.TianJ.YuanK.LiuP.ZhuoL.QinW.et al (2011). Distinct resting-state brain activities in heroin-dependent individuals. Brain Res.1402, 46–53.10.1016/j.brainres.2011.05.054

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 115

  ZhuC. Z.ZangY. F.LiangM.TianL. X.HeY.LiX. B.et al (2005). Discriminative analysis of brain function at resting-state for attention-deficit/hyperactivity disorder. Med. Image Comput. Comput. Assist. Interv.8, 468–475.

  • Pubmed Abstract
  • Google Scholar

References

• 1

  AnthonyL. (2011). “AntConc” (Version 3.2.4). (Tokyo: Waseda University).

  • Google Scholar

• 2

  BartlettP. L.MendelsonS. (2001). Rademacher and Gaussian complexities: risk bounds and structural results. J. Mach. Learn. Res.2111, 224–240.

  • Google Scholar

• 3

  BlumerA.EhrenfeuchtA.HausslerD.WarmuthM. K. (1989). Learnability and the Vapnik-Chervonenkis dimension. J. Altern. Complement. Med.36, 929–965.

  • Google Scholar

• 4

  BoultonA. A.BakerG. B.VanderwolfC. H. (1990). Neurophysiological Techniques. Clifton, NJ: Humana Press.

  • Google Scholar

• 5

  CarterR. M.BowlingD. L.ReeckC.HuettelS. A. (2012). A distinct role of the temporal-parietal junction in predicting socially guided decisions. Science337, 109–111.10.1126/science.1219681

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 6

  ChangC.-C.LinC.-J. (2011). LIBSVM: A library for support vector machines. ACM Trans. Intell. Syst. Technol.2, 1–27.10.1145/1961189.1961199

  • CrossRef
  • Google Scholar

• 7

  DayanP.AbbottL. F. (2001). Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems. Cambridge, MA: Massachusetts Institute of Technology Press.

  • Google Scholar

• 8

  DudaR. O.HartP. E. (1973). Pattern Classification and Scene Analysis. New York: Wiley.

  • Google Scholar

• 9

  FoxM. D.SnyderA. Z.VincentJ. L.CorbettaM.Van EssenD. C.RaichleM. E. (2005). The human brain is intrinsically organized into dynamic, anticorrelated functional networks. Proc. Natl. Acad. Sci. U.S.A.102, 9673–9678.10.1073/pnas.0409470102

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 10

  FrackowiakR. S. J. (2004). Human Brain Function. Amsterdam, Boston: Elsevier Academic Press.

  • Google Scholar

• 11

  FreemanJ.BrouwerG. J.HeegerD. J.MerriamE. P. (2011). Orientation decoding depends on maps, not columns. J. Neurosci.31, 4792–4804.10.1523/JNEUROSCI.5160-10.2011

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 12

  GerstnerW.KistlerW. M. (2002). Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge, NY: Cambridge University Press.

  • Google Scholar

• 13

  HamptonA. N.O’dohertyJ. P. (2007). Decoding the neural substrates of reward-related decision making with functional MRI. Proc. Natl. Acad. Sci. U.S.A.104, 1377–1382.10.1073/pnas.0703402104

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 14

  HansonS. J.MatsukaT.HaxbyJ. V. (2004). Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a “face” area?Neuroimage23, 156–166.10.1016/j.neuroimage.2004.05.020

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 15

  HassabisD.ChuC.ReesG.WeiskopfN.MolyneuxP. D.MaguireE. A. (2009). Decoding neuronal ensembles in the human hippocampus. Curr. Biol.19, 546–554.10.1016/j.cub.2009.02.033

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 16

  HaynesJ. D.ReesG. (2006). Decoding mental states from brain activity in humans. Nat. Rev. Neurosci.7, 523–534.10.1038/nrn1931

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 17

  HuettelS. A.SongA. W.MccarthyG. (2008). Functional Magnetic Resonance Imaging. Sunderland, MA: Sinauer Associates.

  • Google Scholar

• 18

  JimuraK.PoldrackR. A. (2012). Analyses of regional-average activation and multivoxel pattern information tell complementary stories. Neuropsychologia50, 544–552.10.1016/j.neuropsychologia.2011.11.007

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 19

  KamitaniY.SawahataY. (2010). Spatial smoothing hurts localization but not information: pitfalls for brain mappers. Neuroimage49, 1949–1952.10.1016/j.neuroimage.2009.06.040

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 20

  KamitaniY.TongF. (2005). Decoding the visual and subjective contents of the human brain. Nat. Neurosci.8, 679–685.10.1038/nn1444

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 21

  KamitaniY.TongF. (2006). Decoding seen and attended motion directions from activity in the human visual cortex. Curr. Biol.16, 1096–1102.10.1016/j.cub.2006.04.003

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 22

  KimD. S.DuongT. Q.KimS. G. (2000). High-resolution mapping of iso-orientation columns by fMRI. Nat. Neurosci.3, 164–169.10.1038/72109

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 23

  KochC. (1997). Computation and the single neuron. Nature385, 207–210.10.1038/385207a0

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 24

  KouhM.PoggioT. (2008). A canonical neural circuit for cortical nonlinear operations. Neural. Comput.20, 1427–1451.10.1162/neco.2008.02-07-466

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 25

  KriegeskorteN.BandettiniP. (2007). Analyzing for information, not activation, to exploit high-resolution fMRI. Neuroimage38, 649–662.10.1016/j.neuroimage.2007.06.030

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 26

  KriegeskorteN.CusackR.BandettiniP. (2010). How does an fMRI voxel sample the neuronal activity pattern: compact-kernel or complex spatiotemporal filter?Neuroimage49, 1965–1976.10.1016/j.neuroimage.2009.09.059

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 27

  KriegeskorteN.GoebelR.BandettiniP. (2006). Information-based functional brain mapping. Proc. Natl. Acad. Sci. U.S.A.103, 3863–3868.10.1073/pnas.0600244103

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 28

  KriegeskorteN.MurM.BandettiniP. (2008). Representational similarity analysis – connecting the branches of systems neuroscience. Front. Syst. Neurosci.2:4.10.3389/neuro.01.016.2008

  • CrossRef
  • Google Scholar

• 29

  LogothetisN. K.PaulsJ.AugathM.TrinathT.OeltermannA. (2001). Neurophysiological investigation of the basis of the fMRI signal. Nature412, 150–157.10.1038/35084005

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 30

  MangasarianO. L. (1965). Linear and nonlinear separation of patterns by linear programming. Oper. Res.13, 444–452.10.1287/opre.13.3.444

  • CrossRef
  • Google Scholar

• 31

  Martinez-RamonM.KoltchinskiiV.HeilemanG. L.PosseS. (2006). fMRI pattern classification using neuroanatomically constrained boosting. Neuroimage31, 1129–1141.10.1016/j.neuroimage.2006.01.022

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 32

  MeyerF. G.XilinS. (2008). Classification of fMRI time series in a low-dimensional subspace with a spatial prior. IEEE Trans. Med. Imaging27, 87–98.10.1109/TMI.2007.903251

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 33

  MisakiM.KimY.BandettiniP. A.KriegeskorteN. (2010). Comparison of multivariate classifiers and response normalizations for pattern-information fMRI. Neuroimage53, 103–118.10.1016/j.neuroimage.2010.05.051

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 34

  MitchellT. M. (1997). Machine Learning. New York: McGraw-Hill.

  • Google Scholar

• 35

  MountcastleV. B. (1997). The columnar organization of the neocortex. Brain120(Pt 4), 701–722.10.1093/brain/120.4.701

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 36

  NormanK. A.PolynS. M.DetreG. J.HaxbyJ. V. (2006). Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. (Regul. Ed.)10, 424–430.10.1016/j.tics.2006.07.005

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 37

  Op De BeeckH. P. (2010a). Against hyperacuity in brain reading: spatial smoothing does not hurt multivariate fMRI analyses?Neuroimage49, 1943–1948.10.1016/j.neuroimage.2009.02.047

  • CrossRef
  • Google Scholar

• 38

  Op De BeeckH. P. (2010b). Probing the mysterious underpinnings of multi-voxel fMRI analyses. Neuroimage50, 567–571.10.1016/j.neuroimage.2009.12.072

  • CrossRef
  • Google Scholar

• 39

  Op De BeeckH. P.HaushoferJ.KanwisherN. G. (2008). Interpreting fMRI data: maps, modules and dimensions. Nat. Rev. Neurosci.9, 123–135.10.1038/nrn2314

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 40

  PereiraF.BotvinickM. (2011). Information mapping with pattern classifiers: a comparative study. Neuroimage56, 476–496.10.1016/j.neuroimage.2010.05.026

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 41

  PereiraF.MitchellT.BotvinickM. (2009). Machine learning classifiers and fMRI: a tutorial overview. Neuroimage45, S199–S209.10.1016/j.neuroimage.2008.11.007

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 42

  RasmussenP. M.MadsenK. H.LundT. E.HansenL. K. (2011). Visualization of nonlinear kernel models in neuroimaging by sensitivity maps. Neuroimage55, 1120–1131.10.1016/j.neuroimage.2010.12.035

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 43

  RollsE. T.TrevesA. (1998). Neural Networks And Brain Function. New York: Oxford University Press.

  • Google Scholar

• 44

  ShmuelA.ChaimowD.RaddatzG.UgurbilK.YacoubE. (2010). Mechanisms underlying decoding at 7 T: ocular dominance columns, broad structures, and macroscopic blood vessels in V1 convey information on the stimulated eye. Neuroimage49, 1957–1964.10.1016/j.neuroimage.2009.08.040

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 45

  SmithA. T.KosilloP.WilliamsA. L. (2011). The confounding effect of response amplitude on MVPA performance measures. Neuroimage56, 525–530.10.1016/j.neuroimage.2010.05.079

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 46

  TootellR. B.ReppasJ. B.KwongK. K.MalachR.BornR. T.BradyT. J.et al (1995). Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging. J. Neurosci.15, 3215–3230.

  • Pubmed Abstract
  • Google Scholar

• 47

  VapnikV. N.ChervonenkisA. Y. A. (1971). Theory of uniform convergence of frequencies of events to their probabilities and problems of search for an optimal solution from empirical data. IEEE Trans. Automat. Contr.32, 207.

  • Google Scholar

• 48

  WeilR. S.ReesG. (2010). Decoding the neural correlates of consciousness. Curr. Opin. Neurol.23, 649–655.10.1097/WCO.0b013e32834028c7

  • Pubmed Abstract
  • CrossRef
  • Google Scholar

• 49

  XiangZ.XiY.HassonU.RamadgeP. (2009). “Boosting with spatial regularization,” in Advances in Neural Information Processing Systems, eds BengioY.SchuurmansD.LaffertyJ.WilliamsC. K. I.CulottaA. Vol. 22 (Vancouver), 2107–2115.

  • Google Scholar

• 50

  ZekiS.WatsonJ. D.LueckC. J.FristonK. J.KennardC.FrackowiakR. S. (1991). A direct demonstration of functional specialization in human visual cortex. J. Neurosci.11, 641–649.

  • Pubmed Abstract
  • Google Scholar