Original Research ARTICLE
Fronto-temporal white matter connectivity predicts reversal learning errors
- 1Department of Psychology, Temple University, Philadelphia, PA, USA
- 2Department of Radiology, Temple University School of Medicine, Philadelphia, PA, USA
Each day, we make hundreds of decisions. In some instances, these decisions are guided by our innate needs; in other instances they are guided by memory. Probabilistic reversal learning tasks exemplify the close relationship between decision making and memory, as subjects are exposed to repeated pairings of a stimulus choice with a reward or punishment outcome. After stimulus–outcome associations have been learned, the associated reward contingencies are reversed, and participants are not immediately aware of this reversal. Individual differences in the tendency to choose the previously rewarded stimulus reveal differences in the tendency to make poorly considered, inflexible choices. Lesion studies have strongly linked reversal learning performance to the functioning of the orbitofrontal cortex, the hippocampus, and in some instances, the amygdala. Here, we asked whether individual differences in the microstructure of the uncinate fasciculus, a white matter tract that connects anterior and medial temporal lobe regions to the orbitofrontal cortex, predict reversal learning performance. Diffusion tensor imaging and behavioral paradigms were used to examine this relationship in 33 healthy young adults. The results of tractography revealed a significant negative relationship between reversal learning performance and uncinate axial diffusivity, but no such relationship was demonstrated in a control tract, the inferior longitudinal fasciculus. Our findings suggest that the uncinate might serve to integrate associations stored in the anterior and medial temporal lobes with expectations about expected value based on feedback history, computed in the orbitofrontal cortex.
A classic task used to assess stimulus–response learning and cognitive flexibility is reversal learning. In this task, non-human animals or human participants learn to associate various stimuli with either rewards or penalties. Once these associations are adequately learned, the corresponding reward contingencies are reversed, and participants must learn to respond to the newly rewarded stimulus, while suppressing responses to the previously rewarded stimulus. Participants are not immediately aware of this reversal, so the previously rewarded stimulus remains pre-potent. The ease (or difficulty) with which participants learn to adapt their choices based on the reversal phase indexes cognitive flexibility. Reversal learning can be thought of as a type of model-based learning (Lucantonio et al., 2012) in which the incoming reward and punishment information is used to update model parameters and make decisions.
Individual differences in the propensity toward perseveration after reversal reveal important differences in the tendency to make inflexible, and perhaps impulsive choices (Clark et al., 2004). Indeed, reversal learning deficits have been observed across a range of psychiatric disorders that share a core propensity for inflexible and impulsive decision making: certain types of substance abuse (Jentsch et al., 2002; Obernier et al., 2002; Ersche et al., 2008; Fortier et al., 2008; Schoenbaum and Shaham, 2008; Crews and Boettiger, 2009; de Ruiter et al., 2009; Stalnaker et al., 2009; Izquierdo and Jentsch, 2012; Ortega et al., 2013), attention deficit hyperactivity disorder (Kempton et al., 1999; Itami and Uno, 2002), bipolar disorder (McKirdy et al., 2009; Roiser et al., 2009; Dickstein et al., 2010), conduct disorder (Budhani and Blair, 2005), and psychopathy (Mitchell et al., 2002; Budhani et al., 2006).
Investigations into the neural basis of reversal learning have strongly implicated several highly interconnected limbic and paralimbic brain regions: the orbitofrontal cortex (OFC), the hippocampus, and the amygdala. A rich literature of neuroimaging, neuropsychological, and lesion studies suggests that specific reward contingencies are encoded in the OFC, which is also responsible for maintaining and updating the reward history associated with particular stimuli (Clark et al., 2004; Frank and Claus, 2006; Fellows, 2011). Damage to the OFC leads to severe impairments on exceedingly simple reversal tasks across rodents, monkeys, and humans (Fellows and Farah, 2003; Frank and Claus, 2006; Fellows, 2011; Izquierdo and Jentsch, 2012). Similar findings have emerged in patients with hippocampal lesions. Evidence suggests that after hippocampal damage, patients exhibit intact initial acquisition of stimulus–outcome associations; however, performance is impaired when they are required to reverse the associations (Shohamy et al., 2009). This has been demonstrated across human patients, rodents, rabbits, and monkeys (Kimble and Kimble, 1965; Berger and Orr, 1983; Whishaw and Tomie, 1997; Murray et al., 1998; Myers et al., 2000, 2006; Carrillo et al., 2001; Shohamy et al., 2009). Similar reversal deficits have also been documented after damage to the amygdala (Schwartzbaum and Poulos, 1965; Aggleton and Passingham, 1981; Izquierdo and Murray, 2004). Therefore, researchers have posited that the neural regions within this OFC-hippocampus-amygdala circuit contribute to successful reversal learning in similar manners.
However, this view has recently been challenged. It has been proposed that damage to the white matter connecting the OFC to the temporal lobes is the source of reversal learning deficits, rather than damage to OFC gray matter. Specifically, Rudebeck et al. (2013) trained adult rhesus monkeys to learn which of two objects was associated with a food reward. After reaching a criterion, the objects’ associated reward contingencies were reversed and training with the reversed contingencies continued until the criterion was reached again. Results revealed that monkeys with excitotoxic lesions to the OFC, which are restricted to cortical gray matter, exhibited normal reversal learning performance, as measured by errors to criterion. By contrast, monkeys with aspiration lesions to the OFC, which encompass both white and gray matter, made significantly more errors before reaching the criterion, revealing consistent impairments in reversal learning relative to both controls and animals that received excitotoxic lesions. This finding was replicated in a follow-up experiment using smaller aspiration lesions restricted to the posterior portion of the OFC.
A similar paradox has also been observed after amygdala damage. Several more recent studies (e.g., Izquierdo and Murray, 2007; Stalnaker et al., 2007; Rudebeck and Murray, 2008; Izquierdo et al., 2013) have demonstrated intact or even improved reversal learning performance after amygdala damage, which stands in contrast to prior evidence linking amygdala damage to reversal learning deficits (Schwartzbaum and Poulos, 1965; Aggleton and Passingham, 1981; Izquierdo and Murray, 2004). Even an early account of hippocampal reversal deficits pointed out that the lesions that were created usually included white matter of the surrounding temporal cortex, making it difficult to disentangle the contributions of gray matter versus white matter (Berger and Orr, 1983). It has thus been proposed (but not demonstrated) that damage to the white matter connecting the OFC to the medial temporal lobes (MTLs) may be the source of reversal learning deficits, rather than damage to the OFC or MTL gray matter per se (Baxter and Croxson, 2013; Rudebeck et al., 2013).
Here, we tested a related idea by examining the relationship between reversal learning performance and microstructural properties of a white matter tract called the uncinate fasciculus (UF; Catani and Thiebaut de Schotten, 2008). This tract forms a monosynaptic pathway between regions in the anterior and medial temporal lobes (the temporal pole, uncus, parahippocampal gyrus – including the entorhinal and perirhinal cortices, and amygdala) and regions in the frontal lobe (the lateral OFC and frontal pole; Catani et al., 2013; Von Der Heide et al., 2013). By virtue of its location and connectivity (i.e., connections to MTL regions and the amygdala), the UF is considered a limbic pathway. However, the function(s) and information transmission properties of the UF are largely unknown. Several diffusion imaging studies have posited a relationship between the UF and episodic memory functions (Diehl et al., 2008; McDonald et al., 2008; Niogi et al., 2008; Metzler-Baddeley et al., 2011), decision making (e.g., Camara et al., 2010), and several psychiatric disorders, including anxiety (Phan et al., 2009; Baur et al., 2013, 2012). Our review of the non-human primate lesion literature and human diffusion imaging literature led us to hypothesize that the UF plays a role in decision making, as well as long-term memory processing, by integrating associations stored in the MTLs with feedback history computed in the OFC (Von Der Heide et al., 2013). If true, individual differences in UF microstructure should predict the ability to flexibly adapt to changes in reward contingencies, a key part of reversal learning. As a control task, we included a go/no-go task, which requires inhibition of pre-potent responses but does not require the retrieval of stored memory representations to perform the task well. As a control white matter tract, we examined the inferior longitudinal fasciculus (ILF). The ILF is similar to the UF in that it enters the medial and anterior temporal lobes. However, its function is more closely aligned with high level vision, and it lacks any relationship to the frontal lobe (Catani et al., 2003; Pyles et al., 2013).
We used diffusion tensor imaging (DTI), along with deterministic tractography, in order to examine the microstructural properties of the UF and ILF. DTI utilizes diffusion-weighted MR imaging (DW-MRI) to measure the degree of diffusion of the water molecules within human brain tissue. In myelinated axons, which make up white matter tracts, the direction of diffusion is restricted due to the presence of myelin sheaths, neurofilaments, microtubules, and cell membranes (Beaulieu, 2002). DW-MRI captures the degree of restriction, called anisotropy, and provides measures of the microstructural properties of white matter, such as the orientation and magnitude of diffusion within each voxel of the brain (Alexander et al., 2007, 2011; Jones, 2008; Tournier et al., 2011). Tractography allows for the visualization of white matter tracts and can be combined with DTI to calculate microstructural indices specific to particular white matter tracts.
Materials and Methods
Thirty-five healthy individuals (14 male, 21 female) between the ages of 18 and 28 (M = 21.51, SD = 2.55) volunteered for this experiment. Two substantial outliers were found across white matter indices and thus, two participants were excluded from further analyses, leaving a study sample of 33 participants. All participants were right-handed, native English speakers with normal to corrected-to-normal vision. All participants had no history of psychological or neurological disorders as ascertained by self-report and no MRI contraindications. Informed consent was obtained according to the guidelines of the Institutional Review Board of Temple University, and participants received monetary compensation for participation in the experiment.
Study participation occurred in two separate testing sessions. During the behavioral session, participants completed computerized tasks in the laboratory. Participants were tested individually in a well-lit room. Computerized tasks were programmed in E-Prime (Version 2.0 Professional) and presented on Dell computers. During a separate scanning session, DTI data, as well as high-resolution anatomical scans, were acquired at Temple University Hospital.
Computerized Iowa Gambling Task with Reversal
Reversal learning was assessed using a modified version of the Iowa Gambling Task (IGT; Bechara et al., 1994). Participants were instructed to choose freely from four decks of cards, presented on a computer screen, in an attempt to accrue as many points as possible. They were informed that each deck was associated with both rewards (positive points) and penalties (negative points). The point values gained or lost on each trial, along with the running total, were displayed after each choice. Reward probabilities followed the standard IGT design (Bechara et al., 1994). Briefly, two decks yielded higher immediate rewards but were also associated with frequent small to moderate losses, or less frequent but substantial losses. These decks returned a net loss and were considered the disadvantageous decks. The remaining two decks, the advantageous decks, yielded lower immediate rewards but only moderate or infrequent losses and returned a net gain. These contingencies were not disclosed to participants; however, participants were told to keep in mind that some decks may be “better” than other decks and more points would be earned if they could identify the “better” decks. Timing was self-paced.
After 200 trials of initial acquisition of the associated reward contingencies, the reward/penalty contingencies associated with each deck were reversed such that the classic advantageous decks became decks that yielded a net loss (newly disadvantageous), while the classic disadvantageous decks became the decks that yielded a net gain (newly advantageous). This constituted the reversal phase and lasted 200 trials. The entire task lasted approximately 15 minutes. Overall performance was examined by calculating net IGT score, a commonly used measure which subtracts the sum of disadvantageous deck choices from the sum of advantageous deck choices for each participant. Additionally, reversal learning was measured by calculating the total number of reversal errors committed by each participant. A reversal error consisted of any trial where participants chose from either of the previously advantageous decks after the contingency reversal occurred.
A subset of the study sample (n = 24) completed a go/no-go task in order to assess response inhibition abilities. Participants focused on a central fixation cross while random letters appeared one at a time in the center of the screen. Participants were instructed to press the space bar as quickly as possible whenever they saw a letter appear on the screen (go trials). However, any time the letter “X” appeared on the screen, participants were told to withhold their response (no-go trials). The task consisted of 128 total trials; 103 go trials and 25 pseudorandomly placed no-go trials. Performance was assessed by calculating d′, a measure of discrimination sensitivity, by subtracting normalized false alarm rate from normalized hit rate.
MRI scanning was conducted at Temple University Hospital on a 3.0 T Siemens Verio scanner (Erlangen, Germany) using a conventional 12-channel phased-array head coil. DTI data were collected using a diffusion-weighted echo-planar imaging (EPI) sequence covering the whole brain. Salient imaging parameters were as follows: 55 axial slices, 2.5 mm slice thickness, Repetition Time (TR) = 9,900 ms, Echo Time (TE) = 95 ms, Field of View (FOV) = 240 mm × 240 mm, b-values of 0 and 1000 s/mm2, 64 non-collinear directions. These parameters yielded a DTI scan lasting approximately 11 minutes.
In addition to diffusion-weighted images, high-resolution anatomical images (T1-weighted 3D MPRAGE) were also collected for each participant with the following parameters: 160 axial slices, 1 mm slice thickness, TR = 1,900 ms, TE = 2.93 ms, inversion time = 900 ms, flip angle = 9°, FOV = 256 mm × 256 mm. These anatomical images were co-registered to the diffusion images and used to draw regions of interest (ROIs).
The diffusion-weighted data were pre-processed using FSL (Smith et al., 2004) to correct for eddy currents and subject motion using an affine registration model. The b-vector matrix was adjusted based on rigid body registration, ensuring a valid computation of the tensor variables. Non-brain tissue was removed using FSL’s (Smith et al., 2004) automated brain extraction tool (BET), and a standard diffusion tensor fitting model was then applied to the data. The diffusion tensor fitting provided estimates of fractional anisotropy (FA) and mean diffusivity (MD), as well as three eigenvectors and eigenvalues. These estimates were computed on individual voxels using a three-dimensional Gaussian distribution model that yielded a single mean ellipsoid for each voxel.
Whole brain deterministic tractography was performed in subject native space using the Diffusion Toolkit and TrackVis software packages (Wang et al., 2007). This software uses a fiber assignment continuous tracking (FACT) algorithm (Mori et al., 1999) to determine the branching and curving of the fiber tracts. For a given voxel, this algorithm estimates the orientation of the principal eigenvector in that voxel and then uses nearest-neighbor interpolation to step along that direction. Step length was fixed at 0.1 mm, and an angle threshold of 35° was used to determine the termination point of the fiber tracts. A spline filter was used to smooth the tractography data. A multiple ROI-based axonal tracking approach (Mori et al., 2002; Wakana et al., 2007; Thomas et al., 2010) was then used to delineate bilateral UFs by drawing seed regions in the anterior temporal lobe and OFC. ROIs were drawn in subject native space using the high-resolution anatomical T1 images and the methods outlined by Thomas et al. (2010). A Boolean AND term was used to select only the fibers that passed through both of these seed ROIs. A control tract, the ILF, was also traced bilaterally using the same methodology and the ROIs outlined by Thomas et al. (2010). MD and axial diffusivity (AD) indices were subsequently extracted from the tracts of interest, averaging along the length of each tract.
In this study, we specifically focused on the indices of MD and AD. MD is a measure of the overall degree of diffusion, regardless of direction, while AD is a measure of the degree of diffusion along the axis parallel to the axon fibers (Beaulieu, 2011). We chose these two white matter indices because they are thought to reflect more specific information regarding the underlying microstructural properties of white matter (Alexander et al., 2011, 2007). Further, although FA is the most commonly reported microstructural measure, certain studies suggest that FA may be a suboptimal measure for capturing the complexities of the underlying cellular architecture, as it correlates poorly with actual values of individual fiber anisotropy (Leow et al., 2009; Acosta-Cabronero et al., 2010).
Statistical analyses were performed using SPSS (Version 21.0). Regression analyses were used to examine the relationship between microstructure of the UF and performance on the IGT. Gender differences were found within some of the white matter indices, so it was controlled for in the regressions. To control for multiple comparisons, family-wise error rate was adjusted using a Bonferroni correction to account for simultaneous predictors in each regression model (critical p = 0.05/3; Mundfrom et al., 2006). All regression p-values reported are Bonferroni-corrected.
Behavioral results are presented in Table 1 and Figure 1. Consistent with prior findings, participants’ performance on the IGT+reversals improved significantly from the first block to the last block on both the acquisition [t(32) = 4.55, p < 0.001] and reversal phases [t(32) = 4.07, p < 0.001] of the IGT.
FIGURE 1. Behavioral performance on the Iowa Gambling Task (IGT). Group performance is plotted across test blocks (top). IGT net score reflects the sum of disadvantageous deck choices subtracted from the sum of advantageous deck choices. Error bars represent standard error of the mean. Specific to the reversal phase, the total number of reversal errors committed is plotted for each participant (bottom) to display the individual variability among participants.
Thus, participants were able to learn the respective reward contingencies and later, update those reward contingencies after the reversal. However, there were individual differences in learning performance, especially during the reversal phase (see Figure 1). Some participants rapidly adapted to the altered contingencies, while others perseverated for many trials.
The UF has a late maturational profile, extending throughout adolescence and young adulthood (Lebel et al., 2012). Therefore, we examined whether age effects were apparent in our relatively small sample. Regression analyses revealed that age was not significantly predicted by any microstructural indices of the UF or ILF (all p’s > 0.30). These analyses are presented in the Supplementary Table S1.
Recent studies have reported gender differences in DTI measures (Gong et al., 2011; Kanaan et al., 2012; but see Hänggi et al., 2014); therefore, we investigated potential differences in our sample. T-tests revealed that males exhibited decreased AD in the left UF, compared to females, t(31) = 2.43, p = 0.02. However, males exhibited increased AD [t(31) = 2.80, p = 0.009] and increased MD [t(31) = 2.11, p = 0.04] in the left ILF, relative to females. Results are presented in Table 2. Importantly, no gender differences were found with respect to behavioral performance measures. However, since we observed gender differences in white matter indices, this was included as a control variable in all subsequent analyses.
Is the Uncinate Fasciculus Involved in Reversal Learning as Tested by the IGT?
Regression models were constructed to predict total number of reversal errors committed during the reversal phase and net IGT score during the acquisition phase of the IGT. Predictors consisted of bilateral white matter indices (MD and AD) and gender, which was included as a control variable. Regression analyses revealed a relationship between individual differences in mean uncinate AD and performance during the reversal phase, but not performance during the initial acquisition phase of the IGT. This relationship was specific to the left UF. More precisely, after controlling for gender, individual differences in left UF AD significantly predicted the total number of reversal errors committed [β = −0.57, t(29) = 2.65, p = 0.039], but did not predict performance during the acquisition phase of the IGT [β = 0.24, t(29) = 1.02, p = 0.95]. The regression results are presented in Table 3. To directly compare the magnitudes of the left uncinate and ILF model predictors, a z-test was performed using the respective regression coefficients (Paternoster et al., 1998). The magnitude of the relationship between reversal errors and left uncinate AD was significantly greater than the magnitude of the relationship between reversal errors and left ILF AD (z = 2.07, p = 0.038).
TABLE 3. Summary of multiple linear regression models predicting performance on the acquisition and reversal phases of the IGT.
Figure 2 depicts the partial regression plot representing the unique contribution of left UF AD to the prediction of reversal errors. These findings suggest a negative relationship between left uncinate AD and reversal learning, such that lower values of AD were associated with a higher number of reversal errors. Right uncinate AD did not significantly predict performance on either phase of the IGT (p’s > 0.60). Similarly, neither relationship was significant for right uncinate MD (p’s > 0.14). Left uncinate MD did predict number of reversal errors; however, this effect did not survive correction for multiple comparisons (p = 0.05 uncorrected). Similarly, follow-up analyses were completed to examine the same relationships using radial diffusivity (RD). Uncorrected, there was a trending relationship between left uncinate RD and reversal learning errors; however, such a trend cannot survive multiple comparison correction.
FIGURE 2. Tractography delineating the uncinate fasciculus (UF; red) and inferior longitudinal fasciculus (ILF; purple) in a sample participant (left). Scatter plots of residuals from the linear regression analyses (right) illustrating the relationship between individual differences in reversal errors and mean left axial diffusivity (AD) of the respective white matter tracts.
To test whether these results generalized to other tasks where pre-potent responding and impulsive decision making lead to high error rates, we examined the relationship between performance on go/no-go and UF microstructure. Regression models were constructed to predict performance on the go/no-go task. After controlling for gender, neither UF nor ILF microstructure significantly predicted d′ on the go/no-go task (p’s > 0.20). Regression model data are presented in the Supplementary Table S2.
Control Tract: the Inferior Longitudinal Fasciculus
Regression models were again constructed to predict performance on the reversal phase and performance on the acquisition phase of the IGT. The models were analogous to those constructed for the UF; predictors included gender (control variable) and bilateral ILF white matter indices (MD and AD). Regression model data are presented in Table 3. Based on the regression models, no relationships were found between ILF microstructure and performance on either phase of the IGT (p’s > 0.37). Similarly, there was no relationship found between go/no-go performance and any of the ILF indices (p’s > 0.90). Go/no-go regression data are presented in the Supplementary Table S2. In summary, no relationship was found linking microstructural properties of the ILF to performance on the IGT+reversal task or the go/no-go task.
The general function of association white matter pathways is to reciprocally connect gray matter loci in order to establish a temporally and spatially defined network that creates a unified, higher level function (Rolheiser et al., 2011). In this study, we examined an association white matter tract called the UF, which creates a monosynaptic pathway connecting portions of the medial and anterior temporal lobes to ventral portions of the frontal lobe (Ghashghaei and Barbas, 2002; Ghashghaei et al., 2007). Our review of the literature (Von Der Heide et al., 2013) implicated the UF in certain types of long-term memory retrieval (for a review, see Table 1 in Olson et al., under revision), as well as memory-based decision making (e.g., Bussey et al., 2002). During reversal learning, one must integrate long-term memories about prior good and bad choices with value computations in order to predict the optimal future choice. Thus, we predicted that individual variability in UF microstructure would predict reversal learning performance in healthy individuals. Our results provide support for this contention, as variability in the left UF predicted reversal learning errors. There appears to be some selectivity for this finding, because our evaluation of a control tract, the ILF, and a control task, go/no-go, provided no evidence of meaningful relationships with reversal learning and UF microstructure, respectively. The fact that our finding was left lateralized is consistent with existing findings on the UF, as findings are most commonly observed in the left hemisphere (for a review, see Table 1 in Olson et al., under revision).
Our findings were predicted by a study performed in macaques by Rudebeck et al. (2013), detailed in the Introduction. The authors speculated that reversal learning might rely on the integrated function of a hippocampal-amygdala-OFC circuit (Rudebeck et al., 2013). This finding is controversial because it stands in contrast to a robust literature showing reversal learning deficits after lesions to the OFC (Fellows and Farah, 2003; Frank and Claus, 2006; Fellows, 2011; Izquierdo and Jentsch, 2012). In humans, naturally occurring lesions will vary in size, location, and the degree to which white matter is damaged. It is probable that in many instances of human OFC damage, the entire hippocampal-amygdala-OFC circuit is compromised by concomitant white matter damage.
A similar argument has been made regarding the role of the amygdala in reversal learning. The same group (Rudebeck and Murray, 2008) conducted a related study in macaques, but focused on the amygdala. Prior studies had shown that aspiration lesions made to the amygdala led to reversal learning deficits (Schwartzbaum and Poulos, 1965; Aggleton and Passingham, 1981; Izquierdo and Murray, 2004). However, Rudebeck and Murray (2008) found that more refined excitotoxic lesions to the amygdala did not produce classic reversal learning deficits. Finally, a large literature, dating back decades, has reported that hippocampal lesions do not affect the acquisition of associations, but such lesions have a devastating effect on performance after reversal (reviewed in Shohamy et al., 2009). Similar deficits have been reported in rodents, monkeys, and humans following ablative lesions, as well as excitotoxic lesions. However, as is often the case, counter-evidence also exists suggesting that the hippocampus is also involved in the initial acquisition of associations (Henke, 2010).
Other neural regions also undoubtedly participate in reversal learning. For instance, the ventral striatum is thought to be involved in the computation of prediction error, the error signal that is generated to compute the difference between expected versus received rewards during learning (Li et al., 2011).
Reversal Learning in Clinical Populations
Reversal learning deficits have been observed across a range of disorders. For instance, deficits at the reversal stage of learning tasks have been observed in several varieties of drug addiction, in both rodents and humans (Jentsch et al., 2002; Ersche et al., 2008; Schoenbaum and Shaham, 2008; de Ruiter et al., 2009; Stalnaker et al., 2009; Ortega et al., 2013). It has been speculated that drug addiction is associated with impairments in cognitive flexibility that make it difficult to inhibit pre-potent responses and update internal models with new stimulus–outcome mappings (Izquierdo and Jentsch, 2012).
Increased perseveration in reversal learning has also been observed in psychiatric disorders ranging from attentional disorders (e.g., ADHD) to disorders of emotion and social comportment, such as oppositional defiant disorder, conduct disorder, and psychopathy (Kempton et al., 1999; Itami and Uno, 2002; Mitchell et al., 2002; Budhani and Blair, 2005; Budhani et al., 2006; McKirdy et al., 2009; Roiser et al., 2009; Dickstein et al., 2010). The impulse control disorders are noteworthy because several studies have reported that individuals with conduct disorder and/or psychopathic traits have compromised amygdalae and OFCs (Blair, 2007), regions linked by the UF. Moreover, a small but consistent literature is emerging showing altered UF microstructure in individuals with psychopathic traits as compared to matched healthy controls (Craig et al., 2009; Passamonti et al., 2012; Sarkar et al., 2013). We speculate that difficulties in responding to changed reward and punishment contingencies underlie the relationship between psychopathic traits and altered UF microstructure. We further speculate that gross aberrations in this tract would lead to pathologically poor memory-based decision making, where memories can be retrieved and decisions made, but the two processes are poorly integrated.
It is important to bear in mind that white matter does not produce behavior; the electrical activity of neurons produces behavior. White matter provides the communication system that links groups of neurons to other groups of neurons. Thus, the information transmission properties of any given white matter tract are closely aligned with the function of the gray matter regions that it connects (Passingham et al., 2002).
Because the UF is a large white matter bundle linking functionally discrete regions of the temporal lobe (e.g., the uncus, entorhinal cortex, amygdala, perirhinal cortex, temporal pole, and possibly anterior hippocampus) to discrete regions of the frontal lobe (the lateral OFC and BA 10), it is plausible that the UF serves as the information conduit for a family of cognitive processes related to the functions of these regions. Our study was not designed to test the finer-grained question of whether white matter from particular cortical subregions underlies the observed association with reversal learning, but this will be important to examine in subsequent studies.
Another limitation is that our findings were only apparent in AD. AD measures the primary direction of diffusion within each voxel. It is thought to reflect properties such as axonal diameter, myelination (more specific), and axonal damage (less specific; RD has been shown to be more associated with axonal damage due to transection; Alexander et al., 2007; Feldman et al., 2010). We also observed an effect in MD; however, after correcting for multiple comparisons, this effect was no longer significant. Interpreting our findings from a detailed neurobiological standpoint is difficult. Our sampling resolution of approximately 2 mm × 2 mm × 2 mm is coarse; we are capturing far more than simply axons in our analysis. These different tissues and cell types give rise to certain architectural characteristics for each voxel, and it is clear that this architecture plays a role in the behaviors that we are observing. Beyond this, the variability that makes up the distribution of cells in each voxel, and the contribution of this to different DTI indices, is largely unknown.
Last, although we did observe variability in participants’ reversal learning performance, our cohort was more homogeneous than the U.S. population at large, since our participant pool consisted largely of Temple University undergraduate and graduate students. It is likely that our results would have been more robust if we had studied a population with greater variance in the measures of interest, such as individuals with conduct disorder, addiction, or ADHD.
Research utilizing diffusion imaging techniques is still heavily focused on white matter alterations across clinical populations. Studies restricted to neurologically normal populations, and especially the investigation of individual differences among healthy individuals, are still rather rare. In this study, we demonstrate that individual differences in white matter microstructure are able to predict differences in reversal learning performance among a cohort of healthy young adults. We found that microstructural differences specific to the left UF predicted the number of errors committed on a reversal learning task. Therefore, the propensity to flexibly adapt to changing stimulus contingencies seems to be linked to microstructural properties of the UF. Portions of the hippocampus, amygdala, and OFC may form a circuit that allows associative learning to modulate our expectations about upcoming rewards and punishments, thus modulating decision making (Schoenbaum et al., 1998). The UF constitutes the “wires” of the circuit, allowing behavior to be modified by value-laden experiences. Future research should continue to investigate the specificity of this finding and should aim to expand our findings to clinical populations, particularly those characterized by deficiencies in cognitive flexibility.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We would like to thank Hyden Zhang, Vanessa Troiani, Ashley Unger, and Tehila Nugiel for assistance with participant testing and tract tracing. This work was supported by a National Institutes of Health grant to I. Olson [RO1 MH091113]. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institute of Mental Health or the National Institutes of Health. The authors declare no competing financial interests.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/article/10.3389/fnhum.2015.00343/abstract
Acosta-Cabronero, J., Williams, G. B., Pengas, G., and Nestor, P. J. (2010). Absolute diffusivities define the landscape of white matter degeneration in Alzheimer’s disease. Brain 133, 529–539. doi: 10.1093/brain/awp257
Alexander, A. L., Hurley, S. A., Samsonov, A. A., Adluru, N., Hosseinbor, A. P., Mossahebi, P., et al. (2011). Characterization of cerebral white matter properties using quantitative magnetic resonance imaging stains. Brain Connect. 1, 423–446. doi: 10.1089/brain.2011.0071
Baur, V., Brühl, A. B., Herwig, U., Eberle, T., Rufer, M., Delsignore, A., et al. (2013). Evidence of frontotemporal structural hypoconnectivity in social anxiety disorder: a quantitative fiber tractography study. Hum. Brain Mapp. 34, 437–46. doi: 10.1002/hbm.21447
Bechara, A., Damasio, A. R., Damasio, H., and Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7–15. doi: 10.1016/0010-0277(94)90018-3
Berger, T., and Orr, W. (1983). Hippocampectomy selectively disrupts discrimination reversal conditioning of the rabbit nictitating membrane response. Behav. Brain Res. 8, 49–68. doi: 10.1016/0166-4328(83)90171-7
Budhani, S., and Blair, R. J. R. (2005). Response reversal and children with psychopathic tendencies: success is a function of salience of contingency change. J. Child Psychol. Psychiatry 46, 972–981. doi: 10.1111/j.1469-7610.2004.00398.x
Budhani, S., Richell, R. R., and Blair, R. J. R. (2006). Impaired reversal but intact acquisition: probabilistic response reversal deficits in adult individuals with psychopathy. J. Abnorm. Psychol. 115, 552–558. doi: 10.1037/0021-843X.115.3.552
Bussey, T. J., Wise, S. P., and Murray, E. A. (2002). Interaction of ventral and orbital prefrontal cortex with inferotemporal cortex in conditional visuomotor learning. Behav. Neurosci. 116, 703–715. doi: 10.1037/0735-7044.116.4.703
Camara, E., Rodriguez-Fornells, A., and Münte, T. F. (2010). Microstructual brain differences predict functional hemodynamic responses in a reward processing task. J. Neurosci. 30, 11398–11402. doi: 10.1523/JNEUROSCI.0111-10.2010
Carrillo, M. C., Gabrieli, J. D. E., Hopkins, R. O., McGlinchey-Berroth, R., Fortier, C. B., Kesner, R. P., et al. (2001). Spared discrimination and impaired reversal eyeblink conditioning in patients with temporal lobe amnesia. Behav. Neurosci. 115, 1171–1179. doi: 10.1037/0735-7044.115.6.1171
Catani, M., Dell’Acqua, F., and Thiebaut de Schotten, M. (2013). A revised limbic system model for memory, emotion and behaviour. Neurosci. Biobehav. Rev. 37, 1724–1737. doi: 10.1016/j.neubiorev.2013.07.001
de Ruiter, M. B., Veltman, D. J., Goudriaan, A. E., Oosterlaan, J., Sjoerds, Z., and van den Brink, W. (2009). Response perseveration and ventral prefrontal sensitivity to reward and punishment in male problem gamblers and smokers. Neuropsychopharmacology 34, 1027–1038. doi: 10.1038/npp.2008.175
Dickstein, D. P., Finger, E. C., Brotman, M. A., Rich, B. A., Pine, D. S., Blair, J. R., et al. (2010). Impaired probabilistic reversal learning in youths with mood and anxiety disorders. Psychol. Med. 40, 1089–1100. doi: 10.1017/S0033291709991462
Diehl, B., Busch, R. M., Duncan, J. S., Piao, Z., Tkach, J., and Lüders, H. O. (2008). Abnormalities in diffusion tensor imaging of the uncinate fasciculus relate to reduced memory in temporal lobe epilepsy. Epilepsia 49, 1409–1418. doi: 10.1111/j.1528-1167.2008.01596.x
Ersche, K. D., Roiser, J. P., Robbins, T. W., and Sahakian, B. J. (2008). Chronic cocaine but not chronic amphetamine use is associated with perseverative responding in humans. Psychopharmacology (Berl) 197, 421–431. doi: 10.1007/s00213-007-1051-1
Feldman, H. M., Yeatman, J. D., Lee, E. S., Barde, L. H. F., and Gaman-Bean, S. (2010). Diffusion tensor imaging: a review for pediatric researchers and clinicians. J. Dev. Behav. Pediatr. 31, 346–356. doi: 10.1097/DBP.0b013e3181dcaa8b
Fellows, L. K. (2011). Orbitofrontal contributions to value-based decision making: evidence from humans with frontal lobe damage. Ann. N. Y. Acad. Sci. 1239, 51–58. doi: 10.1111/j.1749-6632.2011.06229.x
Fortier, C. B., Steffen, E. M., Lafleche, G., Venne, J. R., Disterhoft, J. F., and McGlinchey, R. E. (2008). Delay discrimination and reversal eyeblink classical conditioning in abstinent chronic alcoholics. Neuropsychology 22, 196–208. doi: 10.1037/0894-4184.108.40.206
Frank, M. J., and Claus, E. D. (2006). Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol. Rev. 113, 300–326. doi: 10.1037/0033-295X.113.2.300
Ghashghaei, H., and Barbas, H. (2002). Pathways for emotion: interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey. Neuroscience 115, 1261–1279. doi: 10.1016/S0306-4522(02)00446-3
Ghashghaei, H. T., Hilgetag, C. C., and Barbas, H. (2007). Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage 34, 905–923. doi: 10.1016/j.neuroimage.2006.09.046
Hänggi, J., Fövenyi, L., and Jäncke, L. (2014). The hypothesis of neuronal interconnectivity as a function of brain size - a cennectomal organisation principle? Front. Hum. Neurosci. 8:915. doi: 10.3389/fnhum.2014.00915
Itami, S., and Uno, H. (2002). Orbitofrontal cortex dysfunction in attention-defcit hyperactivity disorder revealed by reversal and extinction tasks. Neuroreport 13, 2453–2457. doi: 10.1097/00001756-200212200-00016
Izquierdo, A., Darling, C., Manos, N., Pozos, H., Kim, C., Ostrander, S., et al. (2013). Basolateral amygdala lesions facilitate reward choices after negative feedback in rats. J. Neurosci. 33, 4105–4109. doi: 10.1523/JNEUROSCI.4942-12.2013
Izquierdo, A., and Murray, E. A. (2004). Combined unilateral lesions of the amygdala and orbital prefrontal cortex impair affective processing in rhesus monkeys. J. Neurophysiol. 91, 2023–2039. doi: 10.1152/jn.00968.2003
Izquierdo, A., and Murray, E. A. (2007). Selective bilateral amygdala lesions in rhesus monkeys fail to disrupt object reversal learning. J. Neurosci. 27, 1054–1062. doi: 10.1523/JNEUROSCI.3616-06.2007
Jentsch, J. D., Olausson, P., De La Garza, R., and Taylor, J. R. (2002). Impairments of reversal learning and response perseveration after repeated, intermittent cocaine administrations to Monkeys. Neuropsychopharmacology 26, 183–190. doi: 10.1016/S0893-133X(01)00355-4
Kanaan, R. A., Allin, M., Picchioni, M., Barker, G. J., Daly, E., Shergill, S. S., et al. (2012). Gender differences in white matter microstructure. PLoS ONE 7:e38272. doi: 10.1371/journal.pone.0038272
Kempton, S., Vance, A., Maruff, P., Luk, E., Costin, J., and Pantelis, C. (1999). Executive function and attention deficit hyperactivity disorder?: stimulant medication and better executive function performance in children. Psychol. Med. 29, 527–538. doi: 10.1017/S0033291799008338
Lebel, C., Gee, M., Camicioli, R., Wieler, M., Martin, W., and Beaulieu, C. (2012). Diffusion tensor imaging of white matter tract evolution over the lifespan. Neuroimage 60, 340–352. doi: 10.1016/j.neuroimage.2011.11.094
Leow, A. D., Zhan, L., Zhu, S., Hageman, N., Barysheva, M., Toga, A. W., et al. (2009). “White matter integrity measured by fractional anisotropy correlates poorly with actual individual fiber anisotropy,” in Proceedings of the 6th IEEE international Symposium on Biomedical Imaging: From Nano to Macro, ISBI2009, Boston, MA, 622–625. doi: 10.1038/nn.2904
Li, J., Schiller, D., Schoenbaum, G., Phelps, E. A., and Daw, N. D. (2011). Differential roles of human striatum and amygdala in associative learning. Nat. Neurosci. 14, 1250–1252. doi: 10.1038/nn.2904
McDonald, C. R., Ahmadi, M. E., Hagler, D. J., Tecoma, E. S., Iragui, V. J., Gharapetian, L., et al. (2008). Diffusion tensor imaging correlates of memory and language impairments in temporal lobe epilepsy. Neurology 71, 1869–1876. doi: 10.1212/01.wnl.0000327824.05348.3b
McKirdy, J., Sussmann, J. E. D., Hall, J., Lawrie, S. M., Johnstone, E. C., and McIntosh, A. M. (2009). Set shifting and reversal learning in patients with bipolar disorder or schizophrenia. Psychol. Med. 39, 1289–1293. doi: 10.1017/S0033291708004935
Metzler-Baddeley, C., Jones, D. K., Belaroussi, B., Aggleton, J. P., and O’Sullivan, M. J. (2011). Frontotemporal connections in episodic memory and aging: a diffusion MRI tractography study. J. Neurosci. 31, 13236–13245. doi: 10.1523/JNEUROSCI.2317-11.2011
Mitchell, D. G., Colledge, E., Leonard, A., and Blair, R. J. (2002). Risky decisions and response reversal: is there evidence of orbitofrontal cortex dysfunction in psychopathic individuals? Neuropsychologia 40, 2013–2022. doi: 10.1016/S0028-3932(02)00056-8
Mori, S., Crain, B. J., Chacko, V. P., and Van Zijl, P. C. M. (1999). Three-dimensional tracking of axonal projections in the brain by magnetic resonance imaging. Ann. Neurol. 45, 265–269. doi: 10.1002/1531-8249(199902)45:2<265::AID-ANA21>3.0.CO;2-3
Mori, S., Kaufmann, W. E., Davatzikos, C., Stieltjes, B., Amodei, L., Fredericksen, K., et al. (2002). Imaging cortical association tracts in the human brain using diffusion-tensor-based axonal tracking. Magn. Reson. Med. 47, 215–223. doi: 10.1002/mrm.10074
Murray, E. A., Baxter, M. G., and Gaffan, D. (1998). Monkeys with rhinal cortex damage or neurotoxic hippocampal lesions are impaired on spatial scene learning and object reversals. Behav. Neurosci. 112, 1291–1303. doi: 10.1037//0735-7044.112.6.1291
Myers, C. E., Deluca, J., Hopkins, R. O., and Gluck, M. A. (2006). Conditional discrimination and reversal in amnesia subsequent to hypoxic brain injury or anterior communicating artery aneurysm rupture. Neuropsychologia 44, 130–139. doi: 10.1016/j.neuropsychologia.2005.03.026
Niogi, S. N., Mukherjee, P., Ghajar, J., Johnson, C. E., Kolster, R., Lee, H., et al. (2008). Structural dissociation of attentional control and memory in adults with and without mild traumatic brain injury. Brain 131, 3209–3221. doi: 10.1093/brain/awn247
Obernier, J. A., White, A. M., Swartzwelder, H. S., and Crews, F. T. (2002). Cognitive deficits and CNS damage after a 4-day binge ethanol exposure in rats. Pharmacol. Biochem. Behav. 72, 521–532. doi: 10.1016/S0091-3057(02)00715-3
Ortega, L. A., Tracy, B. A., Gould, T. J., and Parikh, V. (2013). Effects of chronic low- and high-dose nicotine on cognitive flexibility in C57BL/6J mice. Behav. Brain Res. 238, 134–145. doi: 10.1016/j.bbr.2012.10.032
Passamonti, L., Fairchild, G., Fornito, A., Goodyer, I. M., Nimmo-Smith, I., Hagan, C. C., et al. (2012). Abnormal anatomical connectivity between the amygdala and orbitofrontal cortex in conduct disorder. PLoS ONE 7:e48789. doi: 10.1371/journal.pone.0048789
Paternoster, R., Brame, R., Mazerolle, P., and Piquero, A. (1998). Using the correct statistical test for the equality of regression coefficients. Criminology 36, 859–866. doi: 10.1111/j.1745-9125.1998.tb01268.x
Phan, K. L., Orlichenko, A., Boyd, E., Angstadt, M., Coccaro, E. F., Liberzon, I., et al. (2009). Preliminary evidence of white matter abnormality in the uncinate fasciculus in generalized social anxiety disorder. Biol. Psychiatry 66, 691–694. doi: 10.1016/j.biopsych.2009.02.028
Roiser, J., Cannon, D., Gandhi, S., Tavares, J., Erickson, K., Wood, S., et al. (2009). Hot and cold cognition in unmedicated depressed subjects with bipolar disorder. Bipolar Disord. 11, 178–189. doi: 10.1111/j.1399-5618.2009.00669.x
Rolheiser, T., Stamatakis, E. A., and Tyler, L. K. (2011). Dynamic processing in the human language system: synergy between the arcuate fascicle and extreme capsule. J. Neurosci. 31, 16949–57. doi: 10.1523/JNEUROSCI.2725-11.2011
Rudebeck, P. H., and Murray, E. A. (2008). Amygdala and orbitofrontal cortex lesions differentially influence choices during object reversal learning. J. Neurosci. 28, 8338–8343. doi: 10.1523/JNEUROSCI.2272-08.2008
Rudebeck, P. H., Saunders, R. C., Prescott, A. T., Chau, L. S., and Murray, E. A. (2013). Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating. Nat. Neurosci. 16, 1140–1145. doi: 10.1038/nn.3440
Sarkar, S., Craig, M. C., Catani, M., Dell’acqua, F., Fahy, T., Deeley, Q., et al. (2013). Frontotemporal white-matter microstructural abnormalities in adolescents with conduct disorder: a diffusion tensor imaging study. Psychol. Med. 43, 401–411. doi: 10.1017/S003329171200116X
Schwartzbaum, J., and Poulos, D. (1965). Discrimination behavior after amygdalectomy in monkeys: learning set and discrimination reversals. J. Comp. Physiol. Psychol. 60, 320–328. doi: 10.1037/h0022551
Shohamy, D., Myers, C. E., Hopkins, R. O., Sage, J., and Gluck, M. A. (2009). Distinct hippocampal and basal ganglia contributions to probabilistic learning and reversal. J. Cogn. Neurosci. 21, 1821–1833. doi: 10.1162/jocn.2009.21138
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., et al. (2004). Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 23(Suppl. 1), S208–S219. doi: 10.1016/j.neuroimage.2004.07.051
Stalnaker, T. A., Franz, T. M., Singh, T., and Schoenbaum, G. (2007). Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments. Neuron 54, 51–58. doi: 10.1016/j.neuron.2007.02.014
Stalnaker, T. A., Takahashi, Y., Roesch, M. R., and Schoenbaum, G. (2009). Neural substrates of cognitive inflexibility after chronic cocaine exposure. Neuropharmacology 56 (Suppl. 1), 63–72. doi: 10.1016/j.neuropharm.2008.07.019
Thomas, C., Humphreys, K., Jung, K.-J., Minshew, N., and Behrmann, M. (2010). The anatomy of the callosal and visual-association pathways in high-functioning autism: a DTI tractography study. Cortex 47, 863–873. doi: 10.1016/j.cortex.2010.07.006
Von Der Heide, R. J., Skipper, L. M., Klobusicky, E., and Olson, I. R. (2013). Dissecting the uncinate fasciculus: disorders, controversies and a hypothesis. Brain 136, 1692–707. doi: 10.1093/brain/awt094
Wakana, S., Caprihan, A., Panzenboeck, M. M., Fallon, J. H., Perry, M., Gollub, R. L., et al. (2007). Reproducibility of quantitative tractography methods applied to cerebral white matter. Neuroimage 36, 630–644. doi: 10.1016/j.neuroimage.2007.02.049
Wang, R., Benner, T., Sorensen, A. G., and Wedeen, V. J. (2007). Diffusion toolkit: a software package for diffusion imaging data processing and tractography. Proc. Int. Soc. Magn. Reson. Med. 15, 3720.
Whishaw, I. Q., and Tomie, J.-A. (1997). Perseveration on place reversals in spatial swimming pool tasks: further evidence for place learning in hippocampal rats. Hippocampus 7, 361–370. doi: 10.1002/(SICI)1098-1063(1997)7:4<361::AID-HIPO2>3.0.CO;2-M
Keywords: orbitofrontal cortex, hippocampus, uncinate fasciculus, diffusion imaging, reversal learning, decision making
Citation: Alm KH, Rolheiser T, Mohamed FB and Olson IR (2015) Fronto-temporal white matter connectivity predicts reversal learning errors. Front. Hum. Neurosci. 9:343. doi: 10.3389/fnhum.2015.00343
Received: 12 February 2015; Accepted: 29 May 2015;
Published: 18 June 2015
Edited by:John J. Foxe, Albert Einstein College of Medicine, USA
Reviewed by:Antoni Rodriguez-Fornells, University of Barcelona, Spain
Jürgen Hänggi, University of Zurich, Switzerland
Copyright © 2015 Alm, Rolheiser, Mohamed and Olson. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ingrid R. Olson, Department of Psychology, Temple University, 1701 North 13th Street, Philadelphia, PA 19122, USA, firstname.lastname@example.org