Impact Factor 2.673 | CiteScore 2.96
More on impact ›

Original Research ARTICLE

Front. Hum. Neurosci., 30 October 2009 |

Altered function of ventral striatum during reward-based decision making in old age

Max-Planck-Institute for Human Development, Berlin, Germany
Department of Psychiatry, Charité – University Medicine Berlin, Campus Mitte, Berlin, Germany
Department of Linguistics, University of Potsdam, Potsdam, Germany
Mind and Brain Institute, Humboldt University Berlin, Berlin, Germany
Max-Planck-Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
Department of Psychiatry, Charité – University Medicine Berlin, Campus Benjamin Franklin, Berlin, Germany
Normal aging is associated with a decline in different cognitive domains and local structural atrophy as well as decreases in dopamine concentration and receptor density. To date, it is largely unknown how these reductions in dopaminergic neurotransmission affect human brain regions responsible for reward-based decision making in older adults. Using a learning criterion in a probabilistic object reversal task, we found a learning stage by age interaction in the dorsolateral prefrontal cortex (dlPFC) during decision making. While young adults recruited the dlPFC in an early stage of learning reward associations, older adults recruited the dlPFC when reward associations had already been learned. Furthermore, we found a reduced change in ventral striatal BOLD signal in older as compared to younger adults in response to high probability rewards. Our data are in line with behavioral evidence that older adults show altered stimulus–reward learning and support the view of an altered fronto-striatal interaction during reward-based decision making in old age, which contributes to prolonged learning of reward associations.


Aging is associated with a decline in different cognitive domains, such as working memory, episodic memory, fluid aspects of intelligence, and executive functioning (Lindenberger et al., 1993 ; Craik and Salthouse, 2000 ). Many aspects of cognitive abilities as well as motor functions rely on the functional integrity of the dopaminergic system (Burns et al., 1983 ; Sawaguchi and Goldman-Rakic, 1991 ; Wittmann et al., 2005 ; Schultz, 2007 for review). During aging, dopamine concentration and receptor density gradually decrease, especially in the prefrontal cortex (PFC) and the striatum (Bäckman and Farde, 2005 ). Furthermore, the PFC and basal ganglia appear to be susceptible to age-related decreases in volume (Raz, 2000 ; Raz and Rodrigue, 2006 ). Based on these findings, the dopamine hypothesis of cognitive aging states that neurochemical alterations of the dopaminergic system give rise to declines in various cognitive functions in old age (Bäckman et al., 2006 ). The dopaminergic system also plays a major role in reward-based learning and decision making (Pagnoni et al., 2002 ; O’Doherty et al., 2003 ; Montague et al., 2006 ). Neurophysiological studies in animals and, more recently, neuroimaging studies in healthy young humans have identified a neural network, which represents different modalities and aspects of reward processing and reward association learning. This network includes the dopaminergic midbrain (substantia nigra/ventral tegmental area, SN/VTA) and its target structures such as the PFC [orbitofrontal cortex (OFC), ventromedial and dorsolateral PFC (dlPFC)], the amygdala, and the ventral striatum (VST, Schultz, 2000 for review). It has been proposed that dopamine neurons generate a “prediction error” serving as a global learning signal (Montague et al., 1996 ; Schultz et al., 1997 ). Neuroimaging studies in humans have confirmed corresponding responses in SN/VTA (Duzel et al., 2009 ) and the striatum (McClure et al., 2003 ). The VST among other frontal cortical areas has been shown to be involved in processing the delivery (Delgado et al., 2000 ; Elliott et al., 2000 ; Breiter et al., 2001 ), anticipation (Knutson et al., 2001 ), and predictability of rewards (Pagnoni et al., 2002 ). Most of these findings are in line with the hypothesis that VST responses signal errors in the prediction of rewards (McClure et al., 2004 ; Schultz, 2007 ).
Little is known, however, about how these processes are altered in the aging brain. Behavioral evidence suggests that reward-based decision making is impaired in old age. In probabilistic reversal learning tasks, older participants are deficient in the acquisition and reversal learning of reward associations (Marschner et al., 2005 ; Mell et al., 2005 ; Weiler et al., 2008 ). Moreover, older participants show insufficient category learning and set shifting as assessed with the Wisconsin Card Sorting Test (WCST, Ridderinkhof et al., 2002 ; Rhodes, 2004 ) and impaired decision making as assessed with the Iowa Gambling Task (Denburg et al., 2005 ).
Few human neuroimaging studies have focused on age-related neurofunctional changes of the reward system and reported striatal dysfunction in old age (Nagahama et al., 1997 ; Esposito et al., 1999 ; Fera et al., 2005 ; Mohr et al., 2009 ). Tasks used in those studies lack the separation of specific processes, such as decision making and reward processing. Furthermore, it is unclear whether the neurofunctional differences observed in those studies are due to performance differences or changes of the reward system.
More recent functional magnetic resonance imaging (fMRI) studies have compared younger and older participants performing a monetary incentive delay (MID) task (Samanez-Larkin et al., 2007 ; Schott et al., 2007 ). Schott et al. found greater increases in BOLD signal in the VST in younger adults during gain anticipation and in older adults during reward feedback (Schott et al., 2007 ). Another study reported age-related differences in VST during loss anticipation indicating an altered reward system in old age (Samanez-Larkin et al., 2007 ). In the MID task, associations between cues and outcomes are learned before the actual experiment; the task does not focus on the learning process and does not have a choice component.
To study reward-based decision making in old age, we used a probabilistic object reversal task (pORT, Heekeren et al., 2007 ). We hypothesized that the PFC and VST would show an altered response during reward association learning in old age. Importantly, our design allows the separation of reward processing and decision making. Furthermore, a learning criterion enabled us to: (1) assess learning-related changes, and (2) control for the potentially confounding effect of performance differences by comparing responses in trials where older adults performed as well as younger adults.

Materials and Methods


Twenty-eight healthy right-handed participants, 14 younger (8 females, mean age 26.48, SD ± 3.96 years) and 14 older adults (7 females, mean age 67.82, SD ± 5.01 years), participated in this study. Participants were recruited through newspaper advertisements and received 40€ for participation. Groups were matched for formal education (see Table 1 for sample characterization).
None of the participants reported cardiovascular pathology, medication, history of neurological or psychiatric episodes or substance abuse. We applied a neuropsychological test battery to further characterize the sample and to assess for signs of dementia in each participant (see Table 2 for descriptive statistics). This included assessing episodic memory [Ten-Word-List with Encoding Enhancement (Reischies et al., 2000 ), Free and Cued Selective Reminding Test (Grober et al., 1988 )], processing speed [Reitan Trail Making Task Part A and B (Reitan, 1958 ), Digit Letter Test (Lindenberger et al., 1993 )], crystallized intelligence [Multiple Choice Vocabulary Test, Mehrfach–Wortwahl–Wortschatz test Version B (Lehrl et al., 1995 )], reasoning [Leistungsprüfsystem Test 3 (LPS-3, Horn, 1983 )], and executive functions [Self Ordered Pointing Task (Petrides and Milner, 1982 ), Tower of London Task (Shallice, 1982 ), Controlled Oral Word Association Task (Benton and Hamsher, 1976 ), Stroop Color–Word Interference Test (Stroop, 1935 ), WCST (Grant and Berg, 1948 )]. As expected, younger participants performed significantly better than older participants on most tasks assessing processing speed, reasoning, executive functions, and episodic memory. Older participants scored higher on the multiple choice vocabulary test and were above normal age performance on the LPS-3 and the Digit Letter Test (see Table 2 ). In conclusion, psychometric data indicate that we included healthy older participants with a high level of cognitive abilities. The study was approved by the local ethics committee of the Charité-University Medicine Berlin, and written consent was obtained from each participant prior to participation.

Probabilistic Object Reversal Task

In object reversal tasks, the participant typically has to learn object-reward associations between repetitively presented items. After a given time or criterion, the reward schedule changes so that another item is maximally rewarding. In this version, participants viewed four of six letters (C, F, H, N, R, S) simultaneously on a screen (Figure 1 A). Each letter corresponded to an abstract non-monetary feedback cue ranging between −40 and +40 points (40, 20, 0, −20, −40; Reischies, 1999 ). Participants had to choose one of the letters and indicate their choice with a button press on a four-button response box. The participant’s task was to collect as many points as possible; that is, to find the maximally rewarding letter. To increase task difficulty and to reduce predictability, we introduced a probabilistic variation in the outcome schedule: for each letter, a fixed payoff was used in 80% of the trials. In the remaining 20%, only a reduced amount of points was delivered (e.g., 20 instead of 40 points). After six to eight continuous successful trials, reward contingencies covertly changed; that is, the participant had to learn new reward associations. If they did not learn this association within 15 trials, the feedback schedule also covertly changed. Thirty control trials were also randomly inserted. The experiment consisted of a total of 12 blocks with different feedback schedules.
Figure 1. Probabilistic object reversal task. (A) Experimental design: Participants chose one of four letters presented for 3.5 s (letter chosen marked red). After a randomized delay, abstract non-monetary feedback cues (“points”) were presented. (B) Performance of one participant. Choices and resulting outcomes are plotted throughout one block. The red marked trials were assigned to “search” trials whereas the blue marked trials were treated as “learned” trials.
Stimuli were presented for 3500 ms. The duration of this period was adjusted according to reaction times in previous studies using this task in older adults to account for age differences in processing speed (Mell et al., 2005 ). The stimulus presentation was separated from the presentation of feedback (1000 ms) by inserting a fixation period of variable duration (2000 ± 1500 ms). The feedback presentation was followed by a variable intertrial interval (ITI, 2500 ± 2000 ms) during which a fixation cross was presented. In control trials, the participant had to choose the letter “X” from a display of three “Y” and one “X” and received 0 points. Prior to the fMRI experiment, participants performed one block without reversal and were told not to use any strategy or rule.
For post hoc analysis, we defined an additional learning criterion that defines a “learned” trial as any correct trial after two successful trials and a continuous correctness of 80%. According to this criterion, we grouped trials into two stages of learning. In “search” trials, participants looked for the maximally rewarding letter by trial and error until they reached the learning criterion, whereas in “learned” trials they showed successful learning according to the criterion (cf. Figure 1 B).
We assessed several behavioral parameters: the total amount of collected points throughout the task (“global score”), and the number of trials in which participants did not choose the most profitable letter of the current block (“errors”). The amount of total errors was subdivided into “perseverative errors” in which participants kept consistently choosing a letter no longer associated with the maximum feedback, and “random errors”. In addition, the number of blocks in which the learning criterion was reached was determined for each participant (number of successful blocks; for a more detailed description, see Mell et al., 2005 ).

fMRI Data Acquisition

FMRI was performed on a 1.5-T Magnetom Vision scanner (Siemens Medical Systems, Erlangen, Germany) with a standard head coil. Head movement was minimized using a vacuum pad. First, two structural 3D data sets were acquired for all participants using a T1-weighted sequence (FLASH, TR 20 ms, TE 5 ms, FA 30°, FOV 256 mm, Matrix 256 × 256, one hundred and eighty 1-mm slices, in-plane resolution: 1 mm2). Thereafter, three runs, each consisting of 210 functional images using a T2*-weighted gradient echo sequence, were acquired (TR 2500 ms, TE 40 ms, FA 90°, FOV 256 mm, matrix 64 × 64, twenty-six 4-mm slices, inter-slice gap 0.6 mm, in-plane resolution: 4 mm2, ascending acquisition of images). The task was programmed in C++ and was projected on a back-projection screen using an LCD projector. We used a rapid event related design. The event schedule was optimized using Optseq2 ( , Dale, 1999 ). Durations of the delay period and ITI were determined by a genetic algorithm (Wager and Nichols, 2003 ). Variation of the delay period and ITI allowed us to acquire scans in temporal asynchrony to the task in order to avoid a systematic bias in sampling over peristimulus time. During functional scanning, each participant completed 164.6 ± 3.6 trials.

Data Analysis

Behavioral data

Raw data were tested for homogeneity of variance using Levene’s test. The global score as well as the number of successful blocks violated this assumption. Therefore, group comparisons for the global score as well as the number of successful blocks were subjected to non-parametric statistics (Mann–Whitney U test). All other scores were calculated using t-tests for independent groups. Analyses were performed using the SPSS software package (SPSS Inc., Cary, NC, USA).

fMRI data

Imaging data were analyzed using a mixed effects approach within the framework of the general linear model as implemented in the statistical parametric mapping software package SPM2 1 . Six functional volumes were excluded to avoid magnetic saturation effects. Slice-time correction, realignment and spatial smoothing (Gaussian Kernel, FWHM = 10 mm × 10 mm × 11.5 mm) were applied. Our design allowed us to define separate regressors for decision making and reward processing within each trial. Decision making was defined as the period between presentation of the letters and the button press response. Reward processing was defined as the time during which participants watched the feedback cue indicating the number of points earned for the preceding choice. Additional regressors for “learned” and “search” trials were defined for decision making and reward processing, respectively. These contrast images were used to analyze the main effects of learning stage (“search”/“learned”) within each group using one sample t-tests for younger and older adults separately in a mixed effects model and treating participants as random (p < 0.005 uncorrected). These regressors resulted in the following contrasts: Decision making “learned” vs. “search” and Reward processing “learned” vs. “search”. Note that for the analysis of reward processing we only compared trials in which participants received 40 points either by chance (“search”) vs. as expected outcome (“learned”). Afterwards, a between-groups analysis was performed using a two-sample t-test in order to study age differences (interaction of learning stage × age, p < 0.005, uncorrected). We assigned neuroanatomical labels to coordinates of each contrast map by converting the MNI coordinates to Talairach coordinate space (Talairach and Tournoux, 1988 ) using the Talairach Daemon (Lancaster et al., 2000 ). For a region of interest analysis in right VST and right dlPFC, we functionally defined a sphere with a diameter of 10 mm around each peak voxel in those contrast maps where a significant signal increase was found. GLM beta weights were obtained for each participant. To test whether age-related differences in BOLD response in dlPFC could be explained by age-related differences in other cognitive abilities we conducted an analysis of covariance (ANCOVA). We entered parameter estimates in the dlPFC region modulated by the learning stage × age interaction as dependent variable, scores of other tests assessing executive functions, processing speed, or episodic memory as covariates, and age group as a two-level independent group variable (younger vs. older).


Behavioral Data

Consistent with an earlier behavioral study (Mell et al., 2005 ), older adults as compared to younger adults collected fewer points throughout the entire task (U = 38.5, p < 0.01, Table 3 ), needed more trials to learn the cue-reward association within a block [t(26) = 12.99, p < 0.001], and completed fewer blocks successfully (U = 22.0, p < 0.001). Error analysis during the search phase indicated that there was no statistically significant difference in the number of perseverative errors between the two groups [t(26) = 0.35, p = 0.56]. Older adults committed more random errors as compared to the young participants [t(26) = 13.76, p < 0.001]. After associations had been learned – that is, during “learned” trials – younger and older adults performed equally well [mean points received: young participants 38.45, SD ± 0.23; older participants 38.39, SD ± 0.23; t(26) = 0.66, p = 0.51]. There were no differences in reaction times between the two groups [mean reaction time: young participants 1420.29 ms, SD ± 350.22 ms, older participants 1442.57 ms, SD ± 90.89 ms; t(26) = −0.17, p = 0.89]. No participant showed reaction times above 2100 ms, indicating that all participants were well within the time limit for responding (3500 ms after cue onset).

fMRI Data

Effect of learning on BOLD signal changes during reward processing (“learned” trials vs. “search” trials)

In younger adults, during reward processing in “learned” relative to “search” trials, we found a bilateral BOLD signal increase in the VST (Table 4 ). Direct group comparison (interaction of learning stage × age) confirmed greater recruitment of the right VST in younger as compared to older participants (Figure 2 ; Table 4 ).
Figure 2. Interaction of learning stage and age in VST in reward processing. (A) Increased activity in bilateral VST in reward processing comparing “learned” trials relative to “search” trials in younger adults (x = 8, y = 12, z = −5). In older adults no significant signal changes were observed. (B) Contrast estimates (mean, standard error) of younger and older participants for “search” and “learned” trials in VST.

Effect of learning on BOLD signal changes during decision making (“learned” trials vs. “search” trials)

Both younger and older adults showed greater BOLD signal increases in the dlPFC when associations had been learned (“learned” trials) as compared to trials when associations had not yet been learned (“search” trials, Table 5 ). There was no significant signal increase in striatal regions in either of the two groups. A direct group comparison (interaction of learning stage × age), however, showed a greater signal increase in older adults in the bilateral frontal cortex, including the dlPFC, the cingulate gyrus, and the left parietal cortex (Figure 3 ; Table 5 ).
Figure 3. Decision making – interaction of learning stage and age. (A) Interaction of learning stage × age in the right dlPFC (x = 52, y = 16, z = 28). (B) Contrast estimates (mean, standard error) of “learned” and “search” trials in younger and older participants in the right dlPFC.
In addition, we tested whether age-related differences in the dlPFC BOLD signal in “learned” vs. “search” trials during decision making could be explained by age-related differences in other tests of executive functions (i.e., SOPT, TOL, FAS, RTMT-B, Stroop), processing speed (Digit Letter Test), or episodic memory (Ten-Word-List). An ANCOVA showed that differences in SOPT, Stroop, TOL, FAS and RTMT-B could not explain differences in dlPFC BOLD signal. After correcting for all scores of executive functions separately as well as simultaneously, the effect of age on changes in BOLD signal in dlPFC remained statistically significant (F = 4.98, p < 0.05; Table 6 ). Furthermore, the age effect found in dlPFC remained statistically significant after correcting for measures of processing speed (Digit Letter Test, corrected age effect: F = 11.33, p < 0.005), and episodic memory (Ten-Word-List, corrected age effect: F = 7.45 p < 0.01).


In this study we investigated age-related changes in reward-based decision making and its neural correlates. At the behavioral level, older adults collected fewer points than younger adults, completed fewer blocks successfully, and needed more trials to learn the stimulus–response association. Remarkably, there was no statistically significant difference in the number of perseverative errors between the two groups, i.e., learning was slower in older adults even in the absence of persistent responding to the previously rewarded stimulus. The results suggest that there is no age-related deficit in reversing learned stimulus–response mappings but instead in learning the stimulus–reward associations, which replicates previous findings (Mell et al., 2005 ).
To study the neuronal correlates of reward-based decision making in old age, we applied an event-related design that allowed separation of age-related differences in brain activity during decision making and reward processing. Furthermore, to test the course of learning and to account for performance differences typically found between young and older adults in a pORT, we grouped trials into “search” and “learned” trials depending on a learning criterion in a post hoc analysis.
During reward processing, we found a greater signal increase in the VST in younger participants when reward associations had been learned relative to when they had not yet been learned. As is known from studies in animals and humans, the VST serves as a key structure in reward processing. It responds to predictors (Knutson et al., 2001 ) and the outcome of expected rewards (Breiter et al., 2001 ). Our data confirm the involvement of the VST in reward association learning by signaling an expected outcome under probabilistic conditions in younger adults (e.g., Heekeren et al., 2007 ). In contrast, we did not observe an analogous signal increase in the VST in older adults. The group × learning stage interaction revealed that while younger adults recruited the VST significantly more in those trials when reward associations had been learned, older adults showed the opposite pattern. They recruited the VST in response to a rewarding stimulus when associations were not yet learned, that is, when the participant was rewarded by chance relative to when associations were learned, as seen in the young participants. Note that during “search” trials, the participant is rewarded by chance and shall use the respective feedback information to guide further decision making. Older adults, while showing a greater signal increase in VST after reward delivery compared to the young adults, still needed longer to learn the reward association as illustrated by the behavioral difference, suggesting that an increase in VST activity might not facilitate reward association learning in old age. Our results are compatible with results of other age-comparative fMRI studies suggesting age-related differential recruitment of the VST (Samanez-Larkin et al., 2007 ; Schott et al., 2007 ; Dreher et al., 2008 ). In our study we found no group difference in VST signals during decision making. This is in contrast to a recent study showing specific recruitment of the VST in young as compared to older adults (Dreher et al., 2008 ). Our results agree with one study reporting stronger ventral striatal activity in older participants during gain outcome in a MID task (Schott et al., 2007 ). Note that in contrast to the pORT used in the present study, in the MID task, associations are known prior to the start of the experiment. Therefore, only the state of anticipation and the occurrence of anticipated outcomes were investigated in those studies, but not the process of reward-based learning and decision making. Our data confirm the view of differential VST function in old age and show that the difference in VST activity is dependent on the stage of learning.
During decision making, older adults compared to younger participants recruited dorsolateral prefrontal areas differentially depending on the stage of learning. While younger adults activated the dlPFC during the initial stage of learning reward associations, older adults activated the dlPFC when reward associations had been learned successfully. The dlPFC is thought to be involved in various aspects of executive functions, such as maintenance, updating, and monitoring of working memory contents (Petrides et al., 2002 ) and decision making (Heekeren et al., 2004 , 2008 ). Note that the learning by age interaction found in dlPFC could not be explained by age-related differences found in other cognitive measures such as executive functions, processing speed or episodic memory, suggesting an age-related differential recruitment of dlPFC during decision making. With regard to reward-based decision making, the dlPFC is assumed to determine relevant reward information to plan and execute behavior directed toward rewards (Schultz, 2000 ; Hornak et al., 2004 ; Ichihara-Takeda and Funahashi, 2008 ). To succeed in our task, participants have to consider the previously experienced rewards and punishments elicited by the presented letters; that is, they have to monitor their own performance and use the respective information for decision making. The interaction of learning stage × age found during decision making could reflect the fact that in the initial learning stages, younger adults successfully use the dlPFC to monitor past and current selections as well as their outcomes, which contributes to finding the maximally rewarding stimulus. In contrast, older adults allocate more resources to actively maintain and monitor performance and choice selection at the later stage of task performance when associations have already been learned.
Studies in non-human primates have shown that the rhinal cortex and the OFC play an important role in reward reversal learning (e.g., Lee et al., 2007 ; Watanabe and Sakagami, 2007 ; Phillips et al., 2008 for reviews). It should be noted that we did not observe statistically significant changes in BOLD signal in these regions during decision-making or reward processing in the pORT. Due to susceptibility artifacts BOLD signal changes in the OFC as well as the hippocampal formation of the brain are more difficult to detect (Asano et al., 2004 ; Du et al., 2007 ).
The present results may support the view of alteration in the functional integrity of the dopaminergic system as suggested by neurocomputational models that hypothesize that age-related loss of dopamine increases neural noise, which results in less distinctive representations in the brain (Li et al., 2001 ). Accordingly, a less distinctive representation of behaviorally relevant feedback information in the VST may cause impoverished inputs to extrastriatal areas (for example, the dlPFC), resulting in diminished fronto-striatal interaction for further decision making in old age. This view is supported by a recent study using 6-[(18)F]FluoroDOPA (FDOPA) positron emission tomography (PET) and fMRI showing a significant interaction between midbrain dopamine synthesis and reward-related lateral PFC function in young compared to older adults. Midbrain measures of FDOPA correlated positively with BOLD signals in the lateral PFC during reward processing in young, but negatively in older participants (Dreher et al., 2008 ).
Age-related changes in the serotonergic system, which have been shown using PET (Yamamoto et al., 2002 ; Moller et al., 2007 ), could also contribute to the observed deficit in reward association learning in older adults. Alterations in the serotonergic system have been reported to result in deficits in learning changing reward-associations, reversal learning and in the evaluation of immediate and delayed rewards (Doya, 2008 for a review; Rogers et al., 1999 ; Clarke et al., 2004 ; Tanaka et al., 2007 ). Thus, age-related decline of serotonin receptors and serotonin transporters could also contribute to an altered neuromodulation of cortical and subcortical regions that mediate important aspects of flexible reward association learning in old age (see Mohr et al., 2009 for a review).
In conclusion, the data support the view of altered fronto-striatal interaction during reward-based decision making in old age, which contributes to altered reward-based learning and decision making.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.


The financial support of DFG [Emmy-Noether-Program (He 3347/2-1)], Graduate Program “Neuropsychiatry and Psychology of Aging” (429-2/03, Graduate Program “Clinical Neurosciences”), BMBF (Berlin NeuroImaging Center), and Stifterverband für die Deutsche Wissenschaft (Claussen Simon Stiftung) is gratefully acknowledged.


Asano, S., Mihara, B., Kirino, T., and Sugishita, M. (2004). Anatomical constraints on visualization of the human hippocampus using echo-planar imaging. Neuroradiology 46, 535–540.
Bäckman, L., and Farde, L. (2005). The role of dopamine systems in cognitive aging. In Cognitive Neuroscience of Aging: Linking Cognitive and Cerebral Aging, R. Cabeza, L. Nyberg and D.C. Park, eds (New York, Oxford University Press), pp. 58–84.
Bäckman, L., Nyberg, L., Lindenberger, U., Li, S. C., and Farde, L. (2006). The correlative triad among aging, dopamine, and cognition: current status and future prospects. Neurosci. Biobehav. Rev. 30, 791–807.
Benton, A. L., and Hamsher, K. (1976). Multilingual Aphasia Examination. Iowa City, University of Iowa.
Breiter, H. C., Aharon, I., Kahneman, D., Dale, A., and Shizgal, P. (2001). Functional imaging of neural responses to expectancy and experience of monetary gains and losses. Neuron 30, 619–639.
Burns, R. S., Chiueh, C. C., Markey, S. P., Ebert, M. H., Jacobowitz, D. M., and Kopin, I. J. (1983). A primate model of parkinsonism: selective destruction of dopaminergic neurons in the pars compacta of the substantia nigra by N-methyl-4-phenyl-1,2,3,6-tetrahydropyridine. Proc. Natl. Acad. Sci. U.S.A. 80, 4546–4550.
Clarke, H. F., Dalley, J. W., Crofts, H. S., Robbins, T. W., and Roberts, A. C. (2004). Cognitive inflexibility after prefrontal serotonin depletion. Science 304, 878–880.
Craik, F. I., and Salthouse, T. A. (2000). Handbook of Aging and Cognition, 2nd Edn. Mahwah, NJ, Erlbaum.
Dale, A. M. (1999). Optimal experimental design for event-related fMRI. Hum. Brain Mapp. 8, 109–114.
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., and Fiez, J. A. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. J. Neurophysiol. 84, 3072–3077.
Denburg, N. L., Tranel, D., and Bechara, A. (2005). The ability to decide advantageously declines prematurely in some normal older persons. Neuropsychologia 43, 1099–1106.
Doya, K. (2008). Modulators of decision making. Nat. Neurosci. 11, 410–416.
Dreher, J. C., Meyer-Lindenberg, A., Kohn, P., and Berman, K. F. (2008). Age-related changes in midbrain dopaminergic regulation of the human reward system. Proc. Natl. Acad. Sci. U.S.A. 105, 15106–15111.
Du, Y. P., Dalwani, M., Wylie, K., Claus, E., and Tregellas, J. R. (2007). Reducing susceptibility artifacts in fMRI using volume-selective z-shim compensation. Magn. Reson. Med. 57, 396–404.
Duzel, E., Bunzeck, N., Guitart-Masip, M., Wittmann, B., Schott, B. H., and Tobler, P. N. (2009). Functional imaging of the human dopaminergic midbrain. Trends Neurosci. 32, 321–328.
Elliott, R., Dolan, R. J., and Frith, C. D. (2000). Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. Cereb. Cortex 10, 308–317.
Esposito, G., Kirkby, B. S., Van Horn, J. D., Ellmore, T. M., and Berman, K. F. (1999). Context-dependent, neural system-specific neurophysiological concomitants of ageing: mapping PET correlates during cognitive activation. Brain 122, 963–979.
Fera, F., Weickert, T. W., Goldberg, T. E., Tessitore, A., Hariri, A., Das, S., Lee, S., Zoltick, B., Meeter, M., Myers, C. E., Gluck, M. A., Weinberger, D. R., and Mattay, V. S. (2005). Neural mechanisms underlying probabilistic category learning in normal aging. J. Neurosci. 25, 11340–11348.
Grant, D. A., and Berg, E. A. (1948). A behavioural analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type cardsorting problem. J. Exp. Psychol. 38, 404–411.
Grober, E., Buschke, H., Crystal, H., Bang, S., and Dresner, R. (1988). Screening for dementia by memory testing. Neurology 38, 900.
Heekeren, H. R., Marrett, S., Bandettini, P. A., and Ungerleider, L. G. (2004). A general mechanism for perceptual decision-making in the human brain. Nature 431, 859–862.
Heekeren, H. R., Marrett, S., and Ungerleider, L. G. (2008). The neural systems that mediate human perceptual decision making. Nat. Rev. Neurosci. 9, 467–479.
Heekeren, H. R., Wartenburger, I., Marschner, A., Mell, T., Villringer, A., and Reischies, F. M. (2007). Role of ventral striatum in reward-based decision making. Neuroreport 18, 951–955.
Horn, W. (1983). Leistungsprüfsystem (LPS), 2nd Edn. Göttingen, Hogrefe.
Hornak, J., O’Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., and Polkey, C. E. (2004). Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. J. Cogn. Neurosci. 16, 463–478.
Ichihara-Takeda, S., and Funahashi, S. (2008). Activity of primate orbitofrontal and dorsolateral prefrontal neurons: effect of reward schedule on task-related activity. J. Cogn. Neurosci. 20, 563–579.
Knutson, B., Adams, C. M., Fong, G. W., and Hommer, D. (2001). Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J. Neurosci. 21, RC159.
Lancaster, J. L., Woldorff, M. G., Parsons, L. M., Liotti, M., Freitas, C. S., Rainey, L., Kochunov, P. V., Nickerson, D., Mikiten, S. A., and Fox, P. T. (2000). Automated Talairach atlas labels for functional brain mapping. Hum. Brain Mapp. 10, 120–131.
Lee, D., Rushworth, M. F., Walton, M. E., Watanabe, M., and Sakagami, M. (2007). Functional specialization of the primate frontal cortex during decision making. J. Neurosci. 27, 8170–8173.
Lehrl, S., Triebig, G., and Fischer, B. (1995). Multiple choice vocabulary test MWT as a valid and short test to estimate premorbid intelligence. Acta Neurol. Scand. 91, 335.
Li, S. C., Lindenberger, U., and Sikstrom, S. (2001). Aging cognition: from neuromodulation to representation. Trends Cogn. Sci. 5, 479–486.
Lindenberger, U., Mayr, U., and Kliegl, R. (1993). Speed and intelligence in old age. Psychol. Aging 8, 207–220.
Marschner, A., Mell, T., Wartenburger, I., Villringer, A., Reischies, F. M., and Heekeren, H. R. (2005). Reward-based decision-making and aging. Brain Res. Bull. 67, 382–390.
McClure, S. M., Berns, G. S., and Montague, P. R. (2003). Temporal prediction errors in a passive learning task activate human striatum. Neuron 38, 339–346.
McClure, S. M., York, M. K., and Montague, P. R. (2004). The neural substrates of reward processing in humans: the modern role of FMRI. Neuroscientist 10, 260–268.
Mell, T., Heekeren, H. R., Marschner, A., Wartenburger, I., Villringer, A., and Reischies, F. M. (2005). Effect of aging on stimulus-reward association learning. Neuropsychologia 43, 554–563.
Mohr, P. N., Li, S. C., and Heekeren, H. R. (2009). Neuroeconomics and aging: neuromodulation of economic decision making in old age. Neurosci. Biobehav. Rev. [Epub ahead of print].
Moller, M., Jakobsen, S., and Gjedde, A. (2007). Parametric and regional maps of free serotonin 5HT1A receptor sites in human brain as function of age in healthy humans. Neuropsychopharmacology 32, 1707–1714.
Montague, P. R., Dayan, P., and Sejnowski, T. J. (1996). A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J. Neurosci. 16, 1936–1947.
Montague, P. R., King-Casas, B., and Cohen, J. D. (2006). Imaging valuation models in human choice. Annu. Rev. Neurosci. 29, 417–448.
Nagahama, Y., Fukuyama, H., Yamauchi, H., Katsumi, Y., Magata, Y., Shibasaki, H., and Kimura, J. (1997). Age-related changes in cerebral blood flow activation during a Card Sorting Test. Exp. Brain Res. 114, 571–577.
O’Doherty, J. P., Dayan, P., Friston, K., Critchley, H., and Dolan, R. J. (2003). Temporal difference models and reward-related learning in the human brain. Neuron 38, 329–337.
Pagnoni, G., Zink, C. F., Montague, P. R., and Berns, G. S. (2002). Activity in human ventral striatum locked to errors of reward prediction. Nat. Neurosci. 5, 97–98.
Petrides, M., Alivisatos, B., and Frey, S. (2002). Differential activation of the human orbital, mid-ventrolateral, and mid-dorsolateral prefrontal cortex during the processing of visual stimuli. Proc. Natl. Acad. Sci. U.S.A. 99, 5649–5654.
Petrides, M., and Milner, B. (1982). Deficits on subject-ordered tasks after frontal- and temporal-lobe lesions in man. Neuropsychologia 20, 249–262.
Phillips, A. G., Vacca, G., and Ahn, S. (2008). A top-down perspective on dopamine, motivation and memory. Pharmacol. Biochem. Behav. 90, 236–249.
Raz, N. (2000). Aging of the brain and its impact on cognitive performance: integration of structural and functional findings. In Handbook of Aging and Cognition, F. I. M. Craik and T. A. Salthouse, eds (Mahwah, NJ, Erlbaum), pp. 1–90.
Raz, N., and Rodrigue, K. M. (2006). Differential aging of the brain: patterns, cognitive correlates and modifiers. Neurosci. Biobehav. Rev. 30, 730–748.
Reischies, F. M. (1999). Pattern of disturbance of different ventral frontal functions in organic depression. Ann. N. Y. Acad. Sci. 877, 775–780.
Reischies, F. M., Kühl, K. P., and Krebs, M. (2000). 10 - Wort - Test mit Imaginationshilfe. Z. Gerontopsychol. 9, 30.
Reitan, R. M. (1958). Validity of the trail making test as an indicator of organic brain damage. Percept. Mot. Skills 8, 271–276.
Rhodes, M. G. (2004). Age-related differences in performance on the Wisconsin Card Sorting Test: a meta-analytic review. Psychol. Aging 19, 482–494.
Ridderinkhof, K. R., Span, M. M., and van der Molen, M. W. (2002). Perseverative behavior and adaptive control in older adults: performance monitoring, rule induction, and set shifting. Brain Cogn. 49, 382–401.
Rogers, R. D., Blackshaw, A. J., Middleton, H. C., Matthews, K., Hawtin, K., Crowley, C., Hopwood, A., Wallace, C., Deakin, J. F., Sahakian, B. J., and Robbins, T. W. (1999). Tryptophan depletion impairs stimulus-reward learning while methylphenidate disrupts attentional control in healthy young adults: implications for the monoaminergic basis of impulsive behaviour. Psychopharmacology (Berl.) 146, 482–491.
Samanez-Larkin, G. R., Gibbs, S. E., Khanna, K., Nielsen, L., Carstensen, L. L., and Knutson, B. (2007). Anticipation of monetary gain but not loss in healthy older adults. Nat. Neurosci. 10, 787–791.
Sawaguchi, T., and Goldman-Rakic, P. S. (1991). D1 dopamine receptors in prefrontal cortex: involvement in working memory. Science 251, 947–950.
Schott, B. H., Niehaus, L., Wittmann, B. C., Schutze, H., Seidenbecher, C. I., Heinze, H. J., and Duzel, E. (2007). Ageing and early-stage Parkinson’s disease affect separable neural mechanisms of mesolimbic reward processing. Brain 130, 2412–2424.
Schultz, W. (2000). Multiple reward signals in the brain. Nat. Rev. Neurosci. 1, 199–207.
Schultz, W. (2007). Multiple dopamine functions at different time courses. Annu. Rev. Neurosci. 30, 259–288.
Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593–1599.
Shallice, T. (1982). Specific impairments of planning. Philos. Trans. R. Soc. Lond., B, Biol. Sci. 298, 199–209.
Stroop, J. R. (1935). Studies of interference in serial verbal reactions. J. Exp. Psychol. 18, 643–662.
Talairach, J., and Tournoux, P. (1988). Co-planar Stereotaxic Atlas of the Human Brain: 3-Dimensional Proportional System – An Approach to Cerebral Imaging. New York, Thieme Medical Publishers.
Tanaka, S. C., Schweighofer, N., Asahi, S., Shishida, K., Okamoto, Y., Yamawaki, S., and Doya, K. (2007). Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum. PLoS ONE 2, e1333. doi: 10.1371/journal.pone.0001333s.
Wager, T. D., and Nichols, T. E. (2003). Optimization of experimental design in fMRI: a general framework using a genetic algorithm. Neuroimage 18, 293–309.
Watanabe, M., and Sakagami, M. (2007). Integration of cognitive and motivational context information in the primate prefrontal cortex. Cereb. Cortex 17(Suppl. 1), i101–i109.
Weiler, J. A., Bellebaum, C., and Daum, I. (2008). Aging affects acquisition and reversal of reward-based associative learning. Learn. Mem. 15, 190–197.
Wittmann, B. C., Schott, B. H., Guderian, S., Frey, J. U., Heinze, H. J., and Duzel, E. (2005). Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 45, 459–476.
Yamamoto, M., Suhara, T., Okubo, Y., Ichimiya, T., Sudo, Y., Inoue, M., Takano, A., Yasuno, F., Yoshikawa, K., and Tanada, S. (2002). Age-related decline of serotonin transporters in living human brain of healthy males. Life Sci. 71, 751–757.
aging, fMRI, reward association learning, ventral striatum, decision making, dorsolateral prefrontal cortex
Mell T, Wartenburger I, Marschner A, Villringer A, Reischies FM and Heekeren HR (2009). Altered function of ventral striatum during reward-based decision making in old age. Front. Hum. Neurosci. 3:34. doi: 10.3389/neuro.09.034.2009
24 June 2009;
 Paper pending published:
31 August 2009;
03 October 2009;
 Published online:
30 October 2009.

Edited by:

William J. Jagust, University of California Berkeley, USA

Reviewed by:

Emrah Duzel, University College London, UK
Andreas Heinz, Charité - Universitätsmedizin Berlin, Germany
© 2009 Mell, Wartenburger, Marschner, Villringer, Reischies and Heekeren. This is an open-access article subject to an exclusive license agreement between the authors and the Frontiers Research Foundation, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are credited.
Hauke R. Heekeren, Affective Neuroscience and Psychology of Emotion, Freie Universität Berlin, Habelschwerdter Allee 45, 14195 Berlin, Germany. e-mail: