ORIGINAL RESEARCH article
Sec. Pathological Conditions
Simulating real world functioning in schizophrenia using a naturalistic city environment and single-trial, goal-directed navigation
- 1Institute of Medical Science, University of Toronto, ON, Canada
- 2Centre for Addiction and Mental Health, Campbell Family Mental Health Research Institute, Toronto, ON, Canada
- 3Department of Psychology, Ryerson University, Toronto, ON, Canada
- 4Department of Psychiatry, University of Toronto, ON, Canada
- 5Collaborative Program in Neuroscience, University of Toronto, ON, Canada
- 6Department of Medical Biophysics, University of Toronto, ON, Canada
- 7Program in Neuroscience and Mental Health, The Hospital for Sick Children, Toronto, ON, Canada
- 8Departments of Psychology and Psychiatry, University of Toronto, ON, Canada
- 9Rotman Research Institute at Baycrest, Toronto, ON, Canada
Objective: To develop a virtual reality platform that would serve as a functionally meaningful measure of cognition in schizophrenia and that would also complement standard batteries of cognitive tests during clinical trials for cognitive treatments in schizophrenia, be amenable to human neuroimaging research, yet lend itself to neurobiological comparison with rodent analogs.
Method: Thirty-three patients with schizophrenia and 33 healthy controls matched for age, sex, video gaming experience, and education completed eight rapid, single-trial virtual navigation tasks within a naturalistic virtual city. Four trials tested their ability to find different targets seen during the passive viewing of a closed path that led them around different city blocks. Four subsequent trials tested their ability to return to four different starting points after viewing a path that took them several blocks away from the starting position.
Results: Individuals with schizophrenia had difficulties in way-finding, measured as distance travelled to find targets previously encountered within the virtual city. They were also more likely not to notice the target during passive viewing, less likely to find novel shortcuts to targets, and more likely to become lost and fail completely in finding the target. Total travel distances across all eight trials strongly correlated (negatively) with neurocognitive measures and, for 49 participants who completed the Quality of Life Scale, psychosocial functioning.
Conclusion: Single-trial, goal-directed navigation in a naturalistic virtual environment is a functionally meaningful measure of cognitive functioning in schizophrenia.
Schizophrenia is a chronic mental illness presenting with psychotic symptoms of delusions and hallucinations against a background of neurocognitive impairment, poor motivation, and poor psychosocial functioning (Heinrichs and Zakzanis, 1998; Wong et al., 2003). Cognitive deficits are a significant predictor of functional outcome (Green, 1996; Harvey et al., 1998; Green et al., 2000, 2004), and are current targets for psychopharmacological treatment (Hyman and Fenton, 2003).
A number of neuropsychological tests assess cognitive domains that are particularly impaired in schizophrenia (Nuechterlein et al., 2004). These have been incorporated into a standard battery of cognitive tests for use in clinical trials by the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative (Nuechterlein et al., 2008). In order to provide tools for clinical trial evaluation, the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS) initiative identified additional tests from cognitive neuroscience literature that are sensitive to schizophrenia (Barch et al., 2009). However, the US Food and Drug Administration stipulates a requirement for a functionally meaningful measure of overall outcome in addition to an accepted battery of cognitive tests for clinical trials for cognitive treatments in schizophrenia (Green et al., 2011).
Goal-directed navigation offers a powerful paradigm for studying neural system interactions during complex human behaviors (Spiers and Maguire, 2006). Rodent models have detailed the neurobiology of various cognitive processes including perception, motivation, planning, and decision making at molecular, cellular, and systems level analysis (Burgess, 2008; Moser et al., 2008; Penner and Mizumori, 2012). The neurotransmitter dopamine, an important target in schizophrenia research (Laruelle and Abi-Dargham, 1999), plays a dominant role in the modulation of the neuroanatomical structures and networks engaged in rodent navigation (Penner and Mizumori, 2012).
Several core brain regions involved in successful goal-directed navigation in humans (Aguirre et al., 1996; Wolbers et al., 2004; Wolbers and Hegarty, 2010) including the hippocampus, prefrontal cortex and striatum (Maguire et al., 1998; Astur et al., 2002; Driscoll et al., 2003; Ekstrom et al., 2003; Hartley et al., 2003; Iaria et al., 2003; Bohbot et al., 2004; Voermans et al., 2004; Spiers and Maguire, 2006; Doeller et al., 2008; Brown et al., 2012), are also strongly implicated in the pathophysiology of schizophrenia (Weinberger et al., 1986; Goldberg et al., 1987; Weinberger, 1987; Bogerts et al., 1990; Csernansky et al., 1999; Laruelle and Abi-Dargham, 1999). Optimum navigation is associated with the ability to flexibly switch between hippocampal and striatal networks (Hartley et al., 2003; Iaria et al., 2003; Etchamendy and Bohbot, 2007) and to integrate wayfinding networks with prefrontal cortex working memory (Wolbers et al., 2007; Hanlon et al., 2012) and executive functions (Maguire et al., 1998; Hartley et al., 2003). The virtual reality (VR) navigation paradigms used for schizophrenia research, by focusing on specific neural structures or cognitive domains, have tended to be based on rodent models or necessarily circumscribed environments within a paradigm of trial and error learning or extensive exploratory activity prior to testing to ensure familiarity with landmark locations (Astur et al., 2004; Hanlon et al., 2006, 2012; Weniger and Irle, 2008; Folley et al., 2010; Spieker et al., 2012).
We sought to extend this work by designing a more realistic human VR task that would assess goal-directed navigation in a naturalistic city environment. In addition, rather than using a multiple-trial incremental learning paradigm, we developed a single-trial paradigm more analogous to daily events such as going to a shopping mall and trying to find the shop you spotted on your way to the drug store or trying to find your way back to your parked car. Here we report on the results of the behavioral testing of performance by patients with schizophrenia using a single-trial navigation paradigm in a naturalistic virtual city.
Materials and Methods
All experiments were conducted with the approval of our institutional research ethics board. Informed consent was obtained from all participants. Diagnosis was based on the Mini International Neuropsychiatric Inventory (MINI) (Sheehan et al., 1998) which enables diagnosis based on DSM-IV. Thirty-three outpatients diagnosed with schizophrenia (n = 22) or schizoaffective disorder (n = 11) and on stable doses of antipsychotics for the preceding 4 weeks took part in this study. All patients were chronically ill with durations of illness ranging from 2 to 39 years (M = 15, median = 11.5). Thirty-three healthy controls were individually matched with patients for age, sex (total 42 male, 24 female), and experience with first person action computer games. As a group, patients, and controls were also matched in education (Table 1).
Table 1. Patients with schizophrenia were individually matched with healthy controls for age (within 4 years), sex, and video gaming experience (within 1 level of difference).
Patients were recruited from the Center for Addiction and Mental Health, Toronto, Canada. Healthy controls were recruited by advertisements within the local community. Exclusion criteria for healthy controls were—no personal or family history of psychiatric dysfunction; for patients—no other DSM-IV Axis I disorder. Inclusion/exclusion criteria for both groups were: (1) 18–55 years of age; (2) no history of substance abuse in the past 3 months; (3) no history of neurological disease or loss of consciousness longer than 15 min; (4) a Wechsler Adult Intelligence Scale-III (WAIS-III) (Wechsler, 1997) prorated full scale IQ score greater than 75; and, (5) fluency in English.
Clinical and Neuropsychological Assessment
Current positive and negative symptoms were assessed by using the Scales for the Assessment of Positive Symptoms (SAPS) and Negative Symptoms (SANS) (Andreasen, 1983, 1984). General intellectual ability was assessed using four subscales (vocabulary, similarities, block design, and matrix reasoning) of the WAIS-III (Wechsler, 1997), prorated to obtain estimated full scale IQ scores (Schrimsher et al., 2008). Participants also completed the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS; Randolph, 1998). Education level was classified along five categories: “less-than-high-school,” “some high school,” “completed high school,” “some post-secondary,” and, “completed-post- secondary.” Forty-nine of the participants in this study (twenty-five with schizophrenia and twenty-four healthy controls) participated in a concurrent study that used the Quality of Life Scale (Heinrichs et al., 1984) to evaluate current psychosocial status. Those results were incorporated into this study. Clinical evaluations were completed during one session, typically 1–2 weeks prior to a single session of cognitive, and navigation trials.
Virtual Reality Environment
The VR environment consisted of a 6 x 6 block cityscape with a central park and over 80 residential, commercial, institutional, and office buildings. Embedded within the city were various “targets” such as a playground and hospital (Figures 1, 2). The environment included distal cues to aid in orienting such as a mountain range along one boundary, a hot air balloon, and a tall radio tower. Participants used a video game controller with simple forward/reverse and left/right levers to navigate. A 5 min practice session of free navigation before the beginning of trials, restricted to an area of the virtual city not used during subsequent trials, ensured familiarity with controller operations.
Figure 1. Virtual city. (A) Screen shot of the VR software operator showing an aerial map view of the virtual city and a 3-D isometric projection of the 6 × 6 block city. (B) Detailed aerial view showing the location of a few landmarks. These views were not seen by the participants.
A total of eight different navigation trials were carried out, each within different areas of the VR city. Each trial commenced with passive viewing of a pre-recorded path taken along several blocks of the virtual city, followed by a single attempt by the participant to locate a target shown during the passive viewing portion of the trial. The first four trials assessed participant ability to find a target seen during the passive viewing of a closed path that led them in a loop around one or more city blocks (“closed-loop” trials, Figure 3). The second four trials assessed participant ability to return to a starting point after viewing a path that took them a few blocks away from the starting position (“return-path” trials, Figure 3). All trials were presented in the same fixed random order to all participants.
Figure 3. Prerecorded paths viewed by participants during the passive viewing of each trial. Shown is the aerial view of each path. During eye-level passive viewing the paths shown in yellow (four closed loop paths numbered according to order of presentation) and red (four return paths, similarly ordered) were followed by the participant starting at the open circle. For the closed loop trials the star represents the target and the small arrow pointing to the target indicates the position along the path where path movement temporarily halted and attention was directed toward the target for 2–3 s before proceeding to the end of the path. For the return path trials the star represents the target focused on at the start of the trial and the small arrow at the end of the path the direction of view at the end of the prerecorded path. At the end of the passive viewing portion of each trial the participant was asked to locate the target using the shortest route they could think of, beginning where the passive viewing portion ended. 8a represents the passive viewing portion of trial 8, ending at a position affording a view of the overhead balloon (B) and radio tower (R); 8b represents the starting position, facing the overhead balloon, for the subsequent attempt, during trial 8, by the participant to return to the starting position at 8a. M, mountain range.
For all trials, participants were instructed to take the shortest route possible to find the targets. Participants were asked to confirm that they had noticed the target immediately after passive viewing in each of the trials. Targets were typically focused on for 2–3 s during path viewing. Those who failed to see the target were allowed to view the pre-recorded path a second time. For those who failed to find the target, distances travelled were measured as total distances travelled until the participant admitted being lost and gave up further searching.
Each of the navigation trials took approximately 2–5 min to complete. Completion of all 8 trials ranged from a low of 15 min to a high of 60 min with an overall average of 30 min for patients and 22 min for controls.
Hardware and Software
The VR environment was rendered and presented on the testing computer to participants using an advanced graphics workstation and a 30′ widescreen LCD display. A separate computer, connected via a local area network to the testing computer, controlled task settings for each trial. The scene assets for the 3D virtual city were created in Maya and Adobe Photoshop. The simulation was rendered using Ogre, an open source 3D graphics engine. Data on distance travelled, time on task, and path directions travelled were stored automatically throughout the trials, and a video recording of the path followed by participants was made during each trial.
Success at finding targets or returning to original starting positions was measured as the distance travelled to find the target or return to origin. Non-parametric statistics were used because all trials showed non-normal distributions in total distances travelled, with Shapiro-Wilk statistics typically significant at p < 0.01. The two matched samples were compared using the Wilcoxon Signed-ranks test (SRT) which yields a Z-statistic. Corresponding effect sizes were calculated as the SRT Z-value divided by the square root of sample size. Correlation analysis (Spearman's rho) was used to assess the relationships between distances travelled across all eight trials and scores on clinical (SAPS/SANS), cognitive (WAIS-III and RBANS), and psychosocial functioning (Quality of Life) measures. A logistic regression was undertaken to determine the role played by VR performance (distance travelled) in predicting group membership as compared to cognitive testing (RBANS total score, prorated WAIS-III full scale IQ), and psychosocial functioning (total score on the Quality of Life Scale). Pearson's r was used to assess relationships between normally distributed cognitive and clinical symptom scores. Correlations between task performance (distance travelled) and cognitive tests (RBANS, pro-rated WAIS-III full scale IQ) as well as the Quality of Life Scale scores were conducted on all subjects. Regression analysis of task performance with cognitive and psychosocial tests similarly represents all subjects. Correlations with clinical tests (SAPS/SANS) were conducted only on patients. Results were evaluated at an alpha-level of 0.05. SPSS v13.0 was used for the statistical analysis.
In order to compare performances across trials, distances travelled were standardized by conversion to z-scores (Figure 4). A Friedman test of the four closed-loop trials indicated that there were no significant differences in difficulty between the trials for either schizophrenia [χ2(3) = 0.82, p = 0.85] or control subjects [χ2(3) = 3.22, p = 0.37]. Similarly, a Friedman test of the four return-path trials showed no significant differences in difficulty for either schizophrenia [χ2(3) = 2.56, p = 0.47] or healthy participants [χ2(3) = 7.01, p = 0.07]. Distances across each of the four trials were therefore added together for a composite distance travelled score for the closed-loop and return-path trials. Across the four closed-loop trials, patients travelled significantly further (median = 9564) than their matched healthy controls (median = 5467), Z = −4.05, p < 0.001, r = 0.50 (Table 2). Across the four return-path trials the patient group again travelled significantly further (median = 19,214) than controls (median = 12,579), Z = −3.58, p < 0.001, r = 0.44 (Table 2). Figure 5 illustrates, using one of the closed loop trials, differences between the two groups' path trajectories based on the representative median for each group.
Figure 4. Individuals with schizophrenia travelled further to find targets in a virtual city than healthy controls. Shown are the standardized distances (z-scores) travelled across each of eight trials. Group means and standard errors are illustrated. Trials 1–4 = closed loop trials; trials 5–8 = return path trials. Asterisks represent between-group comparisons; *p ≤ 0.05; **p < 0.01.
Table 2. A comparison of mean differences between patient and control groups illustrates the ability of goal-directed navigation to obtain results similar to that of standard neurocognitive measures.
Figure 5. Individuals with schizophrenia used longer routes to find targets than healthy controls. Shown are the median distances travelled and their respective routes by patients and healthy controls for closed loop trial #2. The target, identified by the yellow star, is a fire hall. The yellow circle marks the trial start position. Participants unable to recognize a shortcut route typically attempted to retrace the forward path seen during passive viewing or attempted a reverse path to the target. Errors typically occurred when individuals failed to turn at the proper intersection.
The time parameter had similar results. Across the four closed-loop trials, patients took significantly longer in their attempts to find their targets (median = 8.3 min., range = 2.6–20.4 min.) than their matched healthy controls (median = 4.4 min., range = 1.9–14.5 min.), Z = −3.92, p < 0.001, r = 0.48. Across the four return-path trials the patient group again took significantly longer (median = 13.2 min, range = 5.0–38.0 min.) than controls (median = 8.5 min., range = 4.0–22.0 min.), Z = −3.23, p < 0.001, r = 0.40.
Twenty-three of the pre-recorded portions of the trials were repeated a second time because thirteen individuals with schizophrenia and three healthy controls reported failure to notice targets during passive viewing—a statistically significant difference between groups, χ2(1, n = 66) = 8.25, p = 0.004, phi = −0.35. Twenty-nine individuals with schizophrenia were unable to find at least one of the eight targets (median = 2, range = 0–6) compared to twenty healthy controls (median = 1, range = 0–4); a statistically significant difference as measured by a Wilcoxon SRT, Z = −4.21, p < 0.001, r = −0.52. Healthy controls were more likely to use shortcuts during wayfinding to locate targets than individuals with schizophrenia. Thirty healthy controls were able to find the shortcut for at least one of the trials (median = 3 trials) compared to twenty-two individuals with schizophrenia (median = 1 trial), a statistically significant difference as measured by a Wilcoxon SRT, Z = −3.82, p < 0.001, r = −0.47.
Although patients diagnosed with schizoaffective disorder travelled numerically shorter distances to find targets (median = 15,875, range = 8,490–27,409) than patients diagnosed with schizophrenia (median = 21,492, range = 13,523–51,901) the differences, measured by Mann Whitney U, were not statistically significant, Z = −1.53, p = 0.13. Similarly, there were no significant differences in the number of targets not found, the number of shortcuts used and the number of prerecorded portions of trials that had to be repeated because of failure to notice targets during passive viewing.
Total target-finding distances across all eight trials were significantly and negatively correlated with RBANS total score (rho = −0.48, p < 0.001) and the WAIS III pro-rated full scale IQ (rho = −0.40, p < 0.001). Moreover, the differences in standardized z-scores between individuals with schizophrenia and controls in our goal-directed navigation task were as robust as RBANS total scores and almost double that of estimated full scale IQ (Table 2). However, as shown in Table 2, there was some variation across individual indices, with RBANS z-scores for group differences ranging from 0.53 (language) to 0.95 (visualspatial/construction) and WAIS-III performance deficits more than double the effect-size for verbal. These results highlight the importance of assessing visual-spatial abilities in schizophrenia and that our task is at least as sensitive to detecting cognitive deficits as the standardized batteries.
Spearman correlations of distances travelled by individuals with schizophrenia to find targets and clinical symptoms, as measured by SAPS/SANS were non-significant: SAPS (rho =−0.17); SANS (rho =−0.01). Correlations between clinical symptoms and cognitive scores were weak for SAPS (RBANS, r = 0.10; WAIS FSIQ, r = 0.004) to moderate for SANS (RBANS, r = −0.26; WAIS FSIQ, r = −0.31). Spearman correlations of distances travelled by individuals with schizophrenia to find targets and antipsychotic medications, computed as chlorpromazine equivalents, were non-significant, rho = −0.06. For the 49 individuals in this study that also completed the Quality of Life scale (25 with schizophrenia, 24 healthy controls), distances travelled across all eight trials correlated negatively with total score results (rho = −0.37, p = 0.009); i.e., longer travel distances correlated with lower psychosocial functioning. The correlation between distances travelled and psychosocial function was largely, but not completely, reflective of group differences.
A logistic regression analysis was conducted to predict group membership (schizophrenia or healthy control) using distance travelled, RBANS total score, pro-rated WAIS full scale IQ, and Quality of Life total score as predictors. A test of the full model against a constant only model was statistically significant, indicating that the predictors as a set reliably distinguished between individuals with schizophrenia and healthy controls (chi square = 40.49, p < 0.001). Nagelkerke's R2 of 0.750 indicated a moderately strong relationship between prediction and grouping. Prediction success overall was 83.7% (84% for schizophrenia, 83.3% for healthy controls). The Wald criterion demonstrated that only Quality of Life (Wald = 8.45) and distance travelled (Wald = 6.67) made significant contribution to prediction (p = 0.004, p = 0.01, respectively). Neither pro-rated WAIS full scale IQ (Wald = 1.24) nor RBANS (Wald = 2.72) made significant contributions (p = 0.23, p = 0.1., respectively). Running the model using only Quality of Life and distance travelled as predictors provided an overall prediction success rate of 81.6% (80% for schizophrenia and 83.3% for healthy controls).
The present study investigated the ability of people with schizophrenia to return to a starting position or accurately find a target within a naturalistic virtual cityscape after a single exposure to the target while passively viewing a path taken within the virtual environment. Individuals with schizophrenia had significantly more difficulty than healthy controls matched for age, sex, gaming experience, and education during these rapid, single-trial navigation tasks. Patients travelled significantly further than controls, were less likely to find novel shortcuts to targets, and were more likely to fail in finding the target. Although patients were also more likely to fail to notice the target during passive viewing, the above difficulties persisted even after the passive viewing segments of the trials were repeated to ensure participants saw the relevant target.
Both types of trials posed equal levels of difficulty for individuals with schizophrenia compared to healthy controls and were as effective as RBANS and WAIS III prorated full scale IQ in separating patient from control performance (Table 2). Navigation distance on our task also significantly correlated (negatively) with RBANS total score and the WAIS III pro-rated full scale IQ. We also found that navigation performance across trials was significantly inversely correlated with psychosocial functioning. Logistic regression demonstrated that of the three cognitive variables—distance travelled, RBANS and pro-rated WAIS full scale IQ, only distance travelled made a significant contribution to predicting group membership in a model that included Quality of Life self reports. The combination of Quality of Life self reports and distances travelled demonstrated an overall prediction of group membership success rate of 81.6%. Green and colleagues, in their study of meaningful measures of functioning for use in clinical trials (Green et al., 2011) considered both performance-based and interview-based measures as potential coprimary measures. These results would suggest that a combination of the two might be the more effective strategy.
With respect to clinical symptoms, SANS scores were moderately and SAPS scores weakly correlated with cognitive performance, while correlations between distance travelled and clinical symptoms were non-significant. Schizophrenia symptom correlations with cognitive performance have tended to be inconsistent, but generally minimal for positive symptoms and modest for negative or disorganized symptoms (Gold, 2004; Keefe et al., 2006). The relative independence of cognitive impairment from psychotic symptoms, combined with the presence of cognitive problems before symptom onset (David et al., 1997; Cornblatt et al., 1999; Reichenberg et al., 2002; Niendam et al., 2003; Khandaker et al., 2011; Dickson et al., 2012) and strong relationship to functional outcome (Green, 1996; Harvey et al., 1998; Green et al., 2000, 2004), support the recent focus on cognitive impairment as a unique target for treatment (Hyman and Fenton, 2003).
However, cognitive deficits in schizophrenia are broad and display significant heterogeneity (Joyce and Roiser, 2007). Various factor analytic studies have demonstrated a high level of interrelatedness for domains found to be impaired in schizophrenia (Gladsjo et al., 2004; Dickinson et al., 2006; Keefe et al., 2006; Dickinson and Harvey, 2009). These observations are consistent with the argument that schizophrenia may be a neurodevelopmental disorder (Weinberger, 1987; Seidman, 1990; Lewis and Levitt, 2002) characterized by disturbed functional connectivity (Weinberger et al., 1992; Friston and Frith, 1995; Bullmore et al., 1997; Friston, 1999; Meyer-Lindenberg et al., 2001; Stephan et al., 2006, 2009; Garrity et al., 2007; Liu et al., 2008; Ellison-Wright and Bullmore, 2009; Rotarska-Jagiela et al., 2010). While separate tests for different cognitive domains have shown to be effective for identifying localized dysfunctional areas in the brain, they may not be adequate for understanding functional coordination difficulties. Indeed, the growing use of neuroimaging methodologies such as functional magnetic resonance imaging has led to an increased awareness and emphasis on neural circuits or systems implicated in schizophrenia rather than traditional neuropsychological taxonomies (Minzenberg and Carter, 2012; Gold and Dickinson, 2013).
To the best of our knowledge, all the virtual navigation studies in schizophrenia have used a necessarily constrained paradigm of place learning using rodent models such as the Morris water maze (Morris et al., 1982; Astur et al., 2004; Hanlon et al., 2006, 2012; Folley et al., 2010) and radial arm maze (Olton and Samuelson, 1976; Spieker et al., 2012) or circumscribed environments such as a virtual park (Weniger and Irle, 2008) and virtual town (Ledoux et al., 2013). These were designed to test specific neural structures, principally the hippocampus, and/or specific cognitive domains, such as allocentric memory (Weniger and Irle, 2008; Folley et al., 2010), working and reference memory (Spieker et al., 2012), working and relational memory (Hanlon et al., 2012), and episodic memory (Ledoux et al., 2013). These studies were typically based on a multiple-trial learning paradigm where performance is measured across repetitive trial and error attempts to find one or more game-like rewards, or required extensive exploratory navigation prior to testing to ensure familiarity with all the landmarks subsequently used as targets.
When combined with brain imaging these simplified navigation environments are capable of uncovering dysfunctional circuitry associated with other neural structures and networks in schizophrenia. For example, Astur et al. (2004), in addition to finding reduced hippocampal activation in schizophrenia, also found altered cingulate, insular, and prefrontal cortex activations during virtual navigation. Folley et al. (2010) found anomalous patterns in four widely distributed neural circuits. Hanlon et al. (2012) found lower frontotemporal anatomical connectivity using diffusion tensor imaging. Hanlon et al. (2012) also found that longer path lengths to find the submerged platform in the Morris water maze predicted lower everyday functioning as measured by the UCSD Performance-Based Skills Assessment (UPSA; Patterson et al., 2001). However, the Morris water maze or radial arm maze might not be considered functionally meaningful tests of overall outcome for human clinical trial testing. In addition, Folley et al. (2010), using the virtual Morris water maze, found that impaired performance for both the hidden and exposed platforms was associated with negative symptom severity, suggesting possible motivation difficulties by patients using their paradigm based on a rodent task.
Although not a study of schizophrenia, Spiers and Maguire (2006), using a very realistic model of downtown London (UK) and a single-trial challenge, were able to demonstrate that human goal-directed navigation is not simply a hippocampal place learning phenomenon but rather, a “complex choreography of neural dynamics.” Their model, however, required extensive previous driving experience within this particular city environment.
Our study builds upon these prior findings in presenting a paradigm based on a single-trial attempt at finding typical urban facilities previously seen and located within different areas of a novel realistic virtual city. Each of the four closed-loop trials could be viewed as somewhat similar to trying to find the shortcut to the recreational facility spotted while a passenger during a round trip shopping excursion. Each of the return-path trials were somewhat similar to finding the shortest way back home after being driven to a doctor's appointment. The trial designs of this study have been shown to be as effective as the navigation paradigms used to-date in schizophrenia research in identifying poor functional performance by individuals with schizophrenia and have demonstrated significant correlations with neuropsychological testing and functional outcome. In addition they represent a meaningful test of every day functioning and were judged by most participants as engaging and challenging. The lack of correlation between distance travelled and SANS scores are consistent with these self-reports, and that, unlike the Folley et al. (2010) results based on the virtual Morris water maze, decreased motivation to perform was not apparent during our more naturalistic virtual environment. It should be noted, however, that Hanlon et al. (2012), also using the virtual Morris water maze, found no evidence of amotivation in their results.
The results of these trials support the use of single-trial goal-directed navigation in a naturalistic virtual environment as a measure of cognitive functioning with specific, real life consequences (e.g., getting lost). Future applications will verify successful replication of the task findings, including among subsamples other than the high-functioning patients used here, and more directly explore both specific and global neurocognitive mechanisms accounting for impaired performance among patients. For clinical trial use, the four closed loop trials would appear to be adequate in assessing cognitive functioning, thereby reducing overall trial durations to an average of 15 min plus 5 min for practice and explanation of procedure. In addition, the amenability of this tool in neuroimaging studies in humans and cross referencing results with those of rodent studies will aid in uncovering the aetiology and pathophysiology of schizophrenia.
Albert H. C. Wong and Todd A. Girard designed the study and wrote the original protocol. John A. Zawadzki and Jason P. Lerch refined the protocol. John A. Zawadzki and Alicia Rodrigues recruited the participants, obtained the informed consents, performed the behavioral testing and collected the data. Ishraq Siddiqui completed various VR software refinements. John A. Zawadzki processed the data and undertook the statistical analysis. Todd A. Girard, George Foussias and Cheryl Grady contributed to data interpretation. John A. Zawadzki wrote the first draft of the manuscript. Albert H. C. Wong supervised the study. All authors discussed the results and contributed to the final version of the paper and have approved its final version.
Conflict of Interest Statement
Gary Remington has sat on advisory boards for Roche, Neurocrine, and Synchroneuron, received speaker's fees from Novartis and research support from Neurocrine as well as Medicure. All other authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The authors would like to thank the two reviewers whose helpful comments served to improve the quality of the final manuscript. We would also like to thank Sathasan Thavabalasingam, Nasteho Hasan, and Krysta McDonald for their assistance with data collection on this study and Ed Sykes, Bob Jones, Song Ahn, Ian Howatson, Jonathan Eger, and Damian Domagala of the Visualization Design Institute (VDI) of the Sheridan Institute of Technology and Advanced Learning and Darian Segura for their work in developing the VR application. John A. Zawadzki was supported by an Ontario Graduate Scholarship, Ontario Ministry of Training, Colleges and Universities and a Fellowship from the Institute of Medical Sciences, University of Toronto. Albert H. C. Wong was supported by a CIHR Clinician-Scientist Fellowship, a NARSAD Independent Investigator award and an OMHF Mid-career Investigator Fellowship. We would like to thank the Ministry of Health and Long-Term Care (MOHLTC) for supporting this research through the Academic Health Science Center AFP Innovation Fund. This research was also supported by the Canadian Foundation for Innovation (#16014 and #20289), the Ontario Ministry of Research and Innovation, the CAMH Foundation, the Schizophrenia Society of Ontario (Gary Remington and George Foussias) and a CIHR Clinician-Scientist Training Award (George Foussias).
Astur, R. S., St Germain, S., Mathalon, D. H., D'Souza, D. C., Krystal, J. K., Constable, R. T., et al. (2004). Using virtual reality to investigate functioning of the hippocampus in schizophrenia. Cyberpsychol. Behav. 7, 269–269.
Astur, R. S., Taylor, L. B., Mamelak, A. N., Philpott, L., and Sutherland, R. J. (2002). Humans with hippocampus damage display severe spatial memory impairments in a virtual Morris water task. Behav. Brain Res. 132, 77–84. doi: 10.1016/S0166-4328(01)00399-0
Barch, D. M., Carter, C. S., Arnsten, A., Buchanan, R. W., Cohen, J. D., Geyer, M., et al. (2009). Selecting paradigms from cognitive neuroscience for translation into use in clinical trials: proceedings of the third CNTRICS meeting. Schizophr. Bull. 35, 109–114. doi: 10.1093/schbul/sbn163
Bogerts, B., Ashtari, M., Degreef, G., Alvir, J. M. J., Bilder, R. M., and Lieberman, J. A. (1990). Reduced temporal limbic structure volumes on magnetic-resonance images in 1st episode schizophrenia. Psychiatry Res. 35, 1–13. doi: 10.1016/0925-4927(90)90004-P
Bohbot, V. D., Iaria, G., and Petrides, M. (2004). Hippocampal function and spatial memory: evidence from functional neuroimaging in healthy participants and performance of patients with medial temporal lobe resections. Neuropsychology 18, 418–425. doi: 10.1037/0894-418.104.22.1688
Brown, T. I., Ross, R. S., Tobyne, S. M., and Stern, C. E. (2012). Cooperative interactions between hippocampal and striatal systems support flexible navigation. Neuroimage 60, 1316–1330. doi: 10.1016/j.neuroimage.2012.01.046
Bullmore, E. T., Frangou, S., and Murray, R. M. (1997). The dysplastic net hypothesis: an integration of developmental and dysconnectivity theories of schizophrenia. Schizophr. Res. 28, 143–156. doi: 10.1016/S0920-9964(97)00114-X
Cornblatt, B., Obuchowski, M., Roberts, S., Pollack, S., and Erlenmeyer-Kimling, L. (1999). Cognitive and behavioral precursors of schizophrenia. Dev. Psychopathol. 11, 487–508. doi: 10.1017/S0954579499002175
Csernansky, J. G., Wang, L., Joshi, S., Gado, M., Kido, D., Morris, J. C., et al. (1999). Hippocampal shape deformities specific to schizophrenia suggest a disturbance of hippocampal-prefrontal connections. Schizophr. Res. 36, 193–194.
Dickinson, D., and Harvey, P. D. (2009). Systemic hypotheses for generalized cognitive deficits in schizophrenia: a new take on an old problem. Schizophr. Bull. 35, 403–414. doi: 10.1093/schbul/sbn097
Dickinson, D., Ragland, J. D., Calkins, M. E., Gold, J. M., and Gur, R. C. (2006). A comparison of cognitive structure in schizophrenia patients and healthy controls using confirmatory factor analysis. Schizophr. Res. 85, 20–29. doi: 10.1016/j.schres.2006.03.003
Dickson, H., Laurens, K. R., Cullen, A. E., and Hodgins, S. (2012). Meta-analyses of cognitive and motor function in youth aged 16 years and younger who subsequently develop schizophrenia. Psychol. Med. 42, 743–755. doi: 10.1017/S0033291711001693
Doeller, C. F., King, J. A., and Burgess, N. (2008). Parallel striatal and hippocampal systems for landmarks and boundaries in spatial memory. Proc. Natl. Acad. Sci. U.S.A. 105, 5915–5920. doi: 10.1073/pnas.0801489105
Driscoll, I., Hamilton, D. A., Petropoulos, H., Yeo, R. A., Brooks, W. M., Baumgartner, R. N., et al. (2003). The aging hippocampus: cognitive, biochemical and structural findings. Cereb. Cortex 13, 1344–1351. doi: 10.1093/cercor/bhg081
Ekstrom, A. D., Kahana, M. J., Caplan, J. B., Fields, T. A., Isham, E. A., Newman, E. L., et al. (2003). Cellular networks underlying human spatial navigation. Nature 425, 184–187. doi: 10.1038/nature01964
Folley, B. S., Astur, R., Jagannathan, K., Calhoun, V. D., and Pearlson, G. D. (2010). Anomalous neural circuit function in schizophrenia during a virtual Morris water task. Neuroimage 49, 3373–3384. doi: 10.1016/j.neuroimage.2009.11.034
Garrity, A. G., Pearlson, G. D., McKiernan, K., Lloyd, D., Kiehl, K. A., and Calhoun, V. D. (2007). Aberrant “default mode” functional connectivity in schizophrenia. Am. J. Psychiatry 164, 450–457. doi: 10.1176/appi.ajp.164.3.450
Gladsjo, J. A., McAdams, L. A., Palmer, B. W., Moore, D. J., Jeste, D. V., and Heaton, R. K. (2004). A six-factor model of cognition in schizophrenia and related psychotic disorders: relationships with clinical symptoms and functional capacity. Schizophr. Bull. 30, 739–754. doi: 10.1093/oxfordjournals.schbul.a007127
Goldberg, T. E., Weinberger, D. R., Berman, K. F., Pliskin, N. H., and Podd, M. H. (1987). Further evidence for dementia of the prefrontal type in schizophrenia—A controlled-study of teaching the Wisconsin Card Sorting Test. Arch. Gen. Psychiatry 44, 1008–1014. doi: 10.1001/archpsyc.1987.01800230088014
Green, M. F., Kern, R. S., Braff, D. L., and Mintz, J. (2000). Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the “right stuff”? Schizophr. Bull. 26, 119–136. doi: 10.1093/oxfordjournals.schbul.a033430
Green, M. F., Kern, R. S., and Heaton, R. K. (2004). Longitudinal studies of cognition and functional outcome in schizophrenia: implications for MATRICS. Schizophr. Res. 72, 41–51. doi: 10.1016/j.schres.2004.09.009
Green, M. F., Schooler, N. R., Kern, R. S., Frese, F. J., Granberry, W., Harvey, P. D., et al. (2011). Evaluation of functionally meaningful measures for clinical trials of cognition enhancement in schizophrenia. Am. J. Psychiatry 168, 400–407. doi: 10.1176/appi.ajp.2010.10030414
Hanlon, F. M., Houck, J. M., Klimaj, S. D., Caprihan, A., Mayer, A. R., Weisend, M. P., et al. (2012). Frontotemporal anatomical connectivity and working-relational memory performance predict everyday functioning in schizophrenia. Psychophysiology 49, 1340–1352. doi: 10.1111/j.1469-8986.2012.01448.x
Hanlon, F. M., Weisend, M. P., Hamilton, D. A., Jones, A. P., Thoma, R. J., Huang, M. X., et al. (2006). Impairment on the hippocampal-dependent virtual Morris water task in schizophrenia. Schizophr. Res. 87, 67–80. doi: 10.1016/j.schres.2006.05.021
Hartley, T., Maguire, E. A., Spiers, H. J., and Burgess, N. (2003). The well-worn route and the path less traveled: distinct neural bases of route following and wayfinding in humans. Neuron 37, 877–888. doi: 10.1016/S0896-6273(03)00095-3
Harvey, P. D., Howanitz, E., Parrella, M., White, L., Davidson, M., Mohs, R. C., et al. (1998). Symptoms, cognitive functioning, and adaptive skills in geriatric patients with lifelong schizophrenia: a comparison across treatment sites. Am. J. Psychiatry 155, 1080–1086.
Heinrichs, D. W., Hanlon, T. E., and Carpenter, W. T. (1984). The quality of life scale—an instrument for rating the schizophrenic deficit syndrome. Schizophr. Bull. 10, 388–398. doi: 10.1093/schbul/10.3.388
Iaria, G., Petrides, M., Dagher, A., Pike, B., and Bohbot, V. D. (2003). Cognitive strategies dependent on the hippocampus and caudate nucleus in human navigation: variability and change with practice. J. Neurosci. 23, 5945–5952.
Keefe, R. S., Bilder, R. M., Harvey, P. D., Davis, S. M., Palmer, B. W., Gold, J. M., et al. (2006). Baseline neurocognitive deficits in the CATIE schizophrenia trial. Neuropsychopharmacology 31, 2033–2046. doi: 10.1038/sj.npp.1301072
Khandaker, G. M., Barnett, J. H., White, I. R., and Jones, P. B. (2011). A quantitative meta-analysis of population-based studies of premorbid intelligence and schizophrenia. Schizophr. Res. 132, 220–227. doi: 10.1016/j.schres.2011.06.017
Ledoux, A.-A., Lynne Phillips, J., Labelle, A., Smith, A., Deborah Bohbot, V., and Boyer, P. (2013). Decreased fMRI activity in the hippocampus of patients with schizophrenia compared to healthy control participants, tested on a wayfinding task in a virtual town. Psychiatry Res. 211, 47–56. doi: 10.1016/j.pscychresns.2012.10.005
Maguire, E. A., Burgess, N., Donnett, J. G., Frackowiak, R. S., Frith, C. D., and O'Keefe, J. (1998). Knowing where and getting there: a human navigation network. Science 280, 921–924. doi: 10.1126/science.280.5365.921
Meyer-Lindenberg, A., Poline, J. B., Kohn, P. D., Holt, J. L., Egan, M. F., Weinberger, D. R., et al. (2001). Evidence for abnormal cortical functional connectivity during working memory in schizophrenia. Am. J. Psychiatry 158, 1809–1817. doi: 10.1176/appi.ajp.158.11.1809
Niendam, T. A., Bearden, C. E., Rosso, I. M., Sanchez, L. E., Hadley, T., Nuechterlein, K. H., et al. (2003). A prospective study of childhood neurocognitive functioning in schizophrenic patients and their siblings. Am. J. Psychiatry 160, 2060–2062. doi: 10.1176/appi.ajp.160.11.2060
Nuechterlein, K. H., Barch, D. M., Gold, J. M., Goldberg, T. E., Green, M. F., and Heaton, R. K. (2004). Identification of separable cognitive factors in schizophrenia. Schizophr. Res. 72, 29–39. doi: 10.1016/j.schres.2004.09.007
Nuechterlein, K. H., Green, M. F., Kern, R. S., Baade, L. E., Barch, D. M., Cohen, J. D., et al. (2008). The MATRICS consensus cognitive battery, part 1: test selection, reliability, and validity. Am. J. Psychiatry 165, 203–213. doi: 10.1176/appi.ajp.2007.07010042
Patterson, T. L., Goldman, S., McKibbin, C. L., Hughs, T., and Jeste, D. V. (2001). UCSD performance-based skills assessment: development of a new measure of everyday functioning for severely mentally ill adults. Schizophr. Bull. 27, 235–245. doi: 10.1093/oxfordjournals.schbul.a006870
Reichenberg, A., Weiser, M., Rabinowitz, J., Caspi, A., Schmeidler, J., Mark, M., et al. (2002). A population-based cohort study of premorbid intellectual, language, and behavioral functioning in patients with schizophrenia, schizoaffective disorder, and nonpsychotic bipolar disorder. Am. J. Psychiatry 159, 2027–2035. doi: 10.1176/appi.ajp.159.12.2027
Rotarska-Jagiela, A., van de Ven, V., Oertel-Knochel, V., Uhlhaas, P. J., Vogeley, K., and Linden, D. E. J. (2010). Resting-state functional network correlates of psychotic symptoms in schizophrenia. Schizophr. Res. 117, 21–30. doi: 10.1016/j.schres.2010.01.001
Schrimsher, G. W., O'bryant, S. E., O'Jile, J. R., and Sutker, P. B. (2008). Comparison of tetradic WAIS-III short forms in predicting full scale IQ scores in neuropsychiatric clinic settings. J. Psychopathol. Behav. Assess. 30, 235–240. doi: 10.1007/s10862-007-9066-9
Sheehan, D. V., Janavs, J., Baker, R., Harnett-Sheehan, K., Knapp, E., Sheehan, M., et al. (1998). MINI—Mini International Neuropsychiatric Interview—English Version 5.0.0—DSM-IV. J. Clin. Psychiatry 59, 34–57.
Spieker, E. A., Astur, R. S., West, J. T., Griego, J. A., and Rowland, L. M. (2012). Spatial memory deficits in a virtual reality eight-arm radial maze in schizophrenia. Schizophr. Res. 135, 84–89. doi: 10.1016/j.schres.2011.11.014
Stephan, K. E., Friston, K. J., and Frith, C. D. (2009). Dysconnection in schizophrenia: from abnormal synaptic plasticity to failures of self-monitoring. Schizophr. Bull. 35, 509–527. doi: 10.1093/schbul/sbn176
Voermans, N. C., Petersson, K. M., Daudey, L., Weber, B., Van Spaendonck, K. P., Kremer, H. P. H., et al. (2004). Interaction between the human hippocampus and the caudate nucleus during route recognition. Neuron 43, 427–435. doi: 10.1016/j.neuron.2004.07.009
Weinberger, D. R., Berman, K. F., Suddath, R., and Torrey, E. F. (1992). Evidence of dysfunction of a prefrontal-limbic network in schizophrenia—a magnetic-resonance-imaging and regional cerebral blood-flow study of discordant monozygotic twins. Am. J. Psychiatry 149, 890–897.
Weinberger, D. R., Berman, K. F., and Zec, R. F. (1986). Physiological dysfunction of dorsolateral prefrontal cortex in schizophrenia.1. regional cerebral blood-flow evidence. Arch. Gen. Psychiatry 43, 114–124. doi: 10.1001/archpsyc.1986.01800020020004
Weniger, G., and Irle, E. (2008). Allocentric memory impaired and egocentric memory intact as assessed by virtual reality in recent-onset schizophrenia. Schizophr. Res. 101, 201–209. doi: 10.1016/j.schres.2008.01.011
Wolbers, T., Wiener, J. M., Mallot, H. A., and Buchel, C. (2007). Differential recruitment of the hippocampus, medial prefrontal cortex, and the human motion complex during path integration in humans. J. Neurosci. 27, 9408–9416. doi: 10.1523/JNEUROSCI.2146-07.2007
Wong, A. H. C., Macciardi, F., Klempan, T., Kawczynski, W., Barr, C. L., Lakatoo, S., et al. (2003). Identification of candidate genes for psychosis in rat models, and possible association between schizophrenia and the 14-13-3 gene. Mol. Psychiatry 8, 156–166. doi: 10.1038/sj.mp.4001237
Keywords: schizophrenia, cognition, psychosocial functioning, virtual reality, navigation
Citation: Zawadzki JA, Girard TA, Foussias G, Rodrigues A, Siddiqui I, Lerch JP, Grady C, Remington G and Wong AHC (2013) Simulating real world functioning in schizophrenia using a naturalistic city environment and single-trial, goal-directed navigation. Front. Behav. Neurosci. 7:180. doi: 10.3389/fnbeh.2013.00180
Received: 03 August 2013; Accepted: 11 November 2013;
Published online: 26 November 2013.
Edited by:Ales Stuchlik, Academy of Sciences of the Czech Republic, Czech Republic
Reviewed by:Kamil Vlcek, Academy of Sciences of the Czech Republic, Czech Republic
Iveta Fajnerova, Prague Psychiatric Center, Czech Republic
Copyright © 2013 Zawadzki, Girard, Foussias, Rodrigues, Siddiqui, Lerch, Grady Remington and Wong. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Albert H. C. Wong, Centre for Addiction and Mental Health, Campbell Family Mental Health Research Institute, 250 College St., Room 323, Toronto, ON M5T 1R8, Canada e-mail: firstname.lastname@example.org