BRIEF RESEARCH REPORT article
Color Trails Test: A New Set of Data on Cognitive Flexibility and Processing Speed in Schizophrenia
- 1Institute of Psychology, SWPS University of Social Sciences and Humanities, Poznań, Poland
- 2Institute of Psychology, University of Szczecin, Szczecin, Poland
- 3Independent Clinical Psychology Unit, Pomeranian Medical University, Szczecin, Poland
- 4Department of Psychiatry, Pomeranian Medical University, Szczecin, Poland
- 5Department of Neurosurgery, Pomeranian Medical University, Szczecin, Poland
Background: Although schizophrenia patients have been reported to manifest deficits in cognitive flexibility and lower processing speed (measured with i.a., the Color Trails Test, CTT), there still remain a few matters that require further investigation. We have therefore formulated three research aims: 1) to examine the factor structure of CTT in schizophrenia patients and healthy controls, 2) to compare different CTT performance measures in the two groups, 3) to investigate the relationship between these measures and selected psychopathological symptoms in the patient group.
Methods: Sixty-seven patients with paranoid schizophrenia and 67 healthy controls, matched for gender, age, number of years of education, and overall cognitive functioning underwent assessment of cognitive flexibility and processing speed with the CTT.
Results: Factor analysis of CTT variables based on the principal component method revealed a four-factor solution in both groups. Compared with healthy controls, the patients performed poorer on CTT 1 time, CTT 2 time, 2-1 difference, prompts in CTT 2, and had higher regression factor scores for Factor 1 (reflecting the slower speed of perceptual tracking). Furthermore, significant links were found between some CTT measures, and negative and disorganization symptoms.
Conclusions: Schizophrenia patients exhibit problems with speed of perceptual tracking and executive processes dependent on processing speed. Our results may be useful for the development of neuropsychological diagnostic methods for schizophrenia patients. It seems that, compared to other CTT indices, CTT 1 time, CTT 2 time, and 2-1 difference are more appropriate measures of cognitive performance in schizophrenia patients.
Cognitive flexibility is defined as the ability to flexibly transition between at least two processes or tasks [i.e., alternating attention between two goals (1)]. Processing speed refers to the number of correct responses an individual is able to generate during a task within a given amount of time or the speed with which different cognitive operations can be performed [i.e., motor speed and visual scanning speed (2, 3)]. As a consequence of structural and functional abnormalities in the brain, both processes may be severely disturbed in schizophrenia (4, 5).
These processes can be measured with two corresponding neuropsychological tests—the Color Trails Test [CTT, (6)] and the Trail Making Test [TMT, (7)]. Introduced in the 1990s, the CTT was primarily created to meet the demand for a culture-neutral equivalent to the TMT. Even though their scores are comparable in most tested populations, CTT’s lack of numbers and letters and use of colors for responses seems to place people from cultures which don’t use the Latin alphabet, illiterate persons, or those experiencing language difficulties at an advantage (6). Initially, performance times in both parts of these tests were interpreted separately, with CTT 1 and TMT A considered to measure processing speed, while CTT 2 and TMT B to assess cognitive flexibility (8–10).
Although the CTT and TMT are reported to measure various neuropsychological domains, data concerning their factorial validity when applied in clinical samples is still scarce. Internal structures of CTT investigated in the normative vs. traumatic brain injury patient samples proved somewhat divergent, although both yielded four-factor solutions, reflecting the speed of perceptual tracking and sequencing (6). To our knowledge, a factorial analysis of CTT has not been conducted yet in schizophrenia patients.
To date, the CTT was used less often than the TMT to assess response time-dependent mental processes in schizophrenia patients (8, 11). A PubMed search results indicate differences between patients and healthy controls in terms of response times in CTT 1 and/or CTT 2 (12–18), though some studies seem to yield conflicting results (19, 20). Apart from these two indices, other researchers have proposed three derived scores to provide information on cognitive flexibility somewhat independent of motor and visual scanning speed [e.g., 2-1 difference, 2/1 ratio, and (2-1)/1 proportion]. There is, however, little research on their use in schizophrenia (13, 16, 21, 22).
Assessment of cognitive flexibility based on CTT or TMT performance times as a single outcome measure is bound to be limited. In turn, a more qualitative approach can offer much more useful clinical information (1), as suggested in several studies, where CTT and TMT error analysis in clinical samples, including schizophrenia, resulted in increased diagnostic specificity of cognitive testing (13, 23–27).
Although deficient cognitive flexibility and processing speed have been reported in schizophrenia, their association with psychopathology [especially different symptom dimensions, not only negative symptoms, see (28)] remains unclear. What is more, there are few findings reporting links between patients’ performance on the CTT and selected clinical variables (19, 29). In contrast, many studies suggest positive correlations between performance time in TMT part B, and negative and disorganization symptoms (30).
Considering all these findings and inconsistencies, we have formulated the main objective of this study, i.e., to examine the factor structure of CTT in schizophrenia patients and healthy controls. Our secondary aims were to compare different CTT performance measures in the two groups and explore their links with selected psychopathological symptoms in the patient group.
Sixty-seven inpatients of three psychiatric wards were diagnosed with paranoid schizophrenia according to ICD-10 diagnostic criteria [World Health Organization (WHO), (31)] by three licensed psychiatrists. Inclusion criteria were 20–35 years of age, comprehension of test procedure, and stable clinical status. Exclusion criteria were comorbid mental or neurological disorders, craniocerebral injuries, dementia, severe somatic diseases (e.g., cancer), and addiction to alcohol or other substances. All patients gave written informed consent to participate in the study. The study protocol was approved by the local bioethics committee.
Sixty-seven persons without mental or neurological disorders, matched for gender, age, and number of years of education were recruited through information spread by students of the local universities. Inclusion and exclusion criteria for healthy controls were the same as those for patients (except for clinical parameters regarding the diagnosis of schizophrenia).
Polish Version of CTT by Łojek and Stańczak (6, 13) was used to measure cognitive flexibility and processing speed. The CTT is deemed a culture-free version of the TMT and consists of two parts: (a) CTT 1 requires participants to connect a series of 25 numbered circles that are randomly printed on a sheet of paper and (b) in CTT 2 they are to connect numbered circles from 1 to 25 alternating between two colors—pink and yellow. In this study, we used time-related indices: CTT 1 time, CTT 2 time, 2-1 difference proposed by Chan (19), 2/1 ratio adopted from Lamberty (32), (2-1)/1 proportion proposed by D’Elia (6), and error-related ones: number sequence errors in CTT 1 and/or CTT 2 (when participants connected circles in a wrong order, e.g., 1-3 or 2-4), color sequence errors in CTT 2 (when participants connected circles in a wrong color sequence e.g., 1 pink-2 pink), near-misses in both parts of CTT (when participants started connecting circles in a wrong manner but did correct their work), and prompts in both parts of this test (when participants failed to connect circles for 10 sec, the researcher indicated the next move), as suggested by D’Elia et al. (6).
The Positive and Negative Syndrome Scale [PANSS, (33)] was used to measure psychopathological symptom severity in schizophrenia patients. Following Emsley et al. (34), we distinguished five psychopathological dimensions: negative, positive, disorganized, excited, anxiety and depression. In addition, Mini-Mental State Examination [MMSE, (35)] was used to screen for global cognitive function.
Statistical analysis of the data was conducted using the IBM SPSS 24 Statistical package. To investigate the factor structure, 12 CTT scores (see Table 2) were submitted to principal components analysis with VARIMAX rotation. Factors with eigenvalues > 1 (the Kaiser-Guttman criterion) were retained and factor loadings of.40 or greater were considered significant. Indices and factors (regression factor scores) of CTT were used as dependent variables. To check for differences between the groups, we used Student’s t-test. Cohen’s d was used to determine the magnitude of effect size measures (36). Holm’s p-value correction for multiple comparisons was used (37). To assess the strength of the identified correlations, The Pearson r correlation coefficient was used. In the case of significant correlations, single stepwise linear regression procedures were conducted, in the schizophrenia group.
Schizophrenia patient group included 31 women and 36 men, while the control group comprised 27 women and 40 men. The groups did not differ in terms of gender, age, years of education or global cognitive function (MMSE score, see Table 1).
Table 1 Demographic, clinical, psychological characteristics, and performance in the Color Trail Test (CTT) in schizophrenia patients and healthy controls.
Factor Structure of CTT
We conducted exploratory factor analysis separately for the entire sample, schizophrenia patients and healthy controls. The four-factor solution explained 72.39% of the total variance in the entire sample, 73.26% in schizophrenia patients, and 71.70% in healthy controls. The distribution of the explained variance of the 4 factors in the two subgroups remained approximately the same as for the entire sample. Factor loading estimates for the whole sample and the two subgroups are shown in Table 2 for each of the four factors, respectively. Factor structures were somewhat divergent in the two subgroups, although both yielded four-factor solutions. Factor 1 reflected speed of perceptual tracking, Factor 2 - cognitive flexibility independent of processing speed, Factor 3 - inattention and impulsivity, and Factor 4 - simple inattention.
Table 2 Factor loadings of Color Trail Test (CTT) scores for the entire sample, schizophrenia patients and healthy controls.
Performance on Different CTT Measures
Response Time Indices
As shown in Table 1, compared to healthy controls, schizophrenia patients scored poorer on response time-based indices: CTT 1 time (p < 0.001), CTT 2 time (p < 0.001), and 2-1 difference (p < 0.001). The effect sizes (d) of the analysed processes were found to be 0.98–1.26, thus suggesting large effect sizes.
Compared to healthy controls, schizophrenia patients required significantly more prompts (p < 0.01) only in CTT 2. The effect size (d) of the analysed errors was found to be 0.58, indicating medium effect sizes.
Regression factor scores for Factor 1 (p < 0.001) were significantly higher in the patients than the controls. The effect size (d) of the analysed scoring was found to be 0.97, indicating large effect sizes.
CTT Indices and Psychopathological Symptoms
Negative symptoms were significant predictors of CTT 2 time (β = 0.28; t = 2.36; p = 0.021) and 2-1 difference (β = 0.27; t = 2.26; p = 0.027), predicting about 7 and 6% of variance, respectively. Disorganization symptoms were significant predictors of CTT 2 time (β = 0.38; t = 3.33; p = 0.001), 2-1 difference (β = 0.39; t = 3.39; p = 0.001), and regression factor scores for Factor 1 (β = 0.24; t = 2.01; p = 0.049), predicting 13, 14, and 4% of variance, respectively. Excited symptoms were a significant predictor of near-misses (β = 0.30; t = 2.57; p = 0.012), predicting 8% of variance. We identified no other significant predictors of any CTT indices.
Our primary purpose was to examine the factor structure of CTT in the entire sample and the two subgroups. Factor structures in the entire sample, schizophrenia patients, and healthy controls were similar (Factor 1 = speed of perceptual tracking, Factor 2 = cognitive flexibility independent of processing speed, Factor 3 = inattention and impulsivity, and Factor 4 = simple inattention), suggesting that the error and prompt variables might tap factors dissociable from those based on the time variables. In addition, these qualitative variables may offer an alternative take on the speed vs. accuracy trade-off of CTT performance. Respondents may attempt to increase their speed at the expense of committing errors, or reduce the number of errors at the expense of elevated time scores. Our results are thus similar to those reported in the traumatic brain injury and normative samples (6).
Our second aim was to compare CTT performance measures in schizophrenia patients and healthy controls. In this study was used CTT, as performance on CTT 2 is considered to be more perceptually demanding than completion of TMT B [49 vs. 25 circles, respectively; (38)]. Furthermore, the CTT allows the use of more qualitative scoring than the TMT, e.g., number or color sequence errors, near-misses, and prompts (6). Patients performed poorer on three time-based indices (CTT 1 time, CTT 2 time, and 2-1 difference), which is partly consistent with findings reported by other researchers (12, 14, 15, 17, 18). Despite the between-group differences regarding the 2/1 ratio and the (2-1)/1 proportion, after Holm’s p-value correction, the differences were no longer statistically significant, which is consistent with other reports (13, 16). Such results are further confirmed by higher regression factor scores for Factor 1 indicates the slower speed of perceptual tracking in schizophrenia patients. Our results are in-line with the data reported by other researchers, especially Dickinson et al. (39, 40). Furthermore, patients’ poorer performance could result from their impaired working memory or visual-spatial functions, described elsewhere (11). Their executive deficits may stem from improper communication between different cortical and subcortical structures of the brain (41).
Our third purpose was to study the links between all CTT indices and selected psychopathological symptoms. Although Chan et al. (19) report no correlations with psychopathological symptoms, we found associations between negative and disorganization symptoms and lower processing speed as well as impaired cognitive flexibility. Our findings are thus similar to those reported in a meta-analysis by Dibben et al. (30), although those authors used the TMT. The observed links between excited symptoms and near-misses could reflect poor impulse control.
We should take account of the study limitations. Firstly, the sample included patients with paranoid schizophrenia, which may hinder generalization to the entire schizophrenia population. Secondly, we did not include analyses of other neurocognitive tests or make a discriminant or convergent validity analysis. Thirdly, the measures-to-person ratio in the CTT in both groups was low but acceptable (42).
To conclude, the major value of this study is that it provides a new set of clinical and non-clinical data which may be of use for neuropsychologists, clinicians, and psychiatrists to determine more precisely the extent to which CTT 1 and CTT 2 scores, and derived indices reflect patient impaired performance. It seems that using CTT 1 time, CTT 2 time, and 2-1 difference are more appropriate measures of cognitive performance dependent on CTT in schizophrenia. The main finding of this study is also that schizophrenia is primarily characterized by problems in the speed of perceptual tracking and executive processes dependent on processing speed.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
This study was carried out in accordance with the recommendations of Bioethical Commission of the Institute of Psychology of University of Szczecin with written informed consent from all subjects. All subjects gave written informed consent in accordance with the Declaration of Helsinki. The protocol was approved by the Bioethical Commission of the Institute of Psychology of University of Szczecin.
All authors contributed to and have approved the final manuscript. ET was the principal coordinator of the grant, was involved in the study design, and took part in patients recruitment, managed literature searches and analyses, performed the statistical analysis, wrote the first draft of the manuscript. EK was involved in the conceptualization of the project and took part in patients recruitment. MM was involved in the study design and corrected the manuscript. ZL corrected the manuscript. AS corrected the manuscript. JP-W was involved in the study design and corrected the manuscript. LS corrected the manuscript. JS was involved in the study design and corrected the manuscript.
This work was supported by the Faculty of Humanities at the University of Szczecin (504-3000-240-940/2015 and 504-3000-240-940/2016) and the Pomeranian Medical University in Szczecin (FSN-337-06/2016 and FSN-246-05/2017). The project was also financed by the Polish Minister of Science and Higher Education’s program named “Regional Initiative of Excellence” in 2019–2022 (002/RID/2018/19).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
We would like to thank psychology students for their assistance in recruiting and screening subjects for participation in the study.
8. Dickinson D, Ramsey ME, Gold JM. Overlooking the obvious: a meta-analytic comparison of digit symbol coding tasks and other cognitive measures in schizophrenia. Arch Gen Psychiatry (2007) 64:532–42. doi: 10.1001/archpsyc.64.5.532
13. Łojek E, Stańczak J. Kolorowy Test Połączeń wersja dla dorosłych. In: . Polska normalizacja [Color Trails Test for adults. A Polish normalization]. Warszawa: Pracownia Testów Psychologicznych Polskiego Towarzystwa Psychologicznego (2012).
14. Zhou FC, Hou WM, Wang CY, Ungvari GS, Chiu HF, Correll CU, et al. Prospective memory performance in non-psychotic first-degree relatives of patients with schizophrenia: a controlled study. PloS One (2014) 9:e111562. doi: 10.1371/journal.pone.0111562
15. González-Blanch C, Álvarez-Jiménez M, Rodríguez-Sánchez JM, Pérez-Iglesias R, Vázquez-Barquero JL, Crespo-Facorro B. Cognitive functioning in the early course of first-episode schizophrenia spectrum disorders. Eur Arch Psychiatry Clin Neurosci (2006) 256:364–71. doi: 10.1007/s00406-006-0646-6
16. Tu PC, Lee YC, Chen YS, Li CT, Su TP. Schizophrenia and the brain’s control network: aberrant within-and between-network connectivity of the frontoparietal network in schizophrenia. Schizophr Res (2013) 147:339–47. doi: 10.1016/j.schres.2013.04.011
17. Zhou FC, Xiang YT, Wang CY, Dickerson F, Au RW, Zhou JJ, et al. Characteristics and clinical correlates of prospective memory performance in first-episode schizophrenia. Schizophr Res (2012) 135:34–9. doi: 10.1016/j.schres.2011.12.001
18. Zhou FC, Wang CY, Ungvari GS, Ng CH, Zhou Y, Zhang L, et al. Longitudinal changes in prospective memory and their clinical correlates at 1-year follow-up in first-episode schizophrenia. PloS One (2017) 12:e0172114. doi: 10.1371/journal.pone.0172114
19. Chan MW, Yip JT, Lee TM. Differential impairment on measures of attention in patients with paranoid and non-paranoid schizophrenia. J Psychiatr Res (2004) 38:145–52. doi: 10.1016/S0022-3956(03)00102-X
21. Perianez JA, Rios-Lago M, Rodriguez-Sanchez JM, Adrover-Roig D, Sanchez-Cubillo I, Crespo-Facorro BE, et al. Trail Making Test in traumatic brain injury, schizophrenia, and normal ageing: sample comparisons and normative data. Arch Clin Neuropsychol (2007) 22:433–47. doi: 10.1016/j.acn.2007.01.022
22. Wang X, Yao S, Kirkpatrick B, Shi C, Yi J. Psychopathology and neuropsychological impairments in deficit and nondeficit schizophrenia of Chinese origin. Psychiatry Res (2008) 158:195–205. doi: 10.1016/j.psychres.2006.09.007
23. McCaffrey RJ, Krahula MM, Heimberg RG. An analysis of the significance of performance errors on the Trail Making Test in polysubstance users. Arch Clin Neuropsychol (1989) 4:393–8. doi: 10.1016/0887-6177(89)90030-9
24. Mahurin RK, Velligan DI, Hazleton B, Mark Davis J, Eckert S, Miller AL. Trail making test errors and executive function in schizophrenia and depression. Clin Neuropsychol (2006) 20:271–88. doi: 10.1080/13854040590947498
25. Amieva H, Lafont S, Auriacombe S, Rainville C, Orgogozo JM, Dartigues JF, et al. Analysis of error types in the Trail Making Test evidences an inhibitory deficit in dementia of the Alzheimer type. J Clin Exp Neuropsychol (1998) 20:280–5. doi: 10.1076/jcen.20.2.280.1161
26. Ashendorf L, Jefferson AL, O’Connor MK, Chaisson C, Green RC, Stern RA. Trail Making Test errors in normal aging, mild cognitive impairment, and dementia. Arch Clin Neuropsychol (2008) 23:129–37. doi: 10.1016/j.acn.2007.11.005
28. Altamura AC, Caletti E, Paoli RA, Cigliobianco M, Zugno E, Grillo P, et al. Correlation between neuropsychological and social cognition measures and symptom dimensions in schizophrenic patients. Psychiatry Res (2015) 230:172–80. doi: 10.1016/j.psychres.2015.08.034
29. Grover S, Nehra R, Bhateja G, Kulhara P, Kumar S. A comparative study of cognitive deficits in patients with delusional disorder and paranoid schizophrenia. Ind Psychiatry J (2011) 20:107–14. doi: 10.4103/0972-6748.102499
34. Emsley R, Rabinowitz J, Torreman M. RIS-INT-35 Early Psychosis Global Working Group. The factor structure for the Positive and Negative Syndrome Scale (PANSS) in recent-onset psychosis. Schizophr Res (2003) 61:47–57. doi: 10.1016/S0920-9964(02)00302-X
38. Dugbartey AT, Townes BD, Mahurin RK. Equivalence of the color trails test and trail making test in nonnative English-speakers. Arch Clin Neuropsychol (2000) 15:425–31. doi: 10.1093/arclin/15.5.425
39. Dickinson D, Ragland JD, Calkins ME, Gold JM, Gur RC. A comparison of cognitive structure in schizophrenia patients and healthy controls using confirmatory factor analysis. Schizophr Res (2006) 85:20–9. doi: 10.1016/j.schres.2006.03.003
Keywords: cognitive flexibility, processing speed, executive functions, cognitive functions, schizophrenia
Citation: Tyburski E, Karabanowicz E, Mak M, Lebiecka Z, Samochowiec A, Pełka-Wysiecka J, Sagan L and Samochowiec J (2020) Color Trails Test: A New Set of Data on Cognitive Flexibility and Processing Speed in Schizophrenia. Front. Psychiatry 11:521. doi: 10.3389/fpsyt.2020.00521
Received: 19 January 2019; Accepted: 21 May 2020;
Published: 09 June 2020.
Edited by:Ingrid Melle, University of Oslo, Norway
Copyright © 2020 Tyburski, Karabanowicz, Mak, Lebiecka, Samochowiec, Pełka-Wysiecka, Sagan and Samochowiec. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Monika Mak, email@example.com