Impact Factor 3.161 | CiteScore 3.13
More on impact ›

Brief Research Report ARTICLE

Front. Psychiatry, 20 March 2020 | https://doi.org/10.3389/fpsyt.2020.00180

Validation of the Clinical Global Impression—Corrections Scale (CGI-C) by Equipercentile Linking to the BPRS-E

  • Centre for Addiction and Mental Health (CAMH) and University of Toronto, Toronto, ON, Canada

Background: The Clinical Global Impression—Corrections (CGI-C) is an adaptation of the severity scale of the Clinical Global Impression for use in correctional facilities. Although it has been shown to have good inter-rater reliability, there have been no validation studies of this instrument.

Method: We analyzed data from 726 initial assessments of persons detained in two correctional facilities and compared clinician's ratings for the CGI-C and modified Brief Psychiatric Rating Scale-Expanded (BPRS-E). We used equipercentile linkage and Spearman correlations to investigate concordance in the total sample, by diagnostic groups, and by gender.

Results: We found that the CGI-C scores and BPRS-E scores among persons in remand settings were significantly correlated (ρ = 0.51, p < 0.001) and that correlations were the same for men and women. We found that points of equivalence can be reliably found between the two scales using equipercentile linkage, and that those with psychotic disorders had lower BPRS-E scores than those with mood/anxiety/situational stress for equivalent CGI-C scores.

Conclusion: Overall, CGI-C ratings correspond well to BPRS-E ratings for both men and women remand prisoners across diagnoses, and the CGI-C appears to be a valid tool for the assessment of severity of symptoms in this setting.

Background

There is a high prevalence of mental illness among prisoners world-wide (1), and there are significant barriers to the provision of effective care, including challenges in identifying and assessing those who are in need of treatment (2). Several scales have been designed to screen for mental disorder in correctional institutions (3) but there has been little research into the measurement of severity of mental disorder in correctional facilities. Existing tools that are used in general settings for measuring symptom severity such as the Positive and Negative Symptom Scale (PANSS) (4), or the Hamilton Depression Rating Scale (5) could also be used in correctional settings. However, given the operational challenges of providing mental health care in correctional settings, and the high severity of illness and behavioral disturbance due to mental illness among many prisoners, there is a need for a brief assessment tool that can be used in routine practice to assess severity and to monitor change (6, 7).

The Clinical Global Impression—Corrections (CGI-C) (8) was developed as an adaptation of the severity scale of the original Clinical Global Impression (9) (CGI-S) as a brief, reliable tool to measure overall symptom severity of individuals in correctional settings, and to be used by clinicians of different disciplines. It is, as far as we are aware, the only symptom rating scale that has been developed for use in correctional settings. Global symptom severity is rated on a 7-point scale based on direct observation and information from correctional officers or other sources. The tool has been shown to have good inter-rater reliability (10), and has also been translated into German (11) with similar inter-rater reliability.

Comparisons between the original CGI-S and the Brief Psychiatric Rating Scale (BPRS) (12, 13) and the Positive and Negative Symptom Scale (PANSS) (4, 12, 14, 15) have shown a good overall level of concordance among people with schizophrenia. Variations in the degree of concordance have however been found for different symptom clusters, with a greater degree of concordance with positive symptoms, rather than negative or depressive symptoms (14, 16).

Although adapted from the original CGI-S, the CGI-C has not previously been validated by direct comparison with any other rating scales, nor have there been any validation studies of symptom severity rating scales within correctional facilities. Our aim was to validate the CGI-C by comparing CGI-C ratings with BPRS-E ratings among a consecutive sample of remand prisoners, and to investigate whether there were differences in concordance on ratings of primarily affective of psychotic disorders.

Methods

We analyzed data collected during routine clinical care within two provincial correctional facilities in Southern Ontario, Canada; Vanier Centre for Women (VCW), and the Toronto South Detention Centre (TSDC). In these facilities, all inmates are screened at reception by correctional health staff using the Brief Jail Mental Health Screen (17). Those screening positive are then referred to the Forensic Early Intervention Service (FEIS) for further assessment, and are typically assessed within 3 days of arrival at the facility. FEIS clinicians (comprising nurses, social workers, and occupational therapists), carry out assessments using the Jail Screening and Assessment Tool (JSAT) (18) and CGI-C, having received training in using these tools. The JSAT contains a modified BPRS scale (BPRS-E) which comprises 24 items, which are rated 0 (not present), 1 (partially present) or 2 (present). The JSAT also requires clinicians to categorize the putative mental disorder into non-mutually exclusive symptom groups: Situational Stress/Depression; Possible Anxiety/Mood Disorder; History Psychosis/Bipolar Disorder; Possible Recurrent Psychotic Symptoms; Active Current Psychosis; Intellectual Disability/Brain Damage; and Personality Disorder Traits.

We first carried out analyses on the entire sample, irrespective of symptom group. We then created categories of “Mood/Anxiety/Situational Stress” by combining Situational stress/Depression and Possible Anxiety/Mood Disorder, and “Psychotic illness” by combining History Psychosis/Bipolar Disorder, Possible Recurrent Psychotic Symptoms and Active Current Psychosis. There were insufficient participants with a recorded singular diagnostic category of either intellectual disability / brain damage or personality disorder traits to analyse separately. For the purposes of our secondary analysis by non-overlapping diagnostic groups, we excluded participants who were recorded as having both “Mood/Anxiety/Situational Stress” and “Psychotic illness” leaving diagnostic groups of either “Mood/Anxiety/Situational Stress” (n = 290) or “Psychotic illness” (n = 185). We extracted data from clinical records for all inmates in which a BPRS-E and CGI-C were recorded on the same day between September 1, 2017 and June 29, 2019.

Statistical Analyses

Equipercentile linking is the preferred method of comparing one scale against another (1921), and is a technique that establishes points of equivalence between scores on both measures that have the same percentile rank (22). We carried out analyses using the Equate package in R (23) based on the test equating theory described by Kolen and Brennan (22). Single group design was utilized as both scores were measured on the same sample. We first carried out equipercentile linking on the total sample, and then separately for those who were categorized as having a psychotic illness or a mood/anxiety/situational stress disorder.

We also investigated correlations between the CGI-C and BPRS-E. Spearman's rho was used given the ordinal nature of CGI-C data and positive skew observed in both measures. Bivariate outliers were defined as observations with a Mahalanobis distance ≥13.82 (corresponding with p ≤ 0.001). No such observations existed and all leverage values were ≤0.02, so all observations were included in the analyses. Separate correlations were then calculated by diagnosis as defined above. These analyses were performed using the Statistical Package for Social Sciences, Version 25 (24).

Results

The sample consisted of 429 (59.1%) men and 292 (40.2%) women. Five additional inmates identified as having a gender other than male or female were also included in the total sample (n = 726). The mean age of the sample was 35.4 years (SD = 10.6) (see Table 1). Most patients received a diagnosis of a mood related illness (64.7%), and 50.2% of patients were diagnosed with a psychotic illness. Other diagnoses included personality disorders (19.9%) and intellectual disability/brain damage (2.6%). For all patients, the mean CGI-C score was 3.2 (SD = 1.3) and the median score was 3 (IQR = 2). The mean total modified BPRS-E score for all patients was 8.8 (SD = 7.6), and the median score was 6 (IQR = 8.75).

TABLE 1
www.frontiersin.org

Table 1. Participant characteristics.

CGI-C scores correlated significantly in the sample for modified BPRS-E total scores (ρ = 0.51, p < 0.001). There was no difference in correlations between males (ρ = 0.54, p < 0.001), and females (ρ = 0.54, p < 0.001). We also found significant correlations between CGI-C and BPRS-E among those with Mood/Anxiety/Situational Stress (ρ = 0.45, p < 0.001) and those with psychosis (ρ = 0.39, p < 0.001).

Equipercentile linking between the CGI-C and the modified BPRS-E for the total sample are shown in Figure 1. Being scored as “Mildly ill”; a score of 3 on the CGI-C corresponds to the modified BPRS-E total score of 6. Scores of 4, 5, 6, and 7 on the CGI-C corresponded to total scores of 11, 21, 27, and 32 on the modified BPRS-E, respectively.

FIGURE 1
www.frontiersin.org

Figure 1. Linking between CGI-C and modified BPRS-E total scores for all patients. Error bars = SE.

Figure 2 shows linking function performed separately for patients with a mood/anxiety diagnoses and patients with diagnosis of a psychotic disorder. A score 3 on the CGI-C corresponded to a total score on the BPRS-E of 5 for those with a psychosis diagnosis and 7 for those with mood/anxiety/situational stress diagnoses related disorder. CGI-C scores of 4, 5, and 6 corresponded to BPRS-E total scores of 9, 16, and 22, respectively, for patients diagnosed with a psychotic disorder and total scores of 11, 23, and 27, respectively, for patients with a mood/anxiety -related diagnosis. A total score of 7 on the CGI-C corresponded to a total modified BPRS-E score of 29 for those with psychotic disorders and 31 for patients with mood related diagnoses (see also Table 2).

FIGURE 2
www.frontiersin.org

Figure 2. Linking between CGI-C and modified BPRS-E total scores for patients with a diagnosis of mood (n = 290) and psychosis (n = 185). Error bars = SE.

TABLE 2
www.frontiersin.org

Table 2. Equipercentile linked scores and standard errors between CGI-C ratings and BPRS-E total scale and putative diagnostic groups.

Discussion

We found that the CGI-C scores and modified BPRS-E scores among people in remand settings are significantly correlated and that points of equivalence can be reliably found between the two scales. This is the first study that has provided a validation of the CGI-C by demonstrating that clinician's global ratings correspond substantially with the total score on the BPRS-E, and the correlations between the two measures are identical for both men and women.

Although no study has previously compared the CGI-C with other symptom measures, comparisons of BPRS and CGI-S scores have been reported among patients with schizophrenia participating in drug trials (12, 21). We found that the Spearman correlation between CGI-C and modified BPRS-E (0.51) was similar to the mean baseline correlation between the BPRS and CGI-S reported in 14 drug trials among 4,065 people with schizophrenia (0.53) (12). Although in these studies there was concordance between CGI-S and BPRS scores, the authors cautioned that the results only applied to patients who have acute exacerbations of schizophrenia who have predominantly positive symptoms, and that the relationship between the two scales might be very different among those with primarily negative symptoms or other diagnoses.

No previous studies have reported equipercentile linkage of CGI-S and BPRS-E scores, however previous equipercentile linking of BPRS and CGI-S has shown a similar pattern to the findings in our study (19). Our study provides evidence that CGI-C has similar psychometric properties to the CGI-S among persons in correctional facilities, and with a variety of diagnostic groups. Our study also provides points of equivalence between the CGI-C and modified BPRS-E thus allowing for interpretation of studies that have reported results on one or other of the scales, and allowing for the intuitive application and interpretation of either scale among clinicians familiar with the other.

We found that the correlations between CGI-C and Mood/Anxiety/Situational Stress to be slightly higher (0.45) than among those with psychosis (0.39). We also found that the equipercentile linkage scores were somewhat different among the two groups. Among those with Mood/Anxiety/Situation Stress, scores on the CGI-C equated to higher BPRS-E scores than those with Psychosis, particularly among those rated as CGI-C 5, 6, or 7. Being considered moderately ill on the CGI-C equated with a BPRS-E score of 16 for those with psychosis and 23 for those with a mood related diagnosis, indicating that clinicians rate overall symptom severity higher among those with psychosis compared with mood and anxiety disorders with similar BPRS-E scores. This may reflect the more explicit focus on affective symptoms on the BRPS-E. The CGI-C may however better reflect the level of impairment caused by symptoms than the total BPRS-E scores as it relies on clinical judgement, and it has previously been stated that CGI is more informative than the BPRS as the ratings can be understood intuitively by clinicians (21).

With regards to limitations of our study, all inmates in our study were rated with both the BPRS-E and CGI-C by the same clinician. It would have been preferable to have had two clinicians independently rating either the BPRS-E or the CGI-C, and comparing those ratings, as it is possible that rating the BPRS-E may have influenced the CGI-C rating and vice versa when carried out by the same clinician, thus increasing the apparent correlation between the two. Our approach, however, would have reduced inter-rater measurement error that could be introduced from having multiple observers rating each person. It is notable however that the correlations we observed were comparable to those reported in similar studies. In addition, we have not measured the reliability of the putative diagnostic groups and therefore the differences in equipercentile ratings by diagnosis need further investigation for confirmation. We were not able to analyze patients by DSM-V diagnosis, but by symptom cluster as recorded in the JSAT. Future research could confirm our findings by investigating equipercentile linkage in more precise diagnostic categories. In addition, we were not able to analyze separately all of the symptom groupings recorded in the JSAT, such as intellectual disability or personality traits, as equipercentile linkage requires sufficient participants with recorded symptom severity across the whole range of possible scores in order to analyze.

Overall we found that the CGI-C ratings correspond very well to BPRS-E ratings for both men and women remand prisoners across diagnoses, and the CGI-C appears to be a valid tool for the assessment of severity of symptoms in this setting. It appears that the CGI-C is appropriate to be used as a routine measure of severity among both males and females. Further studies are recommended to assess the validity in other correctional settings to ensure generalisability, and to assess serial measures of the CGI-C to investigate sensitivity to change.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Ethics Statement

Research Ethical approval was granted by the Centre for Addictions and Mental Health Research Ethics Board (#018/2018) for use of retrospective data for the purpose of research. No identifiable information was retained or is presented in this manuscript.

Author's Note

RJ is a Forensic Psychiatrist and Clinician Scientist at the Centre for Addiction and Mental Health, Toronto, and is an Assistant Professor at the University of Toronto. CG is a Clinical Psychologist and Clinician Scientist at the Centre for Addiction and Mental Health (CAMH) and Assistant Professor at the University of Toronto. MM is a research coordinator at the Centre for Addiction and Mental Health (CAMH). AS is the Chief of Forensic Psychiatry and a Clinician Scientist at Centre for Addiction and Mental Health, Toronto, and is an Associate Professor at the University of Toronto.

Author Contributions

RJ designed the study, carried out data collection, and preparation of the first and revised drafts of the manuscript. CG and MM contributed to the study design, carried out data analysis and interpretation of the results, and contributed to the preparation and editing of the manuscript. AS contributed to the interpretation of the results and editing of the manuscript. All authors have read and have approved the manuscript.

Funding

RJ work was supported in part by an Academic Scholar Award from the University of Toronto.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

1. Fazel S, Danesh J. Serious mental disorder in 23000 prisoners: a systematic review of 62 surveys. Lancet. (2002) 359:545–50. doi: 10.1016/S0140-6736(02)07740-1

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Simpson AIF, Jones RM. Two challenges affecting access to care for inmates with serious mental illness: detecting illness and acceptable services. Can J Psychiatr. (2018) 63:648–50. doi: 10.1177/0706743718792844

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Martin MS, Colman I, Simpson AIF, McKenzie K. Mental health screening tools in correctional institutions: a systematic review. BMC Psychiatr. (2013) 13:275. doi: 10.1186/1471-244X-13-275

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Kay SR, Fiszbein A, Opler LA. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophrenia Bull. (1987) 13:261–76. doi: 10.1093/schbul/13.2.261

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatr. (1960) 23:56–62. doi: 10.1136/jnnp.23.1.56

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Forrester A, Till A, Simpson A, Shaw J. Mental illness and the provision of mental health services in prisons. Br Med Bull. (2018) 127:101–09. doi: 10.1093/bmb/ldy027

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Nicholls TL, Butler A, Kendrick-Koch L, Brink J, Jones RM, Simpson AIF. Assessing and treating offenders with mental illness. In: Ternes M, Magaletta PR, Patry MW, editors. The Practice of Correctional Psychology. Switzerland, AG: Springer Nature (2018). p. 9–37. doi: 10.1007/978-3-030-00452-1_2

CrossRef Full Text | Google Scholar

8. Jones RM, Moscovici M, Patel K, McMaster R, Glancy G, Simpson A. The Clinical Global Impression-Corrections (CGI-C) (2019). Available online at: https://www.researchgate.net/publication/330482937_The_Clinical_Global_Impression-Corrections_CGI-C

9. Guy W (editor). ECDEU Assessment Manual for Psychopharmacology. Rockville, MD: U.S. Department of Health, Education, and Welfare (1976).

Google Scholar

10. Jones RM, Patel K, Moscovici M, McMaster R, Glancy G, Simpson AIF. Adaptation of the clinical global impression for use in correctional settings: the CGI-C. Front Psychiatr. (2019) 10:687. doi: 10.3389/fpsyt.2019.00687

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Ostermann MS, Billen C, Huchzermeier C. The Clinical Global Impression-Corrections (CGI-C) German Version Langfassung. (2019). doi: 10.13140/RG.2.2.23851.39203

CrossRef Full Text | Google Scholar

12. Leucht S, Kane JM, Etschel E, Kissling W, Hamann J, Engel RR. Linking the PANSS, BPRS, and CGI: clinical implications. Neuropsychopharmacol. (2006) 31:2318–25. doi: 10.1038/sj.npp.1301147

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Overall J, Gorham D. The brief psychiatric rating scale. Psychological Rep. (1962) 10:799–812. doi: 10.2466/pr0.1962.10.3.799

CrossRef Full Text | Google Scholar

14. Rabinowitz J, Mehnert A, Eerdekens M. To what extent do the PANSS and CGI-S overlap? J Clin Psychopharmacol. (2006) 26:303–7. doi: 10.1097/01.jcp.0000218407.10362.6e

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Rabinowitz J, Levine S, Martinez G. Concordance between measures of functioning, symptoms, and change: examining the GAF, CGI-S, CGI-C, and PANSS. J Clin Psychopharmacol. (2010) 30:478–80. doi: 10.1097/JCP.0b013e3181e7145f

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Goldman M, Dequardo JR, Tandon R, Taylor SF, Jibson M. Symptom correlates of global measures of severity in schizophrenia. Compr Psychiatr. (1999) 40:458–61. doi: 10.1016/s0010-440x(99)90090-1

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Steadman HJ, Scott JE, Osher F, Agnese TK, Robbins PC. Validation of the brief jail mental health screen. Psychiatr Services. (2005) 56:816–22. doi: 10.1176/appi.ps.56.7.816

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Nicholls TL. Jail screening assessment tool (JSAT): Guidelines for Mental Health Screening in Jails. Burnaby, BC: Mental Health, Law and Policy Institute, Simon Fraser University (2005).

19. Leucht S, Rothe P, Davis JM, Engel RR. Equipercentile linking of the BPRS and the PANSS. Eur Neuropsychopharmacol. (2013) 23:956–9. doi: 10.1016/j.euroneuro.2012.11.004

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Samara MT, Engel RR, Millier A, Kandenwein J, Toumi M, Leucht S. Equipercentile linking of scales measuring functioning and symptoms: examining the GAF, SOFAS, CGI-S, and PANSS. Eur Neuropsychopharmacol. (2014) 24:1767–72. doi: 10.1016/j.euroneuro.2014.08.009

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Leucht S, Kane JM, Kissling W, Hamann J, Etschel E, Engel R. Clinical implications of brief psychiatric rating scale scores. Br J Psychiatr. (2005) 187:366–71. doi: 10.1192/bjp.187.4.366

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Kolen MJ, Brennan RL. Test Equating, Scaling, and Linking: Methods and Practices. New York, NY: Springer (2014).

Google Scholar

23. Albano A. Equate: Observed-Score Linking and Equating. (2016). https://CRAN.R-project.org/package=equate (2016). doi: 10.18637/jss.v074.i08

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Statistical Package for Social Sciences. Armonk, NY: IBM Corp.

Keywords: CGI-C, BPRS-E, correctional psychiatry, prison, mental health, assessment, rating scale, severity

Citation: Jones RM, Gerritsen C, Maheandiran M and Simpson AIF (2020) Validation of the Clinical Global Impression—Corrections Scale (CGI-C) by Equipercentile Linking to the BPRS-E. Front. Psychiatry 11:180. doi: 10.3389/fpsyt.2020.00180

Received: 09 January 2020; Accepted: 25 February 2020;
Published: 20 March 2020.

Edited by:

Athanassios Douzenis, National and Kapodistrian University of Athens, Greece

Reviewed by:

Loukas Athanasiadis, Aristotle University of Thessaloniki, Greece
Dionysis Seretis, University of Southampton, United Kingdom

Copyright © 2020 Jones, Gerritsen, Maheandiran and Simpson. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Roland M. Jones, Roland.jones@camh.ca