Andrea Wagner1*
Karl-Michael Schebesch2Florian Zeman3
Stefan Isenmann4Andreas Steinbrecher5Thomas Kapapa6
Dobri Baldaranov7Roland Backhaus8
Felix Schlachetzki9- 1Department of Neurology, University Regensburg, Regensburg, Germany
- 2Department of Neurosurgery, University Medical Center Regensburg, Regensburg, Germany
- 3Center for Clinical Studies, University Medical Center Regensburg, Regensburg, Germany
- 4Department of Neurology, HELIOS University Hospital Wuppertal—University Witten/Herdecke, Wuppertal, Germany
- 5Department of Neurology, General Hospital HELIOS Klinikum Erfurt, Erfurt, Germany
- 6Department of Neurosurgery, University Medical Center Ulm, Ulm, Germany
- 7Department of Neurology, University Regensburg, Regensburg, Germany
- 8Stroke Center Hirslanden, Klinik Hirslanden Zurich, Zurich, Switzerland
- 9Department of Neurology, University Regensburg, Regensburg, Germany
Background and Purpose: Intracerebral hemorrhage (ICH) requires rapid decision making to decrease morbidity and mortality although time frame and optimal therapy are still ill defined. Ideally, specialized neurologists, neurosurgeons, and (neuro-) radiologists who know the patient's clinical status and their cerebral computed tomography imaging (cCT) make a joint decision on the clinical management. However, in telestroke networks, a shift toward cCT imaging criteria used for decision making can be observed for practical reasons. Here we investigated the “reverse correlation” from cCT imaging to the actual clinical presentation as evaluated by the Glasgow Coma Scale (GCS) and the National Institutes of Health Stroke Scale (NIHSS).
Methods: CCT images and basic information (age, sex, and time of onset) of 50 patients with hypertensive and lobar ICH were presented to 14 experienced neurologists and 15 neurosurgeons. Based on this information, the NIHSS and GCS scores were estimated for each patient. The differences between the actual GCS and NIHSS scores and the cCT-imaging-based estimated scores were plotted in a bland-Altman plot.
Results: The average estimated GCS score mainly based on cCT imaging was 12. 4 ± 2.8 (actual value: 13.0 ± 2.5; p = 0.100), the estimated NIHSS score was 13.9 ± 9.1 (actual value: 10.8 ± 7.3; p < 0.001). Thus, in cCT-imaging-based evaluation, the neurological status of patients especially employing the NIHSS was estimated poorer, particularly in patients with lobar ICH. “Reverse clinical” evaluation based on cCT-imaging alone may increase the rate of intubation and secondary transferal and neurosurgical treatment. Telestroke networks should consider both, videoassessment of the actual clinical picture and cCT-imaging findings to make appropriate acute treatment decisions.
Introduction
Spontaneous intracerebral hemorrhage (ICH) accounts for 10 to 15% of all strokes in Western populations, and the case fatality ranges between 40 and 55% (1). In patients with acute ICH, physicians need to immediately decide whether surgical or conservative treatment might be the best option for the patient. Often, patients are initially seen in primary care hospitals lacking specific neurological or neurosurgical departments. Non-specialized neurological examinations are increasingly followed by reading a patient's cerebral computed tomography imaging(cCT) via teleradiology consultation. In the case of ischemic stroke, the decision to conduct thrombolysis or even endovascular treatment basically relies on the NIHSS score, a cCT scan excluding ICH, an appropriate time window and, the status of the arteries leading to the brain (2). The NIHSS was primarily designed for estimation of the severity of clinical symptoms in patients suitable for thrombolysis (3), has few items, is quickly to perform and has excellent interrater reliability, supported by available online certification(4). In acute stroke therapy telemedicine is established in Germany in networks like the TeleMedical Project for integrative Stroke Care (TEMPiS) in Bavaria, Germany, since 15 years now and has significantly increased the rate of treated strokes and transient ischemic attacks as well as decreased the onset-to-treatment and door-to-needle time in clinically underserved areas (5). For clinical decision making, e.g., in thrombolysis, teleradiology using electronically transmitted original imaging data has to be completed by teleconsultation by a remotely located expert through the use of high quality videoconferencing (6). The same concept could also be used for the first neurological consultation of patients with intracerebral hemorrhage in rural areas.
However therapeutic strategies in ICH are less clearly defined, and clinical presentation may vary considerably depending on the ICH-specific information gained by the cCT scan. Significant predictive factors are the volume of intraparenchymal blood on the initial cCT scan, presence, and ongoing expansion of intraventricular hemorrhage (IVH), and the location and expansion of hematoma (7). The ICH score is the most widely used outcome score in this context, reflecting the level of consciousness, age, ICH volume, IVH, and the infratentorial location of ICH. These parameters are independent predictors for both acute and long-term outcome (7–9). Because patients with lobar ICH have a different clinical background than patients with non-lobar ICH, the outcome may also differ (1).
To the best of our knowledge, the accuracy of estimating the initial cliniconeurological presentation of a patient by means of a cCT scan, here termed “reverse correlation,” has not been investigated in a study. Therefore, our objective was to evaluate how precisely neurologists and neurosurgeons are able to estimate a patient's clinical status when presented with the patient's first cCT scan but without or with only minimal information on the clinical status of the patient. This is of importance for decision making with growing stroke networks primarily relying on (neuro)radiological consultation.
Materials and Methods
The anonymized files of the initial diagnostic cCT scans of 50 patients with acute neurological deficit and acute ICH on a CD-Rom were send to 20 board-certified neurologists and 20 board-certified neurosurgeons. Of these, 25 patients had signs of acute symptomatic deep ICH [also classified as hypertensive (deep) “typical” ICH due to the location, i.e. the basal ganglia, pons, or cerebellum (10)] and 25 patients had lobar “atypical” ICH. The raters were also provided only with additional information on patient age, sex, and the time between symptom onset and cCT imaging (see Table 1). As the patient data were only used in anonymized form to present them to the physicians neither local ethic approval nor patient consent was necessary. Patients were excluded if they had other causes of ICH such as excessive use of a vitamin K antagonist (INR >3), antecedent head trauma or ischemic stroke, CNS tumor, vascular malformation, vasculitis, blood dyscrasia, or coagulopathy (11). Patients with lobar ICH were only included if they had possible or probable cerebral amyloid angiopathy (CAA) according to the modified Boston criteria (12). These patients routinely underwent MRI with MR-angiography or CT-angiography to rule out any vasculopathy and to detect microbleedings or lobar bleeds in cortical regions or cortical superficial siderosis, which defines probable CAA in the later course of the disease (12). Median age of the patients was 71 years (range: 39 to 97 years) and 26/50 were women. Time from symptom onset to initial cCT-imaging was less than 1.5 h in 12 patients, 1.5 h to 4.5 h in 11 patients, 4.5 h to 12 h in 11 patients, and more than 12 h in 16 patients. This information was given to the raters.
Table 1. Patients characteristics: age, sex, time between symptom onset and initial cCT scan, actual GCS and NIHSS scores, medium GCS and NIHSS scores estimated by the neurologists or neurosurgeons on basis of the presented cCT scan and the basic information about the patient, delta GCS and NIHSS scores as the difference between the actual and the estimated GCS and NIHSS scores.
All raters were asked to estimate the NIHSS and GCS scores according to the cCT scan and the aforementioned basic clinical information. These data were compared with the GCS and NIHSS scores calculated on the basis of the patients' medical records at admission (here called “actual GCS/NIHSS”). Such comparison has been shown to be an appropriate method in previous studies (13). However, previous papers only could prove that for ischemic stroke, but considering the clinical parallels between ischemic and hemorrhagic stroke, we think it is adequate to also use this score for ICH.
Agreement between the actual and estimated NIHSS and GCS scores was evaluated on an individual patient basis, i.e., the patient's actual value was compared with one estimated value and calculated as the mean value of the estimate by all neurologists and neurosurgeons. The extent of agreement between the estimated and the actual NIHSS and GCS scores was quantified with the Bland-Altman plot (3). According to Krouwer (14), the actual NIHSS or GCS values rather than the average value were used on the X-axis. All plots include the mean difference, the 95% limits of confidence, and the regression line. Mean scores between the actual and estimated values were compared with a paired t-test. Differences between deep ICH and lobar ICH were analyzed with the Student's t-test. A p-value < 0.05 was considered statistically significant. All analyses were performed using R (version 3.3.3, The R Foundation for Statistical Computing).
Results
Fourteen of Twenty neurologists and Fifteen of Twenty neurosurgeons addressed answered our questionnaire. The actual mean GCS score of the total ICH patient collective was 14 [standard deviation (SD) 2.5; range 7–15], and the actual mean NIHSS score was 10 (SD 7.3; range 1 to 27) (Table 1). Plotting the difference between the actual GCS and NIHSS scores and the imaging-based estimated scores, we found that—on average—the GCS score was estimated lower than the actual GCS score which was not statistically significant (actual value: 13.0 ± 2.5 vs. estimated value: 12.4 ± 2.8, p = 0.100). In contrast, the NIHSS score was—on average—statistically significant estimated higher than the actual NIHSS score (actual value: 10.8 ± 7.3 vs. estimated value: 13.9 ± 9.1, p < 0.001). Thus, the raters had overestimated the patients' neurological deficits.
The NIHSS score estimated on the basis of the cCT-imaging findings correlated better with the actual values in patients with hypertensive ICH than in patients with lobar ICH (Figure 1). The same finding applied to GCS scores (Figure 2), but the results were not statistically significant: The difference between the actual and the rated GCS values was −0.80 for atypical ICH (95%–CI: −1.80, 0.20) vs. a difference of −0.28 for typical ICH (95%–CI: −1.16, 0.60), p = 0.42. The difference between the actual and the rated NIHSS values was larger for atypical ICH (3.20) (95%–CI: 0.60, 5.80) than for typical ICH (2.92) (95%–CI: 0.60, 5.24), p = 0.869.
Figure 1. The Bland-Altman-plot shows the difference between the actual and the estimated NIHSS scores (mean for all raters) on a patient basis: The mean estimated NIHSS score is too high by 1.24. For deep ICH, the delta of limits of confidence is smaller, which means the differences between the rated and the actual NIHSS scores are smaller; thus, the NIHSS score is estimated more accurately than that of lobar ICH.
Figure 2. The Bland-Altman-plot shows the difference between the actual and the estimated GCS scores (mean for all raters) on patient basis: On average, the estimated GSC score is too low by 1.07 without any significant differences between typical (i.e., deep) and atypical (i.e., lobar) ICH.
Therefore, the raters had fewer problems to properly appraise the actual clinical status of patients with deep ICH than that of patients with lobar ICH. Particularly patients with a low actual NIHSS score were often given higher scores by the raters, whereas patients with a high actual NIHSS score were given lower scores as you can see in the single patient analysis shown as dots in the Bland-Altman plots (Figures 1, 2). The large confidence intervals of NIHSS and GCS score estimates both for the total patient population and the subgroups with deep and lobar ICH showed wide variation between the raters' answers. A typical cCT scan of a patient resulting in overestimation of the clinical presentation by the raters is shown in Figure 3.
Figure 3. cCT scan of a 63-year old man, acquired between 4.5 and 12 h after symptom onset, showing left occipital ICH. Hemianopia to the left side resulted in a NIHSS score of 2 and in a GCS score of 15. The mean estimated NIHSS score was 11.2, the mean estimated GCS score 11.65.
Discussion
In this study, we investigated the “reverse correlation” of experienced neurologists and neurosurgeons examining the cCT scans of patients with ICH, who estimated GCS and NIHSS scores on the basis of only basic additional information on age, sex, and time from symptom onset to imaging. Our study shows that even board-certified neurologists with years of experience in supervising a stroke unit or a neurological ICU or neurosurgeons who regularly treat patients with ICH (see Tables 2, 3) encounter considerable difficulties in estimating the correct scores, which may lead to over-rating the clinical symptoms of patients. In fact, the extent to which estimated and actual scores differed was rather sobering. We also observed a tendency to avoid both high as well as low extremes of the NIHSS and GCS scores. This study is highly relevant in times of growing specialization in medicine and of expanding telemedicine networks.
Table 2. Age and years of experience of board-certified neurologists and neurosurgeons-raw data.
Table 3. Age and years of experience of board-certified neurologists and neurosurgeons and years of supervision of a stroke unit (neurologists only) or the number of operated ICH (neurosurgeons only)–statistics.
For patients with ICH, deep location and mass effects as well as some laboratory and clinical parameters [scored here by CSS (Canadian stroke scale), a score combining the level of consciousness, the degree of limb paresis and communication abnormalities] as well as systolic blood pressure at presentation were factors probably associated with poor outcome (15, 16).
Further relevant predictors for outcome and functional independence after 100 days are age and the NIHSS score at initial presentation, regardless of the location of the ICH (17, 18). In addition to the ICH score, the GCS score is also the most important independent predictor for patient outcome (9). Our study showed that solely relying on a cCT scan for clinical decision-making would lead to erroneous over-estimation of the clinical symptoms and therefore to possibly unnecessary neurosurgical treatments or transport of a patient. Thus, a specialized neurological examination is essential in the acute period of ICH and cannot be replaced by studying imaging scans alone. Telemedicine approaches including both clinical (mainly live stream communication) and radiological assessment by experts have been shown to be remarkably efficient and safe in assessing ischemic stroke including application of thrombolysis (19). Purely teleradiological networks for ICH evaluation by trained experts would be insufficient for immediate decision making.
Non-significant differences occur when estimating NIHSS and GCS scores in patients with hypertensive ICH versus lobar ICH. This finding is in line with a study showing a lower case fatality of patients with lobar ICH (1). This difference may at least in part be explained by the different location of lobar ICH, partly associated with less damage of eloquent brain structures and a lower rate of IVH and hydrocephalus due to the greater distance to the ventricles (20). The involvement of motor fibers and brain structures relevant for consciousness that both heavily weigh on NIHSS and GCS scores may also be more easily evaluated in the case of deep ICH than the more diverse effects of more superficial lesions. Patients with CAA-related ICH may develop some type of protective mechanism shifting away essential functions from the regions prone to bleed, for instance by previous microbleedings. Thus, subsequent lobar hemorrhage may be associated with fewer clinical symptoms than in patients with non-CAA related ICH due to ongoing neuroplasticity, similar to patients with a hemodynamically relevant stenosis of a cerebral vessel who suffer an ischemic stroke in the same region of the brain and are in part protected by ongoing collateral vessel formation (21).
To our knowledge, this is the first study addressing the reverse accuracy of clinical assessment based on cCT scans. One possible limitation of our study is that the included patients had a medium to high GCS score (GCS 7 to 15). Therefore, the question arises whether the results also fit patients with a low GCS score. In addition, we only included patients presenting to our neurological emergency unit that differs from emergency units including neurosurgery. Thus, our study possibly favored patients with a higher GCS score. However, differentiated neurological examination is not possible in most patients with a lower GCS score because such patients are often intubated before arrival in the hospital. The decision on patient care thus relies even more on other parameters such as neuroimaging. A further limitation is that statistical power is low due to small sample size. However, each participant examined 50 cCT scans with completely more than 1,000 images for this study. Neurologists are more familiar with NIHSS, neurosurgeons with GCS. This emphasizes the need for a common language or rather score for both, neurologists and neurosurgeons, for joint treatment decision making. A further concern that could be discussed is the experience of neurologists/neurosurgeons in reading cCT scans. All the same in telemedicine it is frequently up to them rather than to neuroradiologists to decide on patient care.
Our study suggests, that radiological criteria and only basic patient information cannot replace a thorough neurological examination of patients with acute ICH. Telemedical stroke networks should use their capacity for direct patient examination in adjunct to neuroimaging in order to avoid erroneous patient management and therapy.
Data Availability Statement
The raw data supporting the conclusions of this manuscript will be made available by the authors, without undue reservation, to any qualified researcher.
Author Contributions
AW, K-MS, and FS contributed conception and design of the study and analysis and interpretation of the data, AW and FS wrote the first draft of the manuscript, FZ contributed analysis and interpretation of the data and wrote parts of the manuscript, SI, AS, TK, DB, and RB wrote sections of the manuscript. All authors contributed to manuscript revision, read and approved the submitted version.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank Monika C. Schöll, BA, for her assistance in the editing of this paper.
References
1. Samaraskera N, Fonville A, Lerpiniere C, Farrall AJ, Wardlaw JM, White PM, et al. RAS for the lothian audit of the treatment of cerebral hemorrhage collaborators, influence of intracerebral hemorrhage location on incidence, characteristics, and outcome. population-based study. Stroke (2015) 46:361–8. doi: 10.1161/STROKEAHA.114.007953
2. Powers WJ, Derdeyn CP, Biller J, Coffey CS, Hoh BL, Jauch EC, et al. American heart association/American stroke association focused update of the 2013 guidelines for the early management of patients with acute ischemic stroke regarding endovascular treatment. A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association. Stroke (2015) 46: 3020–35. doi: 10.1161/STR.0000000000000074
3. Bland J, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet (1986) 1:307–10. doi: 10.1016/S0140-6736(86)90837-8
4. Lyden P, Raman R, Liu L, Grotta J, Broderick J, Olson S, et al. NIHSS training and certification using a new digital video disk is reliable. Stroke (2005) 36:2446–9. doi: 10.1161/01.STR.0000185725.42768.92
5. Müller-Barna P, Huber G, Boy S, Bogdahn U, Wiedmann S, Heuschmann PU, et al. TeleStroke units serving as a model of care in rural areas- 10-year experience of the TeleMedical project for integrative stroke care. Stroke (2014) 45:2739–44. doi: 10.1161/STROKEAHA.114.006141
6. Audebert HJ, Schwann L. Telestroke: scientific results. Cerebrovasc Dis. (2009) 27(Suppl. 4):15–20. doi: 10.1159/000213054
7. de Oliveira Manoel AL, Goffi A, Zampieri FG, Turkel-Parrella D, Duggal A, Marotta TR, et al. The critical care management of spontaneous intracranial hemorrhage: a contemporary review. Crit. Care (2016) 18:20–272. doi: 10.1186/s13054-016-1432-0
8. Hemphill JC, Farrant M, Neill TA. Prospective validation of the ICH Score for 12-month functional outcome. Neurology (2009) 73:1088–94. doi: 10.1212/WNL.0b013e3181b8b332
9. Ruiz-Sandoval J, Chiquete E, Romero-Vargas S, Padilla-Martínez JJ, Gonzáles-Cornejo S. Grading scale for prediction of outcome in primary intracerebral hemorrhages. Stroke (2007) 38:1641–4. doi: 10.1161/STROKEAHA.106.478222
10. Godoy D, Pinero GR, Koller P, Masotti L, Di Napoli M. Steps to consider in the approach and management of critically ill patient with spontaneous intracerebral hemorrhage. World J Crit Care Med. (2015) 4:213–29. doi: 10.5492/wjccm.v4.i3.213
11. Martí-Fàbregas J, Prats-Sánchez L, Martínez-Domeno A, Camps-Renom P, Marín R, Jiménez-Xarrié E, et al. The H-ATOMIC Criteria for the Etiologic Classification of Patients with Intracerebral Hemorrhage. PLoS ONE (2016) 11:e0156992. doi: 10.1371/journal.pone.0156992
12. Charidimou A, Gang Q, Werring DJ. Review-sporadic cerebral amyloid angiopathy revisited: recent insights into pathophysiology and clinical spectrum. J Neurol Neurosurg Psychiatry (2012) 83:124–37. doi: 10.1136/jnnp-2011-301308
13. Williams L, Yilmaz EY, Loez-Yunez AM. Retrospective assessment of initial stroke severity with the NIH stroke scale. Stroke (2000) 31:858–62. doi: 10.1161/01.STR.31.4.858
14. Krouwer J. Why Bland–Altman plots should use X, not (Y+X)/2 when X is a reference method. Stat Med. (2008) 27:778–80. doi: 10.1002/sim.3086
15. Castellanos M, Leira R, Tejada J, Gil-Peralta A, Dácalos A, Castillo J. Predictors of good outcome in medium to large spontaneous supratentorial intracerebral haemorrhages. J Neurol Neurosurg Psychiatry (2005) 76:691–5. doi: 10.1136/jnnp.2004.044347
16. Szepesi R, Széll IK, Horobágyi T, Kardos L, Nagy K, Lánczi LI, et al. New prognostic score for the prediction of 30-day outcome in spontaneous supratentorial cerebral haemorrhage. BioMed Res Int. (2015). 2015:961085. doi: 10.1155/2015/961085
17. Shaya M, Dubey A, Berk C, Gonzalez-Toledo E, Zhang J, Caldito G, et al. Factors influencing outcome in intracerebral hematoma: a simple, reliable, and accurate method to grade intracerebral hemorrhage. Surg Neurol. (2005) 63:343–8. doi: 10.1016/j.surneu.2004.06.019
18. Weimar C, Roth M, Willig V, Kostopoulos P, Benemann J, Diener HC. Development and validation of a prognostic model to predict recovery following intracerebral hemorrhage. J Neurol. (2006) 253:788–93. doi: 10.1007/s00415-006-0119-x
19. Audebert H. Effects of the implementation of a telemedical stroke network: the Telemedic Pilot Project for Integrative Stroke Care (TEMPiS) in Bavaria, Germany. Lancet Neurol. (2006) 5:742–8. doi: 10.1016/S1474-4422(06)70527-0
20. Moulin S, Cordonnier C. Prognosis and outcome of intracerebral hemorrhage. Front Neurol Neurosci. (2016) 37:182–92. doi: 10.1159/000437122
Keywords: intracerebral hemorrhage, quality of life, outcome, computed tomography, telestroke
Citation: Wagner A, Schebesch K-M, Zeman F, Isenmann S, Steinbrecher A, Kapapa T, Baldaranov D, Backhaus R and Schlachetzki F (2018) Primary cCT Imaging Based Clinico-Neurological Assessment—Calling for Addition of Telestroke Video Consultation in Patients With Intracerebral Hemorrhage. Front. Neurol. 9:607. doi: 10.3389/fneur.2018.00607
Received: 19 April 2018; Accepted: 09 July 2018;
Published: 26 July 2018.
Edited by:
Andreas Charidimou, Harvard Medical School, United StatesReviewed by:
Mirjam R. Heldner, Universität Bern, SwitzerlandMaurizio Acampa, Azienda Ospedaliera Universitaria Senese, Italy
Copyright © 2018 Wagner, Schebesch, Zeman, Isenmann, Steinbrecher, Kapapa, Baldaranov, Backhaus and Schlachetzki. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Andrea Wagner, andrea.wagner@klinik.uni-regensburg.de