ORIGINAL RESEARCH article

Front. Neurol., 24 November 2022

Sec. Neurocritical and Neurohospitalist Care

Volume 13 - 2022 | https://doi.org/10.3389/fneur.2022.968623

Development of nomogram to predict in-hospital death for patients with intracerebral hemorrhage: A retrospective cohort study

  • 1. Department of Neurosurgery, Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China

  • 2. Department of Pharmacy, Hunan Provincial People's Hospital, The First Affiliated Hospital of Hunan Normal University, Changsha, China

  • 3. Department of Critical Care Medicine, People's Hospital of Ningxia Hui Autonomous Region, Ningxia, China

Abstract

Aim:

This study aimed to investigate the association between systemic immune-inflammation (SII) and the risk of in-hospital death for patients with intracerebral hemorrhage (ICH) in the intensive care units (ICU) and to further develop a prediction model related to SII in predicting the risk of in-hospital death for patients with ICH.

Methods:

In this retrospective cohort study, we included 1,176 patients with ICH from the Medical Information Mart for Intensive Care III (MIMIC-III) database. All patients were randomly assigned to the training group for the construction of the nomogram and the testing group for the validation of the nomogram based on a ratio of 8:2. Predictors were screened by the least absolute shrinkage and selection operator (LASSO) regression analysis. A multivariate Cox regression analysis was used to investigate the association between SII and in-hospital death for patients with ICH in the ICU and develop a model for predicting the in-hospital death risk for ICU patients with ICH. The receiver operator characteristic curve was used to assess the predicting performance of the constructed nomogram.

Results:

In the training group, 232 patients with ICH died while 708 survived. LASSO regression showed some predictors, including white blood cell count, glucose, blood urea nitrogen, SII, the Glasgow Coma Scale, age, heart rate, mean artery pressure, red blood cell, bicarbonate, red blood cell distribution width, liver cirrhosis, respiratory failure, renal failure, malignant cancer, vasopressor, and mechanical ventilation. A prediction model integrating these predictors was established. The area under the curve (AUC) of the nomogram was 0.810 in the training group and 0.822 in the testing group, indicating that this nomogram might have a good performance.

Conclusion:

Systemic immune-inflammation was associated with an increased in-hospital death risk for patients with ICH in the ICU. A nomogram for in-hospital death risk for patients with ICH in the ICU was developed and validated.

Introduction

Intracerebral hemorrhage (ICH) is the most severe form of stroke characterized by bleeding into the brain parenchyma, which has a 1-month mortality rate of ~50% and has become one of the leading causes of disability and death worldwide (1, 2). A study from the Big Data Observatory platform for stroke in China reported that the in-hospital death rate of ICH was ~5.1%, and the 12-month disability rate was ~29.2% (3). The burden of disease for patients with ICH is huge, especially for those in intensive care units (ICUs). Therefore, an early prediction of death risk in patients with ICH is critical for assessing the severity of the disease and making appropriate treatment decisions.

Perihematomal edema (PHE) could occur within hours after ICH, which may trigger an inflammatory response and lead to a secondary brain injury (4, 5). Previously published studies have shown that inflammatory response played an important role in the development of ICH (6, 7). ICH drives inflammatory responses of microglia and T-cell-mediated in the brain, and these inflammatory responses were related to cytokine release and perihematomal edema, which might cause a poor prognosis after ICH (8). Nowadays, some inflammation parameters have been reported that might be associated with the prognosis of ICH, such as the neutrophil to lymphocyte ratio (NLR), the platelet to lymphocyte ratio (PLR), and the lymphocyte to monocyte ratio (LMR) (9–11). Recently, the systemic immune-inflammation (SII) index, as an integrated indicator based on peripheral lymphocytes, neutrophils, and platelets counts, was considered a new inflammatory marker and could reflect the local immune response and systemic inflammation (12, 13), which has a good prognostic value in a variety of tumors. Huang et al. highlighted that SII was related to the prognosis of patients with cervical cancer, and the nomogram based on SII showed a good predictive value for predicting postoperative survival of patients with cervical cancer (14). Nevertheless, as far as we know, there were few studies to evaluate the relationship between the SII and in-hospital death of patients with ICH in the ICU, and the predictive value of SII on in-hospital death.

Herein, the present study aimed to investigate the association between SII and the risk of in-hospital death for patients with ICH in the ICU and to further combine other prognostic indicators to develop a prediction model in predicting the risk of in-hospital death for patients with ICH.

Methods

Data sources and study population

In this retrospective cohort study, all data were derived from the Medical Information Mart for Intensive Care (MIMIC-III) database. MIMIC-III is a large, freely-available database, containing the de-identified health-related data of patients admitted to the ICU of the Beth Israel Deaconess Medical Center in 2001–2012 (15). This database collects some information, such as demographic characteristics, vital signs, laboratory tests, and imaging examinations (https://mimic.mit.edu/).

Included criteria are as follows: The patients diagnosed with ICH according to International Classification of Diseases 9th revision (ICD-9) codes = 431, 432, 9487, and 77210–77214 from the MIMIC-III database. Excluded criteria are as follows: The patients who (1) aged <18 years; (2) were hospitalized in the ICU for <24 h; (3) had missing data of SII; and (4) had missing data of other covariates. According to these inclusion and exclusion criteria, a total of 1,176 eligible patients with ICH were ultimately included in this retrospective cohort study (Figure 1). Since this study used data from an anonymous public database that was approved by the Institutional Review Boards of Beth Israel Deaconess Medical Center (Boston, MA) and the Massachusetts Institute of Technology (Cambridge, MA), it was not necessary to obtain the approval of an ethics committee from the People's Hospital of Ningxia Hui Autonomous Region.

Figure 1

Screening for potential predictors

In the present study, we extracted data about included patients from the MIMIC-III database (16, 17): age, gender, ethnicity, temperature (°C), heart rate (times/min), systolic blood pressure (SBP, mmHg), diastolic blood pressure (DBP, mmHg), mean artery pressure (MAP, mmHg), oxygen saturation (SpO2, %); the sequential organ failure assessment (SOFA) total score, the simplified acute physiology score II (SAPS II), the Glasgow Coma Scale (GCS), vasopressor, mechanical ventilation; comorbidities: chronic obstructive pulmonary disease (COPD), lung cancer, atrial fibrillation, liver cirrhosis, congestive heart failure (CHF), heart disease, diabetes, respiratory failure, hyperlipidemia, renal failure, malignant cancer, and hypertension; laboratory parameters: white blood cell count (WBC, K/μl), red blood cell (RBC, m/μl), sodium (mEq/L), potassium (mEq/L), calcium (mg/dl), magnesium (mg/dl), phosphate (mg/dl), platelet (K/μl), international normalized ratio (INR), mean corpuscular volume (MCV, fl), glucose (mg/dl), creatinine (Scr, mg/dl), blood urea nitrogen (BUN, mg/dl), bicarbonate (mEq/L), neutrophil (%), lymphocyte (%), hematocrit (%), hemoglobin (g/dl), mean corpuscular hemoglobin concentration (MCHC, %), red blood cell distribution width (RDW, %), and SII.

Outcome and follow-up

The primary endpoint of this study was regarded as in-hospital death, and the starting point of follow-up was defined as the date of the patient's admission with a median follow-up time of 23.48 (14.83, 30.25) days. The SII index was calculated by the following formula: platelet × neutrophil/lymphocyte (13).

Construction and validation of prediction nomogram

All included patients with ICH were randomly assigned to the training group for the construction of the nomogram and the testing group for the validation of the nomogram based on a ratio of 8:2. In the training group, predictors were screened by the least absolute shrinkage and selection operator (LASSO) regression analysis. These predictors were used to establish a prediction model. The receiver operator characteristic (ROC) curve was used to assess the predicting performance of the constructed nomogram.

Statistical analysis

All data of patients were analyzed by descriptive statistics. The measurement data conducted the normal distribution and the F-test. If measurement data conform to the normal distribution and the F-test, mean ± standard deviation (Mean ± SD) was used to describe the data, and the comparison between the two groups was performed by Student's t-test. If measurement data do not conform to the normal distribution, we used the median and quartile spacing [M (Q1, Q3)] to present the data, and the comparison between the two groups was performed by the Mann–Whitney U-test. In addition, the categorical data were depicted by the number of cases and the composition ratio n (%), and the difference of groups was compared by the chi-square test. The statistical analyses were performed by using SAS 9.4 (SAS Institute Inc., Cary, NC, USA), R 4.2.0, and Python 3.7.4 software.

In the training group, the LASSO regression analysis (18), as a method of shrinkage and variable selection for linear regression models, was adopted to identify predictors, and the optimal penalty parameter was determined by the 10-fold cross-validation. A multivariate Cox regression analysis was used to investigate the association between SII and in-hospital death of patients with ICH in the ICU and developed a model for predicting the in-hospital death risk for ICU patients with ICH by combining the predictors selected in the LASSO regression analysis. Additionally, we compared the predicting performance between the developed nomogram and the traditional scoring systems (SOFA and SAPSII). The hazard ratio (HR) and 95% confidence interval (CI) were calculated, and p < 0.05 was considered to be statistically significant. If the missing data of a variable were <5%, the samples with these missing data were deleted in our study, and the sensitivity analysis was performed in the population before and after deletion (Supplementary Table 1).

Results

Characteristics of patients with ICH

A total of 1,176 patients with ICH were included in this study. These eligible patients with ICH were randomly divided into the training group (n = 940) and the testing group (n = 236). In the training group, 232 patients with ICH died and 708 survived, and the baseline characteristics of patients are listed in Table 1. The patients with ICH in the death group, with a mean age of 69.53 years, were older than the survival group of 66.72 years. We found that the patients with ICH in the survival group were more likely to suffer from respiratory failure, renal failure, and mechanical ventilation than those in the death group. In addition, the patients with ICH in the death group had a higher SII index compared with the survival group.

Table 1

VariablesTotal (n = 940)Survival group (n = 708)Death group (n = 232)StatisticsP
Age, years, Mean ± SD67.41 ± 15.2866.72 ± 15.3369.53 ± 14.97t = −2.440.015
Gender, n (%)χ2 = 0.4750.491
  Male553 (58.83)421 (59.46)132 (56.90)
  Female387 (41.17)287 (40.54)100 (43.10)
Ethnicity, n (%)χ2 = 0.6930.707
  White696 (74.04)527 (74.44)169 (72.84)
  Black70 (7.45)54 (7.63)16 (6.90)
  Other#174 (18.51)127 (17.94)47 (20.26)
Insurance, n (%)χ2 = 8.1270.017
  Medicare541 (57.55)391 (55.23)150 (64.66)
  Other*125 (13.30)94 (13.28)31 (13.36)
  Private274 (29.15)223 (31.50)51 (21.98)
LOS, days, M (Q1, Q3)3.15 (1.90, 6.99)3.07 (1.88, 7.34)3.44 (2.05, 6.14)Z = 0.3740.708
Temperature, °C, Mean ± SD36.71 ± 1.5136.69 ± 1.6036.77 ± 1.22t = −0.730.463
Heart rate, times/min, Mean ± SD81.45 ± 17.3380.22 ± 16.1485.20 ± 20.11t = −3.43<0.001
SBP, mmHg, Mean ± SD141.85 ± 25.60142.53 ± 24.51139.79 ± 28.64t = 1.310.191
DBP, mmHg, Mean ± SD71.75 ± 17.5272.37 ± 17.0269.87 ± 18.90t = 1.790.074
MAP, mmHg, Mean ± SD91.65 ± 17.9792.49 ± 17.3989.06 ± 19.46t = 2.390.017
SPO2, %, Mean ± SD97.98 ± 3.8397.79 ± 4.2098.53 ± 2.26t = −3.42<0.001
WBC, K/uL, M (Q1, Q3)10.10 (7.60, 13.25)9.80 (7.55, 12.60)11.60 (8.40, 15.50)Z = 4.312<0.001
RBC, m/uL, Mean ± SD4.23 ± 0.744.28 ± 0.694.07 ± 0.86t = 3.38<0.001
Sodium, mEq/L, Mean ± SD138.61 ± 4.62138.61 ± 4.34138.58 ± 5.41t = 0.090.925
Potassium, mEq/L, Mean ± SD4.13 ± 0.824.12 ± 0.764.15 ± 0.97t = −0.410.685
Phosphate, mg/dL, M (Q1, Q3)3.20 (2.70, 3.80)3.20 (2.70, 3.70)3.10 (2.70, 3.90)Z = −0.6230.533
Calcium, mg/dL, Mean ± SD8.86 ± 0.818.88 ± 0.768.78 ± 0.93t = 1.420.156
Platelet, K/uL, M (Q1, Q3)230.00 (176.00, 287.50)232.50 (178.00, 287.00)223.50 (158.00, 298.00)Z = −1.1990.231
INR, ratio, M (Q1, Q3)1.10 (1.10, 1.40)1.10 (1.10, 1.30)1.20 (1.10, 1.60)Z = 2.8010.005
MCV, fL, Mean ± SD89.45 ± 6.4889.11 ± 6.1090.48 ± 7.42t = −2.550.011
Magnesium, mg/dL, Mean ± SD1.94 ± 0.321.95 ± 0.311.91 ± 0.36t = 1.180.238
Glucose, mg/dL, M (Q1, Q3)134.00 (109.00, 169.00)129.00 (108.00, 163.00)150.00 (118.00, 198.00)Z = 5.190<0.001
Creatinine, mg/dL, M (Q1, Q3)0.90 (0.80, 1.20)0.90 (0.80, 1.10)1.00 (0.80, 1.30)Z = 1.5740.115
BUN, mg/dL, M (Q1, Q3)18.00 (13.00, 24.00)17.00 (13.00, 23.00)20.00 (15.00, 27.50)Z = 4.050<0.001
Bicarbonate, mEq/L, Mean ± SD24.69 ± 3.7624.86 ± 3.6024.16 ± 4.15t = 2.300.022
Neutrophil, %, Mean ± SD78.09 ± 13.7777.66 ± 13.0879.40 ± 15.66t = −1.520.129
Lymphocytes, %, M (Q1, Q3)12.20 (7.80, 19.20)13.25 (8.65, 20.15)10.00 (5.95, 16.20)Z = −5.076<0.001
Hematocrit, %, Mean ± SD37.61 ± 6.0737.96 ± 5.7436.55 ± 6.88t = 2.820.005
Hemoglobin, g/dL, Mean ± SD12.83 ± 2.1812.97 ± 2.0612.39 ± 2.46t = 3.250.001
MCHC, %, Mean ± SD34.08 ± 1.4134.15 ± 1.4233.86 ± 1.38t = 2.780.006
RDW, %, Mean ± SD14.39 ± 1.8714.22 ± 1.7514.92 ± 2.11t = −4.53<0.001
SII, M (Q1, Q3)1520.30 (788.22, 2607.95)1409.97 (777.82, 2401.21)1869.86 (848.88, 3453.13)Z = 3.396<0.001
SAPS II, M (Q1, Q3)34.00 (27.00, 44.00)32.50 (26.00, 40.00)43.00 (35.00, 54.00)Z = 11.167<0.001
SOFA, M (Q1, Q3)4.00 (2.00, 6.00)3.00 (2.00, 5.50)6.00 (5.00, 8.00)Z = 12.533<0.001
GCS, M (Q1, Q3)14.00 (11.00, 15.00)14.00 (12.00, 15.00)15.00 (7.00, 15.00)Z = −0.9370.349
Vasopressor, yes, n (%)34 (3.62)5 (0.71)29 (12.50)χ2 = 69.719<0.001
Mechanical ventilation, yes, n (%)535 (56.91)337 (47.60)198 (85.34)χ2 = 101.527<0.001
COPD, yes, n (%)69 (7.34)53 (7.49)16 (6.90)χ2 = 0.0890.765
Lung cancer, yes, n (%)25 (2.66)22 (3.11)3 (1.29)χ2 = 2.2220.136
Atrial fibrillation, yes, n (%)235 (25.00)171 (24.15)64 (27.59)χ2 = 1.0990.295
Liver cirrhosis, yes, n (%)25 (2.66)10 (1.41)15 (6.47)χ2 = 17.235<0.001
CHF, yes, n (%)154 (16.38)107 (15.11)47 (20.26)χ2 = 3.3770.066
Heart disease, yes, n (%)39 (4.15)26 (3.67)13 (5.60)χ2 = 1.6390.201
Diabetes, yes, n (%)182 (19.36)139 (19.63)43 (18.53)χ2 = 0.1350.713
Respiratory failure, yes, n (%)222 (23.62)152 (21.47)70 (30.17)χ2 = 7.3380.007
Hyperlipidemia, yes, n (%)273 (29.04)216 (30.51)57 (24.57)χ2 = 2.9910.084
Renal failure, yes, n (%)138 (14.68)92 (12.99)46 (19.83)χ2 = 6.5140.011
Malignant cancer, yes, n (%)189 (20.11)156 (22.03)33 (14.22)χ2 = 6.6350.010
Hypertension, yes, n (%)653 (69.47)492 (69.49)161 (69.40)χ2 = 0.0010.978
Time, days, M (Q1, Q3)23.54 (14.23, 30.38)25.15 (18.14, 31.92)14.94 (8.80, 23.38)Z = −10.024<0.001

The characteristics of included patients in the training group.

Other#: Asian, Hispanic, and so on; Other*: Government, Medicaid, and self-pay; LOS, length of stay; SBP, systolic blood pressure; DPB, diastolic blood pressure; MAP, mean artery pressure; SpO2, oxygen saturation; SAPS II, simplified acute physiology score II; SOFA, sequential organ failure assessment; GCS, Glasgow Coma Scale; COPD, chronic obstructive pulmonary disease; CHF, congestive heart failure; WBC, white blood cell count; RBC, red blood cell; SII, systemic immune-inflammation; INR, international normalized ratio; MCV, mean corpuscular volume; Scr, creatinine; BUN, blood urea nitrogen; MCHC, mean corpuscular hemoglobin concentration; RDW, red blood cell distribution width; χ2: Chi-square test; Z: Mann–Whitney U rank sum test.

SII was associated with the risk of in-hospital death in ICU patients with ICH

As shown in Figure 2, 17 predictors were identified through the LASSO regression analysis. These predictors included WBC, glucose, BUN, SII, GCS, age, heart rate, MAP, RBC, bicarbonate, RDW, liver cirrhosis, respiratory failure, renal failure, malignant cancer, vasopressor, and mechanical ventilation. The result of the multivariate Cox regression analysis showed (Table 2) that SII was associated with the risk of in-hospital death among patients with ICH in the ICU. Notably, SII might be an independent risk factor of in-hospital death for patients with ICH in the ICU, with an HR of 1.12 (95% CI: 1.02–1.22).

Figure 2

Table 2

VariablesHR (95%CI)P
Age1.54 (1.32, 1.81)<0.001
MAP0.95 (0.83, 1.09)0.440
Heart rate1.16 (1.03, 1.32)0.019
GCS0.85 (0.76, 0.95)0.004
WBC1.01 (0.94, 1.09)0.716
Glucose1.18 (1.07, 1.32)0.001
BUN0.99 (0.86, 1.13)0.840
SII1.12 (1.02, 1.22)0.013
RBC0.96 (0.83, 1.11)0.569
Bicarbonate1.09 (0.96, 1.25)0.185
RDW1.22 (1.08, 1.38)0.001
Vasopressor, yes3.60 (2.22, 5.83)<0.001
Mechanical ventilation, yes3.99 (2.69, 5.91)<0.001
Liver cirrhosis, yes2.36 (1.31, 4.24)0.004
Respiratory failure, yes0.56 (0.40, 0.76)<0.001
Renal failure, yes0.84 (0.55, 1.27)0.409
Malignant cancer, yes0.73 (0.50, 1.07)0.104

The HR of the selected predictor in multivariate Cox regression analysis.

HR, hazard ratio; CI, confidence interval; MAP, mean artery pressure; GCS, Glasgow Coma Scale; WBC, white blood cell count; BUN, blood urea nitrogen; SII, systemic immune-inflammation; RBC, red blood cell; RDW, red blood cell distribution width.

Development and validation of prediction nomogram

In the training group, a prediction model integrating WBC, glucose, BUN, SII, GCS, age, heart rate, MAP, RBC, bicarbonate, RDW, liver cirrhosis, respiratory failure, renal failure, malignant cancer, vasopressors, and mechanical ventilation was established. Additionally, for visualizing the prediction model, we plotted a nomogram to predict the probability of in-hospital death for patients with ICH (Figure 3). For example, as shown in Figure 4, the patient was 60 years old with a heart rate of 62 times/min. The MAP was 92 mmHg and the WBC was 15.9 K/μl. The RBC was 4.38 m/μl and the glucose was 111 mg/dl. The BUN was 16 mg/dl and the bicarbonate was 26 mEq/L. The RDW was 13.5% and the GCS was 15. The patient had no complications with liver cirrhosis, respiratory failure, renal failure, or malignant cancer. In addition, the patient did not use vasopressors and mechanical ventilation. According to the nomogram, the total point was 723 and the corresponding predicted probability was 0.042, which indicated a lower risk of death and was in line with the actual outcome of the patient. An online prediction nomogram is available: https://os-model.shinyapps.io/DynNomapp/.

Figure 3

Figure 4

According to the ROC analysis (Figure 5 and Table 3), the area under the curve (AUC) of the nomogram (training group: AUC = 0.810, 95% CI: 0.779–0.840; testing group: AUC = 0.822, 95% CI: 0.765–0.880) was significantly higher than the SOFA (training group: AUC = 0.772, 95% CI: 0.740–0.804; testing group: AUC = 0.745, 95% CI: 0.673–0.818) and SAPS II (training group: AUC = 0.744, 95% CI: 0.708–0.780; testing group: AUC = 0.718, 95% CI: 0.646–0.790) scores. Furthermore, Table 3 also displays that the nomogram has good accuracy, specificity, sensitivity, positive predictive value (PPV), and negative predictive value (NPV) in recognizing whether the ICU patients with ICH survived or were in-hospital death, with 0.712 (95% CI: 0.683–0.741), 0.695 (95% CI: 0.661–0.729), 0.763 (95% CI: 0.708–0.818), 0.450 (95% CI: 0.401–0.500), and 0.899 (95% CI: 0.874–0.925) in the training group and 0.695 (95% CI: 0.636–0.754), 0.650 (95% CI: 0.581–0.719), 0.849 (95% CI: 0.753–0.945), 0.413 (95% CI: 0.320–0.505), and 0.937 (95% CI: 0.895–0.979) in the testing group, respectively.

Figure 5

Table 3

Cut offAUC (95%CI)Accuracy (95%CI)Specificity (95%CI)Sensitivity (95%CI)PPV (95%CI)NPV (95%CI)
NomogramTraining group0.7010.810 (0.779–0.840)0.712 (0.683–0.741)0.695 (0.661–0.729)0.763 (0.708-0.818)0.450 (0.401-0.500)0.899 (0.874-0.925)
Testing group0.822 (0.765–0.880)0.695 (0.636–0.754)0.650 (0.581–0.719)0.849 (0.753–0.945)0.413 (0.320–0.505)0.937 (0.895–0.979)
SOFATraining group0.5220.772 (0.740–0.804)0.669 (0.639–0.699)0.631 (0.596–0.667)0.784 (0.732–0.837)0.411 (0.365–0.457)0.899 (0.873–0.926)
Testing group0.745 (0.673–0.818)0.712 (0.654–0.770)0.749 (0.686–0.811)0.585 (0.452–0.718)0.403 (0.293–0.512)0.862 (0.808–0.915)
SAPSIITraining group0.5210.744 (0.708–0.780)0.690 (0.661–0.720)0.702 (0.668–0.736)0.655 (0.594–0.716)0.419 (0.368–0.469)0.861 (0.833–0.890)
Testing group0.718 (0.646–0.790)0.640 (0.579–0.701)0.656 (0.587–0.725)0.585 (0.452–0.718)0.330 (0.235–0.425)0.845 (0.786–0.905)

Predictive value of the nomogram.

SAPS II, simplified acute physiology score II; SOFA, sequential organ failure assessment; AUC, area under the curve; PPV, positive predictive value; NPV, negative predictive value; CI, confidence interval.

Discussion

In this retrospective cohort study, we found that SII was an independent risk factor of in-hospital death for patients with ICH in the ICU. A prediction model integrating WBC, glucose, BUN, SII, GCS, age, heart rate, MAP, RBC, bicarbonate, RDW, liver cirrhosis, respiratory failure, renal failure, malignant cancer, vasopressors, and mechanical ventilation was established. To our knowledge, this is the first study to explore the relationship between SII and the in-hospital death risk of patients with ICH in the ICU and develop and validate a nomogram associated with SII to predict the risk of in-hospital death among patients with ICH in the ICU. This nomogram showed a good performance to predict the in-hospital death risk for patients with ICH in the ICU in both the training and testing groups.

Inflammatory molecules, as key participants in the secondary injury process after ICH, were also associated with a poor prognosis of ICH (19). For example, an increased C-reactive protein (CRP) level has been found to be a risk factor for predicting an unfavorable prognosis of primary ICH (20). In the study of Miao et al., Interleukin 33 (IL-33) on admission may also be a prognostic indicator of ICH (21). Despite the fact that these inflammatory molecules showed a good performance value in predicting the prognosis of patients with ICH, their clinical application was limited due to the high cost of detection. SII, as an innovative inflammatory biomarker, has been proven to comprehensively reflect the inflammatory state in the body (22). The SII index is composed of neutrophils, lymphocytes, and platelets in which the three components are indicators of blood routine examination (23). In general, a blood routine is a routine examination for all critically ill hospitalized patients. Therefore, compared with other inflammatory indicators, the SII index is simpler, faster, and more inexpensive for clinical application (23).

In this study, the findings indicated that the SII index might be an independent risk factor for in-hospital death among patients with ICH in the ICU, and the higher the SII level, the higher the risk of in-hospital mortality may be. The mechanisms behind the association of SII and poor prognosis of ICH are still unclear so far, and the explanation might be as follows: an increase in SII levels implies a relative increase of platelet and neutrophil counts or a relative decrease of lymphocytes. Platelets are considered an important component of the hemostatic system (24). When patients suffer from ICH, the platelet count in the peripheral circulation increase, leading to a hypercoagulable state that might increase the risk of adverse outcomes (25, 26). In general, damage to vulnerable parts of the central nervous system may increase the sympathetic system or the hypothalamic-pituitary-adrenal axis, which may favor apoptosis of peripheral lymphocytes and lead to a decrease in the number of lymphocytes, thus contributing to a lower immune capacity and a higher risk of infection (27). Neutrophils can induce neurotoxicity through the release of pro-inflammatory cytokines, free radicals, and other toxic chemicals, which further lead to the destruction of the blood-brain barrier and exacerbate the brain damage caused by ICH (26–28).

Recently, a nomogram has been widely used as a prognostic tool to predict individual probabilities of clinical events by using individual variables (29). For the in-hospital death risk of patients with ICH in the ICU, our study is the first to provide a simple and effective nomogram related to SII. The clinician could calculate the score of each indicator and then add up each score to get the final total score, which could correspond to the probability of in-hospital death risk in the nomogram. We believed that the nomogram might help clinicians to quickly and easily understand the risk of death of patients and make timely individualized prevention. Not only that, the nomogram also might show good predicting performance in the in-hospital death risk of patients with ICH in the ICU by the ROC analysis, calibration curve, and DCA. In addition, we compared the predictive ability between the proposed nomogram and the two traditional predictive scoring systems (SOFA and SAPS II). The result also found that the nomogram showed a better predictive ability than the SOFA and SAPS II.

However, the present study had several limitations. First, as a single-center and retrospective study, the sample size was relatively small. Although the nomogram might have a good performance for predicting the death risk of in-hospital patients with ICH in the ICU through internal verification, this nomogram was constructed based on the U.S. population who were hospitalized in the ICU for >24 h, and these patients may be admitted to the ICU as a result of a variety of other factors, such as self-selecting for patients with a worse prognosis. Thus, its generalizability to other populations was still unclear. More prospective and multi-center studies are needed to confirm this result in the future. Second, because all data of this study were derived from the MIMIC-III database, and we could not obtain the imaging features of ICH (such as hematoma volume, hematoma location, intraventricular hemorrhage, intraventricular extension, midline shift, and brainstem extension), and some inflammatory markers (such as C-reactive protein, interleukin-6, and tumor necrosis factor-α), but, the established nomogram contained some indicators that are easy to obtain, and the use of the model has lower professional requirements for medical staff, which makes it more convenient for application in clinical practice. Third, we excluded some patients with missing data, this was also a significant limitation of this study. Fourth, the ICH score (30), as a simple and reliable grading scale for ICH, was not recorded in the MIMIC-III database. Therefore, we did not compare the performance of the nomogram and the ICH score. Last, external validation should be still required in the future.

Conclusion

In summary, SII was associated with an increased in-hospital death risk for patients with ICH in the ICU. Importantly, we developed and validated a nomogram for the risk of in-hospital death for patients with ICH in the ICU, including WBC, glucose, BUN, SII, GCS, age, heart rate, MAP, RBC, bicarbonate, RDW, liver cirrhosis, respiratory failure, renal failure, malignant cancer, vasopressors, and mechanical ventilation. Additionally, the nomogram showed good performance in both the training and testing groups. We believed that the developed nomogram will be a simple and convenient tool to help clinicians accurately identify ICH patients with a high in-hospital death risk.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Statements

Data availability statement

The data analyzed in this study was obtained from the Medical Information Mart for Intensive Care III (MIMIC-III) database, the following licenses/restrictions apply: To access the files, users must be a credentialed user, finish the required training and sign the data use agreement for the project. Requests to access these datasets should be directed to PhysioNet, https://physionet.org/, https://doi.org/10.13026/C2XW26.

Ethics statement

Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. Written informed consent from the patients/participants or patients/participants' legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.

Author contributions

LH and XL designed the study. LH wrote the manuscript. JY, JD, HZ, and FY collected, analyzed, and interpreted the data. XL critically reviewed, edited, and approved the manuscript. All authors read and approved the final manuscript.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2022.968623/full#supplementary-material

References

  • 1.

    KirshnerHSchragM. Management of Intracerebral Hemorrhage: Update and Future Therapies. Curr Neurol Neurosci Rep. (2021) 21:57. 10.1007/s11910-021-01144-9

  • 2.

    NawabiJKniepHElsayedSFriedrichCSpornsPRuscheTet al. Imaging-Based Outcome Prediction of Acute Intracerebral Hemorrhage. Transl Stroke Res. (2021) 12:958–67. 10.1007/s12975-021-00891-8

  • 3.

    TuWJChaoBHMaLYanFCaoLQiuHet al. (2021). Case-fatality, disability and recurrence rates after first-ever stroke: A study from bigdata observatory platform for stroke of China Brain Res Bull. (2021) 175:130–5020. 10.1016/j.brainresbull.2021.07.020

  • 4.

    LiZLiMShiSXYaoNChengXGuoAet al. Brain transforms natural killer cells that exacerbate brain edema after intracerebral hemorrhage. J Exp Med. (2020) 217:0213. 10.1084./jem.20200213

  • 5.

    ChenYChenSChangJWeiJFengMWangRet al. Perihematomal edema after intracerebral hemorrhage: an update on pathogenesis, risk factors, and therapeutic advances. Front Immunol. (2021) 12:740632. 10.3389/fimmu.2021.740632

  • 6.

    BernsteinJESavlaPDongFZampellaBWigintonJGMiulliDEet al. Inflammatory markers and severity of intracerebral hemorrhage. Cureus. (2018) 10.e3529. 10.7759/cureus.3529

  • 7.

    Bjerkne WennebergSOdenstedt HergèsHSvedinPMallardCKarlssonTAdielsMet al. Association between inflammatory response and outcome after subarachnoid haemorrhage. Acta Neurol Scand. (2021) 143:195–205. 10.1111/ane.13353

  • 8.

    FuYLiuQAnratherJShiFD. Immune interventions in stroke. Nat Rev Neurol. (2015) 11:524–35. 10.1038/nrneurol.2015.144

  • 9.

    QiHWangDDengXPangX. Lymphocyte-to-monocyte ratio is an independent predictor for neurological deterioration and 90-day mortality in spontaneous intracerebral hemorrhage. Med Sci Monit. (2018) 24:9282–91. 10.12659/MSM.911645

  • 10.

    ZhangWShenY. Platelet-to-lymphocyte ratio as a new predictive index of neurological outcomes in patients with acute intracranial hemorrhage: a retrospective study. Med Sci Monit. (2018) 24:4413–20. 10.12659/MSM.910845

  • 11.

    LiuSLiuXChenSXiaoYZhuangW. Neutrophil-lymphocyte ratio predicts the outcome of intracerebral hemorrhage: a meta-analysis. Medicine. (2019) 98:e16211. 10.1097/MD.0000000000016211

  • 12.

    YangYLWuCHHsuPFChenSCHuangSSChanWLet al. Systemic immune-inflammation index (SII) predicted clinical outcome in patients with coronary artery disease. Eur J Clin Invest. (2020) 50:e13230. 10.1111/eci.13230

  • 13.

    BartlTBekosCPostlMAlexanderRPolterauerSStefanieAet al. The systemic immune-inflammation index (SII) is an independent prognostic parameter of survival in patients with invasive vulvar cancer. J Gynecol Oncol. (2021) 32:e1e1. 10.3802/jgo.2021.32.e1

  • 14.

    HuangHLiuQZhuLZhangYLuXWuYet al. Prognostic value of preoperative systemic immune-inflammation index in patients with cervical cancer. Sci Rep. (2019) 9:3284. 10.1038/s41598-019-39150-0

  • 15.

    FengMMcSparronJIKienDTStoneDJRobertsDHSchwartzsteinRMet al. Transthoracic echocardiography and mortality in sepsis: analysis of the MIMIC-III database. Intensive Care Med. (2018) 44:884–92. 10.1007/s00134-018-5208-7

  • 16.

    ZouJChenHLiuCCaiZYangJZhangYet al. Development and validation of a nomogram to predict the 30-day mortality risk of patients with intracerebral hemorrhage. Front Neurosci. (2022) 16:942100. 10.3389/fnins.2022.942100

  • 17.

    JiRShenHPanYWangPLiuGWangYet al. A novel risk score to predict 1-year functional outcome after intracerebral hemorrhage and comparison with existing scores. Crit Care. (2013) 17:R275. 10.1186/cc13130

  • 18.

    CaiXTJiLWLiuSSWangMRHeizhatiMLiNFet al. Derivation and validation of a prediction model for predicting the 5-year incidence of type 2 diabetes in non-obese adults: a population-based cohort study. Diabetes Metab Syndr Obes. (2021) 14:2087–101. 10.2147/DMSO.S304994

  • 19.

    WalshKBZhangXZhuXWohlebEWooDLuLet al. Intracerebral hemorrhage induces inflammatory gene expression in peripheral blood: global transcriptional profiling in intracerebral hemorrhage patients. DNA Cell Biol. (2019) 38:660–9. 10.1089/dna.2018.4550

  • 20.

    LöppönenPQianCTetriSJuvelaSHuhtakangasJBodeMKet al. Predictive value of C-reactive protein for the outcome after primary intracerebral hemorrhage. J Neurosurg. (2014) 121:1374–9. 10.3171/2014.7.JNS132678

  • 21.

    MiaoYZhangZXFengXSunWM. IL-33 as a novel serum prognostic marker of intracerebral hemorrhage. Oxid Med Cell Longev. (2021) 2021:5597790. 10.1155/2021/5597790

  • 22.

    PengYHuangWShiZChenYMaJ. Positive association between systemic immune-inflammatory index and mortality of cardiogenic shock. Clin Chim Acta. (2020) 511:97–103022. 10.1016/j.cca.2020.09.022

  • 23.

    TangYZengXFengYChenQLiuZLuoHet al. Association of systemic immune-inflammation index with short-term mortality of congestive heart failure: a retrospective cohort study. Front Cardiovasc Med. (2021) 8:753133. 10.3389/fcvm.2021.753133

  • 24.

    van der MeijdenPEJHeemskerkJWM. Platelet biology and functions: new concepts and clinical perspectives. Nat Rev Cardiol. (2019) 16:166–79. 10.1038/s41569-018-0110-0

  • 25.

    TaoCWangJHuXMaJLiHYouCet al. Clinical value of neutrophil to lymphocyte and platelet to lymphocyte ratio after aneurysmal subarachnoid hemorrhage. Neurocrit Care. (2017) 26:393–401. 10.1007/s12028-016-0332-0

  • 26.

    LiYWenDCuiWChenYZhangFYuanMet al. The prognostic value of the acute phase systemic immune-inflammation index in patients with intracerebral hemorrhage. Front Neurol. (2021) 12:628557. 10.3389/fneur.2021.628557

  • 27.

    LattanziSCagnettiCRinaldiCAngelocolaSProvincialiLSilvestriniMet al. Neutrophil-to-lymphocyte ratio improves outcome prediction of acute intracerebral hemorrhage. J Neurol Sci. (2018) 387:98–102038. 10.1016/j.jns.2018.01.038

  • 28.

    GongXLuZFengXYuCXueMYuLet al. Elevated neutrophil-to-lymphocyte ratio predicts depression after intracerebral hemorrhage. Neuropsychiatr Dis Treat. (2020) 16:2153–9. 10.2147/NDT.S269210

  • 29.

    WuYHuHCaiJChenRZuoXChengHet al. A prediction nomogram for the 3-year risk of incident diabetes among Chinese adults. Sci Rep. (2020) 10:21716. 10.1038/s41598-020-78716-1

  • 30.

    Hemphill JCIIIBonovichDCBesmertisLManleyGTJohnstonSC. The ICH score: a simple, reliable grading scale for intracerebral hemorrhage. Stroke. (2001) 32:891–7. 10.1161/01.STR.32.4.891

Summary

Keywords

systemic immune-inflammation, intracerebral hemorrhage, MIMIC-III database, in-hospital death, nomogram

Citation

Hu L, Yu J, Deng J, Zhou H, Yang F and Lu X (2022) Development of nomogram to predict in-hospital death for patients with intracerebral hemorrhage: A retrospective cohort study. Front. Neurol. 13:968623. doi: 10.3389/fneur.2022.968623

Received

16 June 2022

Accepted

31 October 2022

Published

24 November 2022

Volume

13 - 2022

Edited by

Robert Jeenchen Chen, Stanford University, United States

Reviewed by

Zhibin Chen, Monash University, Australia; Tong Chen, North China University of Science and Technology, China; Jia Xu Lim, National Neuroscience Institute (NNI), Singapore

Updates

Copyright

*Correspondence: Xiaohang Lu

This article was submitted to Neurocritical and Neurohospitalist Care, a section of the journal Frontiers in Neurology

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics