Skip to main content

ORIGINAL RESEARCH article

Front. Neurol., 15 January 2024
Sec. Neurocritical and Neurohospitalist Care

Exploring the utility of a latent variable as comprehensive inflammatory prognostic index in critically ill patients with cerebral infarction

  • 1Tianjin Key Laboratory of Cerebral Vascular and Neurodegenerative Diseases, Tianjin Neurosurgical Institute, Tianjin Huanhu Hospital, Tianjin, China
  • 2Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin, China
  • 3Neural Intensive Care Unit, Tianjin Huanhu Hospital, Tianjin, China

Objective: We introduce the comprehensive inflammatory prognostic index (CIPI), a novel prognostic tool for critically ill cerebral infarction patients, designed to meet the urgent need for timely and convenient clinical decision-making in this high-risk patient group.

Methods: Using exploratory factor analysis on selected indices—neutrophil to lymphocyte ratio (NLR), systemic inflammation response index (SIRI), and systemic immune inflammation index (SIII)—we derived CIPI, a latent variable capturing their combined predictive power. Data from 1,022 patients in the Medical Information Mart for Intensive Care (MIMIC)-IV database were used to develop CIPI-based survival models, with the robustness and area under the receiver operating characteristic curve (AUC) performance of CIPI validated against an independent dataset of 326 patients from the MIMIC-III CareVue subset. The CIPI’s predictive power for in-hospital and intensive care unit (ICU) mortality was assessed through Kaplan–Meier analysis, univariate and multivariate Cox regression models, and time-dependent AUC analysis. Linearity, subgroup sensitivity analyses and interaction effects with CIPI were also evaluated.

Results: CIPI was an independent prognostic factor, demonstrating a statistically significant association with in-hospital and ICU mortality, when assessed as a continuous and a categorical variable. It showed a linear relationship with mortality rates and demonstrated stability across most subgroups, with no significant interactions observed. Its predictive capabilities for in-hospital and ICU mortality among critically ill cerebral infarction patients matched those of established prognostic indices in the MIMIC database.

Conclusion: Our study indicates that CIPI is a reliable and effective prognostic tool for critically ill cerebral infarction patients in predicting in-hospital and ICU mortality. Its straightforward calculation, rooted in routine blood tests, enhances its practicality, promising significant utility in clinical settings.

Introduction

Critically ill patients suffering from cerebral infarction, a distinct and severe form of ischemic stroke, constitute a subgroup with substantial healthcare needs (1). Marked by significant neurological deficits and prone to multi-system complications and comorbidities, these individuals often require intensive care unit (ICU) management (2, 3). The seriousness of their condition is mirrored in the elevated mortality rates observed during their hospital stays (4, 5), underscoring the pressing need for enhanced prognostic tools. Precisely and timely predicting which patients in the ICU with cerebral infarction are most at risk of adverse outcomes is a critical clinical imperative; it is a key determinant that can profoundly influence the direction of therapeutic strategies and patient care (6). Building on previous research, our study is committed to identifying an independent and comprehensive prognostic index that is not only effective but also accessible in predicting in-hospital and ICU mortality for this at-risk patient group.

Increasingly, prognostic significance in critically ill patients with cerebral infarction is being assigned to inflammation-related composite hematological indices (79). Indices such as the neutrophil to lymphocyte ratio (NLR), systemic inflammation response index (SIRI), and the systemic immune inflammation index (SIII) have all been independently associated with in-hospital mortality in critically ill patients with cerebral infarction (810). However, including these highly correlated composite hematological indices in survival analysis models simultaneously can lead to common issues like multicollinearity, complicating their interpretation and potentially weakening the model’s overall predictive accuracy (1113). To overcome this issue, our study implemented a novel, data-driven approach. Initially, we performed a preliminary screening of various composite inflammatory indices to select those with the best predictive capabilities. After that NLR, SIRI, and SIII were selected based on their superior predictive abilities. Subsequently, we applied exploratory factor analysis (EFA) to these chosen indices, leading to the identification of a latent variable, which we have named the comprehensive inflammatory prognostic index (CIPI). CIPI encapsulates the predictive capacities of each of the three individual indices, enhancing their combined utility and potentially addressing the inherent limitations by integrating highly correlated and collinear variables into a single model.

The aim of our study was to identify and confirm CIPI as an independent prognostic factor for critically ill patients with cerebral infarction, with a specific focus on in-hospital and ICU mortality, and to evaluate its predictive performance. This endeavor seeks to equip clinicians with a more effective and convenient tool, thereby enhancing their decision-making capabilities in patient care and potentially improving treatment outcomes.

Methods

Data source

In our study, we predominantly used the Medical Information Mart for Intensive Care (MIMIC)-IV (v2.2) database, a valuable and comprehensive resource for critical care research (14, 15). To enhance the robustness of our findings, we performed an external validation using the CareVue subset of the MIMIC-III (v1.4) database (15, 16). This subset supplied an independent collection of patient data not found in MIMIC-IV, enabling us to circumvent any duplication due to overlapping admissions. The first author, after completing the National Institutes of Health’s Protecting Human Research Participants web course, secured permission to access these datasets. The research committees at the Massachusetts Institute of Technology and Beth Israel Deaconess Medical Center approved their use for research, and a waiver of informed consent was granted.

Data extraction and variables selection

Data extraction was executed using Python’s SQLAlchemy and pandas libraries, connected to a PostgreSQL (version 13.7.2) database, and leveraging Structured Query Language (SQL) for the necessary queries. Critically ill patients diagnosed with cerebral infarction were identified in the database by the following International Classification of Diseases, Ninth Revision (ICD-9) codes: 43,301, 43,311, 43,321, 43,331, 43,381, 43,391, 43,401, 43,411, and 43,491; as well as the Tenth Revision (ICD-10) code I63. The deduplication process was conducted based on clinical rationale, prioritizing the initial cerebral infarction diagnosis for each unique ICU stay. In cases of multiple ICU stays within a single hospital admission, any occurrence of death was considered a single mortality event. If no death occurred, the record corresponding to the patient’s first ICU stay was selected. We eliminated all patients with primary blood diseases by using ICD codes, as well as patients for whom records of lymphocytes, monocytes, neutrophils or platelet were absent (Figure 1).

Figure 1
www.frontiersin.org

Figure 1. Computation process of the latent variable for survival analysis. We conducted a thorough evaluation of multiple inflammation-related composite hematological indices, using time-dependent AUC analysis as the criterion to identify suitable manifest variables for exploratory factor analysis. Ultimately, NLR, SIRI, and SIII were selected for the factor analysis. The initial inflammation-related composite hematological indices evaluated were as follows: SIRI (systemic inflammation response index) = (neutrophil * monocyte)/lymphocyte; SIII (systemic immune inflammation index) = (platelet * neutrophil)/lymphocyte; NLR (neutrophil to lymphocyte ratio) = neutrophil/ lymphocyte; LMR (lymphocyte to monocyte ratio) = lymphocyte/monocyte; PWR (platelet to white blood cell ratio) = platelet /white blood cell; PNR (platelet to neutrophil ratio) = platelet /neutrophil; PLR (platelet to lymphocyte ratio) = platelet/lymphocyte.

In the selection of covariates from the MIMIC-IV database, we prioritized those with no missing values or those where less than 20% of the data was missing, with missing values for relevant variables filled in using the KNNImputer method (17). Notably, initial post-admission results were used for laboratory indicators. Averages for vital signs were taken from the first 24 h in the ICU, during which time established and widely-recognized prognostic scores were also assessed; these scores were later compared with the CIPI to evaluate predictive accuracy.

For external validation of CIPI, the same extraction, deduplication, and data processing methods were applied to the MIMIC-III CareVue subset, following the exact standards used with the MIMIC-IV database. The data processing included outlier exclusion, data transformation, standardization, and latent variable weight extraction. The MIMIC-III CareVue subset was employed to validate univariate Cox regression analysis of CIPI, SIRI, SIII, and NLR, as well as the time-dependent area under the receiver operating characteristic curve (AUC) analysis for predicting in-hospital and ICU mortality using CIPI.

Clinical outcomes

The primary outcome measure in the present study was in-hospital mortality, with ICU mortality as the secondary outcome.

Statistical analysis

Initially, we applied time-dependent AUC analysis to the raw data from the MIMIC-IV database, aiming to identify appropriate manifest variables for EFA (Figure 1). This analysis focused on a broad spectrum of composite hematological indices. These selected manifest variables (SIRI, SIII, and NLR) underwent correlation and multicollinearity analyses, outlier removal, and normality testing via the Shapiro–Wilk test, histograms, and Q-Q plots. To enhance their normality, we applied a Box-Cox transformation. Following the standardization of these variables, they were subjected to Kaiser-Meyer-Olkin and Bartlett’s Test of Sphericity to assess their suitability for EFA. Subsequently, we conducted EFA, generating a factor scoring coefficient equation that enabled us to calculate the latent variable score and evaluate its contribution (Figure 1).

We treated CIPI both as a continuous variable and divided it into four groups based on quartiles (Q1, Q2, Q3, Q4). Furthermore, all other variables were similarly divided into quartile-based groups corresponding to the CIPI quartiles for subsequent analyses and comparisons. Continuous variables are reported as the median and interquartile range. Categorical variables are represented as frequency counts and percentages. The quartile groups were compared using the Kruskal-Wallis test for continuous variables due to their non-parametric distribution, and the Chi-square test was employed for categorical variables.

Kaplan–Meier analysis evaluated in-hospital and ICU mortality across CIPI quartiles (Q1–Q4), with survival differences tested using log-rank tests. We assessed the linearity of CIPI using a restricted cubic spline with default knots. This was followed by a comparison between linear and non-linear Cox models via the Akaike Information Criterion (AIC) and an ANOVA test. We applied Cox proportional hazards models to compute the hazard ratios (HR) and 95% confidence intervals (CI) associated with the CIPI, using both its continuous form and quartile divisions (Q1–Q4), with reference to Q1. Model covariates were chosen based on clinical relevance, prognostic value from literature, and expert opinion. Trend p-values across quartiles were additionally computed to assess the dose–response relationship. We conducted sensitivity analyses to further evaluate the robustness of our findings. In these analyses, CIPI’s predictive value was assessed across different patient subgroups, including factors such as sex, age, marital status, whether cerebral infarction was the first diagnosis, and the presence of comorbidities like diabetes, heart failure, kidney disease, and sepsis. Separate Cox proportional hazards models were utilized for each subgroup, and the value of p for interaction was assessed to determine the existence of a significant interaction effect. Time-dependent AUC analysis was employed to assess the predictive accuracy of the CIPI in comparison with other established ICU patient prognosis scores available in the MIMIC database. Detailed information on these scores can be found at: https://github.com/MIT-LCP/mimic-code/tree/main/mimic-iv/concepts_postgres/score. The Delong method was used to ascertain the statistical significance of AUC differences.

Statistical significance was set at a two-tailed p-value < 0.05. A variance inflation factor (VIF) greater than 10 was taken to indicate the presence of multicollinearity. We conducted a power analysis for determining the minimum effective sample size required for our multivariate Cox regression analysis, following the method proposed by Riley et al. and utilizing the “pmsampsize” R package (18, 19). The key parameters selected for our analysis included: an event rate of 12%, representing the lowest integer value for in-hospital and ICU mortality rates observed in our cohort; a maximum of 17 candidate predictors, which was the highest number included in any of our constructed Cox regression models; and a Cox and Snell R-squared value set at 0.15. Our conservative estimate yielded a minimum effective sample size of 933, which is surpassed by the size of our actual sample. Analyses were executed using R software (version 4.2.3) and Python (version 3.9.13).

Results

CIPI and baseline characteristics

The selected manifest variables for EFA, NLR, SIRI, and SIII, exhibiting higher AUC across various time points, demonstrated strong correlations and multicollinearity, as shown by their high Pearson coefficients and variance inflation factors (VIFs; Figure 1). Following outlier removal, normality checks, and Box-Cox transformations, our data met the criteria for EFA (Figure 1). The resulting CIPI, derived from our EFA, is as follows: CIPI = 0.896 *SIII +0.797 *SIRI +0.923 *NLR. A total of 1,022 patients from the MIMIC-IV database were ultimately enrolled for analysis. The median age of the enrolled patients was 69 [59, 80] years, and 530 (51.9%) were men. The in-hospital mortality and ICU mortality rate were 17.4% and 12.8%, respectively. A total of 326 patients were selected from the MIMIC-III CareVue subset. The median age of the enrolled patients was 75 [59, 83] years, and 156 (47.9%) were men. The in-hospital mortality and ICU mortality rate were 30.4% and 19%, respectively.

Table 1 presents a comprehensive analysis of the variables in the study cohort, based on the CIPI quartiles. A progressive trend was observed across the quartiles for a wide array of variables. Specifically, the rates of congestive heart failure, sepsis3, RDW, PT, BUN, glucose, heart rate, respiratory rate, SAPSII, APSIII, hospital expire time, WBC, neutrophils, NLR, PLR, SIII, and SIRI increased incrementally from Q1 to Q4. Conversely, the median values of PPT, eosinophils, lymphocytes, LMR, PNR, and PWR showed a significant decrease from Q1 to Q4. The mortality rates within the hospital and ICU settings also escalated with higher CIPI scores, with in-hospital mortality rates rising from 10.5% in Q1 to 27.7% in Q4 and ICU mortality rates increasing from 8.2% in Q1 to 18.8% in Q4. These findings highlight the stepwise changes in clinical parameters across CIPI quartiles and underscore the potential role of CIPI scores in risk stratification among critically ill patients with cerebral infarction.

Table 1
www.frontiersin.org

Table 1. Baseline characteristics of the study population in MIMIC-IV v 2.2.

Survival curves and linearity assessment

Kaplan–Meier survival curves were plotted for the four groups defined by CIPI quartiles and compared using the log-rank test. The p-values of 0.00011 and 0.012, displayed on the survival plots (Supplementary Figures 1A,B), denote statistically significant differences in survival distributions across these quartiles. This highlights the impact of CIPI on both patient in-hospital mortality and ICU mortality. According to the restricted cubic spline plots and AIC comparisons (p = 0.051 and p = 0.132), CIPI appears to have a linear relationship with both in-hospital and ICU mortality rates (Supplementary Figures 1C,D).

Univariate Cox regression analysis

In the MIMIC-IV dataset (Table 2), all four indices (CIPI, SIRI, SIII, and NLR) showed significant HR with both in-hospital and ICU mortality when treated as continuous variables. In quartile analysis, all indices, excluding SIII, exhibited significant HR differences between Q1 and Q4, along with a significant increasing trend from Q1 to Q4. Notably, CIPI also revealed a significant HR difference between Q1 and Q3. When we applied the same methods used in the MIMIC-IV dataset to the MIMIC-III CareVue subset (Table 2), only CIPI demonstrated statistically significant HR in predicting both in-hospital and ICU mortality when treated as a continuous variable. Analyzed as quartiles, all indices lacked significant trends from Q1 to Q4, likely due to the smaller sample size. For in-hospital mortality, only CIPI demonstrated a significant HR difference between Q1 and Q4. For ICU mortality, such a significant HR difference was seen only in CIPI and SIII between Q1 and Q3. The results consistently emphasized the superior predictive performance and robustness of CIPI over its individual manifest variables used in the EFA, in both the original dataset and external validation, thus underscoring the value of consolidating these variables into a single index.

Table 2
www.frontiersin.org

Table 2. Univariate Cox regression analysis for CIPI, SIRI, SIII, and NLR.

Multivariate Cox regression analysis

As seen in Table 3, our results indicate that the CIPI, as a continuous variable, consistently exerted significant predictive power for both in-hospital and ICU mortality across all four models, emphasizing its independence and robustness as a prognostic factor. Upon categorization into quartiles, a significant trend in CIPI signaled a dose–response relationship with mortality risk. Particularly for in-hospital mortality, higher CIPI quartiles were significantly correlated with increased risk across all models. This, however, was not mirrored in ICU mortality, where interquartile comparisons did not consistently show statistical significance. This suggests that the CIPI quartiles might not be able to capture the nuances of ICU mortality risk effectively. To address this, we transformed CIPI into a trichotomy, which revealed that higher CIPI values were indeed significantly associated with elevated ICU mortality risk. These findings underscore the potential utility of CIPI as a nuanced prognostic tool for critically ill patients with cerebral infarction.

Table 3
www.frontiersin.org

Table 3. Performance of CIPI in multivariate Cox analysis.

Utilizing all independent prognostic factors identified in above models, and corroborated through VIF analysis to avoid multicollinearity with well-recognized ICU prognostic indicators, we formulated our final model, as demonstrated in Figure 2. The results showed that, for in-hospital mortality prediction, only CIPI and SAPSII surfaced as independent prognostic factors. On the other hand, for ICU mortality, CIPI alone maintained its prognostic significance. The results of including CIPI as a four-category graded variable in the model align with those observed when it is treated as a continuous variable. These findings strongly underscore the unique clinical value of CIPI as an independent factor in predicting mortality outcomes.

Figure 2
www.frontiersin.org

Figure 2. Multivariate Cox analysis confirms that CIPI is an independent prognostic factor for both in-hospital mortality (A and C) and ICU mortality (B and D).

Subgroup and interaction analysis

For in-hospital mortality (Supplementary Figure 2A), all subgroups (except those aged under 60) displayed statistically significant HR values. The risk change associated with each increase in CIPI varied among these subgroups. For instance, in patients where cerebral infarction was the first diagnosis, each increase in CIPI resulted in a 2.041-fold higher death risk [HR (95% CI) 2.041 (1.501–2.776)]. However, when cerebral infarction was not the first diagnosis, the risk was 1.237-fold [HR (95% CI) 1.237 (1.026–1.491)]. For patients with severe infections, the risk was 1.226-fold [HR (95% CI) 1.226 (1.023–1.470)]. Without severe infections, the risk more than doubled to 2.092-fold [HR (95% CI) 2.092 (1.517–2.886)]. These results reaffirm the CIPI’s robust independent prognostic power, given that the interaction p-values were above 0.05 for all variables, except sepsis (p = 0.002). For ICU mortality (Supplementary Figure 2B), the HR values for CIPI were not statistically significant in several subgroups. However, in all other subgroups, the HR values were significant, proving that the CIPI remains a strong prognostic tool even after controlling for these factors. The absence of significant interaction with these subgroups confirms CIPI’s independent predictive value.

Time-dependent survival analysis

CIPI demonstrates superior predictive performance over several existing prognostic indicators for in-hospital mortality across various time points (Table 4). Notably, the CIPI consistently outperforms the GCS in terms of AUC at all analyzed time points except for the first day, and surpasses the SIRS and SOFA in AUC at day 8. In the context of ICU mortality, CIPI exceeds the GCS in AUC for mortality prediction at 2, 4, 6, and 8 days, but the OASIS performs better within the first day (Table 4). There is no significant difference in AUC between the CIPI and other established prognostic indicators at the remaining time points, for either in-hospital or ICU mortality.

Table 4
www.frontiersin.org

Table 4. Comparison of time-dependent survival analysis AUC values.

Further, the CIPI underwent external validation, with results illustrated in Table 4. This validation strengthens the evidence of CIPI’s robustness and reliability as a prognostic tool.

Discussion

This study introduces CIPI and validates its role as an independent prognostic factor for critically ill patients with cerebral infarction. Its predictive capacity is comparable to that of established prognostic indicators. However, the CIPI offers notable advantages in terms of simplicity and operational ease. It relies solely on the results of routine blood tests. With a programmed calculation using these readily available values, clinicians can quickly and effortlessly obtain the CIPI, simplifying the prognostic process significantly.

In our study, we diligently improved our research methodology to ensure robust and accurate results. We used the MIMIC-III CareVue subset as an independent validation set, unlike previous studies that combined unfiltered data from MIMIC-III and MIMIC-IV (2024), which can lead to data duplication and affect the stability and accuracy of results. In most research on ischemic stroke patients using the MIMIC database, the selection of cases is overly broad. Many studies indiscriminately include all patients coded under ICD-9: 433, ICD-9: 434, ICD-9: 436, and ICD-10: I63 (2528). However, half of these specific sub-codes, such as 433.00: Occlusion and stenosis of the basilar artery without mention of cerebral infarction, 433.10: Occlusion and stenosis of the carotid artery without mention of cerebral infarction, 433.20: Occlusion and stenosis of the vertebral artery without mention of cerebral infarction, and 433.30: Occlusion and stenosis of multiple and bilateral precerebral arteries without mention of cerebral infarction, do not necessarily diagnose an ischemic stroke. Instead, they signify susceptibility factors for such a stroke. Consequently, this indiscriminate approach to case selection creates a significant selection bias. In statistical terms, this is problematic because it can lead to an overestimation of the associations between the supposed risk factors and ischemic stroke outcomes. Such overestimation can distort the true relationships under study and result in spurious conclusions. By strictly selecting records based on a cerebral infarction diagnosis, we minimized such selection bias, hence enhancing the accuracy and validity of our study. Due to the aforementioned bias in case selection, the independent prognostic utility of many indices warrants reevaluation. For instance, while numerous studies have validated NLR, SII, and SIRI as effective prognostic indicators, our stringent selection criteria and univariate Cox regression analysis results revealed that the performance of these indices individually was not as effective, particularly when compared with our newly proposed CIPI index in the MIMIC-III CareVue subset.

The robustness of CIPI as an independent prognostic indicator was extensively validated in our study. Following rigorous variable selection and multicollinearity tests, we constructed a final multivariate Cox regression model that included several officially recognized prognostic indices from the MIMIC database, such as GCS, SIRS, SOFA, SAPSII, OASIS, LODS, and APSIII (16, 29), as illustrated in Figure 2. The results revealed that CIPI and SAPSII were the only independent predictors of in-hospital mortality. Moreover, CIPI emerged as the unique independent predictor for ICU mortality. This indicates that many prognostic indicators, although effective, may overlap in their predictive functions for critically ill cerebral infarction patients and lose their individual prognostic utility when combined. The CIPI we introduced is a latent variable derived from EFA of NLR, SIII, and SIRI, encapsulating their combined contributions to critically ill patient prognosis in cerebral infarction. The composition of NLR, SIII, and SIRI share common elements, such as neutrophils and lymphocytes, yet each has its focus: SIII on platelets, and SIRI on monocytes (9, 30, 31). This composition reflects their inherent high correlations and unique characteristics. Together, they capture various aspects of the systemic inflammatory response and coagulation process, key factors influencing outcomes in cerebral infarction patients (32). Inflammation is a key mechanism in stroke, and the post-stroke inflammatory response plays a vital role in secondary brain injury and activation of coagulation (33, 34). The disruption of normal coagulation processes after cerebral infarction can lead to exacerbated ischemic damage in the brain, and also activate multiple inflammatory pathways (35). The changes in peripheral blood indicators like neutrophils, lymphocytes, monocytes, and platelets are sensitive markers of the body’s cascade response to cerebral infarction, especially in the presence of severe complications and comorbidities (36, 37). By conducting EFA on NLR, SIII, and SIRI, CIPI maintains their common features while enhancing their unique contributions. This underpins CIPI’s independence compared to traditional ICU prognostic indicators. Furthermore, our confirmation of its linear relationship with mortality rates, along with its resilience to interaction effects, strengthens our belief in CIPI’s potential for clinical application as an independent prognostic tool.

In our time-dependent AUC analysis, we observed that no existing prognostic indices from the MIMIC database, such as GCS, SIRS, SOFA, SAPSII, OASIS, LODS, and APSIII (16, 29), statistically significantly outperformed CIPI at all analyzed time points. This indicates that, overall, CIPI’s ability to predict in-hospital and ICU mortality among critically ill cerebral infarction patients is on par with these established indices. This equivalency in performance could be attributed to the fact that these indices, including CIPI, reflect patient prognosis from different perspectives, as supported by references (3844). Given the complexity and rapid disease progression in ICU settings, it is challenging to identify a single prognostic indicator that completely surpasses others in all dimensions of patient care. This highlights the multifaceted nature of critical care prognosis, where each indicator provides unique insights without statistically outperforming the others. Hence, the deep research value of a prognostic indicator in such a context lies significantly in its accessibility and ease of evaluation. Recent studies have also been focused on finding simple indices for predicting outcomes in critically ill cerebral infarction patients. For instance, Zhao et al. reported AUC values of 0.552, 0.644, and 0.541 for NLR, neutrophil to albumin ratio, and red cell distribution width to albumin ratio, respectively, in predicting 30-day mortality in critical stroke patients (45). Jhou et al. found that plasma anion gap predicted in-hospital mortality in ICU acute ischemic stroke patients with an AUC of 0.631 (46). Chen et al. used the triglyceride glucose index to predict in-hospital mortality in critical cerebrovascular disease patients, achieving an AUC of 0.610 (47). Our CIPI showed AUC values greater than 0.6 for predicting both in-hospital and ICU mortality at multiple time points, with an AUC of 0.753 for predicting in-hospital mortality and 0.718 for ICU mortality on the second day of ICU admission. This predictive ability is, to a certain extent, superior to the aforementioned indices. Additionally, CIPI offers a significant advantage as it is derived entirely from a routine complete blood count test. This test, a routine blood draw performed for every critically ill patient upon admission, provides all the necessary data at once for the CIPI calculation. This method, complemented by a streamlined calculation process, makes CIPI a more convenient and rapid prognostic tool compared to most indices in the MIMIC database. Moreover, our study confirms that CIPI, exhibiting significant predictive value both as a continuous variable with a linear relationship and as a categorical variable with statistically significant trend p-values, holds promise for guiding more personalized treatment strategies. Patients with higher CIPI scores may benefit from more aggressive interventions due to their increased risk, whereas those with lower scores might be managed with less intensive treatments, reducing unnecessary medical interventions and associated risks. However, the integration of CIPI into clinical decision-making should be approached with caution. Additional clinical trials are necessary, to further explore how CIPI’s application in clinical settings affects patient outcomes and treatment efficacy.

This study, while offering valuable insights, is subject to a few limitations. First, as a retrospective analysis, it inherently faces selection bias and potential unmeasured confounders that could influence the results. Second, due to its nature as a data mining study, the scope of data available was limited. We were unable to include comprehensive patient data such as imaging studies or genomics information as covariates in our CIPI survival analysis. This limitation may have led to an underestimation of the multifactorial nature of severe cerebral infarction prognosis, potentially affecting its predictive accuracy and generalizability to broader patient populations. Finally, the study utilized the MIMIC database, a single-center dataset with a large and diverse patient population. However, the outcomes observed may not be applicable to other clinical settings or patient populations. Therefore, multi-center studies are necessary to validate our findings and to further explore the predictive value of CIPI.

Conclusion

This study introduces the CIPI as a robust and enhanced independent prognostic factor for critically ill patients with cerebral infarction, demonstrating linear predictability and statistically significant prognostic effectiveness both as a continuous and categorical variable. The CIPI not only matches the predictive power of established prognostic indicators but also surpasses them in simplicity and operational ease. Its derivation solely from routine complete blood count data and the potential for quick computer algorithm processing make it a practical tool for clinical use. Further multi-center studies are needed to validate these findings and to deepen the exploration of the potential utility of CIPI.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

The collection of patient information and creation of the research resource were reviewed by the Institutional Review Board at the Beth Israel Deaconess Medical Center, who granted a waiver of informed consent and approved the data sharing initiative.

Author contributions

CS: Conceptualization, Formal analysis, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing. CZ: Funding acquisition, Supervision, Writing – original draft. GZ: Investigation, Supervision, Validation, Writing – original draft.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by the Natural Science Foundation of Tianjin (grant number: 20JCZDJC00540).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2024.1287895/full#supplementary-material

References

1. Kirkman, MA, Citerio, G, and Smith, M. The intensive Care Management of Acute Ischemic Stroke: an overview. Intensive Care Med. (2014) 40:640–53. doi: 10.1007/s00134-014-3266-z

Crossref Full Text | Google Scholar

2. Pilato, F, Profice, P, Dileone, M, Ranieri, F, Capone, F, Minicuci, G, et al. Stroke in critically ill patients. Minerva Anestesiol. (2009) 75:245–50.

PubMed Abstract | Google Scholar

3. Carval, T, Garret, C, Guillon, B, Lascarrou, JB, Martin, M, Lemarie, J, et al. Outcomes of patients admitted to the Icu for acute stroke: a retrospective cohort. BMC Anesthesiol. (2022) 22:235. doi: 10.1186/s12871-022-01777-4

PubMed Abstract | Crossref Full Text | Google Scholar

4. Rordorf, G, Koroshetz, W, Efird, JT, and Cramer, SC. Predictors of mortality in stroke patients admitted to an intensive care unit. Crit Care Med. (2000) 28:1301–5. doi: 10.1097/00003246-200005000-00007

PubMed Abstract | Crossref Full Text | Google Scholar

5. Alhazzani, AA, Mahfouz, AA, Abolyazid, AY, Awadalla, NJ, Katramiz, K, Faraheen, A, et al. In hospital stroke mortality: rates and determinants in southwestern Saudi Arabia. Int J Environ Res Public Health. (2018) 15:927. doi: 10.3390/ijerph15050927

PubMed Abstract | Crossref Full Text | Google Scholar

6. Lapp, L, Roper, M, Kavanagh, K, Bouamrane, MM, and Schraag, S. Dynamic prediction of patient outcomes in the intensive care unit: a scoping review of the state-of-the-art. J Intensive Care Med. (2023) 38:575–91. doi: 10.1177/08850666231166349

PubMed Abstract | Crossref Full Text | Google Scholar

7. Quan, K, Wang, A, Zhang, X, Meng, X, Chen, P, Li, H, et al. Neutrophil to lymphocyte ratio and adverse clinical outcomes in patients with ischemic stroke. Ann Transl Med. (2021) 9:1047. doi: 10.21037/atm-21-710

PubMed Abstract | Crossref Full Text | Google Scholar

8. Huang, YW, Yin, XS, and Li, ZP. Association of the Systemic Immune-Inflammation Index (Sii) and clinical outcomes in patients with stroke: a systematic review and Meta-analysis. Front Immunol. (2022) 13:1090305. doi: 10.3389/fimmu.2022.1090305

PubMed Abstract | Crossref Full Text | Google Scholar

9. Zhou, Y, Zhang, Y, Cui, M, Zhang, Y, and Shang, X. Prognostic value of the systemic inflammation response index in patients with acute ischemic stroke. Brain Behav. (2022) 12:e2619. doi: 10.1002/brb3.2619

PubMed Abstract | Crossref Full Text | Google Scholar

10. Sharma, D, Spring, KJ, and Bhaskar, SMM. Neutrophil-lymphocyte ratio in acute ischemic stroke: immunopathology, management, and prognosis. Acta Neurol Scand. (2021) 144:486–99. doi: 10.1111/ane.13493

PubMed Abstract | Crossref Full Text | Google Scholar

11. Yilmaz, H, Cinar, NB, Avci, IE, Telli, E, Uslubas, AK, Teke, K, et al. The systemic inflammation response index: an independent predictive factor for survival outcomes of bladder Cancer stronger than other inflammatory markers. Urol Oncol. (2023) 41:256.e1–8. doi: 10.1016/j.urolonc.2022.11.011

PubMed Abstract | Crossref Full Text | Google Scholar

12. Shen, YJ, Qian, LQ, Ding, ZP, Luo, QQ, Zhao, H, Xia, WY, et al. Prognostic value of inflammatory biomarkers in patients with stage I lung adenocarcinoma treated with surgical dissection. Front Oncol. (2021) 11:711206. doi: 10.3389/fonc.2021.711206

PubMed Abstract | Crossref Full Text | Google Scholar

13. Zeng, JL, Xiang, YF, Zhang, LW, Chen, LC, Chen, JH, Liang, WJ, et al. Predictive value of systemic inflammation score for contrast-associated acute kidney injury and adverse outcomes among patients undergoing elective percutaneous coronary intervention. J Inflamm Res. (2023) 16:2845–54. doi: 10.2147/JIR.S419831

PubMed Abstract | Crossref Full Text | Google Scholar

14. Johnson, AEW, Bulgarelli, L, Shen, L, Gayles, A, Shammout, A, Horng, S, et al. Mimic-iv, a freely accessible electronic health record dataset. Sci Data. (2023) 10:1. doi: 10.1038/s41597-022-01899-x

PubMed Abstract | Crossref Full Text | Google Scholar

15. Goldberger, AL, Amaral, LA, Glass, L, Hausdorff, JM, Ivanov, PC, Mark, RG, et al. Physiobank, Physiotoolkit, and Physionet: components of a new research resource for complex physiologic signals. Circulation. (2000) 101:E215–20. doi: 10.1161/01.cir.101.23.e215

PubMed Abstract | Crossref Full Text | Google Scholar

16. Johnson, AE, Stone, DJ, Celi, LA, and Pollard, TJ. The mimic code repository: enabling reproducibility in critical care research. J Am Med Inform Assoc. (2018) 25:32–9. doi: 10.1093/jamia/ocx084

PubMed Abstract | Crossref Full Text | Google Scholar

17. Faisal, S, and Tutz, G. Imputation methods for high-dimensional mixed-type datasets by nearest neighbors. Comput Biol Med. (2021) 135:104577. doi: 10.1016/j.compbiomed.2021.104577

PubMed Abstract | Crossref Full Text | Google Scholar

18. Riley, RD, Ensor, J, Snell, KIE, Harrell, FE Jr, Martin, GP, Reitsma, JB, et al. Calculating the sample size required for developing a clinical prediction model. BMJ. (2020) 368:m441. doi: 10.1136/bmj.m441

Crossref Full Text | Google Scholar

19. Riley, RD, Snell, KI, Ensor, J, Burke, DL, Harrell, FE Jr, Moons, KG, et al. Minimum sample size for developing a multivariable prediction model: part ii-binary and time-to-event outcomes. Stat Med. (2019) 38:1276–96. doi: 10.1002/sim.7992

PubMed Abstract | Crossref Full Text | Google Scholar

20. Chen, T, Li, AP, Gong, Q, Zhou, L, Zhao, YX, Zhou, ZW, et al. The Association of Blood Urea Nitrogen to creatinine ratio and the prognosis of critically ill patients with cerebral infarction: a cohort study. Mediat Inflamm. (2022) 2022:2151840–8. doi: 10.1155/2022/2151840

PubMed Abstract | Crossref Full Text | Google Scholar

21. Xu, F, Zhang, L, Wang, Z, Han, D, Li, C, Zheng, S, et al. A new scoring system for predicting in-hospital death in patients having liver cirrhosis with esophageal varices. Front Med. (2021) 8:678646. doi: 10.3389/fmed.2021.678646

PubMed Abstract | Crossref Full Text | Google Scholar

22. Cai, D, Xiao, T, Zou, A, Mao, L, Chi, B, Wang, Y, et al. Predicting acute kidney injury risk in acute myocardial infarction patients: an artificial intelligence model using medical information Mart for intensive care databases. Front Cardiovasc Med. (2022) 9:964894. doi: 10.3389/fcvm.2022.964894

PubMed Abstract | Crossref Full Text | Google Scholar

23. Huang, X, and Zhang, Y. Relationship between serum bicarbonate levels and the risk of death within 30 days in Icu patients with acute ischemic stroke. Front Neurol. (2023) 14:1125359. doi: 10.3389/fneur.2023.1125359

PubMed Abstract | Crossref Full Text | Google Scholar

24. Gao, H, and Zhao, Y. A prediction model for assessing hypoglycemia risk in critically ill patients with Sepsis. Heart Lung. (2023) 62:43–9. doi: 10.1016/j.hrtlng.2023.05.010

PubMed Abstract | Crossref Full Text | Google Scholar

25. Hu, X, Liang, J, Hao, W, Zhou, J, Gao, Y, Gong, X, et al. Prognostic value of inflammatory markers for in-hospital mortality in intensive care patients with acute ischemic stroke: a retrospective observational study based on mimic-iv. Front Neurol. (2023) 14:1174711. doi: 10.3389/fneur.2023.1174711

Crossref Full Text | Google Scholar

26. Zhang, S, Cui, YL, Yu, S, Shang, WF, Li, J, Pan, XJ, et al. Association between mean arterial pressure during the first 24 hours and clinical outcome in critically ill stroke patients: an analysis of the mimic-iii database. J Clin Med. (2023) 12:556. doi: 10.3390/jcm12041556

PubMed Abstract | Crossref Full Text | Google Scholar

27. Wu, CS, Chen, PH, Chang, SH, Lee, CH, Yang, LY, Chen, YC, et al. Atrial fibrillation is not an independent determinant of mortality among critically ill acute ischemic stroke patients: a propensity score-matched analysis from the mimic-iv database. Front Neurol. (2021) 12:730244. doi: 10.3389/fneur.2021.730244

PubMed Abstract | Crossref Full Text | Google Scholar

28. Liu, S, Li, M, Yang, Y, Chen, Y, Wang, W, and Zheng, X. A novel risk model based on white blood cell-related biomarkers for acute kidney injury prediction in patients with ischemic stroke admitted to the intensive care unit. Front Med. (2022) 9:1043396. doi: 10.3389/fmed.2022.1043396

PubMed Abstract | Crossref Full Text | Google Scholar

29. Johnson, AEW, Bulgarelli, L, Shen, L, Gayles, A, Shammout, A, Horng, S, et al. Author correction: mimic-iv, a freely accessible electronic health record dataset. Sci Data. (2023) 10:219. doi: 10.1038/s41597-023-02136-9

PubMed Abstract | Crossref Full Text | Google Scholar

30. Suh, B, Shin, DW, Kwon, HM, Yun, JM, Yang, HK, Ahn, E, et al. Elevated neutrophil to lymphocyte ratio and ischemic stroke risk in generally healthy adults. PLoS One. (2017) 12:e0183706. doi: 10.1371/journal.pone.0183706

PubMed Abstract | Crossref Full Text | Google Scholar

31. Karakayali, M, Omar, T, Artac, I, Rencuzogullari, I, Karabag, Y, and Demir, O. The relationship between the systemic immune-inflammation index and reverse-dipper circadian pattern in newly diagnosed hypertensive patients. J Clin Hypertens. (2023) 25:700–7. doi: 10.1111/jch.14688

PubMed Abstract | Crossref Full Text | Google Scholar

32. Anrather, J, and Iadecola, C. Inflammation and stroke: an overview. Neurotherapeutics. (2016) 13:661–70. doi: 10.1007/s13311-016-0483-x

PubMed Abstract | Crossref Full Text | Google Scholar

33. DeLong, JH, Ohashi, SN, O'Connor, KC, and Sansing, LH. Inflammatory responses after ischemic stroke. Semin Immunopathol. (2022) 44:625–48. doi: 10.1007/s00281-022-00943-7

Crossref Full Text | Google Scholar

34. Altunova, M, Karakayali, M, Kahraman, S, Avci, Y, Demirci, G, Sevinc, S, et al. Systemic immune-inflammatory index is associated with residual syntax score in patients with St-segment elevation myocardial infarction. Anatol J Cardiol. (2023) 27:472–8. doi: 10.14744/AnatolJCardiol.2023.3074

PubMed Abstract | Crossref Full Text | Google Scholar

35. Sun, Y, and Langer, HF. Platelets, Thromboinflammation and neurovascular disease. Front Immunol. (2022) 13:843404. doi: 10.3389/fimmu.2022.843404

PubMed Abstract | Crossref Full Text | Google Scholar

36. Dziedzic, EA, Gasior, JS, Tuzimek, A, and Kochman, W. Blood count-derived inflammatory markers and acute complications of ischemic heart disease in elderly women. J Clin Med. (2023) 12:1369. doi: 10.3390/jcm12041369

PubMed Abstract | Crossref Full Text | Google Scholar

37. Kriplani, A, Pandit, S, Chawla, A, de la Rosette, J, Laguna, P, Jayadeva Reddy, S, et al. Neutrophil-lymphocyte ratio (Nlr), platelet-lymphocyte ratio (Plr) and lymphocyte-monocyte ratio (Lmr) in predicting systemic inflammatory response syndrome (Sirs) and Sepsis after percutaneous Nephrolithotomy (Pnl). Urolithiasis. (2022) 50:341–8. doi: 10.1007/s00240-022-01319-0

PubMed Abstract | Crossref Full Text | Google Scholar

38. Chen, Q, Zhang, L, Ge, S, He, W, and Zeng, M. Prognosis predictive value of the Oxford acute severity of illness score for Sepsis: a retrospective cohort study. PeerJ. (2019) 7:e7083. doi: 10.7717/peerj.7083

PubMed Abstract | Crossref Full Text | Google Scholar

39. Leitgeb, J, Mauritz, W, Brazinova, A, Majdan, M, Janciak, I, Wilbacher, I, et al. Glasgow coma scale score at intensive care unit discharge predicts the 1-year outcome of patients with severe traumatic brain injury. Eur J Trauma Emerg Surg. (2013) 39:285–92. doi: 10.1007/s00068-013-0269-3

PubMed Abstract | Crossref Full Text | Google Scholar

40. Jin, G, Hu, W, Zeng, L, Diao, M, Chen, H, Chen, J, et al. Development and verification of a nomogram for predicting short-term mortality in elderly ischemic stroke populations. Sci Rep. (2023) 13:12580. doi: 10.1038/s41598-023-39781-4

PubMed Abstract | Crossref Full Text | Google Scholar

41. Minne, L, Abu-Hanna, A, and de Jonge, E. Evaluation of Sofa-based models for predicting mortality in the Icu: a systematic review. Crit Care. (2008) 12:R161. doi: 10.1186/cc7160

PubMed Abstract | Crossref Full Text | Google Scholar

42. Jentzer, JC, Lawler, PR, van Diepen, S, Henry, TD, Menon, V, Baran, DA, et al. Systemic inflammatory response syndrome is associated with increased mortality across the Spectrum of shock severity in cardiac intensive care patients. Circ Cardiovasc Qual Outcomes. (2020) 13:e006956. doi: 10.1161/CIRCOUTCOMES.120.006956

PubMed Abstract | Crossref Full Text | Google Scholar

43. Metnitz, PG, Lang, T, Valentin, A, Steltzer, H, Krenn, CG, and Le Gall, JR. Evaluation of the logistic organ dysfunction system for the assessment of organ dysfunction and mortality in critically ill patients. Intensive Care Med. (2001) 27:992–8. doi: 10.1007/s001340100888

Crossref Full Text | Google Scholar

44. Honselmann, KC, Buthut, F, Heuwer, B, Karadag, S, Sayk, F, Kurowski, V, et al. Long-term mortality and quality of life in intensive care patients treated for pneumonia and/or Sepsis: predictors of mortality and quality of life in patients with Sepsis/pneumonia. J Crit Care. (2015) 30:721–6. doi: 10.1016/j.jcrc.2015.03.009

Crossref Full Text | Google Scholar

45. Zhao, J, Feng, J, Ma, Q, Li, C, and Qiu, F. Prognostic value of inflammation biomarkers for 30-day mortality in critically ill patients with stroke. Front Neurol. (2023) 14:1110347. doi: 10.3389/fneur.2023.1110347

PubMed Abstract | Crossref Full Text | Google Scholar

46. Jhou, HJ, Chen, PH, Yang, LY, Chang, SH, and Lee, CH. Plasma anion gap and risk of in-hospital mortality in patients with acute ischemic stroke: analysis from the mimic-iv database. J Pers Med. (2021) 11:1004. doi: 10.3390/jpm11101004

PubMed Abstract | Crossref Full Text | Google Scholar

47. Chen, T, Qian, Y, and Deng, X. Triglyceride glucose index is a significant predictor of severe disturbance of consciousness and all-cause mortality in critical cerebrovascular disease patients. Cardiovasc Diabetol. (2023) 22:156. doi: 10.1186/s12933-023-01893-6

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: cerebral infarction, prognostic index, mortality, exploratory factor analysis, survival analysis

Citation: Shu C, Zheng C and Zhang G (2024) Exploring the utility of a latent variable as comprehensive inflammatory prognostic index in critically ill patients with cerebral infarction. Front. Neurol. 15:1287895. doi: 10.3389/fneur.2024.1287895

Received: 03 September 2023; Accepted: 05 January 2024;
Published: 15 January 2024.

Edited by:

Hipólito Nzwalo, University of Algarve, Portugal

Reviewed by:

Ibrahim Rencuzogullari, Kafkas University, Türkiye
Yujie Chen, Army Medical University, China
Xiaobin Gu, First Affiliated Hospital of Zhengzhou University, China

Copyright © 2024 Shu, Zheng and Zhang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Guobin Zhang, huanhu_icu_data@126.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.