Skip to main content

ORIGINAL RESEARCH article

Front. Neurol., 19 January 2024
Sec. Endovascular and Interventional Neurology
This article is part of the Research Topic Advances and controversies in ischemic stroke management: from prevention to diagnosis and acute treatment View all 56 articles

Application of a nomogram model for the prediction of 90-day poor outcomes following mechanical thrombectomy in patients with acute anterior circulation large-vessel occlusion

Xia Li,&#x;Xia Li1,2Chen Li&#x;Chen Li1Ao-fei Liu&#x;Ao-fei Liu1Chang-chun JiangChang-chun Jiang2Yi-qun ZhangYi-qun Zhang1Yun-e LiuYun-e Liu1Ying-ying ZhangYing-ying Zhang1Hao-yang LiHao-yang Li3Wei-jian Jiang
Wei-jian Jiang1*Jin Lv
Jin Lv1*
  • 1The PLA Rocket Force Characteristic Medical Center, Beijing, China
  • 2Department of Neurology, Baotou Center Hospital, Neurointerventional Medical Center of Inner Mongolia Medical University, Institute of Cerebrovascular Disease in Inner Mongolia, Inner Mongolia, China
  • 3Department of Psychiatric Specialty, Capital Medical University, Beijing, China

Background: The past decade has witnessed advancements in mechanical thrombectomy (MT) for acute large-vessel occlusions (LVOs). However, only approximately half of the patients with LVO undergoing MT show the best/independent 90-day favorable outcome. This study aimed to develop a nomogram for predicting 90-day poor outcomes in patients with LVO treated with MT.

Methods: A total of 187 patients who received MT were retrospectively analyzed. Factors associated with 90-day poor outcomes (defined as mRS of 4–6) were determined by univariate and multivariate logistic regression analyzes. One best-fit nomogram was established to predict the risk of a 90-day poor outcome, and a concordance index was utilized to evaluate the performance of the model. Additionally, 145 patients from a single stroke center were retrospectively recruited as the validation cohort to test the newly established nomogram.

Results: The overall incidence of 90-day poor outcomes was 45.16%, affecting 84 of 186 patients in the training set. Moreover, five variables, namely, age (odds ratio [OR]: 1.049, 95% CI [1.016–1.083]; p = 0.003), glucose level (OR: 1.163, 95% CI [1.038–1.303]; p = 0.009), baseline National Institute of Health Stroke Scale (NIHSS) score (OR: 1.066, 95% CI [0.995–1.142]; p = 0.069), unsuccessful recanalization (defined as a TICI grade of 0 to 2a) (OR: 3.730, 95% CI [1.688–8.245]; p = 0.001), and early neurological deterioration (END, defined as an increase of ≥4 points between the baseline NIHSS score and the NIHSS score at 24 h after MT) (OR: 3.383, 95% CI [1.411–8.106]; p = 0.006), were included in the nomogram to predict the potential risk of poor outcomes at 90 days following MT in LVO patients, with a C-index of 0.763 (0.693–0.832) in the training set and 0.804 (0.719–0.889) in the validation set.

Conclusion: The proposed nomogram provided clinical evidence for the effective control of these risk factors before or during the process of MT surgery in LVO patients.

Introduction

Due to its well-established high efficiency and relative safety, mechanical thrombectomy (MT) has been considered the first-line strategy for managing acute anterior circulation (AC)-large-vessel occlusion (LVO) for the past several years (15). MT in patients with LVO-induced stroke, even with an extended time window of 24 h (6, 7), has demonstrated improved recanalization rates (58.7 to 88%), amelioration of functional outcomes, and reduced disability rates at 90 days (8). Despite these beneficial effects, more than half of the patients (51–56.7%) still exhibit a non-independent functional outcome (modified Rankin Scale [mRS] score of ≥3 at 90 days) after MT (6, 7, 9). In addition, 37.1% of patients who underwent MT were severely disabled for life (mRS score of ≥4 at 90 days), and even with successful recanalization following MT, only 27% of the patients were disability-free at 90 days. The definition of non-independent functional outcomes after MT has been a topic of debate, with most studies suggesting that non-functionally independent outcomes include mainly moderate disability, severe disability, very severe disability, and death. However, moderate disability is characterized by the ability to walk with help or assistance, which, in reality, is an acceptable functional outcome after MT for acute LVO. Furthermore, the median mRS score for the 90-day clinical outcome in most RCT studies comparing the findings with medication was 3, which was closer to the mRS score of 2 rather than 4 in clinical practice (10). Therefore, more clinical attention should be directed toward the poor outcomes that impose an unbearable burden on stroke patients, such as the inability to walk and to look after themselves with necessary help, and even worse scenarios.

At present, to ensure the maximum benefit of MT for LVO stroke patients, a large number of neurologists are committed to exploring the risk factors for unfavorable outcomes (a 90-day mRS score of 3–6) after MT by using various clinical predictive models and scoring systems for the accurate prediction and precise assessment of the surgical procedure (11, 12). While a vast majority of such studies (1316) have focused on non-independent functional outcomes (mRS score of 3–6) as unfavorable outcomes at 90 days following MT for acute stroke, few studies have addressed the 90-day poor outcomes (mRS score of 4–6) in AC-LVO patients who underwent MT, and studies reporting the risk factors for poor outcomes in this patient population are even more scarce.

Thus, the present study aimed to identify the clinical risk factors for 90-day poor outcomes (mRS score of 4–6) after MT in patients with acute AC ischemic stroke, to develop a nomogram model for predicting the probability of poor outcomes at 90 days in this population, and to validate the performance of this nomogram using an external single-center dataset.

Methods

Study design and population

This study was a retrospective investigation of the prospectively collected data from the Jrecan trial between 1 March 2018 and 30 June 2019, which was named as the training set. The Jrecan trial was a prospective, multicenter, randomized, non-inferiority clinical trial comparing the efficacy and safety of two MT stents (the Jrecan revascularization device and the Solitaire device) in patients with AC-LVO stroke. The trial involved 16 comprehensive stroke centers in China. Each center handled more than 50 cases of MT annually, and each neuro-interventionalist performed at least 10 MT procedures per year. The Jrecan trial was approved by the ethics committees of the participating centers and was duly registered with the Chinese Clinical Trial Registry, http://www.chictr.org.cn/showproj.aspx?proj=23396, identifier ChiCTR-TOC-17013822. The patient data for the validation set were retrospectively collected from Baotou Center Hospital between January 2013 and December 2020 and approved by the ethics committee of Baotou Center Hospital. Informed consent was obtained from the participants or their legal representatives. The flowchart of the patient profile is shown in Figure 1.

Figure 1
www.frontiersin.org

Figure 1. A flowchart of eligible patients with acute large-vessel occlusions in the anterior circulation. AIS, acute ischemic stroke; AC-LVO, anterior circulation large-vessel occlusion; mRS, modified Rankin Scale; NIHSS, National Institute of Health Stroke Scale.

Patients were enrolled if they met the following criteria: (1) age ≥ 18 years; (2) diagnosed with acute ischemic stroke (AIS) within 8 h of symptom onset; (3) baseline admission National Institute of Health Stroke Scale (NIHSS) score of ≥6; (4) modified Rankin Scale (mRS) score prior to stroke ≤2; and (4) proximal intracranial large artery occlusion in the AC confirmed by digital subtraction angiography. All participants and their legal representatives provided written informed consent.

Procedures

Stroke patients underwent mechanical thrombectomy under either conscious sedation or general anesthesia within 8 h of symptom onset, and those eligible for thrombolysis received intravenous recombinant tissue plasminogen activator (IV-rtPA) within 4.5 h of stroke onset. Patients were randomly assigned to receive either the Jrecan or Solitaire stent for MT in a 1:1 ratio. The goal of thrombectomy was to achieve a modified thrombolysis in cerebral infarction (mTICI) grade of 2b or 3. Salvage therapies, such as intra-arterial thrombolysis, balloon angioplasty, or stent implantation, were performed if recanalization of the target vessel was not achieved after three passes of thrombectomy. MT was considered to have failed if the patients required rescue therapy. The time from stroke onset to admission was documented for all cases. All patients were followed up for 90 days after MT.

Outcome measures

Functional outcomes were determined by measuring the mRS score, and poor outcomes were defined as an mRS score of 4–6 at 90 days. Successful recanalization was defined as a TICI grade of 2b or 3. Early neurological deterioration (END) was defined as an increase of ≥4 points between the baseline NIHSS score and the NIHSS score at 24 h after MT.

Statistical analysis

Statistical analysis was performed with SPSS version 22.0 (IBM Corporation, Armonk, New York, United States) or R version 4.1.2 software (http://www.R-project.org, Foundation for Statistical Computing, Vienna, Austria). Categorical variables were presented as numbers (percentage, %). Continuous variables were expressed as mean (standard deviation, [SD]) or median (interquartile range, [IQR]) and were dichotomized into categorical variables using the median as a cutoff value.

Univariable logistic regression analysis was first performed to identify potential predictive factors of 90-day poor outcomes (mRS score of 4–6) in patients receiving MT, with the Mann–Whitney U-tests for continuous variables and Fisher exact or χ2 tests for categorical variables. Then, variables with p-values<0.05 in the univariate analysis were included in the multivariate logistic regression analysis. Based on the results of the multivariable logistic regression analysis, a nomogram model for predicting poor outcomes at 90 days was constructed, which determined the likelihood of poor outcomes by assigning each predictor a score of 0–100. The total score of each patient was obtained by summing the individual scores of each predictor, and then, the individual probabilities of poor outcomes ranging from 0 to 100% were derived. The discriminative power of the nomogram was assessed using Harrell’s concordance index (C-index). The performance of the nomogram was externally validated in a validation set. A calibration plot was drawn to verify the fit between the actual outcomes and the poor outcomes predicted by the nomogram. Decision curve analyzes were used to discriminate between the net benefit and the probability of poor outcomes in patients with LVO undergoing MT.

Results

General characteristics of participants

In the training set, a total of 187 patients were enrolled in the Jrecan trial, and 1 patient was lost to follow-up after discharge (Figure 1). The mean age of the patients was 66 years (IQR, 58–74 years), and 56.7% (106/187) of the patients were men. The median baseline NIHSS score was 14 (IQR, 11–18), and the median ASPECT score was 9 (IQR, 8–10). The median onset to admission time was 180 min (IQR, 110–268 min), and 32.6% (61/187) of the patients received IV-rtPA. The rate of unsuccessful recanalization was 24.1% (45/186). Poor outcomes were observed in 84 of 186 patients (45.2%) at 90 days. In terms of complications within 24 h, 19.3% (36/187) of the patients showed early neurological deterioration (END), and 5.3% (10/187) of the patients showed symptomatic intracerebral hemorrhage (sICH). The modified Rankin Scale (mRS) score distributions in patients who underwent successful recanalization versus those who did not, patients who exhibited END or sICH versus those who did not, and those who had survived or died at 90 days were compared. The results are shown in Figure 2. The survival status of the patients with successful recanalization versus unsuccessful recanalization, END versus no-END, sICH versus no-sICH, and poor outcomes (90-day mRS score of 4–6) versus acceptable functional recovery (90-day mRS score of 0–3) was illustrated using the K–M curves, and statistically significant differences were observed between the groups (p < 0.05) (Supplementary Figure S1). Baseline patient characteristics and procedural parameters are listed in Supplementary Table S1.

Figure 2
www.frontiersin.org

Figure 2. Distribution of the modified Rankin Scale (mRS) score of patients with successful recanalization vs. unsuccessful recanalization, END vs. no-END, sICH vs. no-sICH, and survival vs. death at 90 days after mechanical thrombectomy. The mRS scores ranged from 0 to 6, with the higher scores indicating a more severe disability. SR, successful recanalization; Un-SR, unsuccessful recanalization; END, early neurological deterioration; sICH, symptomatic intracerebral hemorrhage.

Predictors of 90-day poor outcomes in patients with AC-LVO undergoing MT

The baseline characteristics of patients with AC-LVO in the training and validation sets grouped by 90-day outcomes (mRS score, 4–6 vs. 0–3) are shown in Table 1. Continuous variables, including age, glucose level, systolic blood pressure, diastolic blood pressure, baseline NIHSS score, ASPECTS score, and onset to admission time, are presented as median with IQR. A univariable analysis identified age, glucose level, baseline NIHSS score, unsuccessful recanalization, and END as potential predictors (with p < 0.05), all of which were finally entered into the multivariable logistic regression model for predicting the probability of a 90-day poor outcome following MT (Table 1). In the multivariable analysis, age (OR: 1.049 [95% CI: 1.016–1.083]; p = 0.003), glucose level (OR: 1.163 [95% CI: 1.038–1.303]; p = 0.009), unsuccessful recanalization (OR: 3.730 [95% CI: 1.688–8.245]; p = 0.001), and the occurrence of END (OR: 3.383 [95% CI: 1.411–8.106]; p = 0.006) were associated with a poor outcome at 90 days following MT in the training set (Table 2), while age (OR: 1.051 [95% CI: 1.008–1.095]; p = 0.020), baseline NIHSS (OR: 1.187 [95% CI: 1.055–1.335]; p = 0.004), and the occurrence of END (OR: 3.548 [95% CI: 1.068–11.787]; p = 0.039) were identified as independent predictors of 90-day poor outcomes in the validation set (Table 2).

Table 1
www.frontiersin.org

Table 1. Univariable analysis of the factor associated with 90-day poor outcomes (mRS scores of 4–6) following mechanical thrombectomy (MT) in patients with anterior circulation large-vessel occlusion (AC-LVO) in the training set and the validation set.

Table 2
www.frontiersin.org

Table 2. Multivariable analysis of risk factors associated with 90-day poor outcomes (mRS scores of 4 to 6) following mechanical thrombectomy in patients with acute anterior circulation large-vessel occlusion.

Construction of the nomogram for the prediction of 90-day poor outcomes in patients undergoing MT and its performance validation

A nomogram model based on the results of multivariable regression analysis was developed to predict the 90-day poor outcome by assigning each independent predictor a score ranging from 0 to 100. The cumulative sum of the contribution scores for each factor in the nomogram represents the probability of a 90-day poor outcome (range, 0–280 points; Figure 3A). The performance of the nomogram was validated by calculating the C-index, which was 0.763 (95% CI: 0.693–0.832) and 0.804 (95% CI: 0.719–0.889) in the training and the validation sets, respectively. A calibration plot with bootstraps of 1,000 repetitions was employed to compare the agreement of the 90-day poor outcome between nomogram predictions and actual observations, which revealed that the nomogram had good predictive accuracy in both the training and validation sets (Figures 3B,C). A decision curve analysis was performed to evaluate the net benefit of the nomogram model in predicting 90-day poor outcomes after MT in LVO patients. Figure 4 shows that, when the risk threshold ranged from 14 to 98% and from 7 to 92% in the training and in the validation sets, respectively, using the nomogram model in the current study to predict 90-day poor outcomes in stroke patients after MT resulted in a greater net benefit than either all AIS patients undergoing MT or no patients undergoing MT. For example, if the personal threshold probability of a patient was 50%, then the net benefit in this nomogram model was 14.6% (95% CI: 8.6–25.4%) and 5.9% (95% CI: 0–15.4%) in the training and the validation sets, respectively.

Figure 3
www.frontiersin.org

Figure 3. The nomogram model of a 90-day poor outcome (mRS scores of 4–6) in LVO patients after mechanical thrombectomy. (A) A nomogram for predicting the probability of a 90-day poor outcome. (B) A calibration curve of the training set. (C) A calibration curve of the validation set. The calibration plot with bootstraps of 1,000 repetitions represents the degree of fit between actual and nomogram-predicted poor outcomes. The x-axis represents the predicted probability of a 90-day poor outcome. The y-axis indicates the actual rate of 90-day poor outcomes. The dashed line represents the reference line, where an ideal nomogram would be. The dotted line represents the performance of the nomogram, while the solid line is corrected for any bias in the nomogram.

Figure 4
www.frontiersin.org

Figure 4. Decision curve analysis of the nomogram in the training set (A) and the validation set (B). x-axis, the threshold probability; y-axis, the net benefit. The gray line indicates that all acute ischemic stroke patients undergoing mechanical thrombectomy will develop poor functional outcomes at 3 months. The black line indicates that no acute ischemic stroke patients undergoing mechanical thrombectomy will develop poor functional outcomes at 3 months. The red line is the nomogram to predict 3-month poor functional outcomes in AIS patients undergoing mechanical thrombectomy.

Translation of the nomogram model into practice

To better translate the nomogram into clinical application, we developed a calculator for calculating each patient’s total score based on the contributions of each indicator in the model; thus, 96 points were assigned for patient ages ranging from 25 to 85 years, 100 points for glucose levels ranging from 4.0 to 24 mmol/L, 74 points for baseline NIHSS scores ranging from 5 to 40 score, 44 points for unsuccessful recanalization, and 40 points for the occurrence of END. The total score for individual patients was then calculated as follows: total score = (age–25) × [96/(85–25)] + (glucose level–4) × [100/ (24–4)] + (baseline NIHSS score–5) × [74/ (40–5)] + (0 or 1 of unsuccessful recanalization) × 44 + (0 or 1 of END) × 40. Then, we identified the optimal cutoff value for differing 90-day poor outcomes after MT in patients with AC-LVO, which was 144.65 in the training set and 110.72 in the validation set, showing a sensitivity of 51.8% (training set) and 76.3% (validation set) and a specificity of 92.2% (training set) and 73.5% (validation set). Furthermore, the chances of developing poor outcomes were approximately 60% in the training set and 35% in the validation set. The receiver operating characteristic curves and scatter plots of the total scores of the patients in the training and validation sets are shown in Figure 5.

Figure 5
www.frontiersin.org

Figure 5. The receiver operating characteristic (ROC) curve and scatter plot of total scores in individual patients translated by the nomogram calculator. The ROC for identifying the optimal threshold (left) and the scatter plot of the total scores (right) in AC-LVO patients undergoing MT in the training set (A) and in the internal validation set (B). AC-LVO, anterior circulation large-vessel occlusion; MT, mechanical thrombectomy.

Discussion

The present study developed a nomogram model composed of age, glucose level, baseline NIHSS score, unsuccessful recanalization, and END to predict the probability of a poor outcome at 90 days after MT in patients with AC-LVO. This prognostic nomogram for the prediction of 90-day poor outcomes was derived from a prospective, multicenter, randomized clinical trial of MT with two flow reconstruction devices within 8 h of symptom onset in AIS. Additionally, it was externally validated in a retrospective cohort study from another single center. The nomogram showed good predictive power with C-index values of 0.763 (0.693–0.832) in the training set and 0.804 (0.719–0.889) in the validation set.

In the present study, 45.2% (84/186) of the patients developed poor outcomes (mRS scores of 4–6) at 90 days after MT, which was comparable to the corresponding values (37.1%) in the highly effective reperfusion evaluated in the multiple endovascular stroke (HERMES) clinical trial (9) and the individual patient data meta-analysis on the RCTs of MT across a 6–24 h time window (AURORA trial; 40%) (17). The incidence of poor outcomes (mRS scores of 4–6) at 90 days after MT in AC-LVO patients documented by the previous RCTs varied substantially (68), ranging from 12 to 48.79%, which was expected to be further reduced by actively screening the relevant risk factors of prognosis. In addition, we achieved a successful recanalization rate of 76.3%, consistent with the 71% rate in the HERMES trial (9) and 81% in the AURORA clinical trial (17). With the sICH rate of 5.4% and a mortality rate of 20.9% being comparable to those in the HERMES (4.4 and 15.3%, respectively) (9) and AURORA (5.3 and 16.5%, respectively) trials (17), our study confirmed that MT was safe for treating AIS patients with AC-LVO within 8 h of symptom onset.

At present, scoring systems (13, 14, 1824) and nomograms (16, 25, 26) are the two main types of prognostic prediction tools for accurately and conveniently predicting clinical outcomes after MT. Although the existing scoring systems, including the THRIVE score (20), PRE score (14), and MR PREDICT score (27), have been externally validated, most of them focused on the 90-day independent functional outcomes (mRS scores of 0–2) or unfavorable outcomes (mRS ≥ 3), with less focus on the 90-day poor outcomes (mRS ≥ 4) (Supplementary Table S2) (12, 18, 19, 21, 22, 28). Among these, HAIT (18) and HIAT2 (19) were designed for the prediction of poor outcomes (mRS scores of 4–6) at discharge, which may have undermined their efficiency in predicting longer prognoses in clinical practice. The subsequent SAD score (22) and mTHRIVE score (21) that incorporated radiology variables based on the previous PRE (14) and THRIVE scores (20) were effective when applied for the prediction of 90-day poor outcomes; nevertheless, population-based cohort trials in large sample sizes were required to validate the utility of these scoring tools in clinical practice. Most of the recently developed nomogram models for predicting the 90-day outcomes after MT in acute AC-LVO patients were focused on either a good outcome (mRS scores of 0–2) or an unfavorable outcome (mRS scores ≥3). To our knowledge, the nomogram model constructed in this study is the first of its kind for the prediction of 90-day poor outcomes (mRS scores of 4 to 6) after MT in patients with AC-LVO, which provided a more accurate individualized estimation of the risk probability of poor outcomes (ranging from 0.2 to 0.95) by translating the nomogram into a formula instead of tracing lines along the scheme.

Prognostic prediction models have been classified into pre-procedure and post-procedure tools (11), which would be helpful for the selection and management of thrombectomy patients in decision-making. However, the variables used by scoring systems and nomogram models for predicting the risk of unfavorable outcomes vary considerably (12), posing a dilemma for their clinical application. In our study, three pre-treatment parameters (age, baseline NIHSS score, and glucose level on admission) were incorporated into the nomogram model. Previous studies have reported that advanced age is strongly associated with poor clinical outcomes in patients receiving MT (2931). In the PRE scoring system, it was also reported that, when applied to assess a good prognosis for octogenarian patients who have successfully achieved recanalization, the requirement was for their PRE scores to be within a specific range (14). Unlike previous studies that converted ages into a categorical variable by dichotomizing them on the basis of the median value, our study included age as a continuous variable in the nomogram and reported a contribution of 95 points to the total score to ensure complete utilization of within-category information. The baseline NIHSS score is a well-recognized variable that has been shown to be associated with 90-day functional independence following MT in AC-LVO (14, 19, 23). In our nomogram model, the baseline NIHSS score contributed 74 points to the total score for patients predicting the 90-day poor outcomes after MT in acute AC-LVO patients, although it was not an independent predictor of poor outcomes in the final nomogram model. The mechanisms by which hyperglycemia damages the blood vessels, causes the accumulation of extracellular glutamate, disrupts the blood–brain barrier, and eventually aggravates brain injury have been well established (3234). Therefore, higher levels of glucose would exacerbate the clinical outcomes in patients with LVO. Kim et al. (35) and Goyal et al. (36) demonstrated that hyperglycemia increased the risk of poor outcomes of incomplete reperfusion after MT, supporting the synergistic effect of ischemia–glucose concentration. Similarly, our study found that the glucose level on admission significantly contributed to a higher risk of poor outcomes in LVO patients after MT in the prognostic nomogram model, with 100 points contributing to the total score of the nomogram model. Consistently, the meta-analysis conducted by Calos et al. (37) also demonstrated that hyperglycemia could increase the risk of unfavorable clinical outcomes in LVO patients undergoing MT.

Unlike the previous scoring systems and the nomogram models based on pre-treatment variables for prognostic prediction, we developed a nomogram that also incorporated two post-treatment variables for predicting the probability of 90-day poor outcomes in AIS patients eligible for MT. Although the reasons why 19–43% of AIS patients with futile recanalization exhibited unfavorable outcomes (23) and 34% of AIS patients with failed recanalization obtained favorable outcomes (38) have not been fully elucidated, the beneficial effect of MT in AIS patients remains undeniable. Nevertheless, an unsuccessful recanalization rate of 12–41.3% (8) has been associated with the unfavorable outcome of AIS patients after MT, weakening the clinical efficacy of MT to a certain extent. In the IER-START nomogram (16), the reperfusion grade was demonstrated as a strong post-treatment radiological predictor of unfavorable outcomes 3 months after thrombectomy. The most recently published study of a clinical nomogram also reinforced the increased risk of 3-month unfavorable outcomes after unsuccessful recanalization (25). Consistently, we found that unsuccessful recanalization was a strong predictor of poor clinical outcomes, with a contribution of 44 to the total score, in patients with AIS following MT and can be effectively used to estimate the probability of poor outcomes after MT. The incidence of END in LVOS patients after MT is 35–42% (3941), and it has been identified as a definite risk factor for 90-day poor clinical outcomes in AIS patients treated with MT (40, 4244). Unfortunately, no previous study has reported its role in predicting the probability of unfavorable outcomes in AIS patients treated with MT. We employed END as a risk factor that exhibited strong power in predicting the probability of a 90-day poor outcome, with a contribution of 40 points to the total score.

Limitations

This study had some limitations. First, the sample sizes of both the training and validation sets for model construction and validation were relatively small. Therefore, studies with larger sample sizes are required for future validation. Second, the data used for our nomogram model were derived from randomized controlled clinical trials, which may not be the optimal design for prognostic studies. Unlike those in real-world studies, RCTs enroll patients who strictly meet the inclusion criteria and provide informed consent; thus, the study population in an RCT is not fully representative of the general population. The generalizability of the model may have been weakened by this factor.

Conclusion

Our post-treatment nomogram model consisting of five variables (age, baseline NIHSS score, glucose level on admission, unsuccessful recanalization, and END) exhibited very good efficacy in external validation and can be used to accurately estimate the probability of a poor outcome at 90 days for LVOS patients who underwent MT within 8 h after the stroke onset. This post-MT nomogram model can be easily translated into practice and can complement existing models.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by the ethics committee of PLA Rocket Force Characteristic Medical Center (X2017008). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

XL: Writing – original draft, Data curation, Investigation. CL: Writing – original draft, Writing – review & editing, Investigation, Methodology, Project administration, Resources. A-fL: Writing – original draft, Writing – review & editing, Investigation, Methodology. C-cJ: Investigation, Writing – review & editing, Methodology, Project administration. Y-qZ: Investigation, Methodology, Writing – review & editing. YL: Investigation, Methodology, Writing – review & editing. Y-yZ: Investigation, Writing – review & editing, Formal analysis. H-yL: Formal analysis, Writing – review & editing, Software. W-jJ: Writing – review & editing, Conceptualization, Funding acquisition, Methodology, Resources, Supervision. JL: Conceptualization, Supervision, Writing – review & editing, Formal analysis, Writing – original draft.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was supported by the grants from the National Key Basic Research Program of China (973 program) (grant no. 2013CB733805), the National Natural Science Foundation of China (grant no. 81871464), and the Joint Project of Inner Mongolia Medical University (grant no. YKD2021LH085).

Acknowledgments

The authors thank all the participating hospitals, relevant clinicians, statisticians, as well as imaging and laboratory technicians of the Jrecan Trial Collaborative Group for their support.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2024.1259973/full#supplementary-material

References

1. Berkhemer, OA, Fransen, PS, Beumer, D, Van Den Berg, LA, Lingsma, HF, Yoo, AJ, et al. A randomized trial of intraarterial treatment for acute ischemic stroke. N Engl J Med. (2015) 372:11–20. doi: 10.1056/NEJMoa1411587

Crossref Full Text | Google Scholar

2. Saver, JL, Jahan, R, Levy, EI, Jovin, TG, Baxter, B, Nogueira, RG, et al. Solitaire flow restoration device versus the Merci retriever in patients with acute ischaemic stroke (SWIFT): a randomised, parallel-group, non-inferiority trial. Lancet. (2012) 380:1241–9. doi: 10.1016/S0140-6736(12)61384-1

Crossref Full Text | Google Scholar

3. Goyal, M, Demchuk, AM, Menon, BK, Eesa, M, Rempel, JL, Thornton, J, et al. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med. (2015) 372:1019–30. doi: 10.1056/NEJMoa1414905

Crossref Full Text | Google Scholar

4. Campbell, BC, Mitchell, PJ, Kleinig, TJ, Dewey, HM, Churilov, L, Yassi, N, et al. Endovascular therapy for ischemic stroke with perfusion-imaging selection. N Engl J Med. (2015) 372:1009–18. doi: 10.1056/NEJMoa1414792

Crossref Full Text | Google Scholar

5. Jovin, TG, Chamorro, A, Cobo, E, de Miquel, MA, Molina, CA, Rovira, A, et al. Thrombectomy within 8 hours after symptom onset in ischemic stroke. N Engl J Med. (2015) 372:2296–306. doi: 10.1056/NEJMoa1503780

Crossref Full Text | Google Scholar

6. Nogueira, RG, Jadhav, AP, Haussen, DC, Bonafe, A, Budzik, RF, Bhuva, P, et al. Thrombectomy 6 to 24 hours after stroke with a mismatch between deficit and infarct. N Engl J Med. (2018) 378:11–21. doi: 10.1056/NEJMoa1706442

PubMed Abstract | Crossref Full Text | Google Scholar

7. Albers, GW, Marks, MP, Kemp, S, Christensen, S, Tsai, JP, Ortega-Gutierrez, S, et al. Thrombectomy for stroke at 6 to 16 hours with selection by perfusion imaging. N Engl J Med. (2018) 378:708–18. doi: 10.1056/NEJMoa1713973

PubMed Abstract | Crossref Full Text | Google Scholar

8. Hasan, TF, Todnem, N, Gopal, N, Miller, DA, Sandhu, SS, Huang, JF, et al. Endovascular thrombectomy for acute ischemic stroke. Curr Cardiol Rep. (2019) 21:112. doi: 10.1007/s11886-019-1217-6

Crossref Full Text | Google Scholar

9. Goyal, M, Menon, BK, van Zwam, WH, Dippel, DW, Mitchell, PJ, Demchuk, AM, et al. Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet. (2016) 387:1723–31. doi: 10.1016/S0140-6736(16)00163-X

PubMed Abstract | Crossref Full Text | Google Scholar

10. Rangaraju, S, Haussen, D, Nogueira, RG, Nahab, F, and Frankel, M. Comparison of 3-month stroke disability and quality of life across modified Rankin scale categories. Interv Neurol. (2017) 6:36–41. doi: 10.1159/000452634

PubMed Abstract | Crossref Full Text | Google Scholar

11. Raza, SA, and Rangaraju, S. Prognostic scores for large vessel occlusion strokes. Neurology. (2021) 97:S79–90. doi: 10.1212/WNL.0000000000012797

Crossref Full Text | Google Scholar

12. Kremers, F, Venema, E, Duvekot, M, Yo, L, Bokkers, R, Lycklama, ANG, et al. Outcome prediction models for endovascular treatment of ischemic stroke: systematic review and external validation. Stroke. (2021) 53:825–36. doi: 10.1161/STROKEAHA.120.033445

PubMed Abstract | Crossref Full Text | Google Scholar

13. Flint, AC, Cullen, SP, Faigeles, BS, and Rao, VA. Predicting long-term outcome after endovascular stroke treatment: the totaled health risks in vascular events score. AJNR Am J Neuroradiol. (2010) 31:1192–6. doi: 10.3174/ajnr.A2050

PubMed Abstract | Crossref Full Text | Google Scholar

14. Rangaraju, S, Aghaebrahim, A, Streib, C, Sun, CH, Ribo, M, Muchada, M, et al. Pittsburgh response to endovascular therapy (PRE) score: optimizing patient selection for endovascular therapy for large vessel occlusion strokes. J Neurointerv Surg. (2015) 7:783–8. doi: 10.1136/neurintsurg-2014-011351

PubMed Abstract | Crossref Full Text | Google Scholar

15. Venema, E, Roozenbeek, B, Mulder, M, Brown, S, Majoie, C, Steyerberg, EW, et al. MCR. Prediction of outcome and endovascular treatment benefit: validation and update of the MR PREDICTS decision tool. Stroke. (2021) 52:2764–72. doi: 10.1161/STROKEAHA.120.032935

Crossref Full Text | Google Scholar

16. Cappellari, M, Mangiafico, S, Saia, V, Pracucci, G, Nappini, S, Nencini, P, et al. IER-START nomogram for prediction of three-month unfavorable outcome after thrombectomy for stroke. Int J Stroke. (2020) 15:412–20. doi: 10.1177/1747493019837756

PubMed Abstract | Crossref Full Text | Google Scholar

17. Jovin, TG, Nogueira, RG, Lansberg, MG, Demchuk, AM, Martins, SO, Mocco, J, et al. Thrombectomy for anterior circulation stroke beyond 6 h from time last known well (AURORA): a systematic review and individual patient data meta-analysis. Lancet. (2022) 399:249–58. doi: 10.1016/S0140-6736(21)01341-6

Crossref Full Text | Google Scholar

18. Hallevi, H, Barreto, AD, Liebeskind, DS, Morales, MM, Martin-Schild, SB, Abraham, AT, et al. Identifying patients at high risk for poor outcome after intra-arterial therapy for acute ischemic stroke. Stroke. (2009) 40:1780–5. doi: 10.1161/STROKEAHA.108.535146

PubMed Abstract | Crossref Full Text | Google Scholar

19. Sarraj, A, Albright, K, Barreto, AD, Boehme, AK, Sitton, CW, Choi, J, et al. Optimizing prediction scores for poor outcome after intra-arterial therapy in anterior circulation acute ischemic stroke. Stroke. (2013) 44:3324–30. doi: 10.1161/STROKEAHA.113.001050

PubMed Abstract | Crossref Full Text | Google Scholar

20. Flint, AC, Rao, VA, Chan, SL, Cullen, SP, Faigeles, BS, Smith, WS, et al. Improved ischemic stroke outcome prediction using model estimation of outcome probability: the THRIVE-c calculation. Int J Stroke. (2015) 10:815–21. doi: 10.1111/ijs.12529

PubMed Abstract | Crossref Full Text | Google Scholar

21. Ryu, CW, Kim, BM, Kim, HG, Heo, JH, Nam, HS, Kim, DJ, et al. Optimizing outcome prediction scores in patients undergoing endovascular thrombectomy for large vessel occlusions using collateral grade on computed tomography angiography. Neurosurgery. (2019) 85:350–8. doi: 10.1093/neuros/nyy316

PubMed Abstract | Crossref Full Text | Google Scholar

22. Liggins, JT, Yoo, AJ, Mishra, NK, Wheeler, HM, Straka, M, Leslie-Mazwi, TM, et al. A score based on age and DWI volume predicts poor outcome following endovascular treatment for acute ischemic stroke. Int J Stroke. (2015) 10:705–9. doi: 10.1111/ijs.12207

PubMed Abstract | Crossref Full Text | Google Scholar

23. Sallustio, F, Toschi, N, Mascolo, AP, Marrama, F, Morosetti, D, Da Ros, V, et al. Selection of anterior circulation acute stroke patients for mechanical thrombectomy. J Neurol. (2019) 266:2620–8. doi: 10.1007/s00415-019-09454-2

Crossref Full Text | Google Scholar

24. Ben Hassen, W, Raynaud, N, Bricout, N, Boulouis, G, Legrand, L, Ferrigno, M, et al. MT-DRAGON score for outcome prediction in acute ischemic stroke treated by mechanical thrombectomy within 8 hours. J Neurointerv Surg. (2020) 12:246–51. doi: 10.1136/neurintsurg-2019-015105

PubMed Abstract | Crossref Full Text | Google Scholar

25. Meng, L, Wang, H, Yang, H, Zhang, X, Zhang, Q, Dong, Q, et al. Nomogram to predict poor outcome after mechanical thrombectomy at older age and histological analysis of thrombus composition. Oxidative Med Cell Longev. (2020) 2020:8823283–8. doi: 10.1155/2020/8823283

PubMed Abstract | Crossref Full Text | Google Scholar

26. Li, X, Zou, Y, Hu, J, Li, XM, Huang, CP, Shan, YJ, et al. A NAC nomogram to predict the probability of three-month unfavorable outcome in Chinese acute ischemic stroke patients treated with mechanical thrombectomy. Int J Neurosci. (2021) 131:163–9. doi: 10.1080/00207454.2020.1733565

PubMed Abstract | Crossref Full Text | Google Scholar

27. Venema, E, Mulder, M, Roozenbeek, B, Broderick, JP, Yeatts, SD, Khatri, P, et al. Selection of patients for intra-arterial treatment for acute ischaemic stroke: development and validation of a clinical decision tool in two randomised trials. BMJ. (2017) 357:j1710. doi: 10.1136/bmj.j1710

PubMed Abstract | Crossref Full Text | Google Scholar

28. Karamchandani, RR, Prasad, T, Strong, D, Rhoten, JB, and Asimos, AW. A tool to improve stroke outcome prediction: the charlotte large artery occlusion endovascular therapy outcome score. J Stroke Cerebrovasc Dis. (2022) 31:106393. doi: 10.1016/j.jstrokecerebrovasdis.2022.106393

PubMed Abstract | Crossref Full Text | Google Scholar

29. Shi, ZS, Liebeskind, DS, Xiang, B, Ge, SG, Feng, L, Albers, GW, et al. Predictors of functional dependence despite successful revascularization in large-vessel occlusion strokes. Stroke. (2014) 45:1977–84. doi: 10.1161/STROKEAHA.114.005603

PubMed Abstract | Crossref Full Text | Google Scholar

30. Linfante, I, Starosciak, AK, Walker, GR, Dabus, G, Castonguay, AC, Gupta, R, et al. Predictors of poor outcome despite recanalization: a multiple regression analysis of the NASA registry. J Neurointerv Surg. (2016) 8:224–9. doi: 10.1136/neurintsurg-2014-011525

PubMed Abstract | Crossref Full Text | Google Scholar

31. Wang, H, Zhang, M, Hao, Y, Zi, W, Yang, D, Zhou, Z, et al. Early prediction of poor outcome despite successful recanalization after endovascular treatment for anterior large vessel occlusion stroke. World Neurosurg. (2018) 115:e312–21. doi: 10.1016/j.wneu.2018.04.042

PubMed Abstract | Crossref Full Text | Google Scholar

32. Pulsinelli, WA, Waldman, S, Rawlinson, D, and Plum, F. Moderate hyperglycemia augments ischemic brain damage: a neuropathologic study in the rat. Neurology. (1982) 32:1239–46. doi: 10.1212/wnl.32.11.1239

PubMed Abstract | Crossref Full Text | Google Scholar

33. Koistinaho, J, Pasonen, S, Yrjanheikki, J, and Chan, PH. Spreading depression-induced gene expression is regulated by plasma glucose. Stroke. (1999) 30:114–9. doi: 10.1161/01.str.30.1.114

PubMed Abstract | Crossref Full Text | Google Scholar

34. Li, PA, Shuaib, A, Miyashita, H, He, QP, Siesjo, BK, and Warner, DS. Hyperglycemia enhances extracellular glutamate accumulation in rats subjected to forebrain ischemia. Stroke. (2000) 31:183–92. doi: 10.1161/01.str.31.1.183

PubMed Abstract | Crossref Full Text | Google Scholar

35. Kim, JT, Jahan, R, Saver, JL, and Investigators, S. Impact of glucose on outcomes in patients treated with mechanical thrombectomy: a post hoc analysis of the solitaire flow restoration with the intention for thrombectomy study. Stroke. (2016) 47:120–7. doi: 10.1161/STROKEAHA.115.010753

PubMed Abstract | Crossref Full Text | Google Scholar

36. Goyal, N, Tsivgoulis, G, Pandhi, A, Dillard, K, Katsanos, AH, Magoufis, G, et al. Admission hyperglycemia and outcomes in large vessel occlusion strokes treated with mechanical thrombectomy. J Neurointerv Surg. (2018) 10:112–7. doi: 10.1136/neurintsurg-2017-012993

PubMed Abstract | Crossref Full Text | Google Scholar

37. Perez-Vega, C, Domingo, RA, Tripathi, S, Ramos-Fresnedo, A, Kashyap, S, Quinones-Hinojosa, A, et al. Influence of glucose levels on clinical outcome after mechanical thrombectomy for large-vessel occlusion: a systematic review and meta-analysis. J Neurointerv Surg. (2021) 14:neurintsurg-2021-017771. doi: 10.1136/neurintsurg-2021-017771

PubMed Abstract | Crossref Full Text | Google Scholar

38. Ospel, JM, Hill, MD, Demchuk, A, Menon, BK, Thornton, J, Rempel, J, et al. Clinical impact of EVT with failed reperfusion in patients with acute ischemic stroke: results from the ESCAPE and ESCAPE-NA1 trials. Neuroradiology. (2021) 63:1883–9. doi: 10.1007/s00234-021-02723-w

PubMed Abstract | Crossref Full Text | Google Scholar

39. Kim, JM, Bae, JH, Park, KY, Lee, WJ, Byun, JS, Ahn, SW, et al. Incidence and mechanism of early neurological deterioration after endovascular thrombectomy. J Neurol. (2019) 266:609–15. doi: 10.1007/s00415-018-09173-0

PubMed Abstract | Crossref Full Text | Google Scholar

40. Zhang, YB, Su, YY, He, YB, Liu, YF, Liu, G, and Fan, LL. Early neurological deterioration after recanalization treatment in patients with acute ischemic stroke: a retrospective study. Chin Med J. (2018) 131:137–43. doi: 10.4103/0366-6999.222343

PubMed Abstract | Crossref Full Text | Google Scholar

41. Kim, JM, Moon, J, Ahn, SW, Shin, HW, Jung, KH, and Park, KY. The Etiologies of early neurological deterioration after thrombolysis and risk factors of ischemia progression. J Stroke Cerebrovasc Dis. (2016) 25:383–8. doi: 10.1016/j.jstrokecerebrovasdis.2015.10.010

PubMed Abstract | Crossref Full Text | Google Scholar

42. Seners, P, Turc, G, Oppenheim, C, and Baron, JC. Incidence, causes and predictors of neurological deterioration occurring within 24 h following acute ischaemic stroke: a systematic review with pathophysiological implications. J Neurol Neurosurg Psychiatry. (2015) 86:87–94. doi: 10.1136/jnnp-2014-308327

PubMed Abstract | Crossref Full Text | Google Scholar

43. Helleberg, BH, Ellekjaer, H, and Indredavik, B. Outcomes after early neurological deterioration and transitory deterioration in acute ischemic stroke patients. Cerebrovasc Dis. (2016) 42:378–86. doi: 10.1159/000447130

PubMed Abstract | Crossref Full Text | Google Scholar

44. Li, Z, Zhang, H, Han, J, Chu, Z, Zhao, S, Yang, Q, et al. Time course and clinical relevance of neurological deterioration after endovascular recanalization therapy for anterior circulation large vessel occlusion stroke. Front Aging Neurosci. (2021) 13:651614. doi: 10.3389/fnagi.2021.651614

PubMed Abstract | Crossref Full Text | Google Scholar

Glossary

Keywords: mechanical thrombectomy (MT), large-vessel occlusion (LVO), acute ischemic stroke (AIS), poor outcome, nomogram, prognostic predictive model

Citation: Li X, Li C, Liu A-f, Jiang C-c, Zhang Y-q, Liu Y-e, Zhang Y-y, Li H-y, Jiang W-j and Lv J (2024) Application of a nomogram model for the prediction of 90-day poor outcomes following mechanical thrombectomy in patients with acute anterior circulation large-vessel occlusion. Front. Neurol. 15:1259973. doi: 10.3389/fneur.2024.1259973

Received: 17 July 2023; Accepted: 02 January 2024;
Published: 19 January 2024.

Edited by:

Lucio D’Anna, Imperial College London, United Kingdom

Reviewed by:

Chubin Ou, Macquarie University, Australia
Raffaele Ornello, University of L’Aquila, Italy
Matteo Foschi, Azienda Unità Sanitaria Locale (AUSL) della Romagna, Italy

Copyright © 2024 Li, Li, Liu, Jiang, Zhang, Liu, Zhang, Li, Jiang and Lv. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Wei-jian Jiang, jiangweijian2018@163.com; Jin Lv, lvjin6630@hotmail.com

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.