Risk prediction models for discharge disposition in patients with stroke: a systematic review and meta-analysis

Aims: Multivariate prediction models can be used to estimate the risk of discharged stroke patients needing a higher level of care. To determine the model’s performance, a systematic evaluation and meta-analysis were performed.

Methods: China National Knowledge Infrastructure (CNKI), Wanfang Database, China Science and Technology Journal Database (VIP), SinoMed, PubMed, Web of Science, CINAHL, and Embase were searched from inception to September 30, 2024. Multiple reviewers independently conducted screening and data extraction. The Prediction Model Risk of Bias Assessment Tool (PROBAST) checklist was used to assess the risk of bias and applicability. All statistical analyses were conducted in Stata 17.0.

Results: A total of 4,059 studies were retrieved, and after the selection process, 14 studies included 22 models were included in this review. The incidence of non-home discharge in stroke patients ranged from 15 to 84.9%. The most frequently used predictors were age, the National Institutes of Health Stroke Scale (NIHSS) score at admission, the Functional Independence Measure (FIM) cognitive function score, and the FIM motor function score. The reported area under the curve (AUC) ranged from 0.75 to 0.95. Quality appraisal was performed. All studies were found to have a high risk of bias, mainly attributable to unsuitable data sources and inadequate reporting of the analytical domain. All statistical analyses were conducted in Stata 17.0. In the meta-analysis, the area under the curve (AUC) value for the five validation models was 0.80 [95%CI (0.75–0.86)].

Conclusion: Research on risk prediction models for stroke patient discharge disposition is still in its initial stages, with a high overall risk of bias and a lack of clinical application, but the model has good predictive performance. Future research should focus on developing highly interpretive, high-performance, easy-to-use machine learning models, enhancing external validation, and driving clinical applications.

Systematic review registration: https://www.crd.york.ac.uk/PROSPERO/, CRD42024576996.

1 Introduction

Stroke ranks as the world’s second-deadliest cause and significantly exacerbates long-term impairments and suboptimal rehabilitation (1), placing a heavy societal toll. Due to the high survival rate (2) and the increasing population alongside increased life expectancy, the total count of stroke occurrences is continuously rising (3, 4). About 70–80% of stroke survivors experience varying degrees of functional disabilities, such as language, cognition, swallowing, and limb movement (5). Patients with stroke have relatively high rehabilitation needs and still require further rehabilitation training and care support after discharge (6, 7). Effective rehabilitation nursing is particularly crucial for improving the patients’ quality of life.

Discharge disposition refers to the location or place where a patient will go after being discharged from the hospital, including returning to their original home for home-based care without new family members moving in to provide care, or having a new nanny or caregiver provide care at home, being admitted to the home of relatives for care, or being admitted to rehabilitation institutions, professional care facilities, nursing homes, lower-level hospitals, etc., for non-home-based discharge arrangements (8). If the rehabilitation plan after discharge is not properly implemented and the discharge placement is inappropriate, patients will face multiple challenges such as difficulties in meeting their rehabilitation needs, an increased risk of falls, secondary injuries, and unplanned readmission (9). Therefore, the development of methods for the early identification of patients requiring high levels of care postdischarge has become important for patients, caregivers, clinicians, and payers alike.

Risk prediction assessment tools are used for early screening, identification of delayed discharge or unplanned readmission risk, and early prediction of discharge destination in patients to initiate discharge preparation services as early as possible and shorten the transition time from admission to discharge (10, 11). A systematic review (12) indicates that social economic factors, family support, and the patient’s psychological condition can predict the patient’s discharge placement, and it suggests that clinical healthcare providers should implement personalized discharge plans based on social support, living conditions, insurance type, and the patient’s psychological assessment results. Currently, there is no unified standardized screening tool. The commonly used screening tools are the Blaylock Risk Assessment Screening Score (BRASS) (13) and the LACE Index scoring tool (LACE Index Scoring Tool for Risk Assessment of Death and Readmission) (14), which are widely used to clinically evaluate the risk of delayed discharge or unexpected readmission. However, these measures may not adequately reflect the likelihood of unplanned readmission or delayed discharge in a particular demographic, and they frequently lack specificity for stroke patients. As a result, developing risk prediction models for stroke patients’ discharge disposition has gained importance.

In recent years, many risk prediction models for stroke patients’ discharge disposition have been developed globally, but their usefulness and quality have not been thoroughly assessed. Thus, we embarked on an exhaustive review of pertinent research to meticulously assess the risk bias and clinical feasibility of these models. Our goal was to establish a solid scientific foundation for the creation, implementation, optimization, and tailored prevention and care strategies for risk prediction models concerning discharge outcomes in stroke patients.

2 Methods

According to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, this systematic review was conducted. On August 18, 2024, the study protocol was registered on PROSPERO (CRD42024576996).

2.1 Search strategy

To cast a wide net in our search, we scoured both Chinese and English databases due to the vast population and widespread use of these languages. The databases under the microscope were the China National Knowledge Infrastructure (CNKI), Wanfang, the China Science and Technology Journal Database (VIP), SinoMed, PubMed, Web of Science, the Cochrane Library, CINAHL, and Embase. Our search was exhaustive, covering the birth of these databases up to September 30, 2024. We combed through with the following search terms: “Stroke,” “Cerebral stroke,” “patient discharge,” “disposition,” “outcome,” “destination,” “prediction model,” “Risk factors,” “Predictors” and “Risk score,” along with their respective variations. The nitty-gritty of our search tactics is detailed in Supplemental material. Moreover, we delved into reference lists and pertinent systematic reviews manually to uncover any pertinent studies that might have been overlooked for inclusion in our analysis.

In conducting our systematic review, we relied on the PICOTS system, which is endorsed by the Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Studies (CHARMS) checklist (15). This system is instrumental in shaping the review’s objectives, the search methodology, as well as the criteria for including and excluding studies (16). The core components of our systematic review are outlined here:

P (Population): Stroke patients.

I (Intervention model): Published stroke patient discharge disposition risk prediction model construction and/or validation (predictor ≥2).

C (Comparator): No rival model exists.

O (Outcome): Discharge back to home or non-home disposition.

T (Timing): Predictions were derived following an assessment of stroke patients’ fundamental details and laboratory metrics.

S (Setting): Used during hospitalization to predict high-risk discharge disposition for stroke patients, providing personalized interventions to improve patient prognosis and quality of life.

2.2 Inclusion and exclusion criteria

The inclusion criteria were: (1) Study subjects: Conforms to the diagnostic standards for stroke guidelines for therapy established by the Neurology Branch of the Chinese Medical Association (17), MRI or CT scans were used to diagnose stroke; aged ≥18 years; (2) Study types: include cohort studies, cross-sectional studies, and case–control studies; (3) Study content: focused on the construction and validation of risk prediction models for discharge disposition in stroke patients; (4) Predict the outcome: discharge to home or non-home setting; (5) Language type: Chinese or English textual form.

The exclusion criteria were: (1) Articles that identified risk factors but did not formulate a predictive model; (2) Study included fewer than two predictors in the model; (3) Studies with incomplete data or full text; (4) reviews, systematic reviews, and meta-analyses; (5) Conference papers.

2.3 Study selection and screening

Two writers (XCR and HL) individually imported all retrieved records into Zotero,¹ an open-source, free reference management software. The duplicate studies were then first removed. Second, the rest of papers were assessed at random based on their abstract and title to see if they qualified for inclusion. The papers were then further examined in full text in accordance with the inclusion and exclusion criteria, and more potentially suitable research were located by looking through the reference lists of all eligible studies. When the authors could not agree on which research were eligible, authors (XCR, HL, and XLJ) talked it out and came to an agreement.

2.4 Data extraction

Two authors (XCR and HL) individually extracted search results and checked with each other to minimize bias and ensure the consistency of collected data. According to the CHARMS checklist (Checklists for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Studies) (15) used for systematic review data extraction of risk prediction models, the following data were extracted from the included studies: basic information included details such as author, publication year, research design, participants, data source, and sample size. Variable selection method, model building methodologies, validation kinds, performance measures, continuous variable handling techniques, final predicted variables, and presentation styles are all examples of model information. A third reviewer (XLJ) confirmed the information gathered during data extraction. To make sure they all agreed, the three researchers discussed and worked out any discrepancies. The two reviewers had extremely high consistency during the whole-text screening phase, with a Cohen’s kappa coefficient of 0.86 [Cohen’s kappa≥0.75 indicates extremely good consistency in the screening results (18)].

2.5 Risk of bias and applicability assessment

The quality of the included studies was assessed based on the TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) guidelines (19), which offer a template for the transparent and comprehensive reporting of a multivariate predictive model for individual prognosis or diagnosis. Furthermore, the PROBAST (Predictive Model Risk of Bias Assessment Tool) was used to assess the risk of bias and applicability of the included studies in the present research on predictive modeling (20). The risk of bias was assessed in four domains: participants, predictors, outcomes, and analysis methods. Each domain comprised 2–9 questions, and the answers were scored as “Yes/Likely,” “No/Unlikely,” or “No Information,” representing low risk of bias, high risk of bias, or unclear risk of bias, respectively. The domain of risk of bias was judged as low risk if all questions were scored as low risk; if one or more questions were scored as unclear, the domain was judged as unclear; and if one or more questions were scored as high risk, the domain was judged as high risk. Applicability was assessed in three fields—“participants,” “predictors” and “outcome measures” (excluding the critical issues)—with criteria similar to those used for the bias assessment (21, 22). Two researchers (XCR and HL) used the PROBAST tool to independently assess the risk of bias and the applicability of the prediction models included in the present study. A third researcher (XLJ) was consulted for a conclusion in cases of disagreement.

2.6 Data synthesis and statistical analysis

Use Stata 17.0 software to perform analysis using the area under the curve (AUC) and 95% confidence interval (CI) as effect statistics. Employ the Q test and I² statistic to assess heterogeneity among multiple studies. If p > 0.1 or I² < 50%, it indicates low heterogeneity between studies, and a fixed-effects model is used for combined analysis (23); if p ≤ 0.1 or I² ≥ 50%, it suggests significant heterogeneity among studies, and a random-effects model is adopted, along with sensitivity analysis (24). To assess publication bias, Egger’s test and a funnel plot were employed. At α = 0.05, the significance level is established. There is less chance of publication bias when p > 0.05.

2.7 Ethical approval

Ethical approval was unnecessary in this study, because it was a systematic review of existing articles, and no individual patient data were handled.

3 Results

3.1 Study selection

A total of 4,059 indexed documents were found in the first search. The titles and abstracts of 3,239 documents were evaluated after 820 duplicate records discovered in all databases were eliminated. Fifty six papers were included for additional review after this screening procedure. In the course of the following assessment, 15 studies were ruled out because they either did not create prediction models or only addressed risk factors. Furthermore, seven studies were deemed incompatible with the review’s target population, 10 studies included fewer than two predictors, and 11 studies were unable to provide necessary data. The PRISMA flow diagram, which depicts the thorough literature screening procedure and outcomes, is displayed in Figure 1.

Figure 1

Figure 1. Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) flowchart of literature search and selection.

3.2 Study characteristics

The review’s studies were released between 2008 and 2024. Four of these were carried out in Japan, three in the United States, two in Australia, and one each in China, the United Kingdom, Switzerland, South Korea, and France. Regarding study design, six were prospective studies (including two multicenter studies), and eight were retrospective studies. The subjects consisted of two categories, with nine studies focused on stroke patients in the acute phase and five studies focusing on stroke patients undergoing rehabilitation in the sub-acute phase. Predicting discharge outcomes mainly involves two scenarios: home and non-home discharge. The former includes patients being discharged back to their own homes or the homes of relatives or friends, while the latter includes patients dying during hospitalization or being discharged to inpatient rehabilitation facilities, professional nursing facilities, nursing homes, secondary hospitals, rehabilitation centers, etc. The incidence of home discharge ranges from 15.1 to 85%, and the incidence of non-home discharge ranges from 15 to 84.9%. The number of people included in these studies varied, with sample sizes ranging from 296 to 74,425. Table 1 provides specifics.

Table 1

Table 1. Overview of basic data of the included studies.

3.3 Basic characteristics of prediction models

A total of 22 prediction models were constructed across the 14 studies. Cui et al. (25) developed 6 models and before deciding on the best one for creating nomograms, Lensky et al. (26) developed 3 models, Brauer et al. (7) developed 2 models; 1 model was built in each of the other studies. In terms of variable selection, Cui et al. (25) (8.3%) optimal model used the Feature Importance analysis, Lensky et al. (26) (8.3%) applied principal component analysis, Itaya et al. (27) and Stineman et al. (28) (16.7%) applied the backward variable selection method, Brauer et al. (7) (8.3%) used a multinomial forward stepwise logistic regression, and the other 7 studies (58.3%) utilized univariate analysis to select variables. Regarding modeling methods, Cui et al. (25), Lensky et al. (26), Veerbeek et al. (29), and Berker et al. (30) employed machine learning method, such as the support vector machine (SVM), random forests (RF), naive bayes (NB), gradient boosting (GB), KNearest Neighbors (KNN) (25), AdaBoost, Bootstrap (26), and CART decision tree (29), while other 10 models used logistic regression (LR). The performance indicators mentioned in this research report include model Calibration, sensitivity, specificity, accuracy rate and AUC. For all these indicators, the closer the value is to 1.0, the better the performance. Thirteen models provided the area under the curve (AUC), which varied between 0.75 and 0.95; one model (31) reported the C statistic. Nine studies addressed calibration, and the most commonly used approach was the Hosmer-Lemeshow test. Only one study (25) compared machine learning algorithms with other classical statistical methods (including logistic regression). Cui et al. (25) compared the LR, SVM, RF, NB, GB, and KNN models using data from 523 stroke patients and found that the RF model was the best. Additionally, the AUC values of four of the machine learning algorithms were higher than that of the logistic regression model, while the KNN model was slightly lower than the LR model (LR: 0.85, SVM: 0.92; RF: 0.95; NB: 0.93; GB: 0.93; KNN: 0.84). Details are provided in Tables 2, 3.

Table 2

Table 2. Overview of the information of the included prediction models.

Table 3

Table 3. The frequency of each variable selection method.

The prediction models in the majority of the 14 investigations were validated either internally or externally, proving their generalizability and robustness. In particular, nine research were validated internally, while four studies were validated externally. Two articles were combined with internal and external validation, and two articles did not perform any validation after model construction. Regarding model presentation, 7 used risk scoring system, 5 used formula of risk score obtained by regression coefficient of each factor, and 1 studies used nomograms. The total amount of predictors that are included ranges from two to ten. The most often utilized factors in these models are age, the Functional Independence Measure (FIM) cognitive function score, the National Institutes of Health Stroke Scale (NIHSS) score at admission, and the FIM motor function score, which appear in six, five, five, and four studies, respectively. Other commonly used predictive indicators include the modified Rankin Scale (mRS) score at admission and stroke types, which appear in three studies. Barthel index (BI), Enteral feeding, pre-admission residence, marital status, paralysis degree, living alone and comorbidities, which appear in two studies. Additional details are available in Table 4.

Table 4

Table 4. Includes the literature predictors and the presentation methods.

3.4 Results of quality assessment

3.4.1 Risk of bias assessment

All 14 studies included in the narrative review were scored as risk of bias (ROB) using the PROBAST (Figure 2). All 14 (100%) of the studies were assessed as having a high ROB overall, pointing to methodological issues with the development or validation procedures. The main reasons for high ROB were as follows: events per variable (EPV) < 10, defects or omission in handling missing data, flaws in methods for the selection of predictors and inadequate assessment of model performance measures.

Figure 2

Figure 2. Risk of bias assessment for the predictive model studies.

In the participant domain, two studies were found to have a significant risk of bias, mainly as a result of unreliable data sources (10, 32). In the predictor domain, two studies were judged to have a high risk of bias because they included predictive variables that were based on hypotheses (29, 33). In the outcome domain, four studies were identified as having a high risk of bias due to an inappropriate time interval being left between evaluating predictive factors and determining outcomes (7, 11, 32, 33).

All 14 studies were judged to have a high risk of bias in the analytical domain. Five of these studies lacked sufficient sample size for validation or modeling (7, 11, 29, 32, 34). For modeling studies, the number of EPV should be greater than 20 for each variable to avoid over-fitting of the model; for model validation studies, at least 100 subjects with outcome events should be included (35). Four studies lacked detailed information on participant follow-up, withdrawal, or study termination, and how missing data were handled (28, 34, 36, 37),six studies directly deleted subjects with missing values, without adopting the complete case analysis method to reduce bias (7, 11, 25, 31–33). Continuous variables were transformed into categorical variables in six studies (7, 11, 25, 26, 28, 32), which led to a substantial loss of information and even diminished the model’s capacity for prediction. Five research failed to thoroughly evaluate their prediction models’ predictive capabilities (7, 11, 26, 30, 33). Four studies used the randomized split-validation method (25, 28, 36, 37), and one did not specify the exact validation method (11). Details are provided in Supplementary Table S2.

3.4.2 Applicability assessment

Twelve studies demonstrated generally good applicability, while the remaining two studies (28, 32) showed poor applicability: In the Participants domain, Kim’s study focused on home discharge after subacute rehabilitation of moderate stroke patients, while Stineman’s study restricted participants to veteran subjects, which limited the studies’ generalizability. Overall, the results of this systematic review indicated a high risk of bias across all studies, which raises the possibility of methodological issues with the models’ creation or validation. Details are provided in Supplementary Table S2.

3.5 Quality assessment of the literature

The overall quality of the studies included in this analysis was rather excellent, covering more than 70% of the reporting items, according to our quality evaluation, which was based on the TRIPOD guidelines (19). Nevertheless, we also observed certain restrictions or ambiguities in specific reporting elements. For example, despite Lensky’s study (26) being comprehensive, it is deficient in providing sufficient details about its predictive model parameters and their applications. In their comprehensive report, Cho’s study (11) failed to define the parameters of their prediction model or the methodology for determining the sample size. Despite the fact that the TRIPOD rules offer us a reliable instrument for evaluating the quality of predictive models, this evaluation might not adequately capture all the information essential to predictive modeling because of the models’ complexity and diversity. For instance, sample size has a big impact on how accurate and robust models are, and choosing and modifying model parameters is essential for predictive power and model optimization. Detailed quality assessment in Supplementary Table S6.

3.6 Meta-analysis of validation models

Only five of the listed papers were suitable for synthesis because of inadequate reporting on the model development specifics. The validation model used a random effects model to calculate the combined AUC, which was 0.80 (95% CI [0.75–0.86]), indicating good overall predictive performance (Figure 3). The heterogeneity test revealed significant heterogeneity (p < 0.001, I² = 95.2%), and a random effects model was used. Changes in study design, sample size, predictor selection, and outcome definition may be the cause of the significant variability among studies. The findings’ robustness was demonstrated by the results’ stability even after any one study was eliminated. In addition, the sensitivity analysis confirmed the robustness of the results, with no single study altering the magnitude of the combined effect (Figure 4). The Egger’s test indicated no significant asymmetry (p = 0.757) (Figure 5). The funnel plot showed a roughly symmetrical distribution of the scatter points around the pooled effect size, with all points falling within the pseudo 95% confidence limits (Supplementary Figure 1), suggesting a low likelihood of publication bias. The meta-regression analysis identified the country of the participants (p = 0.5235), to be not a significant source of the heterogeneity.

Figure 3

Figure 3. Forest plot of pooled AUC estimates for validation models.

Figure 4

Figure 4. The results of the sensitivity analysis of the model.

Figure 5

Figure 5. The results of the Egger test of the model.

4 Discussion

Stroke disease is characterized by a “high disability rate,” often leaving stroke patients with disabilities of various aspects and degrees after receiving acute treatment (6) Assisting stroke patients in safely transitioning from the hospital to home has become a focal point of clinical nursing work. At the same time, with the increase in hospital bed turnover rates, the average length of stay for stroke patients has significantly shortened. Factors such as the patient’s advanced age, mobility difficulties, or memory decline often result in discharge before full recovery, shifting the significant responsibility of continued rehabilitation post-discharge to community medical institutions, patients, and their families (38, 39). Therefore, accurately assessing the non-home discharge risks for stroke patients, as well as early detection and precise intervention, is essential to lower the frequency and severity of negative outcomes.

4.1 Models perform well, but there is a high risk of bias; external validation and various modeling are essential

Following a thorough screening and search of the literature, we found 14 original research. The risk prediction algorithms now in use for stroke patients’ discharge disposition are still in the early stages of development. All of these investigations included model construction and showed strong performance, with AUC values above the 0.7 threshold and ranging from 0.75 to 0.95. It is noteworthy that 2 studies (27, 29, 36) performed internal and external validation. This step is essential for assessing the generalization ability of the model, detecting overfitting, boosting prediction accuracy, and guaranteeing the dependability and significance of the findings (40). AUC values of 0.80 (95% CI [0.75–0.86]) were also noted for validation models, coupled with notable heterogeneity that was probably brought on by different demographic features, predictive factors, and methodology. Furthermore, most of the included studies presented their model results in the form of a risk-scoring system. The simplified scoring system is relatively simple and easy to understand clinically, and can achieve intuitive, convenient and effective individualized risk prediction, thus promoting the clinical application of healthcare professionals (41). Overall, these models have strong predictive power for discharge non-home disposition of stroke patients, showing favorable performance. However, the model’s clinical application was limited because all analyzed papers were deemed to have a high bias risk based on the PROBAST checklist.

First, the data sources are biased. Eight of the studies were retrospective analyses, which perhaps increased recollection bias and impacted the model’s quality. The majority of the data came from single-center research with small sample sizes. Multicenter, large sample, high-quality prospective studies should be given priority in future research in order to reduce recollection bias and enable the adaptation of prediction models to a larger patient population.

Second, there is also a bias in the model construction. (1) In terms of variable selection, univariate selection was one of the most commonly employed methods (58.3% of studies), and it ignored the interaction between variables and potential problems of collinearity, which may lead to inaccurate prediction results (42). (2) Eight research have explicitly eliminated missing data, and four studies have not reported missing values. The link between predictor factors and outcomes may become biased as a result of this approach; even in the absence of bias, missing data reduces precision and increases the confidence interval (43). (3) Ten research built their models using logistic regression, which limited their capacity to capture intricate interactions between variables and impacted the model’s accuracy and stability. We propose that more sophisticated variable screening techniques, including LASSO regression, which can address the issue of multicollinearity among variables and assist in identifying the most predictive variables (44), be used to increase the model’s stability and predictive power. In order to lessen the negative effects of missing data on statistical analysis and model stability, techniques like multiple imputation and single imputation should be applied when addressing missing data. Cui et al. (25), Lensky et al. (26), Veerbeek et al. (29), and Berker et al. (30) developed models using machine learning methods in this systematic review. Despite their potential to enhance prediction accuracy (45), machine learning algorithms showed limited advantages in this review. We assume that variables like random data set division, univariate analysis-based variable screening methods, and inadequate sample size may be connected to this phenomenon.

Finally, there are some limitations to the model validation. The predictive power of the model may be influenced by population and regional differences, thus highlighting the need for comprehensive validation during model development. For example, Kim et al. (32) study used a high sample size and a prospective cohort design, but it omitted internal validation. While random split validation is typically thought of as an internal validation method, it does not address the matter of model overfitting (46). Furthermore, only four studies performed external validation, and the remaining articles lacked such validation, limiting the generalization and applicability of the model (47). To increase the model’s generalizability, future research should place a strong emphasis on external validation, particularly across various geographies, racial groups, cultural contexts, and lifestyle characteristics. Different phases of the disease and variations in stroke types (such as hemorrhagic, mixed, and ischemic strokes) should also be taken into account. The degree of social support, frailty, and treatment strategy may also affect predictive performance. Taking all of these things into account will help to increase the model’s applicability and dependability.

4.2 Dissimilarities and similarities among predictors: emphasize age, NIHSS, FIM cognitive and motor function

Between two and ten predictors were included in the 22 models in this study, which were primarily divided into four groups: Sociodemographic factors: (e.g., age, marital status, residence before admission, lived alone), Clinical factors: (e.g., type of stroke, degree of paralysis, mRS, NIHSS, motor cognitive function score), Psychological factors: (e.g., depression), Comorbidities: (e.g., dyslipidemia, high blood pressure, acute heart attack, cerebral hemorrhage), Treatment: (e.g., mechanical ventilation, tube feeding, ICU admission). Some similarities were found despite differences in predictor selection brought about by research types and included variables. Age, NIHSS as well as FIM cognitive function and motor function scores at admission, are high-frequency predictive factors. Age was important predictor of institutional long-term care admission directly from the hospital after an acute stroke. Multiple studies (11, 25, 31, 33) have found a positive association between age and discharge non-home placement, where older patients may have more comorbidities with less support at home and may require further medical care and monitoring at institutions. Studies reported a strong correlation between non-home firing and initial neurological function as assessed by the NIHSS score (25, 28, 30, 31). High NIHSS scores are a common risk factor for neurological deficit after severe stroke and poor recovery after stroke. FIM motor and cognitive scores at admission showed significantly high score weights, with the former showing the highest predictive power in the model (30), a finding supported by Stineman et al. (28) Instead, Kim et al. (32) and Choi-Kwon et al. (11) state that cognitive FIM is the most important factor. This may be because patients with low cognitive ability often struggle to self-discharge or reunite with family, as cognitive and emotional disorders impose a greater burden on caregivers than physical disability. Further study is required to evaluate the effectiveness of the place where a patient gets referred at discharge, and discharge decisions should take into account patient-specific biopsychosocial characteristics that may take precedence over isolated outcomes of the outcome measures.

Therefore, in order to promptly identify high-risk patients, early screening should concentrate on these common variables. Nursing intervention is limited, though, as this study also revealed that many of the present factors are hard to directly alter. Future studies should look into incorporating controllable characteristics such stroke knowledge, psychological state and medication adherence in an effort to achieve individualized care interventions and prevent needless hospitalizations and resource misallocation.

4.3 Implications for clinical practice

Applying credible models helps to identify patients who require non-home discharge to higher levels of care, enabling early intervention plans. To guarantee the precision and legitimacy of the best outcomes, future research efforts should follow the TRIPOD guidelines. This means that investigators should prioritize the implementation of studies with a larger sample size and adopt a prospective study design. Numerous included research had difficulties with sample size, selecting predictors, and handling continuous variables. The application of sophisticated machine learning techniques in model construction can help with some of these issues. However, the current dearth of appropriate demonstration tools is a disadvantage of the machine learning models. Consequently, researchers need to select the right model creation techniques based on the particular circumstance. Although all of the models performed well overall, there was still a significant chance of bias. The number of events, processing of continuous variables, methods for selecting predictor variables, data complexity, model calibration and fitting, time interval between assessment of predictor variables and outcome determination, and study design (cohort or case–control study) all require improvement. Future research should concentrate on developing new models through larger, rigorously designed studies including multicenter external validations and improved reporting transparency, in order to increase the prediction models’ usefulness for evaluating discharge disposition risks in stroke patients. With the continuous progress in research methods and data processing technologies, the model will be continuously optimized and adjusted to better adapt to clinical needs, and thus provide a more accurate risk assessment tool in clinical practice.

5 Strengths and limitations

This review is the first to scientifically and systematically evaluate the risk prediction models for discharge disposition in stroke patients through PROBAST and TRIPOD guidelines based assessment quality and ROB. We detail the characteristics of existing models and also summarize the most common predictors of, providing a valuable reference for healthcare personnel’ targeted care of high-risk patients. This review may be limited in a number of ways. First, our analysis was limited to papers published in English and Chinese, which would have introduced language bias by excluding pertinent studies published in other languages that might have included useful data. Second, there is currently a dearth of research on stroke discharge disposition prediction models in mainland China, with the majority of studies being carried out in nations like the US, Japan, and Australia. This could restrict the findings’ applicability to other geographical areas and call for modifications when using these models in various contexts. Third, a thorough evaluation of the predictive models was limited by certain research’ reporting of only specific performance indicators. Lastly, our meta-analysis only included five validated models from five investigations because of methodological discrepancies and inadequate data. This restriction might have diminished the efficacy of bias evaluations and prevented additional investigation into the causes of study heterogeneity. These problems, however, partly reflect the methodological and reporting difficulties in developing and validating these models rather than affecting the evaluation of the models themselves. Future research requires more rigorous methodology and transparent reporting.

6 Conclusion

This systematic review included 14 studies and 22 models, systematically summarizing the features of these models. The findings indicated that the overall effect of models was good, but there was still a high risk of bias, and most lacked external validation. Therefore, the clinical application effect of the models needs further validation. Future studies priority should be given to assessing the applicability of the models, adhering to strict methodological standards, familiar the PROBAST checklist and adhering to the reporting guidelines outlined in the TRIPOD statement to improve the quality of future studies. In addition, we can develop, apply and optimize the prediction model of discharge disposition based on clinical practice by using data mining and AI technology, which could help to enhance the discharge procedure.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding authors.

Author contributions

CX: Writing – original draft. LX: Writing – review & editing, Formal analysis. YLu: Writing – review & editing, Methodology. LH: Writing – review & editing, Conceptualization. LT: Data curation, Writing – review & editing. YLi: Writing – review & editing, Data curation. KH: Writing – review & editing, Data curation. MD: Writing – review & editing, Supervision, Methodology. XZ: Supervision, Writing – review & editing, Funding acquisition.

Funding

The author(s) declare that financial support was received for the research and/or publication of this article. This work was supported by the Natural Science Foundation of Basic and Applied Basic Research Foundation of Guangdong Province in 2022 (grant number 2022A1515012184), the Southern Medical University Nanfang Hospital Nursing Excellence-Evidence-based Nursing Project for 2024 (grant number 2024EBNb004) and the Clinical Research Fund of Nanfang Hospital, Southern Medical University (grant number 2023CR026).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The authors declare that no Gen AI was used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2025.1637606/full#supplementary-material

Footnotes

1. ^https://www.zotero.org/

References

1. GBD 2016 Neurology Collaborators. Global, regional, and national burden of neurological disorders, 1990-2016: a systematic analysis for the global burden of disease study 2016. Lancet Neurol. (2019) 18:459–80. doi: 10.1016/S1474-4422(18)30499-X

Crossref Full Text | Google Scholar

2. Thorpe, ER, Garrett, KB, Smith, AM, Reneker, JC, and Phillips, RS. Outcome measure scores predict discharge destination in patients with acute and subacute stroke: a systematic review and series of meta-analyses. J Neurol Phys Ther. (2018) 42:2–11. doi: 10.1097/NPT.0000000000000211

PubMed Abstract | Crossref Full Text | Google Scholar

3. Béjot, Y, Bailly, H, Durier, J, and Giroud, M. Epidemiology of stroke in Europe and trends for the 21st century. Presse Med. (2016) 45:e391–8. doi: 10.1016/j.lpm.2016.10.003

PubMed Abstract | Crossref Full Text | Google Scholar

4. Feigin, VL, Krishnamurthi, RV, Parmar, P, Norrving, B, Mensah, GA, Bennett, DA, et al. GBD 2013 Writing Group; GBD 2013 Stroke Panel Experts Group. Update on the Global Burden of Ischemic and Hemorrhagic Stroke in 1990-2013: The GBD 2013 Study. Neuroepidemiology. (2015) 45:161–76. doi: 10.1159/000441085

Crossref Full Text | Google Scholar

5. GBD 2019 Stroke Collaborators. Global, regional, and national burden of stroke and its risk factors, 1990-2019: a systematic analysis for the global burden of disease study 2019. Lancet Neurol. (2021) 20:795–820. doi: 10.1016/S1474-4422(21)00252-0

Crossref Full Text | Google Scholar

6. Rejnö, Å, Nasic, S, Bjälkefur, K, Bertholds, E, and Jood, K. Changes in functional outcome over five years after stroke. Brain Behav. (2019) 9:e01300. doi: 10.1002/brb3.1300

PubMed Abstract | Crossref Full Text | Google Scholar

7. Brauer, SG, Bew, PG, Kuys, SS, Lynch, MR, and Morrison, G. Prediction of discharge destination after stroke using the motor assessment scale on admission: a prospective, multisite study. Arch Phys Med Rehabil. (2008) 89:1061–5. doi: 10.1016/j.apmr.2007.10.042

PubMed Abstract | Crossref Full Text | Google Scholar

8. Gong, k, Shao, z, Chen, q, Zhang, x, and Bai, j. Investigation and influencing factors analysis of the current situationof discharge disposition of elderly patients with chronic diseases in a tertiary hospital in Shanghai. Chinese Hosp Manag. (2020) 40:49–53+67.

Google Scholar

9. Bambhroliya, AB, Donnelly, JP, Thomas, EJ, Tyson, JE, Miller, MC, McCullough, LD, et al. Estimates and temporal trend for US nationwide 30-day hospital readmission among patients with ischemic and hemorrhagic stroke. JAMA Netw Open. (2018) 1:e181190. doi: 10.1001/jamanetworkopen.2018.1190

Crossref Full Text | Google Scholar

10. Sun, C, Hu, HX, and Y, D. Risk factors analysis and risk prediction model construction of un-planned readmission in elderly patients with ischemic stroke. Chin Nurs Manag. (2020) 20:1601–5.

Google Scholar

11. Cho, J, Place, K, Salstrand, R, Rahmat, M, Mansuri, M, Fell, N, et al. Developing a predictive tool for hospital discharge disposition of patients poststroke with 30-day readmission validation. Stroke Res Treat. (2021) 2021:5546766. doi: 10.1155/2021/5546766

Crossref Full Text | Google Scholar

12. Chevalley, O, Truijen, S, Saeys, W, and Opsommer, E. Socio-environmental predictive factors for discharge destination after inpatient rehabilitation in patients with stroke: a syste-matic review and meta-analysis. Disabil Rehabil. (2022) 44:4974–85. doi: 10.1080/09638288.2021.1923838

Crossref Full Text | Google Scholar

13. Walker, C PhD, RN, Hogstel, MO PhD, RN-BC, and Curry, LC PhD, RN. Hospital discharge of older adults: how nurses can ease the transition. AJN Am J Nurs. (2007) 107:60–70. doi: 10.1097/01.NAJ.0000271853.38215.20

PubMed Abstract | Crossref Full Text | Google Scholar

14. van Walraven, c, Dhalla, lA, Bell, c, Ethcks, E, Stiell, IG, Zarnke, K, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ. (2010) 182:551–7. doi: 10.1503/cmaj.091117

Crossref Full Text | Google Scholar

15. Moons, KGM, DE Groot, JAH, Bouwmeester, W, Vergouwe, Y, Mallett, S, Altman, DG, et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med. (2014) 11:e1001744. doi: 10.1371/journal.pmed.1001744

PubMed Abstract | Crossref Full Text | Google Scholar

16. Debray, TP, Damen, JA, Snell, KI, Ensor, J, Hooft, L, and Reitsma, JB. A guide to systematic review and meta-analysis of prediction model performance. BMJ. (2017) 356:i6460. doi: 10.1136/bmj.i6460

Crossref Full Text | Google Scholar

17. Chinese Society of Neurology, Chinese Stroke Society. Diagnostic criteria of cerebrovascular diseases in China (version 2019). Chin J Neurol. (2019) 52:710–5. doi: 10.3760/cma.j.issn.1006-7876.2019.09.003

Crossref Full Text | Google Scholar

18. Kraemer, HC, Periyakoil, VS, and Noda, A. Kappa coeficients in medical research. Stat Med. (2002) 21:2109–29. doi: 10.1002/sim.1180

Crossref Full Text | Google Scholar

19. Collins, GS, Reitsma, JB, Altman, DG, and Moons, K. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) the TRIPOD statement. Circulation. (2015) 131:211–9. doi: 10.1161/CIRCULATIONAHA.114.014508

PubMed Abstract | Crossref Full Text | Google Scholar

20. Wolff, RF, Moons, KG, Riley, RD, Whiting, PF, Westwood, M, Collins, GS, et al. PROBAST: a tool to assess the risk of bias and applicability of prediction model studies. Ann Intern Med. (2019) 170:51–8. doi: 10.7326/M18-1376

PubMed Abstract | Crossref Full Text | Google Scholar

21. De, JY, Ramspek, CL, Zoccali, C, Jager, KJ, Dekker, FW, and Van, DM. Appraising prediction research: a guide and meta-review on bias and applicability assessment using the prediction model risk of bias assessment tool (PROBAST). Nephrol. (2021) 26:939–47. doi: 10.1111/nep.13913

Crossref Full Text | Google Scholar

22. Monahan, AC, and Feldman, SS. Models predicting hospital admission of adult patients utilizing prehospital data: systematic review using PROBAST and CHARMS. JMIR Med Inform. (2021) 9:e30022. doi: 10.2196/30022

PubMed Abstract | Crossref Full Text | Google Scholar

23. Fu, H, Hou, D, Xu, R, You, Q, Li, H, Yang, Q, et al. Risk prediction models for deep venous thrombosis in patients with acute stroke: a systematic review and meta-analysis. Int J Nurs Stud. (2024) 149:104623. doi: 10.1016/j.ijnurstu.2023.104623

PubMed Abstract | Crossref Full Text | Google Scholar

24. Higgins, JP, Thompson, SG, Deeks, JJ, and Altman, DG. Measuring inconsistency in meta-analyses. BMJ. (2003) 327:557–60. doi: 10.1136/bmj.327.7414.557

PubMed Abstract | Crossref Full Text | Google Scholar

25. Cui, Y, Xiang, L, Zhao, P, Chen, J, Cheng, L, Liao, L, et al. Machine learning decision support model for discharge planning in stroke patients. J Clin Nurs. (2024) 33:3145–60. doi: 10.1111/jocn.16999

PubMed Abstract | Crossref Full Text | Google Scholar

26. Lensky, A, Lueck, C, Suominen, H, Jones, B, Vlieger, R, and Ahluwalia, T. Explaining predictors of discharge destination assessed along the patients' acute stroke journey. J Stroke Cerebrovasc Dis. (2024) 33:107514. doi: 10.1016/j.jstrokecerebrovasdis.2023.107514

PubMed Abstract | Crossref Full Text | Google Scholar

27. Itaya, T, Murakami, Y, Ota, A, Nomura, E, Fukushima, T, and Nishigaki, M. Assessment model to identify patients with stroke with a high possibility of discharge to home: a retrospective cohort study. Stroke. (2017) 48:2812–8. doi: 10.1161/STROKEAHA.117.018075

PubMed Abstract | Crossref Full Text | Google Scholar

28. Stineman, MG, Kwong, PL, Bates, BE, Kurichi, JE, Ripley, DC, and Xie, D. Development and validation of a discharge planning index for achieving home discharge after hospitalization for acute stroke among those who received rehabilitation services. Am J Phys Med Rehabil. (2014) 93:217–30. doi: 10.1097/PHM.0b013e3182a92bfb

PubMed Abstract | Crossref Full Text | Google Scholar

29. Veerbeek, JM, Ottiger, B, Cazzoli, D, Vanbellingen, T, and Nyffeler, T. Speed up discharge planning at the acute stroke unit: a development and external validation study for the early prediction of discharge home. Front Neurol. (2022) 13:999595. doi: 10.3389/fneur.2022.999595

Crossref Full Text | Google Scholar

30. de Berker, H, de Berker, A, Htin, A, Pedro, D, Salman, M, Hamsaraj, S, et al. Pre-stroke disability and stroke severity as predictors of discharge destination from an acute stroke ward. Clin Med. (2021) 21:e186–91.

Google Scholar

31. Béjot, Y, Daubail, B, Sensenbrenner, B, Legris, N, and Giroud, M. Iscore for predicting institutional care after ischemic stroke: a population-based study. J Stroke Cerebrovasc Dis. (2015) 24:694–8. doi: 10.1016/j.jstrokecerebrovasdis.2014.11.010

PubMed Abstract | Crossref Full Text | Google Scholar

32. Kim, MS, Joo, MC, Sohn, MK, Lee, J, Kim, DY, and Lee, SG. Development and validation of a prediction model for home discharge in patients with moderate stroke: the Korean stroke cohort for functioning and rehabilitation study. Top Stroke Rehabil. (2020) 27:453–61. doi: 10.1080/10749357.2019.1711338

PubMed Abstract | Crossref Full Text | Google Scholar

33. Ito, D, Kawakami, M, Ishii, R, Tsujikawa, M, Honaga, K, Kondo, K, et al. Cognitive function is associated with home discharge in subacute stroke patients: a retrospective cohort study. BMC Neurol. (2022) 22:219. doi: 10.1186/s12883-022-02745-8

PubMed Abstract | Crossref Full Text | Google Scholar

34. Ouellette, DS, Timple, C, Kaplan, SE, Rosenberg, SS, and Rosario, ER. Predicting discharge destination with admission outcome scores in stroke patients. NeuroRehabilitation. (2015) 1:173–9. doi: 10.3233/NRE-151250

Crossref Full Text | Google Scholar

35. Courvoisier, DS, Combescure, C, Agoritsas, T, Gayet-Ageron, A, and Perneger, TV. Performance of logistic regression modeling: beyond the number of events per variable, the role of data structure. J Clin Epidemiol. (2011) 64:993–1000. doi: 10.1016/j.jclinepi.2010.11.012

Crossref Full Text | Google Scholar

36. Itaya, T, Murakami, Y, Ota, A, Shimomura, R, Fukushima, T, and Nishigaki, M. Temporal validation of an assessment tool that predicts a possibility of home discharge for patients with acute stroke. J Stroke Cerebrovasc Dis. (2022) 31:106188. doi: 10.1016/j.jstrokecerebrovasdis.2021.106188

Crossref Full Text | Google Scholar

37. Kubo, K, Kamo, T, Momosaki, R, and Mitsutomi, K. Development of a point system to predict discharge to home for acute stroke patients. PM&R. (2020) 13:pmrj.12371. doi: 10.1002/pmrj.12371

PubMed Abstract | Crossref Full Text | Google Scholar

38. Galvin, EC, Wills, T, and Coffey, A. Readiness for hospital discharge: A concept analysis. J Adv Nurs. (2017) 73:2547–57. doi: 10.1111/jan.13324

Crossref Full Text | Google Scholar

39. Zhang, R, Wang, D, Zhu, L, He, Y, Cheng, L, Ma, J, et al. Research trends in readiness for hospital discharge between 2002 and 2021: a bibliometric analysis. Nurs Open. (2023) 10:7676–93. doi: 10.1002/nop2.2009

PubMed Abstract | Crossref Full Text | Google Scholar

40. Efthimiou, O, Seo, M, Chalkou, K, Debray, T, Egger, M, and Salanti, G. Developing clinical prediction models: a step-by-step guide. BMJ. (2024) 386:e078276. doi: 10.1136/bmj-2023-078276

PubMed Abstract | Crossref Full Text | Google Scholar

41. Qureshi, MA, Safian, RD, Grines, CL, Goldstein, JA, Westveer, DC, Glazier, S, et al. Simplified scoring system for predicting mortality after percutaneous coronary intervention. J Am Coll Cardiol. (2003) 42:1890–5. doi: 10.1016/j.jacc.2003.06.014

PubMed Abstract | Crossref Full Text | Google Scholar

42. Sanchez-Pinto, LN, Venable, LR, Fahrenbach, J, and Churpek, MM. Comparison of variable selection methods for clinical predictive modeling. Int J Med Inform. (2018) 116:10–7. doi: 10.1016/j.ijmedinf.2018.05.006

PubMed Abstract | Crossref Full Text | Google Scholar

43. Grund, S, Lüdtke, O, and Robitzsch, A. Multiple imputation of missing data for multilevel models: simulations and recommendations. Organ Res Methods. (2018) 21:111–49. doi: 10.1177/1094428117703686

Crossref Full Text | Google Scholar

44. Chen, Q, Hu, H, He, Q, Huang, X, Shi, H, Cao, X, et al. Evaluating the risk of developing hyperuricemia in patients with type 2 diabetes mellitus using least absolute shrinkage and selection operator regression and machine learning algorithm. Digit Health. (2024) 10:20552076241241381. doi: 10.1177/20552076241241381

PubMed Abstract | Crossref Full Text | Google Scholar

45. Fast, L, Temuulen, U, Villringer, K, Kufner, A, Ali, HF, Siebert, E, et al. Machine learning-based prediction of clinical outcomes after first-ever ischemic stroke. Front Neurol. (2023) 14:1114360. doi: 10.3389/fneur.2023.1114360

PubMed Abstract | Crossref Full Text | Google Scholar

46. Wang, J, Bi, L, and Fei, W. EEG-based motor BCIs for upper limb movement: current techniques and future insights. IEEE Trans Neural Syst Rehabil Eng. (2023) 31:4413–27. doi: 10.1109/TNSRE.2023.3330500

PubMed Abstract | Crossref Full Text | Google Scholar

47. Choi-Kwon, S, Kim, HS, Kwon, SU, and Kim, JS. Factors affecting the burden on caregivers of stroke survivors in South Korea. Arch Phys Med Rehabil. (2005) 86:1043–8. doi: 10.1016/j.apmr.2004.09.013

PubMed Abstract | Crossref Full Text | Google Scholar

48. Ottiger, B, Vanbellingen, T, Cazzoli, D, Nyffeler, T, and Veerbeek, JM. Development and validation of the short-LIMOS for the acute stroke unit - a short version of the Lucerne ICF-based multidisciplinary observation scale. Front Rehabil Sci. (2022) 3:857955. doi: 10.3389/fresc.2022.857955

PubMed Abstract | Crossref Full Text | Google Scholar