Skip to main content

ORIGINAL RESEARCH article

Front. Med., 31 May 2021
Sec. Family Medicine and Primary Care
Volume 8 - 2021 | https://doi.org/10.3389/fmed.2021.646875

Risk Stratification Score to Predict Readmission of Patients With Acute Decompensated Cirrhosis Within 90 Days

Xiaomei Xu1,2 Juntao Tan3 Haolin Wang3 Wenlong Zhao3,4 Bo Qin1*
  • 1Department of Infectious Diseases, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
  • 2Department of Gastroenterology, The Fifth People's Hospital of Chengdu, Chengdu, China
  • 3College of Medical Informatics, Chongqing Medical University, Chongqing, China
  • 4Medical Data Science Academy, Chongqing Medical University, Chongqing, China

Background and Aims: Patients with acute decompensated (AD) cirrhosis are frequently readmitted to the hospital. An accurate predictive model for identifying high-risk patients may facilitate the development of effective interventions to reduce readmission rates.

Methods: This cohort study of patients with AD cirrhosis was conducted at six tertiary hospitals in China between September 2012 and December 2016 (with 705 patients in the derivation cohort) and between January 2017 and April 2020 (with 251 patients in the temporal validation cohort). Least absolute shrinkage and selection operator Cox regression was used to identify the prognostic factors and construct a nomogram. The discriminative ability, calibration, and clinical net benefit were evaluated based on the C-index, area under the curve, calibration curve, and decision curve analysis. Kaplan–Meier curves were constructed for stratified risk groups, and log-rank tests were used to determine significant differences between the curves.

Results: Among 956 patients, readmission rates were 24.58, 42.99, and 51.78%, at 30, 60, and 90 days, respectively. Bacterial infection was the main reason for index hospitalization and readmission. Independent factors in the nomogram included gastrointestinal bleeding [hazard rate (HR): 2.787; 95% confidence interval (CI): 2.221–3.499], serum sodium (HR: 0.955; 95% CI: 0.933–0.978), total bilirubin (HR: 1.004; 95% CI: 1.003–1.005), and international normalized ratio (HR: 1.398; 95% CI: 1.126–1.734). For the convenience of clinicians, we provided a web-based calculator tool (https://cqykdx1111.shinyapps.io/dynnomapp/). The nomogram exhibited good discrimination ability, both in the derivation and validation cohorts. The predicted and observed readmission probabilities were calibrated with reliable agreement. The nomogram demonstrated superior net benefits over other score models. The high-risk group (nomogram score >56.8) was significantly likely to have higher rates of readmission than the low-risk group (nomogram score ≤ 56.8; p < 0.0001).

Conclusions: The nomogram is useful for assessing the probability of short-term readmission in patients with AD cirrhosis and to guide clinicians to develop individualized treatments based on risk stratification.

Introduction

Acute decompensated (AD) cirrhosis, defined as the acute development of ascites, hepatic encephalopathy, gastrointestinal hemorrhage, bacterial infections, or a combination of these factors, is the main cause of hospitalization and mortality in patients with cirrhosis (13). Owing to these complications, patients with decompensated cirrhosis are more frequently hospitalized and rapidly readmitted shortly after discharge. Hospital readmission is considered as a surrogate marker of the quality of healthcare delivery systems. Moreover, readmissions are associated with negative outcomes in patients and their families, and they have a significant impact on the overall costs of health care (4).

An estimated 27.1% of readmissions may be avoidable (5). To date, several studies have focused on assessing the predictors of readmission in decompensated cirrhosis (618). However, hospital readmission rates of patients with cirrhosis remain high, ranging from 10 to 50%, with a pooled estimate of 26% at 30 days and 21–71% at 90 days (19). The reason for these findings may be that the effective implementation of interventions requires not only understanding risk factors, but also identifying high-risk patients on the basis of highly accurate individualized risk predictive models, given that misleading risk estimates often lead to inappropriate treatment choices (20, 21). Therefore, the establishment of a model that can effectively predict and distinguish the individual risk of readmission remains an urgent medical requirement.

The current study was conducted to determine the readmission risk factors for patients with AD cirrhosis-related complications, to develop and temporally validate a nomogram to estimate the individual probability of readmission within 90 days, and to guide clinicians to develop individualized counseling programs and treatments based on risk stratification.

Patients and Methods

Population and Study Design

We conducted a multicenter retrospective prognostic study of inpatients with AD cirrhosis at six tertiary hospitals in Chongqing, China, including the Second Affiliated Hospital of Chongqing Medical University, Yong Chuan Hospital of Chongqing Medical University, Third Affiliated Hospital of Chongqing Medical University, University-Town Hospital of Chongqing Medical University, People's Hospital of Tong Liang District, and Southeast Hospital of Chongqing. We followed the transparent reporting of a multivariable predictive model for individual prognosis or diagnosis (TRIPOD) guidelines for model development and validation (22). Clinical data were collected using electronic medical record systems. Consecutive patients with AD cirrhosis admitted to the above hospitals from September 2012 to December 2016 were enrolled as the derivation cohort, and those with the same clinical characteristics hospitalized between January 2017 and April 2020 were enrolled as the temporal validation cohort. To determine whether patients admitted in April 2020 were readmitted to the hospital, we conducted follow-up until August 2020. The end points were cirrhosis-related readmissions within 90 days from the date of hospital discharge. In cases of multiple admissions, only the first readmission was considered.

The study protocol was reviewed and approved by the ethics committee of the First Affiliated Hospital of Chongqing Medical University. Due to its retrospective nature, this study required no conformed consent.

Inclusion and Exclusion Criteria

The inclusion criteria were as follows: (1) patients aged ≥ 18 years and (2) hospital admission for AD cirrhosis.

The exclusion criteria were as follows: (1) patients with acute-on-chronic liver failure (ACLF): diagnosis of ACLF was based on the criteria from the consensus recommendation of the Asian Pacific Association for the Study of the Liver (23); (2) liver cancer or other active malignancies; (3) evidence of congestive heart failure, chronic kidney disease, or other significant chronic extrahepatic diseases; (4) hospital stay ≤ 1 day; (5) endoscopic ligation of esophageal varices or transjugular intrahepatic portosystemic shunt (TIPS) in the initial hospitalization or elective hospital admission; (6) discharge against medical advice; (7) patients lost to follow-up or death during index hospitalization; and (8) patients with >30% of data missing. Details of readmission in other hospitals or planned procedures, surgery, and therapy were compiled from medical history.

AD cirrhosis was defined as the rapid development of one or more major complications of liver disease, such as ascites, encephalopathy, gastrointestinal hemorrhage, bacterial infection, or a combination of these factors, requiring hospitalization (1, 2427).

Ascites was recorded as the primary reason for admission if this was the sole criterion for admission, and infection was absent. Hepatic encephalopathy was characterized by altered mental status or neuropsychiatric abnormalities in the presence of liver cirrhosis after exclusion of other causes. Gastrointestinal (GI) bleeding was defined as the development of an upper and/or lower gastrointestinal hemorrhage of any etiology (27). Bacterial infection was defined in cases of spontaneous bacterial peritonitis, pneumonia, cellulitis, biliary tract infection, urinary system infection, and spontaneous bacteremia (26).

In the presence of more than one contributory factor, the main cause of admission was defined as follows: (1) in patients admitted with GI bleeding in the presence of ascites, bacterial infection, or hepatic encephalopathy, GI bleeding was considered the main cause; (2) in the absence of bleeding at admission, bacterial infection was the main cause of hospitalization; and (3) in patients with hepatic encephalopathy and ascites, the main cause was the former (11). The principal cause of hospitalization was subsequently assessed independently by two subspecialist physicians.

Treatment

Medical therapies were used for all patients during hospitalization and after discharge, such as antiviral therapy, diuretics, lactulose, non-selective beta-blockers, antibiotics, symptomatic and supportive therapies. Prophylactic antibiotics were not routinely administered after discharge.

Data Collection

Demographic, etiological, clinical, and laboratory data were recorded within 24 h of the first hospital visit. Demographic characteristics included age and sex. The etiological characteristics, including hepatitis B virus (HBV)/hepatitis C virus (HCV) infection, autoimmunity, and alcohol consumption, were assessed from medical history. Clinical data included length of hospital stay, complications related to liver cirrhosis, comorbidities, smoking history, alcohol consumption, and family history of liver disease. Laboratory analyses included liver function test, routine blood test, creatinine, blood urea nitrogen, serum sodium, serum potassium, and international normalized ratio (INR). End-stage Liver Disease score (MELDs), Child–Turcotte–Pugh score (CTPs), chronic liver failure-consortium acute decompensation scores (CLIF-C ADs), and MELD-Na score (MELD-Nas) were calculated at admission according to previously published criteria (2831).

Statistical Analyses

Continuous variables were expressed as mean ± standard deviation (SD) or median (interquartile range), according to the distribution of normality. Categorical variables were reported as counts with percentages. Group comparisons of continuous variables were analyzed with the Mann–Whitney U test and categorical variables with χ2 or Fisher's exact test. For variables with omission rates <30%, multiple imputation was used.

To avoid overfitting, we performed two steps of variable selection. First, we evaluated the association between readmission within 90 days and a set of potential predictors by using univariate analyses (Mann–Whitney U test for quantitative predictors and χ2 or Fisher's exact test for binary predictors). Predictors with p < 0.05 were subsequently considered in an automated variable selection procedure within the least absolute shrinkage and selection operator (LASSO) framework to select the best predictor subset (32). The complexity of LASSO regression was controlled by a tuning parameter lambda (λ) with the rule that the penalty for each variable coefficient increases with λ value, and the relevant features with non-zero coefficients were selected that contributed to the final LASSO regression (33). The number of variables involved in the final model was considered based on the optimal λ value to balance the accuracy and simplicity of the model. Then, the retained variables were used to construct the nomogram using multivariate Cox regression. The nomogram was based on the fitted predictive model using R version 4.0.2 with the rms package (34). To streamline the power calculation estimation, we produced PowerTools, an interactive open-source web application, written in R code by using the Shiny framework (http://www.shinyapps.io/).

The discriminatory value of the models was assessed based on the concordance index (C-index). The area under the curve (AUC) of the receiver operating characteristic (ROC) curve was also used to evaluate the prognostic accuracy of the nomogram. To demonstrate the stability of the model, we applied bootstraps with 200 resamples to correct the C-index to overcome overfitting. Calibration curves were additionally drawn to evaluate the concordance between the predicted and observed probabilities. The nomogram model was validated with a temporal validation cohort using the same process of capability assessment. Decision curve analyses (DCA) were applied to compare the benefits and improved performance of different models (35).

According to the nomogram score, the patients were classified into two groups representing low and high risk. The optimal cut-off values for the total points of the nomogram were determined by maximizing the Youden index (sensitivity + specificity – 1). Kaplan–Meier curves were constructed for stratified risk groups, and log-rank tests were used to determine significant differences between the curves.

All tests were two-sided, and data were considered statistically significant at p < 0.05. Statistical analyses were performed using R software (version 4.0.2, Vienna, Austria).

Results

Characteristics of the Study Cohort

A total of 8,402 patients met the inclusion criteria. Following the application of the exclusion criteria, 956 patients were finally included in the study, specifically 705 patients in the derivation cohort (from September 2012 to December 2016) and 251 patients in the temporal validation cohort (from January 2017 to April 2020). The study selection process is depicted as a flow chart (see Supplementary Figure 1 for details).

The mean (SD) age of all patients was 58.8 (12.6) years, and 68.31% were male. The etiologies of cirrhosis were chronic hepatitis B (50.4%), alcoholic (10.7%), autoimmune liver disease (9.9%), chronic hepatitis C (5.0%), and other/cryptogenic factors (19.6%). The overall readmission rates for patients at 30, 60, and 90 days were 24.6, 43.0, and 51.8%, respectively. As shown in Table 1, bacterial infection was the main reason for index admission (54.3%), followed by GI bleeding (35.0%), hepatic encephalopathy (5.8%), and ascites (4.9%). Regarding the main reason for readmission, bacterial infection was the most common cause, followed by GI bleeding, other cirrhosis-related diseases, hepatic encephalopathy, and ascites at the 30-, 60-, and 90-day time points.

TABLE 1
www.frontiersin.org

Table 1. Cirrhosis-related index hospitalizations and readmissions.

Based on the baseline characteristics of the two cohorts of patients as listed in Supplementary Table 1, patients in the derivation set were older and had lower neutrophil percentages and blood urea nitrogen levels; higher total protein, total bilirubin (TB), direct bilirubin, hemoglobin, aspartate aminotransferase, and alkaline phosphatase levels; lower rates of gastrointestinal hemorrhage; higher rates of bacterial infection; higher lengths of stay at initial admission; and higher CTPs and CLIF-C ADs (p < 0.05). The 30-, 60-, and 90-day risk of readmission were higher for the temporal validation set than for the derivation set (p < 0.05). The remaining clinical and laboratory parameters at initial admission as well as MELDs and MELD-Nas were similar between the derivation and temporal validation sets.

Development of a Nomogram

Supplementary Table 2 provides the results of the univariate analyses for all 36 factors considered as potential predictors in our scoring system. Fifteen candidate predictor variables with p < 0.05 were used as the input data in the LASSO regression. When the lambda value was collected as 1 standard error [log (λ1se) = −2.10], four variables were selected (see Supplementary Figure 2 for details). Then, the four retained variables were used to construct the nomogram using multivariate Cox regression. As shown in Table 2, GI bleeding, serum sodium, total bilirubin (TB), and INR composed a panel of significant predictors of readmission in patients with AD cirrhosis.

TABLE 2
www.frontiersin.org

Table 2. The HR values of the independent risk factors for prediction of 90-day readmission in patients with acute decompensated cirrhosis.

A nomogram was constructed based on the four aforementioned independent prognosticators (Figure 1). The values of each risk factor were assigned a score on the point scale axis. By adding each single score and using that value in the total point scale axis, the total score could be easily calculated to assign the probability of readmission for individual patients at 30, 60, and 90 days. For the convenience of clinicians, we have provided the nomogram as a web-based calculator tool (https://cqykdx1111.shinyapps.io/dynnomapp/). Doctors can enter the indicators for each patient to automatically calculate the patient's probability of readmission within 90 days.

FIGURE 1
www.frontiersin.org

Figure 1. The nomogram to predict the risk of readmission in patients with acute decompensated cirrhosis.

The model exhibited good discrimination ability. The C-index values of the nomogram for 30-, 60-, and 90-day readmission were 0.770 [95% confidence interval (CI): 0.728–0.812], 0.754 (95% CI: 0.716–0.791), and 0.731 (95% CI: 0.693–0.768), respectively. Furthermore, the predictive performance of nomogram was calculated by AUC of ROC curve. The AUC values were 0.775 (95% CI: 0.733–0.817), 0.753 (95% CI: 0.715–0.791), and 0.733 (95% CI: 0.695–0.770) for 30-, 60-, and 90-day, respectively (Figure 2A). Bootstraps with 200 resamples were performed to correct the predictive model. The adjusted C-index values of the nomogram for 30-, 60-, and 90-day readmission were 0.770, 0.750, and 0.732, respectively.

FIGURE 2
www.frontiersin.org

Figure 2. ROC curves for nomogram. ROC curves of nomogram in derivation cohort (A) and in temporal validation cohort (B). ROC, receiver operating characteristic; AUC, area under the curve.

The calibration curves showed good agreement between nomogram predictions and observed probabilities for 30-, 60-, and 90-day outcomes in the derivation cohort (Figure 3A).

FIGURE 3
www.frontiersin.org

Figure 3. The calibration curve of nomogram at 30, 60, and 90 days for the derivation cohort (A) and the temporal validation cohort (B). Dashed lines along the 45-degree line through the point of origin represent the perfect calibration models in which the predicted probabilities are identical to the actual probabilities.

Temporal Validation of the Nomogram

The validation set was estimated using the established nomogram, and the C-index values obtained were 0.703 (95% CI 0.638–0.768), 0.694 (95% CI: 0.627–0.762), and 0.707 (95% CI: 0.636–0.777), respectively. The AUC values were 0.714 (95% CI: 0.649–0.778), 0.682 (95% CI: 0.614–0.751), and 0.712 (95% CI: 0.644–0.780), respectively (Figure 2B), supporting the suitability of the nomogram for estimating 30-, 60-, and 90-day readmission.

The calibration curves revealed good agreement between the nomogram predictions and observed probabilities for 30-, 60-, and 90-day outcomes in the temporal validation cohort (Figure 3B).

Comparison of Predictive Accuracy for Readmission Among Nomogram, MELDs, CLIF-C ADs, CTPs, and MELD-Nas

Predictive power for readmission was compared for the nomogram, MELDs, CLIF-C ADs, CTPs, and MELD-Nas based on C-indexes. DCA was performed to determine the clinical utility of the nomogram by calculating the net benefits at different threshold probabilities. The C-indexes for 30-, 60-, and 90-day readmission predicted with MELDs, CLIF-C ADs, CTPs, and MELD-Nas were significantly lower than those with the nomogram, in both the derivation and temporal validation cohorts (Table 3).

TABLE 3
www.frontiersin.org

Table 3. Predictive discrimination ability of nomogram as compared to MELDs, CLIF-C ADs, CTPs, and MELD-Nas in the derivation and temporal validation cohort.

Using DCA, our nomogram provided superior net benefit and displayed improved performance in prognostic evaluation over the 30-, 60-, and 90-day periods, both in the derivation (Figures 4A–C) and validation (Figures 4D–F) cohorts, compared to MELDs, CLIF-C ADs, CTPs, and MELD-Nas models.

FIGURE 4
www.frontiersin.org

Figure 4. Decision curve analysis at 30, 60, and 90 days for the derivation cohort (A–C) and the temporal validation cohort (D–F). The horizontal solid black line represents the assumption that no patients will experience the event, and the solid gray line represents the assumption that all patients will relapse. On decision curve analysis, the readmission nomogram showed superior net benefit compared with other models across a range of threshold probabilities.

Performance of the Nomogram in Stratifying Patient Risk

When patients were stratified according to the optimal cut-off value by the total nomogram points (high risk: >56.8 and low risk: ≤ 56.8), each group represented a distinct prognosis. The high-risk group was more likely to have readmission than the low-risk group, with statistical significance in both the derivation cohort and temporal validation cohort (p < 0.0001, Figures 5A,B).

FIGURE 5
www.frontiersin.org

Figure 5. Risk group stratification according to bisection of the nomogram predicted readmission in the derivation cohort (A) and the temporal validation cohort (B).

Discussion

In the present study, we generated an easy-to-perform nomogram consisting of clinical complications and laboratory indicators for the first time that could be effectively used to prognosticate the readmission probability of AD cirrhotic patients receiving drug-based therapy at different time points within a 90-day period. To avoid the effects of other coexisting medical conditions, we only included patients with cirrhosis-related complications as the reason for initial hospitalization or readmission. The nomogram model performed well, as determined from C-indexes, AUC values, and the calibration curves both in the derivation cohort and temporal validation cohort at 30, 60, and 90 days, respectively. According to DCA, our nomogram demonstrated better net benefit and improved performance in 30-, 60-, and 90-day prognostic evaluations in both the derivation and validation cohorts, compared with MELDs, CLIF-C ADs, CTPs, and MELD-Nas. Furthermore, the model was able to stratify patients into groups with high and low risk of readmission within 90 days. Finally, our nomogram is accessible to medical staff via a link to the algorithm to automatically calculate a patient's probability of readmission within 90 days (https://cqykdx1111.shinyapps.io/dynnomapp/). This scoring system can facilitate early identification of high-risk patients, thus allowing implementation of interventions during hospitalization to reduce readmission.

Readmission among patients with AD cirrhosis in the current study was common, with incidence rates of 24.6, 43.0, and 51.8% at 30, 60, and 90 days, respectively. This finding was similar to that obtained from earlier studies based in India and North America (10, 16, 18). The etiology of cirrhosis in India was mainly hepatitis B virus (50.4%), while in North America and Europe, the main causes of cirrhosis were alcohol consumption (29.4%) and HCV (39.3%) (10, 11). We identified bacterial infection as the main reason for index admission and readmission (54.3% at initial admission, 44.7% at 30 days, 48.2% at 60 days, and 48.9% at 90 days), distinct from findings from India, North America, and Europe, where hepatic encephalopathy and ascites were identified as the main contributory factors (10, 11, 16, 18, 36). This difference may be associated with the distinct inclusion/exclusion criteria and medical conditions in different regions. The admission of cirrhosis patients with bacteremia to the intensive care unit was associated with an increase in the severity of the disease and an increase in the need for extrahepatic organ support. Bacteremia was an independent predictor of mortality in patients with ACLF (37, 38). Recent novel perspectives in the management of decompensated cirrhosis suggest that the systemic inflammatory response is one of the upstream events underlying the development of complications of liver cirrhosis (39). A PREDICT study showed that the most severe course of acute decompensation occurs in patients with pre-ACLF who display rapid progression of systemic inflammation leading to the development of ACLF and death within 90 days (40). These findings clearly suggest that systemic inflammatory response is predictive of poor prognosis. Therefore, clinicians should pay significant attention to the prevention of infections, which could avoid downstream complications (further decompensation, repeat infections, ACLF, or death) of cirrhosis (41).

Our nomogram includes laboratory and clinical indicators, which is better compared with other models, reflecting the severity of disease. Hyponatremia has been associated with hepatorenal syndrome and ascites and is an important predictor of readmission and mortality among patients with decompensated cirrhosis (30, 42). INR and TB are critical markers of liver protein synthesis function and the extent of hepatocellular necrosis (23, 43). These three indicators are all or partly involved in the construction of CLIF-C ADs, MELD-Nas, MELDs, and CTPs, reported to be significantly associated with the prognosis of AD cirrhosis or readmission (6, 11, 16, 18, 31, 36). However, owing to the involvement of the logarithm in calculations of MELDs, MELD-Nas, and CLIF-C ADs, clinicians have to use calculators, making it impractical in busy clinical practice. Although the calculation of CTPs is relatively simple, there are still some limitations, such as the narrow range of disease severity and subjective criteria, including hepatic encephalopathy and ascites (44). Notably, our model was more accurate than CLIF-C ADs, MELD-Nas, MELDs, and CTPs in predicting the risk of AD cirrhosis readmission. GI bleeding is a frequent and serious complication of cirrhosis. Mortality rates associated with acute esophageal variceal bleeding (EVB) are 12–20% and as high as 50% with EVB rebleeding (45). We found that although GI bleeding was a risk factor, the main cause for readmission in our study was bacterial infection. This finding underscores that patients with decompensated cirrhosis with gastrointestinal bleeding may be more likely to develop community-acquired infections after being discharged. Further studies are needed to confirm this possibility.

Our study showed that the readmission rate of AD cirrhosis patients in the low-risk group with total points ≤ 56.8 was significantly lower than that of high-risk patients with total points >56.8. In situations of limited medical resources and to improve cost effectiveness, low-risk patients could be considered for early discharge, whereas high-risk patients, especially those with GI bleeding, might need intensive management to prevent short-term readmission.

Our study has several strengths. First, we included only patients readmitted to the hospital for the first time after the initial discharge, thus avoiding the effects of multiple admissions. Second, our study was based on the Cox proportional hazard model, which predicts the probability of readmission at different time points within 90 days, rather than a logistic model that predicts readmission risk at a single time point, as used in most previous studies. In addition, we used temporal validation to demonstrate that our model can be generalized to further applications.

Limitations

This study has several limitations. First, selection bias may exist due to the retrospective nature of the investigation. However, we used a relatively large training cohort to construct the model, which was further subjected to temporal validation. Second, we excluded planned readmissions. Most of these patients underwent endoscopic variceal ligation during the initial hospitalization. Therefore, we did not evaluate the effects of this intervention on readmission. However, because the main reason for readmission is bacterial infection, the treatment target for patients with GI bleeding should not be limited to only preventing rebleeding. Third, data on social support, level of education, and socioeconomic status were not available. Further research is warranted to explore the impact of these important indicators.

Conclusions

The rates of short-term readmission related to cirrhosis were high in our patients. Bacterial infection was the main cause of index admission and readmission. We developed and temporally validated a prognostic model that accurately predicts the incidence of cirrhosis-related readmissions in patients with AD cirrhosis receiving drug-based therapy. The readmission probability can be obtained with the nomogram scoring system, which is based on four independent variables for each patient (https://cqykdx1111.shinyapps.io/dynnomapp/). The present nomogram can assist in clinical decision-making, counseling for treatment, and, most importantly, risk stratification of patients to help differentiate patients who need intensive management to prevent short-term readmission from those who could discharge earlier.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.

Ethics Statement

The studies involving human participants were reviewed and approved by The Ethics Committee of the First Affiliated Hospital of Chongqing Medical University. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author Contributions

XX, JT, and BQ: concept and design. XX and JT: drafting of the manuscript. XX, JT, HW, and WZ: statistical analysis. HW, WZ, and BQ: administrative, technical, and material support. XX and BQ: had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis and supervision. All authors critical revision of the manuscript for important intellectual content, acquisition, analysis, or interpretation of data, and read and approved the final manuscript.

Funding

This research was funded by Chongqing Science and Health Joint Project (Grant no. 2020MSXM026) and Intelligence Medicine Project of Chongqing Medical University (Grant no. YJSZHYX202001).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We would like to thank Editage (www.editage.com) for English language editing.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2021.646875/full#supplementary-material

Abbreviations

AD, acute decompensated; TRIPOD, transparent reporting of a multivariable prediction model for individual prognosis or diagnosis; ACLF, acute-on-chronic liver failure; TIPS, transjugular intrahepatic portosystemic shunt; GI, gastrointestinal; HBV, hepatitis B virus; HCV, hepatitis C virus; INR, international normalized ratio; MELDs, model for end-stage liver disease score; CTPs, Child-Turcotte-Pugh score; CLIF-ADs, chronic liver failure-consortium acute decompensation scores; MELD-Nas, MELD-Na score; SD, standard deviation; LASSO, least absolute shrinkage and selection operator; λ, lambda; AUC, area under the curve; ROC, receiver operating characteristic; C-index, concordance index; DCA, decision curve analyses; TB, total bilirubin; CI, confidence interval; EVB, esophageal variceal bleeding.

References

1. Arvaniti V, D'Amico G, Fede G, Manousou P, Tsochatzis E, Pleguezuelo M, et al. Infections in patients with cirrhosis increase mortality four-fold and should be used in determining prognosis. Gastroenterology. (2010) 139:1246–56, 56.e1–5. doi: 10.1053/j.gastro.2010.06.019

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Arroyo V, Moreau R, Kamath PS, Jalan R, Ginès P, Nevens F, et al. Acute-on-chronic liver failure in cirrhosis. Nat Rev Dis Primers. (2016) 2:16041. doi: 10.1038/nrdp.2016.41

CrossRef Full Text | Google Scholar

3. Fernández J, Acevedo J, Wiest R, Gustot T, Amoros A, Deulofeu C, et al. Bacterial and fungal infections in acute-on-chronic liver failure: prevalence, characteristics and impact on prognosis. Gut. (2018) 67:1870–80. doi: 10.1136/gutjnl-2017-314240

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Chirapongsathorn S, Talwalkar JA, Kamath PS. Readmission in cirrhosis: a growing problem. Curr Treat Options Gastroenterol. (2016) 14:236–46. doi: 10.1007/s11938-016-0091-1

CrossRef Full Text | Google Scholar

5. van Walraven C, Bennett C, Jennings A, Austin PC, Forster AJ. Proportion of hospital readmissions deemed avoidable: a systematic review. CMAJ. (2011) 183: E391–402. doi: 10.1503/cmaj.101860

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Berman K, Tandra S, Forssell K, Vuppalanchi R, Burton JR Jr, Nguyen J, et al. Incidence and predictors of 30-day readmission among patients hospitalized for advanced liver disease. Clin Gastroenterol Hepatol. (2011) 9:254–9. doi: 10.1016/j.cgh.2010.10.035

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Volk ML, Tocco RS, Bazick J, Rakoski MO, Lok AS. Hospital readmissions among patients with decompensated cirrhosis. Am J Gastroenterol. (2012) 107:247–52. doi: 10.1038/ajg.2011.314

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Singal AG, Rahimi RS, Clark C, Ma Y, Cuthbert JA, Rockey DC, et al. An automated model using electronic medical record data identifies patients with cirrhosis at high risk for readmission. Clin Gastroenterol Hepatol. (2013) 11:1335–41.e1. doi: 10.1016/j.cgh.2013.03.022

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Tapper EB, Finkelstein D, Mittleman MA, Piatkowski G, Lai M. Standard assessments of frailty are validated predictors of mortality in hospitalized patients with cirrhosis. Hepatology. (2015) 62:584–90. doi: 10.1002/hep.27830

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Koola JD, Ho SB, Cao A, Chen G, Perkins AM, Davis SE, et al. Predicting 30-day hospital readmission risk in a national cohort of patients with cirrhosis. Dig Dis Sci. (2020) 65:1003–31. doi: 10.1007/s10620-019-05826-w

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Morales BP, Planas R, Bartoli R, Morillas RM, Sala M, Cabré E, et al. Early hospital readmission in decompensated cirrhosis: incidence, impact on mortality, and predictive factors. Dig Liver Dis. (2017) 49:903–9. doi: 10.1016/j.dld.2017.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Chirapongsathorn S, Krittanawong C, Enders FT, Pendegraft R, Mara KC, Borah BJ, et al. Incidence and cost analysis of hospital admission and 30-day readmission among patients with cirrhosis. Hepatol Commun. (2018) 2:188–98. doi: 10.1002/hep4.1137

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Gaspar R, Rodrigues S, Silva M, Costa-Moreira P, Morais R, Andrade P, et al. Predictive models of mortality and hospital readmission of patients with decompensated liver cirrhosis. Dig Liver Dis. (2019) 51:1423–9. doi: 10.1016/j.dld.2019.03.016

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Chirapongsathorn S, Poovorawan K, Soonthornworasiri N, Pan-Ngum W, Phaosawasdi K, Treeprasertsuk S. Thirty-day readmission and cost analysis in patients with cirrhosis: a nationwide population-based data. Hepatol Commun. (2020) 4:453–60. doi: 10.1002/hep4.1472

CrossRef Full Text | Google Scholar

15. Graupera I, Solà E, Fabrellas N, Moreira R, Solé C, Huelin P, et al. Urine monocyte chemoattractant protein-1 is an independent predictive factor of hospital readmission and survival in cirrhosis. PLoS ONE. (2016) 11:e0157371. doi: 10.1371/journal.pone.0157371

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Bajaj JS, Reddy KR, Tandon P, Wong F, Kamath PS, Garcia-Tsao G, et al. The 3-month readmission rate remains unacceptably high in a large North American cohort of patients with cirrhosis. Hepatology. (2016) 64:200–8. doi: 10.1002/hep.28414

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Shaheen AA, Nguyen HH, Congly SE, Kaplan GG, Swain MG. Nationwide estimates and risk factors of hospital readmission in patients with cirrhosis in the United States. Liver Int. (2019) 39:878–84. doi: 10.1111/liv.14054

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Patel R, Poddar P, Choksi D, Pandey V, Ingle M, Khairnar H, et al. Predictors of 1-month and 3-months hospital readmissions in decompensated cirrhosis: a prospective study in a large Asian cohort. Ann Hepatol. (2019) 18:30–9. doi: 10.5604/01.3001.0012.7859

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Orman ES, Ghabril M, Emmett TW, Chalasani N. Hospital readmissions in patients with Cirrhosis: a systematic review. J Hosp Med. (2018) 13:490–5. doi: 10.12788/jhm.2967

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Moons KG, Altman DG, Vergouwe Y, Royston P. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ. (2009) 338:b606. doi: 10.1136/bmj.b606

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Amarasingham R, Patzer RE, Huesch M, Nguyen NQ, Xie B. Implementing electronic health care predictive analytics: considerations and challenges. Health Aff. (2014) 33:1148–54. doi: 10.1377/hlthaff.2014.0352

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ. (2015) 350:g7594. doi: 10.1136/bmj.g7594

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Sarin SK, Choudhury A, Sharma MK, Maiwall R, Al Mahtab M, Rahman S, et al. Acute-on-chronic liver failure: consensus recommendations of the Asian Pacific association for the study of the liver (APASL): an update. Hepatol Int. (2019) 13:353–90. doi: 10.1007/s12072-019-09946-3

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Blei AT, Cordoba J. Hepatic encephalopathy. Am J Gastroenterol. (2001) 96:1968–76. doi: 10.1111/j.1572-0241.2001.03964.x

CrossRef Full Text | Google Scholar

25. Moore KP, Wong F, Gines P, Bernardi M, Ochs A, Salerno F, et al. The management of ascites in cirrhosis: report on the consensus conference of the International Ascites Club. Hepatology. (2003) 38:258–66. doi: 10.1053/jhep.2003.50315

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Gustot T, Durand F, Lebrec D, Vincent JL, Moreau R. Severe sepsis in cirrhosis. Hepatology. (2009) 50:2022–33. doi: 10.1002/hep.23264

CrossRef Full Text | Google Scholar

27. Garcia-Tsao G, Bosch J. Management of varices and variceal hemorrhage in cirrhosis. N Engl J Med. (2010) 362:823–32. doi: 10.1056/NEJMra0901512

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Pugh RN, Murray-Lyon IM, Dawson JL, Pietroni MC, Williams R. Transection of the oesophagus for bleeding oesophageal varices. Br J Surg. (1973) 60:646–9. doi: 10.1002/bjs.1800600817

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Kamath PS, Kim WR. The model for end-stage liver disease (MELD). Hepatology. (2007) 45:797–805. doi: 10.1002/hep.21563

CrossRef Full Text | Google Scholar

30. Kim WR, Biggins SW, Kremers WK, Wiesner RH, Kamath PS, Benson JT, et al. Hyponatremia and mortality among patients on the liver-transplant waiting list. N Engl J Med. (2008) 359:1018–26. doi: 10.1056/NEJMoa0801209

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Jalan R, Pavesi M, Saliba F, Amoros A, Fernandez J, Holland-Fischer P, et al. The CLIF Consortium Acute Decompensation score (CLIF-C ADs) for prognosis of hospitalised cirrhotic patients without acute-on-chronic liver failure. J Hepatol. (2015) 62:831–40. doi: 10.1016/j.jhep.2014.11.012

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Friedman J, Hastie T, Tibshirani R. Regularization paths for generalized linear models via coordinate descent. J Stat Softw. (2010) 33:1–22. doi: 10.18637/jss.v033.i01

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Vasquez MM, Hu C, Roe DJ, Chen Z, Halonen M, Guerra S. Least absolute shrinkage and selection operator type methods for the identification of serum biomarkers of overweight and obesity: simulation and application. BMC Med Res Methodol. (2016) 16:154. doi: 10.1186/s12874-016-0254-8

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Frank E, Harrell J. Rms: Regression Modeling Strategies. R Package version 3.4–0. Available online at: https://CRAN.R-project.org/package=Hmisc (accessed April 21, 2017).

Google Scholar

35. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. (2006) 26:565–74. doi: 10.1177/0272989X06295361

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Louissaint J, Foster C, Harding-Theobald E, Lok AS, Tapper EB. Social support does not modify the risk of readmission for patients with decompensated cirrhosis. Dig Dis Sci. (2020). doi: 10.1007/s10620-020-06421-0. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Feltracco P, Brezzi M, Barbieri S, Milevoj M, Galligioni H, Cillo U, et al. Intensive care unit admission of decompensated cirrhotic patients: prognostic scoring systems. Transplant Proc. (2011) 43:1079–84. doi: 10.1016/j.transproceed.2011.01.153

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Karvellas CJ, Pink F, McPhail M, Austin M, Auzinger G, Bernal W, et al. Bacteremia, acute physiology and chronic health evaluation II and modified end stage liver disease are independent predictors of mortality in critically ill nontransplanted patients with acute on chronic liver failure. Crit Care Med. (2010) 38:121–6. doi: 10.1097/CCM.0b013e3181b42a1c

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Bernardi M, Caraceni P. Novel perspectives in the management of decompensated cirrhosis. Nat Rev Gastroenterol Hepatol. (2018) 15:753–64. doi: 10.1038/s41575-018-0045-2

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Trebicka J, Fernandez J, Papp M, Caraceni P, Laleman W, Gambino C, et al. The PREDICT study uncovers three clinical courses of acutely decompensated cirrhosis that have distinct pathophysiology. J Hepatol. (2020) 73:842–54. doi: 10.1016/j.jhep.2020.06.013

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Garcia-Tsao G. Prophylactic antibiotics in cirrhosis: are they promoting or preventing infections? Clin Liver Dis. (2019) 14:98–102. doi: 10.1002/cld.819

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Deitelzweig S, Amin A, Christian R, Friend K, Lin J, Lowe TJ. Hyponatremia-associated healthcare burden among US patients hospitalized for cirrhosis. Adv Ther. (2013) 30:71–80. doi: 10.1007/s12325-012-0073-1

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Moreau R, Jalan R, Gines P, Pavesi M, Angeli P, Cordoba J, et al. Acute-on-chronic liver failure is a distinct syndrome that develops in patients with acute decompensation of cirrhosis. Gastroenterology. (2013) 144:1426–37, 37.e1–9. doi: 10.1053/j.gastro.2013.02.042

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Cai YJ, Dong JJ, Dong JZ, Chen Y, Lin Z, Song M, et al. A nomogram for predicting prognostic value of inflammatory response biomarkers in decompensated cirrhotic patients without acute-on-chronic liver failure. Aliment Pharmacol Ther. (2017) 45:1413–26. doi: 10.1111/apt.14046

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Rush B, Deol N, Teriyaki A, Sey M, Jairath V, Walley KR, et al. Lower 90-day hospital readmission rates for esophageal variceal bleeding after TIPS: a nationwide linked analysis. J Clin Gastroenterol. (2020) 54:90–5. doi: 10.1097/MCG.0000000000001199

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: acute decompensated cirrhosis, readmission, independent predictors, nomogram, risk stratification

Citation: Xu X, Tan J, Wang H, Zhao W and Qin B (2021) Risk Stratification Score to Predict Readmission of Patients With Acute Decompensated Cirrhosis Within 90 Days. Front. Med. 8:646875. doi: 10.3389/fmed.2021.646875

Received: 28 December 2020; Accepted: 10 May 2021;
Published: 31 May 2021.

Edited by:

Ugo Cioffi, University of Milan, Italy

Reviewed by:

Jun Lyu, First Affiliated Hospital of Jinan University, China
Huiguo Ding, Capital Medical University, China
Keqing Shi, First Affiliated Hospital of Wenzhou Medical University, China

Copyright © 2021 Xu, Tan, Wang, Zhao and Qin. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Bo Qin, cqqinbo@126.com

These authors have contributed equally to this work and share first authorship

Download