ORIGINAL RESEARCH article

Front. Med., 13 March 2024

Sec. Hepatobiliary Diseases

Volume 11 - 2024 | https://doi.org/10.3389/fmed.2024.1368899

Development and validation of a machine learning model to predict prognosis in liver failure patients treated with non-bioartificial liver support system

  • SS

    Shi Shi 1,2

  • YY

    Yanfen Yang 3

  • YL

    Yuanli Liu 3

  • RC

    Rong Chen 4

  • XJ

    XiaoXia Jia 3

  • YW

    Yutong Wang 4

  • CD

    Chunqing Deng 1,2*

  • 1. Department of Health Statistics, School of Public Health, Shanxi Medical University, Taiyuan, Shanxi, China

  • 2. Department of Infectious Disease, First Hospital of Shanxi Medical University, Taiyuan, Shanxi, China

  • 3. The 1st School of Clinical Medicine, Shanxi Medical University, Taiyuan, Shanxi, China

  • 4. Department of Health Statistics, School of Medical Sciences, Shanxi Medical University, Taiyuan, Shanxi, China

Abstract

Background and objectives:

The prognosis of liver failure treated with non-bioartificial liver support systems is poor. Detecting its risk factors and developing relevant prognostic models still represent the top priority to lower its death risk.

Methods:

All 215 patients with liver failure treated with non-bioartificial liver support system were retrospectively analyzed. Potential prognostic factors were investigated, and the Nomogram and the Random Survival Forests (RSF) models were constructed, respectively. Notably, we evaluated the performance of models and calculated the risk scores to divide patients into low-risk and high-risk groups.

Results:

In the training set, multifactorial Cox regression analysis showed that etiology, hepatic encephalopathy, total bilirubin, serum alkaline phosphatase, platelets, and MELD score were independent factors of short-term prognosis. The RSF model (AUC: 0.863, 0.792) performed better in prediction than the Nomogram model (AUC: 0.816, 0.756) and MELD (AUC: 0.658, 0.700) in the training and validation groups. On top of that, patients in the low-risk group had a significantly better prognosis than those in the high-risk group.

Conclusion:

We constructed the RSF model with etiology, hepatic encephalopathy, total bilirubin, serum alkaline phosphatase, platelets, and MELD score, which showed better prognostic power than the Nomogram model and MELD score and could help physicians make optimal treatment decisions.

1 Introduction

Liver failure (LF) is a seriously life-threatening hepatic syndrome associated with numerous serious complications characterized by organ failure and high clinical mortality (1, 2). There is no specific treatment for LF, and the current treatment consists of general management, artificial liver support system therapy, and liver transplantation. However, the efficacy of comprehensive management is relatively slow. Donor liver scarcity and high treatment costs have made liver transplantation (LT) impracticable for most patients (3, 4).

In the past few decades, artificial liver support system (ALSS) therapy has developed into a therapeutic option for LF because it is able to temporarily replace part of the functions of the failing liver, remove harmful substances from the body, stabilize the internal environment, and reduce the burden on the liver (5). Several studies found that the non-bioartificial liver support system (NBAL) could afford survival benefits for LF patients (6–8). However, one study (9) found the deterioration of liver failure in some patients even after more than 10 treatments. The prognosis has emerged as a clinical challenge. Comprehensively digesting its risk factors and thus accurately estimating its prognosis is all the more important.

Nowadays, various prognostic models, including the Chinese Group on the Study of Severe Hepatitis B-ACLF (COSSH ACLF) (10), the PALS model (11), and the APM model (12) were deemed suitable to predict the prognosis in patients with acute-on chronic liver failure (ACLF) treated using NBAL. Nevertheless, LF can present as acute liver failure (ALF), subacute liver failure (SALF), ACLF (an acute deterioration of known or unknown chronic liver disease), and chronic liver failure (CLF) (13, 14). Whether these models serve to evaluate the prognosis of LF patients with NBAL is uncertain. Besides that, most of the models have been constructed based on the Cox regression that should initially be satisfied with the assumptions.

Yet, Random Survival Forests (RSF), proposed by Ishwaran et al., has few limitations. RSF is a newly introduced forest ensemble learner to analyze right-censored survival data (15). Given the limited survival data, it sought a model that best represented the data. Moreover, there is the possibility to rank the importance of the variables, thus filtering out variables with greater significance. Now, RSF has successfully applied to the risk prediction of several diseases (16, 17). Accordingly, in the present study, we investigated the factors affecting short-term prognosis in patients with LF treated with NBAL therapy and applied the nomogram and RSF to develop clinical prediction models, respectively. We hope to find the optimal models which will help clinicians identify patients with LF at different risk levels and make treatment decisions, regardless of presentation.

2 Materials and methods

2.1 Study population

Two groups of patients were identified retrospectively: one for model establishment (training set) and the other for model validation (validation set). The training group included patients admitted to the Department of Infectious Diseases at the First Hospital of Shanxi Medical University between January 2014 and December 2021. The validation group included patients admitted to the Department of Infectious Diseases at the First Hospital of Shanxi Medical University between January 2022 and December 2022. The study protocol conforms to the ethical guidelines of the 1975 Declaration of Helsinki (6th revision, 2008) as reflected in a priori approval by the Ethics Committee of the First Hospital of Shanxi Medical University research committee, and the requirement for informed consent was waived owing to the retrospective nature of the study.

The inclusion criteria were as follows: (1) patients with SALF and CLF who were diagnosed according to the Guidelines for Diagnosis and Treatment of Liver Failure, and patients with ACLF and ALF were, respectively, diagnosed according to the consensus recommendations of the Asian Pacific Association for the Study of the Liver and the recommendations of the American College of Gastroenterology (13, 14, 18); (2) patients that underwent NBAL therapy; (3) age ranging from 18 to 75 years; (4) hospitalization time for at least 1 day; (5) complete availability inpatient clinical data, including basic patient information (name, gender, age, classification of LF, etiology, contact information and prior medical history), non-biological artificial liver treatments (number of treatments, mode of treatment and date of treatment), and clinical parameters (missing values <30%). The exclusion criteria included: (1) pregnancy or lactation; (2) HIV infection and other viral infections; (3) liver cancer and other malignancy; (4) any other severe extrahepatic chronic disease including severe renal, cardiac, respiratory, neurologic diseases, or other systemic diseases; (5) patients lacking timely follow-up.

All patients were followed up routinely at 3-month intervals from the first NBAL treatment with a cohort follow-up cut-off date of March 2023. The outcome of this study was all-cause mortality after 3 months of follow-up. During that time, if patients underwent liver transplantation, they were considered dead. The patient enrollment process is shown in Figure 1.

Figure 1

2.2 Treatment

All patients received standard medical therapy (SMT), including bed rest, adequate nutritional support, and correction of hypoproteinemia, water-electrolyte, and acid–base balance. Antiviral treatment was provided for HBV DNA-positive patients. Complications were also treated as follows: treatment of ascites included mainly etiologic therapy, sodium intake restriction, and diuretic therapy; treatment of hepatic encephalopathy included dietary restriction, lactulose, ammonia-lowering drugs, L-ornithine-L-aspartate (LOLA) and other supportive therapy.

The NBAL treatments in our study included plasma exchange (PE), double plasma molecular adsorption system (DPMAS), and DPMAS with sequential half-dose plasma exchange (DPMAS+PE). These methods are performed depending on the patient’s condition. PE applies to patients with other diseases in which macromolecules or pathogenic mediators bound to albumin are present in the blood, but PE alone is not recommended in patients with preexisting significant hepatic encephalopathy; DPMAS applies to patients with prehepatic failure, hyperbilirubinemia, and also in those with hepatic encephalopathy; DPMAS + PE is indicated in patients with hyperbilirubinemia, especially those with bilirubin levels >500 μmol/L (6, 19).

2.3 Data-collection

Clinical data collected included gender, age, main complications, etiology, classification of LF, number of treatments and treatment modality of NBAL, and laboratory parameters within 24 h before the first treatment, including alanine aminotransferase (ALT), aspartate aminotransferase (AST), albumin (ALB), alkaline phosphatase (ALP), total bilirubin (TBIL), cholinesterase (CHE), gamma-glutamyl transpeptidase (GGT), low-density lipoprotein (LDL), platelets (PLT), prothrombin time (PT), international normalized ratio (INR), creatinine (Cr), sodium, alpha-fetoprotein (AFP), and MELD score. Furthermore, the calculation of total bilirubin actual resident rate (TBARR), total bilirubin rebound rate (TBRR), and total bilirubin clearance rate (TBCR) was performed, which were calculated according to the following formula:

2.4 Statistical analysis

Quantitative data were expressed as mean ± standard deviation (SD) when normally distributed and compared using Student’s t-test; when not normally distributed, they were indicated as median (interquartile range) and compared using the Mann–Whitney U test. Qualitative data were expressed as numbers (percentages), and chi-square tests were used for inter-group comparisons.

Baseline characteristics of the survival and death groups were compared using Student’s t-test, Mann–Whitney U-test, and Chi-square test. Potential predictors of prognosis were identified by univariate and multivariate analyses using Cox proportional risk regression models, using the forward stepwise method to screen for variables significantly associated with outcome. The test level α was set at 0.05, and the differences were considered significant at p < 0.05. The Nomogram and RSF models were developed, respectively, based on the above-mentioned characteristic variables. Bootstrap repeated sampling method (500 times) was used to perform internal validation of the prediction models. We compared the out-of-bag error rate and composite Brier score and plotted the prediction error curves. The optimal model was externally validated using calibration plots, decision-curse analysis (DCA) curves, and the area under the subject’s work characteristics curve.

All statistical analyses were performed using SPSS 25.0 software. Model construction was performed using R software version 4.2.1. Missing data were filled using the missForest package in the R software, version 4.2.1. The Nomogram model and calibration plots were constructed using the R package “rms”; the RSF model was constructed using the R package “randomForestSRC”; the DCA curves were drawn using the R package “dcurves”; “ROC curve analysis was performed using the R package “timeROC.”

3 Results

3.1 Patients characteristics

All 215 LF patients treated with NBAL participated in this study. Based on a three-month follow-up, patients were divided into survival (N = 138) and death groups (N = 77) in the training cohort. There were no significant differences in gender, classification of LF, treatment modality, and treatment frequency of NBAL in both groups (Table 1). A higher proportion of patients with hepatic encephalopathy (HE) was found in the death group than in the survival group (p < 0.05). Compared with the survival group, the levels of age, TBIL, PT, INR, Cr, MELD score, and TBARR were significantly higher in the death group (p < 0.05). Moreover, the levels of AST, ALP, CHE, GGT, LDL, and PLT in the death group were significantly lower than in the survival group (p < 0.05).

Table 1

Survival group (n = 138)Death group (n = 77)χ2/Z/tp-value
Gender (man/women)83/5552/251.1540.306
Etiology13.3850.004
Hepatitis virus48(34.8)34(44.2)
Medication34(24.6)8(10.4)
Alcohol28(20.3)8(10.4)
Others28(20.3)27(35.1)
Classification1.7560.647
ALF23(16.7)14(18.2)
SALF13(9.4)6(7.8)
ACLF88(63.8)53(68.8)
CLF14(10.1)4(5.2)
Treatment modality
PE111(80.4)64(83.1)0.2350.716
DPMAS2(1.4)1(1.3)0.0081.000
DPMAS+ PE11(8.0)3(39)1.3480.272
Main complications
Ascites89(64.5)48(62.3)0.0990.769
HE26(18.8)33(42.9)14.317<0.001
Treatment frequency2(2, 4)2(1, 4)−1.4200.156
Age47.36 ± 12.1651.71 ± 11.642.2250.011
ALT (U/L)141.0(48.5, 416.3)109.0(42.5, 351.0)−1.0070.314
AST (U/L)209.5(90.0, 358.5)131.0(81.0, 238.0)−2.2990.021
ALB (g/L)30.22(27.70, 33.00)30.00(28.20, 32.00)−0.7200.471
ALP (U/L)122.7(106.0, 153.0)109.5(95.0, 133.0)−2.9340.003
TBIL (μmol/L)364.75 ± 152.75436.76 ± 141.343.4030.001
CHE (U/L)1673.5(948.6, 2354.0)1198.0(4.3, 1986.0)−2.4690.014
GGT (U/L)83.14(62.00, 128.00)72.72(44.00, 94.00)−2.5060.012
LDL (mmol/L)1.10(0.93, 1.33)0.97(0.84 ~ 1.22)−2.4900.013
PLT (×109/L)99.77(74.65, 131.56)79.00(46.00, 115.77)−3.0340.002
PT (s)25.60(21.99, 41.30)29.79(25.00, 41.30)2.9820.003
INR2.30(1.94, 2.91)2.78(2.24, 3.61)3.590<0.001
Cr (μmol/L)62.86(52.00 ~ 80.10)75.00(55.00, 109.22)2.3010.021
Na (mmol/L)135.22(132.14, 137.86)134.00(131.00, 136.57)−1.7120.087
AFP68.87(12.90, 168.15)62.50(5.90, 140.24)−0.9770.328
MELD score23.73(20.26, 26.98)28.32(22.32, 33.16)3.860<0.001
TBARR (%)78.19(67.37, 88.72)85.06(76.93, 95.58)3.3380.001
TBRR (%)24.46(2.10, 45.77)32.42(11.04, 48.48)1.1280.259
TBCR (%)37.94(28.97, 44.55)21.99(35.67, 42.74)−1.8200.069

Characteristics of survival and death groups in the training cohort.

ALF, acute liver failure; SALF, subacute liver failure; ACLF, acute-on chronic liver failure; CLF, chronic liver failure; PE, plasma exchange; DPMAS, double plasma molecular adsorption system; DPMAS + PE, double plasma molecular adsorption system with sequential half-dose plasma exchange; HE, hepatic encephalopathy; ALT, alanine aminotransferase; AST, aspartate aminotransferase; ALB, albumin; ALP, alkaline phosphatase; TBIL, total bilirubin; CHE, cholinesterase; GGT, gamma-glutamyl transpeptidase; LDL, low-density lipoprotein; PLT, platelets; PT, prothrombin time; INR, international normalized ratio; Cr, creatinine; AFP, alpha-fetoprotein; MELD, Model for End-stage Liver Disease; TBARR, total bilirubin actual resident rate; TBRR, total bilirubin rebound rate; TBCR, total bilirubin clearance rate.

As shown in Table 2, we conducted the univariable Cox analysis on 25 potential factors, and the result determined 12 significant variables, including etiology, HE, age, ALP, TBIL, PLT, PT, INR, Cr, MELD score, TBARR, and TBCR. Additionally, the multivariable Cox regression analysis revealed that independent predictors of LF with NBAL treatments were etiology, HE, ALP, TBIL, PLT, and MELD scores.

Table 2

Univariate Cox regressionMultivariate Cox regression
VariablesBSEWaldPHR95%CIBSEWaldPHR95%CI
Gender−0.2130.2430.7680.3810.8080.501–1.302
Etiology12.8530.00512.1620.007
Etiology 2/Etiology 1−0.9080.3935.3340.0210.4030.187–0.872−0.4870.4061.4360.2310.6150.277–1.363
Etiology 3/Etiology 1−0.7460.3933.6050.0580.4740.219–1.024−0.9220.3965.4100.0200.3980.183–0.865
Etiology 4/Etiology 10.2870.2581.2370.2661.3320.804–2.2090.3710.2621.9980.1581.4490.866–2.424
Classification1.6110.657
Classification 2/Classification 1−0.2620.4880.2870.5920.7700.296–2.003
Classification 3/Classification 1−0.0520.3010.0300.8630.9490.527–1.711
Classification 4/Classification 1−0.6480.5671.3050.2530.5230.172–1.590
Treatment modality
PE−0.1210.3040.1570.6920.8860.488–1.609
DPMAS0.2021.0070.0400.8411.2240.170–8.805
DPMAS+ PE0.6040.5891.0510.3051.8290.577–5.803
Main complications
ascites0.1100.2350.2180.6401.1160.704–1.770
HE−0.8860.23114.759<0.0010.4120.262–0.648−1.0480.24218.791<0.0010.3510.218–0.563
Treatment frequency−0.0550.0730.5680.4510.9460.820–1.092
Age0.0250.0106.5690.0101.0251.006–1.045
ALT (U/L)0.0000.0001.3490.2461.0000.999–1.000
AST (U/L)0.0000.0000.2100.6471.0001.000–1.000
ALB (g/L)−0.0190.0260.5550.4560.9810.932–1.032
ALP (U/L)−0.0090.0038.8270.0030.9910.986–0.997−0.0080.0038.4060.0040.9920.987–0.997
TBIL (μmol/L)0.0030.00112.361<0.0011.0031.001–1.0040.0030.00114.098<0.0011.0031.001–1.005
CHE (U/L)0.0000.0003.7210.0541.0001.000–1.000
GGT (U/L)−0.0030.0023.7450.0530.9970.993–1.000
LDL (mmol/L)−0.4850.3292.1800.1400.6160.323–1.172
PLT (×109/L)−0.0080.0039.3510.0020.9920.987–0.997−0.0060.0035.0450.0250.9940.988–0.999
PT (s)0.0270.00811.5560.0011.0271.012–1.044
INR0.2830.07116.037<0.0011.3271.156–1.525
Cr (μmol/L)0.0020.0014.3150.0381.0021.000–1.004
Na (mmol/L)−0.0310.0241.5820.2080.9700.925–1.017
AFP−0.0010.0010.7970.3720.9990.997–1.001
MELD score0.0750.01331.930<0.0011.0781.050–1.1070.0480.01411.3150.0011.0491.020–1.079
TBARR (%)0.0100.0048.7460.0031.0101.004–1.017
TBRR (%)0.0020.0030.2700.6031.0020.995–1.009
TBCR (%)−0.0110.0046.9660.0080.9890.982–0.997

Results from univariate Cox regression and multivariate Cox regression.

HR, hazard ration; CI, confidence interval; Etiology 1, hepatitis virus; Etiology 2, medication; Etiology 3, alcohol; Etiology 4, others; Classification 1, acute liver failure; Classification 2, subacute liver failure; Classification 3, acute-on chronic liver failure; Classification 4, chronic liver failure; PE, plasma exchange; DPMAS, double plasma molecular adsorption system; DPMAS + PE, double plasma molecular adsorption system with sequential half-dose plasma exchange; HE, hepatic encephalopathy; ALT, alanine aminotransferase; AST, aspartate aminotransferase; ALB, albumin; ALP, alkaline phosphatase; TBIL, total bilirubin; CHE, cholinesterase; GGT, gamma-glutamyl transpeptidase; LDL, low-density lipoprotein; PLT, platelets; PT, prothrombin time; INR, international normalized ratio; Cr, creatinine; AFP, alpha-fetoprotein; MELD, Model for End-stage Liver Disease; TBARR, total bilirubin actual resident rate; TBRR, total bilirubin rebound rate; TBCR, total bilirubin clearance rate.

3.2 Development of models in the training cohort

According to independent predictors from multivariable Cox regression, we constructed a risk prediction nomogram model of LF with NBAL treatments (Figure 2).

Figure 2

The RSF model incorporates the above feature variables, and we trained the trees continuously based on mtry = 1 and ntree = 5,000 trees. Ntree = 2,000, which made the model stable, was selected as the optimal parameter (Supplementary Figures S1A). The optimal parameters, nodesize = 15 and mtry = 1, were determined by the grid search method (Supplementary Figures S1B). Based on the VIMP method, variables ranked in importance. All had VIMP values greater than 0, and the importance in descending order was MELD, HE, ALP, TBIL, PLT, and etiology (Supplementary Figures S2).

The internal validation results showed that both OBB and the composite Brier score of the RSF model (0.255, 0.161) are slightly lower than those (0.264, 0.169) of the Nomogram model. Meanwhile, the error curve of the RSF model was slightly lower than that of the Nomogram model as time increased, further indicating that the RSF model was relatively stable and reliable (Supplementary Figure S3).

3.3 Testing of models in the validation cohort

The developed model was further tested in the validation group. We plotted the ROC curves and calculated the corresponding AUC values in the training and validation cohorts. As shown in the ROC plots, there were significantly higher AUC values of the RSF model [0.863(95% CI, 0.815 ~ 0.912), 0.792(95% CI, 0.668 ~ 0.917)] in the training cohort, and validation cohort, compared to Nomogram model [0.816(95% CI, 0.758 ~ 0.874), 0.756(95% CI, 0.607 ~ 0.904)] and MELD [0.658(95% CI, 0.577 ~ 0.739), 0.700(95% CI, 0.545 ~ 0.855)] (Figure 3).

Figure 3

By observing the calibration plot both in the training cohort and the validation cohort, it is possible to roughly determine that there is a better agreement between the predicted survival probability and the actual observed results in the RSF model (Figure 4).

Figure 4

Figure 5 is a decision curve depicting the clinical efficiency of the RSF model and the Nomogram model for predicting the prognosis of patients. Notably, the clinical efficiency of the RSF model was higher than that of the Nomogram model in the training cohort. However, the clinical efficiency of the RSF model was similar to that of the Nomogram model in the validation cohort. The net benefits of the RSF model were close to 0.94 and 0.81 in the training and validation cohorts, respectively.

Figure 5

Combining the results of OOB, the composite Brier score, ROC curve, calibration curve, and DCA curve, we found that the RSF model had better predictive value for the prognosis of LF patients treated with NBAL with high precision and clinical applicability.

3.4 Risk stratification of overall survival by the RSF model

The patients were divided into low-risk and high-risk groups by calculating the risk scores based on the RSF model. The optimal cutoff value for risk stratification of the RSF model was 11.97, which was determined using X-tile software version 3.6.1 (20). Supplementary Figure S4 shows the K-M survival curves for the different risk groups in the training and validation cohorts. As observed, patients in the low-risk group had a significantly better prognosis than those in the high-risk group (p < 0.001). Furthermore, as shown in Supplementary Tables S1, S2, the log-rank test results showed differences among groups.

4 Discussion

LF is a severely life-threatening clinical syndrome that has no effective treatment to improve patients’ clinical course. However, some LF patients with reversible potential may have a chance to be corrected by aggressive artificial liver therapy (21). PE has been widely used in China to remove toxic substances, but it requires a large amount of plasma and carries the potential risk of infection and allergy. Previous studies (22) have reported that PE helps to improve systemic inflammatory response syndrome (SIRS) and reduce the occurrence of multiple organ failure (MOF), thus prolonging the survival of patients. DPMAS fully utilizes plasma adsorption to remove inflammatory substances with plasma conservation and prevention of allergic reactions. These effects from DPMAS may help reduce TNF-α and IL-6 levels and effectively scavenge pro-inflammatory factors, with good survival benefits (23, 24). In recent years, it has been pointed out that DPMAS+PE combines both of these treatment modalities and has been considered as one of the best treatment modalities in case of plasma shortage and inability to perform liver transplantation (25, 26).

Although several previous prognostic models for LF have been applied and validated by some scholars, while specific models for predicting LF patients treated with ALSS have been published among Eastern and Western countries, few machine learning-based prognostic models have been published in detail for patients with LF treated with NBAL. We found that etiology, HE, ALP, TBIL, PLT, and MELD scores were associated with the outcome of LF patients treated with NBAL. Some scholars have reported that the prognosis of LF patients treated with NBAL is related to cirrhosis, TBIL, INR, infection, HE (11), Cr (7), age, MELD score (27), and AFP (12), which is generally consistent with our results. We also attempted to construct prognostic models based on the nomogram and RSF algorithm separately for LF patients treated with NBAL and select the better model while stratifying patients into different risk subgroups.

4.1 Etiology, complication, and prognosis

According to one study (28), approximately 1.32 million people worldwide died from alcohol-associated LF in 2017, making it the leading cause of liver-related mortality. Alcohol abuse increases intestinal permeability. In addition, lipids are peroxidized by reactive oxygen species produced by alcohol with its metabolites thus leading to hepatocellular damage (29, 30). Santhosh’s results (31) showed that low-volume plasma exchange and low-dose steroids improved survival in patients with alcohol-associated LF. We found that alcohol-associated LF was related to improved outcomes in patients treated with NBAL, although hepatitis virus-associated LF accounted for the highest proportion of LF. It suggests that more attention should be paid to this population of alcohol-associated LF. HE is a severe neuropsychiatric complication observed in patients with liver failure. The pathophysiology of HE is sophisticated and incompletely understood, but hyperammonemia and cerebral hemodynamic dysfunction appear to be central to the pathogenesis of HE (32). Some scholars have also hypothesized that HE may predict prognosis in patients with liver failure (33). Cai’s results (34) showed that HE, more commonly seen in LF patients presenting with infection, was an independent risk factor for 90-day mortality in ACLF patients showing infection. Du’s results (11) showed HE was the independent predictor of 3-month prognosis in patients with HBV-ACLF treated with PE therapy, which is generally consistent with our results.

4.2 Clinical indicators and prognosis

TBIL serves as an essential indicator of liver metabolic function and a prognostic indicator of liver failure (35). Severe hepatic impairment causes a decrease in bilirubin binding, allowing unconjugated bilirubin to accumulate in the blood. Meanwhile, biliary stasis leads to the accumulation of bile acids and conjugated bilirubin in the liver and systemic system (36). Studies have shown that high TBIL is associated with poor prognosis in patients with liver failure treated with non-bioartificial liver support systems, which is consistent with our findings (11). Our study also found lower ALP levels in the death group compared to the survival group. It suggests that cholestasis may develop in patients with a low risk of death, while high-risk patients have possible limitations of capillary bile duct function (37). Thrombocytopenia may be driven by viral infection, changes in portal pressure, and splenomegaly (38). Williamson and Chapman (39) found that ALP worked as one of the indicators to determine prognosis. Mu et al. (40) found that platelet counts had a high value in predicting short-term outcomes in patients with hepatitis E virus-related acute liver failure (HEV-ALF). Despite the different study populations, these findings seem to strengthen our results.

4.3 MELD score and prognosis

MELD is a recognized score for predicting survival in patients with end-stage liver disease, including TBIL, INR, Cr, and etiology (41). Che et al. (42) found a significant reduction in total bilirubin levels and MELD scores after NBAL treatment compared to pre-treatment. Chen’s results (43) showed that PE-based NBAL performed best in patients with 30 ~ 40 MELD scores. A meta-analysis by Li et al. (44) showed that patients treated with NBAL with lower-level MELD scores had a higher 28-day survival rate. In turn, our results found that MELD >32.12 had a higher risk of death. Moreover, our results showed that the MELD score within 24 h before the first NBAL treatment was an independent predictor of 3-month prognosis in LF patients treated with NBAL. Also, we found that both RSF and Nomogram models offered remarkable benefits compared to the MELD score. The TBIL level after artificial liver treatment will decrease to some extent, while it will rebound inevitably after a period of time. We sought to investigate the relationship between three indicators, TBCR, TBRR, and TBARR, and prognosis. Univariate Cox regression results suggest that TBARR and TBCR were probably relevant to prediction. However, data from retrospective studies were affected by various factors. Further confirmation of this conjecture is needed in the future.

4.4 Previous prognostic models

There are several nomogram models for predicting the prognosis of LF patients treated with NBAL. Ma et al. (10) conducted a retrospective study to assess the prognostic value of six models to predict the prognosis of patients with liver failure treated with artificial liver, and reported that the COSSH ACLF (AUC: 0.806, 95% confidence interval [CI]: 0.753 ~ 0.853) was more accurate in predicting the short-term prognosis of patients with ACLF treated with ALSS. Zhou et al. (27) used the number of comorbidities, age, MELD score, and artificial liver pattern to construct a model to predict the survival of patients with liver failure treated with artificial liver. PALS score (AUROC = 0.818) was established by Du et al. (11) to screen the subgroups (PALS score of 3–5 who received 1–2 sessions of ALSS therapy, PALS score of 6–9 who received ≥6 sessions of ALSS therapy) who could benefit from PE-centered ALSS therapy. Xie et al. (12) proposed a new APM model (AUC:0.790, 95% confidence interval [CI]: 0.740 ~ 0.834) including AFP levels to predict 28-day survival in patients with hepatitis B virus-related chronic plus acute liver failure treated with an artificial liver support system. To the best of our study, time-dependent AUC, calibration curve, and DCA all suggested that the RSF model had potential clinical application value. Also, we distinguished between high-risk and low-risk patients based on the risk score calculated from the RSF model. K-M plots and log-rank analysis showed significant differences between the two groups. Therefore, we should focus highly on patients with risk scores higher than 11.97. In addition, we wanted to try to compare the RSF model with existing prognostic models, but in this retrospective study, the data lacked relevant indicators. Further studies will have to be done in the future.

4.5 Limitations of study

There are several limitations of our study. The first one concerns that this is a single-center retrospective study and the issue of selection bias cannot be completely avoided. The second one lies in the small sample size of our data both in the training and validation sets. Because patients with acute liver failure, sub-acute liver failure, acute-on-chronic liver failure, and chronic liver failure have a diverse survival rate, sub-group analyses are required. However, the small sample size of our data will lead to an overfitting of the results. The last one is that our findings are based on the Chinese population and cannot be extrapolated to other countries. In the future, a prospective large sample of data shared by multiple medical centers may increase the reliability and generalizability of the prediction model.

In summary, the RSF model allows for predicting the short-term prognosis of patients with liver failure treated with non-bioartificial liver support systems, including etiology, HE, ALP, TBIL, PLT, and MELD scores. Stratifying the risk scores of the model enables the promotion of individualized treatment. This model needs to be further validated in the future.

Statements

Data availability statement

The datasets presented in this article are not readily available because protecting patients' privacy and interests. Requests to access the datasets should be directed to SS, .

Ethics statement

The studies involving humans were approved by the Ethics Committee of the First Hospital of Shanxi Medical University Research Committee. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required from the participants or the participants’ legal guardians/next of kin because the retrospective nature of the study.

Author contributions

SS: Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing. YY: Investigation, Methodology, Visualization, Writing – original draft. YL: Investigation, Writing – review & editing. RC: Data curation, Formal analysis, Investigation, Writing – review & editing. XJ: Writing – review & editing. YW: Data curation, Formal analysis, Writing – review & editing. CD: Funding acquisition, Methodology, Project administration, Software, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This research was funded by the Beijing Liver and Gallbladder Foundation “Special Fund for Artificial Liver in 2022” (iGandanF-1082022-RGG005).

Acknowledgments

We thank the workers in the Medical Records Office for their help. We also thank all the patients who participated in this study for their understanding and recognition of our work.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2024.1368899/full#supplementary-material

References

  • 1.

    SarinSKChoudhuryA. Acute-on-chronic liver failure: terminology, mechanisms and management. Nat Rev Gastroenterol Hepatol. (2016) 13:13149. doi: 10.1038/nrgastro.2015.219

  • 2.

    MontriefTKoyfmanALongB. Acute liver failure: a review for emergency physicians. Am J Emerg Med. (2019) 37:32937. doi: 10.1016/j.ajem.2018.10.032

  • 3.

    LiHChenHSNybergSL. Extracorporeal liver support and liver transplant for patients with acute-on-chronic liver failure. Semin Liver Dis. (2016) 36:15360. doi: 10.1055/s-0036-1583197

  • 4.

    TujiosSStravitzRTLeeWM. Management of acute liver failure: update 2022. Semin Liver Dis. (2022) 42:36278. doi: 10.1055/s-0042-1755274

  • 5.

    LiLJZhangYMLiuXLduWBHuangJRYangQet al. Artificial liver support system in China: a review over the last 30 years. Ther Apher Dial. (2006) 10:1607. doi: 10.1111/j.1744-9987.2006.00358.x

  • 6.

    SalibaFBañaresRLarsenFSWilmerAParésAMitznerSet al. Artificial liver support in patients with liver failure: a modified Delphi consensus of international experts. Intensive Care Med. (2022) 48:135267. doi: 10.1007/s00134-022-06802-1

  • 7.

    ChenJJHuangJRYangQXuXWLiuXLHaoSRet al. Plasma exchange-centered artificial liver support system in hepatitis B virus-related acute-on-chronic liver failure: a nationwide prospective multicenter study in China. Hepatobiliary Pancreat Dis Int. (2016) 15:27581. doi: 10.1016/S1499-3872(16)60084-X

  • 8.

    YangLWuTLiJXinJShiDJiangJet al. Artificial liver treatment improves survival in patients with hepatitis B virus-related acute-on-chronic liver failure: a case-control matched analysis. Hepatol Res. (2020) 50:65670. doi: 10.1111/hepr.13497

  • 9.

    García MartínezJJBendjelidK. Artificial liver support systems: what is new over the last decade?Ann Intensive Care. (2018) 8:109. doi: 10.1186/s13613-018-0453-z

  • 10.

    MaYJduLYBaiLTangH. Assessment value of short-term prognosis of six predictive models for patients with acute-on-chronic liver failure treated with artificial liver support system. Sichuan Da Xue Xue Bao Yi Xue Ban. (2022) 53:75863. doi: 10.12182/20220960203

  • 11.

    DuLMaYZhouSChenFXuYWangMet al. A prognostic score for patients with acute-on-chronic liver failure treated with plasma exchange-centered artificial liver support system. Sci Rep. (2021) 11:1469. doi: 10.1038/s41598-021-81019-8

  • 12.

    XieZViolettaLChenEHuangKWuDXuXet al. A prognostic model for hepatitis B acute-on-chronic liver failure patients treated using a plasma exchange-centered liver support system. J Clin Apher. (2020) 35:94103. doi: 10.1002/jca.21762

  • 13.

    SarinSKChoudhuryASharmaMKMaiwallRal MahtabMRahmanSet al. Acute-on-chronic liver failure: consensus recommendations of the Asian Pacific association for the study of the liver (Apasl): an update. Hepatol Int. (2019) 13:35390. doi: 10.1007/s12072-019-09946-3

  • 14.

    Liver Failure and Artificial Liver Group; Severe Liver Disease and Artificial Liver Group; Chinese Medical Association. Guideline for diagnosis and treatment of liver failure (2018). Chin J Hepatol. (2019) 27:1826. doi: 10.3760/cma.j.issn.1007-3418.2019.01.006

  • 15.

    IshwaranHKogalurUBBlackstoneEHLauerMS. Random survival forests. Ann App Stat. (2008) 2:84160. doi: 10.1214/08-AOAS169

  • 16.

    MohammedMMboyaIBMwambiHElbashirMKOmoloB. Predictors of colorectal cancer survival using cox regression and random survival forests models based on gene expression data. PLoS One. (2021) 16:e0261625. doi: 10.1371/journal.pone.0261625

  • 17.

    ZhangLHuangTXuFLiSZhengSLyuJet al. Prediction of prognosis in elderly patients with sepsis based on machine learning (random survival forest). BMC Emerg Med. (2022) 22:26. doi: 10.1186/s12873-022-00582-z

  • 18.

    FlammSLYangYXSinghSFalck-YtterYTFlammSLLimJKet al. American Gastroenterological Association Institute guidelines for the diagnosis and management of acute liver failure. Gastroenterology. (2017) 152:6447. doi: 10.1053/j.gastro.2016.12.026

  • 19.

    Liver Failure and Artificial Liver Group, Branch of Infectious Diseases, Chinese Medical Association. Guideline for non-bioartificial liver support systems in treatment of liver failure (2016). Chin J Clin Infect Dis. (2016) 9:97103. doi: 10.3760/cma.j.issn.1674-2397.2016.02.001

  • 20.

    CampRLDolled-FilhartMRimmDL. X-tile: a new bio-informatics tool for biomarker assessment and outcome-based cut-point optimization. Clin Cancer Res. (2004) 10:72529. doi: 10.1158/1078-0432.CCR-04-0713

  • 21.

    MoreauRGaoBPappMBañaresRKamathPS. Acute-on-chronic liver failure: a distinct clinical syndrome. J Hepatol. (2021) 75:S27s35. doi: 10.1016/j.jhep.2020.11.047

  • 22.

    MaiwallRBajpaiMChoudhuryAKKumarASharmaMKDuanZet al. Therapeutic plasma-exchange improves systemic inflammation and survival in acute-on-chronic liver failure: a propensity-score matched study from AARC. Liver Int. (2021) 41:108396. doi: 10.1111/liv.14806

  • 23.

    ZhangJLuoHHanYZhouX. Sequential versus mono double plasma molecular adsorption system in acute-on-chronic liver failures: a propensity-score matched study. Int J Artif Organs. (2022) 45:513. doi: 10.1177/0391398820987565

  • 24.

    HeJZhangXPZhouXCaiZLKangXYDuanWet al. Application of double plasma molecular adsorption system in children with acute liver failure. Zhongguo Dang Dai Er Ke Za Zhi. (2021) 23:1805. doi: 10.7499/j.issn.1008-8830.2010145 PMID:

  • 25.

    GuoXWuFGuoWZhangJYangYLuYet al. Comparison of plasma exchange, double plasma molecular adsorption system, and their combination in treating acute-on-chronic liver failure. J Int Med Res. (2020) 48:300060520932053. doi: 10.1177/0300060520932053

  • 26.

    YaoJLiSZhouLLuoLYuanLDuanZet al. Therapeutic effect of double plasma molecular adsorption system and sequential half-dose plasma exchange in patients with Hbv-related acute-on-chronic liver failure. J Clin Apher. (2019) 34:3928. doi: 10.1002/jca.21690

  • 27.

    ZhouPQZhengSPYuMHeSSWengZH. Prognosis of acute-on-chronic liver failure patients treated with artificial liver support system. World J Gastroenterol. (2015) 21:961422. doi: 10.3748/wjg.v21.i32.9614

  • 28.

    SingalAKMathurinP. Diagnosis and treatment of alcohol-associated liver disease: a review. JAMA. (2021) 326:16576. doi: 10.1001/jama.2021.7683

  • 29.

    GustotTJalanR. Acute-on-chronic liver failure in patients with alcohol-related liver disease. J Hepatol. (2019) 70:31927. doi: 10.1016/j.jhep.2018.12.008

  • 30.

    TrebickaJLouvetAArroyoVJalanRShahVHMoreauR. Severe alcoholic hepatitis as precipitant for organ failure and Aclf. Z Gastroenterol. (2022) 60:6776. doi: 10.1055/a-1713-3796

  • 31.

    KumarSEGoelAZachariahUNairSCDavidVGVarugheseSet al. Low volume plasma exchange and low dose steroid improve survival in patients with alcohol-related acute on chronic liver failure and severe alcoholic hepatitis - preliminary experience. J Clin Exp Hepatol. (2022) 12:3728. doi: 10.1016/j.jceh.2021.07.010

  • 32.

    HadjihambiAKhetanVJalanR. Pharmacotherapy for hyperammonemia. Expert Opin Pharmacother. (2014) 15:168595. doi: 10.1517/14656566.2014.931372

  • 33.

    ZhangQShiBWuL. Characteristics and risk factors of infections in patients with Hbv-related acute-on-chronic liver failure: a retrospective study. PeerJ. (2022) 10:e13519. doi: 10.7717/peerj.13519

  • 34.

    CaiJZhangMHanTJiangHQ. Characteristics of infection and its impact on short-term outcome in patients with acute-on-chronic liver failure. Medicine. (2017) 96:e8057. doi: 10.1097/MD.0000000000008057

  • 35.

    WuTLiJShaoLXinJJiangLZhouQet al. Development of diagnostic criteria and a prognostic score for hepatitis B virus-related acute-on-chronic liver failure. Gut. (2018) 67:218191. doi: 10.1136/gutjnl-2017-314641

  • 36.

    VítekLOstrowJD. Bilirubin chemistry and metabolism; harmful and protective aspects. Curr Pharm Des. (2009) 15:286983. doi: 10.2174/138161209789058237

  • 37.

    PouponR. Liver alkaline phosphatase: a missing link between choleresis and biliary inflammation. Hepatology. (2015) 61:208090. doi: 10.1002/hep.27715

  • 38.

    LismanTLuyendykJP. Platelets as modulators of liver diseases. Semin Thromb Hemost. (2018) 44:11425. doi: 10.1055/s-0037-1604091

  • 39.

    WilliamsonKDChapmanRW. Editorial: further evidence for the role of serum alkaline phosphatase as a useful surrogate marker of prognosis in PSC. Aliment Pharmacol Ther. (2015) 41:14951. doi: 10.1111/apt.13004

  • 40.

    MuXZouJChenJTongJMaLNingPet al. Low platelets: a new and simple prognostic marker for patients with hepatitis E virus-related acute liver failure. Hepatol Int. (2022) 16:111626. doi: 10.1007/s12072-022-10302-1

  • 41.

    KamathPSWiesnerRHMalinchocMKremersWTherneauTMKosbergCLet al. A model to predict survival in patients with end-stage liver disease. Hepatology. (2001) 33:46470. doi: 10.1053/jhep.2001.22172

  • 42.

    CheXQLiZQChenZGuoDJiaQYJiangSCet al. Plasma exchange combining with plasma bilirubin adsorption effectively removes toxic substances and improves liver functions of hepatic failure patients. Eur Rev Med Pharmacol Sci. (2018) 22:111825. doi: 10.26355/eurrev_201802_14400

  • 43.

    ChenYYLiHXuBYZhengXLiBLWangXBet al. Plasma exchange-based non-bioartificial liver support system improves the short-term outcomes of patients with hepatitis B virus-associated acute-on-chronic liver failure: a multicenter prospective cohort study. Front Med. (2021) 8:779744. doi: 10.3389/fmed.2021.779744

  • 44.

    LiGZhangPZhuY. Artificial liver support systems for hepatitis B virus-associated acute-on-chronic liver failure: a meta-analysis of the clinical literature. J Viral Hepat. (2023) 30:90100. doi: 10.1111/jvh.13767

Summary

Keywords

non-bioartificial liver support system, liver failure, random survival forests, multivariate cox regression, nomogram

Citation

Shi S, Yang Y, Liu Y, Chen R, Jia X, Wang Y and Deng C (2024) Development and validation of a machine learning model to predict prognosis in liver failure patients treated with non-bioartificial liver support system. Front. Med. 11:1368899. doi: 10.3389/fmed.2024.1368899

Received

11 January 2024

Accepted

29 February 2024

Published

13 March 2024

Volume

11 - 2024

Edited by

Terry Cheuk-Fung Yip, The Chinese University of Hong Kong, Hong Kong SAR, China

Reviewed by

Yalei Zhao, The First Affiliated Hospital of Xi'an Jiaotong University, China

Huapeng Lin, Shanghai Jiao Tong University, China

Updates

Copyright

*Correspondence: Chunqing Deng,

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics