Development and validation of mortality prediction models for heart transplantation using nutrition-related indicators: a single-center study from China

1 Introduction

Heart failure (HF) is a global pandemic. There are about 64.3 million HF patients worldwide and approximately 4.5 million in China (1, 2). Advanced end-stage HF has an unfavorable prognosis, and the ultimate therapeutic option is heart transplantation (HT) (3, 4). In 2021, about 738 HT were performed in China according to data from the China Heart Transplant Registration Network (5). In 2023, the number increased and our center performed 121 HT. The total number of HT reached 1,000 in April 2023. Due to the mismatch between organ supply and demand, there is a significantly higher waitlist than HT surgery rates (6, 7). This leads to longer waiting periods before HT, which may cause disease progression and poor nutritional status (2, 8, 9).

Malnutrition is common in HF, affecting up to 70% of HF patients (10). As HF progresses, it may appear as “cardiac cachexia” in extreme states. In this state, patients would develop protein-calorie malnutrition along with muscle wasting and peripheral edema (11). It leads to a poor life quality and an increase in mortality. However, less severe malnutrition is hard to recognize and the same as its effect on prognosis of HT. An easy and accessible mortality prediction model using nutrition-related indicators may reflect the effect of mild malnutrition on the prognosis of HT and predict mortality risk of HT patients. To our knowledge, there is no such clinical model yet.

Nutritional risk index (NRI) is an easily calculated index incorporating albumin and body size (12). For the past few years, NRI has proven its prognostic utility in HF patients, but there is little data, especially Chinese data, in HT (13–15). In this study, we verified the prognostic value of NRI in HT. Moreover, we used HT patients' data in China to derivate and validate risk prediction models for post-HT surgery death. We aimed at developing and validating a mortality prediction model for HT. This risk stratification approach can be used to identify patients at high risk of death after HT.

2 Method

2.1 Ethical statement

After donor brain death, all donor hearts were donated to the Red Cross Society in the terms of China's laws. The donor hearts transplanted to recipients were allocated by the China Organ Transplant Response System. The study conformed to the “Declaration of Istanbul on Organ Trafficking and Transplant Tourism” and the national program for deceased organ donation in China (national protocol for China category I) (16). This study was approved by the Ethics Committee of Wuhan Union Hospital. And the requirement of written informed consent was waived by the ethics committee since the study was retrospective. In addition, all clinical data was anonymized and de-identified.

2.2 Study population

We used the HT database from our center in which participants were followed up through telephone or outpatient visit. For those who could not attend the telephone interview for physical or cognitive reasons, we performed an interview with their relatives to reduce attrition bias. All participants received orthotopic heart transplantation between 1 January 2015 and 31 December 2020. We excluded people who underwent multiple organ transplantation or re-transplantation and those with missing data. Then we divided patients into the derivation and validation cohorts using a simple randomization method. First, a random number was generated for each participant with random seed 20,191,102. Then, the random numbers were sorted in order from smallest to largest. The first 70% of participants were divided into the derivation cohort; the remaining were placed into the validation cohort (Supplementary Figure S1).

2.3 Study outcomes

The primary outcome of the study was defined as all-cause postoperative death. Mortality data were obtained from the China Heart Transplant Registration Network until 26 May 2021, where all deaths of HT are required to be registered by law.

2.4 Candidate predictors

We identified nutrition-associated candidate predictors available prior to HT operation through published systematic reviews and univariate Cox proportional hazards regression. All the predictors were retrieved from electronic medical records. Laboratory examinations were conducted within 7 days prior to HT operation. NRI was calculated using the following formula: NRI = [1.519 × serum albumin (in g/dl)] + [41.7 × weight (in kg)/ideal body weight (in kg)] (13). We used the Lorentz formula to calculate ideal body weight (IBW) on the basis of patients' height and gender: IBW = height (in cm)−100−[height (in cm) – 150]/4 for men and IBW = height (in cm)−100−[height (in cm) – 150]/2.5 for women (17).

2.5 Model derivation

All nutrition-associated candidate predictors with a significance level of 0.1 in univariate Cox proportional hazards regression were included as potential variables in multivariate Cox proportional hazards regression models in the derivation cohort. To create prediction models that could be more efficiently used, we performed stepwise backward variable selection based on Akaike Information Criterion (AIC) in 1,000 bootstrapped samples with a significance level of 0.05 (18, 19). The bootstrapped samples were the same size as the derivation sample. Then, we fit a reduced model and compared the full prediction model with NRI and the reduced model.

2.6 Model performance

The overall goodness-of-fit of the models was compared between models using an AIC indicator. Model discrimination was evaluated through C statistic and integrated discrimination improvement (IDI). As for calibration, calibration curves were drawn graphically. We calculated categorical and continuous net reclassification index to compare the reclassification ability of clinical prediction models (20). For the categorical net reclassification index, the risk threshold was defined as less than 20%, 20% to less than 40%, and 40% or higher.

The area under the ROC curve (AUC) was calculated to validate the discrimination of NRI in overall mortality after HT surgery. Kaplan–Meier (KM) survival analysis was generated to compare survival rate in different groups and differences were examined using log-rank. Statistical significance was considered as a P-value of <0.05 (two-sided) for all contrasts. Statistical analysis was conducted using SPSS 27.0.1 and R 4.3.0.

3 Results

3.1 Characteristics of cohorts

A total of 428 HT patients were included in the study cohort (299 participants in the derivation cohort and 129 in the validation cohort). In the derivation cohort, 240 (80.3%) participants were male with mean (SD) age 48.67 (12.33) years. Most participants (181, 60.5%) were diagnosed with ischemic cardiomyopathy. About 79 (26.4%) underwent cardiac surgery beforehand. The mean (SD) NRI was 100.47 (11.89). By the end of follow up, a total of 66 (22.1%) participants died after HT (Table 1 and Supplementary Table S1).

Table 1

Table 1. Baseline characteristics of derivation and validation cohorts.

Demographics in the validation cohort were similar to the derivation cohort. And 28 (21.7%) participants died by the end of follow up. Donors' characteristics were also available in the study and there were no statistical differences between the derivation cohort and validation cohort.

3.2 Prediction performance of nutritional risk Index

In the derivation cohort, the AUC of NRI for predicting overall postoperative death was 0.613, with a cut-off level of 103.79 (95% CI, 0.542–0.684, P = 0.005). Patients in the low NRI group had lower body mass index, hemoglobin, red blood cells, hematocrit, total cholesterol, low density lipoprotein, and lower triglyceride (TG) and higher levels of blood urea nitrogen and brain natriuretic peptide. These patients presented lower prevalence of hypertension and diabetes mellitus and higher prevalence of chronic liver disease (Supplementary Table S2). The result of the K–M survival curve showed that the high NRI group had better overall survival (OS) compared to the low NRI group (P < 0.01) (Supplementary Figure S2). The C statistic was 0.59 (95% CI, 0.53–0.66) in the derivation cohort and 0.63 (95% CI, 0.53–0.73) in the validation cohort (Tables 2, 3).

Table 2

Table 2. Mortality after heart transplantation predictors and performance of models in the derivation cohort^a.

Table 3

Table 3. Predictive performance of models in the validation cohort^a.

3.3 Nutrition-associated prediction model derivation

In the bootstrapped samples of the derivation cohort, multivariable Cox proportional hazards regression analysis showed that older age, lower NRI values, and higher serum creatinine (SCr) and TG values were relevant to a high risk of death after HT. After this, the four-variable model (model-1) was finally developed. The odds ratio of multivariable Cox proportional hazards regression for variables in the model can be seen in Table 2.

3.4 Prediction model performance in the derivation and validation cohort

The AUC of the four-variable model (model-1) for predicting overall postoperative death was 0.755 in the derivation cohort. (Supplementary Figure S3A) Compared with other models, model-1 had the highest C statistic and lowest AIC both in the derivation and validation cohorts. The C statistic of model-1 was 0.72 (95% CI, 0.67–0.78) in the derivation cohort and 0.71 (95% CI, 0.62–0.81) in the validation cohort. Discrimination based on IDI significantly improved in the four-variable model compared with model-2 without SCr and TG (6.9%; 95% CI, 1.8%–15.1%; P < 0.01) and with model-3, which only included variable NRI (14.7%; 95% CI, 7.4%–26.2%; P < 0.001) in the derivation cohort (Tables 2, 3). A similar IDI improvement was also observed in the validation cohort. Both continuous and categorical net reclassification index improved in the four-variable model compared with other models in the derivation and validation cohorts.

As the calibration curves show, the four-variable model was better calibrated than other models in the derivation cohort and was the same in the validation cohort (Supplementary Figure S4). Based on the predicted risk of 5-year post-HT death calculated through the four-variable model, 155 patients (51.8%) in the derivation cohort had less than 20%; 102 (34.1%) 20% to less than 40%; and 42 (14.0%) 40% or more risk of death (Supplementary Table S3). The K–M survival curve analysis demonstrated that participants in the group with a predicted risk of 5-year post-HT death less than 20% had better OS compared to that of 20% to less than 40% risk of postoperative death and 40% or more risk of death (P < 0.0001) (Supplementary Figure S3B). Then we presented the four-variable model as a nomogram (Figure 1A) and made it freely available online to help clinicians to calculate the risk of post-HT death (Figure 1B) (https://docqianofwuhanunionhospital.shinyapps.io/MortalityPredictionAfterHeartTransplantation/).

Figure 1

Figure 1. Nomogram of the four-variable model. (A) Nomogram was constructed based on the derivation cohort. The range of indicators in the nomogram was shown as follows: Age, 18–70 years old; NRI, 51.65–142.09; SCr, 36.1–531.5 µmol/L; TG, 0.25–4.79 mmol/L. (B) The dynamic nomogram is available online (https://docqianofwuhanunionhospital.shinyapps.io/MortalityPredictionAfterHeartTransplantation/).

4 Discussion

In this study, we first investigated the prediction efficiency of NRI on post-HT surgery death. The results showed that patients with higher NRI had lower OS post operation. Patients in the low NRI group had a higher prevalence of liver disease. As reported, malnutrition occurs in more than 50% of patients with chronic liver disease. Both adipose tissue and muscle tissue can be depleted; female patients more frequently develop a depletion in fat deposits while males more rapidly lose muscle tissue (21). Patients with low NRI had lower hemoglobin, fewer red blood cells, and higher blood urea nitrogen. The reason for that may be these patients had more severe primary disease, which would affect the nutritional status of the body.

Then, we developed a four-variable mortality prediction model using nutrition-related indicators. It can be used to estimate mortality risk 1-year and 5-year post-HT operation and is available online. This model included variables of age, NRI, SCr, and TG, which can be obtained readily in clinical practice, and showed the best performance for predicting postoperative death of HF patients in derivation and validation cohorts than reduced models based on age and NRI, or based on NRI alone. In clinical practice, it can be used easily to estimate individualized risk of death post HT operation. Death risk stratification according to this model could help guide prognostic assessment and medical care after admission.

As the results of the model discrimination and calibration showed, there was no deterioration in the validation cohort, which means the four-variable nutrition-associated mortality prediction model was not overfit. Generally speaking, a C statistic higher than 0.70 is a criterion to determine whether models are useful in clinical use (22). In this four-variable model, the C statistic was 0.72 (95% CI, 0.67–0.78) in the derivation cohort and 0.71 (95% CI, 0.62–0.81) in the validation cohort. Since both C statistics were higher than 0.70, this model was considered as having significance in clinical decision making. Compared to the reduced model and variable NRI alone, net reclassification improvement of the full model demonstrated that the four-variable nutrition-associated mortality prediction model could improve accuracy of predicting post-HT death and risk stratification of death.

Singh et al. reported a risk prediction model to predict in-hospital mortality post HT operation using six recipient variables in 2012 (23). The model was derived in HT participants in the United States and validated internally through bootstrapping method and externally in patients receiving HT from July 2009 to October 2010. The C statistics were 0.72 in the derivation cohort, 0.73 in the internal validation cohort, and 0.68 in the external validation cohort. In addition, Weiss et al. developed a risk score using 12 recipient variables in US recipients from 1997 to 2008. This score could be used to predict 1-year mortality post HT (C statistic, 0.65) (24). Both of these studies focused on early mortality after HT. The mortality risk prediction model using nutrition-related indicators in this study differs importantly by its focus on post-operation 5-year mortality and using a more recent China cohort (2015–2020). There is no other prediction model using Chinese HT data to our knowledge. Besides, the model in this study focused on the malnutrition effect on prognosis of patients who received HT. Hence, all the candidates and the ultimate variables of this model were nutrition-associated indexes.

The mortality prediction model developed in this study may have implications for clinical care and decision making. Obtaining individualized risk of death after HT may help inform decisions about pursuing a course of treatment. Clinicians could use this model to identify patients at high risk of postoperative death before HT surgery, which would help with targeted preventative therapy to reduce the mortality risk. Also, being able to identify patients at high risk of postoperative mortality before HT may allow for better planning of resource allocation. In clinical practice, it is quite challenging for clinicians to determine the therapy of HT, especially in complex HF patients, as there are alternative therapies like implantable ventricular assist devices (25, 26). The mortality risk prediction model may be useful in assessing whether patients could benefit from a transplant.

5 Limitations

This study has some limitations. First, several nutrition-associated variables like muscle mass, weight loss within 1 month, triceps' skinfold thickness, and so on were not included in this study since this was a retrospective study and such variables were not attainable in the HT database. Second, participants with retransplant were excluded from this study, so the prediction model may not be appropriate for those patients. Due to the complex condition and extra risk of retransplant patients, a more specific study should be performed for those patients. Finally, the model was developed using HT data from a single center in China and we did not perform external validation for this model, which may influence the efficacy of the model. This work should be verified in the future.

6 Conclusion

A multivariable prediction model using variables of age, NRI, SCr, and TG was developed in this study. It was able to predict mortality after HT operation and is available online for use. The utility of this prediction model in clinical practice requires further investigation.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding authors.

Ethics statement

The studies involving humans were approved by Ethics Committee of Tongji Medical College of Huazhong University of Science and Technology. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation was not required from the participants or the participants’ legal guardians/next of kin in accordance with the national legislation and institutional requirements.

Author contributions

SQ: Formal Analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing. BC: Data curation, Writing – original draft. PL: Investigation, Writing – review & editing. ND: Funding acquisition, Investigation, Writing – review & editing.

Funding

The authors declare financial support was received for the research, authorship, and/or publication of this article.

This study was supported by the National Natural Science Foundation of China (81930052).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcvm.2024.1346202/full#supplementary-material

References

1. GBD 2017 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the global burden of disease study 2017. Lancet. (2018) 392(10159):1789–858. doi: 10.1016/S0140-6736(18)32279-7

PubMed Abstract | Crossref Full Text | Google Scholar

2. Ma LY, Chen WW, Gao RL, Liu LS, Zhu ML, Wang YJ, et al. China Cardiovascular diseases report 2018: an updated summary. J Geriatr Cardiol. (2020) 17(1):1–8. doi: 10.11909/j.issn.1671-5411.2020.01.001

PubMed Abstract | Crossref Full Text | Google Scholar

3. Yusen RD, Edwards LB, Dipchand AI, Goldfarb SB, Kucheryavaya AY, Levvey BJ, et al. The registry of the international society for heart and lung transplantation: thirty-third adult lung and heart-lung transplant report-2016; focus theme: primary diagnostic indications for transplant. J Heart Lung Transplant. (2016) 35(10):1170–84. doi: 10.1016/j.healun.2016.09.001

PubMed Abstract | Crossref Full Text | Google Scholar

4. McDonagh TA, Metra M, Adamo M, Gardner RS, Baumbach A, Böhm M, et al. 2021 ESC guidelines for the diagnosis and treatment of acute and chronic heart failure. Eur Heart J. (2021) 42(36):3599–726. doi: 10.1093/eurheartj/ehab368

PubMed Abstract | Crossref Full Text | Google Scholar

5. Wang Z, Ma L, Liu M, Fan J, Hu S, Writing Committee of the Report on Cardiovascular Health and Diseases in China. Summary of the 2022 report on cardiovascular health and diseases in China. Chin Med J. (2023) 136(24):2899–908. doi: 10.1097/CM9.0000000000002927

PubMed Abstract | Crossref Full Text | Google Scholar

6. Manara A, Shemie SD, Large S, Healey A, Baker A, Badiwala M, et al. Maintaining the permanence principle for death during in situ normothermic regional perfusion for donation after circulatory death organ recovery: a United Kingdom and Canadian proposal. Am J Transplant. (2020) 20(8):2017–25. doi: 10.1111/ajt.15775

PubMed Abstract | Crossref Full Text | Google Scholar

7. Crespo-Leiro MG, Costanzo MR, Gustafsson F, Khush KK, Macdonald PS, Potena L, et al. Heart transplantation: focus on donor recovery strategies, left ventricular assist devices, and novel therapies. Eur Heart J. (2022) 43(23):2237–46. doi: 10.1093/eurheartj/ehac204

PubMed Abstract | Crossref Full Text | Google Scholar

8. Singhal AK, Abrams JD, Mohara J, Hasz RD, Nathan HM, Fisher CA, et al. Potential suitability for transplantation of hearts from human non-heart-beating donors: data review from the gift of life donor program. J Heart Lung Transplant. (2005) 24(10):1657–64. doi: 10.1016/j.healun.2004.11.043

PubMed Abstract | Crossref Full Text | Google Scholar

9. Taylor DO, Stehlik J, Edwards LB, Aurora P, Christie JD, Dobbels F, et al. Registry of the international society for heart and lung transplantation: twenty-sixth official adult heart transplant report-2009. J Heart Lung Transplant. (2009) 28(10):1007–22. doi: 10.1016/j.healun.2009.08.014

PubMed Abstract | Crossref Full Text | Google Scholar

10. Sze S, Pellicori P, Kazmi S, Rigby A, Cleland JGF, Wong K, et al. Prevalence and prognostic significance of malnutrition using 3 scoring systems among outpatients with heart failure: a comparison with body mass index. JACC Heart Fail. (2018) 6(6):476–86. doi: 10.1016/j.jchf.2018.02.018

PubMed Abstract | Crossref Full Text | Google Scholar

11. Grossniklaus DA, O'Brien MC, Clark PC, Dunbar SB. Nutrient intake in heart failure patients. J Cardiovasc Nurs. (2008) 23(4):357–63. doi: 10.1097/01.JCN.0000317433.52210.e0

PubMed Abstract | Crossref Full Text | Google Scholar

12. Yoshihisa A, Kanno Y, Watanabe S, Yokokawa T, Abe S, Miyata M, et al. Impact of nutritional indices on mortality in patients with heart failure. Open Heart. (2018) 5(1):e000730. doi: 10.1136/openhrt-2017-000730

PubMed Abstract | Crossref Full Text | Google Scholar

13. Adejumo OL, Koelling TM, Hummel SL. Nutritional risk index predicts mortality in hospitalized advanced heart failure patients. J Heart Lung Transplant. (2015) 34(11):1385–9. doi: 10.1016/j.healun.2015.05.027

PubMed Abstract | Crossref Full Text | Google Scholar

14. Krishnan A, Bigelow B, Hsu S, Gilotra NA, Sharma K, Choi CW, et al. Decreased nutritional risk index is associated with mortality after heart transplantation. Clin Transplant. (2021) 35(5):e14253. doi: 10.1111/ctr.14253

PubMed Abstract | Crossref Full Text | Google Scholar

15. Almutawa DA, Almuammar M, Elshafie MM, Aljuraiban GS, Alnafisah A, Abulmeaty MMA. Survival and nutritional status of male and female heart transplant patients based on the nutritional risk index. Nutrients. (2020) 12(12):3868. doi: 10.3390/nu12123868

PubMed Abstract | Crossref Full Text | Google Scholar

16. International Summit on Transplant Tourism and Organ Trafficking. The declaration of Istanbul on organ trafficking and transplant tourism. Clin J Am Soc Nephrol. (2008) 3(5):1227–31. doi: 10.2215/CJN.03320708

PubMed Abstract | Crossref Full Text | Google Scholar

17. Lee M, Lim JS, Kim Y, Lee JH, Kim CH, Lee SH, et al. Association between geriatric nutritional risk index and post-stroke cognitive outcomes. Nutrients. (2021) 13(6):1776. doi: 10.3390/nu13061776

PubMed Abstract | Crossref Full Text | Google Scholar

18. James MT, Pannu N, Hemmelgarn BR, Austin PC, Tan Z, McArthur E, et al. Derivation and external validation of prediction models for advanced chronic kidney disease following acute kidney injury. JAMA. (2017) 318(18):1787–97. doi: 10.1001/jama.2017.16326

PubMed Abstract | Crossref Full Text | Google Scholar

19. Liu Q, Charleston MA, Richards SA, Holland BR. Performance of akaike information criterion and Bayesian information criterion in selecting partition models and mixture models. Syst Biol. (2023) 72(1):92–105. doi: 10.1093/sysbio/syac081

PubMed Abstract | Crossref Full Text | Google Scholar

20. Cook NR, Ridker PM. Advances in measuring the effect of individual predictors of cardiovascular risk: the role of reclassification measures. Ann Intern Med. (2009) 150(11):795–802. doi: 10.7326/0003-4819-150-11-200906020-00007

PubMed Abstract | Crossref Full Text | Google Scholar

21. European Association for the Study of the Liver. Electronic address: easloffice@easloffice.eu, & European Association for the Study of the Liver. EASL clinical practice guidelines on nutrition in chronic liver disease. J Hepatol. (2019) 70(1):172–93. doi: 10.1016/j.jhep.2018.06.024

PubMed Abstract | Crossref Full Text | Google Scholar

22. Hosmer DW, Lemeshow S. Applied Logistic Regression. 2nd ed. New York, NY: John Wiley & Sons (2000).

23. Singh TP, Almond CS, Semigran MJ, Piercey G, Gauvreau K. Risk prediction for early in-hospital mortality following heart transplantation in the United States. Circ Heart Fail. (2012) 5(2):259–66. doi: 10.1161/CIRCHEARTFAILURE.111.965996

PubMed Abstract | Crossref Full Text | Google Scholar

24. Weiss ES, Allen JG, Arnaoutakis GJ, George TJ, Russell SD, Shah AS, et al. Creation of a quantitative recipient risk index for mortality prediction after cardiac transplantation (IMPACT). Ann Thorac Surg. (2011) 92:914–21. doi: 10.1016/j.athoracsur.2011.04.030

PubMed Abstract | Crossref Full Text | Google Scholar

25. Brown CR, Khurshan F, Chen Z, Groeneveld PW, McCarthy F, Acker M, et al. Optimal timing for heart transplantation in patients bridged with left ventricular assist devices: is timing of the essence? J Thorac Cardiovasc Surg. (2019) 157(6):2315–24.e4. doi: 10.1016/j.jtcvs.2018.12.118

PubMed Abstract | Crossref Full Text | Google Scholar

26. Macera F, Occhi L, Masciocco G, Varrenti M, Frigerio M. A new life: motherhood after heart transplantation. A single-center experience and review of literature. Transplantation. (2018) 102(9):1538–44. doi: 10.1097/TP.0000000000002281

PubMed Abstract | Crossref Full Text | Google Scholar