Performance of Sequential Organ Failure Assessment and Simplified Acute Physiology Score II for Post-Cardiac Surgery Patients in Intensive Care Unit

Introduction

Prognosis is a common challenge for patients after cardiac surgery. Although some progress has been achieved in the application of cardiac surgery procedures, the mortality rates after surgery remain high. Some scoring systems played an important role in the successful prediction of cardiac surgery-related mortality (1, 2). There was a preoperative risk stratification model, which had been widely accepted for mortality prediction of in-hospital mortality after cardiac surgery (3).

However, the scoring system focused on preoperative indicators without attention to intraoperative or postoperative conditions (4). The severity of surgical stress and inflammatory response to cardiopulmonary surgery could not be ignored (5) in cases that were associated with organ dysfunction and acute physiological changes. Previous studies reported that hyperlactatemia, bicarbonate, heart rate, and creatinine were essential for post-cardiac surgery patients as mortality-predictive variables (6–8). Recent studies had confirmed that the neutrophil/lymphocyte ratio of post 24 h after intensive care unit (ICU) admission is associated with postoperative mortality of cardiac surgery (9). Parameters and physiological indexes of post 24 h after ICU admission may provide a new way to improve prognosis early.

The Sequential Organ Failure Assessment (SOFA) score and Simplified Acute Physiology Score (SAPA II) were composed of organ function and biochemical indexes, which showed excellent predictive performance on many diseases in ICU (10, 11). There were few pieces of small sample literature that explored the role of SAPS II and SOFA scoring systems in predicting poor prognosis after cardiac surgery (12). The purpose of this study was to determine the critical values of the SAPS II and SOFA scoring system and to evaluate their performance in predicting the prognosis of patients undergoing cardiac surgery.

Materials and Methods

Sources of Data

All data in this study were retrospectively extracted from MIMIC-III (Medical Information Mart for Intensive Care-III) database (13, 14). This is a freely open database for the public, which includes more than 40,000 critically ill patients from Beth Israel Deaconess Medical Center (Boston, Massachusetts, United States) between 2001 and 2012. The application of the database was approved by the institutional review committee of Beth Israel Deaconess Medical Center and Beth Israel Deacons Medical Center (Approval Code 10323541). Patient-related information in the database was anonymous, and personal informed consent was abandoned in this study.

Data Collection and Definitions

The structure query language (SQL) with code in MIMIC Code Repository (https://github.com/MIT-LCP/Mimic-Website) was used for extracting data. The whole variables involved basic characteristics (age, gender, body mass index), comorbidities (drug abuse, alcohol abuse, coagulopathy, liver disease, hypertension, hypothyroidism, congestive heart failure, diabetes, chronic lung disease, chronic kidney disease), laboratory tests (sodium, potassium, white blood cell counts, hemoglobin, platelet, lactate, creatinine, blood urea nitrogen, prothrombin time, international normalized ratio, glucose), and vital signs (heart rate, respiratory rate, body temperature, pulse oxygen saturation, diastolic pressure, systolic pressure, and mean arterial pressure). The SOFA score and SAPS II score were evaluated within the first 24 h after ICU admission. Variables were reported as the average value within 24 h admitted to ICU.

Patients with cardiac surgery whose diagnose code ranged from 33,010 to 37,799 were identified using current procedural terminology. Inclusion criteria were patients aged between 18 and 89 years, choosing the first hospitalization for analysis when admitted to hospital or ICU multiple times. Patients hospitalized in ICU <24 h were excluded. The primary outcomes were in-hospital mortality, 28-day mortality, 90-day mortality, and 1-year mortality after cardiac surgery. The secondary outcomes were the length of hospital stay, ICU stay, and the incidence of acute kidney injury (AKI) within 7 days after ICU admission. The diagnosis of AKI referenced the improving global outcomes guideline (15).

Statistical Methods

Continuous variables of the study were non-normally distributed and reported as medians along with interquartile ranges (IQRs). Categorical variables were presented as numbers and percentages. Comparison of different groups was made using Kruskal–Wallis test or Mann–Whitney U-test for continuous variables, whereas chi-square or Fisher's exact tests were used for categorical variables. Non-adjusted models and adjusted models were established to investigate the association between scoring systems and outcomes in this study.

The cutoff values of SOFA and SAPS II scoring systems were obtained across receiver-operating characteristic (ROC) curve and Youden Indexes calculation. Based on different cutoff values, patients were divided into two groups. The clinical efficacy of scoring system models for poor outcomes was assessed by decision curve analysis (DCA), which was considered an appropriate method for estimating prognostic strategies (16). Kaplan–Meier curve was used to describe the difference in 1-year survival between different groups of the scoring system.

The SPSS software version 24.0 (IBM Corporation, Armonk, NY, United States) and the R software (version 4.0.3) were used for data processing, statistical analysis, and illustrations. Data missing 30% were removed and data missing <30% were processed by multiple imputations. Statistical differences were set at p < 0.05.

Results

Clinical Characteristics

A total of 6,122 patients admitted to ICU after cardiac surgery were enrolled retrospectively. The procedures and standards for data selection are shown in Figure 1. The clinical basic characteristics of the populations are shown in Table 1.

FIGURE 1

Figure 1. Flowchart of study cohort selection.

TABLE 1

Table 1. Baseline clinical characteristics between survivors and non-survivors at 1 year.

The AUC of SOFA and SAPS II scoring systems with 1-year postoperation mortality was 0.649 (p < 0.001) and 0.724 (p < 0.001), respectively (Figure 2). The cutoff value of the SOFA scoring system was 7, whereas the critical value of the SAPS II scoring system was 43. In the SOFA scoring system, the patients were divided into high SOFA group (H-SOFA group, SOFA ≥ 7, N = 2,114) and low SOFA group (L-SOFA group, SOFA < 7, N = 4,008). In the SAPS II scoring system, patients were divided into the high SAPS II group (H-SAPS II group, SAPS II ≥ 43, N = 2,262) and low SAPS II group (L-SAPS II group, SAPS II < 43, N = 3,860). Kaplan–Meier survival curves of scoring system groups were statistically different (log-rank p < 0.001, Figure 3).

FIGURE 2

Figure 2. The ROC curves for SOFA score and SAPS II score with 1-year postoperative mortality. ROC, receiver-operating characteristic.

FIGURE 3

Figure 3. Kaplan–Meier curves of 1-year mortality by scoring system groups. (A) For the SAPS II score, while (B) is for the SOFA score.

Correlation Between SOFA Scoring System and Postoperative Outcomes

General comparative data of population are reported in Table 2 and further explored in Table 3. Both short-term and long-term mortality rates were statistically significant in the comparison between SOFA scoring system groups. In-hospital mortality [odds ratio (OR) 2.86, 95% confidence interval (CI) 2.471, 3.312; p < 0.001], 28-day mortality (OR 2.897, 95% CI 2.528,3.323; p < 0.001), 90-day mortality (OR 2.817, 95% CI 2.475,3.208; p < 0.001), 1-year mortality (OR 2.479, 95% CI 2.195, 2.8; p < 0.001) all increased in the H-SOFA group compared with the L-SOFA group. In addition, length of in-hospital stay (OR 1.744, 95% CI 1.557, 1.954; p < 0.001) and ICU stay (OR 2.444, 95% CI 2.18, 2.743; p < 0.001) was extended in the H-SOFA group. However, there were no significant relationships in the incidence of acute renal failure (AKI) within 7 days after ICU admission (p < 0.05) between the two groups.

TABLE 2

Table 2. Basic characteristics of SOFA scoring system.

TABLE 3

Table 3. The logistics regression of SOFA scoring system.

Correlation Between SAPS II Scoring System and Postoperative Outcomes

The basic general data are summarized in Table 4 and deeply analyzed in Table 5. There were statistical differences between the groups of the SAPS II scoring system. The increased in-hospital mortality (OR 3.544, 95% CI 3.02, 4.164; p < 0.001), 28-day mortality (OR 3.92, 95% CI 3.376, 4.558; p < 0.001), 90-day mortality (OR 4.069, 95% CI 3.533, 4.693; p < 0.001) and 1-year mortality (OR 4.272, 95% CI 3.744, 4.879; p < 0.001) were obvious in the H-SAPS II group. The length of in-hospital stay (OR 2.912, 95% CI 2.581, 3.287; p < 0.001) and ICU stay (OR 2.997, 95% CI 2.651, 3.392; p < 0.001) was longer in the H-SAPS II group than the L-SAPS II group. The incidence of AKI within 7 days admitted to ICU was statistically significant (OR 1.464, 95% CI 1.258, 1.706; p < 0.001) in comparison.

TABLE 4

Table 4. Basic characteristics of SAPS II scoring system.

TABLE 5

Table 5. The logistics regression of SAPSII scoring system.

Comparison of Decision Curves

As exhibited in Figure 4, the DCA curve of the SAPS II scoring system was higher than that of the SOFA scoring system in predicting 1-year mortality and 90-day mortality. Otherwise, the net benefit was not different between the two scoring systems in in-hospital mortality and 28-day mortality. This suggests that the SAPS-II scoring system is more meaningful than SOFA in assessing long-term mortality.

FIGURE 4

Figure 4. Decision curve analysis (DCA) of the two scoring systems. (A) In-hospital mortality, (B) 28-day mortality, (C) 90-day mortality, and (D) 1-year mortality.

Discussion

This retrospective study demonstrated that a score of 7 in the SOFA scoring system and a score of 43 in the SAPS II scoring system with the first 24 h after ICU admission were warning values for predicting the risk of outcomes. Exceeding the warning values of the SOFA score and SAPS II score was associated with elevated mortality, prolonged ICU interval, and hospital interval. Besides, the incidence of AKI was increased in the SAPS II scoring system but not in the SOFA scoring system.

After cardiac surgery, patients have the risk of organ dysfunction or even deterioration, which predicted a poorer prognosis. The aim of the SOFA score was to objectively and quantitatively evaluate the severity of six organ systems dysfunction over time. It consisted of respiratory, circulatory, renal, hematology, hepatic, and central nervous systems, which are related to the recovery of patients with cardiac surgery (17). Although its main role is to predict organ dysfunction, the association between quantification of SOFA score and survival was inevitable (18). A previous systematic review showed that the SOFA model based on 24 h after ICU admission could be used to predict mortality (19). Other types of patients were also effectively evaluated by SOFA score, including post-cardiac arrest syndrome (20), people requiring extracorporeal cardiopulmonary resuscitation (21), critically ill cirrhotic patients with acute decompensation (22), patients with acute respiratory failure in intensive care unit (23), contemporary cardiac intensive care unit population (24), critically ill elderly patients with acute infective endocarditis (25), extracorporeal membrane oxygenation (ECMO)-treated acute myocardial infarction (AMI) patients (26)—some of above studies behaved even well. In the cardiac surgery population, the previous literature stated that SOFA score had good discriminative power for hospital mortality (27); the same observation was also confirmed in Ceriani et al.'s research (28). Doerr et al.'s study had found that SOFA score could predict 30-day mortality (29). In our study, we used a larger sample size to test the predictive effect of SOFA scores on short-term and long-term mortality. Results are remarkable on the performance of SOFA score as previous studies, especially above the cutoff value. The warning value of the SOFA scoring system is able to assess the risk of outcomes as a new valuable observation index in post-cardiac patients.

The SAPS II scoring system consisted of physiological variables, basic characteristics, and several complications, which could provide an estimate of the risk of death on the basis of large samples with the independence of primary diagnosis, and also was developed for the evaluation of the efficiency of ICUs (30). Recent research established that the SAPS II score could predict the prognosis and in-hospital mortality in AMI patients treated with ECMO with a good performance (26). But it could not ser good predictor for discharged mortality in small sample size studies (31). The result of the previous study of more than 2,000 patients after cardiac surgery showed that the SAPS II score had good discrimination in-hospital mortality (27). The same role was confirmed in another post-cardiac surgery population (32). These researches were consistent with part of our findings. Moreover, previous literature had claimed that the SAPS II scoring system could be implemented reliably while mortality was closely related to the rater's scoring practice (33). This can be interpreted as the diversities of results. Although overestimates of mortality were reported by some researchers (34–37), the objective of our study was for early warning based on the threshold of the SAPS II scoring system.

Decision curve analysis is a method widely used to evaluate the clinical utility of specific models (38). The curve with the highest benefit score at a given threshold was determined to be the best choice (16). A recent study involving multiple scoring systems confirmed the superiority of the SAPS II scoring system in predicting mortality through DCA among sepsis patients (39). Besides, Abraham Schoe et al.'s research including more than 3,600 post-cardiac surgery patients has demonstrated that SOFA score and SAPS II score could predict hospital mortality, while SAPS II was better (32). This tendency is similar to our finding: The SAPS II scoring system had more net benefits on assessing the long-term mortality compared with the SOFA scoring system. As a comprehensive scoring system for postoperative multiple organ physiological function during post-cardiac surgery patients, the SAPS II scoring system may perform better in clinical application.

As for the complexity of progressing in disease, it is hard to find a perfect score of predicting risk comprehensively. The strength of this study lies in identifying warning values of the SOFA score and SAPS II score and giving new insight into the reference value of the SOFA and SAPS II scoring system. Moreover, it enriched the methods of early detecting the prognosis in patients with cardiac surgery and might be used as decision support for clinical intervention. The scoring system was tested in the discrimination of long-term mortality in a large sample of patients with cardiac surgery. However, it was a retrospective observational study which raised possible bias caused by heterogeneous factors. This study focuses on the whole group after cardiac surgery, but we believe that the changes in organ function after different cardiac surgery can also be reflected through the scoring system. Of course, it is also a perfect direction to further explore the differences in the scoring system in different types of cardiac surgery. Moreover, the collected data were from over 10 years ago, these conclusions may not be feasible nowadays with the improvement of surgical technology and ICU treatment level. In this large sample retrospective analysis, the short-term results are consistent with existing studies. There are still few longer-term results. These results can provide clinicians with a warning SOFA and SAPS II value, but the specific implementation should be treated with caution. More retrospective and prospective clinical studies are necessary for verification in the future.

Conclusion

This study suggested that exceeding the cutoff values of the SOFA score and SAPS II score could lead to increased mortality, prolonged length of ICU stay, and in-hospital stay. Score 7 in the SOFA scoring system and score 43 in the SAPS II scoring system with the first 24 h after ICU admission were warning values for worse outcomes. The SAPS II scoring system had a better discriminative performance of 90-day mortality and 1-year mortality in post-cardiac surgery patients than the SOFA scoring system. Focusing on the critical value of the scoring system is of significance for treatment in ICU.

Data Availability Statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession numbers can be found below: https://mimic.mit.edu/docs/iii/tables/.

Ethics Statement

Access to the database was reviewed and approved by the Institutional Review Committee of Beth Israel Deaconess Medical Center and Beth Israel deacons Medical Center (Approval Code 10323541). Written informed consent was not required for this study, in accordance with the local legislation and institutional requirements.

Author Contributions

FX gathered and processed the data. FX, WL, and CZ prepared the results. FX, WL, and CZ contributed to writing the manuscript. FX and RC put forward the idea. RC revised the manuscript. All the authors read and approved the final manuscript.

Funding

This project is supported by the Sichuan Science and Technology Program, China (Grant No. 2019YFS0352).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Geissler HJ, Holzl P, Marohl S, Kuhn-Regnier F, Mehlhorn U, Sudkamp M, et al. Risk stratification in heart surgery: comparison of six score systems. Eur J Cardiothorac Surg. (2000) 17:400–6. doi: 10.1016/s1010-7940(00)00385-7

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg. (1999) 16:9–13. doi: 10.1016/s1010-7940(99)00134-7

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Kunt AG, Kurtcephe M, Hidiroglu M, Cetin L, Kucuker A, Bakuy V, et al. Comparison of original EuroSCORE, EuroSCORE II and STS risk models in a Turkish cardiac surgical cohort. Interact Cardiovasc Thorac Surg. (2013) 16:625–9. doi: 10.1093/icvts/ivt022

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Yalcin M, Godekmerdan E, Tayfur K, Yazman S, Urkmez M, Ata Y. The APACHE II score as a predictor of mortality after open heart surgery. Turk J Anaesthesiol Reanim. (2019) 47:41–7. doi: 10.5152/TJAR.2018.44365

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Tu LN, Hsieh L, Kajimoto M, Charette K, Kibiryeva N, Forero A, et al. Shear stress associated with cardiopulmonary bypass induces expression of inflammatory cytokines and necroptosis in monocytes. JCI Insight. (2021) 6:e141341. doi: 10.1172/jci.insight.141341

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Meregalli A, Oliveira RP, Friedman G. Occult hypoperfusion is associated with increased mortality in hemodynamically stable, high-risk, surgical patients. Crit Care. (2004) 8:R60–5. doi: 10.1186/cc2423

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Ranucci M, De Toffol B, Isgro G, Romitti F, Conti D, Vicentini M. Hyperlactatemia during cardiopulmonary bypass: determinants and impact on postoperative outcome. Crit Care. (2006) 10:R167. doi: 10.1186/cc5113

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Ranucci M, Ballotta A, Castelvecchio S, Baryshnikova E, Brozzi S, Boncilli A, et al. Intensive care unit admission parameters improve the accuracy of operative mortality predictive models in cardiac surgery. PLoS ONE. (2010) 5:e13551. doi: 10.1371/journal.pone.0013551

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Wang Q, Li J, Wang X. The neutrophil-lymphocyte ratio is associated with postoperative mortality of cardiac surgery. J Thorac Dis. (2021) 13:67–75. doi: 10.21037/jtd-20-2593

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Matsuda J, Kato S, Yano H, Nitta G, Kono T, Ikenouchi T, et al. The Sequential Organ Failure Assessment (SOFA) score predicts mortality and neurological outcome in patients with post-cardiac arrest syndrome. J Cardiol. (2020) 76:295–302. doi: 10.1016/j.jjcc.2020.03.007

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Aytuluk HG, Basaran S, Dogan NO, Demir N. Comparison of conventional intensive care scoring systems and prognostic scores specific for intracerebral hemorrhage in predicting one-year mortality. Neurocrit Care. (2021) 34:92–101. doi: 10.1007/s12028-020-00987-3

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Martinez-Alario J, Tuesta ID, Plasencia E, Santana M, Mora ML. Mortality prediction in cardiac surgery patients: comparative performance of Parsonnet and general severity systems. Circulation. (1999) 99:2378–82. doi: 10.1161/01.cir.99.18.2378

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Goldberger AL, Amaral LA, Glass L, Hausdorff JM, Ivanov PC, Mark RG, et al. PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation. (2000) 101:E215–20. doi: 10.1161/01.cir.101.23.e215

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Johnson AE, Pollard TJ, Shen L, Lehman LW, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data. (2016) 3:160035. doi: 10.1038/sdata.2016.35

PubMed Abstract | CrossRef Full Text

15. Stevens PE, Levin A Kidney Disease: Improving Global Outcomes Chronic Kidney Disease Guideline Development Work Group M. Evaluation and management of chronic kidney disease: synopsis of the kidney disease: improving global outcomes 2012 clinical practice guideline. Ann Intern Med. (2013) 158:825–30. doi: 10.7326/0003-4819-158-11-201306040-00007

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. (2006) 26:565–74. doi: 10.1177/0272989X06295361

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Moreno R, Vincent JL, Matos R, Mendonca A, Cantraine F, Thijs L, et al. The use of maximum SOFA score to quantify organ dysfunction/failure in intensive care. Results of a prospective, multicentre study Working Group on Sepsis related Problems of the ESICM. Intensive Care Med. (1999) 25:686–96. doi: 10.1007/s001340050931

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Arts DG, de Keizer NF, Vroom MB, de Jonge E. Reliability and accuracy of Sequential Organ Failure Assessment (SOFA) scoring. Crit Care Med. (2005) 33:1988–93. doi: 10.1097/01.ccm.0000178178.02574.ab

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Minne L, Abu-Hanna A, de Jonge E. Evaluation of SOFA-based models for predicting mortality in the ICU: A systematic review. Crit Care. (2008) 12:R161. doi: 10.1186/cc7160

PubMed Abstract | CrossRef Full Text

20. Cour M, Bresson D, Hernu R, Argaud L, SOFA. score to assess the severity of the post-cardiac arrest syndrome. Resuscitation. (2016) 102:110–5. doi: 10.1016/j.resuscitation.2016.03.001

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Bisbal M, Jouve E, Papazian L, de Bourmont S, Perrin G, Eon B, et al. Effectiveness of SAPS III to predict hospital mortality for post-cardiac arrest patients. Resuscitation. (2014) 85:939–44. doi: 10.1016/j.resuscitation.2014.03.302

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Costa ESPP, Codes L, Rios FF, Esteve CP, Valverde Filho MT, Lima DOC, et al. Comparison of general and liver-specific prognostic scores in their ability to predict mortality in cirrhotic patients admitted to the intensive care unit. Can J Gastroenterol Hepatol. (2021) 2021:9953106. doi: 10.1155/2021/9953106

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Huang WC, Xie HJ, Fan HT, Yan MH, Hong YC. Comparison of prognosis predictive value of 4 disease severity scoring systems in patients with acute respiratory failure in intensive care unit: a STROBE report. Medicine. (2021) 100:e27380. doi: 10.1097/MD.0000000000027380

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Jentzer JC, Bennett C, Wiley BM, Murphree DH, Keegan MT, Gajic O, et al. Predictive value of the sequential organ failure assessment score for mortality in a contemporary cardiac intensive care unit population. J Am Heart Assoc. (2018) 7:8169. doi: 10.1161/JAHA.117.008169

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Lin Y, Liu F, Gong S, Liao B, Liu H, Yuan J, et al. Validity of SOFA score as a prognostic tool for critically ill elderly patients with acute infective endocarditis. Rev Cardiovasc Med. (2021) 22:967–73. doi: 10.31083/j.rcm2203105

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Kim HS, Park KH, Ha SO, Lee SH, Choi HM, Kim SA, et al. Predictors of survival following veno-arterial extracorporeal membrane oxygenation in patients with acute myocardial infarction-related refractory cardiogenic shock: clinical and coronary angiographic factors. J Thorac Dis. (2020) 12:2507–16. doi: 10.21037/jtd.2020.03.51

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Doerr F, Badreldin AM, Heldwein MB, Bossert T, Richter M, Lehmann T, et al. A comparative study of four intensive care outcome prediction models in cardiac surgery patients. J Cardiothorac Surg. (2011) 6:21. doi: 10.1186/1749-8090-6-21

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Ceriani R, Mazzoni M, Bortone F, Gandini S, Solinas C, Susini G, et al. Application of the sequential organ failure assessment score to cardiac surgical patients. Chest. (2003) 123:1229–39. doi: 10.1378/chest.123.4.1229

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Patila T, Kukkonen S, Vento A, Pettila V, Suojaranta-Ylinen R. Relation of the Sequential Organ Failure Assessment score to morbidity and mortality after cardiac surgery. Ann Thorac Surg. (2006) 82:2072–8. doi: 10.1016/j.athoracsur.2006.06.025

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Le Gall JR, Lemeshow S, Saulnier F. A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA. (1993) 270:2957–63. doi: 10.1001/jama.270.24.2957

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Czajka S, Ziebinska K, Marczenko K, Posmyk B, Szczepanska AJ, Krzych LJ. Validation of APACHE II, APACHE III and SAPS II scores in in-hospital and one year mortality prediction in a mixed intensive care unit in Poland: a cohort study. BMC Anesthesiol. (2020) 20:296. doi: 10.1186/s12871-020-01203-7

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Schoe A, Bakhshi-Raiez F, de Keizer N, van Dissel JT, de Jonge E. Mortality prediction by SOFA score in ICU-patients after cardiac surgery; comparison with traditional prognostic-models. BMC Anesthesiol. (2020) 20:65. doi: 10.1186/s12871-020-00975-2

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Strand K, Strand LI, Flaatten H. The interrater reliability of SAPS II and SAPS 3. Intensive Care Med. (2010) 36:850–3. doi: 10.1007/s00134-010-1772-1

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Capuzzo M, Scaramuzza A, Vaccarini B, Gilli G, Zannoli S, Farabegoli L, et al. Validation of SAPS 3 Admission Score and comparison with SAPS II. Acta Anaesthesiol Scand. (2009) 53:589–94. doi: 10.1111/j.1399-6576.2009.01929.x

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Desa K, Peric M, Husedzinovic I, Sustic A, Korusic A, Karadza V, et al. Prognostic performance of the Simplified Acute Physiology Score II in major Croatian hospitals: a prospective multicenter study. Croat Med J. (2012) 53:442–9. doi: 10.3325/cmj.2012.53.442

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Haaland OA, Lindemark F, Flaatten H, Kvale R, Johansson KA, A. calibration study of SAPS II with Norwegian intensive care registry data. Acta Anaesthesiol Scand. (2014) 58:701–8. doi: 10.1111/aas.12327

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Nassar AP, Malbouisson LM, Moreno R. Evaluation of Simplified Acute Physiology Score 3 performance: a systematic review of external validation studies. Crit Care. (2014) 18:R117. doi: 10.1186/cc13911

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Fitzgerald M, Saville BR, Lewis RJ. Decision curve analysis. JAMA. (2015) 313:409–10. doi: 10.1001/jama.2015.37

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Hu T, Lv H, Jiang Y. The association between four scoring systems and 30-day mortality among intensive care patients with sepsis: a cohort study. Sci Rep. (2021) 11:11214. doi: 10.1038/s41598-021-90806-2

PubMed Abstract | CrossRef Full Text | Google Scholar