ORIGINAL RESEARCH article

Front. Oncol., 10 July 2019

Sec. Surgical Oncology

Volume 9 - 2019 | https://doi.org/10.3389/fonc.2019.00584

A Simple-to-Use Nomogram for Predicting the Survival of Early Hepatocellular Carcinoma Patients

  • SC

    Si-Hai Chen 1

  • QW

    Qin-Si Wan 1

  • DZ

    Di Zhou 2

  • TW

    Ting Wang 1

  • JH

    Jia Hu 1

  • YH

    Yu-Ting He 1

  • HY

    Hai-Liang Yuan 1

  • YW

    Yu-Qi Wang 1

  • KZ

    Kun-He Zhang 1*

  • 1. Department of Gastroenterology, The First Affiliated Hospital of Nanchang University, Jiangxi Institute of Gastroenterology and Hepatology, Nanchang, China

  • 2. Department of Occupational and Environmental Health Sciences, School of Public Health, Peking University, Beijing, China

Abstract

Objective: This study aimed to develop and validate a simple-to-use nomogram for early hepatocellular carcinoma (HCC) patients undergoing a preoperative consultation and doctors conducting a postoperative evaluation.

Methods: A total of 2,225 HCC patients confirmed with stage I or II were selected from the Surveillance, Epidemiology, and End Results database between January 2010 and December 2015. The patients were randomly divided into two groups: a training group (n = 1,557) and a validation group (n = 668). Univariate and multivariate hazards regression analyses were used to identify independent prognostic factors. The Akaike information criterion (AIC) was used to select variables for the nomogram. The performance of the nomogram was validated concerning its ability of discrimination and calibration and its clinical utility.

Results: Age, alpha-fetoprotein (AFP), race, the degree of differentiation, and therapy method were significantly associated with the prognosis of early HCC patients. Based on the AIC results, five variables (age, race, AFP, degree of differentiation, and therapy method) were incorporated into the nomogram. The concordance indexes of the simple nomogram in the training and validation groups were 0.707 (95% CI: 0.683–0.731) and 0.733 (95% CI: 0.699–0.767), respectively. The areas under the receiver operating characteristic (ROC) curve of the nomogram in the training and validation groups were 0.744 and 0.764, respectively, for predicting 3-year survival, and 0.786 and 0.794, respectively, for predicting 5-year survival. Calibration plots showed good consistency between the predictions of the nomogram and the actual observations in both the training and validation groups. Decision curve analysis (DCA) showed that the simple nomogram was clinically useful, and the overall survival significantly differed between low- and high-risk groups divided by the median score of the nomogram in the training group (P < 0.001).

Conclusion: A simple-to-use nomogram based on a large population-based study is developed and validated, which is a conventional tool for doctors to facilitate the individual consultation of preoperative patients and the postoperative personalized evaluation.

Introduction

Hepatocellular carcinoma (HCC), accounting for 75–85% of primary hepatic carcinoma (PHC), is the fourth leading cause of cancer death globally in 2018 (1). The prognosis of HCC is associated with the stage of tumor (2). Although early HCC treated with surgical resection has an ~70% of 5-year survival rate (3), the remaining 30% of early HCC patients still have a poor outcome. Therefore, careful evaluation of the prognosis is still needed for early HCC.

Accurate prognostic evaluation is an important step in the management of patients with HCC. The TNM staging system (American Joint Committee on Cancer, AJCC), which was first published in 1977 and is widely used in the clinic, has been updated to the eighth edition (4). However, the TNM staging system did not perform well in HCC prognosis (5). It was found that there was no significant difference in overall survival between stage I and stage II based on the TNM staging system (6), which indicated that this staging system could not predict the personalized prognosis of early HCC. An easy-to-use and personalized scoring system is still needed to predict the prognosis of early HCC.

Recently, the nomogram, a simple and personalized visual tool, has been widely used in the diagnosis and prognosis of diseases (7, 8). Behind the nomogram is a complicated computational formula that can simply determine the definite survival probability. Some scoring systems of the nomogram have demonstrated better performance in predicting prognosis (911).

The Surveillance, Epidemiology, and End Results (SEER) program based on the U.S. population provides an abundance of high-quality information for different cancers. Several studies on the prognosis of cancer are based on the SEER database (12, 13). In the present study, information on early HCC was extracted from the SEER database to establish a nomogram that is intuitive and easy to use for predicting the prognosis of early HCC.

Patients and Methods

Patients

A total of 114,872 patients with liver cancer between 1973 and 2015 were retrospectively extracted from the SEER database. Fifteen variables were selected in this study, including age, sex, race, year of diagnosis, histological type based on the third revision of the International Classification of Diseases for Oncology (ICD-O-3) (14), degree of differentiation, TNM stage (including explicit T, N, and M stage), alpha-fetoprotein (AFP), fibrosis score, therapy method, months of survival, and vital status. Then, early HCC patients from 2010 and 2015 were selected. We selected 20,814 patients with a TNM stage limited to stage I and II who had a confirmed histological type (ICD-O-3 code: 8170, 8171, 8172, 8173, 8174, or 8175). After excluding patients with an unknown race, degree of differentiation, AFP, and fibrosis score, a total of 2,225 early HCC patients were eventually selected for this study. There were 356 patients who received radiofrequency ablation (RFA) out of a total of 397 patients with local tumor treatment. The remaining 41 patients received other treatments including local tumor destruction by ultrasound or acetic acid (14 patients), cryosurgery (7 patients), percutaneous ethanol injection (6 patients), laser (2 patients), electrocautery (1 patient), and unknown local therapy (10 patients) (see Supplementary Table 1 and Supplementary Figure 2). Those 2,225 patients were randomly divided into a training group (n = 1557) used to develop the nomogram and a validation group (n = 668) used to validate the nomogram. A flow diagram demonstrating the detailed screening process is shown in Figure 1.

Figure 1

Statistical Analysis

Univariable Cox regression analysis was performed to explore the potential confounders. Subsequently, variables with the P value below 0.5 in univariate analysis were selected into multivariable Cox regression to identify the independent predictors (15). The backward step-down process based on the Akaike information criterion (AIC) was used to select the final variables for constructing the nomogram (16, 17). The concordance index (C-index) and receiver operating characteristic (ROC) curve were used to evaluate the discrimination ability of the nomogram. The C-index is defined as the proportion of all evaluable and orderly patient pairs whose predictions are consistent with the results (18). Calibration curves were plotted to assess the calibration ability of the nomogram. Decision curve analysis (DCA) was performed to show the clinical usefulness of the nomogram (19, 20). Kaplan–Meier curves were constructed to analyze the difference in overall survival between the high- and low-risk groups based on the median score of patients in the training group according to the nomogram.

Student's t-test and the chi-square test were used to compare the differences between the training and validation groups for the continuous and categorical variables, respectively. SPSS software (IBM Corporation, USA, version 24) was used for the randomization of groups and univariate and multivariate Cox proportional hazards regression analyses. The cutoff value for age was determined by the X-tile program (21). The R statistical packages “rms,” “survival,” “foreign,” and “survivalROC” were used to calculate the C-index and plot the calibration curves, the ROC curves, and Kaplan–Meier curves. The source file “stdca.r” was obtained from the website www.mskcc.org, which was used to draw the DCA curves. Two-sided P value < 0.05 was considered statistically significant.

Results

Demographic and Clinical Characteristics

The demographics and clinical characteristics of the whole, training, and validation groups are shown in Table 1. In the whole group, nearly 76% of patients were male, and ~67% of patients were white. Most patients had an early AJCC stage (stage I), a high fibrosis score, and a positive AFP. Moderately differentiated tumors accounted for more than half of all cases. Across the entire study population, more than 53% of patients underwent surgery. There was no significant difference between the two groups in demographics and clinical characteristics.

Table 1

All patients
(n = 2,225)
Training group
(n = 1,557)
Validation group
(n = 668)
P value
Age (mean ± SD), years62.70 ± 9.9762.72 ± 9.9762.66 ± 9.960.907a
Sex, n(%)
    Male1,676 (75.3)1,161 (74.6)515 (77.1)0.205b
    Female549 (24.7)396 (25.4)153 (22.9)
Race, n(%)
    Black283 (12.7)197 (12.7)86 (12.9)0.988b
    White1,480 (66.5)1,036 (66.5)444 (66.5)
    Other*462 (20.8)324 (20.8)138 (20.7)
AJCC stage, n(%)
    I1,380 (62.0)965 (62.0)415 (62.1)0.948b
    II845 (38.0)592 (38.0)253 (37.9)
NAll are N0
MAll are M0
AFP, n(%)
    Negative855 (38.4)603 (38.7)252 (37.7)0.655b
    Positive1,370 (61.6)954 (61.3)416 (62.3)
Histological differentiation, n(%)
    I744 (33.4)524 (33.7)220 (32.9)0.896b
    II1,142 (51.3)799 (51.3)343 (51.3)
    III and IV339 (15.2)234 (15.0)105 (15.7)
Fibrosis score, n(%)
    0–4618 (27.8)432 (27.7)186 (27.8)0.962b
    5–61,607 (72.2)1,125 (72.3)482 (72.2)
Primary tumor therapy, n(%)
    Surgery1,197 (53.8)832 (53.4)365 (54.6)
    Local therapy397 (17.8)287 (18.4)110 (16.5)
    Non-surgery631 (28.4)438 (28.1)193 (28.9)

Demographics and clinical characteristics of eligible patients with early HCC.

*

Other comprises American Indian/Alaska Native, and Asian/Pacific Islander.

a

t-test, comparison between the training group and the validation group.

b

Chi-square test, comparison between the training group and the validation group.

AFP, alpha fetoprotein; AJCC, American Joint Committee on Cancer; HCC, hepatocellular carcinoma; SD, standard deviation.

Prognostic Factors in Patients With Early HCC

In univariate regression analysis, seven variables, i.e., age, race, AJCC stage, AFP level, histological differentiation, fibrosis score, and therapy method, were significantly associated with the overall survival. In multivariate Cox regression analysis, five variables, i.e., age, race, AFP level, histological differentiation, and therapy method, were identified as independent prognostic factors of early HCC (Table 2).

Table 2

VariableUnivariate analysisMultivariate analysis
HR (95% CI)P valueHR (95% CI)P value
Age1.023
(1.015–1.031)
< 0.0011.018
(1.010–1.026)
< 0.001
Race
    Other*ReferenceReference
    Black1.584
(1.228–2.044)
< 0.0011.368
(1.055–1.773)
0.018
    White1.384
(1.139–1.683)
0.0011.259
(1.033–1.535)
0.022
Sex
    MaleReferenceReference
    Female0.933
(0.789–1.104)
0.4210.888
(0.749–1.054)
0.175
AJCC stage
    IReferenceReference
    II1.227
(1.064–1.414)
0.0051.154
(0.998–1.334)
0.054
AFP
    NegativeReferenceReference
    Positive1.424
(1.223–1.657)
< 0.0011.270
(1.082–1.491)
0.003
Histological grade
    IReferenceReference
    II1.071
(0.910–1.259)
0.4101.362
(1.152–1.610)
< 0.001
    III and IV1.644
(1.342–2.015)
< 0.0012.032
(1.647–2.507)
< 0.001
Fibrosis score
    0–4ReferenceReference
    5–61.453
(1.225–1.722)
< 0.0011.068
(0.895–1.276)
0.465
Primary tumor therapy
    ResectionReferenceReference
    Local therapy2.099
(1.717–2.567)
< 0.0012.116
(1.722–2.601)
< 0.001
    Non-surgery4.358
(3.706–5.125)
< 0.0014.304
(3.628–5.106)
< 0.001

Univariate and multivariate Cox regression analyses of prognostic factors in patients with early HCC.

*

Other comprises American Indian/Alaska Native, and Asian/Pacific Islander.

AFP, alpha fetoprotein; AJCC, American Joint Committee on Cancer; HCC, hepatocellular carcinoma.

Construction and Validation of the Prognostic Prediction Nomogram

Based on the AIC results, race, age, AFP, histological differentiation, and therapy method were identified as variables that were incorporated into the nomogram (Figure 2), which is an intuitive visualization of the model. According to the nomogram, therapy method had the greatest influence on the prognosis of early HCC, followed by histological differentiation, age, race, and AFP. Users could determine the total score based on the individual scores of those five variables and obtain a specific probability of 3- and 5-year survival. The detailed scores of all variables are shown in Table 3.

Figure 2

Table 3

VariableNomogram score
Age (years)
    ≤650
    66–7417
    ≤7529
Race
    Other*0
    White17
    Black25
AFP
    Negative0
    Positive11
Differentiation
    I0
    II26
    III and IV48
Therapy method
    Surgery0
    Local therapy51
    No surgery of primary site100

Detailed scores of all variables in the nomogram.

*

Other comprises American Indian/Alaska Native and Asian/Pacific Islander.

AFP, alpha fetoprotein.

The discrimination power of the nomogram was evaluated by the C-index values and ROC curves. The C-indexes for the prediction of overall survival in the training and validation groups were 0.707 (95% CI: 0.683–0.731) and 0.733 (95% CI: 0.699–0.767), respectively. However, the C-indexes of the TNM staging system in the training and validation groups were 0.511 (95% CI: 0.488–0.534) and 0.546 (95% CI: 0.511–0.581). The areas under ROC curve (AUROCs) of the 3-year survival probability in the training and validation groups were 0.744 and 0.764, respectively (Figures 3A,B). The AUROCs of the 5-year survival probability in the training and validation groups were 0.786 and 0.794, respectively (Figures 3C,D). AUROCs of TNM stages were 0.529 and 0.554, respectively, for predicting 3-year survival probability in the training and validation groups (Figures 4A,B), and 0.519 and 0.583, respectively, for predicting 5-year survival probability in the training and validation groups (Figures 4C,D). The calibration curves of the nomogram showed good probability consistencies between the prediction and observation (Figure 5).

Figure 3

Figure 4

Figure 5

Clinical Value of the Nomogram

DCA is a novel method for evaluating alternative prognostic strategies, which has advantages over AUROC (19, 20). The 3- and 5-year DCA curves for the nomogram and the AJCC stage in both the training and validation groups are presented in Figure 6. Compared with the AJCC stage, the nomogram had higher net benefits, which indicated that it had better clinical utility. We divided the early HCC patients into two different risk groups based on the median score of the nomogram, 76 points, in the training group, and the high-risk group had a lower survival probability in both the training and validation groups (Figures 7A,B). There was no difference between patients with TNM stage I and II in the training group, but patients with TNM stage I had higher survival rate than stage II in the validation group (Figures 7C,D).

Figure 6

Figure 7

Discussion

In this study, we first established a nomogram to evaluate the definite 3- and 5-year survival probabilities of early HCC patients based on a population-based database and verified the ability of the nomogram regarding its discrimination and calibration in both training and validation groups. The performance of the nomogram in the validation group was better than that in the training group, which indicated that the nomogram might have a better external utility. In the perspective of clinical utility, the nomogram had a wide range of threshold probabilities. Additionally, our results also showed that the TNM staging system could not accurately reflect the exact survival probability in early HCC, which was consistent with the findings of other studies (6). Moreover, the nomogram divided the patients with early HCC into two groups, the low- and high-risk groups, which had significant difference in overall survival. These results indicate that the nomogram could be used as a conventional tool in predicting the prognosis of early HCC.

In the present study, age was an independent prognostic factor of early HCC. A patient with younger age showed an increased overall survival. Other studies on the prognosis of early HCC also found that patients with a younger age had a better prognosis, even in the elderly (22, 23).

Race is a controversial prognostic factor. An early study found that there was no significant difference of survival time between black and white patients (24). A study based on SEER database showed that blacks had the highest 1- and 3-year mortality rates, followed by Hispanics, whites, and Asians (25). Our study also found that blacks had a higher mortality rate than whites, while the “other” race, including 425 Asians or Pacific Islanders and 37 American Indians/Alaska Natives, had the lowest mortality. In addition, we found that there was no difference of survival time between 425 Asians or Pacific Islanders and 37 American Indians/Alaska Natives (see Supplementary Figure 1).

The degree of differentiation is a critical characteristic of carcinoma. Nathan et al. (26) selected 788 patients with early HCC and found that tumor histologic grade was not an independent prognostic factor in early HCC, but patients with poor differentiation had a worse survival than patients with a high degree of differentiation. However, this study did not exclude the degree of unknown differentiation. Another study established a survival prediction model for patients with postoperative HCC and identified that the degree of differentiation was an independent predictor for the 5-year survival rate of HCC patients (27). Some studies also found that poor differentiation was associated with HCC recurrence after curative hepatectomy and liver transplantation (28, 29). In our study, the patients with unknown degree of differentiation were excluded, and the results showed that a worse degree of differentiation was associated with a poor prognosis.

The option of surgery or local destruction is controversial in patients with early HCC. A study based on SEER demonstrated that patients with surgical resection had a longer lifetime than those with thermal ablation (30). A propensity-matched analysis in a single institution compared hepatectomy with stereotactic body radiotherapy and concluded that patients who received surgical resection had a higher overall survival (31). Another study that included 7,185 patients with a tumor size ≤ 3 cm showed that surgical resection might provide a lower rate of recurrence than percutaneous ablation, but there were no differences between surgical resection, RFA, and percutaneous ethanol ablation and overall survival (32). Similarly, a retrospective study found that hepatectomy did not provide a higher overall survival compared with RFA combined with chemoembolization in patients with early HCC (33). In particular, the treatment methods that early HCC patients received are influenced by several factors, such as age, income, tumor characteristics, liver-related comorbidities, and hospital factors (34). However, we proposed that if the patient condition allows, surgery is still the preferred treatment.

AFP has been widely used not only for diagnosis but also for predicting the prognosis of HCC. A large tumor size, bilobar involvement, massive or diffuse types, and portal vein thrombosis might contribute to the high levels of AFP (35). In fact, AFP is still a controversial biomarker for HCC (36, 37). Giannini et al. (38) found that AFP was not associated with the prognosis of well-compensated cirrhosis patients with single and small HCC. In this study, we found that AFP was an independent prognostic factor. More clinical studies are needed to estimate the prognostic significance of AFP in early HCC.

Several staging systems have been developed to stratify the patients with HCC, including Barcelona Clinic Liver Cancer (BCLC) staging (39), Cancer of the Liver Italian Program score (40), Japan Integrated Staging Score (41), and Chinese University Prognostic Index (CUPI) (42). These staging systems are frequently utilized for prognostic evaluation for all stages of HCC. Compared with these systems, our nomogram exhibits better predictive value for the overall survival of early HCC. A study including 232 patients with early HCC showed that the C-indexes and AUROCs were 0.6479 and 0.5949 in the training group and 0.6323 and 0.5873 in the validation group, respectively, for BCLC staging, and 0.6096 and 0.5231 in the training group and 0.6889 and 0.5714 in the validation group, respectively, for CLIP staging (43). Nathan et al. (44) found that the C-indexes of CLIP, BCLC, JIS, and AJCC staging systems were 0.51, 0.51, 0.52, and 0.59, respectively, in 379 patients with early HCC.

Wan et al. (45) developed a prognostic nomogram based on 661 stages of HCC patients and validated it by 220 patients in a single institution, in which the total C-indexes of training and validation groups were 0.81 and 0.78, respectively, higher than the current staging systems (TNM, BCLC, Okuda, JIS, CLIP, and CUPI), but the C-index for early stage HCC was not known. Compared with their nomogram, ours had fewer variables and was population-based, including 1557 patients in the training set and 668 patients in the validation set.

Our nomogram only contained five variables, which represented a simple and visual tool for the prognostic prediction of patients with early HCC. To the best of our knowledge, this is the first nomogram for predicting the survival of early HCC patients. Before treatment option, the nomogram could be used to select therapy methods and predict survival rates. After treatment, the nomogram could help doctors to distinguish high- and low-risk patients, and careful follow-up should be performed in high-risk patients.

However, this study still has some limitations. Although the performance of the nomogram was better in the validation group, multicenter clinical application is also needed to evaluate the external utility of this nomogram. Most patients with HCC are associated with chronic liver disease (46), and underlying liver function is possibly an important factor for predicting the prognosis of HCC. Because of the lack of information on liver function in SEER, this nomogram did not contain any variables on liver function, which may be useful to modify the monogram.

Conclusion

In conclusion, we developed and validated a nomogram for predicting the personalized survival probability of early HCC patients. The simple nomogram had an adequate ability of discrimination and calibration, and good clinical utility. It could be a useful tool for patients undergoing a preoperative consultation and doctors conducting a postoperative evaluation.

Statements

Data availability statement

Publicly available datasets were analyzed in this study. This data can be found here: https://seer.cancer.gov/.

Author contributions

S-HC and K-HZ contributed to the idea and design. S-HC, Q-SW, DZ, and K-HZ contributed to the data acquisition and analysis. S-HC, Q-SW, TW, and K-HZ contributed to the manuscript writing and revision. All authors contributed to data acquisition and analysis and to manuscript writing and revision, and agreed to all aspects of the work.

Funding

This work was supported by the National Natural Science Foundation of China (81702107) and the Science and Technology Project of Jiangxi Province, China (No. 20171BBG70083).

Acknowledgments

We thank the open access to the database from SEER.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2019.00584/full#supplementary-material

References

  • 1.

    BrayFFerlayJSoerjomataramISiegelRLTorreLAJemalA. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. (2018) 68:394424. 10.3322/caac.21492

  • 2.

    GallePFornerALlovetJMazzaferroVPiscagliaFRaoulJet al. EASL clinical practice guidelines: management of hepatocellular carcinoma. J Hepatol. (2018) 69:182236. 10.1016/j.jhep.2018.03.019

  • 3.

    LlovetJMZucman-RossiJPikarskyESangroBSchwartzMShermanMet al. Hepatocellular carcinoma. Nat Rev Dis Primers. (2016) 2:16018. 10.1038/nrdp.2016.19

  • 4.

    AminMBGreeneFLEdgeSBComptonCCGershenwaldJEBrooklandRKet al. The eighth edition AJCC cancer staging manual: continuing to build a bridge from a population-based to a more “personalized” approach to cancer staging. CA Cancer J Clin. (2017) 67:939. 10.3322/caac.21388

  • 5.

    ChunYHKimSUParkJYKimDYHanKHChonCYet al. Prognostic value of the 7th edition of the AJCC staging system as a clinical staging system in patients with hepatocellular carcinoma. Eur J Cancer. (2011) 47:256875. 10.1016/j.ejca.2011.07.002

  • 6.

    NanashimaAOmagariKTobinagaSShibataKSumidaYMineMet al. Comparative study of survival of patients with hepatocellular carcinoma predicted by different staging systems using multivariate analysis. Eur J Surg Oncol. (2005) 31:88290. 10.1016/j.ejso.2005.04.016

  • 7.

    GraesslinOAbdulkarimBSCoutantCHuguetFGabosZHsuLet al. Nomogram to predict subsequent brain metastasis in patients with metastatic breast cancer. J Clin Oncol. (2010) 28:20327. 10.1200/JCO.2009.24.6314

  • 8.

    HuangYQLiangCHHeLTianJLiangCSChenXet al. Development and validation of a radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal cancer. J Clin Oncol. (2016) 34:215764. 10.1200/JCO.2015.65.9128

  • 9.

    DongFShenYGaoFShiXXuTWangXet al. Nomograms to predict individual prognosis of patients with primary small cell carcinoma of the bladder. J Cancer. (2018) 9:115264. 10.7150/jca.23344

  • 10.

    HeCZhangYCaiZDuanFLinXLiS. Nomogram to predict cancer-specific survival in patients with pancreatic acinar cell carcinoma: a competing risk analysis. J Cancer. (2018) 9:411727. 10.7150/jca.26936

  • 11.

    HeCZhangYCaiZLinXLiS. Overall survival and cancer-specific survival in patients with surgically resected pancreatic head adenocarcinoma: a competing risk nomogram analysis. J Cancer. (2018) 9:315667. 10.7150/jca.25494

  • 12.

    HenleySJMillerJWDowlingNFBenardVBRichardsonLC. Uterine cancer incidence and mortality—United States, 1999–2016. MMWR Morb Mortal Wkly Rep. (2018) 67:13338. 10.15585/mmwr.mm6748a1

  • 13.

    MelamedAMargulDJChenLKeatingNLDel CarmenMGYangJet al. Survival after minimally invasive radical hysterectomy for early-stage cervical cancer. N Engl J Med. (2018) 379:190514. 10.1056/NEJMoa1804923

  • 14.

    FritzAG. International Classification of Diseases for Oncology: ICD-O.Geneva: World Health Organization (2000).

  • 15.

    AbougergiMSPelusoHSaltzmanJR. Thirty-day readmission among patients with non-variceal upper gastrointestinal hemorrhage and effects on outcomes. Gastroenterology. (2018) 155:3846.e31. 10.1053/j.gastro.2018.03.033

  • 16.

    HarrellFEJrLeeKLMarkDB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. (1996) 15:36187. 10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4

  • 17.

    MoonsKGAltmanDGReitsmaJBIoannidisJPMacaskillPSteyerbergEWet al. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis. (TRIPOD): explanation and elaboration. Ann Intern Med. (2015) 162:W173. 10.7326/M14-0698

  • 18.

    WolbersMKollerMTWittemanJCSteyerbergEW. Prognostic models with competing risks: methods and application to coronary risk prediction. Epidemiology. (2009) 20:55561. 10.1097/EDE.0b013e3181a39056

  • 19.

    VickersAJElkinEB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. (2006) 26:56574. 10.1177/0272989X06295361

  • 20.

    FitzgeraldMSavilleBRLewisRJ. Decision curve analysis. JAMA. (2015) 313:40910. 10.1001/jama.2015.37

  • 21.

    CampRLDolled-FilhartMRimmDL. X-tile: a new bio-informatics tool for biomarker assessment and outcome-based cut-point optimization. Clin Cancer Res. (2004) 10:72529. 10.1158/1078-0432.CCR-04-0713

  • 22.

    OweiraHPetrauschUHelblingDSchmidtJMannhartMMehrabiAet al. Early stage hepatocellular carcinoma in the elderly: a SEER database analysis. J Geriatr Oncol. (2017) 8:27783. 10.1016/j.jgo.2017.03.002

  • 23.

    PetersNAJavedAAHeJWolfgangCLWeissMJ. Association of socioeconomics, surgical therapy, and survival of early stage hepatocellular carcinoma. J Surg Res. (2017) 210:25360. 10.1016/j.jss.2016.11.042

  • 24.

    El-SeragHBMasonACKeyC. Trends in survival of patients with hepatocellular carcinoma between 1977 and 1996 in the United States. Hepatology. (2001) 33:625. 10.1053/jhep.2001.21041

  • 25.

    DavilaJAEl-SeragHB. Racial differences in survival of hepatocellular carcinoma in the United States: a population-based study. Clin Gastroenterol Hepatol. (2006) 4:104110. quiz 104–105. 10.1016/S1542-3565(05)00745-7

  • 26.

    NathanHSchulickRDChotiMAPawlikTM. Predictors of survival after resection of early hepatocellular carcinoma. Ann Surg. (2009) 249:799805. 10.1097/SLA.0b013e3181a38eb5

  • 27.

    RenZHeSFanXHeFSangWBaoYet al. Survival prediction model for postoperative hepatocellular carcinoma patients. Medicine. (2017) 96:e7902. 10.1097/MD.0000000000007902

  • 28.

    OishiKItamotoTAmanoHFukudaSOhdanHTashiroHet al. Clinicopathologic features of poorly differentiated hepatocellular carcinoma. J Surg Oncol. (2007) 95:3116. 10.1002/jso.20661

  • 29.

    Perez-SaboridoBde los GalanesSJMeneu-DiazJCRomeroCJElola-OlasoAMSuarezYFet al. Tumor recurrence after liver transplantation for hepatocellular carcinoma: recurrence pathway and prognostic factors. Transplant Proc. (2007) 39:23047. 10.1016/j.transproceed.2007.06.059

  • 30.

    MillsAThayerDNodaCSalterATaoYXingMet al. Thermal ablation versus surgical resection for localized hepatocellular carcinoma: a population study using the SEER database. Future Oncol. (2018) 14:63145. 10.2217/fon-2017-0447

  • 31.

    NakanoROhiraMKobayashiTIdeKTaharaHKurodaSet al. Hepatectomy versus stereotactic body radiotherapy for primary early hepatocellular carcinoma: a propensity-matched analysis in a single institution. Surgery. (2018) 164:21926. 10.1016/j.surg.2018.03.006

  • 32.

    HasegawaKMakuuchiMTakayamaTKokudoNAriiSOkazakiMet al. Surgical resection vs. percutaneous ablation for hepatocellular carcinoma: a preliminary report of the Japanese nationwide survey. J Hepatol. (2008) 49:58994. 10.1016/j.jhep.2008.05.018

  • 33.

    YamakadoKNakatsukaATakakiHYokoiHUsuiMSakuraiHet al. Early-stage hepatocellular carcinoma: radiofrequency ablation combined with chemoembolization versus hepatectomy. Radiology. (2008) 247:2606. 10.1148/radiol.2471070818

  • 34.

    NathanHHyderOMayoSCHiroseKWolfgangCLChotiMAet al. Surgical therapy for early hepatocellular carcinoma in the modern era: a 10-year SEER-medicare analysis. Ann Surg. (2013) 258:102227. 10.1097/SLA.0b013e31827da749

  • 35.

    QinLXTangZY. The prognostic significance of clinical and pathological features in hepatocellular carcinoma. World J Gastroenterol. (2002) 8:1939. 10.3748/wjg.v8.i2.193

  • 36.

    European Association for the Study of the Liver, European Organisation for Research and Treatment of Cancer. EASL-EORTC clinical practice guidelines: management of hepatocellular carcinoma. J Hepatol. (2012) 56:90843. 10.1016/j.jhep.2011.12.001

  • 37.

    AsrihMLengletSMachFMontecuccoF. Alpha-fetoprotein: a controversial prognostic biomarker for small hepatocellular carcinoma. World J Gastroenterol. (2013) 19:32830. 10.3748/wjg.v19.i3.328

  • 38.

    GianniniEGMarencoSBorgonovoGSavarinoVFarinatiFDel PoggioPet al. Alpha-fetoprotein has no prognostic role in small hepatocellular carcinoma identified during surveillance in compensated cirrhosis. Hepatology. (2012) 56:13719. 10.1002/hep.25814

  • 39.

    FornerAReigMBruixJ. Hepatocellular carcinoma. Lancet. (2018) 391:130114. 10.1016/S0140-6736(18)30010-2

  • 40.

    ManghisiGElbaSMossaAGiorgioAAloisioVPerrottaA. A new prognostic system for hepatocellular carcinoma: a retrospective study of 435 patients: the Cancer of the Liver Italian Program (CLIP) investigators. Hepatology. (1998) 28:7515. 10.1002/hep.510280322

  • 41.

    KudoMChungHOsakiY. Prognostic staging system for hepatocellular carcinoma (CLIP score): its value and limitations, and a proposal for a new staging system, the Japan Integrated Staging Score (JIS score). J Gastroenterol. (2003) 38:20715. 10.1007/s005350300038

  • 42.

    LeungTWTangAMZeeBLauWYLaiPBLeungKLet al. Construction of the Chinese University Prognostic Index for hepatocellular carcinoma and comparison with the TNM staging system, the Okuda staging system, and the Cancer of the Liver Italian Program staging system: a study based on 926 patients. Cancer. (2002) 94:17609. 10.1002/cncr.10384

  • 43.

    SantambrogioRSalcedaJCostaMKlugerMDBarabinoMLaurentAet al. External validation of a simplified BCLC staging system for early hepatocellular carcinoma. Eur J Surg Oncol. (2013) 39:8507. 10.1016/j.ejso.2013.05.001

  • 44.

    NathanHMenthaGMarquesHPCapussottiLMajnoPAldrighettiLet al. Comparative performances of staging systems for early hepatocellular carcinoma. HPB. (2009) 11:38290. 10.1111/j.1477-2574.2009.00070.x

  • 45.

    WanGGaoFChenJLiYGengMSunLet al. Nomogram prediction of individual prognosis of patients with hepatocellular carcinoma. BMC Cancer. (2017) 17:91. 10.1186/s12885-017-3062-6

  • 46.

    SimonettiRGCammaCFiorelloFPolitiFD'AmicoGPagliaroL. Hepatocellular carcinoma. a worldwide problem and the major risk factors. Dig Dis Sci. (1991) 36:96272. 10.1007/BF01297149

Summary

Keywords

early hepatocellular carcinoma, nomogram, survival analysis, prediction, clinic utility

Citation

Chen S-H, Wan Q-S, Zhou D, Wang T, Hu J, He Y-T, Yuan H-L, Wang Y-Q and Zhang K-H (2019) A Simple-to-Use Nomogram for Predicting the Survival of Early Hepatocellular Carcinoma Patients. Front. Oncol. 9:584. doi: 10.3389/fonc.2019.00584

Received

22 March 2019

Accepted

17 June 2019

Published

10 July 2019

Volume

9 - 2019

Edited by

Orhan Alimoglu, Istanbul Medeniyet University Goztepe Education and Research Hospital, Turkey

Reviewed by

Paul Willemsen, Ziekenhuisnetwerk Antwerpen Middelheim, Belgium; Lunxu Liu, West China Hospital, Sichuan University, China

Updates

Copyright

*Correspondence: Kun-He Zhang

This article was submitted to Surgical Oncology, a section of the journal Frontiers in Oncology

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics