<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Oncol.</journal-id>
<journal-title>Frontiers in Oncology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Oncol.</abbrev-journal-title>
<issn pub-type="epub">2234-943X</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fonc.2018.00671</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Oncology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>Comparison of Different Lymph Node Staging Systems in Patients With Resectable Colorectal Cancer</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Pei</surname> <given-names>Jun-Peng</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x02020;</sup></xref>
<uri xlink:href="http://loop.frontiersin.org/people/628119/overview"/>
</contrib>
<contrib contrib-type="author">
<name><surname>Zhang</surname> <given-names>Chun-Dong</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref>
<xref ref-type="author-notes" rid="fn002"><sup>&#x02020;</sup></xref>
</contrib>
<contrib contrib-type="author">
<name><surname>Fan</surname> <given-names>Yu-Chen</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
</contrib>
<contrib contrib-type="author" corresp="yes">
<name><surname>Dai</surname> <given-names>Dong-Qiu</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="aff" rid="aff3"><sup>3</sup></xref>
<xref ref-type="corresp" rid="c001"><sup>&#x0002A;</sup></xref>
</contrib>
</contrib-group>
<aff id="aff1"><sup>1</sup><institution>Department of Gastrointestinal Surgery, The Fourth Affiliated Hospital of China Medical University</institution>, <addr-line>Shenyang</addr-line>, <country>China</country></aff>
<aff id="aff2"><sup>2</sup><institution>Department of Gastrointestinal Surgery, Graduate School of Medicine, University of Tokyo</institution>, <addr-line>Tokyo</addr-line>, <country>Japan</country></aff>
<aff id="aff3"><sup>3</sup><institution>Cancer Center, The Fourth Affiliated Hospital of China Medical University</institution>, <addr-line>Shenyang</addr-line>, <country>China</country></aff>
<author-notes>
<fn fn-type="edited-by"><p>Edited by: Robert Rosenberg, Kantonsspital Baselland, Switzerland</p></fn>
<fn fn-type="edited-by"><p>Reviewed by: Mirko Omejc, University of Ljubljana, Slovenia; Vladimir Cuk, Clinical Hospital Center Zvezdara, Serbia</p></fn>
<corresp id="c001">&#x0002A;Correspondence: Dong-Qiu Dai <email>daidq63&#x00040;126.com</email>; <email>daidq63&#x00040;163.com</email></corresp>
<fn fn-type="other" id="fn001"><p>This article was submitted to Gastrointestinal Cancers, a section of the journal Frontiers in Oncology</p></fn>
<fn fn-type="other" id="fn002"><p>&#x02020;These authors have contributed equally to this work</p></fn></author-notes>
<pub-date pub-type="epub">
<day>15</day>
<month>01</month>
<year>2019</year>
</pub-date>
<pub-date pub-type="collection">
<year>2018</year>
</pub-date>
<volume>8</volume>
<elocation-id>671</elocation-id>
<history>
<date date-type="received">
<day>25</day>
<month>10</month>
<year>2018</year>
</date>
<date date-type="accepted">
<day>20</day>
<month>12</month>
<year>2018</year>
</date>
</history>
<permissions>
<copyright-statement>Copyright &#x000A9; 2019 Pei, Zhang, Fan and Dai.</copyright-statement>
<copyright-year>2019</copyright-year>
<copyright-holder>Pei, Zhang, Fan and Dai</copyright-holder>
<license xlink:href="http://creativecommons.org/licenses/by/4.0/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract><p><bold>Background and Objectives:</bold> Currently, the United States Joint Commission on Cancer (AJCC) N staging, lymph node positive rate (LNR), and log odds of positive lymph nodes (LODDS) are the main lymph node (LN) staging systems. However, the type of LN staging system that is more accurate in terms of prognostic performance remains controversial. We compared the prognostic accuracy of the three staging systems in patients with CRC and determine the best choice for clinical applications.</p>
<p><bold>Methods:</bold> From the Surveillance, Epidemiology, and End Results (SEER) database, 56,747 patients were identified who were diagnosed with CRC between 2004 and 2013. Akaike&#x00027;s Information Criterion (AIC) and Harrell&#x00027;s Consistency Index (c-index) were used to assess the relative discriminative abilities of different LN staging systems.</p>
<p><bold>Results:</bold> In 56,747 patients, when using classification cut-off values for evaluation, the LNR of Rosenberg et al. showed significantly better predictive power, especially when the number of dissected lymph nodes (NDLN) were insufficient. When analyzed as a continuous variable, the LODDS staging system performed the best and was not affected by the NDLN.</p>
<p><bold>Conclusions:</bold> We suggest that the LNR of Rosenberg et al. should be introduced into the AJCC system as a supplement when the NDLN is insufficient until the optimal LODDS cut-off values are calculated.</p></abstract>
<kwd-group>
<kwd>log odds</kwd>
<kwd>lymph node ratio</kwd>
<kwd>N staging</kwd>
<kwd>colorectal cancer</kwd>
<kwd>survival analysis</kwd>
</kwd-group>
<counts>
<fig-count count="3"/>
<table-count count="4"/>
<equation-count count="0"/>
<ref-count count="36"/>
<page-count count="8"/>
<word-count count="5834"/>
</counts>
</article-meta>
</front>
<body>
<sec sec-type="intro" id="s1">
<title>Introduction</title>
<p>Colorectal cancer (CRC) is the third most commonly diagnosed cancer in men and women in the United States (<xref ref-type="bibr" rid="B1">1</xref>). Lymph node (LN) metastasis is an important prognostic factor associated with overall survival (OS) (<xref ref-type="bibr" rid="B2">2</xref>). Therefore, in order to accurately describe LN status, a variety of LN staging systems have been proposed. The most representative of these LN staging systems are the American Joint Committee on Cancer/Union for International Cancer Control (AJCC/UICC) eighth edition N staging (<xref ref-type="bibr" rid="B3">3</xref>), lymph node ratio (LNR) and the log odds of positive lymph nodes (LODDS).</p>
<p>The goal of cancer staging systems is to group patients with similar prognosis. Rice et al. defined the characteristics of a good staging system as: (a) the patient survival rate decreases as the stage group increases (Monotonicity), (b) the groups have clearly different survival rates (Distinctiveness), and (c) within a group, the survival rate is similar (Homogeneity) (<xref ref-type="bibr" rid="B4">4</xref>). Currently, the most widely accepted LN staging system is the AJCC/UICC 8th N staging, which is based on the absolute number of positive lymph nodes (NPLN). Its classification system is: pN0: no LN metastasis; pN1a: 1 metastatic LN; pN1b: 2&#x02013;3 metastatic LNs; pN2a: 4&#x02013;6 metastatic LNs; pN2b: &#x02265;7 metastatic LNs (<xref ref-type="bibr" rid="B3">3</xref>).</p>
<p>Many studies have shown that OS is closely related to the NDLN in resectable surgery in patients with CRC, and a greater NDLN could provide more accurate staging and longer survival (<xref ref-type="bibr" rid="B5">5</xref>&#x02013;<xref ref-type="bibr" rid="B7">7</xref>). The AJCC/UICC 8th N staging system recommends that at least 12 LNs in tumor specimens must be resectable and histopathologically evaluated to fully assess LN status. However, despite the availability of accurate recommendations, the recommended cut-off values for the NDLN needed varies widely among published studies, with the median ranging between 6 and 13, which results in staging migration and can affect further treatment for CRC (<xref ref-type="bibr" rid="B8">8</xref>, <xref ref-type="bibr" rid="B9">9</xref>). In addition to surgeons, pathologists have also played a significant role in determining the status of LN in resected specimens (<xref ref-type="bibr" rid="B10">10</xref>). Therefore, in order to reduce staging migration, two new LN staging systems have been proposed.</p>
<p>LNR is defined as the ratio of NPLN relative to the NDLN. Recently, some scholars have reported that LNR has been shown to have a strong independent prognostic value in rectal and colon cancer (<xref ref-type="bibr" rid="B11">11</xref>, <xref ref-type="bibr" rid="B12">12</xref>). These results were also shown in patients with lung, breast, and gastric cancer (<xref ref-type="bibr" rid="B13">13</xref>&#x02013;<xref ref-type="bibr" rid="B15">15</xref>). Berger et al. first proposed that LNR has a higher prognostic impact in patients with colon cancer. They believed that LNR could reduce staging migration in patients with an insufficient NDLN (<xref ref-type="bibr" rid="B16">16</xref>). Rosenberg et al. also suggested that LNR should include routine histopathology reports because of their higher prognostic impact on colon cancer than AJCC/UICC N staging (<xref ref-type="bibr" rid="B17">17</xref>). However, some experts believe that when the NDLN is not sufficient, LNR cannot completely eliminate staging migration (<xref ref-type="bibr" rid="B18">18</xref>, <xref ref-type="bibr" rid="B19">19</xref>). In addition, when LNR is an extreme value (LNR &#x0003D; 0 or 1), it does not accurately predict prognosis (<xref ref-type="bibr" rid="B12">12</xref>).</p>
<p>LODDS is another innovative N staging system. LODDS is defined as the logarithm of the ratio between the probability of being a positive LN and the probability of being a negative LN when an LN is retrieved (<xref ref-type="bibr" rid="B5">5</xref>, <xref ref-type="bibr" rid="B20">20</xref>, <xref ref-type="bibr" rid="B21">21</xref>). The formula for the LODDS system is log{(NPLN &#x0002B; 0.5)/(NDLN - NPLN &#x0002B; 0.5)}. &#x0201C;0.5&#x0201D; appears twice in the formula to avoid dividing by 0 and avoid having many patients with a LODDS of 0. According to previous reports, the use of LODDS has reduced the risk of staging migration in gastric, breast, colon, and pancreatic cancer in recent years (<xref ref-type="bibr" rid="B22">22</xref>&#x02013;<xref ref-type="bibr" rid="B25">25</xref>). After comparing the prognostic utility of the LODDS system with the LNR system and AJCC/UICC N staging in patients with CRC, Persiani et al. showed that the LODDS system performed better (<xref ref-type="bibr" rid="B24">24</xref>). Wang et al. used the Surveillance, Epidemiology, and End Results (SEER) data to study the LODDS system in stage III colon cancer cases and concluded that LODDS also performed better than LNR and AJCC/UICC N staging in predicting prognosis (<xref ref-type="bibr" rid="B26">26</xref>).</p>
<p>The aim of this study was to compare the ability of different LN staging systems to predict OS in patients with resectable CRC to identify the most accurate system for application in clinical practice.</p></sec>
<sec sec-type="materials and methods" id="s2">
<title>Materials and Methods</title>
<sec>
<title>Patients</title>
<p>In this retrospective analysis, we used data from the SEER linked database. The SEER Program of the National Cancer Institute is an authoritative source of information on cancer incidence and survival in the United States (U.S.) that is updated annually. SEER currently collects and publishes cancer incidence and survival data from population-based cancer registries covering approximately 34.6 percent of the U.S. population. Data from SEER was used to identify patients with CRC diagnosed between 2004 and 2013. Among the 90,529 patients diagnosed with CRC between these years, patients with the following characteristics were included: (a) the patients were over 18 years old; (b) CRC was the first and only malignant tumor; (c) surgical resection was performed; (d) there was complete staging information; and (e) no neoadjuvant chemoradiation was used in treatment. The final study sample contained 56,747 patients.</p></sec>
<sec>
<title>LN Staging Systems</title>
<p>We analyzed LNR and LODDS as both continuous and categorical variables. When used as categorical variables, different researchers have developed different optimal cut-off values. For the LNR staging system, we used cut-off values from Berger et al. and Rosenberg et al. Berger et al. considered 0.05, 0.19, and 0.39 as the best cut-off values, and divided the LNR into four groups as follows: LNR1 &#x0003C; 0.05; 0.05 &#x02264; LNR2 &#x0003C; 0.19; 0.19 &#x02264; LNR3 &#x0003C; 0.39; and 0.39 &#x02264; LNR4 &#x02264; 1.00 (<xref ref-type="bibr" rid="B16">16</xref>). Rosenberg et al. calculated the best cut-off values between groups as 0.17, 0.41 and 0.69, and divided the LNR into five subgroups as follows: LNR0 &#x0003D; 0.00; 0.01 &#x02264; LNR1 &#x02264; 0.17; 0.18 &#x02264; LNR2 &#x02264; 0.41; 0.42 &#x02264; LNR3 &#x02264; 0.69; and LNR4 &#x02265; 0.70 (<xref ref-type="bibr" rid="B17">17</xref>). For the LODDS staging system, we used the ideal cut-off values from Persiani et al. and Wang et al. Persiani et al. divided LODDS into three groups as follows: LODDS1 &#x02264; &#x02212;1.36;&#x02212;1.36 &#x0003C; LODDS2 &#x02264; &#x02212;0.53; LODDS3 &#x0003E;&#x02212;0.53 (<xref ref-type="bibr" rid="B24">24</xref>). Wang et al. divided LODDS into five groups as follows: LODDS1 &#x0003C; &#x02212;2.2;&#x02212;2.2 &#x02264; LODDS2 &#x0003C; &#x02212;1.1;&#x02212;1.1 &#x02264; LODDS3 &#x0003C; 0.0; 0.0 &#x02264; LODDS4 &#x0003C; 1.1; LODDS5 &#x02265; 1.1 (<xref ref-type="bibr" rid="B26">26</xref>) (Table <xref ref-type="table" rid="T1">1</xref>).</p>
<table-wrap position="float" id="T1">
<label>Table 1</label>
<caption><p>Basic characteristics of different lymph node staging systems.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>AJCC 8th N stage (3)</bold></th>
<th valign="top" align="left"><bold>LNR, Berger et al. (<xref ref-type="bibr" rid="B16">16</xref>)</bold></th>
<th valign="top" align="left"><bold>LNR, Rosenberg et al. (<xref ref-type="bibr" rid="B17">17</xref>)</bold></th>
<th valign="top" align="left"><bold>LODDS, Wang et al. (<xref ref-type="bibr" rid="B26">26</xref>)</bold></th>
<th valign="top" align="left"><bold>LODDS, Persiani et al. (<xref ref-type="bibr" rid="B24">24</xref>)</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">pN0</td>
<td valign="top" align="left">LNR1 &#x0003C; 0.05</td>
<td valign="top" align="left">LNR0 &#x0003D; 0.00</td>
<td valign="top" align="left">LODDS1 &#x0003C; &#x02212;2.2</td>
<td valign="top" align="left">LODDS1 &#x02264; &#x02212;1.36</td>
</tr>
<tr>
<td valign="top" align="left">pN1a</td>
<td valign="top" align="left">0.05 &#x02264; LNR2 &#x0003C; 0.19</td>
<td valign="top" align="left">0.01 &#x02264; LNR1 &#x02264; 0.17</td>
<td valign="top" align="left">&#x02212;2.2 &#x02264; LODDS2 &#x0003C; &#x02212;1.1</td>
<td valign="top" align="left">&#x02212;1.36 &#x0003C; LODDS2 &#x02264; &#x02212;0.53</td>
</tr>
<tr>
<td valign="top" align="left">pN1b</td>
<td valign="top" align="left">0.19 &#x02264; LNR3 &#x0003C; 0.39</td>
<td valign="top" align="left">0.18 &#x02264; LNR2 &#x02264; 0.41</td>
<td valign="top" align="left">&#x02212;1.1 &#x02264; LODDS3 &#x0003C; 0.0</td>
<td valign="top" align="left">LODDS3 &#x0003E; &#x02212;0.53</td>
</tr>
<tr>
<td valign="top" align="left">pN2a</td>
<td valign="top" align="left">0.39 &#x02264; LNR4 &#x02264; 1.00</td>
<td valign="top" align="left">0.42 &#x02264; LNR3 &#x02264; 0.69</td>
<td valign="top" align="left">0.0 &#x02264; LODDS4 &#x0003C; 1.1</td>
</tr>
<tr>
<td valign="top" align="left">pN2b</td>
<td/>
<td valign="top" align="left">LNR4 &#x02265; 0.70</td>
<td valign="top" align="left">LODDS5 &#x02265; 1.1</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>AJCC, American Joint Committee on Cancer; LNR, lymph node ratio; LODDS, log odds of positive lymph nodes</italic>.</p>
</table-wrap-foot>
</table-wrap></sec>
<sec>
<title>Statistical Analysis</title>
<p>We used the Kaplan-Meier method to estimate OS and tested it using the log-rank procedure. Odds ratio (OR) and 95% confidence intervals (95% CI) are presented. We used the Akaike Information Criterion (AIC) and the Harrell Consistency Index (c-index) to assess the relative discriminative power of different LN staging systems. A value of c &#x0003D; 0.5 indicates no predictive power, and a value of c &#x0003D; 1 indicates complete differentiation. In general, a predictive model with a low AIC indicates a better model fit, while a high c-index indicates a better discriminating ability. All analyses were carried out with SPSS version 22.0 and R version 3.50. For all analysis, <italic>P</italic> &#x0003C; 0.05 was considered significant, and all tests were two-tailed.</p></sec></sec>
<sec sec-type="results" id="s3">
<title>Results</title>
<sec>
<title>Patient Characteristics</title>
<p>Table <xref ref-type="table" rid="T2">2</xref> shows clinical and histopathological characteristics for the study population. The cohort consisted of 27,507 males (48.5%) and 29,240 females (51.5%). The median age &#x000B1; standard deviation was 66.0 &#x000B1; 13.3 years. There were 22,723 (40.5%) patients with CRC who had LN metastases and 34,024 (59.5%) patients with no LN metastases. The mean &#x000B1; standard deviation of NDLN and NPLN in the whole cohort were 16.9 &#x000B1; 9.8 and 1.6 &#x000B1; 3.3, respectively. 10,613 (18.7%) subjects had tumor located in the rectum and 46,134 (81.3%) were in the colon. In the univariate analysis, the age of diagnosis, histological grade, pT stage, tumor size, and NDLN were significantly correlated with prognosis.</p>
<table-wrap position="float" id="T2">
<label>Table 2</label>
<caption><p>Clinical and histopathological characteristics for the entire population.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Variables</bold></th>
<th valign="top" align="center"><bold>N (%)</bold></th>
<th valign="top" align="center" colspan="2" style="border-bottom: thin solid #000000;"><bold>Univariate analysis</bold></th>
</tr>
<tr>
<th/>
<th/>
<th valign="top" align="center"><bold>5-year OS (%)</bold></th>
<th valign="top" align="center"><bold><italic>P-</italic>value</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Age, years</td>
<td/>
<td/>
<td valign="top" align="center">&#x0003C; 0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0; &#x02264; 65</td>
<td valign="top" align="center">26,305 (46.4)</td>
<td valign="top" align="center">85.3</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;&#x0003E; 65</td>
<td valign="top" align="center">30,442 (53.6)</td>
<td valign="top" align="center">72.6</td>
</tr>
<tr>
<td valign="top" align="left">Gender</td>
<td/>
<td/>
<td valign="top" align="center">0.353</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Male</td>
<td valign="top" align="center">27,507 (48.5)</td>
<td valign="top" align="center">78.5</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Female</td>
<td valign="top" align="center">29,240 (51.5)</td>
<td valign="top" align="center">78.7</td>
</tr>
<tr>
<td valign="top" align="left">Tumor location</td>
<td/>
<td/>
<td valign="top" align="center">0.763</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Rectum</td>
<td valign="top" align="center">10,613 (18.7)</td>
<td valign="top" align="center">78.3</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Colon</td>
<td valign="top" align="center">46,134 (81.3)</td>
<td valign="top" align="center">78.5</td>
</tr>
<tr>
<td valign="top" align="left">Histologic grade</td>
<td/>
<td/>
<td valign="top" align="center">&#x0003C; 0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Well differentiated</td>
<td valign="top" align="center">5,382 (9.5)</td>
<td valign="top" align="center">87.6</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Moderately differentiated</td>
<td valign="top" align="center">41,004 (72.3)</td>
<td valign="top" align="center">80.2</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Poorly differentiated</td>
<td valign="top" align="center">9,609 (16.9)</td>
<td valign="top" align="center">66.9</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Undifferentiated</td>
<td valign="top" align="center">752 (1.3)</td>
<td valign="top" align="center">65.4</td>
</tr>
<tr>
<td valign="top" align="left">Tumor size, cm</td>
<td/>
<td/>
<td valign="top" align="center">&#x0003C; 0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0; &#x02264; 5</td>
<td valign="top" align="center">35,672 (62.9)</td>
<td valign="top" align="center">80.6</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;&#x0003E; 5</td>
<td valign="top" align="center">16,259 (28.7)</td>
<td valign="top" align="center">72.2</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Unknown</td>
<td valign="top" align="center">4,816 (8.5)</td>
<td valign="top" align="center">85.6</td>
</tr>
<tr>
<td valign="top" align="left">AJCC 8th T stage</td>
<td/>
<td/>
<td valign="top" align="center">&#x0003C; 0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;pT1</td>
<td valign="top" align="center">8,022 (14.1)</td>
<td valign="top" align="center">95.5</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;pT2</td>
<td valign="top" align="center">9,957 (17.5)</td>
<td valign="top" align="center">91.6</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;pT3</td>
<td valign="top" align="center">32,726 (57.7)</td>
<td valign="top" align="center">75.7</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;pT4</td>
<td valign="top" align="center">6,042 (10.7)</td>
<td valign="top" align="center">51.6</td>
</tr>
<tr>
<td valign="top" align="left">NDLN</td>
<td/>
<td/>
<td valign="top" align="center">&#x0003C; 0.001</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Inadequate (<italic>n</italic> &#x0003C; 12)</td>
<td valign="top" align="center">16,699 (29.4)</td>
<td valign="top" align="center">76.2</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;Adequate (<italic>n</italic> &#x02265; 12)</td>
<td valign="top" align="center">40,048 (70.6)</td>
<td valign="top" align="center">79.7</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="TN1"><p><italic>N, number; OS, overall survival rate; NDLN, the number of dissected lymph nodes; AJCC, American Joint Committee on Cancer</italic>.</p></fn>
</table-wrap-foot>
</table-wrap></sec>
<sec>
<title>Survival</title>
<p>Survival analysis was performed on the factors in the univariate analysis (Figures <xref ref-type="fig" rid="F1">1A&#x02013;G</xref>). The 5-year OS of patients with an adequate NDLN was 79.7% and with an inadequate NDLN was 76.2% (<italic>P</italic> &#x0003C; 0.001; Figure <xref ref-type="fig" rid="F1">1E</xref>). The 5-year OS of patients with tumor located in the rectum was 78.3% and in the colon was 78.5%. The tumor location was not significant in predicting prognosis (<italic>P</italic> &#x0003D; 0.763; Figure <xref ref-type="fig" rid="F1">1G</xref>). Therefore, we grouped rectal and colon cancer together. The 5-year OS of different histological grades were 87.6% for well differentiated, 80.2% for moderately differentiated, 66.9% for poorly differentiated, and 65.4% for undifferentiated (<italic>P</italic> &#x0003C; 0.001; Figure <xref ref-type="fig" rid="F1">1B</xref>). No significant difference was found between poorly differentiated and undifferentiated tumors (<italic>P</italic> &#x0003D; 0.148). Kaplan-Meier survival curves and survival data based on different LN staging systems are shown in Figure <xref ref-type="fig" rid="F2">2</xref> and Table <xref ref-type="table" rid="T3">3</xref> for all patients. The AJCC/UICC N staging system divided patients into five different prognostic groups and the 5-year OS for each subgroup were: pN0 &#x0003D; 87.2%, pN1a &#x0003D; 75.2%, pN1b &#x0003D; 68.1%, pN2a &#x0003D; 58.3%, and pN2b &#x0003D; 44.1% (<italic>P</italic> &#x0003C; 0.001; Figure <xref ref-type="fig" rid="F2">2A</xref>). The 5-year OS of the LNR subgroups according to the Rosenberg et al. criteria were LNR0 &#x0003D; 87.2%, LNR1 &#x0003D; 74.1%, LNR2 &#x0003D; 61.3%, LNR3 &#x0003D; 48.9%, and LNR4 &#x0003D; 33.0% (<italic>P</italic> &#x0003C; 0.001; Figure <xref ref-type="fig" rid="F2">2B</xref>), and the 5-year OS according to the Berger et al. criteria were LNR1 &#x0003D; 86.9%, LNR2 &#x0003D; 72.4%, LNR3 &#x0003D; 61.3%, and LNR4 &#x0003D; 44.3% (<italic>P</italic> &#x0003C; 0.001; Figure <xref ref-type="fig" rid="F2">2C</xref>). Finally, the 5-year OS of LODDS based on the classification by Wang et al. were LODDS1 &#x0003D; 91%, LODDS2 &#x0003D; 86.5%, LODDS3 &#x0003D; 69.7%, LODDS4 &#x0003D; 48.8%, and LODDS5 &#x0003D; 35.6% (<italic>P</italic> &#x0003C; 0.001; Figure <xref ref-type="fig" rid="F2">2D</xref>) and those using the criteria by Persiani et al. were LODDS1 &#x0003D; 88.2%, LODDS2 &#x0003D; 77.9%, LODDS3 &#x0003D; 53.6% (<italic>P</italic> &#x0003C; 0.001; Figure <xref ref-type="fig" rid="F2">2E</xref>). Significant survival differences were detected between the subgroups of each staging system (Figure <xref ref-type="fig" rid="F2">2</xref>,Table <xref ref-type="table" rid="T3">3</xref>).</p>
<fig id="F1" position="float">
<label>Figure 1</label>
<caption><p>Kaplan&#x02013;Meier survival curves for five-year OS stratified by different prognostic factors with statistical significance based on the <bold>(A)</bold> Age, <bold>(B)</bold> Histologic grade, <bold>(C)</bold> Tumor size, <bold>(D)</bold> AJCC 8th T stage, <bold>(E)</bold> NDLN, <bold>(F)</bold> Gender, and <bold>(G)</bold> Tumor location. (AJCC, American Joint Committee on Cancer; NDLN, the number of dissected lymph nodes).</p></caption>
<graphic xlink:href="fonc-08-00671-g0001.tif"/>
</fig>
<fig id="F2" position="float">
<label>Figure 2</label>
<caption><p>Kaplan&#x02013;Meier survival curves for five-year OS stratified by LN categories based on the <bold>(A)</bold> AJCC 8th N stage, <bold>(B)</bold> LNR of Rosenberg et al. <bold>(C)</bold> LNR of Berger et al. <bold>(D)</bold> LODDS of Wang et al. and <bold>(E)</bold> LODDS of Persiani et al. (LN, lymph node; AJCC, American Joint Committee on Cancer; LNR, lymph node ratio; LODDS, log odds of positive lymph nodes).</p></caption>
<graphic xlink:href="fonc-08-00671-g0002.tif"/>
</fig>
<table-wrap position="float" id="T3">
<label>Table 3</label>
<caption><p>Five-year overall survival and 95% confidence interval according to different LN staging.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="left"><bold>Staging systems</bold></th>
<th valign="top" align="center"><bold>N (%)</bold></th>
<th valign="top" align="center"><bold>OR (95 % CI)</bold></th>
<th valign="top" align="center"><bold>5-year OS (%)</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left" colspan="4"><bold>AJCC 8th N stage (3)</bold></td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;pN0</td>
<td valign="top" align="center">34,024 (60.0)</td>
<td valign="top" align="center">1.00 (Reference)</td>
<td valign="top" align="center">87.2</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;pN1a</td>
<td valign="top" align="center">6,975 (12.3)</td>
<td valign="top" align="center">2.06 (1.95&#x02013;2.17)</td>
<td valign="top" align="center">75.2</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;pN1b</td>
<td valign="top" align="center">7,149 (12.6)</td>
<td valign="top" align="center">2.76 (2.63&#x02013;2.90)</td>
<td valign="top" align="center">68.1</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;pN2a</td>
<td valign="top" align="center">4,764 (8.4)</td>
<td valign="top" align="center">3.82 (3.63&#x02013;4.02)</td>
<td valign="top" align="center">58.3</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;pN2b</td>
<td valign="top" align="center">3,835 (6.8)</td>
<td valign="top" align="center">5.80 (5.52&#x02013;6.10)</td>
<td valign="top" align="center">44.1</td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><bold>LNR, Berger et al. (<xref ref-type="bibr" rid="B16">16</xref>)</bold></td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LNR1</td>
<td valign="top" align="center">36,041 (63.5)</td>
<td valign="top" align="center">1.00 (Reference)</td>
<td valign="top" align="center">86.9</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LNR2</td>
<td valign="top" align="center">10,058 (17.7)</td>
<td valign="top" align="center">2.26 (2.16&#x02013;2.36)</td>
<td valign="top" align="center">72.4</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LNR3</td>
<td valign="top" align="center">5,594 (9.9)</td>
<td valign="top" align="center">3.34 (3.19&#x02013;3.51)</td>
<td valign="top" align="center">61.3</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LNR4</td>
<td valign="top" align="center">5,054 (8.9)</td>
<td valign="top" align="center">5.62 (5.38&#x02013;5.88)</td>
<td valign="top" align="center">44.3</td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><bold>LNR, Rosenberg et al. (<xref ref-type="bibr" rid="B17">17</xref>)</bold></td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LNR0</td>
<td valign="top" align="center">34,024 (60.0)</td>
<td valign="top" align="center">1.00 (Reference)</td>
<td valign="top" align="center">87.2</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LNR1</td>
<td valign="top" align="center">11,520 (20.3)</td>
<td valign="top" align="center">2.41 (2.05&#x02013;2.24)</td>
<td valign="top" align="center">74.1</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LNR2</td>
<td valign="top" align="center">6,659 (11.7)</td>
<td valign="top" align="center">3.44 (3.29&#x02013;3.61)</td>
<td valign="top" align="center">61.3</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LNR3</td>
<td valign="top" align="center">2,919 (5.1)</td>
<td valign="top" align="center">5.06 (4.78&#x02013;5.35)</td>
<td valign="top" align="center">48.9</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LNR4</td>
<td valign="top" align="center">1,625 (2.9)</td>
<td valign="top" align="center">7.99 (7.49&#x02013;8.53)</td>
<td valign="top" align="center">33.0</td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><bold>LODDS, Wang et al. (<xref ref-type="bibr" rid="B26">26</xref>)</bold></td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LODDS1</td>
<td valign="top" align="center">3,707 (6.5)</td>
<td valign="top" align="center">1.00 (Reference)</td>
<td valign="top" align="center">91.0</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LODDS2</td>
<td valign="top" align="center">29,557 (52.1)</td>
<td valign="top" align="center">1.57 (1.41&#x02013;1.75)</td>
<td valign="top" align="center">86.5</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LODDS3</td>
<td valign="top" align="center">19,761 (34.8)</td>
<td valign="top" align="center">3.84 (3.45&#x02013;4.27)</td>
<td valign="top" align="center">69.7</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LODDS4</td>
<td valign="top" align="center">1,578 (2.8)</td>
<td valign="top" align="center">7.70 (6.80&#x02013;8.70)</td>
<td valign="top" align="center">48.8</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LODDS5</td>
<td valign="top" align="center">2,144 (3.8)</td>
<td valign="top" align="center">11.00 (9.80&#x02013;12.35)</td>
<td valign="top" align="center">35.6</td>
</tr>
<tr>
<td valign="top" align="left" colspan="4"><bold>LODDS, Persiani et al. (<xref ref-type="bibr" rid="B24">24</xref>)</bold></td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LODDS1</td>
<td valign="top" align="center">24,983 (44.0)</td>
<td valign="top" align="center">1.00 (Reference)</td>
<td valign="top" align="center">88.2</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LODDS2</td>
<td valign="top" align="center">21,423 (37.8)</td>
<td valign="top" align="center">1.97 (1.88&#x02013;2.06)</td>
<td valign="top" align="center">77.9</td>
</tr>
<tr>
<td valign="top" align="left">&#x000A0;&#x000A0;LODDS3</td>
<td valign="top" align="center">10,341 (18.2)</td>
<td valign="top" align="center">4.81 (4.60&#x02013;5.02)</td>
<td valign="top" align="center">53.6</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>N, number; OR, Odds Ratio; 95% CI, 95% confidence interval; LNR, lymph node ratio; LODDS, log odds of positive lymph nodes; AJCC, American Joint Committee on Cancer</italic>.</p>
</table-wrap-foot>
</table-wrap>
</sec>
<sec>
<title>Prognostic Accuracy of Different LN Staging Systems</title>
<p>The AIC and c-index were used to estimate the prognostic discriminative ability of different LN staging systems (Table <xref ref-type="table" rid="T4">4</xref>). First, the LN status was evaluated as a categorical variable to analyze the prognostic discriminating power of different LN staging systems. In the whole population, two LNR staging systems showed better prognostic performance than other staging systems, with the LNR from Rosenberg et al. (c-index: 0.669, AIC: 287984.1) showing the best prognostic performance. The LNR of Berger et al. (c-index: 0.666, AIC: 288125.3) and AJCC/UICC N staging (c-index: 0.666; AIC: 288397.0) had similar prognostic performances. In addition, the two LODDS (Wang et al.: c-index: 0.659, AIC: 288619.9; Persiani et al.: c-index: 0.659, AIC: 288994.6) staging systems performed relatively poorly. Further analysis based on different NDLN showed that when the NDLN was insufficient (NDLN &#x0003C; 12), the LNR of Rosenberg et al. (c-index: 0.649, AIC: 85842.9) still maintained the best prognostic performance. However, when the NDLN is sufficient (NDLN &#x02265; 12), AJCC/UICC N staging (c-index: 0.647; AIC: 85899.4) is the best prognostic model. In contrast, both LODDS staging systems showed the worst prognosis performance regardless of the adequacy of the NDLN.</p>
<table-wrap position="float" id="T4">
<label>Table 4</label>
<caption><p>Prognostic performance of different lymph node staging systems before and after stratifying for NDLN.</p></caption>
<table frame="hsides" rules="groups">
<thead><tr>
<th valign="top" align="center" colspan="6" style="border-bottom: thin solid #000000;"><bold>NDLN</bold></th>
</tr>
<tr>
<th valign="top" align="left"><bold>Variables</bold></th>
<th valign="top" align="center" colspan="2" style="border-bottom: thin solid #000000;"><bold>ALL (<italic>n</italic> &#x0003D; 56, 747)</bold></th>
<th valign="top" align="center" colspan="2" style="border-bottom: thin solid #000000;"><bold>&#x02265; 12 (<italic>n</italic> &#x0003D; 16, 699)</bold></th>
<th valign="top" align="center" colspan="2" style="border-bottom: thin solid #000000;"><bold>&#x0003C; 12 (<italic>n</italic> &#x0003D; 40, 048)</bold></th>
</tr>
<tr>
<th/>
<th valign="top" align="center"><bold>C Index (95% CI)</bold></th>
<th valign="top" align="center"><bold>AIC</bold></th>
<th valign="top" align="center"><bold>C Index (95% CI)</bold></th>
<th valign="top" align="center"><bold>AIC</bold></th>
<th valign="top" align="center"><bold>C Index (95% CI)</bold></th>
<th valign="top" align="center"><bold>AIC</bold></th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">PLN (continuous)</td>
<td valign="top" align="center">0.668 (0.663&#x02013;0.672)</td>
<td valign="top" align="center">290576.3</td>
<td valign="top" align="center">0.682 (0.677&#x02013;0.688)</td>
<td valign="top" align="center">186085.5</td>
<td valign="top" align="center">0.648 (0.641&#x02013;0.655)</td>
<td valign="top" align="center">86189.8</td>
</tr>
<tr>
<td valign="top" align="left">LNR (continuous)</td>
<td valign="top" align="center">0.673 (0.668&#x02013;0.677)</td>
<td valign="top" align="center">288763.7</td>
<td valign="top" align="center">0.684 (0.679&#x02013;0.690)</td>
<td valign="top" align="center">185052.7</td>
<td valign="top" align="center">0.651 (0.644&#x02013;0.658)</td>
<td valign="top" align="center">86050.7</td>
</tr>
<tr>
<td valign="top" align="left">LODDS (continuous)</td>
<td valign="top" align="center">0.682 (0.677&#x02013;0.687)</td>
<td valign="top" align="center">287860.5</td>
<td valign="top" align="center">0.691 (0.685&#x02013;0.697)</td>
<td valign="top" align="center">184338.2</td>
<td valign="top" align="center">0.652 (0.644&#x02013;0.661)</td>
<td valign="top" align="center">85970.4</td>
</tr>
<tr>
<td valign="top" align="left">AJCC 8th N stage (<xref ref-type="bibr" rid="B3">3</xref>)</td>
<td valign="top" align="center">0.666 (0.662&#x02013;0.671)</td>
<td valign="top" align="center">288397.0</td>
<td valign="top" align="center">0.681 (0.675&#x02013;0.686)</td>
<td valign="top" align="center">184632.6</td>
<td valign="top" align="center">0.647 (0.640&#x02013;0.654)</td>
<td valign="top" align="center">85899.4</td>
</tr>
<tr>
<td valign="top" align="left">LNR, Rosenberg et al. (<xref ref-type="bibr" rid="B17">17</xref>)</td>
<td valign="top" align="center">0.669 (0.664&#x02013;0.673)</td>
<td valign="top" align="center">287984.1</td>
<td valign="top" align="center">0.679 (0.673&#x02013;0.684)</td>
<td valign="top" align="center">184496.2</td>
<td valign="top" align="center">0.649 (0.642&#x02013;0.656)</td>
<td valign="top" align="center">85842.9</td>
</tr>
<tr>
<td valign="top" align="left">LNR, Berger et al. (<xref ref-type="bibr" rid="B16">16</xref>)</td>
<td valign="top" align="center">0.666 (0.662&#x02013;0.670)</td>
<td valign="top" align="center">288125.3</td>
<td valign="top" align="center">0.674 (0.669&#x02013;0.679)</td>
<td valign="top" align="center">184686.9</td>
<td valign="top" align="center">0.639 (0.632&#x02013;0.646)</td>
<td valign="top" align="center">85856.0</td>
</tr>
<tr>
<td valign="top" align="left">LODDS, Wang et al. (<xref ref-type="bibr" rid="B26">26</xref>)</td>
<td valign="top" align="center">0.659 (0.655&#x02013;0.664)</td>
<td valign="top" align="center">288619.9</td>
<td valign="top" align="center">0.665 (0.660&#x02013;0.670)</td>
<td valign="top" align="center">184888.2</td>
<td valign="top" align="center">0.629 (0.621&#x02013;0.636)</td>
<td valign="top" align="center">86265.7</td>
</tr>
<tr>
<td valign="top" align="left">LODDS, Persiani et al. (<xref ref-type="bibr" rid="B24">24</xref>)</td>
<td valign="top" align="center">0.659 (0.654&#x02013;0.663)</td>
<td valign="top" align="center">288994.6</td>
<td valign="top" align="center">0.673 (0.668&#x02013;0.678)</td>
<td valign="top" align="center">184899.7</td>
<td valign="top" align="center">0.616 (0.609&#x02013;0.623)</td>
<td valign="top" align="center">86388.1</td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<p><italic>NDLN, The number of dissected lymph nodes; AIC, Akaike&#x00027;s Information Criterion; C Index, Harrell&#x00027;s consistency Index; LNR, lymph node ratio; LODDS, log odds of positive lymph nodes; AJCC, American Joint Committee on Cancer; PLN, positive lymph node</italic>.</p>
</table-wrap-foot>
</table-wrap>
<p>To assess whether the ability of the predicted prognosis of different LN staging systems was affected by artificially determined cut-off values, the LN status was modeled as a continuous variable for repeated analysis. The results showed that the LODDS system was superior to other staging systems and was not affected by the NDLN. It is worth noting that PLN always showed the worst prognostic discriminative ability regardless of whether the NDLN was sufficient.</p>
<p>We created scatter plots to explain the relationship between LNR and LODDS. As shown in Figure <xref ref-type="fig" rid="F3">3A</xref>, when patients have different LNR, the LODDS has a one-to-one mapping value for each LNR, and as the LNR increases, the value of LODDS increases. This indicates a close correlation between LODDS and LNR (except when LNR &#x0003D; 0 or 1). Thus, both contain the same prognostic information. However, as shown in Figures <xref ref-type="fig" rid="F3">3B,C</xref>, when the LNR is close to 0 or 1, the value of LODDS is heterogeneous.</p>
<fig id="F3" position="float">
<label>Figure 3</label>
<caption><p><bold>(A)</bold> The scatter plots of LODDS vs. LNR; <bold>(B)</bold> The magnified view of <bold>(A)</bold> for LNR between 0 to 0.25; <bold>(C)</bold> The magnified view of A for LNR between 0.75 to 1. (LNR, lymph node ratio; LODDS, log odds of positive lymph nodes).</p></caption>
<graphic xlink:href="fonc-08-00671-g0003.tif"/>
</fig></sec></sec>
<sec sec-type="discussion" id="s4">
<title>Discussion</title>
<p>Regional LN metastasis of malignant tumors is one of the main metastatic patterns of CRC. LN status is also considered to be one of the most important prognostic parameters for recurrence and death after CRC resection. Therefore, accurate staging of LN status can more accurately predict cancer risk and lead to the development of postoperative treatment options for patients with CRC (<xref ref-type="bibr" rid="B16">16</xref>). A number of LN staging systems have been proposed to accurately describe LN status, including AJCC/UICC N staging, LNR, and the LODDS staging systems. Among them, the AJCC/UICC N staging system is widely recognized and used in clinical practice, but some scholars question its accuracy (<xref ref-type="bibr" rid="B19">19</xref>, <xref ref-type="bibr" rid="B27">27</xref>&#x02013;<xref ref-type="bibr" rid="B31">31</xref>). Some researchers have shown that the NPLN is significantly correlated with the NDLN, especially when the NDLN is insufficient, which may lead to the missed PLN, resulting in staging migration (<xref ref-type="bibr" rid="B6">6</xref>, <xref ref-type="bibr" rid="B7">7</xref>, <xref ref-type="bibr" rid="B16">16</xref>). LNR is a ratio-based LN status estimation method that considers both the NPLN and NPDLN. Many researchers have demonstrated that it is a better independent prognostic factor than the AJCC/UICC N staging in rectal cancer or colon cancer (<xref ref-type="bibr" rid="B27">27</xref>&#x02013;<xref ref-type="bibr" rid="B31">31</xref>). Ozawa et al. studied the prognostic ability of LNR in stage IV CRC and found that patients with the same AJCC/UICC N staging group had 23% higher OS in the low LNR group than the high LNR group (<xref ref-type="bibr" rid="B32">32</xref>). This further illustrates that subgroups of patients with the same AJCC/UICC N stage can be divided into significantly different prognostic subgroups by the LNR system, and other studies have reached similar conclusions (<xref ref-type="bibr" rid="B17">17</xref>, <xref ref-type="bibr" rid="B18">18</xref>). LODDS is another staging system that describes the LN status and has great potential to further improve the accuracy of LN staging for predicting prognosis. Persiani et al. used multivariate regression analysis to compare the accuracy of different LN staging systems in estimating the prognosis of colon cancer (<xref ref-type="bibr" rid="B24">24</xref>). That study demonstrated that LODDS is an independent prognostic factor, further showing that LODDS is more accurate than LNR in assessing colon cancer survival, and other researchers have used similar methods to draw similar conclusions (<xref ref-type="bibr" rid="B5">5</xref>, <xref ref-type="bibr" rid="B21">21</xref>, <xref ref-type="bibr" rid="B26">26</xref>, <xref ref-type="bibr" rid="B33">33</xref>). However, they did not use statistical methods to directly compare the discriminative ability of different LN staging system models.</p>
<p>In our study, we used two statistical indicators, the AIC and the c-index, to analyze the relative discriminative ability of different LN staging systems in predicting CRC survival in a CRC patient population. We first analyzed LN status as a continuous variable. We found that LODDS is superior to PLN and LNR. When we analyzed LN status as a categorical variable, we showed that the two LNR staging systems were superior to other staging systems.</p>
<p>There is still controversy regarding the categorical cut-off values for different LN staging systems. The reason for heterogeneity in the cut-off values is multifactorial. First, different studies used different statistical methods to determine these optimal cut-off values. For example, Song et al. used log-rank statistical methods (<xref ref-type="bibr" rid="B34">34</xref>), Rosenberg et al. used categorical and regression tree techniques (<xref ref-type="bibr" rid="B17">17</xref>), Berger et al. used the quartile method (<xref ref-type="bibr" rid="B16">16</xref>), Kornprat et al. used the receiver operating characteristic (ROC) statistical method (<xref ref-type="bibr" rid="B35">35</xref>), and Wang et al. used the X-tile program (<xref ref-type="bibr" rid="B26">26</xref>). In addition, different countries and research institutions, differences in patient numbers, and different average NDLN also lead to the diversity in cut-off values.</p>
<p>In addition to LN status and categorical cut-off values, many studies have shown that the NDLN has a significant impact on patient prognosis. Le Voyer et al. showed that an increase in the NDLN was significantly associated with improved OS (<xref ref-type="bibr" rid="B7">7</xref>). The National Comprehensive Cancer Network (NCCN) guidelines recommend at least 12 NDLN for accurate staging. However, the NDLN in clinically resected specimens can vary greatly. In our study, the proportion of patients with insufficient NDLN reached 29.4%. In view of this, we conducted a subgroup study based on different NDLN to analyze the prognostic accuracy of each LN staging system. We divided patients into two subgroups according to the NDLN: NDLN &#x0003C; 12 and NDLN &#x02265; 12.</p>
<p>Therefore, we conducted a comprehensive study based on LN status (continuous variable and categorical variable) and the NDLN. When analyzed as a categorical variable, the LNR of Rosenberg et al. (<xref ref-type="bibr" rid="B17">17</xref>) was the best staging system when the NDLN &#x0003C; 12. However, in patients with NDLN &#x02265; 12, AJCC/UICC N staging is the most accurate system for predicting patient outcomes. When analyzed as a continuous variable, LODDS showed the best discrimination ability regardless of the NDLN.</p>
<p>Many studies have shown that evaluating the LN status as a continuous variable reveals its true performance, so LODDS is a more accurate staging system than LNR in predicting CRC patient OS (<xref ref-type="bibr" rid="B36">36</xref>). We further illustrated the relationship between LNR and LODDS through scatter plots. Figure <xref ref-type="fig" rid="F3">3</xref> shows that the overall trend of LNR and LODDS is consistent. However, when the LNR is around 0 or 1, the value of LODDS is heterogeneous, indicating that LODDS has a better discriminating power for patients with very low or high LNR. Some researchers believe that because of the lack of consensus on the cut-off values of different LN staging systems, LN status should be treated as a continuous variable (<xref ref-type="bibr" rid="B36">36</xref>). However, we believe that ignoring the cut-off values and using the LN status as a continuous variable cannot be applied in clinical practice. Thus, it has only theoretical value and no practical clinical value. Although LODDS is the best staging system, LODDS has no advantage over other staging systems when considering the impact of categorical cut-off values on staging systems. Therefore, optimal cut-off values should be calculated to make the LODDS staging system more useful for clinical practice.</p>
<p>The innovations of this study are as follows. First, the SEER data offers the unique opportunity to study prognostic elements in a larger number of patients. Second, in seeking the best staging system, we took the cut-off values of each staging system into account. However, there are limitations to our results, and we advise appropriate caution in their interpretation. This is a retrospective study based on the SEER database, so there will inevitably be some selection bias. The SEER database lacks some clinical information such as operative time, specific surgical procedures, lymph and/or vascular invasion, and specific locations of LN metastasis. Additionally, these results may not be applicable to other populations as they were based on Western patient data. Whether the use of this staging system could be applied to daily practice in Eastern countries, therefore, requires to be further validated. However, these shortcomings are common to any retrospective and population-based research. Finally, we believe that the patient data for this study is large and these shortcomings can be largely compensated by long-term follow-up.</p></sec>
<sec sec-type="conclusions" id="s5">
<title>Conclusions</title>
<p>In conclusion, we believe that regardless of the adequacy of the NDLN, LODDS is the most accurate staging system for predicting the survival of patients with CRC. However, the best LODDS cut-off values that can be applied to clinical practice have not been calculated. Therefore, the LNR staging system of Rosenberg et al. with cut-off values of 0.17, 0.41, and 0.69 should be introduced to the AJCC/UICC system as supplements when the NDLN are insufficient.</p></sec>
<sec id="s6">
<title>Author Contributions</title>
<p>J-PP, C-DZ, and D-QD designed this study. J-PP and C-DZ performed search and collected data. Y-CF re-checked data. J-PP and C-DZ performed analysis. J-PP wrote the manuscript. C-DZ and D-QD reviewed the manuscript.</p>
<sec>
<title>Conflict of Interest Statement</title>
<p>The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p></sec></sec>
</body>
<back>
<ack><p>We acknowledge the efforts of the Surveillance, Epidemiology, and End Results (SEER) Program tumor registries for creating the SEER database. We thank International Science Editing (<ext-link ext-link-type="uri" xlink:href="http://www.internationalscienceediting.com">http://www.internationalscienceediting.com</ext-link>) for editing this manuscript.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="B1">
<label>1.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Siegel</surname> <given-names>RL</given-names></name> <name><surname>Miller</surname> <given-names>KD</given-names></name> <name><surname>Fedewa</surname> <given-names>SA</given-names></name> <name><surname>Ahnen</surname> <given-names>DJ</given-names></name> <name><surname>Rgs</surname> <given-names>M</given-names></name> <name><surname>Barzi</surname> <given-names>A</given-names></name> <etal/></person-group>. <article-title>Colorectal cancer statistics, 2017</article-title>. <source>CA Cancer J Clin.</source> (<year>2017</year>) <volume>67</volume>:<fpage>104</fpage>&#x02013;<lpage>17</lpage>. <pub-id pub-id-type="doi">10.3322/caac.21395</pub-id><pub-id pub-id-type="pmid">28248415</pub-id></citation></ref>
<ref id="B2">
<label>2.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Compton</surname> <given-names>CC</given-names></name> <name><surname>Greene</surname> <given-names>FL</given-names></name></person-group>. <article-title>The staging of colorectal cancer: 2004 and beyond</article-title>. <source>CA Cancer J Clin.</source> (<year>2010</year>) <volume>54</volume>:<fpage>295</fpage>&#x02013;<lpage>308</lpage>. <pub-id pub-id-type="doi">10.3322/canjclin.54.6.295</pub-id><pub-id pub-id-type="pmid">15537574</pub-id></citation></ref>
<ref id="B3">
<label>3.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Amin</surname> <given-names>MB</given-names></name> <name><surname>Greene</surname> <given-names>FL</given-names></name> <name><surname>Edge</surname> <given-names>SB</given-names></name> <name><surname>Compton</surname> <given-names>CC</given-names></name> <name><surname>Gershenwald</surname> <given-names>JE</given-names></name> <name><surname>Brookland</surname> <given-names>RK</given-names></name> <etal/></person-group>. <article-title>The eighth edition ajcc cancer staging manual: continuing to build a bridge from a population-based to a more &#x0201C;personalized&#x0201D; approach to cancer staging</article-title>. <source>CA Cancer J Clin</source>. (<year>2017</year>) <volume>67</volume>:<fpage>93</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.3322/caac.21388</pub-id><pub-id pub-id-type="pmid">28094848</pub-id></citation></ref>
<ref id="B4">
<label>4.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rice</surname> <given-names>TW</given-names></name> <name><surname>Rusch</surname> <given-names>VW</given-names></name> <name><surname>Ishwaran</surname> <given-names>H</given-names></name> <name><surname>Blackstone</surname> <given-names>EH</given-names></name></person-group>. <article-title>Cancer of the esophagus and esophagogastric junction</article-title>. <source>Cancer</source> (<year>2010</year>) <volume>116</volume>:<fpage>3763</fpage>&#x02013;<lpage>73</lpage>. <pub-id pub-id-type="doi">10.1002/cncr.25146</pub-id><pub-id pub-id-type="pmid">20564099</pub-id></citation></ref>
<ref id="B5">
<label>5.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Arslan</surname> <given-names>NC</given-names></name> <name><surname>Sokmen</surname> <given-names>S</given-names></name> <name><surname>Canda</surname> <given-names>AE</given-names></name> <name><surname>Terzi</surname> <given-names>C</given-names></name> <name><surname>Sarioglu</surname> <given-names>S</given-names></name></person-group>. <article-title>The prognostic impact of the log odds of positive lymph nodes in colon cancer</article-title>. <source>Colorectal Dis.</source> (<year>2015</year>) <volume>16</volume>:<fpage>O386</fpage>&#x02013;<lpage>92</lpage>. <pub-id pub-id-type="doi">10.1111/codi.12702</pub-id><pub-id pub-id-type="pmid">24980876</pub-id></citation></ref>
<ref id="B6">
<label>6.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tsai</surname> <given-names>HL</given-names></name> <name><surname>Lu</surname> <given-names>CY</given-names></name> <name><surname>Hsieh</surname> <given-names>JS</given-names></name> <name><surname>Wu</surname> <given-names>DC</given-names></name> <name><surname>Jan</surname> <given-names>CM</given-names></name> <name><surname>Chai</surname> <given-names>CY</given-names></name> <etal/></person-group>. <article-title>The prognostic significance of total lymph node harvest in patients with t 2&#x02013;4 n 0 m 0, colorectal cancer</article-title>. <source>J Gastrointest Surg.</source> (<year>2007</year>) <volume>11</volume>:<fpage>660</fpage>&#x02013;<lpage>5</lpage>. <pub-id pub-id-type="doi">10.1007/s11605-007-0119-x</pub-id></citation></ref>
<ref id="B7">
<label>7.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Le</surname> <given-names>VT</given-names></name> <name><surname>Sigurdson</surname> <given-names>ER</given-names></name> <name><surname>Hanlon</surname> <given-names>AL</given-names></name> <name><surname>Mayer</surname> <given-names>RJ</given-names></name> <name><surname>Macdonald</surname> <given-names>JS</given-names></name> <name><surname>Catalano</surname> <given-names>PJ</given-names></name> <etal/></person-group>. <article-title>Colon cancer survival is associated with increasing number of lymph nodes analyzed: a secondary survey of intergroup trial int-0089</article-title>. <source>J Clin Oncol.</source> (<year>2003</year>) <volume>21</volume>:<fpage>2912</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1200/JCO.2003.05.062</pub-id></citation></ref>
<ref id="B8">
<label>8.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kehoe</surname> <given-names>J</given-names></name> <name><surname>Khatri</surname> <given-names>VP</given-names></name></person-group>. <article-title>Staging and prognosis of colon cancer</article-title>. <source>Surg Oncol Clin N Am.</source> (<year>2006</year>) <volume>1</volume>:<fpage>129</fpage>&#x02013;<lpage>46</lpage>. <pub-id pub-id-type="doi">10.1016/j.soc.2005.08.006</pub-id></citation></ref>
<ref id="B9">
<label>9.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wong</surname> <given-names>SL</given-names></name> <name><surname>Ji</surname> <given-names>H</given-names></name> <name><surname>Hollenbeck</surname> <given-names>BK</given-names></name> <name><surname>Morris</surname> <given-names>AM</given-names></name> <name><surname>Baser</surname> <given-names>O</given-names></name> <name><surname>Birkmeyer</surname> <given-names>JD</given-names></name></person-group>. <article-title>Hospital lymph node examination rates and survival after resection for colon cancer</article-title>. <source>J Am Med Assoc.</source> (<year>2007</year>) <volume>298</volume>:<fpage>2149</fpage>&#x02013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1001/jama.298.18.2149</pub-id><pub-id pub-id-type="pmid">18000198</pub-id></citation></ref>
<ref id="B10">
<label>10.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Edler</surname> <given-names>D</given-names></name> <name><surname>Ohrling</surname> <given-names>K</given-names></name> <name><surname>Hallstr&#x000F6;m</surname> <given-names>M</given-names></name> <name><surname>Karlberg</surname> <given-names>M</given-names></name> <name><surname>Ragnhammar</surname> <given-names>P</given-names></name></person-group>. <article-title>The number of analyzed lymph nodes - a prognostic factor in colorectal cancer</article-title>. <source>Acta Oncol.</source> (<year>2007</year>) <volume>46</volume>:<fpage>975</fpage>&#x02013;<lpage>81</lpage>. <pub-id pub-id-type="doi">10.1080/02841860701203537</pub-id><pub-id pub-id-type="pmid">17917828</pub-id></citation></ref>
<ref id="B11">
<label>11.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Walker</surname> <given-names>R</given-names></name> <name><surname>Wood</surname> <given-names>T</given-names></name> <name><surname>LeSouder</surname> <given-names>E</given-names></name> <name><surname>Cleghorn</surname> <given-names>M</given-names></name> <name><surname>Maganti</surname> <given-names>M</given-names></name> <name><surname>MacNeill</surname> <given-names>A</given-names></name> <etal/></person-group>. <article-title>Comparison of two novel staging systems with the tnm system in predicting stage iii colon cancer survival</article-title>. <source>J Surg Oncol.</source> (<year>2018</year>) <volume>117</volume>:<fpage>1049</fpage>&#x02013;<lpage>57</lpage>. <pub-id pub-id-type="doi">10.1002/jso.25009</pub-id><pub-id pub-id-type="pmid">29473957</pub-id></citation></ref>
<ref id="B12">
<label>12.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shen</surname> <given-names>F</given-names></name> <name><surname>Cui</surname> <given-names>J</given-names></name> <name><surname>Cai</surname> <given-names>K</given-names></name> <name><surname>Pan</surname> <given-names>H</given-names></name> <name><surname>Bu</surname> <given-names>H</given-names></name> <name><surname>Yu</surname> <given-names>F</given-names></name></person-group>. <article-title>Prognostic accuracy of different lymph node staging systems in rectal adenocarcinoma with or without preoperative radiation therapy</article-title>. <source>Jpn J Clin Oncol.</source> (<year>2018</year>) <volume>48</volume>: <fpage>625</fpage>&#x02013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1093/jjco/hyy070</pub-id></citation></ref>
<ref id="B13">
<label>13.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tamura</surname> <given-names>M</given-names></name> <name><surname>Matsumoto</surname> <given-names>I</given-names></name> <name><surname>Saito</surname> <given-names>D</given-names></name> <name><surname>Yoshida</surname> <given-names>S</given-names></name> <name><surname>Takata</surname> <given-names>M</given-names></name> <name><surname>Takemura</surname> <given-names>H</given-names></name></person-group>. <article-title>Lymph node ratio as a prognostic factor in patients with pathological n2 non-small cell lung cancer</article-title>. <source>World J Surg Oncol.</source> (<year>2016</year>) <volume>14</volume>:<fpage>295</fpage>. <pub-id pub-id-type="doi">10.1186/s12957-016-1048-5</pub-id><pub-id pub-id-type="pmid">27884195</pub-id></citation></ref>
<ref id="B14">
<label>14.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ataseven</surname> <given-names>B</given-names></name> <name><surname>K&#x000FC;mmel</surname> <given-names>S</given-names></name> <name><surname>Weikel</surname> <given-names>W</given-names></name> <name><surname>Heitz</surname> <given-names>F</given-names></name> <name><surname>Holtschmidt</surname> <given-names>J</given-names></name> <name><surname>Lorenz-Salehi</surname> <given-names>F</given-names></name> <etal/></person-group>. <article-title>Additional prognostic value of lymph node ratio over pn staging in different breast cancer subtypes based on the results of 1,656 patients</article-title>. <source>Arch Gynecol Obstet.</source> (<year>2015</year>) <volume>291</volume>:<fpage>1153</fpage>&#x02013;<lpage>66</lpage>. <pub-id pub-id-type="doi">10.1007/s00404-014-3528-6</pub-id><pub-id pub-id-type="pmid">25367604</pub-id></citation></ref>
<ref id="B15">
<label>15.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Smith</surname> <given-names>DD</given-names></name> <name><surname>Nelson</surname> <given-names>RA</given-names></name> <name><surname>Schwarz</surname> <given-names>RE</given-names></name></person-group>. <article-title>A comparison of five competing lymph node staging schemes in a cohort of resectable gastric cancer patients</article-title>. <source>Ann Surg Oncol.</source> (<year>2014</year>) <volume>21</volume>:<fpage>875</fpage>&#x02013;<lpage>82</lpage>. <pub-id pub-id-type="doi">10.1245/s10434-013-3356-0</pub-id><pub-id pub-id-type="pmid">24242677</pub-id></citation></ref>
<ref id="B16">
<label>16.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Berger</surname> <given-names>AC</given-names></name> <name><surname>Sigurdson</surname> <given-names>ER</given-names></name> <name><surname>Levoyer</surname> <given-names>T</given-names></name> <name><surname>Hanlon</surname> <given-names>A</given-names></name> <name><surname>Mayer</surname> <given-names>RJ</given-names></name> <name><surname>Macdonald</surname> <given-names>JS</given-names></name> <etal/></person-group>. <article-title>Colon cancer survival is associated with decreasing ratio of metastatic to examined lymph nodes</article-title>. <source>J Clin Oncol.</source> (<year>2005</year>) <volume>23</volume>:<fpage>8706</fpage>&#x02013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1200/JCO.2005.02.8852</pub-id><pub-id pub-id-type="pmid">16314630</pub-id></citation></ref>
<ref id="B17">
<label>17.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Rosenberg</surname> <given-names>R</given-names></name> <name><surname>Engel</surname> <given-names>J</given-names></name> <name><surname>Bruns</surname> <given-names>C</given-names></name> <name><surname>Heitland</surname> <given-names>W</given-names></name> <name><surname>Hermes</surname> <given-names>N</given-names></name> <name><surname>Jauch</surname> <given-names>KW</given-names></name> <etal/></person-group>. <article-title>The prognostic value of lymph node ratio in a population-based collective of colorectal cancer patients</article-title>. <source>Ann Surg.</source> (<year>2010</year>) <volume>251</volume>:<fpage>1070</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1097/SLA.0b013e3181d7789d</pub-id><pub-id pub-id-type="pmid">20485149</pub-id></citation></ref>
<ref id="B18">
<label>18.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>J</given-names></name> <name><surname>Hassett</surname> <given-names>JM</given-names></name> <name><surname>Dayton</surname> <given-names>MT</given-names></name> <name><surname>Kulaylat</surname> <given-names>MN</given-names></name></person-group>. <article-title>Lymph node ratio: role in the staging of node-positive colon cancer</article-title>. <source>Ann Surg Oncol.</source> (<year>2008</year>) <volume>15</volume>:<fpage>1600</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1245/s10434-007-9716-x</pub-id><pub-id pub-id-type="pmid">18327530</pub-id></citation></ref>
<ref id="B19">
<label>19.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>HY</given-names></name> <name><surname>Choi</surname> <given-names>HJ</given-names></name> <name><surname>Park</surname> <given-names>KJ</given-names></name> <name><surname>Shin</surname> <given-names>JS</given-names></name> <name><surname>Kwon</surname> <given-names>HC</given-names></name> <name><surname>Roh</surname> <given-names>MS</given-names></name> <etal/></person-group>. <article-title>Prognostic significance of metastatic lymph node ratio in node-positive colon carcinoma</article-title>. <source>Ann Surg Oncol.</source> (<year>2007</year>) <volume>14</volume>:<fpage>1712</fpage>&#x02013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1245/s10434-006-9322-3</pub-id><pub-id pub-id-type="pmid">17253102</pub-id></citation></ref>
<ref id="B20">
<label>20.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Huang</surname> <given-names>B</given-names></name> <name><surname>Chen</surname> <given-names>C</given-names></name> <name><surname>Ni</surname> <given-names>M</given-names></name> <name><surname>Mo</surname> <given-names>S</given-names></name> <name><surname>Cai</surname> <given-names>G</given-names></name> <name><surname>Cai</surname> <given-names>S</given-names></name></person-group>. <article-title>Log odds of positive lymph nodes is a superior prognostic indicator in stage iii rectal cancer patients: a retrospective analysis of 17,632 patients in the seer database</article-title>. <source>Int J Surg.</source> (<year>2016</year>) <volume>32</volume>:<fpage>24</fpage>&#x02013;<lpage>30</lpage>. <pub-id pub-id-type="doi">10.1016/j.ijsu.2016.06.002</pub-id><pub-id pub-id-type="pmid">27321382</pub-id></citation></ref>
<ref id="B21">
<label>21.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lee</surname> <given-names>CW</given-names></name> <name><surname>Wilkinson</surname> <given-names>KH</given-names></name> <name><surname>Sheka</surname> <given-names>AC</given-names></name> <name><surname>Leverson</surname> <given-names>GE</given-names></name> <name><surname>Kennedy</surname> <given-names>GD</given-names></name></person-group>. <article-title>The log odds of positive lymph nodes stratifies and predicts survival of high-risk individuals among stage iii rectal cancer patients</article-title>. <source>Oncologist</source> (<year>2016</year>) <volume>21</volume>:<fpage>425</fpage>&#x02013;<lpage>32</lpage>. <pub-id pub-id-type="doi">10.1634/theoncologist.2015-0441</pub-id><pub-id pub-id-type="pmid">26975865</pub-id></citation></ref>
<ref id="B22">
<label>22.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sun</surname> <given-names>Z</given-names></name> <name><surname>Xu</surname> <given-names>Y</given-names></name> <name><surname>Li de</surname> <given-names>M</given-names></name> <name><surname>Wang</surname> <given-names>ZN</given-names></name> <name><surname>Zhu</surname> <given-names>GL</given-names></name> <name><surname>Huang</surname> <given-names>BJ</given-names></name> <etal/></person-group>. <article-title>Log odds of positive lymph nodes: a novel prognostic indicator superior to the number-based and the ratio-based n category for gastric cancer patients with r0 resection</article-title>. <source>Cancer</source> (<year>2010</year>) <volume>116</volume>:<fpage>2571</fpage>&#x02013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1002/cncr.24989</pub-id><pub-id pub-id-type="pmid">20336791</pub-id></citation></ref>
<ref id="B23">
<label>23.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Chen</surname> <given-names>LJ</given-names></name> <name><surname>Chung</surname> <given-names>KP</given-names></name> <name><surname>Chang</surname> <given-names>YJ</given-names></name> <name><surname>Chang</surname> <given-names>YJ</given-names></name></person-group>. <article-title>Ratio and log odds of positive lymph nodes in breast cancer patients with mastectomy</article-title>. <source>Surg Oncol.</source> (<year>2015</year>) <volume>24</volume>:<fpage>239</fpage>&#x02013;<lpage>47</lpage>. <pub-id pub-id-type="doi">10.1016/j.suronc.2015.05.001</pub-id><pub-id pub-id-type="pmid">26055316</pub-id></citation></ref>
<ref id="B24">
<label>24.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Persiani</surname> <given-names>R</given-names></name> <name><surname>Cananzi</surname> <given-names>FCM</given-names></name> <name><surname>Biondi</surname> <given-names>A</given-names></name> <name><surname>Paliani</surname> <given-names>G</given-names></name> <name><surname>Tufo</surname> <given-names>A</given-names></name> <name><surname>Ferrara</surname> <given-names>F</given-names></name> <etal/></person-group>. <article-title>Log odds of positive lymph nodes in colon cancer: a meaningful ratio-based lymph node classification system</article-title>. <source>World J Surg.</source> (<year>2012</year>) <volume>36</volume>:<fpage>667</fpage>&#x02013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.1007/s00268-011-1415-x</pub-id><pub-id pub-id-type="pmid">22270984</pub-id></citation></ref>
<ref id="B25">
<label>25.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>La</surname> <given-names>TM</given-names></name> <name><surname>Nigri</surname> <given-names>G</given-names></name> <name><surname>Petrucciani</surname> <given-names>N</given-names></name> <name><surname>Cavallini</surname> <given-names>M</given-names></name> <name><surname>Aurello</surname> <given-names>P</given-names></name> <name><surname>Cosenza</surname> <given-names>G</given-names></name> <etal/></person-group>. <article-title>Prognostic assessment of different lymph node staging methods for pancreatic cancer with r0 resection: pn staging, lymph node ratio, log odds of positive lymph nodes</article-title>. <source>Pancreatology</source> (<year>2014</year>) <volume>14</volume>:<fpage>289</fpage>&#x02013;<lpage>94</lpage>. <pub-id pub-id-type="doi">10.1016/j.pan.2014.05.794</pub-id></citation></ref>
<ref id="B26">
<label>26.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname> <given-names>J</given-names></name> <name><surname>Hassett</surname> <given-names>JM</given-names></name> <name><surname>Dayton</surname> <given-names>MT</given-names></name> <name><surname>Kulaylat</surname> <given-names>MN</given-names></name></person-group>. <article-title>The prognostic superiority of log odds of positive lymph nodes in stage iii colon cancer</article-title>. <source>J Gastrointest Surg.</source> (<year>2008</year>) <volume>12</volume>:<fpage>1790</fpage>&#x02013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.1007/s11605-008-0651-3</pub-id><pub-id pub-id-type="pmid">18709510</pub-id></citation></ref>
<ref id="B27">
<label>27.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>In Ja</surname> <given-names>P</given-names></name> <name><surname>Sik</surname> <given-names>YC</given-names></name> <name><surname>Seok-Byung</surname> <given-names>L</given-names></name> <name><surname>Sik</surname> <given-names>YY</given-names></name> <name><surname>Wook</surname> <given-names>KC</given-names></name> <name><surname>Tae Won</surname> <given-names>K</given-names></name> <etal/></person-group>. <article-title>Ratio of metastatic lymph nodes is more important for rectal cancer patients treated with preoperative chemoradiotherapy</article-title>. <source>World J Gastroenterol.</source> (<year>2015</year>) <volume>21</volume>:<fpage>3274</fpage>&#x02013;<lpage>81</lpage>. <pub-id pub-id-type="doi">10.3748/wjg.v21.i11.3274</pub-id></citation></ref>
<ref id="B28">
<label>28.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Leonard</surname> <given-names>D</given-names></name> <name><surname>Remue</surname> <given-names>C</given-names></name> <name><surname>Orabi</surname> <given-names>NA</given-names></name> <name><surname>Maanen</surname> <given-names>AV</given-names></name> <name><surname>Danse</surname> <given-names>E</given-names></name> <name><surname>Dragean</surname> <given-names>A</given-names></name> <etal/></person-group>. <article-title>Lymph node ratio and surgical quality are strong prognostic factors of rectal cancer: results from a single referral centre</article-title>. <source>Colorectal Dis.</source> (<year>2016</year>) <volume>18</volume>:<fpage>O175</fpage>&#x02013;<lpage>84</lpage>. <pub-id pub-id-type="doi">10.1111/codi.13362</pub-id><pub-id pub-id-type="pmid">27128602</pub-id></citation></ref>
<ref id="B29">
<label>29.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Lykke</surname> <given-names>J</given-names></name> <name><surname>Jess</surname> <given-names>P</given-names></name> <name><surname>Roikjaer</surname> <given-names>O</given-names></name> <name><surname>Group</surname> <given-names>DCC</given-names></name></person-group>. <article-title>The prognostic value of lymph node ratio in a national cohort of rectal cancer patients</article-title>. <source>Eur J Surg Oncol.</source> (<year>2016</year>) <volume>42</volume>:<fpage>504</fpage>&#x02013;<lpage>12</lpage>. <pub-id pub-id-type="doi">10.1016/j.ejso.2016.01.012</pub-id><pub-id pub-id-type="pmid">26856955</pub-id></citation></ref>
<ref id="B30">
<label>30.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhou</surname> <given-names>D</given-names></name> <name><surname>Ye</surname> <given-names>M</given-names></name> <name><surname>Bai</surname> <given-names>Y</given-names></name> <name><surname>Rong</surname> <given-names>L</given-names></name> <name><surname>Hou</surname> <given-names>Y</given-names></name></person-group>. <article-title>Prognostic value of lymph node ratio in survival of patients with locally advanced rectal cancer</article-title>. <source>Can J Surg J.</source> (<year>2015</year>) <volume>58</volume>:<fpage>237</fpage>&#x02013;<lpage>44</lpage>. <pub-id pub-id-type="doi">10.1503/cjs.001515</pub-id><pub-id pub-id-type="pmid">26022151</pub-id></citation></ref>
<ref id="B31">
<label>31.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Peschaud</surname> <given-names>F</given-names></name> <name><surname>Benoist</surname> <given-names>S</given-names></name> <name><surname>Juli&#x000E9;</surname> <given-names>C</given-names></name> <name><surname>Beauchet</surname> <given-names>A</given-names></name> <name><surname>Penna</surname> <given-names>C</given-names></name> <name><surname>Rougier</surname> <given-names>P</given-names></name> <etal/></person-group>. <article-title>The ratio of metastatic to examined lymph nodes is a powerful independent prognostic factor in rectal cancer</article-title>. <source>Ann Surg.</source> (<year>2008</year>) <volume>248</volume>:<fpage>1067</fpage>&#x02013;<lpage>73</lpage>. <pub-id pub-id-type="doi">10.1097/SLA.0b013e31818842ec</pub-id><pub-id pub-id-type="pmid">19092352</pub-id></citation></ref>
<ref id="B32">
<label>32.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ozawa</surname> <given-names>T</given-names></name> <name><surname>Ishihara</surname> <given-names>S</given-names></name> <name><surname>Nishikawa</surname> <given-names>T</given-names></name> <name><surname>Tanaka</surname> <given-names>T</given-names></name> <name><surname>Tanaka</surname> <given-names>J</given-names></name> <name><surname>Kiyomatsu</surname> <given-names>T</given-names></name> <etal/></person-group>. <article-title>Prognostic significance of the lymph node ratio in stage iv colorectal cancer patients who have undergone curative resection</article-title>. <source>Ann Surg Oncol.</source> (<year>2015</year>) <volume>22</volume>:<fpage>1513</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1245/s10434-014-4184-6</pub-id><pub-id pub-id-type="pmid">25398278</pub-id></citation></ref>
<ref id="B33">
<label>33.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Scarinci</surname> <given-names>A</given-names></name> <name><surname>Di</surname> <given-names>TC</given-names></name> <name><surname>Cavaniglia</surname> <given-names>D</given-names></name> <name><surname>Neri</surname> <given-names>T</given-names></name> <name><surname>Colletti</surname> <given-names>M</given-names></name> <name><surname>Cosenza</surname> <given-names>G</given-names></name> <etal/></person-group>. <article-title>The impact of log odds of positive lymph nodes (lodds) in colon and rectal cancer patient stratification: a single-center analysis of 323 patients</article-title>. <source>Updates Surg.</source> (<year>2018</year>) <volume>70</volume>:<fpage>23</fpage>&#x02013;<lpage>31</lpage>. <pub-id pub-id-type="doi">10.1007/s13304-018-0519-3</pub-id><pub-id pub-id-type="pmid">29500795</pub-id></citation></ref>
<ref id="B34">
<label>34.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Song</surname> <given-names>YX</given-names></name> <name><surname>Gao</surname> <given-names>P</given-names></name> <name><surname>Wang</surname> <given-names>ZN</given-names></name> <name><surname>Tong</surname> <given-names>LL</given-names></name> <name><surname>Xu</surname> <given-names>YY</given-names></name> <name><surname>Sun</surname> <given-names>Z</given-names></name> <etal/></person-group>. <article-title>Which is the most suitable classification for colorectal cancer, log odds, the number or the ratio of positive lymph nodes?</article-title> <source>PLoS ONE</source> (<year>2011</year>) <volume>6</volume>:<fpage>e28937</fpage>. <pub-id pub-id-type="doi">10.1371/journal.pone.0028937</pub-id></citation></ref>
<ref id="B35">
<label>35.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Kornprat</surname> <given-names>P</given-names></name> <name><surname>Pollheimer</surname> <given-names>MJ</given-names></name> <name><surname>Lindtner</surname> <given-names>RA</given-names></name> <name><surname>Schlemmer</surname> <given-names>A</given-names></name> <name><surname>Rehak</surname> <given-names>P</given-names></name> <name><surname>Langner</surname> <given-names>C</given-names></name></person-group>. <article-title>Value of tumor size as a prognostic variable in colorectal cancer: a critical reappraisal</article-title>. <source>Am J Clin Oncol.</source> (<year>2011</year>) <volume>34</volume>:<fpage>43</fpage>&#x02013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1097/COC.0b013e3181cae8dd</pub-id><pub-id pub-id-type="pmid">20101166</pub-id></citation></ref>
<ref id="B36">
<label>36.</label>
<citation citation-type="journal"><person-group person-group-type="author"><name><surname>Spolverato</surname> <given-names>G</given-names></name> <name><surname>Ejaz</surname> <given-names>A</given-names></name> <name><surname>Kim</surname> <given-names>Y</given-names></name> <name><surname>Squires</surname> <given-names>MH</given-names></name> <name><surname>Poultsides</surname> <given-names>G</given-names></name> <name><surname>Fields</surname> <given-names>RC</given-names></name> <etal/></person-group>. <article-title>Prognostic performance of different lymph node staging systems after curative intent resection for gastric adenocarcinoma</article-title>. <source>Ann Surg.</source> (<year>2015</year>) <volume>262</volume>:<fpage>991</fpage>&#x02013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1097/SLA.0000000000001040</pub-id><pub-id pub-id-type="pmid">25563867</pub-id></citation></ref>
</ref-list> <fn-group>
<fn fn-type="financial-disclosure"><p><bold>Funding.</bold> C-DZ was supported in part by Japan China Sasakawa Medical Fellowship.</p>
</fn>
</fn-group>
</back>
</article> 