Score for predicting overall survival in pancreatic adenocarcinoma patients with positive lymph nodes after surgery: a novel nomogram-based risk assessment
Introduction
Pancreatic adenocarcinoma (PaC) represents one of the most lethal malignancies among humans. Surgical resection remains the mainstay therapy for PaC; nonetheless, <20% of patients are considered candidates for resection (1,2), and the 5-year survival remains disappointing even if a curative resection is performed (3-5). It is likely that the implementation of a reasonable treatment strategy remains imperfect. Considering the high rate of postoperative local recurrence (6), most PaC patients will ultimately die from local progression.
The National Comprehensive Cancer Network (NCCN) guidelines clearly state that PaC patients with positive lymph nodes (PLN-PaCs) are specific individuals with a high recurrence risk (7). While lymph node (LN) status is a strong prognosticator for overall survival (OS) (8), insufficient LN examination may lead to the misclassification of N1 disease as N0 disease in some PaC patients (9). Therefore, PLN-PaCs with a high recurrence risk should be regarded as a population distinct from other PaC patients.
The American Joint Committee on Cancer (AJCC) staging system is currently the tool widely used by oncologists for predicting the prognosis of PaC patients (10). However, the AJCC staging system does not consider specific individuals, including the tumor differentiation grade (11), therapy method (12,13), and number of regional LNs examined. In reality, various factors can influence the cancer course and prognosis of PaC patients, and refining and establishing a new model for specific individuals (i.e., PLN-PaCs) are thus important.
The use of a nomogram, a novel statistical prediction model, can accurately estimate individual survival and guide plans for follow-up by integrating multiple factors (14). Furthermore, several studies have indicated the favorable results of nomogram (15) and its utility in various cancers (16-19). To date, an effective nomogram for PLN-PaCs has never been developed. Hence, the present study aimed to explore critical prognostic factors and construct a novel nomogram for predicting the prognosis of PLN-PaCs based on the Surveillance, Epidemiology, and End Results (SEER) database, which contains data from a large population. Furthermore, the novel nomogram was validated using data from Guangdong Provincial People’s Hospital in China.
We present the following article in accordance with the TRIPOD reporting checklist (available at http://dx.doi.org/10.21037/gs-20-597).
Methods
Patient selection
Data of PLN-PaCs were acquired from the SEER database using SEER*Stat software version 8.3.5 (www.seer.cancer.gov/seerstat). These patients were selected based on the 2nd and 3rd editions of the International Classification of Diseases for Oncology (ICD-O-2/3), and “8140/3” was used as the ICD-O-3 diagnosis to identify PaC.
Patients were included only if they were PLN-PaCs. The exclusion criteria were as follows: fewer than 11 regional LNs examined or unknown number of regional LNs; distant metastases; receiving other forms of treatment aside from surgery; survival time ≤1 month; second primary cancer; and missing or incomplete data (Figure 1).
Data processing
A total of 1,340 eligible PLN-PaCs from the SEER database were finally included in our retrospective study based on the above mentioned inclusion and exclusion criteria. External validation data (n=64) were collected from Guangdong Provincial People’s Hospital in China. Data on pathological and clinical variables [e.g., age at diagnosis, sex, tumor size, tumor differentiation, tumor-node-metastasis (TNM) stage, chemotherapy, radiotherapy, LNs] as well as follow-up information were extracted from the Guangdong Provincial People’s Hospital and SEER databases. LN ratio (LNR) was defined as the ratio of the number of metastasized LNs to the total number of resected LNs. Information on TNM-8th edition staging was gathered based on the 7th edition of the AJCC staging system (2010+), and tumor size and number of PLNs were used to estimate the AJCC-8th edition stage.
Risk factors were extensively evaluated by conducting a univariate analysis of all included variables, and a multivariate analysis was adopted to select independent risk factors. A nomogram was constructed based on these independent risk factors and was validated in both training and external validation cohorts.
Nomogram development and external validation
For nomogram construction, PLN-PaCs (n=1,340) from the SEER database [2010–2015] were randomly divided at a ratio of 7:3 into a training set (n=940) and an internal validation set (n=400). The training set was used to construct the nomogram, and the benefits of the novel model were evaluated by internal and external validation. The second cohort consisted of patients from Guangdong Provincial People’s Hospital (n=64) and was used as an external validation cohort [2010–2019]. Furthermore, the predictive power of the established nomogram was compared with that of the 8th edition of the TNM staging system.
Statistical analyses
Baseline patient demographics and disease features were compared using the chi-square test or Fisher’s exact test, as appropriate. Statistical analyses were performed using SPSS software version 25 (IBM Corp., Armonk, NY, USA). Cox multivariate regression and the nomogram were constructed using the rms package in R version 3.6.1 (http://www.r-project.org/). For outcome-based optimization, the best cut-off points for age, LNR, tumor size, and nomogram score (nomo-score) were calculated using X-tile software (Yale School of Medicine, New Haven, CT, USA). P values were two-sided, and P values lower than 0.05 were considered statistically significant. The C-index and area under the receiver operating characteristic (ROC) curve (AUC) were used to evaluate the discriminative ability of the nomogram (20). Calibration curves were utilized to examine the association between actual outcomes and predicted probabilities (21). The clinical usefulness and benefits of the prediction model were estimated using decision curve analyses (DCA) (22).
Ethical statement
The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).
Results
Characteristics of PLN-PaCs
The PLN-PaCs (n=1,340) from the SEER database were randomly divided at a ratio of 7:3 into a training set (n=940) and an internal validation set (n=400). For these PLN-PaCs from the SEER database, the median survival time (MST) was 20 months, whereas the 1-, 2-, and 3-year OS rates were 70.5%, 40.3%, and 25.1%, respectively.
A total of 64 PLN-PaCs from Guangdong Provincial People’s Hospital were allocated to the external validation set. The clinicopathological characteristics, including age, sex, radiotherapy, chemotherapy, and TNM stage, are summarized in Table 1. The MST was 23.8 months, whereas the 1-, 2-, and 3-year OS rates were 77.3%, 47.5%, and 30.7%, respectively. Additionally, for these 64 PLN-PaCs, the median disease-free survival (DFS) was 10.3 months, whereas the 1-, 2-, and 3-year DFS rates were 44.3%, 26.8%, and 22.4%, respectively.
Full table
Screening of prognostic factors for PLN-PaCs
Multivariate analysis was performed to identify independent prognostic factors in the training set. In order to avoid the influence of tumor size on AJCC T stage and of AJCC N stage on LNR, tumor size and AJCC N stage were not included in the multivariate analysis. Univariate and multivariate analyses revealed that age, tumor differentiation grade, LNR, AJCC T stage, radiotherapy, and chemotherapy were independent prognostic factors for OS (Table 2).
Full table
Nomogram construction
Based on the above mentioned results of multivariate analysis from the training set, we integrated these independent prognostic factors to establish a satisfactory nomogram for OS prediction in PLN-PaCs (Figure 2). The detailed scores of all variables in the nomogram are presented in Table S1. By summing the detailed score of each variable, we could obtain a nomo-score to predict the possibility of 1-, 2-, and 3-year OS, with a higher nomo-score indicating worse prognosis.
Validation and calibration of the nomogram
With respect to the 1-, 2-, and 3-year OS, the AUC values indicated better discriminative ability for this model than for the traditional AJCC-8th edition staging system in the training set (1-year: 0.717 vs. 0.565, 2-year: 0.675 vs. 0.549, 3-year: 0.678 vs. 0.562; Figure 3A,B), internal validation set (1-year: 0.721 vs. 0.577, 2-year: 0.719 vs. 0.541, 3-year: 0.700 vs. 0.544; Figure 3C,D), and external validation set (1-year: 0.898 vs. 0.626, 2-year: 0.748 vs. 0.677, 3-year: 0.775 vs. 0.629; Figure 3E,F). Furthermore, the nomogram had a higher C-index than the AJCC staging system only in the training set (0.658 vs. 0.546) and internal validation set (0.661 vs. 0.546). The C-index of the nomogram was also higher than that of the AJCC staging system in the external validation set (0.691 vs. 0.581).
The calibration curves indicated an acceptable agreement between the actual and predicted outcomes for the 1-, 2-, and 3-year probabilities of OS in the training set (Figure 3G), internal validation set (Figure 3H), and external validation set (Figure 3I). Importantly, the DCA of clinical applicability revealed that the established nomogram had greater net benefits across a range of death risk than the AJCC-8th edition staging system in the training cohort (Figure 4).
Performance of the nomogram in stratifying patient risk
The training set was stratified into three risk groups according to the nomo-score, with the cut-off value determined by X-tile software—namely, low-risk group: 0≤ nomo-score ≤174; middle-risk group: 177< nomo-score ≤262; and high-risk group: nomo-score >264. Kaplan-Meier survival curves for OS in the three risk groups according to the nomo-score were plotted (Figure 5), which showed an obvious grading ability based on the new risk group model (P<0.001).
Discussion
PaC is a heterogeneous disease that may lead to different prognoses in different patients, even after radical resection (23). PLN-PaCs are a population distinct from PaC patients owing to their low resection rates and high recurrence risk, making prognostic studies on PLN-PaCs who had undergone surgical resection difficult. Several previous studies have attempted to predict the prognosis of PaC patients; nevertheless, most of these studies lack representativeness because they were based on a broad pancreatic cancer population and had no restrictions on pathological type, specific individuals, number of regional LNs examined, or surgery status (24,25). Therefore, developing and validating an effective nomogram with better applicability for PLN-PaCs is still necessary. To the best of our knowledge, the present study is the first large-sample study to identify critical prognostic factors for PLN-PaCs. Importantly, we established an easy-to-use nomogram based on clinicopathological and personalized characteristics to predict the prognosis of specific PaC individuals at a personal level, which is consistent with the concept of individualized treatment for cancer patients.
In the present study, we established a novel nomogram for PLN-PaCs by integrating age, tumor differentiation grade, AJCC T stage, LNR, chemotherapy, and radiotherapy. In the clinic, the 1-, 2-, and 3-year OS rates can be easily predicted using this nomogram, as it only includes six parameters, all of which are easy to acquire. Importantly, our nomogram exhibited higher predictive power than the AJCC-8th edition staging system in both the training and validation sets, which was confirmed by the higher C-indexes and AUC values. The most likely reason for this is that the AJCC staging system takes the tumor size, number of PLNs, and metastasis into consideration; however, the differentiation grade and number of regional LNs examined are also independent critical factors for survival (26-28).
Indubitably, higher tumor differentiation grade and AJCC T stage are strongly associated with worse survival, as shown in our study and other previous investigations (25,29). Unsurprisingly, LN status is an important predictor of survival. Recommendations for the number of LNs that should be examined range from 11 to 20 (30-35) in the case of pancreatectomy, and variable LNR categories are discussed in various studies (34-36). Additionally, several studies have reported that LNR may be a better prognostic indicator than the total number of positive nodes in node-positive patients (30,37). Consequently, a sufficient number of regional LNs examined and accurate LNR enable accurate staging of patients and diminish the disparities in survival outcomes. To avoid understaging, we selected PLN-PaCs who underwent pancreatectomy and had at least 11 removed and examined LNs in our study. Our results indicated worse survival for PLN-PaCs who underwent pancreaticoduodenectomy and had ≥11 LNs examined than for those who had <11 LNs evaluated [MST: 14 vs. 20 months; hazard ratio (HR), 0.7; 95% confidence interval (CI), 0.61–0.80; P<0.0001]. Moreover, our analysis showed that a greater LNR resulted in worse survival (HR, 1.88; 95% CI, 1.51–2.34; P<0.001).
Currently, adjuvant multi-agent chemotherapy followed by surgical resection is strongly recommended for resected PaCs (38). Correspondingly, our study also showed that chemotherapy was a protective factor, which was consistent with the findings of a clinical randomized controlled trial (39,40).
Nevertheless, whether the administration of adjuvant radiotherapy to patients with resected PaC has a different effect on prognosis remains controversial. Some investigators argued that adjuvant radiotherapy did not significantly improve the OS of PaC patients, which was proven in our other studies (data are being published). However, we determined in our current study that radiotherapy was a critical factor that improved survival in PLN-PaCs. Based on the above mentioned results, the reasons for this may be that previous studies mixed up different histological types and recurrence risk groups in analyzing survival and did not identify specific individuals. Our results revealed that adjuvant radiotherapy did not improve survival in PaC patients with negative LNs (HR, 0.889; 95% CI, 0.788–1.004; P=0.06) but was a protective critical factor in PLN-PaCs (HR, 0.830; 95% CI, 0.700–0.990; P=0.03). The NCCN guidelines point out that the role of adjuvant radiotherapy is still being evaluated in clinical studies; nonetheless, these guidelines also suggest that PLN-PaCs may receive radiotherapy after resection, which is consistent with our results. As PaC is a heterogeneous disease that may lead to different prognoses in different patients even after radical resection, we should therefore treat specific PaC patients individually rather than generally.
The novel nomogram described in this study can be used to define a high-risk population with a total nomo-score of >264 among PLN-PaCs. As shown in Figure 5, the Kaplan–Meier survival curves for OS indicate an obvious grading ability according to the new risk group model. Additionally, this effective nomogram was established for the first time using a Western database and validated using an Eastern database, suggesting that it is applicable across races.
The present study has some limitations. First, our study was a retrospective observational study exposed to potential confounding bias; a larger multicenter prospective study may be required. Second, we not only constructed an easy-to-use model but also used an Eastern database for the external validation cohort. However, the sample for the external validation cohort was small, and some meaningful metrics, such as carbohydrate antigen 19-9, surgical margin, platelet-to-lymphocyte ratio, and oncogene expression, were lacking. Multidimensional factors pertaining to the tumor, microenvironment, and host should be considered in a good prediction model, as adding these factors may improve the quality of the nomogram. Therefore, a larger multicenter prospective study should be performed to verify the conclusions of our study.
Conclusions
Distinct clinical characteristics among different individuals lead to different outcomes after curative resection. We established a novel nomogram that combined clinicopathological features, AJCC T stage, and therapy methods, showed satisfactory predictive power in PLN-PaCs following surgical resection, and might be a good model for application in the clinic. Our easy-to-use nomogram could not only define a high-risk population based on the nomo-score but also indicate that adjuvant radiotherapy was a critical prognostic factor in PLN-PaCs. Based on these findings, more laboratory indexes and genetic information should be explored in the future to promote individualized treatment for PLN-PaCs.
Acknowledgments
Funding: This study was supported by the Guangdong Medical Science and Technology Research Fund (A2018128).
Footnote
Reporting Checklist: The authors have completed the TRIPOD reporting checklist. Available at http://dx.doi.org/10.21037/gs-20-597
Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form (available at http://dx.doi.org/10.21037/gs-20-597). The authors have no conflicts of interest to declare.
Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).
Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0/.
References
- Huang L, Jansen L, Balavarca Y, et al. Resection of pancreatic cancer in Europe and USA: an international large-scale study highlighting large variations. Gut 2019;68:130-9. [Crossref] [PubMed]
- Moyer MT GR. Pancreatic adenocarcinoma. N Engl J Med 2014;371:2140. [PubMed]
- Krempien R, Roeder F. Intraoperative radiation therapy (IORT) in pancreatic cancer. Radiat Oncol 2017;12:8. [Crossref] [PubMed]
- Zaki Azzam A, Alqarni A, Mahmoud Amin T. The role of intraoperative radiotherapy (IORT) in the management of patients with pancreatic and periampullary cancer: A single center experience. J Egypt Natl Canc Inst 2018;30:77-9. [Crossref] [PubMed]
- Hidalgo M. Pancreatic cancer. N Engl J Med 2010;362:1605-17. [Crossref] [PubMed]
- Song X, Shao Z, Liang H. Using the new INTRABEAM mobile intraoperative radiotherapy system during surgery for pancreatic cancer: a case report. J Med Case Rep 2019;13:23. [Crossref] [PubMed]
- Tempero MA, Malafa MP, Al-Hawary M, et al. Pancreatic Adenocarcinoma, Version 2.2017, NCCN Clinical Practice Guidelines in Oncology. J Natl Compr Canc Netw 2017;15:1028-61. [Crossref] [PubMed]
- Warschkow R, Tsai C, Köhn N, et al. Role of lymphadenectomy, adjuvant chemotherapy, and treatment at high-volume centers in patients with resected pancreatic cancer—a distinct view on lymph node yield. Langenbecks Arch Surg 2020;405:43-54. [Crossref] [PubMed]
- Eskander MF, de Geus SW, Kasumova GG, et al. Evolution and impact of lymph node dissection during pancreaticoduodenectomy for pancreatic cancer. Surgery 2017;161:968-76. [Crossref] [PubMed]
- Kamarajah SK, Burns WR, Frankel TL, et al. Validation of the American Joint Commission on Cancer (AJCC) 8th Edition Staging System for Patients with Pancreatic Adenocarcinoma: A Surveillance, Epidemiology and End Results (SEER) Analysis. Ann Surg Oncol 2017;24:2023-30.
- Schorn S, Demir IE, Haller B, et al. The influence of neural invasion on survival and tumor recurrence in pancreatic ductal adenocarcinoma - A systematic review and meta-analysis. Surg Oncol 2017;26:105-15. [Crossref] [PubMed]
- Aziz H, Zeeshan M, Jie T, et al. Neoadjuvant Chemoradiation Therapy Is Associated with Adverse Outcomes in Patients Undergoing Pancreaticoduodenectomy for Pancreatic Cancer. Am Surg 2019;85:1276-80. [Crossref] [PubMed]
- Loveday BPT, Lipton L, Thomson BN. Pancreatic cancer: An update on diagnosis and management. Aust J Gen Pract 2019;48:826-31. [Crossref] [PubMed]
- Iasonos A, Schrag D, Raj GV, et al. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol 2008;26:1364-70. [Crossref] [PubMed]
- Sternberg CN. Are nomograms better than currently available stage groupings for bladder cancer? J Clin Oncol 2006;24:3819-20. [Crossref] [PubMed]
- Tian T, Zhang P, Zhong F, et al. Nomogram construction for predicting survival of patients with non-small cell lung cancer with malignant pleural or pericardial effusion based on SEER analysis of 10,268 patients. Oncol Lett 2020;19:449-59. [PubMed]
- Han L, Dai W, Mo S, et al. Nomogram to predict the risk and survival of synchronous bone metastasis in colorectal cancer: a population-based real-world analysis. Int J Colorectal Dis 2020;35:1575-85. [Crossref] [PubMed]
- Fakhry C, Zhang Q, Nguyen-Tân PF, et al. Development and validation of nomograms predictive of overall and progression-free survival in patients with oropharyngeal cancer. J Clin Oncol 2017;35:4057-65. [Crossref] [PubMed]
- Lu Z, Yan W, Liang J, et al. Nomogram Based on Systemic Immune-Inflammation Index to Predict Survival of Tongue Cancer Patients Who Underwent Cervical Dissection. Front Oncol 2020;11;10:341.
- Wolbers M, Koller MT, Witteman JC, et al. Prognostic models with competing risks: methods and application to coronary risk prediction. Epidemiology 2009;20:555-61. [Crossref] [PubMed]
- Van Calster B, Nieboer D, Vergouwe Y, et al. A calibration hierarchy for risk models was defined: from utopia to empirical data. J Clin Epidemiol 2016;74:167-76. [Crossref] [PubMed]
- Van Calster B, Wynants L, Verbeek JFM, et al. Reporting and Interpreting Decision Curve Analysis: A Guide for Investigators. Eur Urol 2018;74:796-804. [Crossref] [PubMed]
- Ansari D, Althini C, Ohlsson H, et al. Early-onset pancreatic cancer: a population-based study using the SEER registry. Langenbeck’s Archives of Surgery 2019;404:565-71. [Crossref] [PubMed]
- Wu M, Li X, Zhang T, et al. Identification of a Nine-Gene Signature and Establishment of a Prognostic Nomogram Predicting Overall Survival of Pancreatic Cancer. Front Oncol 2019;9:996. [Crossref] [PubMed]
- He C, Zhang Y, Cai Z, et al. Overall survival and cancer-specific survival in patients with surgically resected pancreatic head adenocarcinoma: A competing risk nomogram analysis. J Cancer 2018;9:3156-67. [Crossref] [PubMed]
- Okamura Y, Yasukawa S, Narimatsu H, et al. The hENT1 expression is a predictor in patients with resected pancreatic cancer treated with adjuvant S-1 chemotherapy. Cancer Sci 2020;111:548-60. [Crossref] [PubMed]
- Hlavsa J, Cecka F, Zaruba P, et al. Tumor grade as significant prognostic factor in pancreatic cancer: validation of a novel TNMG staging system. Neoplasma 2018;65:637-43. [Crossref] [PubMed]
- Warschkow R, Widmann B, Beutner U, et al. The More the Better-Lower Rate of Stage Migration and Better Survival in Patients With Retrieval of 20 or More Regional Lymph Nodes in Pancreatic Cancer: A Population-Based Propensity Score Matched and Trend SEER Analysis. Pancreas 2017;46:648-57. [Crossref] [PubMed]
- Song W, Miao DL, Chen L. Nomogram for predicting survival in patients with pancreatic cancer. Onco Targets Ther 2018;11:539-45. [Crossref] [PubMed]
- Slidell MB, Chang DC, Cameron JL, et al. Impact of total lymph node count and lymph node ratio on staging and survival after pancreatectomy for pancreatic adenocarcinoma: a large, population-based analysis. Ann Surg Oncol 2008;15:165-74. [Crossref] [PubMed]
- Schwarz RE, Smith DD. Extent of lymph node retrieval and pancreatic cancer survival: information from a large US population database. Ann Surg Oncol 2006;13:1189-200. [Crossref] [PubMed]
- Tomlinson JS JS, Bentrem DJ, et al. Accuracy of staging node-negative pancreas cancer: a potential quality measure. Arch Surg 2007;142:767-723; discussion 773-4. [Crossref] [PubMed]
- Showalter TN, Winter KA, Berger AC, et al. The influence of total nodes examined, number of positive nodes, and lymph node ratio on survival after surgical resection and adjuvant chemoradiation for pancreatic cancer: a secondary analysis of RTOG 9704. Int J Radiat Oncol Biol Phys 2011;81:1328-35. [Crossref] [PubMed]
- Pawlik TM, Gleisner AL, Cameron JL, et al. Prognostic relevance of lymph node ratio following pancreaticoduodenectomy for pancreatic cancer. Surgery 2007;141:610-8. [Crossref] [PubMed]
- Sierzega M, Popiela T, Kulig J, et al. The Ratio of Metastatic Resected Lymph Nodes is an Independent Prognostic Factor in Patients With Node-positive Pancreatic Head Cancer. Pancreas 2006;33:240-5. [Crossref] [PubMed]
- Riediger H, Keck T, Wellner U, et al. The lymph node ratio is the strongest prognostic factor after resection of pancreatic cancer. J Gastrointest Surg 2009;13:1337-44. [Crossref] [PubMed]
- Ashfaq A, Pockaj BA, Gray RJ, et al. Nodal counts and lymph node ratio impact survival after distal pancreatectomy for pancreatic adenocarcinoma. J Gastrointest Surg 2014;18:1929-35. [Crossref] [PubMed]
- Strobel O, Neoptolemos J, Jager D, et al. Optimizing the outcomes of pancreatic cancer surgery. Nat Rev Clin Oncol 2019;16:11-26. [Crossref] [PubMed]
- Oettle H, Neuhaus P, Hochhaus A, et al. Adjuvant chemotherapy with gemcitabine and long-term outcomes among patients with resected pancreatic cancer: the CONKO-001 randomized trial. Jama 2013;310:1473-81. [Crossref] [PubMed]
- Maeda A, Boku N, Fukutomi A, et al. Randomized phase III trial of adjuvant chemotherapy with gemcitabine versus S-1 in patients with resected pancreatic cancer: Japan Adjuvant Study Group of Pancreatic Cancer (JASPAC-01). Jpn J Clin Oncol 2008;38:227-9. [Crossref] [PubMed]