Published online Jul 29, 2019.
https://doi.org/10.4174/astr.2019.97.2.58
Clinical validation of the 2017 international consensus guidelines on intraductal papillary mucinous neoplasm of the pancreas
Abstract
Purpose
The 2017 international consensus guidelines (ICG) for intraductal papillary mucinous neoplasm (IPMN) of the pancreas were recently released. Important changes included the addition of worrisome features such as elevated serum CA 19-9 and rapid cyst growth (>5 mm over 2 years). We aimed to clinically validate the 2017 ICG and compare the diagnostic performance between the 2017 and 2012 ICG.
Methods
This was a retrospective cohort study. During January 2000–January 2017, patients who underwent complete surgical resection and had pathologic confirmation of branch-duct or mixed-type IPMN were included. To evaluate diagnostic performance, the areas under the receiver operating curves (AUCs) were evaluated.
Results
A total of 448 patients were included. The presence of mural nodule (hazard ratio [HR], 9.12; 95% confidence interval [CI], 4.60–18.09; P = 0.001), main pancreatic duct dilatation (>5 mm) (HR, 5.32; 95% CI, 2.67–10.60; P = 0.001), thickened cystic wall (HR, 3.40; 95% CI, 1.51–7.63; P = 0.003), and elevated CA 19-9 level (>37 unit/mL) (HR, 5.25; 95% CI, 2.05–13.42; P = 0.001) were significantly associated with malignant IPMN. Malignant lesions showed a cyst growth rate >5 mm over 2 years more frequently than benign lesions (60.9% vs. 29.7%, P = 0.012). The AUC was higher for the 2017 ICG than the 2012 ICG (0.784 vs. 0.746).
Conclusion
The new 2017 ICG for IPMN is clinically valid, with a superior diagnostic performance to the 2012 ICG. The inclusion of elevated serum CA 19-9 level and cyst growth rate to the 2017 ICG is appropriate.
INTRODUCTION
In 1996, intraductal papillary mucinous neoplasm (IPMN) of the pancreas was designated as an independent disease by the World Health Organization (WHO) [1]. Whereas mainduct type IPMN has a high malignant potential and warrants surgical resection, surgical indications for branch-duct type IPMN (BD-IPMN) or mixed-type IPMN remain controversial due to their low malignant potential. The first and second editions of the international consensus guidelines (ICG) for the management of IPMN of the pancreas were introduced in 2006 and 2012, respectively [2, 3]. The 2012 ICG proposed three high-risk stigmata (obstructive jaundice in a patient with a cystic lesion of the head of the pancreas, enhancing mural nodule ≥5 mm, main pancreatic duct [MPD] size ≥10 mm) and five worrisome features (cyst size ≥3 cm, enhancing mural nodule <5 mm, thickened/enhancing cyst walls, 5–9 mm of MPD size, and abrupt change in caliber of the pancreatic duct with distal pancreatic atrophy). Patients who were diagnosed with BD-IPMN under these guidelines were recommended to undergo complete surgical resection. One study reported that the 2012 ICG provided the practical validity for predicting malignant BD-IPMN [4].
In 2015, more conservative guidelines were released by the American Gastroenterological Association (AGA) [5]. They suggested less aggressive resection criteria and more conservative surveillance criteria than the 2012 guidelines. However, some studies questioned the limited evidence of these guidelines and proposed their revision [6, 7, 8].
Recently, the new 2017 ICG were released [9]. Only limited changes have been introduced compared to the 2012 ICG, with the addition of two worrisome features, such as increased serum CA 19-9 and a rapid cyst growth (>5 mm per 2 years) [10, 11, 12]. However, these features have not undergone rigorous clinical validation. Therefore, this study sought to investigate the usefulness of the parameters proposed by the 2017 ICG, clinically validate the 2017 ICG and compare the diagnostic performance between the 2017 and 2012 ICG.
METHODS
Patients and materials
This was a retrospective cohort study with prospectively collected clinicopathological data from electronic medical records in accordance with the protocol of our institution. We included patients admitted to the Department of Surgery of our hospital between January 2000 and January 2017 who underwent complete surgical resection and had been pathologically confirmed with BD-IPMN or mixed-type IPMN.
BD-IPMN was defined as a >5-mm-sized pancreatic cyst that communicated with the MPD, which was not dilated on radiologic examination, such as multidetector computed tomography (MDCT), MRI, or endoscopic ultrasonography (EUS) [9]. Mixed-type IPMN was defined as BD-IPMN with MPD dilatation >5 mm without any obstructive lesions. Clinical valuables included the patient's age, sex, preoperative MPD size, IPMN diameter measured by radiology, IPMN type, surgery type, location of IPMN, pathologic grade, mural nodule, cyst wall thickness, lymph node enlargement, jaundice, preoperative serum CEA and CA 19-9 levels, and cyst growth rates.
This study was approved by the Institutional Review Board (approval number: C-1609-055-790), and all patients consented to participate in this study.
Diagnostic modalities
All patients who were diagnosed with suspected IPMN underwent MDCT using either the Brilliance 64 (Philips Medical Systems, Cleveland, OH, USA) or LightSpeed Ultra (GE Healthcare, Little Chalfont, UK). MRI (Magnetom Verio; Siemens Healthcare, Erlangen, Germany) or EUS was performed as required. The MPD and cyst diameter were measured at the maximal point, on the 3-mm-thick axial and coronal images of the portal venous phase, using a picture archiving and communication system (Marosis M-view; Marotech, Seoul, Korea). Each radiologic parameter was reviewed by one surgeon and one radiologist.
Pathologic evaluation
Specimens were serially transected at a thickness of 5–7 mm and all slides were reviewed by a pancreatic pathology specialist in our institute. The grade of IPMN was classified by 2015 WHO criteria [13]. Low-grade dysplasia was considered as benign, and high-grade dysplasia (HGD) and IPMN with an associated invasive carcinoma were considered as malignant.
Statistical analysis
Categorical variables were compared using the chi-square test. Continuous variables were compared using Student t-test. Variables for which P < 0.05 in univariate analysis were entered into a multivariate logistic regression (LR) model to find significant predictors and estimate the hazard ratios (HRs) for the corresponding predictors. Data was considered statistically significant when P < 0.05 in 2-tailed testing.
The diagnostic performance of the 2012 and 2017 ICG were compared based on the predictability of malignancy, which was measured as the area under the receiver operating curves (AUCs). Receiver operating curves were calculated using tenfold cross-validation of each of 3 statistical models: LR, support vector machine (SVM), and random forest (RF). As the numbers of patients with benign and malignant tumors were different, the same number of individuals from the benign group as in the malignant group were randomly selected during each tenfold cross-validation. This procedure was repeated 100 times and mean AUCs were calculated for both guidelines. A tenfold cross-validation using the LR model was performed to determine statistically driven cutoff values for continuous predictors.
All statistical analyses used IBM SPSS Statistics ver. 22.0 (IBM Co., Armonk, NY, USA) and R ver. 3.3.3 (R Foundation for Statistical Computing, Vienna, Austria).
RESULTS
A total of 448 patients were included in this study (Table 1). Mean age was 64.7 years and the male to female ratio was 1.4. The majority of lesions were located on the pancreatic head (55.6%), with a mean cyst size of 32.0 mm, and a mean MPD diameter of 5 mm.
Table 1
Baseline characteristics of patients with branch-duct/mixed type intraductal papi llary mucinous neoplasm
Out of 448 patients, 148 patients (33.0%) had a pathologically malignant lesion (HGD [n = 58, 12.9%] or IPMN with invasive carcinoma [n = 90, 20.1%]). Compared to patients with benign lesions, their age was typically older (66.3 years vs. 63.9 years, P = 0.008), their cyst sizes were larger (35.0 mm vs. 30.5 mm, P = 0.002), and their MPD diameters were larger (7 mm vs. 4 mm, P = 0.001). Malignant lesions were more frequently located on the pancreatic head versus the benign lesions (62.8% vs. 52.0%, P = 0.001).
Diagnostic parameters predicting malignant BD/mixed type IPMN
Table 2 shows the univariate analysis and the diagnostic values of each parameter. Parameters significantly associated with the malignancy in the univariate analysis included MPD dilatation (>5 mm) (54.7% vs. 22.0%, P = 0.001), the presence of mural nodule (62.8% vs. 12.7%, P = 0.001), thickened cystic wall (38.5% vs. 10.3%, P = 0.001), abrupt change in MPD diameter (19.3% vs. 4.1%, P = 0.001), lymphadenopathy (5.2% vs. 0.4%, P = 0.002), elevated CEA level (>5 ng/mL) (6.8% vs. 2.3%, P = 0.046), and elevated CA 19-9 level (>37 unit/mL) (60.9% vs. 29.7%, P = 0.012). For the 87 patients who underwent imaging surveillance for at least 2 years, lesions showing >5 mm growth over 2 years were more frequently malignant compared to benign lesions (60.9% vs. 29.7%, P = 0.012). The presence of a mural nodule had the highest balanced accuracy (79.2%), followed by elevated CA 19-9 level (72.9%) and thickened cystic wall (72.7%). A cystic growth rate >5 mm over 2 years had a balanced accuracy of 67.8%.
Table 2
Univariate analysis and diagnostic value of each parameter
In our multivariate analysis, the presence of mural nodule (HR, 9.12; 95% confidence interval [CI], 4.60–18.09; P = 0.001), MPD dilatation (>5 mm) (HR, 5.32; 95% CI, 2.67–10.60; P = 0.001), thickened cystic wall (HR, 3.40; 95% CI, 1.51–7.63; P = 0.003), and elevated CA 19-9 level (>37 unit/mL) (HR, 5.25; 95% CI, 2.05–13.42; P = 0.001) were independent risk factors for malignant branch-duct (BD)/mixed type IPMN (Table 3). Cyst growth rate was removed from the LR model because only 87 patients (19.4%) were evaluated.
Table 3
Predictive factors for malignant branch-duct type intraductal papillary mucinous neoplasm
After the risk factors for predicting malignant lesion were selected, diagnostic values were calculated according to the number of risk factors (Table 4). Sensitivity, specificity, positive predictive value (PPV), and balanced accuracy increased as the number of risk factors increased.
Table 4
Diagnostic value according to the number of risk factors
Comparison of the diagnostic performance of the 2012 and 2017 ICG
AUCs using three statistical methods (LR, SVM, and RF) were evaluated based on the 87 patients who had data on cystic growth rates. All of the AUCs were higher with the 2017 ICG than with the 2012 ICG (SVM, 0.686 vs. 0.650; LR, 0.784 vs. 0.746; RF, 0.787 vs. 0.758).
DISCUSSION
Following the 2006 and 2012 ICG for the management of IPMN [2, 3], research intensified to gather the evidence needed to support these guidelines. Particularly in the case of BD/mixed type IPMN, where large-scaled retrospective studies suggest that the BD/mixed type IPMN has only a 5%–20% likelihood of invasiveness [14, 15, 16, 17, 18, 19], the question of whether surgical resection or regular surveillance is preferable is an important issue. BD/mixed type IPMN without high-risk or worrisome features has been defined by the 2012 guidelines not to warrant surgical resection [3]. The associated decline in unnecessary surgeries had led to a decrease in surgery-related mortality, morbidity, and medical costs.
In 2015, the AGA released new guidelines with lesser aggressive resection criteria and more conservative surveillance criteria than those of the 2012 guidelines [5]. However, these changes were not without controversy. In terms of detecting malignant IPMN, one study reported that 45% of malignant IPMNs were not detected following the AGA guidelines [20]. In regards to the surveillance, new-onset pancreatic cancer [21], and the IPMNs with new-onset high risk stigmata and/or worrisome features were observed beyond 5 years of surveillance [7]. One study recommended continued surveillance beyond 5 years because the overall risk rate of malignancy was 8% during 10 years of surveillance [6]. The present guideline revision was focused on addressing these issues [9].
In 2017, the ICG for IPMN were revised to include 2 new factors: elevated serum CA 19-9 level and cyst growth rate [9]. Although the role of elevated CEA has been controversial, elevated serum CA 19-9 has been reported as a useful predictive marker for malignant IPMNs [12, 15, 22]. In the present study, elevated serum CA 19-9 (>37 U/mL) was strongly associated with malignancy in a multivariate analysis (HR, 5.25; 95% CI, 2.05–13.42; P < 0.001) (Table 3), and had a high diagnostic accuracy (72.9%, Table 2). Laboratory criteria benefit greatly from their relative objectivity compared to preoperative radiologic interpretation. Therefore, the introduction of serum CA 19-9 to the guidelines would be reasonable and improve diagnostic accuracy.
Some studies suggested that a cyst growth rate >2–4 mm per year could be a risk factor for malignant BD/mixed type IPMN [10, 11, 15]. One large-scale study revealed that benign BD-IPMNs observed for >5 years grew slowly at a rate of only 0.8 mm per year [23]. Therefore, growth of 2–4 mm per year is relatively rapid. In the 2017 ICG, the cyst growth rate >5 mm in 2 years was added to the worrisome features. In the present study, the cyst growth rate >5 mm in 2 years was observed more frequently in malignant lesions, and the predictive accuracy was 67.8% in the univariate analysis (Table 2). However, it was not entered into the multivariate analysis due to insufficient data. In order to overcome this limitation, large-cohort studies with long-term surveillance data should be performed.
In our multivariate analysis, mural nodule, dilated MPD, thickened cyst wall, and elevated CA 19-9 level (>37 U/mL) were associated with malignancy (Table 3). The diagnostic validity was evaluated according to the number of risk factors (Table 4). According to these results, if a patient had at least 2 risk factors, the resection would be appropriate because the PPV was over 40% and the balanced accuracy was nearly 80%. Furthermore, the possibility of malignant IPMN was greater than 90% when at least three risk factors were present. Several nomograms able to quantify the possibility of malignancy were released, which combined the risk factors based on the multivariate LR [24, 25]. Therefore, these nomograms can be valuable tools to accurately predict malignant IPMNs.
Whether cystic size is a risk factor or not remains controversial. In the 2017 ICG, a cyst size >3 cm is a worrisome feature [9]. However, recent studies argue that cystic size is not associated with malignant BD-IPMNs [26, 27, 28]. In the present study, cystic size was not associated with malignancy in the univariate analysis, and it had the lowest diagnostic accuracy (54.5%) among the potential risk factors (Table 2). Cyst size alone could not be an absolute indication for resection [4]. However, larger IPMNs tended to have more risk factors and, thus, greater malignant potential [23]. Therefore, larger IPMNs should be observed carefully with standardized protocols.
Jang et al. [4] reported the superior diagnostic performance of the 2012 ICG over the 2006 ICG by using 3 statistical methods (LR, SVM, and RF). In the present study, the same methods were utilized and the AUC values of the 2017 ICG were further improved over the 2012 ICG. The introduction of elevated serum CA 19-9 and a rapid cyst growth rate increased the diagnostic performance of the 2017 ICG.
Despite the strengths of this study, it does have its limitations. It was a single-center retrospective study. All patients had pathologic diagnosis after surgical resection. Many small cysts without worrisome features were excluded due to the lack of a pathologic diagnosis. Only patients who had both postoperative radiologic surveillance data and pathologic results were included in the analysis of cystic growth rate. Therefore, the number of patients available for evaluating cyst growth rate was limited; and therefore, the LR could not include this feature. A future study based on long-term regular surveillance would be needed to more fully address the role of cystic growth rate. Despite of these shortcomings, all the patients in the present study underwent diagnostic examination with standardized protocols, and the radiologic parameters were reviewed again by both a surgeon and a radiologist to improve diagnostic concordance.
In conclusion, the new 2017 ICG for IPMN are clinically valid with improved diagnostic performance over the previous 2012 guidelines. The introduction of elevated serum CA 19-9 level and cyst growth rate to the 2017 guidelines is appropriate.
CONFLICTS OF INTEREST:No potential conflict of interest relevant to this article was reported.
ACKNOWLEDGEMENTS
This research was supported by grants of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI16C2037), and by the Collaborative Genome Program for Fostering New Post-Genome Industry of the National Research Foundation funded by the Ministry of Science and ICT (NRF-2017M3C9A5031591).
References
-
Kloppel G, Solcia E, Longnecker D, Capella C, Sobin L. Histological typing of tumors of the exocrine pancreas. In: Kloppel G, Solcia E, Longnecker D, Capella C, Sobin L, editors. Histological classification of tumors of the exocrine pancreas. 2nd ed. Berlin: Springer-Verlag; 1996. pp. 7-9.
-
-
Singhi AD, Zeh HJ, Brand RE, Nikiforova MN, Chennat JS, Fasanella KE, et al. American Gastroenterological Association guidelines are inaccurate in detecting pancreatic cysts with advanced neoplasia: a clinicopathologic study of 225 patients with suppor t ing molecular data. Gastrointest Endosc 2016;83:1107–1117.e2.
-
-
Attiyeh MA, Fernandez-Del Castillo C, Al Efishat M, Eaton AA, Gonen M, Batts R, et al. Development and validation of a multi-institutional preoperative nomogram for predicting grade of dysplasia in intraductal papillary mucinous neoplasms (IPMNs) of the pancreas: a report from the pancreatic surgery consortium. Ann Surg 2018;267:157–163.
-