Bing Lv
Kunhong Wang2
Yanting Shi- 1School of Computer Science and Technology, Shandong University of Technology, Zibo, Shandong, China
- 2Department of Gastroenterology, Zibo Central Hospital, Zibo, Shandong, China
Background and aims: Endoscopic ultrasonography (EUS) is commonly utilized in the diagnosis of pancreatic tumors, although as this modality relies primarily on the practitioner’s visual judgment, it is prone to result in a missed diagnosis or misdiagnosis due to inexperience, fatigue, or distraction. Deep learning (DL) techniques, which can be used to automatically extract detailed imaging features from images, have been increasingly beneficial in the field of medical image-based assisted diagnosis. The present systematic review included a meta-analysis aimed at evaluating the accuracy of DL-assisted EUS for the diagnosis of pancreatic tumors diagnosis.
Methods: We performed a comprehensive search for all studies relevant to EUS and DL in the following four databases, from their inception through February 2023: PubMed, Embase, Web of Science, and the Cochrane Library. Target studies were strictly screened based on specific inclusion and exclusion criteria, after which we performed a meta-analysis using Stata 16.0 to assess the diagnostic ability of DL and compare it with that of EUS practitioners. Any sources of heterogeneity were explored using subgroup and meta-regression analyses.
Results: A total of 10 studies, involving 3,529 patients and 34,773 training images, were included in the present meta-analysis. The pooled sensitivity was 93% (95% confidence interval [CI], 87–96%), the pooled specificity was 95% (95% CI, 89–98%), and the area under the summary receiver operating characteristic curve (AUC) was 0.98 (95% CI, 0.96–0.99).
Conclusion: DL-assisted EUS has a high accuracy and clinical applicability for diagnosing pancreatic tumors.
Systematic review registration: https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023391853, identifier CRD42023391853.
1 Introduction
Pancreatic tumors (PTs) are relatively common tumors of the digestive tract. Benign PTs include serous cystadenomas, mucinous cystadenomas, and intraductal papillary mucinous neoplasms (IPMNs), while malignant tumors include pancreatic ductal adenocarcinomas (PDACs), pancreatic neuroendocrine tumors (PNETs), and pancreatic adenosquamous carcinomas (PASCs). Overall, PDAC, which has a high degree of malignancy, is the most common type of pancreatic cancer (PC), and owing to a lack of obvious symptoms in the early stages along with rapid progression, it is often detected at a late stage (1). Studies have shown that the five-year survival rate for PDAC is only 8–10% (2). Different degrees of malignancy in PT, however, result in significantly different prognoses. PNET, for example, has a 5-year survival rate of > 60% when diagnosed as pathological grade 1 or 2, which are low-grade malignancies, whereas those diagnosed as grade 3, or a high-grade malignancy, have a 5-year survival rate of < 30% (3–5). The accurate and timely identification and staging of PT can help determine patient prognosis and the appropriate course of treatment.
Currently, computed tomography (CT), magnetic resonance imaging (MRI), and endoscopic ultrasound (EUS) are the primary modalities utilized for the diagnosis of PT. MRI and CT, however, are less sensitive for monitoring smaller pancreatic lesions, and also for differentiating between benign and malignant tumors (6, 7). By combining endoscopy with ultrasound, EUS provides a more accurate and complete display of the pancreatic structure and visualization of space-occupying lesions (8), and previous studies have shown that EUS performs well in the diagnosis of a variety of pancreatic masses, with higher accuracy than many other clinical diagnostic techniques (9, 10). Additionally, EUS-guided fine-needle aspiration/biopsy (EUS-FNA/EUS-FNB) allows for the quick and easy sampling of pathological tissue, further improving the accuracy of PT diagnoses (11). The primary method for the imaging-based diagnosis of PT in clinical practice still relies heavily on the visual judgment of the individual operating the endoscope, which is overly dependent on their experience, and can lead to missed diagnoses or misdiagnosed cases as the result of insufficient experience, fatigue, or distraction. Computer-aided diagnosis/detection (CAD) analyses medical image data and other data using computer technology to assist practitioners in more objectively, quickly, and accurately completing diagnostic work. Many studies have verified the feasibility of utilizing CAD in the process of image-based diagnosis (12–14).
In recent years, artificial intelligence (AI) technology has been increasingly utilized in various fields of medicine, such as image analysis, diagnostic recommendations, and clinical risk prediction, which has reduced medical errors, to a certain extent, and improved diagnostic efficiency (15). Sunwoo et al. (16), for example, used AI technology to analyze the diagnosis of brain metastases from MRI scans, and the sensitivity increased from 77.6% to 81.9%, while the reading time decreased from 114.4 seconds to 72.1 seconds. There are two primary methods for utilizing AI in the analysis of medical images for assisted diagnosis: diagnosis based on traditional machine learning methods and diagnosis based on deep learning (DL) methods.
As a branch of AI, traditional machine learning-based methods primarily involve the manual extraction of features and the selection of suitable classifiers for statistical analysis. DL, in turn, is a subset of machine learning. At the 2012 ImageNet Large Scale Visual Recognition Challenge (17), Krizhevsky et al. (18) proposed AlexNet, a deep convolutional neural network, that overwhelmingly won the competition and triggered a wave of DL in various fields. Compared to traditional machine learning, DL automates feature extraction in a data-driven manner, and is capable of learning deeper and more abstract features from the target data (19, 20). DL significantly improves accuracy in areas such as image classification, object detection, and semantic segmentation, and its performance exceeds that of traditional machine learning techniques (19, 21).
A previous meta-analysis showed that practitioners using EUS for the diagnosis of PT had a sensitivity of 85% (95% confidence interval [CI], 69–94%), specificity of 58% (95% CI, 40–74%), and accuracy of 75% (95% CI, 67–82%) (6). Dumitrescu et al. (22) conducted a meta-analysis of AI-assisted EUS for PC diagnosis, which included 10 studies; three used traditional machine learning techniques, and seven used DL techniques. The pooled sensitivity for the AI diagnoses was 92% (95% CI, 89–95%), and the pooled specificity was 90% (95% CI, 83–94%). We are hopeful that the results of these studies can be compared with the results of our meta-analysis as a way to evaluate the advantages of DL-assisted EUS for the diagnosis of PC.
In the present study, the accuracy of DL-assisted EUS in the diagnosis of PT was quantified through a meta-analysis, which aimed to provide comprehensive and objective evidence for its utilization in clinical practice. The primary outcome of the present study was the overall performance of DL in diagnosing PT, while the secondary outcome was the ability to compare DL and practitioners performing traditional EUS.
2 Methods
The present study followed the Preferred Reporting Items for Systematic Review and Meta-Analysis of Diagnostic Test Accuracy Studies (PRISMA-DTA) guidelines (23), the checklist for which is presented in Supplementary Table S1. Prior to its onset, the present study was registered with the International Prospective Register of Systematic Reviews (PROSPERO) (24) on January 25, 2023 (ID: CRD42023391853), and because all of the data analyzed were collected from the included literature, ethical approval was not required.
2.1 Search strategy
We performed searches for the present meta-analysis in four commonly used databases: PubMed, Embase, Web of Science, and the Cochrane Library database. The final search was conducted on February 21, 2023, and included all articles from the four databases, beginning at the time of their creation and ending at the time of the final search. The keywords which were searched relating to DL included “deep learning”, “artificial intelligence”, “machine learning”, “computer-aided”, “natural networks”, “image classification”, “object detection”, and “semantic segmentation”; those relating to EUS included “ultrasonography”, “ultrasound”, and “EUS”; and those relating to PT included “pancreas” and “pancreatic”. The detailed search strategy is presented in Supplementary Table S2.
2.2 Study selection
The inclusion criteria for the present study were as follows (1): studies using DL to detect PT; (2) detection based on EUS images or videos; (3) use of pathological findings or expert labeling as diagnostic criteria; (4) detailed description of the source and composition of the training and test sets; and (5) true positive (TP), false positive (FP), true negative (TN), and false negative (FN) values were obtained directly or indirectly. For studies with missing data, the corresponding author was contacted via email in order to fill in the blanks.
The exclusion criteria were as follows: (1) articles without raw data, such as reviews, comments, or letters; (2) not full-text articles; (3) TP, FP, TN, and FN data not included, or no response received from the corresponding author via email when attempting to gather the missing data.
The initial articles returned from the searches were screened for inclusion by KW and NW, based on the aforementioned criteria, and any disagreements were resolved through discussions with BL.
2.3 Data extraction
KW and TT independently extracted data from the included studies, and resolved any disagreements through discussion. The following information was collected from each included study: first author, year of publication, country or region, diagnostic criteria, number of patients, data source, number of training sets, DL algorithms, sensitivity, and specificity. For studies with multiple test results, we extracted the resulting data in the following order: prospective test set, external test set, and test set with the largest sample size. We also extracted diagnostic data regarding the EUS practitioners for comparison with the DL models.
2.4 Quality assessment
We utilized the Quality Assessment of Diagnostic Accuracy Studies version 2 (QUADAS-2) to assess the quality of the included studies, although to more accurately assess the DL models, we supplemented the patient selection section with the following questions: (1) “Was the composition of the training and test sets described?”; and (2) “Were imaging modalities and image/video quality described in detail?”. We also added the following questions to the index test section: (1) “Was the algorithm development and training processes described?”; and (2) “Does the model be evaluated using an independent test set?”.
2.5 Statistical analysis
We conducted our meta-analysis using a bivariate random-effects model to evaluate the performance of DL in the diagnosis of PT. We plotted a summary receiver operating characteristic (SROC) curve, and calculated the pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), area under the SROC curve (AUC), and 95% CIs. High sensitivity and PLR indicated that the DL model was suitable for confirming the diagnosis of PT; high specificity and low NLR indicated that the DL model was good at excluding patients who did not have the disease; and DOR and AUC are overall measures of diagnostic accuracy, with a high DOR and AUC indicating that the DL model was good at confirming and excluding PT.
Statistical heterogeneity was determined by the I2 statistic as follows: < 30% indicated low heterogeneity; 30–60% indicated moderate heterogeneity; and > 60% indicated high heterogeneity. Publication bias was analyzed using Deeks’ funnel plot asymmetry test, for which P < 0.05 indicated publication bias. We utilized subgroup analysis and meta-regression to identify sources of heterogeneity, and also to explore the diagnostic performance of the different subgroups, and we used Fagan plots to assess the clinical applicability of DL for the diagnosis of PT.
The quality of the included studies was assessed using Review Manager 5.4 (Cochrane Collaboration, Oxford, UK), while other statistics and charts were obtained using Stata/SE 16.0 (Stata, College Station, TX, USA).
3 Results
3.1 Included studies and quality assessment
Our initial search yielded 2,233 relevant articles, of which 322 duplicates were automatically removed by the software and 1,872 that were not relevant were manually excluded after reading the titles and abstracts. After reading the full-text, a total of ten articles were included in the present meta-analysis (25–34). The data extraction process is shown in Figure 1, and the details of the included studies are listed in Table 1.
Figure 1 Preferred Reporting Items for Systematic Review and Meta-Analysis of Diagnostic Test Accuracy Studies (PRISMA) flow diagram for study selection.
Table 1 Details of the included studies.
The QUADAS-2 tool was used to assess the quality of the included studies, one of which (26) used data-enhanced images for testing, and was deemed to have a high risk of bias in the index test section, while two (26, 27) failed to describe their patient selection processes and were considered, therefore, to have an unknown risk of bias in the patient selection section. The overall assessment results are shown in Figure 2.
Figure 2 Summary of risk of bias and applicability of concerns graph.
The 10 included studies encompassed 3,529 patients, with nine of the studies being retrospective while one was prospective (34). All of the studies used pathological findings as the diagnostic criteria, and seven studies were single-center (25, 26, 28–30, 32, 33) while three were multicenter (27, 31, 34); eight were from East Asia (25, 27–31, 33, 34) and two were from Europe (26, 32); six used plain EUS images (25, 27, 29, 30, 32, 34) while three used contrast-enhanced EUS (CEUS) images (28, 31, 33) and one used grey-scale, low-mechanical index (MI) contrast enhancement, high-MI color Doppler, and real-time elastography multiple imaging techniques (26); six studies used image classification algorithms (25, 26, 28, 30–32), one (30) used object detection algorithms, and three (27, 33, 34) used semantic segmentation algorithms; and six studies (25–27, 31–33) tested the model on an image basis, while four (28–30, 34) tested the model on a patient or video basis. The study aims, participant characteristics, types of lesions, and funding sources of the included studies are listed in Supplementary Table S3.
3.2 Study characteristics and data extraction
Tonozuka et al. (25) constructed a DL model using convolutional neural networks to identify patients with a normal pancreas (NP) versus those with chronic pancreatitis (CP) and PDAC. A total of 139 patients were included in their study – 76 with PDAC, 34 with CP, and 29 with NP, for whom the sensitivity and specificity were 92.4% and 84.1%, respectively.
Udriștoiu et al. (26) developed a convolutional neural network-based CAD system with long short-term memory neural networks to identify cases of chronic pseudotumoral pancreatitis (CPP), PNET, and PDAC. A total of 65 patients were included in their study – 30 with PDAC, 20 with CPP, and 15 with PNETs. The overall accuracy of their model was 98.26%. In the meta-analysis, we combined the sensitivity and specificity of these models for the diagnosis of PNET and PDAC.
Oh et al. (27) used DL techniques to automatically segment PT on EUS, and their study included 111 patients from 2 hospitals. Their model was tested using internal and external test sets, and the test results were extracted from the external test set for inclusion in the present meta-analysis.
Huang et al. (28) combined DL with traditional machine learning techniques to predict the preoperative invasiveness of PNETs. A total of 104 patients were included in their study, and the AUC of the DL model was 0.81 (95% CI, 0.62–1.00). We only extracted the test results from the DL model for the present meta-analysis.
Kuwahara et al. (29) created a DL model to distinguish between pancreatic and non-pancreatic cancer (NPC) cases, and their study included 933 patients with 9 pancreatic masses, including PDACs, PNETs, and CP. The test results were extracted from the video test set, and the accuracy and AUC of the DL model were 91% (95% CI, 85–95%) and 0.90 (95% CI, 0.84–0.97), respectively.
Tian et al. (30) performed a real-time diagnosis of PC or NPC based on an object detection algorithm compared with the results of EUS practitioners. Their study included 157 patients, 102 with PC and 55 with NPC. The sensitivity and specificity of their model were 95% and 75%, respectively, while those for the EUS practitioners were 80% and 87.5%, respectively.
Tong et al. (31) created a DL model for differentiating between PDAC and CP. In their study, 558 patients were recruited from 3 hospitals, including 414 patients with PADCs and 144 with CP. Data from one hospital were used for model training and internal testing, while those from the other two were used as the two external test cohorts. We combined the test results of the two external test cohorts for the present meta-analysis.
Vilas-Boas et al. (32) constructed a DL model for the identification of mucinous and non-mucinous pancreatic cystic lesions (PCLs), in which they included a total of 28 patients – 17 with mucinous PCLs and 11 with non-mucinous PCLs. The overall accuracy of their model was 98.5%.
Seo et al. (33) proposed a DL method for PC segmentation. A total of 150 patients with PC were included in this study. The sensitivity and specificity of this model were 89.0% and 98.1%, respectively.
Tang et al. (34) developed a DL-based CAD system to distinguish PC from benign pancreatic masses, for which they retrospectively collected the EUS images of 1,245 patients from multiple centers for training and testing, and also recruited 39 patients for prospective testing. The CAD system achieved an accuracy, sensitivity, and specificity of 93.8%, 90.9%, and 100%, respectively.
We performed a meta-analysis of the aforementioned studies, the results of which were the primary outcomes of the present study. Of the 10 studies included in the present meta-analysis, three (30, 31, 34) compared the diagnostic abilities of the DL model with those of the EUS practitioners. We extracted the data from these three groups and performed a comparative analysis, which was the secondary outcome of the present study.
3.3 Performance of DL
The pooled sensitivity of DL for diagnosing PT was 93% (95% CI, 87–96%; I2 = 96.08%), and the pooled specificity was 95% (95% CI, 89–98%; I2 = 98.09%) (Figure 3). The PLR was 18.2 (95% CI, 7.91–41.86), the NLR was 0.08 (95% CI, 0.04–0.15), and the DOR was 238.04 (95% CI, 76.3–742.61) (Supplementary Figures S1, S2). A PLR > 10 indicates that DL can accurately diagnose PT, while an NLR < 0.1 indicates that DL can effectively exclude PT and a DOR significantly > 1 indicates that DL has good discriminatory ability for PT. We plotted SROC curves to provide a more comprehensive assessment of the performance of the DL model (Figure 4), which showed an AUC of 0.98 (95% CI, 0.96–0.99). The AUC value was very close to 1, indicating that DL accurately diagnosed PT.
Figure 3 Forest plot of sensitivity and specificity of deep learning (DL) in identifying pancreatic tumors.
Figure 4 Summary receiver operating characteristic (SROC) curves for the diagnosis of pancreatic tumors using DL. Each circle indicates an individual study, red diamond represents summary sensitivity and specificity.
We evaluated the clinical application of DL in the diagnosis of PT using Fagan plots (Figure 5). When the pre-test probability was set at 50%, the probability of positive patients being diagnosed with PT was 95%, while the probability of negative patients being diagnosed with PT was 7%. These results indicate that DL has a high accuracy, and is an important clinical tool for the diagnosis of PT.
Figure 5 Fagan nomogram of the accuracy of DL in the diagnosis of pancreatic tumors.
3.4 Subgroup analysis and meta-regression
Although the pooled sensitivity, specificity, and DOR showed excellent diagnostic performance for DL, the I2 showed high heterogeneity; therefore, we performed a subgroup analysis with meta-regression to analyze the potential sources of heterogeneity. The grouping conditions were as follows: (1) imaging type – normal EUS images vs. other images, such as CEUS; (2) number of training set images – regardless of whether or not the training set had > 1,000 images, using 1,000 divided the 10 studies equally into two parts; (3) test set data type – whether the test data were images, videos, or patients; (4) DL algorithm types – classification vs. other algorithms; and (5) lesion type – solid vs. cystic lesions, the detailed classification is shown in Supplementary Table S3. The results of the subgroup analyses showed no statistically significant differences between the subgroups (Table 2), indicating that the heterogeneity in the meta-analysis was not due to these factors.
Table 2 Subgroup analyses and meta-regression results.
3.5 Sensitivity analysis and publication bias
We further analyzed the sources of heterogeneity in the included studies by performing a sensitivity analysis. After removing each study individually, we examined whether sensitivity, specificity, and the corresponding I2 values changed significantly after each change. After removing the study by Oh et al. (27), the sensitivity changed from 93% (95% CI, 87–96%; I2 = 96.08%) to 94% (95% CI, 89–97%; I2 = 87.1%), with the most significant change in I2, although the results still suggested high heterogeneity. Given these results, no source of heterogeneity was identified in the sensitivity analysis, and the overall results of the meta-analysis were considered relatively stable.
Publication bias was evaluated using Deeks’ funnel plot (Figure 6), which showed P = 0.39 (P >0.05), indicating that there was no publication bias. Although Deeks’ test was performed, a high publication bias could not definitively be excluded, due to the small number of included studies.
Figure 6 Deeks’ funnel plot asymmetry test for publication.
3.6 DL vs. EUS practitioners
Of the 10 studies 3 (30, 31, 34) compared DL models with the performance of EUS practitioners (Table 1). We performed a subgroup analysis of these three data sets, with a resulting combined sensitivity of 92% (95% CI, 88–97%) vs. 86% (95% CI, 80–92%; P = 0.1), and specificity of 86% (95% CI, 76–96%) vs. 84% (95% CI, 73–95%; P = 0.37), respectively. Although the DL model performed better than the practitioners, the difference was not statistically significant. As the data from only three groups were included in the comparison, the reliability of the results requires further validation.
4 Discussion
DL techniques are being used more and more in clinical practice to significantly improve diagnostic accuracy, stability, and efficiency. In the present study, we performed a meta-analysis to comprehensively evaluate the accuracy of DL-assisted EUS for the diagnosis of PT. A total of 10 studies, encompassing 3,529 patients and 34,773 training images, were included in the present study. The combined sensitivity was 93% (95% CI, 87–96%), specificity was 95% (95% CI, 89–98%), and AUC was 0.98 (95% CI, 0.96–0.99), indicating that the DL-assisted diagnosis of PT is highly accurate. Additionally, we found that the DL model had a better diagnostic ability than that of EUS practitioners, although the difference was not statistically significant.
In the present study, we observed high heterogeneity among the 10 included studies; however, even though subgroup and sensitivity analyses were performed, no sources of heterogeneity were identified. In addition, smaller sample sizes, various DL algorithms, parameter settings, image quality, and EUS devices are possible sources of heterogeneity but need further investigation.
In addition to the high heterogeneity among the included studies, the present meta-analysis had the following limitations (1): most of the included studies were retrospective, while only one was prospective – the clinical applicability of DL, therefore, needs to be validated through more prospective studies; (2) most of the included studies were single-center studies, with only three involving multiple centers – due to differences in equipment and practitioner operating habits, using data from a variety of centers may result in differences in imaging, meaning the generalisability of the single-center trained model requires further validation; (3) most of the included studies involved populations from East Asian, with only two involving European populations, meaning the results of these studies were representative of only a certain population; and (4) some of the included studies involved only a small number of patients, such as one study (30) which included only 28 patients for training and testing, meaning the small sample size may have led to sample bias.
Although we have initially validated the effectiveness of DL models in the diagnosis of PT, these models are still in the clinical exploration stage, and some aspects still need to be improved. One such aspect is the availability of public datasets. Most medical institutions are reluctant to share EUS imaging data for legal purposes, the protection of patient privacy, or for information security, making it difficult for researchers to conduct studies using data from multiple centers. Therefore, there is an urgent need to establish a standard public EUS image database for future research. Another such aspect is open source code. Although most studies used public algorithms, using different parameter settings can affect the results. The availability of open source code, however, could help replicate research and promote the development of this field.
In recent years, emerging EUS-based techniques have shown good performance in the diagnosis of pancreatic lesions (35–37), with one study showing that the accuracy for diagnosing solid pancreatic lesions using wet suction EUS-FNB is 90.4% (35), and a meta-analysis showing that the sensitivity and specificity for detecting malignant pancreatic cystic lesions using EUS-guided through-the-needle biopsy (EUS-TTNB) were 97% and 95%, respectively (36). These techniques, however, require physicians with enhanced expertise and skills to be utilized effectively. As such, one of the included studies constructed a DL-based real-time assisted diagnostic system to guide EUS-FNA and improve the accuracy and efficiency of diagnosing pancreatic masses (34). Combining these new technologies with DL techniques is an important direction for future technological development, and further research is required to improve the efficiency and accuracy of the clinical diagnosis of PT.
The present systematic review provides a comprehensive introduction and quantitative analysis of current research on DL-assisted EUS for the diagnosis of PT. The results of our meta-analysis showed that DL has an excellent diagnostic capability, and can be used as an effective diagnostic aid in clinical practice.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.
Ethics statement
All of the data for the present study were collected from the referenced literature; therefore, ethical approval was not required.
Author contributions
YS and BL conceived the idea for the present meta-analysis. BL analyzed the data and wrote the manuscript with the support of the other authors. KW, NW, and TT screened the data. YS and FY provided suggestions for the project and revised the manuscript accordingly. All of the authors discussed the project, and read and approved the final manuscript.
Acknowledgments
We thank Jian Yang from Zibo Central Hospital for proofreading the manuscript for language.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2023.1191008/full#supplementary-material
Abbreviations
AI, artificial intelligence; AUC, area under the curve; CAD, computer-aided diagnosis/detection; CEUS, contrast-enhanced endoscopic ultrasound; CI, confidence interval; CP, chronic pancreatitis; CT, computed tomography; DL, deep learning; DOR, diagnostic odds ratio; EUS, endoscopic ultrasound; EUS-FNA, EUS-guided fine-needle aspiration; EUS-FNB, EUS-guided fine-needle biopsy; FN, false negative; FP, false positive; IPMN, intraductal papillary mucinous neoplasms; MI, Mechanical index; MRI, magnetic resonance imaging; NLR, negative likelihood ratio; NP, normal pancreas; NPC, non-pancreatic cancer; PASC, pancreatic adenosquamous carcinoma; PC, pancreatic cancer; PDAC, pancreatic ductal adenocarcinoma; PLR, positive likelihood ratio; PNET, pancreatic neuroendocrine tumors; PT,pancreatic tumor; SROC, summary receiver operating characteristic.
References
1. Goral V. Pancreatic cancer: pathogenesis and diagnosis. Asian Pac J Cancer Prev (2015) 16:5619–24. doi: 10.7314/apjcp.2015.16.14.5619
2. Siegel RL, Miller KD, Fuchs HE, Jemal A. Cancer statistics, 2022. CA Cancer J Clin (2022) 72:7–33. doi: 10.3322/caac.21708
3. Shah MH, Goldner WS, Halfdanarson TR, Bergsland E, Berlin JD, Halperin D, et al. NCCN guidelines insights: neuroendocrine and adrenal tumors, version 2.2018. J Natl Compr Canc Netw (2018) 16:693–702. doi: 10.6004/jnccn.2018.0056
4. Plöckinger U, Rindi G, Arnold R, Eriksson B, Krenning EP, de Herder WW, et al. Guidelines for the diagnosis and treatment of neuroendocrine gastrointestinal tumours. A consensus statement on behalf of the European Neuroendocrine Tumour Society (ENETS). Neuroendocrinology (2004) 80:394–424. doi: 10.1159/000085237
5. Scarpa A, Mantovani W, Capelli P, Beghelli S, Boninsegna L, Bettini R, et al. Pancreatic endocrine tumors: improved TNM staging and histopathological grading permit a clinically efficient prognostic stratification of patients. Mod Pathol (2010) 23:824–33. doi: 10.1038/modpathol.2010.58
6. Krishna SG, Rao BB, Ugbarugba E, Shah ZK, Blaszczak A, Hinton A, et al. Diagnostic performance of endoscopic ultrasound for detection of pancreatic malignancy following an indeterminate multidetector CT scan: a systemic review and meta-analysis. Surg Endosc (2017) 31:4558–67. doi: 10.1007/s00464-017-5516-y
7. Kartalis N, Manikis GC, Loizou L, Albiin N, Zöllner FG, Del Chiaro M, et al. Diffusion-weighted MR imaging of pancreatic cancer: A comparison of mono-exponential, bi-exponential and non-Gaussian kurtosis models. Eur J Radiol Open (2016) 3:79–85. doi: 10.1016/j.ejro.2016.04.002
8. Wang AY, Yachimski PS. Endoscopic management of pancreatobiliary neoplasms. Gastroenterology (2018) 154:1947–63. doi: 10.1053/j.gastro.2017.11.295
9. Udare A, Agarwal M, Alabousi M, McInnes M, Rubino JG, Marcaccio M, et al. Diagnostic accuracy of MRI for differentiation of benign and malignant cystic lesions compared to CT and endoscopic ultrasound: systematic review and meta-analysis. J Magn Reson Imaging (2021) 54:1126–37. doi: 10.1002/jmri.27606
10. Bhutani MS, Gupta V, Guha S, Gheonea DI, Săftoiu A. Pancreatic cyst fluid analysis – A review. J Gastrointestinal Liver Dis (2011) 20:175–80.
11. Kim E, Telford JJ. Endoscopic ultrasound advances, part 1: diagnosis. Can J Gastroenterol (2009) 23:594–601. doi: 10.1155/2009/876057
12. Ahmad OF, Soares AS, Mazomenos E, Brandao P, Vega R, Seward E, et al. Artificial intelligence and computer-aided diagnosis in colonoscopy: current evidence and future directions. Lancet Gastroenterol Hepatol (2019) 4:71–80. doi: 10.1016/S2468-1253(18)30282-6
13. Zheng H, Xiao Z, Luo S, Wu S, Huang C, Hong T, et al. Improve follicular thyroid carcinoma diagnosis using computer aided diagnosis system on ultrasound images. Front Oncol (2022) 12:939418. doi: 10.3389/fonc.2022.939418
14. Jiang Y, Yang G, Liang Y, Shi Q, Cui B, Chang X, et al. Computer-aided system application value for assessing hip development. Front Physiol (2020) 11:587161. doi: 10.3389/fphys.2020.587161
15. Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, et al. Artificial intelligence in healthcare: past, present and future. Stroke Vasc Neurol (2017) 2:230–43. doi: 10.1136/svn-2017-000101
16. Sunwoo L, Kim YJ, Choi SH, Kim K-G, Kang JH, Kang Y, et al. Computer-aided detection of brain metastasis on 3D MR imaging: Observer performance study. PloS One (2017) 12:e0178265. doi: 10.1371/journal.pone.0178265
17. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, et al. ImageNet large scale visual recognition challenge. Int J Comput Vis (2015) 115:211–52. doi: 10.1007/s11263-015-0816-y
18. Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Commun ACM (2017) 60:84–90. doi: 10.1145/3065386
21. Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, van Ginneken B, Sánchez CI. A survey on deep learning in medical image analysis. Medical Image Analysis. Singapore: Springer (2017). 42:60–88. doi: 10.1016/j.media.2017.07.005
22. Dumitrescu EA, Ungureanu BS, Cazacu IM, Florescu LM, Streba L, Croitoru VM, et al. Diagnostic value of artificial intelligence-assisted endoscopic ultrasound for pancreatic cancer: A systematic review and meta-analysis. Diagnostics (2022) 12:309. doi: 10.3390/diagnostics12020309
23. Salameh J-P, Bossuyt PM, McGrath TA, Thombs BD, Hyde CJ, Macaskill P, et al. Preferred reporting items for systematic review and meta-analysis of diagnostic test accuracy studies (PRISMA-DTA): explanation, elaboration, and checklist. BMJ (2020) 370:m2632. doi: 10.1136/bmj.m2632
24. Booth A, Clarke M, Ghersi D, Moher D, Petticrew M, Stewart L. An international registry of systematic-review protocols. Lancet (2011) 377:108–9. doi: 10.1016/S0140-6736(10)60903-8
25. Tonozuka R, Itoi T, Nagata N, Kojima H, Sofuni A, Tsuchiya T, et al. Deep learning analysis for the detection of pancreatic cancer on endosonographic images: a pilot study. J Hepatobiliary Pancreat Sci (2021) 28:95–104. doi: 10.1002/jhbp.825
26. Udriștoiu AL, Cazacu IM, Gruionu LG, Gruionu G, Iacob AV, Burtea DE, et al. Real-time computer-aided diagnosis of focal pancreatic masses from endoscopic ultrasound imaging based on a hybrid convolutional and long short-term memory neural network model. PLoS One (2021) 16:e0251701. doi: 10.1371/journal.pone.0251701
27. Oh S, Kim Y-J, Park Y-T, Kim K-G. Automatic pancreatic cyst lesion segmentation on EUS images using a deep-learning approach. Sensors (Basel) (2021) 22:245. doi: 10.3390/s22010245
28. Huang J, Xie X, Wu H, Zhang X, Zheng Y, Xie X, et al. Development and validation of a combined nomogram model based on deep learning contrast-enhanced ultrasound and clinical factors to predict preoperative aggressiveness in pancreatic neuroendocrine neoplasms. Eur Radiol (2022) 32:7965–75. doi: 10.1007/s00330-022-08703-9
29. Kuwahara T, Hara K, Mizuno N, Haba S, Okuno N, Kuraishi Y, et al. Artificial intelligence using deep learning analysis of endoscopic ultrasonography images for the differential diagnosis of pancreatic masses. Endoscopy (2022) 55:140–9. doi: 10.1055/a-1873-7920
30. Tian G, Xu D, He Y, Chai W, Deng Z, Cheng C, et al. Deep learning for real-time auxiliary diagnosis of pancreatic cancer in endoscopic ultrasonography. Front Oncol (2022) 12:973652. doi: 10.3389/fonc.2022.973652
31. Tong T, Gu J, Xu D, Song L, Zhao Q, Cheng F, et al. Deep learning radiomics based on contrast-enhanced ultrasound images for assisted diagnosis of pancreatic ductal adenocarcinoma and chronic pancreatitis. BMC Med (2022) 20:74. doi: 10.1186/s12916-022-02258-8
32. Vilas-Boas F, Ribeiro T, Afonso J, Cardoso H, Lopes S, Moutinho-Ribeiro P, et al. Deep learning for automatic differentiation of mucinous versus non-mucinous pancreatic cystic lesions: A pilot study. Diagnost (Basel) (2022) 12:2041. doi: 10.3390/diagnostics12092041
33. Tang A, Tian L, Gao K, Liu R, Hu S, Liu J, et al. Contrast-enhanced harmonic endoscopic ultrasound (CH-EUS) MASTER: A novel deep learning-based system in pancreatic mass diagnosis. Cancer Med (2023) cam4:5578. doi: 10.1002/cam4.5578
34. Seo K, Lim J-H, Seo J, Nguon LS, Yoon H, Park J-S, et al. Semantic segmentation of pancreatic cancer in endoscopic ultrasound images using deepd learning approach. Cancers (Basel) (2022) 14:5111. doi: 10.3390/cancers14205111
35. Crinò SF, Conti Bellocchi MC, Di Mitri R, Inzani F, Rimbaș M, Lisotti A, et al. Wet-suction versus slow-pull technique for endoscopic ultrasound-guided fine-needle biopsy: a multicenter, randomized, crossover trial. Endoscopy (2023) 55:225–34. doi: 10.1055/a-1915-1812
36. Li S-Y, Wang Z-J, Pan C-Y, Wu C, Li Z-S, Jin Z-D, et al. Comparative performance of endoscopic ultrasound-based techniques in patients with pancreatic cystic lesions: A network meta-analysis. Am J Gastroenterol (2023) 118:243–55. doi: 10.14309/ajg.0000000000002088
Keywords: pancreatic tumor, artificial intelligence, deep learning, endoscopic ultrasound, meta-analysis, systemic review
Citation: Lv B, Wang K, Wei N, Yu F, Tao T and Shi Y (2023) Diagnostic value of deep learning-assisted endoscopic ultrasound for pancreatic tumors: a systematic review and meta-analysis. Front. Oncol. 13:1191008. doi: 10.3389/fonc.2023.1191008
Received: 21 March 2023; Accepted: 13 July 2023;
Published: 27 July 2023.
Edited by:
Samir Pathak, Bristol Royal Infirmary, United KingdomReviewed by:
Yao Lu, Sun Yat-sen University, ChinaStefano Francesco Crinò, University of Verona, Italy
Copyright © 2023 Lv, Wang, Wei, Yu, Tao and Shi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yanting Shi, yantingshi@hotmail.com