Chen BB. Artificial intelligence in pancreatic disease. Artif Intell Med Imaging 2020; 1(1): 19-30
Corresponding Author of This Article
Bang-Bin Chen, MD, Associate Professor, Department of Medical Imaging, National Taiwan University College of Medicine and Hospital, No. 7, Chung-Shan South Road, Taipei 10016, Taiwan. email@example.com
Checklist of Responsibilities for the Scientific Editor of This Article
This article is an open-access article which was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Author contributions: Chen BB wrote and revised the manuscript.
Supported bygrants from the Ministry of Science and Technology (Taiwan), No. 104-2314-B-002-080-MY3 and No. 107-2314-B-002-102-MY3.
Conflict-of-interest statement: No conflict of interest.
Open-Access: This article is an open-access article that was selected by an in-house editor and fully peer-reviewed by external reviewers. It is distributed in accordance with the Creative Commons Attribution NonCommercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Corresponding author: Bang-Bin Chen, MD, Associate Professor, Department of Medical Imaging, National Taiwan University College of Medicine and Hospital, No. 7, Chung-Shan South Road, Taipei 10016, Taiwan. firstname.lastname@example.org
Received: June 9, 2020 Peer-review started: June 9, 2020 First decision: June 15, 2020 Revised: June 18, 2020 Accepted: June 20, 2020 Article in press: June 20, 2020 Published online: June 28, 2020
In recent years, the application of artificial intelligence (AI) in radiology has been growing rapidly, fueled by the availability of large datasets, advances in computing power, and newly developed algorithms. Progress in AI applied to medical imaging analyses has transformed these images into quantitative data, termed radiomics. When combined with patients’ clinical data, these models, when developed by machine learning, have the potential to improve diagnostic, prognostic, and predictive accuracy. Currently, limited literature is available on the use of radiomics for pancreatic disease. Here, we will review recent studies in the application of AI in a variety of pancreatic diseases, mainly involving lesion detection, tumor characterization, tumor grading, response, and prognosis evaluation. Finally, we will also discuss the challenges and prospects in the field of radiomics for pancreatic disease.
Core tip: The integration of radiomics, clinical data, and advanced machine-learning methodologies will improve diagnostic, prognostic, and predictive accuracy in patients with pancreatic disease, and facilitate clinical decision and management towards precision medicine.
Citation: Chen BB. Artificial intelligence in pancreatic disease. Artif Intell Med Imaging 2020; 1(1): 19-30
Artificial intelligence (AI) describes the use of computers to simulate performance and critical thinking equivalent to a human being. Its application in radiology has been growing rapidly, powered by the availability of large datasets, advances in computing power, and newly developed algorithms. The progress in AI of medical imaging analyses has converted these images into quantitative and minable data to facilitate better clinical decisions and management[2,3]. This comprehensive method, when used to analyze high-dimensional quantitative features from multimodality medical images, is known as radiomics.
To establish robust quantitative image analyses, standardized methodologies are required based on various image modalities, such as those of computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET), especially for texture- and filter-based features[5,6]. After the mining of correlations between these features and diagnosis/prognosis of tumors, tumors can then be decoded into different imaging phenotypes. These data are then combined with other patients’ data to develop models that can potentially enhance diagnostic, prognostic, and predictive accuracy. Because these analyses are based on the standard of care images, it is imaginable that radiomics analysis will eventually become routine practice[9,10].
There are three approaches to data-mining for radiomics, including hand-crafted features, deep features, and a hybrid method. Traditional radiomics is done with the computation of agnostic hand-crafted features, which are computed automatically by image analysis algorithms. For instance, texture analysis has been widely used to quantify intuitive qualities by measuring the spatial variation in pixel intensities on images. In contrast to traditional radiomics, deep-learning extracts deep features from medical images based on the specifications of a pre-defined task, including disease diagnostics, cancer type prediction, or survival prediction. These deep features can be obtained via various architectures, such as a convolutional neural network (CNN), to find the most relevant features related to a pre-defined task. Thus, they can automatically learn the best features for a given task, without the need for human involvement for feature design. Recent studies have shown better performance by deep learning methods over traditional radiomics[12,13]. Besides, the hybrid method, which combines hand-crafted and deep features, could provide complementary information for the radiological evaluation in cancer patients[14-16].
The currently available literature on the use of radiomics for pancreatic disease is limited. Here, we will review recent studies in the application of texture analysis and radiomics in pancreatic malignancy, mainly involving cancer detection, grading, response, and prognosis evaluation. We will also review the performance of radiomics in differentiating between pancreatic cancer and other benign pancreatic lesions, such as autoimmune pancreatitis (AIP) and mass-forming pancreatitis (MFP). Finally, we will discuss the challenges and prospects in the field of radiomics for pancreatic disease. A summary table (Table 1) is also presented based on our review of the recent literature.
Table 1 Recent publications using artificial intelligence and radiomics in pancreatic disease.
AIP: Autoimmune pancreatitis; AUC: Area under receiver operating characteristic curve; CNN: Convolutional neural network; DFS: Disease-free survival; IPMN: Intraductal papillary mucinous neoplasms; LASSO: Least absolute shrinkage and selection operator; LDA: Linear discriminative analysis; LN: Lymph node; MFP: Mass-forming pancreatitis; MRMR: Minimum redundancy maximum relevance; OS: Overall survival; PD: Pancreaticoduodenectomy; PDAC: Pancreatic ductal adenocarcinoma; PET: Positron emission tomography; PFS: Progression-free survival; PNET: Pancreatic neuroendocrine tumor; POPF: Postoperative pancreatic fistula; RF: Random forest; SBRT: Stereotactic body radiation therapy; SVM: Support vector machine; SMV: Superior mesenteric vein.
PANCREATIC DUCTAL ADENOCARCINOMA
Pancreatic ductal adenocarcinoma (PDAC) is the third leading cause of cancer-related deaths in the USA. The 5-year survival for PDAC is only 8%, due to its aggressive nature and late-stage presentation when discovered in most patients. Therefore, early detection of PDAC is critical, because surgical resection is the only method to cure this disease. In patients receiving a surgical intervention, the involvement of regional lymph nodes and residual tumor at the surgical margin are also important issues related to survival outcome. In patients with metastatic disease receiving chemotherapy or radiotherapy, the use of radiomics to predict treatment response is being investigated.
Early detection of pancreatic ductal adenocarcinoma
Radiomics might offer an advantage over other techniques in the early detection of PDAC. This is because the subtle difference of the texture patterns between early cancer and normal pancreas might be discernable using radiomic features prior to visual detection.
Chu et al used 3D CT radiomic features to differentiate PDAC and normal pancreas by manually segmented features of the pancreas. The dataset included 190 patients with PDAC and 190 healthy controls, and was divided into 255 training and 125 validation cases. A total of 478 features was extracted, and 40 features were selected for analysis by a random forest (RF) classifier. The overall accuracy was 99.2%, and the area under the curve (AUC) was 99.9%. The results were encouraging for using radiomics in the early detection of PDAC, but a limitation of this study was that the manual segmentation of pancreas boundaries was a labor-intensive work and required expert knowledge of radiologists.
To overcome this limitation, Liu et al used CNN to distinguish 370 patients with pancreatic cancer and 320 normal controls. CT images were preprocessed into patches to classify as cancerous or non-cancerous. In local test sets, CNN-based analysis had an accuracy of 0.986–0.989 and AUC of 0.997–0.999. In the test set (281 pancreatic cancers and 82 controls) of a different country, the accuracy was 0.832 and AUC was 0.920. The sensitivity for tumors smaller than 2 cm was 92.1% in the local test sets and 63.1% in the other country test set. When compared with radiologists’ interpretation, CNN-based analysis achieved higher sensitivity than radiologists. Therefore, this method could be incorporated into the development of computer-aided detection software for pancreatic cancer detection. In clinical practice, other benign lesions, such as MFP or AIP, might mimic PDAC. Whether CNNs can distinguish between PDAC and other pancreatic pathologies, such as pancreatitis and other pancreatic tumors, must also be further studied. Besides, about 11%–27% of pancreatic cancer is enhancing the pancreatic parenchyma and not visible on contrast-enhanced CT. It is interesting to see whether radiomics can detect this particular type of PDAC.
Predicting lymph node metastasis
Accurate identification of the extent of lymph node (LN) metastasis is critical for the determination of surgical methods in resectable PDAC.
Li et al developed a model integrating clinical data and imaging features extracted from venous phase CT to predict LN metastasis. Their study included 159 patients with PDAC (118 in the primary cohort and 41 in the validation cohort). A total of 2041 radiomics features were extracted, and 15 features were selected for constructing the radiomics signature in the primary cohort. A combined prediction model was built by integrating the radiomics signature and clinical characteristics selected by using multivariable logistic regression. The combined prediction model reached a better discrimination power than the clinical prediction model, with an AUC of 0.944 vs 0.666 in the primary cohort, and 0.912 vs 0.713 in the validation cohort.
Bian et al used arterial phase CT images to predict LN metastasis in 225 patients. A total of 1029 radiomics features of the arterial phase were extracted and then reduced using the least absolute shrinkage and selection operator logistic regression (LASSO) algorithm. Multivariate logistic regression models were used to analyze the association. The radiomics score (rad-score), which consisted of 12 selected features, was significantly associated with LN status, both in univariate and multivariate analyses. Higher arterial rad-score was also associated with LN metastasis. In the future, it is necessary to establish a one-to-one correlation between the imaging findings and the pathological evidence of LN metastasis.
Predicting surgical margin and postoperative pancreatic fistula after pancreaticoduodenectomy
In a pathological examination after pancreaticoduodenectomy (PD), a resection margin without cancer cells in 1 mm is considered as R0; a resection margin with cancer cells in 1 mm is considered as R1. The preoperative identification of R0 and R1 is a determining factor for surgical decisions and prognosis[23,24].
Hui et al retrospectively analyzed CT images of 86 patients (34 cases of R0 and 52 cases of R1) with pancreatic head PDAC and that underwent PD. The radiomics features were reduced using principal component analysis. The support vector machine (SVM) with a linear kernel was used to classify the resection margins with leave-one-out cross-validation. The results achieved an AUC of 0.8614 and an accuracy of 84.88%. Two features of the run-length matrix, which are derived from diagonal sub-bands in wavelet decomposition, showed significant differences between R0 and R1.
Similarly, Yun et al used a portal rad-score to predict pathologic superior mesenteric vein (SMV) resection margin in 181 patients. For each patient, 1029 radiomics features of the portal phase were extracted, which were reduced using the LASSO logistic regression algorithm. The rad-score was significantly associated with the SMV resection margin status. The portal rad-score had an accuracy of 71.3% and AUC of 0.750. Although radiomics seem promising in predicting SMV section margin, assessment of all pancreatic resection margins is needed to predict patients’ outcomes. Furthermore, the radiomic features of mesopancreas (located between the superior mesenteric artery and the uncinate process) are more likely to predict the status of the section margin than those of a primary tumor, because it is regarded as the primary site of cancer cell infiltration.
Zhang et al used radiomic features extracted from the portal venous phase CT for the preoperative prediction of postoperative pancreatic fistula (POPF) in 117 patients receiving PD. The rad-score was constructed by LASSO, and its performance was compared with standard pancreatic Fistula Risk Score. Their rad-score could predict POPF with an AUC of 0.8248 in the training cohort (80 patients) and of 0.7609 in the validation cohort (39 patients). In addition, the AUC of the rad-score was statistically higher than the Fistula Risk Score for predicting POPF in both cohorts.
Predicting therapy response
Many researchers have utilized radiomic features derived from pretreatment CT to identify imaging phenotypes that might predict the treatment response in patients with PDAC.
Chen et al assessed the response of pancreatic head cancer during chemoradiation therapy in 20 patients. They found that significant changes in CT radiomic features were observed during therapy based on quantitative analysis of daily CT. In cases of good response, patients tend to have large reductions in mean histograms of CT number and skewness, and large increases in standard deviation and kurtosis. Thus, a high reduction of these features might suggest early treatment response and could be used to identify patients that need therapeutic intensification.
Borazanci et al used texture analysis to predict treatment response to poly adenosine diphosphate-ribose polymerase (PARP) inhibitors. In 13 patients with PDAC who have deoxyribonucleic acid damage repair deficiency mutations, exploratory analysis of index lesions revealed correlations between lesion texture features with overall survival (OS), and also with time on PARP inhibitors.
Yue et al stratified patients into low and high-risk groups using pre- and post-radiotherapy 18F-FDG-PET/CT images from 26 patients. A total of 48 texture and clinical variables were identified, and the prognostic heterogeneity features were selected using LASSO/elastic net regression and multivariate Cox analysis. After radiotherapy, the metabolic activity in the primary tumor was suppressed, and underlying tissue heterogeneity was reduced. The authors identified five significant variables: Age, node stage, variations of homogeneity, variance, and cluster tendency. These patients could be stratified into two risk groups: A low-risk group (n = 11) with a longer mean OS and higher texture variation (> 30%), and a high-risk group (n = 15) with a shorter mean OS and lower texture variation (< 15%). The authors concluded that locoregional metabolic texture response might predict clinical outcomes following radiotherapy.
Recent studies have suggested that radiomic features extracted from CT and PET were predictive of the survival outcome of PDAC patients.
Xie et al developed a CT-based radiomics nomogram for survival prediction in patients with resected PDAC in 220 patients (training = 147; validation = 73). A total of 300 radiomic features were extracted, followed by LASSO with multivariate regression analysis. The rad-score was significantly associated with disease-free survival (DFS) and OS. Radiomics nomogram could better predict survival than the clinical model, and the TNM staging system could. However, there was no association between the rad-score and recurrence patterns.
Cozzi et al used CT radiomics signature to predict clinical outcomes after stereotactic body radiation therapy in 100 patients (training = 60; validation = 40) and found a clinical-radiomics signature was associated with OS and local control.
The value of texture features to predict prognosis and help clinical management in PDAC patients has been evaluated in several studies. In patients undergoing surgical resection, Kim et al found that high grey-level non-uniformity values suggested shorter recurrence-free survival in 116 patients, suggesting that high tumor heterogeneity was a poor prognostic indicator. However, Yun et al found that lower average values with homogeneous features (lower standard deviation and contrast and higher correlation) were significantly associated with poorer DFS in 18 patients. They conjectured that homogeneous texture features could represent more aggressive tumor nature, resulting from higher cellular density or dense desmoplasia. Besides, Eilaghi et al found that high tumor dissimilarity (high heterogeneity) and low inverse difference normalized (low heterogeneity) were associated with better OS in 30 patients. Therefore, the results of correlations between tumor heterogeneity with surgical outcome were contradictory and need further investigation.
In patients with unresectable PDAC treated with chemotherapy, Cheng et al found pretreatment CT texture analysis was associated with PFS and OS in 41 patients. Besides, a combination of pretreatment standard deviation (spatial scaling factor = 3) with tumor size in the survival model performed better than the standard deviation alone. Similarly, Sandrasegaran et al found that texture features of the mean value of positive pixels and kurtosis at medium spatial filters had a significant correlation with OS in 60 patients.
Hyun et al evaluated intratumoral heterogeneity measured by 18F-FDG PET texture analysis in 137 patients. The best imaging biomarker for OS prediction was first-order entropy (AUC = 0.720), followed by total lesion glycolysis (AUC = 0.697), metabolic tumor volume (AUC = 0.692), and maximum standard uptake value (AUC = 0.625). Multivariable Cox analysis demonstrated that higher entropy was independently associated with worse survival. Thus, first-order entropy is a better quantitative imaging biomarker of prognosis than conventional PET parameters.
INTRADUCTAL PAPILLARY MUCINOUS NEOPLASMS GRADE AND RISK
Intraductal papillary mucinous neoplasms (IPMN) represents 15%–30% of cystic lesions of the pancreas. They are premalignant tumors that can progress from low-grade dysplasia to high-grade dysplasia to invasive cancer, accounting for 20%–30% of pancreatic cancer. The ability to identify IPMNs with low or high risk and malignant transformation into invasive cancer would optimize treatment strategy and improve surgical decision-making.
Chakraborty et al retrospective analyzed pancreatic cyst and parenchyma regions on preoperative CT in 103 patients with pathologically proven branch duct-IPMN to predict IPMN risk. Expert pathologists categorized IPMNs as low or high risk following resection. A total of 131 texture features were derived from each cyst and pancreas regions. Five clinical variables were combined with imaging features to design prediction models. Their results of CT features achieved an AUC of 0.77, and the combination model obtained an AUC of 0.81.
Corral et al developed a new deep learning protocol on MRI to identify neoplasia for IPMN in 139 cases. A computer-aided framework was designed using CNN to classify IPMN. Their cases included normal pancreas (20%), low-grade dysplasia (34%), high-grade dysplasia (14%), and adenocarcinoma (29%). The sensitivity and specificity of the deep learning protocol to detect dysplasia were 92% and 52%, and to detect high-grade dysplasia or cancer were 75% and 78%, respectively. The deep learning protocol showed accuracy (AUC = 0.78) comparable to current radiographic criteria (American Gastroenterology Association, AUC = 0.76; Fukuoka, AUC = 0.77). Their computer-aided frameworks could assist in identifying high-risk IPMN.
Hanania et al investigated 360 texture features on CT images in 53 patients with IPMN (34 high-grade and 19 low-grade). These authors identified 14 imaging features within the gray-level co-occurrence matrix that predicted histopathological grade. The most predictive feature differentiated low-grade and high-grade lesions with an AUC of 0.82 (sensitivity 85%, specificity 68%). Using a cross-validated design, the best logistic regression yielded an AUC of 0.96 (sensitivity 97%, specificity of 88%).
Permuth et al evaluated 38 IPMNs (20 benign, 18 malignant) with preoperative CT radiomic data and matched plasma-based miRNA genomic classifier data. The miRNA classifier, high-risk, and worrisome radiologic features had AUC values of 0.83, 0.84, and 0.54, respectively. Fourteen CT radiomic features differentiated malignant from benign IPMNs with an AUC of 0.77. Combining radiomic features with the miRNA classifier revealed an AUC of 0.92 and superior predictive performance than other models. This study suggested that radiogenomic approach might more accurately predict IPMN pathology than radiologic features in consensus guidelines.
PANCREATIC NEUROENDOCRINE TUMOR GRADES
Recent updates of the World Health Organization classification separate pancreatic neuroendocrine tumor (PNET) into two broad categories, including the Ki-67 proliferative index and mitotic counts: Well-differentiated PNET and poorly differentiated pancreatic neuroendocrine carcinoma (PNEC). The classification also incorporates a new subcategory of well-differentiated grade 3 (G3) PNET. The assessment of tumor grade is essential for the prediction of prognosis and choice of the proper treatment strategy.
D’Onofrio et al evaluated 3D CT-texture analysis in 100 patients with NET [grade 1 (G1) in 31, grade 2 (G2) in 52, and G3 in 17 cases]. Their results showed kurtosis was significantly different among the three groups, and entropy was significantly different between the G1 and G3 groups and between the G2 and G3 groups.
Guo et al evaluated CT images of 37 patients (G1 in 13, G2 in 11, and G3 in 13 cases). Arterial enhancement ratio and portal enhancement ratio showed the best sensitivity (0.86–0.94) and specificity (0.92–1.0) for differentiating G3 from G1/G2, while the mean grey-level intensity, entropy, and uniformity showed acceptable sensitivity (0.73–0.91) and specificity (0.85–1.0). Mean grey-level intensity also showed acceptable sensitivity (91% to 100%) and specificity (82% to 91%) in differentiating G1 from G2.
Canellas et al evaluated CT images of 101 patients (G1 in 63, G2 in 35, and G3 in 3 cases). The CT features predictive of G2/3 were size larger than 2.0 cm, presence of vascular involvement, pancreatic ductal dilatation, and lymphadenopathy. The texture parameter entropy was also predictive of more aggressive tumors. Tumors with high grade (G2/3), vascular invasion, and high entropy had shorter PFS after surgical resection.
Liang et al used arterial phase CT to preoperatively differentiate grade 1 and grade 2/3 NET of 137 patients (training = 86, validation = 51). The Mann-Whitney U test and LASSO were applied for feature selection, and an eight-feature-combined radiomics signature was constructed. The nomogram model combining the radiomics signature with the clinical stage had the best performance (training AUC = 0.907; validation AUC = 0.891). A significant correlation was found between the nomogram model and the Ki-67 index and the rate of nuclear mitosis. The survivals of predicted grade 1 and grade 2/3 groups were significantly different.
Gu et al used arterial and portal venous phase CT images for preoperatively predicting grade 1 and grade 2/3 NET in 138 patients (training = 104, validation = 34). A total of 853 radiomic features were extracted. Minimum redundancy, maximum relevance, and RF methods were adopted for the feature selection. The radiomics signature had a significant association with histologic grade. The nomogram incorporating independent clinical risk factor, tumor margin, and fusion radiomics signature showed strong discrimination in the training cohort (AUC = 0.974) and validation cohort (AUC = 0.902) with good calibration.
Bian et al used 3T MRI for the preoperative prediction of nonfunctional PNET grade in 139 cases (training = 97, validation = 42). The LASSO and linear discriminative analysis were used to select the features and to construct a radiomics model. The clinical model revealed an AUC of 0.769 in the training cohort and 0.729 in the validation cohort. The mixed model, which combined the radiomics signature and 14 imaging features, yielded AUC values of 0.870 and 0.701. Thus, the noncontrast MRI could be used as a screening tool to help differentiate G1 and G2/3 tumors.
Currently, most studies have attempted to differentiate between G1 and G2/3 PNETs. However, the 5-year survival rates were 75%, 62%, and 7% for G1, G2, and G3, respectively. It would be more valuable to show the diagnostic values of the nomogram model in differentiating G1/G2 and G3. Furthermore, the G3 tumors are divided into two subgroups: Well-differentiated PNETs G3 and PNEC. The prognosis of the two subgroups is also different. Further studies are now needed to differentiate well-differentiated PNET G3 and PNEC, and between PNETs G1/G2 and G3.
PANCREATIC TUMOR CHARACTERIZATION
Autoimmune pancreatitis vs pancreatic ductal adenocarcinoma
AIP has similar clinical and radiological presentations to PDAC, but the treatments of these two entities are different. Patients with AIP might be treated with oral corticosteroids, but patients with PDAC need surgical resection and chemotherapy. Thus, the differentiation of these two entities is imperative to avoid unnecessary surgical resections in patients with AIP or delayed treatment in patients with PDAC.
Park et al used CT-based machine learning of radiomic features to distinguish AIP from PDAC. Eighty-nine patients with AIP and 93 patients with PDAC were retrospectively included. Four-hundred-thirty-one radiomic features were extracted, and a RF method was used to discriminate AIP from PDAC. The radiomic features help differentiate AIP from PDAC with a sensitivity of 89.7%, specificity of 100%, accuracy of 95.2%, and AUC of 0.975.
Zhang et al used 18F FDG PET/CT to distinguish AIP from PDAC in 111 patients (AIP = 45, PDAC = 66). They extracted 251 features from 2D and 3D images and recombined these features into five feature sets according to their modalities and dimensions. Four machine learning classifiers were evaluated. CT features and 3D features performed better than PET features and 2D features, respectively. Multidomain features were superior to single domain features. In addition, the combination of the SVM-recursive feature elimination feature selection strategy and linear SVM classifier had the best performance (AUC = 0.93, accuracy= 0.85). The radiomics model was significantly superior to both human doctors and clinical factors-based prediction models.
The results of these studies are encouraging. For future work, combined features extracted from CNNs and more clinical factors to differentiate these two diseases would be an interesting direction to pursue.
Mass-forming pancreatitis vs pancreatic ductal adenocarcinoma
Ren et al used arterial and portal phase CT texture analysis to differentiate 30 patients with MFP and 79 patients with PDAC. Arterial CT attenuation, arterial, and portal enhancement ratios of MFP were higher than PDAC. Arterial CT attenuation and pancreatic duct penetrating sign were independent predictors in multivariate analysis. AUC of imaging feature-based, texture feature-based in arterial and portal phases, and the combined models were 0.84, 0.96, 0.93, and 0.98, respectively. Thus, CT texture analysis holds great potential to differentiate MFP from PDAC.
Mashayekhi et al used CT radiomics to differentiate 56 patients with recurrent acute pancreatitis (n = 20), functional abdominal pain (n = 19), or chronic pancreatitis (n = 17). In 54 radiomic features extracted by one-vs-one Isomap SVM classifier, 11 radiomic features were significantly different between the patient groups with an overall accuracy of 82.1%.
Serous and mucinous cystadenomas
Yang et al used CT textural features in the differential diagnosis of pancreatic serous cystadenomas (n = 53) and mucinous cystadenomas (n = 25). Textural parameters were analyzed using RF and LASSO methods. Patients were divided into training and validation sets with a ratio of 4:1. Radiomic features were able to separate serous from mucinous cystadenomas in both the training group (slice thickness of 5 mm, AUC 0.72, accuracy 0.86) and the validation group (AUC 0.75, accuracy 0.83). These results might provide a noninvasive approach to determine whether surgery or imaging follow up is suitable for these patients.
CHALLENGES AND PROSPECTS OF ARTIFICIAL INTELLIGENCE IN THE PANCREAS
There are three main challenges for the application of AI in the pancreas. First, the image analysis methods are diverse and variable, so many study results are inconsistent and contradictory. To ensure the availability of accurate and reproducible radiomics data, the initiatives to standardize the development of quantitative imaging biomarkers have recently been developed. Second, the public data of pancreatic imaging available for machine-learning is insufficient, because most early pancreatic lesions are small and occult, and require labor-intensive work from experienced radiologists to label the target lesion. Automatic detection and segmentation of these pancreatic lesions, either with or without the aid of a radiologist, is needed to solve this issue. Third, most studies are retrospective, with limited clinical, laboratory, and outcome data. Previous studies have shown that combined models of radiomic and clinical factors achieve better performance than each individual model. Upcoming prospective studies that combined radiomics and clinical data, even with genomic data, are warranted. Ultimately, it is only with the availability of robust integrated radiomics and comprehensive clinical data that we can proceed to deploy AI in daily practice to improve the care of our patients.
The pancreas has both an endocrine and an exocrine digestive function, and its imaging presentations are diverse and frequently pose a diagnostic dilemma in clinical settings. The use of AI will greatly facilitate accurate pancreatic lesion detection, characterization, treatment response evaluation, and prognosis prediction in these patients. Currently, radiomics is under rigorous investigation in various pancreatic diseases, and recent study results are promising. With the growth of advanced AI technology and the availability of standardized imaging data, it seems likely that we will accomplish the goal of precision medicine and increase patients’ outcomes in the near future.
Manuscript source: Invited manuscript
Specialty type: Radiology, nuclear medicine and medical imaging
P-Reviewer: Cimen SG S-Editor: Wang JL L-Editor: A E-Editor: Xing YX
Hosny A, Parmar C, Quackenbush J, Schwartz LH, Aerts HJWL. Artificial intelligence in radiology.Nat Rev Cancer. 2018;18:500-510.
Thrall JH, Li X, Li Q, Cruz C, Do S, Dreyer K, Brink J. Artificial Intelligence and Machine Learning in Radiology: Opportunities, Challenges, Pitfalls, and Criteria for Success.J Am Coll Radiol. 2018;15:504-508.
Savadjiev P, Chong J, Dohan A, Vakalopoulou M, Reinhold C, Paragios N, Gallix B. Demystification of AI-driven medical image interpretation: past, present and future.Eur Radiol. 2019;29:1616-1624.
Larue RT, Defraene G, De Ruysscher D, Lambin P, van Elmpt W. Quantitative radiomics studies for tissue characterization: a review of technology and methodological procedures.Br J Radiol. 2017;90:20160665.
Savadjiev P, Chong J, Dohan A, Agnus V, Forghani R, Reinhold C, Gallix B. Image-based biomarkers for solid tumor quantification.Eur Radiol. 2019;29:5431-5440.
Aerts HJ, Velazquez ER, Leijenaar RT, Parmar C, Grossmann P, Carvalho S, Bussink J, Monshouwer R, Haibe-Kains B, Rietveld D, Hoebers F, Rietbergen MM, Leemans CR, Dekker A, Quackenbush J, Gillies RJ, Lambin P. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach.Nat Commun. 2014;5:4006.
Aerts HJ. The Potential of Radiomic-Based Phenotyping in Precision Medicine: A Review.JAMA Oncol. 2016;2:1636-1642.
Liu Z, Wang S, Dong D, Wei J, Fang C, Zhou X, Sun K, Li L, Li B, Wang M, Tian J. The Applications of Radiomics in Precision Diagnosis and Treatment of Oncology: Opportunities and Challenges.Theranostics. 2019;9:1303-1322.
Verma V, Simone CB 2nd, Krishnan S, Lin SH, Yang J, Hahn SM. The Rise of Radiomics and Implications for Oncologic Management.J Natl Cancer Inst. 2017;109:djx055.
Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More than Pictures, They Are Data.Radiology. 2016;278:563-577.
Afshar P, Mohammadi A, Plataniotis KN, Oikonomou A, Benali H. From Handcrafted to Deep-Learning-Based Cancer Radiomics Challenges and opportunities.IEEE Signal Process Mag. 2019;36:132-160.
Truhn D, Schrading S, Haarburger C, Schneider H, Merhof D, Kuhl C. Radiomic versus Convolutional Neural Networks Analysis for Classification of Contrast-enhancing Lesions at Multiparametric Breast MRI.Radiology. 2019;290:290-297.
Zhu Y, Man C, Gong L, Dong D, Yu X, Wang S, Fang M, Wang S, Fang X, Chen X, Tian J. A deep learning radiomics model for preoperative grading in meningioma.Eur J Radiol. 2019;116:128-134.
Yang X, Wu L, Zhao K, Ye W, Liu W, Wang Y, Li J, Li H, Huang X, Zhang W, Huang Y, Chen X, Yao S, Liu Z, Liang C. Evaluation of human epidermal growth factor receptor 2 status of breast cancer using preoperative multidetector computed tomography with deep learning and handcrafted radiomics features.Chin J Cancer Res. 2020;32:175-185.
Wu X, Li Y, Chen X, Huang Y, He L, Zhao K, Huang X, Zhang W, Huang Y, Li Y, Dong M, Huang J, Xia T, Liang C, Liu Z. Deep Learning Features Improve the Performance of a Radiomics Signature for Predicting KRAS Status in Patients with Colorectal Cancer.Acad Radiol. 2020;.
Hasan AM, Jalab HA, Meziane F, Kahtan H, Al-Ahmad AS. Combining Deep and Handcrafted Image Features for MRI Brain Scan Classification.IEEE Access. 2019;7:79959-79967.
Rawla P, Sunkara T, Gaduputi V. Epidemiology of Pancreatic Cancer: Global Trends, Etiology and Risk Factors.World J Oncol. 2019;10:10-27.
Chu LC, Park S, Kawamoto S, Fouladi DF, Shayesteh S, Zinreich ES, Graves JS, Horton KM, Hruban RH, Yuille AL, Kinzler KW, Vogelstein B, Fishman EK. Utility of CT Radiomics Features in Differentiation of Pancreatic Ductal Adenocarcinoma From Normal Pancreatic Tissue.AJR Am J Roentgenol. 2019;213:349-357.
Liu KL, Wu TH, Chen PT, Tsai YM, Roth H, Wu MS, Liao WC, Wang WC. Deep learning to distinguish pancreatic cancer tissue from non-cancerous pancreatic tissue: a retrospective study with cross-racial external validation.Lancet Digit Health. 2020;2:E303-E313.
Pietryga JA, Morgan DE. Imaging preoperatively for pancreatic adenocarcinoma.J Gastrointest Oncol. 2015;6:343-357.
Li K, Yao Q, Xiao J, Li M, Yang J, Hou W, Du M, Chen K, Qu Y, Li L, Li J, Wang X, Luo H, Yang J, Zhang Z, Chen W. Contrast-enhanced CT radiomics for predicting lymph node metastasis in pancreatic ductal adenocarcinoma: a pilot study.Cancer Imaging. 2020;20:12.
Bian Y, Guo S, Jiang H, Gao S, Shao C, Cao K, Fang X, Li J, Wang L, Hua W, Zheng J, Jin G, Lu J. Relationship Between Radiomics and Risk of Lymph Node Metastasis in Pancreatic Ductal Adenocarcinoma.Pancreas. 2019;48:1195-1203.
Tummers WS, Groen JV, Sibinga Mulder BG, Farina-Sarasqueta A, Morreau J, Putter H, van de Velde CJ, Vahrmeijer AL, Bonsing BA, Mieog JS, Swijnenburg RJ. Impact of resection margin status on recurrence and survival in pancreatic cancer surgery.Br J Surg. 2019;106:1055-1065.
Strobel O, Hank T, Hinz U, Bergmann F, Schneider L, Springfeld C, Jäger D, Schirmacher P, Hackert T, Büchler MW. Pancreatic Cancer Surgery: The New R-status Counts.Ann Surg. 2017;265:565-573.
Hui B, Qiu JJ, Liu JH, Ke NW. Identification of Pancreaticoduodenectomy Resection for Pancreatic Head Adenocarcinoma: A Preliminary Study of Radiomics.Comput Math Methods Med. 2020;2020:2761627.
Bian Y, Jiang H, Ma C, Cao K, Fang X, Li J, Wang L, Zheng J, Lu J. Performance of CT-based radiomics in diagnosis of superior mesenteric vein resection margin in patients with pancreatic head cancer.Abdom Radiol (NY). 2020;45:759-773.
Terakawa H, Kitagawa H, Makino I, Hayashi H, Oyama K, Nakagawara H, Miyashita T, Tajima H, Takamura H, Fushida S, Ozaki N, Ohta T. Location of the meso-pancreatoduodenum as a regional lymphatic basin for pancreatic head carcinoma.Oncol Lett. 2017;14:397-403.
Zhang W, Cai W, He B, Xiang N, Fang C, Jia F. A radiomics-based formula for the preoperative prediction of postoperative pancreatic fistula in patients with pancreaticoduodenectomy.Cancer Manag Res. 2018;10:6469-6478.
Chen X, Oshima K, Schott D, Wu H, Hall W, Song Y, Tao Y, Li D, Zheng C, Knechtges P, Erickson B, Li XA. Assessment of treatment response during chemoradiation therapy for pancreatic cancer based on quantitative radiomic analysis of daily CTs: An exploratory study.PLoS One. 2017;12:e0178961.
Borazanci E, Korn R, Liang WS, Guarnieri C, Haag S, Snyder C, Hendrickson K, Caldwell L, Von Hoff D, Jameson G. An Analysis of Patients with DNA Repair Pathway Mutations Treated with a PARP Inhibitor.Oncologist. 2020;25:e60-e67.
Yue Y, Osipov A, Fraass B, Sandler H, Zhang X, Nissen N, Hendifar A, Tuli R. Identifying prognostic intratumor heterogeneity using pre- and post-radiotherapy 18F-FDG PET images for pancreatic cancer patients.J Gastrointest Oncol. 2017;8:127-138.
Xie T, Wang X, Li M, Tong T, Yu X, Zhou Z. Pancreatic ductal adenocarcinoma: a radiomics nomogram outperforms clinical model and TNM staging for survival estimation after curative resection.Eur Radiol. 2020;30:2513-2524.
Cozzi L, Comito T, Fogliata A, Franzese C, Franceschini D, Bonifacio C, Tozzi A, Di Brina L, Clerici E, Tomatis S, Reggiori G, Lobefalo F, Stravato A, Mancosu P, Zerbi A, Sollini M, Kirienko M, Chiti A, Scorsetti M. Computed tomography based radiomic signature as predictive of survival and local control after stereotactic body radiation therapy in pancreatic carcinoma.PLoS One. 2019;14:e0210758.
Kim HS, Kim YJ, Kim KG, Park JS. Preoperative CT texture features predict prognosis after curative resection in pancreatic cancer.Sci Rep. 2019;9:17389.
Yun G, Kim YH, Lee YJ, Kim B, Hwang JH, Choi DJ. Tumor heterogeneity of pancreas head cancer assessed by CT texture analysis: association with survival outcomes after curative resection.Sci Rep. 2018;8:7226.
Eilaghi A, Baig S, Zhang Y, Zhang J, Karanicolas P, Gallinger S, Khalvati F, Haider MA. CT texture features are associated with overall survival in pancreatic ductal adenocarcinoma - a quantitative analysis.BMC Med Imaging. 2017;17:38.
Cheng SH, Cheng YJ, Jin ZY, Xue HD. Unresectable pancreatic ductal adenocarcinoma: Role of CT quantitative imaging biomarkers for predicting outcomes of patients treated with chemotherapy.Eur J Radiol. 2019;113:188-197.
Sandrasegaran K, Lin Y, Asare-Sawiri M, Taiyini T, Tann M. CT texture analysis of pancreatic cancer.Eur Radiol. 2019;29:1067-1073.
Hyun SH, Kim HS, Choi SH, Choi DW, Lee JK, Lee KH, Park JO, Lee KH, Kim BT, Choi JY. Intratumoral heterogeneity of (18)F-FDG uptake predicts survival in patients with pancreatic ductal adenocarcinoma.Eur J Nucl Med Mol Imaging. 2016;43:1461-1468.
Lim J, Allen PJ. The diagnosis and management of intraductal papillary mucinous neoplasms of the pancreas: has progress been made?Updates Surg. 2019;71:209-216.
Chakraborty J, Midya A, Gazit L, Attiyeh M, Langdon-Embry L, Allen PJ, Do RKG, Simpson AL. CT radiomics to predict high-risk intraductal papillary mucinous neoplasms of the pancreas.Med Phys. 2018;45:5019-5029.
Corral JE, Hussein S, Kandel P, Bolan CW, Bagci U, Wallace MB. Deep Learning to Classify Intraductal Papillary Mucinous Neoplasms Using Magnetic Resonance Imaging.Pancreas. 2019;48:805-810.
Hanania AN, Bantis LE, Feng Z, Wang H, Tamm EP, Katz MH, Maitra A, Koay EJ. Quantitative imaging to evaluate malignant potential of IPMNs.Oncotarget. 2016;7:85776-85784.
Permuth JB, Choi J, Balarunathan Y, Kim J, Chen DT, Chen L, Orcutt S, Doepker MP, Gage K, Zhang G, Latifi K, Hoffe S, Jiang K, Coppola D, Centeno BA, Magliocco A, Li Q, Trevino J, Merchant N, Gillies R, Malafa M; Florida Pancreas Collaborative. Combining radiomic features with a miRNA classifier may improve prediction of malignant pathology for pancreatic intraductal papillary mucinous neoplasms.Oncotarget. 2016;7:85785-85797.
Guilmette JM, Nosé V. Neoplasms of the Neuroendocrine Pancreas: An Update in the Classification, Definition, and Molecular Genetic Advances.Adv Anat Pathol. 2019;26:13-30.
D'Onofrio M, Ciaravino V, Cardobi N, De Robertis R, Cingarlini S, Landoni L, Capelli P, Bassi C, Scarpa A. CT Enhancement and 3D Texture Analysis of Pancreatic Neuroendocrine Neoplasms.Sci Rep. 2019;9:2176.
Guo C, Zhuge X, Wang Z, Wang Q, Sun K, Feng Z, Chen X. Textural analysis on contrast-enhanced CT in pancreatic neuroendocrine neoplasms: association with WHO grade.Abdom Radiol (NY). 2019;44:576-585.
Canellas R, Burk KS, Parakh A, Sahani DV. Prediction of Pancreatic Neuroendocrine Tumor Grade Based on CT Features and Texture Analysis.AJR Am J Roentgenol. 2018;210:341-346.
Liang W, Yang P, Huang R, Xu L, Wang J, Liu W, Zhang L, Wan D, Huang Q, Lu Y, Kuang Y, Niu T. A Combined Nomogram Model to Preoperatively Predict Histologic Grade in Pancreatic Neuroendocrine Tumors.Clin Cancer Res. 2019;25:584-594.
Gu D, Hu Y, Ding H, Wei J, Chen K, Liu H, Zeng M, Tian J. CT radiomics may predict the grade of pancreatic neuroendocrine tumors: a multicenter study.Eur Radiol. 2019;29:6880-6890.
Bian Y, Zhao Z, Jiang H, Fang X, Li J, Cao K, Ma C, Guo S, Wang L, Jin G, Lu J, Xu J. Noncontrast Radiomics Approach for Predicting Grades of Nonfunctional Pancreatic Neuroendocrine Tumors.J Magn Reson Imaging. 2020;.
Strosberg JR, Weber JM, Feldman M, Coppola D, Meredith K, Kvols LK. Prognostic validity of the American Joint Committee on Cancer staging classification for midgut neuroendocrine tumors.J Clin Oncol. 2013;31:420-425.
Lee L, Ito T, Jensen RT. Prognostic and predictive factors on overall survival and surgical outcomes in pancreatic neuroendocrine tumors: recent advances and controversies.Expert Rev Anticancer Ther. 2019;19:1029-1050.
Park S, Chu LC, Hruban RH, Vogelstein B, Kinzler KW, Yuille AL, Fouladi DF, Shayesteh S, Ghandili S, Wolfgang CL, Burkhart R, He J, Fishman EK, Kawamoto S. Differentiating autoimmune pancreatitis from pancreatic ductal adenocarcinoma with CT radiomics features.Diagn Interv Imaging. 2020;.
Zhang Y, Cheng C, Liu Z, Wang L, Pan G, Sun G, Chang Y, Zuo C, Yang X. Radiomics analysis for the differentiation of autoimmune pancreatitis and pancreatic ductal adenocarcinoma in 18 F-FDG PET/CT.Med Phys. 2019;46:4520-4530.
Ren S, Zhang J, Chen J, Cui W, Zhao R, Qiu W, Duan S, Chen R, Chen X, Wang Z. Evaluation of Texture Analysis for the Differential Diagnosis of Mass-Forming Pancreatitis From Pancreatic Ductal Adenocarcinoma on Contrast-Enhanced CT Images.Front Oncol. 2019;9:1171.
Mashayekhi R, Parekh VS, Faghih M, Singh VK, Jacobs MA, Zaheer A. Radiomic features of the pancreas on CT imaging accurately differentiate functional abdominal pain, recurrent acute pancreatitis, and chronic pancreatitis.Eur J Radiol. 2020;123:108778.
Yang J, Guo X, Ou X, Zhang W, Ma X. Discrimination of Pancreatic Serous Cystadenomas From Mucinous Cystadenomas With CT Textural Features: Based on Machine Learning.Front Oncol. 2019;9:494.
Zwanenburg A, Vallières M, Abdalah MA, Aerts HJWL, Andrearczyk V, Apte A, Ashrafinia S, Bakas S, Beukinga RJ, Boellaard R, Bogowicz M, Boldrini L, Buvat I, Cook GJR, Davatzikos C, Depeursinge A, Desseroit MC, Dinapoli N, Dinh CV, Echegaray S, El Naqa I, Fedorov AY, Gatta R, Gillies RJ, Goh V, Götz M, Guckenberger M, Ha SM, Hatt M, Isensee F, Lambin P, Leger S, Leijenaar RTH, Lenkowicz J, Lippert F, Losnegård A, Maier-Hein KH, Morin O, Müller H, Napel S, Nioche C, Orlhac F, Pati S, Pfaehler EAG, Rahmim A, Rao AUK, Scherer J, Siddique MM, Sijtsema NM, Socarras Fernandez J, Spezi E, Steenbakkers RJHM, Tanadini-Lang S, Thorwarth D, Troost EGC, Upadhaya T, Valentini V, van Dijk LV, van Griethuysen J, van Velden FHP, Whybra P, Richter C, Löck S. The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping.Radiology. 2020;295:328-338.