Use of artificial intelligence in endoscopic ultrasound evaluation of pancreatic pathologies

Abstract

The application of artificial intelligence (AI) using deep learning and machine learning approaches in modern medicine is rapidly expanding. Within the field of Gastroenterology, AI is being evaluated across a breadth of clinical and diagnostic applications including identification of pathology, differentiation of disease processes, and even automated procedure report generation. Many pancreatic pathologies can have overlapping features creating a diagnostic dilemma that provides a window for AI-assisted improvement in current evaluation and diagnosis, particularly using endoscopic ultrasound. This topic highlight will review the basics of AI, history of AI in gastrointestinal endoscopy, and prospects for AI in the evaluation of autoimmune pancreatitis, pancreatic ductal adenocarcinoma, chronic pancreatitis and intraductal papillary mucinous neoplasm.

Key Words: Artificial intelligence, Deep learning, Machine learning, Convolutional neural network, Endoscopic ultrasound, Autoimmune pancreatitis, Pancreatic ductal adenocarcinoma, Chronic pancreatitis, Intraductal papillary mucinous neoplasm

Core Tip: Artificial intelligence is an emerging diagnostic tool that may further aid clinicians in the current evaluation of diseases of the pancreas.

INTRODUCTION

Artificial intelligence (AI) has emerged as a mechanism to assist clinicians, particularly in the analysis and interpretation of clinical data such as radiologic images and pathology. In general, AI encompasses the use of computer algorithms and learning models designed to complete undertakings that typically require conscious human processing[1]. For pattern recognition in images, a deep neural network learns multiple representations of the input images at different levels of abstractions. Subsets of AI include machine learning (support vector machine algorithms, artificial neural networks) and direct learning (convolutional neural networks, recurrent neural networks[1-3]. Deep learning has shown great promise in healthcare applications ranging from early detection of cancers to predicting disease survivability. The overarching goal of AI in medicine has been to decrease inter-operator variability while improving diagnostic accuracy and real-time decision making[4]. The application of AI in Gastroenterology has largely been focused on endoscopy, ranging from the detection and classification of colon polyps, to the diagnosis of esophageal and gastric cancer[1,3]. However, more recently there has been further evaluation of the role of AI in biliopancreatic endoscopy, including improved endoscopic ultrasound (EUS) differentiation between pancreatic ductal adenocarcinoma (PDAC) and other pancreatic pathologies such as autoimmune pancreatitis (AIP), chronic pancreatitis (CP) and cystic pancreas lesions such as intraductal papillary mucinous neoplasm (IPMN). This “topic highlight” will focus on the potential use of AI in the EUS evaluation of pancreatic conditions.

HISTORY OF AI IN GASTROINTESTINAL ENDOSCOPY

Early studies on the application of AI in GI endoscopy dating back to the 1990s-2000s were focused on aiding the detection and classification of colorectal polyps to improve adenoma detection rates and decrease interval colon cancers[5-8]. Additional studies have used AI to help diagnose inflammatory bowel disease and predict histologic inflammation during colonoscopy evaluation[9,10], as well as grade bowel preparation[11]. The use of AI in upper endoscopy has been assessed in the identification and labeling of basic anatomic structures with automatic image capture[12], diagnosis of Helicobacter pylori infection[13], identification of gastric and esophageal cancer[14], as well as diagnosis of dysplasia in Barrett’s esophagus[15]. With regards to capsule endoscopy, existing technology within current software platforms allows for removal of redundant or uninformative images and identifies potential images of bleeding through color detection, while more recent studies are looking into the use of AI to identify other small bowel pathologies[16]. PDAC and AIP are diseases with a highly analogous visual presentation that are difficult to distinguish by imaging. AI systems have been developed to aid EUS evaluation of pancreatic lesions with the particular goal of distinguishing pancreatic cancer from other pancreatic pathologies including CP and AIP[17-19].

AI IN PANCREATICOBILIARY ENDOSCOPY

The use of AI in pancreaticobiliary endoscopy is still in its infancy, therefore there is a paucity of literature related to EUS evaluation of pancreatic conditions using AI-based systems. However, the need for improved diagnostic evaluation of pancreatic conditions including AIP, PDAC, CP and pancreatic cystic lesions, provides an exciting niche for further research. AI has previously been applied in EUS differentiation of pancreatic cystic lesions and pancreatic tumors, thereby offering the capability of earlier and more accurate diagnosis. Both conventional machine learning and deep learning architectures have been used. A convolutional neural network (CNN) is a deep learning algorithm developed based on the concepts of visual tasks and signaling. In building a CNN for EUS, initial image data is collected and labeled based on the findings, these images are then entered as input and filtered through a multi-layer deep learning program which allows the system to learn key features of the provided EUS images. Multiple rounds of this process allow for the formation of a neural network where the system can then apply the previously learned features in analyzing novel images (Figure 1).

Figure 1 Example of neural network design.

LITERATURE SEARCH

To identify relevant literature on this topic, we searched the PubMed database through our institution’s library for articles combining the terms “autoimmune pancreatitis”, “pancreatic adenocarcinoma”, “chronic pancreatitis”, “intraductal papillary mucinous neoplasm”, “artificial intelligence”, and “endoscopic ultrasound”.

AI IN THE EVALUATION OF AUTOIMMUNE PANCREATITIS

Autoimmune pancreatitis is an inflammatory condition of the pancreas commonly associated with a constellation of findings referred to as immunoglobulin G4-related disease. AIP is characterized radiologically/endoscopically by diffuse or focal enlargement of the pancreas parenchyma and diffuse irregular narrowing of the main pancreatic duct, histologically by pancreatic fibrosis and lymphoplasmacytic infiltration, and serologically by increased levels of serum gamma globulin, including immunoglobulin G4 (IgG4)[20,21]. The diagnosis of AIP can be challenging due to the overlap of clinical, laboratory and imaging findings with those of PDAC[22-24]. Studies have shown that 2%-5% of patients who undergo pancreatic resection of suspected cancer are found to have AIP on histopathologic evaluation, and instead of receiving highly effective immunosuppressive therapy such as corticosteroids, these patients are left to manage the morbidity associated with an invasive surgery[25,26]. While EUS remains the preeminent diagnostic tool in evaluating pancreatic diseases, the yield of needle aspiration/biopsy techniques can be inconclusive or non-specific, creating a diagnostic dilemma that may ultimately delay or compromise patient care[25-28].

In late 2020, Marya et al[22] published novel research on the development of EUS-based AI to improve the diagnosis of AIP. Using a CNN built from a large collection of EUS images and videos (583 patients: 146 AIP, 292 PDAC, 72 CP, 73 normal pancreas), their team sought to develop a reliable, real-time method of distinguishing AIP from PDAC on EUS evaluation. Going one step further, they also used occlusion heatmapping to identify key sonographic features of AIP compared to PDAC, further strengthening the utility of their model. On combined still image and continuous video image analysis, the developed CNN was able to distinguish AIP from PDAC with 90% sensitivity and 87% specificity; and distinguish AIP from all other studied diagnoses (PDAC, CP, normal pancreas) with 90% sensitivity and 78% specificity. On continuous video image analysis, the developed CNN was able to successfully differentiate AIP from PDAC with a sensitivity of 90% and specificity of 93%; and differentiate AIP from all other studied diagnoses with a sensitivity of 90% and specificity of 85%. Furthermore, occlusion heatmap evaluation showed that “enhanced hyperechoic interfaces between pancreas parenchyma and pancreas duct/vessels” were predictive of AIP, and “post-acoustic enhancement deep to a dilated pancreas duct” was more commonly associated with PDAC. In addition, the study evaluated the accuracy of diagnosis between the CNN and a group of expert endosonographers, showing that the CNN correctly diagnosed AIP with a sensitivity of 88.2% and specificity of 82.5%, while expert endosonographers correctly diagnosed AIP with a sensitivity of 53.8% and specificity of 86.7%. Overall, this study serves as a model for the application of AI in the EUS evaluation of pancreatic pathologies including AIP.

AI IN THE EVALUATION OF CHRONIC PANCREATITIS

CP is an irreversible fibro-inflammatory condition caused by recurrent or persistent pancreatic parenchymal injury[29]. The diagnosis of CP is often made by analyzing a patient’s risk factors, radiographic imaging results and direct/indirect pancreatic function laboratory tests. EUS-guided tissue acquisition still serves as the gold standard for CP diagnosis when less invasive tools are inconclusive, however, studies have found similar sensitivities and specificities in the diagnosis of CP using EUS, MRI or CT[30]. This again identifies another diagnostic dilemma for which AI may serve a role to improve diagnostic accuracy, thereby improving patient care and outcomes.

Computer aided diagnosis based on digital image analysis (DIA) was initially utilized in a small study attempting to differentiate between focal, pseudotumorous pancreatitis and pancreatic malignancy with an overall diagnostic accuracy of 89%[31]. In 2008, Săftoiu et al developed a neural network to differentiate between CP and pancreatic malignancy through imaging features of EUS-elastography, further expanding to include the evaluation of contrast-enhanced EUS images in 2015[19]. Their initial system was able to differentiate between malignant and benign pancreatic masses with a sensitivity of 91.4%, specificity of 87.9% and accuracy of 89.7%. Das et al[32] used DIA of the spatial distribution of pixels on EUS images to create a neural network that could differentiate PDAC and CP with a 93% accuracy. In 2013, Zhu et al[33] published data on the use of a support vector machine predictive model to differentiate PDAC and CP based on EUS images which achieved a diagnostic accuracy of 94%. Overall, these studies provide positive reinforcement to the notion that AI can improve EUS differentiation of pancreatic malignancy from other pathologies including CP.

AI IN THE EVALUATION OF INTRADUCTAL PAPILLARY MUCINOUS NEOPLASMS

With the increasing detection of pancreatic cystic lesions on cross-sectional imaging, IPMNs have become an important pancreatic pathology given their potential for malignant transformation[34]. Early resection of IPMNs, particularly those with high grade dysplasia limit the progression to PDAC. International consensus guidelines for IPMN management have identified high risk stigmata (i.e., obstructive jaundice) and worrisome features (size > 3 cm, enhancing mural nodule < 5 mm, thickened cyst wall, MPD > 5-9 mm, abrupt change in MPD diameter) of malignancy associated with IPMN[34]. However, the use of these features alone to differentiate benign vs malignant IPMN leaves room for improvement, particularly through the use of AI-assisted EUS evaluation. In 2019, Kuwahara et al[35] performed a retrospective single-center study that developed an EUS-based CNN to differentiate benign vs malignant IPMNs. Their model identified malignant IPMNs with a diagnostic accuracy of 94%, compared to the human pre-operative diagnosis control group based on consensus guidelines which had an accuracy of 56%. While further research in this area is needed, the overarching theme of improved diagnostic accuracy when AI is applied to EUS evaluation of pancreatic disease appears to be evident.

CONCLUSION

The diagnosis of pancreatic lesions can be difficult, often stemming from the overlap of features found in benign lesions with those found in PDAC. The development of improved diagnostic tools to differentiate PDAC from other pancreatic lesions presents an opportunity for significant impact on the overall care of patients with pancreatic disease. More robust studies are needed to validate the current available research, namely in the form of prospective, multicenter studies which may further determine the generalizability of current models and the overall, real-time clinical application of these AI systems. It should be noted that standardization of endoscopic image capture and reporting may better help facilitate future interdisciplinary work in this field[36,37]. While the use of AI to evaluate the pancreas appears to be in its early stages, the potential for AI-assisted EUS assessment provides an exciting and promising future for the diagnosis and management of pancreatic lesions.