1
|
Hassan C, Antonelli G, Chiu PWY, Emura F, Goda K, G Iyer P, Al Awadhi S, Al Lehibi A, Arantes V, Burgos H, Cerisoli CL, Dawsey S, Draganov P, Fleischer D, Fluxá F, Gonzalez N, Inoue H, John S, Kashin S, Khashab M, Kim GH, Kothari S, Yeh Lee Y, Ngamruengphong S, Remes-Troche JM, Sharara AI, Shimamura Y, Varocha M, Villa-Gomez G, Wang KK, Wang WL, Yip HC, Sharma P. Position statement of the World Endoscopy Organization: Role of endoscopy in screening, diagnosis, and treatment of esophageal superficial squamous neoplasiaia. Dig Endosc 2025; 37:470-489. [PMID: 39722219 DOI: 10.1111/den.14967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/15/2024] [Accepted: 11/10/2024] [Indexed: 12/28/2024]
Abstract
Esophageal squamous cell carcinoma (ESCC) remains a significant global health challenge, being the sixth leading cause of cancer mortality with pronounced geographic variability. The incidence rates range from 125 per 100,000 in northern China to 1-1.5 per 100,000 in the United States, driven by environmental and lifestyle factors such as tobacco and alcohol use, dietary habits, and pollution. Major modifiable risk factors include tobacco and alcohol consumption, with a synergistic risk increase when combined. Nonmodifiable risk factors include previous diagnoses of head and neck squamous cell carcinoma (H&N SCC), achalasia, and prior radiotherapy. Prevention strategies must be tailored to specific regional burdens to efficiently allocate medical and financial resources. Gastrointestinal endoscopy is crucial in reducing ESCC burden through early detection and characterization of neoplastic changes, such as high-grade dysplasia. Early diagnosis significantly improves survival rates, while endoscopic resection of noninvasive dysplasia can prevent ESCC onset, reducing treatment burden for advanced disease. Postresection surveillance can detect high-risk metachronous lesions. Despite these benefits, endoscopic prevention faces challenges, including the lack of high-level evidence supporting its efficacy, opportunity costs, the need for specialized training and techniques, and the requirement for advanced technology investments. This Position Statement from the World Endoscopy Organization (WEO) aims to address these challenges, supplying recommendations for the exploitation of endoscopic resources regarding the possible role of screening, quality, and training for the detection, characterization, resection, and surveillance of ESCC.
Collapse
Affiliation(s)
- Cesare Hassan
- Department of Biomedical Sciences, Humanitas University, Milan, Italy
- IRCCS Humanitas Research Hospital, Milan, Italy
| | - Giulio Antonelli
- Gastroenterology and Digestive Endoscopy Unit, Ospedale dei Castelli Hospital, Rome, Italy
- Department of Anatomical, Histological, Forensic Medicine and Orthopedics Sciences, "Sapienza" University of Rome, Rome, Italy
| | - Philip Wai-Yan Chiu
- Division of Upper Gastrointestinal and Metabolic Surgery, Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, China
| | - Fabian Emura
- Digestive Health and Liver Diseases, University of Miami, Miami, USA
- Interventional Endoscopy Center, Jackson Memorial Hospital, Miami, USA
| | - Kenichi Goda
- Gastrointestinal Endoscopy Center, Dokkyo Medical University Hospital, Tochigi, Japan
| | - Prasad G Iyer
- Esophageal Interest Group, Division of Gastroenterology and Hepatology, Mayo Clinic, Rochester, USA
| | - Sameer Al Awadhi
- Rashid Hospital, Dubai Health Authority, Dubai, United Arab Emirates
| | - Abed Al Lehibi
- Gastroenterology and Hepatology Department, King Fahad Medical City, Riyad, Saudi Arabia
| | - Vitor Arantes
- Endoscopy Unit, Alfa Institute of Gastroenterology, School of Medicine, Federal University of Minas Gerais, Hospital Mater Dei Contorno, Belo Horizonte, Brazil
| | - Herbert Burgos
- World Gastroenterology Organization-Training Center in Costa Rica, University of Costa Rica, FASGE, Costa Rica, Central America
| | - Cecilio L Cerisoli
- Therapeutic and Diagnostic Gastroenterology (GEDYT) Center, Buenos Aires, Argentina
| | - Sanford Dawsey
- Division of Cancer Epidemiology and Genetics, National Cancer Institute, Maryland, USA
| | | | - David Fleischer
- Division of Gastroenterology and Hepatology, Mayo Clinic, Scottsdale, USA
| | - Fernando Fluxá
- Gastroenterology Department Clinica Meds, Santiago, Chile
| | | | - Haruhiro Inoue
- Digestive Diseases Center, Showa University Koto Toyosu Hospital, Tokyo, Japan
| | - Sneha John
- Endoscopy Unit, Gold Coast University Hospital, Southport, Australia
| | - Sergey Kashin
- Endoscopy Department, Yaroslavl State Medical University, Yaroslavl, Russia
| | - Mouen Khashab
- Therapeutic Endoscopy, Johns Hopkins Hospital, Baltimore, USA
| | - Gwang Ha Kim
- Department of Internal Medicine, Pusan National University College of Medicine, Busan, South Korea
- Biomedical Research Institute, Pusan National University Hospital, Busan, South Korea
| | - Shivangi Kothari
- Division of Gastroenterology and Hepatology, University of Rochester Medical Center, Rochester, USA
| | - Yeong Yeh Lee
- School of Medical Sciences, Universiti Sains Malaysia, Kota Bharu, Malaysia
| | | | | | - Ala I Sharara
- Division of Gastroenterology, American University of Beirut Medical Center, Beirut, Lebanon
| | | | - Mahachai Varocha
- Center of Excellence in Digestive Diseases, Thammasat University, Bangkok, Thailand
| | - Guido Villa-Gomez
- Gastroenterology and Digestive Endoscopy Unit, WGO La Paz Training Center, La Paz, Bolivia
| | - Kenneth K Wang
- Russ and Kathy Van Cleve Professor of Gastroenterology, Mayo Clinic, Rochester, USA
| | - Wen-Lun Wang
- Department of Internal Medicine, E-Da Hospital/I-Shou University, Kaohsiung, Taiwan
| | - Hon-Chi Yip
- Division of Upper Gastrointestinal and Metabolic Surgery, Department of Surgery, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong, China
| | - Prateek Sharma
- University of Kansas School of Medicine and VA Medical Center, Kansas City, USA
| |
Collapse
|
2
|
Nathani P, Sharma P. Role of Artificial Intelligence in the Detection and Management of Premalignant and Malignant Lesions of the Esophagus and Stomach. Gastrointest Endosc Clin N Am 2025; 35:319-353. [PMID: 40021232 DOI: 10.1016/j.giec.2024.10.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/03/2025]
Abstract
The advent of artificial intelligence (AI) and deep learning algorithms, particularly convolutional neural networks, promises to address pitfalls, bridging the care for patients at high risk with improved detection (computer-aided detection [CADe]) and characterization (computer-aided diagnosis [CADx]) of lesions. This review describes the available artificial intelligence (AI) technology and the current data on AI tools for screening esophageal squamous cell cancer, Barret's esophagus-related neoplasia, and gastric cancer. These tools outperformed endoscopists in many situations. Recent randomized controlled trials have demonstrated the successful application of AI tools in clinical practice with improved outcomes.
Collapse
Affiliation(s)
- Piyush Nathani
- Department of Gastroenterology, University of Kansas School of Medicine, Kansas City, KS, USA.
| | - Prateek Sharma
- Department of Gastroenterology, University of Kansas School of Medicine, Kansas City, KS, USA; Kansas City Veteran Affairs Medical Center, Kansas City, MO, USA
| |
Collapse
|
3
|
Li B, Du YY, Tan WM, He DL, Qi ZP, Yu HH, Shi Q, Ren Z, Cai MY, Yan B, Cai SL, Zhong YS. Effect of computer aided detection system on esophageal neoplasm diagnosis in varied levels of endoscopists. NPJ Digit Med 2025; 8:160. [PMID: 40082585 PMCID: PMC11906877 DOI: 10.1038/s41746-025-01532-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2024] [Accepted: 02/19/2025] [Indexed: 03/16/2025] Open
Abstract
A computer-aided detection (CAD) system for early esophagus carcinoma identification during endoscopy with narrow-band imaging (NBI) was evaluated in a large-scale, prospective, tandem, randomized controlled trial to assess its effectiveness. The study was registered at the Chinese Clinical Trial Registry (ChiCTR2100050654, 2021/09/01). Involving 3400 patients were randomly assigned to either routine (routine-first) or CAD-assisted (CAD-first) NBI endoscopy, followed by the other procedure, with targeted biopsies taken at the end of the second examination. The primary outcome was the diagnosis of 1 or more neoplastic lesion of esophagus during the first examination. The CAD-first group demonstrated a significantly higher neoplastic lesion detection rate (3.12%) compared to the routine-first group (1.59%) with a relative detection ratio of 1.96 (P = 0.0047). Subgroup analysis revealed a higher detection rate in junior endoscopists using CAD-first, while no significant difference was observed for senior endoscopists. The CAD system significantly improved esophageal neoplasm detection, particularly benefiting junior endoscopists.
Collapse
Affiliation(s)
- Bing Li
- Endoscopy Center, Zhongshan Hospital of Fudan University, Shanghai, China
| | - Yan-Yun Du
- Endoscopy Center, Zhongshan Hospital of Fudan University, Shanghai, China
| | - Wei-Min Tan
- School of Computer Science, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai, China
| | - Dong-Li He
- Endoscopy Center, Xuhui Hospital, Zhongshan Hospital of Fudan University, Shanghai, China
| | - Zhi-Peng Qi
- Endoscopy Center, Zhongshan Hospital of Fudan University, Shanghai, China
| | - Hon-Ho Yu
- Department of Gastroenterology, Kiang Wu Hospital, Macau SAR, China
| | - Qiang Shi
- Endoscopy Center, Zhongshan Hospital of Fudan University, Shanghai, China
| | - Zhong Ren
- Endoscopy Center, Zhongshan Hospital of Fudan University, Shanghai, China
| | - Ming-Yan Cai
- Endoscopy Center, Zhongshan Hospital of Fudan University, Shanghai, China
| | - Bo Yan
- School of Computer Science, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University, Shanghai, China.
| | - Shi-Lun Cai
- Endoscopy Center, Zhongshan Hospital of Fudan University, Shanghai, China.
- Endoscopy Center, Xuhui Hospital, Zhongshan Hospital of Fudan University, Shanghai, China.
| | - Yun-Shi Zhong
- Endoscopy Center, Zhongshan Hospital of Fudan University, Shanghai, China.
- Endoscopy Center, Xuhui Hospital, Zhongshan Hospital of Fudan University, Shanghai, China.
- Endoscopy Center, Shanghai Geriatric Medical Center, Shanghai, China.
| |
Collapse
|
4
|
Zhou N, Yuan X, Liu W, Luo Q, Liu R, Hu B. Artificial intelligence in endoscopic diagnosis of esophageal squamous cell carcinoma and precancerous lesions. Chin Med J (Engl) 2025:00029330-990000000-01442. [PMID: 40008787 DOI: 10.1097/cm9.0000000000003490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2024] [Indexed: 02/27/2025] Open
Abstract
Esophageal squamous cell carcinoma (ESCC) poses a significant global health challenge, necessitating early detection, timely diagnosis, and prompt treatment to improve patient outcomes. Endoscopic examination plays a pivotal role in this regard. However, despite the availability of various endoscopic techniques, certain limitations can result in missed or misdiagnosed ESCCs. Currently, artificial intelligence (AI)-assisted endoscopic diagnosis has made significant strides in addressing these limitations and improving the diagnosis of ESCC and precancerous lesions. In this review, we provide an overview of the current state of AI applications for endoscopic diagnosis of ESCC and precancerous lesions in aspects including lesion characterization, margin delineation, invasion depth estimation, and microvascular subtype classification. Furthermore, we offer insights into the future direction of this field, highlighting potential advancements that can lead to more accurate diagnoses and ultimately better prognoses for patients.
Collapse
Affiliation(s)
- Nuoya Zhou
- Department of Gastroenterology and Hepatology, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China
| | - Xianglei Yuan
- Digestive Endoscopy Medical Engineering Research Laboratory, West China Hospital, Med-X Center for Materials, Sichuan University, Chengdu, Sichuan 610041, China
| | - Wei Liu
- Department of Gastroenterology and Hepatology, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China
| | - Qi Luo
- Department of Gastroenterology and Hepatology, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China
| | - Ruide Liu
- Department of Gastroenterology and Hepatology, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China
| | - Bing Hu
- Department of Gastroenterology and Hepatology, West China Hospital, Sichuan University, Chengdu, Sichuan 610041, China
| |
Collapse
|
5
|
Rai HM, Yoo J, Razaque A. Comparative analysis of machine learning and deep learning models for improved cancer detection: A comprehensive review of recent advancements in diagnostic techniques. EXPERT SYSTEMS WITH APPLICATIONS 2024; 255:124838. [DOI: 10.1016/j.eswa.2024.124838] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/11/2024]
|
6
|
Zhang WY, Chang YJ, Shi RH. Artificial intelligence enhances the management of esophageal squamous cell carcinoma in the precision oncology era. World J Gastroenterol 2024; 30:4267-4280. [PMID: 39492825 PMCID: PMC11525855 DOI: 10.3748/wjg.v30.i39.4267] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/28/2024] [Revised: 08/31/2024] [Accepted: 09/19/2024] [Indexed: 10/12/2024] Open
Abstract
Esophageal squamous cell carcinoma (ESCC) is the most common histological type of esophageal cancer with a poor prognosis. Early diagnosis and prognosis assessment are crucial for improving the survival rate of ESCC patients. With the advancement of artificial intelligence (AI) technology and the proliferation of medical digital information, AI has demonstrated promising sensitivity and accuracy in assisting precise detection, treatment decision-making, and prognosis assessment of ESCC. It has become a unique opportunity to enhance comprehensive clinical management of ESCC in the era of precision oncology. This review examines how AI is applied to the diagnosis, treatment, and prognosis assessment of ESCC in the era of precision oncology, and analyzes the challenges and potential opportunities that AI faces in clinical translation. Through insights into future prospects, it is hoped that this review will contribute to the real-world application of AI in future clinical settings, ultimately alleviating the disease burden caused by ESCC.
Collapse
Affiliation(s)
- Wan-Yue Zhang
- School of Medicine, Southeast University, Nanjing 221000, Jiangsu Province, China
| | - Yong-Jian Chang
- School of Cyber Science and Engineering, Southeast University, Nanjing 210009, Jiangsu Province, China
| | - Rui-Hua Shi
- Department of Gastroenterology, Zhongda Hospital, Southeast University, Nanjing 210009, Jiangsu Province, China
| |
Collapse
|
7
|
Theocharopoulos C, Davakis S, Ziogas DC, Theocharopoulos A, Foteinou D, Mylonakis A, Katsaros I, Gogas H, Charalabopoulos A. Deep Learning for Image Analysis in the Diagnosis and Management of Esophageal Cancer. Cancers (Basel) 2024; 16:3285. [PMID: 39409906 PMCID: PMC11475041 DOI: 10.3390/cancers16193285] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2024] [Revised: 09/21/2024] [Accepted: 09/24/2024] [Indexed: 10/20/2024] Open
Abstract
Esophageal cancer has a dismal prognosis and necessitates a multimodal and multidisciplinary approach from diagnosis to treatment. High-definition white-light endoscopy and histopathological confirmation remain the gold standard for the definitive diagnosis of premalignant and malignant lesions. Artificial intelligence using deep learning (DL) methods for image analysis constitutes a promising adjunct for the clinical endoscopist that could effectively decrease BE overdiagnosis and unnecessary surveillance, while also assisting in the timely detection of dysplastic BE and esophageal cancer. A plethora of studies published during the last five years have consistently reported highly accurate DL algorithms with comparable or superior performance compared to endoscopists. Recent efforts aim to expand DL utilization into further aspects of esophageal neoplasia management including histologic diagnosis, segmentation of gross tumor volume, pretreatment prediction and post-treatment evaluation of patient response to systemic therapy and operative guidance during minimally invasive esophagectomy. Our manuscript serves as an introduction to the growing literature of DL applications for image analysis in the management of esophageal neoplasia, concisely presenting all currently published studies. We also aim to guide the clinician across basic functional principles, evaluation metrics and limitations of DL for image recognition to facilitate the comprehension and critical evaluation of the presented studies.
Collapse
Affiliation(s)
| | - Spyridon Davakis
- First Department of Surgery, School of Medicine, Laiko General Hospital, National and Kapodistrian University of Athens, 11527 Athens, Greece; (S.D.); (A.M.); (I.K.); (A.C.)
| | - Dimitrios C. Ziogas
- First Department of Medicine, School of Medicine, Laiko General Hospital, National and Kapodistrian University of Athens, 11527 Athens, Greece; (D.C.Z.); (D.F.); (H.G.)
| | - Achilleas Theocharopoulos
- Department of Electrical and Computer Engineering, National Technical University of Athens, 10682 Athens, Greece;
| | - Dimitra Foteinou
- First Department of Medicine, School of Medicine, Laiko General Hospital, National and Kapodistrian University of Athens, 11527 Athens, Greece; (D.C.Z.); (D.F.); (H.G.)
| | - Adam Mylonakis
- First Department of Surgery, School of Medicine, Laiko General Hospital, National and Kapodistrian University of Athens, 11527 Athens, Greece; (S.D.); (A.M.); (I.K.); (A.C.)
| | - Ioannis Katsaros
- First Department of Surgery, School of Medicine, Laiko General Hospital, National and Kapodistrian University of Athens, 11527 Athens, Greece; (S.D.); (A.M.); (I.K.); (A.C.)
| | - Helen Gogas
- First Department of Medicine, School of Medicine, Laiko General Hospital, National and Kapodistrian University of Athens, 11527 Athens, Greece; (D.C.Z.); (D.F.); (H.G.)
| | - Alexandros Charalabopoulos
- First Department of Surgery, School of Medicine, Laiko General Hospital, National and Kapodistrian University of Athens, 11527 Athens, Greece; (S.D.); (A.M.); (I.K.); (A.C.)
| |
Collapse
|
8
|
Bou Jaoude J, Al Bacha R, Abboud B. Will artificial intelligence reach any limit in gastroenterology? Artif Intell Gastroenterol 2024; 5:91336. [DOI: 10.35712/aig.v5.i2.91336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 04/25/2024] [Accepted: 06/07/2024] [Indexed: 08/08/2024] Open
Abstract
Endoscopy is the cornerstone in the management of digestive diseases. Over the last few decades, technology has played an important role in the development of this field, helping endoscopists in better detecting and characterizing luminal lesions. However, despite ongoing advancements in endoscopic technology, the incidence of missed pre-neoplastic and neoplastic lesions remains high due to the operator-dependent nature of endoscopy and the challenging learning curve associated with new technologies. Artificial intelligence (AI), an operator-independent field, could be an invaluable solution. AI can serve as a “second observer”, enhancing the performance of endoscopists in detecting and characterizing luminal lesions. By utilizing deep learning (DL), an innovation within machine learning, AI automatically extracts input features from targeted endoscopic images. DL encompasses both computer-aided detection and computer-aided diagnosis, assisting endoscopists in reducing missed detection rates and predicting the histology of luminal digestive lesions. AI applications in clinical gastrointestinal diseases are continuously expanding and evolving the entire digestive tract. In all published studies, real-time AI assists endoscopists in improving the performance of non-expert gastroenterologists, bringing it to a level comparable to that of experts. The development of DL may be affected by selection biases. Studies have utilized different AI-assisted models, which are heterogeneous. In the future, algorithms need validation through large, randomized trials. Theoretically, AI has no limit to assist endoscopists in increasing the accuracy and the quality of endoscopic exams. However, practically, we still have a long way to go before standardizing our AI models to be accepted and applied by all gastroenterologists.
Collapse
Affiliation(s)
- Joseph Bou Jaoude
- Department of Gastroenterology, Levant Hospital, Beirut 166830, Lebanon
| | - Rose Al Bacha
- Department of Gastroenterology, Levant Hospital, Beirut 166830, Lebanon
| | - Bassam Abboud
- Department of General Surgery, Geitaoui Hospital, Faculty of Medicine, Lebanese University, Lebanon, Beirut 166830, Lebanon
| |
Collapse
|
9
|
Tsao YM, Mukundan A, Karmakar R, Lu SC, Nguyen HT, Wang HC. Hyperspectral Imaging Applied to Identify Early Esophageal Cancer. 2024 CONFERENCE ON LASERS AND ELECTRO-OPTICS PACIFIC RIM (CLEO-PR) 2024:1-2. [DOI: https:/doi.org/10.1109/cleo-pr60912.2024.10676726] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/02/2025]
Affiliation(s)
- Yu-Ming Tsao
- National Chung Cheng University,Department of Mechanical Engineering,Minxiong,Chiayi,Taiwan,62102
| | - Arvind Mukundan
- National Chung Cheng University,Department of Mechanical Engineering,Minxiong,Chiayi,Taiwan,62102
| | - Riya Karmakar
- National Chung Cheng University,Department of Mechanical Engineering,Minxiong,Chiayi,Taiwan,62102
| | - Song-Cun Lu
- National Chung Cheng University,Department of Mechanical Engineering,Minxiong,Chiayi,Taiwan,62102
| | - Hong-Thai Nguyen
- National Chung Cheng University,Department of Mechanical Engineering,Minxiong,Chiayi,Taiwan,62102
| | - Hsiang-Chen Wang
- National Chung Cheng University,Department of Mechanical Engineering,Minxiong,Chiayi,Taiwan,62102
| |
Collapse
|
10
|
Bangolo A, Wadhwani N, Nagesh VK, Dey S, Tran HHV, Aguilar IK, Auda A, Sidiqui A, Menon A, Daoud D, Liu J, Pulipaka SP, George B, Furman F, Khan N, Plumptre A, Sekhon I, Lo A, Weissman S. Impact of artificial intelligence in the management of esophageal, gastric and colorectal malignancies. Artif Intell Gastrointest Endosc 2024; 5:90704. [DOI: 10.37126/aige.v5.i2.90704] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Revised: 01/28/2024] [Accepted: 03/04/2024] [Indexed: 05/11/2024] Open
Abstract
The incidence of gastrointestinal malignancies has increased over the past decade at an alarming rate. Colorectal and gastric cancers are the third and fifth most commonly diagnosed cancers worldwide but are cited as the second and third leading causes of mortality. Early institution of appropriate therapy from timely diagnosis can optimize patient outcomes. Artificial intelligence (AI)-assisted diagnostic, prognostic, and therapeutic tools can assist in expeditious diagnosis, treatment planning/response prediction, and post-surgical prognostication. AI can intercept neoplastic lesions in their primordial stages, accurately flag suspicious and/or inconspicuous lesions with greater accuracy on radiologic, histopathological, and/or endoscopic analyses, and eliminate over-dependence on clinicians. AI-based models have shown to be on par, and sometimes even outperformed experienced gastroenterologists and radiologists. Convolutional neural networks (state-of-the-art deep learning models) are powerful computational models, invaluable to the field of precision oncology. These models not only reliably classify images, but also accurately predict response to chemotherapy, tumor recurrence, metastasis, and survival rates post-treatment. In this systematic review, we analyze the available evidence about the diagnostic, prognostic, and therapeutic utility of artificial intelligence in gastrointestinal oncology.
Collapse
Affiliation(s)
- Ayrton Bangolo
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Nikita Wadhwani
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Vignesh K Nagesh
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Shraboni Dey
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Hadrian Hoang-Vu Tran
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Izage Kianifar Aguilar
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Auda Auda
- Department of Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Aman Sidiqui
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Aiswarya Menon
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Deborah Daoud
- Department of Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - James Liu
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Sai Priyanka Pulipaka
- Department of Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Blessy George
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Flor Furman
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Nareeman Khan
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Adewale Plumptre
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Imranjot Sekhon
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Abraham Lo
- Department of Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| | - Simcha Weissman
- Department of Internal Medicine, Palisades Medical Center, North Bergen, NJ 07047, United States
| |
Collapse
|
11
|
Zhang B, Zhang W, Yao H, Qiao J, Zhang H, Song Y. A study on the improvement in the ability of endoscopists to diagnose gastric neoplasms using an artificial intelligence system. Front Med (Lausanne) 2024; 11:1323516. [PMID: 38348337 PMCID: PMC10859510 DOI: 10.3389/fmed.2024.1323516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 01/08/2024] [Indexed: 02/15/2024] Open
Abstract
Background Artificial intelligence-assisted gastroscopy (AIAG) based on deep learning has been validated in various scenarios, but there is a lack of studies regarding diagnosing neoplasms under white light endoscopy. This study explored the potential role of AIAG systems in enhancing the ability of endoscopists to diagnose gastric tumor lesions under white light. Methods A total of 251 patients with complete pathological information regarding electronic gastroscopy, biopsy, or ESD surgery in Xi'an Gaoxin Hospital were retrospectively collected and comprised 64 patients with neoplasm lesions (excluding advanced cancer) and 187 patients with non-neoplasm lesions. The diagnosis competence of endoscopists with intermediate experience and experts was compared for gastric neoplasms with or without the assistance of AIAG, which was developed based on ResNet-50. Results For the 251 patients with difficult clinical diagnoses included in the study, compared with endoscopists with intermediate experience, AIAG's diagnostic competence was much higher, with a sensitivity of 79.69% (79.69% vs. 72.50%, p = 0.012) and a specificity of 73.26% (73.26% vs. 52.62%, p < 0.001). With the help of AIAG, the endoscopists with intermediate experience (<8 years) demonstrated a relatively higher specificity (59.79% vs. 52.62%, p < 0.001). Experts (≥8 years) had similar results with or without AI assistance (with AI vs. without AI; sensitivities, 70.31% vs. 67.81%, p = 0.358; specificities, 83.85% vs. 85.88%, p = 0.116). Conclusion With the assistance of artificial intelligence (AI) systems, the ability of endoscopists with intermediate experience to diagnose gastric neoplasms is significantly improved, but AI systems have little effect on experts.
Collapse
Affiliation(s)
- Bojiang Zhang
- Department of Gastroenterology, Xi’an Gaoxin Hospital, Xi’an, China
| | - Wei Zhang
- Clinical Medical College, Xi’an Medical University, Xi’an, China
| | - Hongjuan Yao
- Department of Gastroenterology, Xi’an Gaoxin Hospital, Xi’an, China
| | - Jinggui Qiao
- Department of Gastroenterology, Xi’an Gaoxin Hospital, Xi’an, China
| | - Haimiao Zhang
- College of Nursing and Rehabilitation, Xi’an Medical University, Xi’an, China
| | - Ying Song
- Department of Gastroenterology, Xi’an Gaoxin Hospital, Xi’an, China
| |
Collapse
|
12
|
Lam AB, Moore V, Nipp RD. Care Delivery Interventions for Individuals with Cancer: A Literature Review and Focus on Gastrointestinal Malignancies. Healthcare (Basel) 2023; 12:30. [PMID: 38200936 PMCID: PMC10779432 DOI: 10.3390/healthcare12010030] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 12/05/2023] [Accepted: 12/21/2023] [Indexed: 01/12/2024] Open
Abstract
BACKGROUND Gastrointestinal malignancies represent a particularly challenging condition, often requiring a multidisciplinary approach to management in order to meet the unique needs of these individuals and their caregivers. PURPOSE In this literature review, we sought to describe care delivery interventions that strive to improve the quality of life and care for patients with a focus on gastrointestinal malignancies. CONCLUSION We highlight patient-centered care delivery interventions, including patient-reported outcomes, hospital-at-home interventions, and other models of care for individuals with cancer. By demonstrating the relevance and utility of these different care models for patients with gastrointestinal malignancies, we hope to highlight the importance of developing and testing new interventions to address the unique needs of this population.
Collapse
Affiliation(s)
- Anh B. Lam
- Department of Medicine, University of Oklahoma Health Sciences Center, Oklahoma City, OK 73104, USA
| | - Vanessa Moore
- College of Medicine, University of Oklahoma Health Sciences Center, Oklahoma City, OK 73117, USA;
| | - Ryan D. Nipp
- Division of Hematology and Oncology, University of Oklahoma Health Sciences Center, Stephenson Cancer Center, Oklahoma City, OK 73104, USA
| |
Collapse
|
13
|
Lupu A, Reynard S, Rivory J, Lafeuille P, Grimaldi J, Yzet C, Pioche M. Endoscopic submucosal dissection of esophageal squamous cell carcinoma with superficial capillary changes and epithelialization after chemotherapy for pancreatic adenocarcinoma. Endoscopy 2023; 55:E1089-E1090. [PMID: 37802105 PMCID: PMC10558251 DOI: 10.1055/a-2163-1658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/08/2023]
Affiliation(s)
- Alexandru Lupu
- Gastroenterology and Endoscopy Unit, Edouard Herriot Hospital, Lyon, France
| | | | - Jérôme Rivory
- Gastroenterology and Endoscopy Unit, Edouard Herriot Hospital, Lyon, France
| | - Pierre Lafeuille
- Gastroenterology and Endoscopy Unit, Edouard Herriot Hospital, Lyon, France
| | - Jean Grimaldi
- Gastroenterology and Endoscopy Unit, Edouard Herriot Hospital, Lyon, France
| | - Clara Yzet
- Gastroenterology and Endoscopy Unit, Edouard Herriot Hospital, Lyon, France
| | - Mathieu Pioche
- Gastroenterology and Endoscopy Unit, Edouard Herriot Hospital, Lyon, France
| |
Collapse
|
14
|
Guidozzi N, Menon N, Chidambaram S, Markar SR. The role of artificial intelligence in the endoscopic diagnosis of esophageal cancer: a systematic review and meta-analysis. Dis Esophagus 2023; 36:doad048. [PMID: 37480192 PMCID: PMC10789250 DOI: 10.1093/dote/doad048] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/23/2023]
Abstract
Early detection of esophageal cancer is limited by accurate endoscopic diagnosis of subtle macroscopic lesions. Endoscopic interpretation is subject to expertise, diagnostic skill, and thus human error. Artificial intelligence (AI) in endoscopy is increasingly bridging this gap. This systematic review and meta-analysis consolidate the evidence on the use of AI in the endoscopic diagnosis of esophageal cancer. The systematic review was carried out using Pubmed, MEDLINE and Ovid EMBASE databases and articles on the role of AI in the endoscopic diagnosis of esophageal cancer management were included. A meta-analysis was also performed. Fourteen studies (1590 patients) assessed the use of AI in endoscopic diagnosis of esophageal squamous cell carcinoma-the pooled sensitivity and specificity were 91.2% (84.3-95.2%) and 80% (64.3-89.9%). Nine studies (478 patients) assessed AI capabilities of diagnosing esophageal adenocarcinoma with the pooled sensitivity and specificity of 93.1% (86.8-96.4) and 86.9% (81.7-90.7). The remaining studies formed the qualitative summary. AI technology, as an adjunct to endoscopy, can assist in accurate, early detection of esophageal malignancy. It has shown superior results to endoscopists alone in identifying early cancer and assessing depth of tumor invasion, with the added benefit of not requiring a specialized skill set. Despite promising results, the application in real-time endoscopy is limited, and further multicenter trials are required to accurately assess its use in routine practice.
Collapse
Affiliation(s)
- Nadia Guidozzi
- Department of General Surgery, University of Witwatersrand, Johannesburg, South Africa
| | - Nainika Menon
- Department of General Surgery, Oxford University Hospitals, Oxford, UK
| | - Swathikan Chidambaram
- Academic Surgical Unit, Department of Surgery and Cancer, Imperial College London, St Mary’s Hospital, London, UK
| | - Sheraz Rehan Markar
- Department of General Surgery, Oxford University Hospitals, Oxford, UK
- Nuffield Department of Surgery, University of Oxford, Oxford, UK
| |
Collapse
|
15
|
Lu S, Tsao YM, Mukundan A, Huang CW, Wang YK, Wu IC, Wang HC. Hyperspectral imaging applied to YOLOv5 to identify early esophageal cancer. OPTICS IN HEALTH CARE AND BIOMEDICAL OPTICS XIII 2023:115. [DOI: 10.1117/12.2688665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/15/2024]
|
16
|
Lu S, Tsao YM, Mukundan A, Huang CW, Wang YK, Wu IC, Wang HC. Hyperspectral imaging applied to YOLOv5 to identify early esophageal cancer. OPTICS IN HEALTH CARE AND BIOMEDICAL OPTICS XIII 2023:115. [DOI: https:/doi.org/10.1117/12.2688665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/02/2025]
|
17
|
Zhang JQ, Mi JJ, Wang R. Application of convolutional neural network-based endoscopic imaging in esophageal cancer or high-grade dysplasia: A systematic review and meta-analysis. World J Gastrointest Oncol 2023; 15:1998-2016. [DOI: 10.4251/wjgo.v15.i11.1998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 09/05/2023] [Accepted: 10/11/2023] [Indexed: 11/15/2023] Open
Abstract
BACKGROUND Esophageal cancer is the seventh-most common cancer type worldwide, accounting for 5% of death from malignancy. Development of novel diagnostic techniques has facilitated screening, early detection, and improved prognosis. Convolutional neural network (CNN)-based image analysis promises great potential for diagnosing and determining the prognosis of esophageal cancer, enabling even early detection of dysplasia.
AIM To conduct a meta-analysis of the diagnostic accuracy of CNN models for the diagnosis of esophageal cancer and high-grade dysplasia (HGD).
METHODS PubMed, EMBASE, Web of Science and Cochrane Library databases were searched for articles published up to November 30, 2022. We evaluated the diagnostic accuracy of using the CNN model with still image-based analysis and with video-based analysis for esophageal cancer or HGD, as well as for the invasion depth of esophageal cancer. The pooled sensitivity, pooled specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR) and area under the curve (AUC) were estimated, together with the 95% confidence intervals (CI). A bivariate method and hierarchical summary receiver operating characteristic method were used to calculate the diagnostic test accuracy of the CNN model. Meta-regression and subgroup analyses were used to identify sources of heterogeneity.
RESULTS A total of 28 studies were included in this systematic review and meta-analysis. Using still image-based analysis for the diagnosis of esophageal cancer or HGD provided a pooled sensitivity of 0.95 (95%CI: 0.92-0.97), pooled specificity of 0.92 (0.89-0.94), PLR of 11.5 (8.3-16.0), NLR of 0.06 (0.04-0.09), DOR of 205 (115-365), and AUC of 0.98 (0.96-0.99). When video-based analysis was used, a pooled sensitivity of 0.85 (0.77-0.91), pooled specificity of 0.73 (0.59-0.83), PLR of 3.1 (1.9-5.0), NLR of 0.20 (0.12-0.34), DOR of 15 (6-38) and AUC of 0.87 (0.84-0.90) were found. Prediction of invasion depth resulted in a pooled sensitivity of 0.90 (0.87-0.92), pooled specificity of 0.83 (95%CI: 0.76-0.88), PLR of 7.8 (1.9-32.0), NLR of 0.10 (0.41-0.25), DOR of 118 (11-1305), and AUC of 0.95 (0.92-0.96).
CONCLUSION CNN-based image analysis in diagnosing esophageal cancer and HGD is an excellent diagnostic method with high sensitivity and specificity that merits further investigation in large, multicenter clinical trials.
Collapse
Affiliation(s)
- Jun-Qi Zhang
- The Fifth Clinical Medical College, Shanxi Medical University, Taiyuan 030001, Shanxi Province, China
| | - Jun-Jie Mi
- Department of Gastroenterology, Shanxi Provincial People’s Hospital, Taiyuan 030012, Shanxi Province, China
| | - Rong Wang
- Department of Gastroenterology, The Fifth Hospital of Shanxi Medical University (Shanxi Provincial People’s Hospital), Taiyuan 030012, Shanxi Province, China
| |
Collapse
|
18
|
Arif AA, Jiang SX, Byrne MF. Artificial intelligence in endoscopy: Overview, applications, and future directions. Saudi J Gastroenterol 2023; 29:269-277. [PMID: 37787347 PMCID: PMC10644999 DOI: 10.4103/sjg.sjg_286_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 08/16/2023] [Indexed: 09/15/2023] Open
Abstract
Since the emergence of artificial intelligence (AI) in medicine, endoscopy applications in gastroenterology have been at the forefront of innovations. The ever-increasing number of studies necessitates the need to organize and classify applications in a useful way. Separating AI capabilities by computer aided detection (CADe), diagnosis (CADx), and quality assessment (CADq) allows for a systematic evaluation of each application. CADe studies have shown promise in accurate detection of esophageal, gastric and colonic neoplasia as well as identifying sources of bleeding and Crohn's disease in the small bowel. While more advanced CADx applications employ optical biopsies to give further information to characterize neoplasia and grade inflammatory disease, diverse CADq applications ensure quality and increase the efficiency of procedures. Future applications show promise in advanced therapeutic modalities and integrated systems that provide multimodal capabilities. AI is set to revolutionize clinical decision making and performance of endoscopy.
Collapse
Affiliation(s)
- Arif A. Arif
- Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Shirley X. Jiang
- Department of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Michael F. Byrne
- Division of Gastroenterology, Department of Medicine, University of British Columbia, Vancouver, BC, Canada
- Satisfai Health, Vancouver, BC, Canada
| |
Collapse
|
19
|
Pan Y, He L, Chen W, Yang Y. The current state of artificial intelligence in endoscopic diagnosis of early esophageal squamous cell carcinoma. Front Oncol 2023; 13:1198941. [PMID: 37293591 PMCID: PMC10247226 DOI: 10.3389/fonc.2023.1198941] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Accepted: 05/16/2023] [Indexed: 06/10/2023] Open
Abstract
Esophageal squamous cell carcinoma (ESCC) is a common malignant tumor of the digestive tract. The most effective method of reducing the disease burden in areas with a high incidence of esophageal cancer is to prevent the disease from developing into invasive cancer through screening. Endoscopic screening is key for the early diagnosis and treatment of ESCC. However, due to the uneven professional level of endoscopists, there are still many missed cases because of failure to recognize lesions. In recent years, along with remarkable progress in medical imaging and video evaluation technology based on deep machine learning, the development of artificial intelligence (AI) is expected to provide new auxiliary methods of endoscopic diagnosis and the treatment of early ESCC. The convolution neural network (CNN) in the deep learning model extracts the key features of the input image data using continuous convolution layers and then classifies images through full-layer connections. The CNN is widely used in medical image classification, and greatly improves the accuracy of endoscopic image classification. This review focuses on the AI-assisted diagnosis of early ESCC and prediction of early ESCC invasion depth under multiple imaging modalities. The excellent image recognition ability of AI is suitable for the detection and diagnosis of ESCC and can reduce missed diagnoses and help endoscopists better complete endoscopic examinations. However, the selective bias used in the training dataset of the AI system affects its general utility.
Collapse
Affiliation(s)
- Yuwei Pan
- Department of Gastroenterology, Chongqing University Cancer Hospital, Chongqing, China
| | - Lanying He
- Department of Gastroenterology, Chongqing University Cancer Hospital, Chongqing, China
| | - Weiqing Chen
- Department of Gastroenterology, Chongqing University Cancer Hospital, Chongqing, China
- Chongqing Key Laboratory of Translational Research for Cancer Metastasis and Individualized Treatment, Chongqing University Cancer Hospital, Chongqing, China
| | - Yongtao Yang
- Department of Gastroenterology, Chongqing University Cancer Hospital, Chongqing, China
- Chongqing Key Laboratory of Translational Research for Cancer Metastasis and Individualized Treatment, Chongqing University Cancer Hospital, Chongqing, China
| |
Collapse
|
20
|
Bhattarai B, Subedi R, Gaire RR, Vazquez E, Stoyanov D. Histogram of Oriented Gradients meet deep learning: A novel multi-task deep network for 2D surgical image semantic segmentation. Med Image Anal 2023; 85:102747. [PMID: 36702038 PMCID: PMC10626764 DOI: 10.1016/j.media.2023.102747] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 12/01/2022] [Accepted: 01/05/2023] [Indexed: 01/15/2023]
Abstract
We present our novel deep multi-task learning method for medical image segmentation. Existing multi-task methods demand ground truth annotations for both the primary and auxiliary tasks. Contrary to it, we propose to generate the pseudo-labels of an auxiliary task in an unsupervised manner. To generate the pseudo-labels, we leverage Histogram of Oriented Gradients (HOGs), one of the most widely used and powerful hand-crafted features for detection. Together with the ground truth semantic segmentation masks for the primary task and pseudo-labels for the auxiliary task, we learn the parameters of the deep network to minimize the loss of both the primary task and the auxiliary task jointly. We employed our method on two powerful and widely used semantic segmentation networks: UNet and U2Net to train in a multi-task setup. To validate our hypothesis, we performed experiments on two different medical image segmentation data sets. From the extensive quantitative and qualitative results, we observe that our method consistently improves the performance compared to the counter-part method. Moreover, our method is the winner of FetReg Endovis Sub-challenge on Semantic Segmentation organised in conjunction with MICCAI 2021. Code and implementation details are available at:https://github.com/thetna/medical_image_segmentation.
Collapse
Affiliation(s)
| | - Ronast Subedi
- Nepal Applied Mathematics and Informatics Institute for research (NAAMII), Nepal
| | - Rebati Raman Gaire
- Nepal Applied Mathematics and Informatics Institute for research (NAAMII), Nepal
| | | | | |
Collapse
|
21
|
Xue P, Si M, Qin D, Wei B, Seery S, Ye Z, Chen M, Wang S, Song C, Zhang B, Ding M, Zhang W, Bai A, Yan H, Dang L, Zhao Y, Rezhake R, Zhang S, Qiao Y, Qu Y, Jiang Y. Unassisted Clinicians Versus Deep Learning-Assisted Clinicians in Image-Based Cancer Diagnostics: Systematic Review With Meta-analysis. J Med Internet Res 2023; 25:e43832. [PMID: 36862499 PMCID: PMC10020907 DOI: 10.2196/43832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 01/19/2023] [Accepted: 02/13/2023] [Indexed: 02/16/2023] Open
Abstract
BACKGROUND A number of publications have demonstrated that deep learning (DL) algorithms matched or outperformed clinicians in image-based cancer diagnostics, but these algorithms are frequently considered as opponents rather than partners. Despite the clinicians-in-the-loop DL approach having great potential, no study has systematically quantified the diagnostic accuracy of clinicians with and without the assistance of DL in image-based cancer identification. OBJECTIVE We systematically quantified the diagnostic accuracy of clinicians with and without the assistance of DL in image-based cancer identification. METHODS PubMed, Embase, IEEEXplore, and the Cochrane Library were searched for studies published between January 1, 2012, and December 7, 2021. Any type of study design was permitted that focused on comparing unassisted clinicians and DL-assisted clinicians in cancer identification using medical imaging. Studies using medical waveform-data graphics material and those investigating image segmentation rather than classification were excluded. Studies providing binary diagnostic accuracy data and contingency tables were included for further meta-analysis. Two subgroups were defined and analyzed, including cancer type and imaging modality. RESULTS In total, 9796 studies were identified, of which 48 were deemed eligible for systematic review. Twenty-five of these studies made comparisons between unassisted clinicians and DL-assisted clinicians and provided sufficient data for statistical synthesis. We found a pooled sensitivity of 83% (95% CI 80%-86%) for unassisted clinicians and 88% (95% CI 86%-90%) for DL-assisted clinicians. Pooled specificity was 86% (95% CI 83%-88%) for unassisted clinicians and 88% (95% CI 85%-90%) for DL-assisted clinicians. The pooled sensitivity and specificity values for DL-assisted clinicians were higher than for unassisted clinicians, at ratios of 1.07 (95% CI 1.05-1.09) and 1.03 (95% CI 1.02-1.05), respectively. Similar diagnostic performance by DL-assisted clinicians was also observed across the predefined subgroups. CONCLUSIONS The diagnostic performance of DL-assisted clinicians appears better than unassisted clinicians in image-based cancer identification. However, caution should be exercised, because the evidence provided in the reviewed studies does not cover all the minutiae involved in real-world clinical practice. Combining qualitative insights from clinical practice with data-science approaches may improve DL-assisted practice, although further research is required. TRIAL REGISTRATION PROSPERO CRD42021281372; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=281372.
Collapse
Affiliation(s)
- Peng Xue
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Mingyu Si
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Dongxu Qin
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Bingrui Wei
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Samuel Seery
- Faculty of Health and Medicine, Division of Health Research, Lancaster University, Lancaster, United Kingdom
| | - Zichen Ye
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Mingyang Chen
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Sumeng Wang
- Department of Cancer Epidemiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Cheng Song
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Bo Zhang
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Ming Ding
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Wenling Zhang
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Anying Bai
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Huijiao Yan
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Le Dang
- Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yuqian Zhao
- Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, School of Medicine, University of Electronic Science & Technology of China, Sichuan, China
| | - Remila Rezhake
- Affiliated Cancer Hospital, The 3rd Affiliated Teaching Hospital of Xinjiang Medical University, Xinjiang, China
| | - Shaokai Zhang
- Henan Cancer Hospital, Affiliated Cancer Hospital of Zhengzhou University, Henan, China
| | - Youlin Qiao
- Center for Global Health, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yimin Qu
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yu Jiang
- Department of Epidemiology and Biostatistics, School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| |
Collapse
|
22
|
Wang J, Long Q, Liang Y, Song J, Feng Y, Li P, Sun W, Zhao L. AI-assisted identification of intrapapillary capillary loops in magnification endoscopy for diagnosing early-stage esophageal squamous cell carcinoma: a preliminary study. Med Biol Eng Comput 2023:10.1007/s11517-023-02777-3. [PMID: 36841920 DOI: 10.1007/s11517-023-02777-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 12/22/2022] [Indexed: 02/27/2023]
Abstract
Esophageal squamous cell carcinoma (ESCC) is one of the most common histological types of esophageal cancers. It can seriously affect public health, particularly in Eastern Asia. Early diagnosis and effective therapy of ESCC can significantly help improve patient prognoses. The visualization of intrapapillary capillary loops (IPCLs) under magnification endoscopy (ME) can greatly support the identification of ESCC occurrences by endoscopists. This paper proposes an artificial-intelligence-assisted endoscopic diagnosis approach using deep learning for localizing and identifying IPCLs to diagnose early-stage ESCC. An improved Faster region-based convolutional network (R-CNN) with a polarized self-attention (PSA)-HRNetV2p backbone was employed to automatically detect IPCLs in ME images. In our study, 2887 ME with blue laser imaging (ME-BLI) images of 246 patients and 493 ME with narrow-band imaging (ME-NBI) images of 81 patients were collected from multiple hospitals and used to train and test our detection model. The ME-NBI images were used as the external testing set to verify the generalizability of the model. The experimental evaluation revealed that the proposed method achieved a recall of 79.25%, precision of 75.54%, F1-score of 0.764 and mean average precision (mAP) of 74.95%. Our method outperformed other existing approaches in our evaluation. It can effectively improve the accuracy of ESCC detection and provide a useful adjunct to the assessment of early-stage ESCC for endoscopists.
Collapse
Affiliation(s)
- Jinming Wang
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230026, China.,Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Qigang Long
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230026, China.,Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Yan Liang
- Department of Gastroenterology, Zhongda Hospital Affiliated to Southeast University, Nanjing, 210009, China
| | - Jie Song
- Department of Gastroenterology, Zhongda Hospital Affiliated to Southeast University, Nanjing, 210009, China
| | - Yadong Feng
- Department of Gastroenterology, Zhongda Hospital Affiliated to Southeast University, Nanjing, 210009, China
| | - Peng Li
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Wei Sun
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, 230026, China.,Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China
| | - Lingxiao Zhao
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou, 215163, China.
| |
Collapse
|
23
|
Liang M, Xu C, Zhang X, Zhang Z, Cao J. Effect of anesthesia assistance on the detection rate of precancerous lesions and early esophageal squamous cell cancer in esophagogastroduodenoscopy screening: A retrospective study based on propensity score matching. Front Med (Lausanne) 2023; 10:1039979. [PMID: 37035346 PMCID: PMC10078984 DOI: 10.3389/fmed.2023.1039979] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Accepted: 02/28/2023] [Indexed: 04/11/2023] Open
Abstract
Background Esophagogastroduodenoscopy (EGD) screening is vital for the early diagnosis of esophageal squamous cell cancer (ESCC). However, improvement in the detection rate of precancerous lesions and early ESCC with anesthesia assistance (AA) has not yet been investigated. This retrospective study aimed to evaluate the effect of AA on the detection rate of precancerous lesions and early ESCC in patients undergoing EGD screening and identify risk factors affecting the detection rate. Methods We reviewed patients' electronic medical records who underwent EGD screening between May 2019 and August 2020. Patients were divided into two groups based on whether they received AA: those in Group A underwent EGD screening with AA, and patients in Group O underwent EGD screening without AA. Propensity score matching (PSM) was used to account for differences in baseline characteristics. Detection rates of precancerous lesions and early ESCC were compared between the two groups following PSM. Binary logistic regression was used to identify risk factors affecting the detection rate. Results The final analysis included 21,835 patients (Group A = 13,319, Group O = 8,516) from 28,985 patients who underwent EGD screening during the study period. Following PSM, 6009 patients remained in each group for analysis. There was no significant difference in the detection rate of precancerous lesions and early ESCC between Groups A and O (1.1% vs. 0.8%, p > 0.05). Binary logistic regression showed that age (50-59 years, 60-69 years and 70-79 years), higher endoscopist seniority, high-definition (HD) endoscopy, narrow-band imaging (NBI), and number of endoscopic images were all independent risk factors that affected the detection rate of precancerous lesions and early ESCC. Conclusion There was no statistically significant difference in the detection rate of precancerous lesions and early ESCC between patients who underwent EGD screening with and without AA. All independent risk factors that affected the detection rate of precancerous lesions and early ESCC included the following: age (50-59 years, 60-69 years and 70-79 years), higher endoscopist seniority, HD endoscopy, NBI, and number of endoscopic images. Endoscopists should consider all these factors as much as possible when performing EGD screening.
Collapse
Affiliation(s)
- Min Liang
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, China
- Department of Anesthesiology, Liaocheng People’s Hospital, Liaocheng, Shandong, China
| | - Chunhong Xu
- Department of Astroenterology, Liaocheng People’s Hospital, Liaocheng, Shandong, China
| | - Xinyan Zhang
- Department of Pathology, Liaocheng People’s Hospital, Liaocheng, Shandong, China
| | - Zongwang Zhang
- Department of Anesthesiology, Liaocheng People’s Hospital, Liaocheng, Shandong, China
- *Correspondence: Zongwang Zhang,
| | - Junli Cao
- Jiangsu Province Key Laboratory of Anesthesiology, Xuzhou Medical University, Xuzhou, China
- Jiangsu Province Key Laboratory of Anesthesia and Analgesia Application Technology, Xuzhou Medical University, Xuzhou, China
- Department of Anesthesiology, Affiliated Hospital of Xuzhou Medical University, Xuzhou, China
- Junli Cao,
| |
Collapse
|
24
|
Wang Jinming 王, Li Peng 李, Liang Yan 梁, Sun Wei 孙, Song Jie 宋, Feng Yadong 冯, Zhao Lingxiao 赵. 基于轻量化注意力残差网络的食管鳞癌识别方法. LASER & OPTOELECTRONICS PROGRESS 2023; 60:1010023. [DOI: 10.3788/lop220856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
|
25
|
Galati JS, Duve RJ, O'Mara M, Gross SA. Artificial intelligence in gastroenterology: A narrative review. Artif Intell Gastroenterol 2022; 3:117-141. [DOI: 10.35712/aig.v3.i5.117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 11/21/2022] [Accepted: 12/21/2022] [Indexed: 12/28/2022] Open
Abstract
Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.
Collapse
Affiliation(s)
- Jonathan S Galati
- Department of Medicine, NYU Langone Health, New York, NY 10016, United States
| | - Robert J Duve
- Department of Internal Medicine, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY 14203, United States
| | - Matthew O'Mara
- Division of Gastroenterology, NYU Langone Health, New York, NY 10016, United States
| | - Seth A Gross
- Division of Gastroenterology, NYU Langone Health, New York, NY 10016, United States
| |
Collapse
|
26
|
Islam MM, Poly TN, Walther BA, Yeh CY, Seyed-Abdul S, Li YC(J, Lin MC. Deep Learning for the Diagnosis of Esophageal Cancer in Endoscopic Images: A Systematic Review and Meta-Analysis. Cancers (Basel) 2022; 14:cancers14235996. [PMID: 36497480 PMCID: PMC9736434 DOI: 10.3390/cancers14235996] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Revised: 11/17/2022] [Accepted: 12/02/2022] [Indexed: 12/12/2022] Open
Abstract
Esophageal cancer, one of the most common cancers with a poor prognosis, is the sixth leading cause of cancer-related mortality worldwide. Early and accurate diagnosis of esophageal cancer, thus, plays a vital role in choosing the appropriate treatment plan for patients and increasing their survival rate. However, an accurate diagnosis of esophageal cancer requires substantial expertise and experience. Nowadays, the deep learning (DL) model for the diagnosis of esophageal cancer has shown promising performance. Therefore, we conducted an updated meta-analysis to determine the diagnostic accuracy of the DL model for the diagnosis of esophageal cancer. A search of PubMed, EMBASE, Scopus, and Web of Science, between 1 January 2012 and 1 August 2022, was conducted to identify potential studies evaluating the diagnostic performance of the DL model for esophageal cancer using endoscopic images. The study was performed in accordance with PRISMA guidelines. Two reviewers independently assessed potential studies for inclusion and extracted data from retrieved studies. Methodological quality was assessed by using the QUADAS-2 guidelines. The pooled accuracy, sensitivity, specificity, positive and negative predictive value, and the area under the receiver operating curve (AUROC) were calculated using a random effect model. A total of 28 potential studies involving a total of 703,006 images were included. The pooled accuracy, sensitivity, specificity, and positive and negative predictive value of DL for the diagnosis of esophageal cancer were 92.90%, 93.80%, 91.73%, 93.62%, and 91.97%, respectively. The pooled AUROC of DL for the diagnosis of esophageal cancer was 0.96. Furthermore, there was no publication bias among the studies. The findings of our study show that the DL model has great potential to accurately and quickly diagnose esophageal cancer. However, most studies developed their model using endoscopic data from the Asian population. Therefore, we recommend further validation through studies of other populations as well.
Collapse
Affiliation(s)
- Md. Mohaimenul Islam
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110, Taiwan
- International Center for Health Information Technology (ICHIT), Taipei Medical University, Taipei 110, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei 116, Taiwan
| | - Tahmina Nasrin Poly
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110, Taiwan
- International Center for Health Information Technology (ICHIT), Taipei Medical University, Taipei 110, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei 116, Taiwan
| | - Bruno Andreas Walther
- Deep Sea Ecology and Technology, Alfred-Wegener-Institut Helmholtz-Zentrum für Polar- und Meeresforschung, Am Handelshafen 12, D-27570 Bremerhaven, Germany
| | - Chih-Yang Yeh
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110, Taiwan
| | - Shabbir Seyed-Abdul
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110, Taiwan
| | - Yu-Chuan (Jack) Li
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110, Taiwan
- International Center for Health Information Technology (ICHIT), Taipei Medical University, Taipei 110, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei 116, Taiwan
- Department of Dermatology, Wan Fang Hospital, Taipei 116, Taiwan
- TMU Research Center of Cancer Translational Medicine, Taipei Medical University, Taipei 110, Taiwan
| | - Ming-Chin Lin
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei 110, Taiwan
- Department of Neurosurgery, Shuang Ho Hospital, Taipei Medical University, New Taipei City 23561, Taiwan
- Taipei Neuroscience Institute, Taipei Medical University, Taipei 11031, Taiwan
- Correspondence:
| |
Collapse
|
27
|
Yuan XL, Liu W, Liu Y, Zeng XH, Mou Y, Wu CC, Ye LS, Zhang YH, He L, Feng J, Zhang WH, Wang J, Chen X, Hu YX, Zhang KH, Hu B. Artificial intelligence for diagnosing microvessels of precancerous lesions and superficial esophageal squamous cell carcinomas: a multicenter study. Surg Endosc 2022; 36:8651-8662. [PMID: 35705757 PMCID: PMC9613556 DOI: 10.1007/s00464-022-09353-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Accepted: 05/20/2022] [Indexed: 02/08/2023]
Abstract
BACKGROUND Intrapapillary capillary loop (IPCL) is an important factor for predicting invasion depth of esophageal squamous cell carcinoma (ESCC). The invasion depth is closely related to the selection of treatment strategy. However, diagnosis of IPCLs is complicated and subject to interobserver variability. This study aimed to develop an artificial intelligence (AI) system to predict IPCLs subtypes of precancerous lesions and superficial ESCC. METHODS Images of magnifying endoscopy with narrow band imaging from three hospitals were collected retrospectively. IPCLs subtypes were annotated on images by expert endoscopists according to Japanese Endoscopic Society classification. The performance of the AI system was evaluated using internal and external validation datasets (IVD and EVD) and compared with that of the 11 endoscopists. RESULTS A total of 7094 images from 685 patients were used to train and validate the AI system. The combined accuracy of the AI system for diagnosing IPCLs subtypes in IVD and EVD was 91.3% and 89.8%, respectively. The AI system achieved better performance than endoscopists in predicting IPCLs subtypes and invasion depth. The ability of junior endoscopists to diagnose IPCLs subtypes (combined accuracy: 84.7% vs 78.2%, P < 0.0001) and invasion depth (combined accuracy: 74.4% vs 67.9%, P < 0.0001) were significantly improved with AI system assistance. Although there was no significant differences, the performance of senior endoscopists was slightly elevated. CONCLUSIONS The proposed AI system could improve the diagnostic ability of endoscopists to predict IPCLs classification of precancerous lesions and superficial ESCC.
Collapse
Affiliation(s)
- Xiang-Lei Yuan
- Department of Gastroenterology, West China Hospital, Sichuan University, No. 37 Guo Xue Alley, Wu Hou District, Chengdu, 610041, China
| | - Wei Liu
- Department of Gastroenterology, West China Hospital, Sichuan University, No. 37 Guo Xue Alley, Wu Hou District, Chengdu, 610041, China
| | - Yan Liu
- School of Automation, Nanjing University of Information Science and Technology, Nanjing, China
| | - Xian-Hui Zeng
- Department of Gastroenterology, West China Hospital, Sichuan University, No. 37 Guo Xue Alley, Wu Hou District, Chengdu, 610041, China
| | - Yi Mou
- Department of Gastroenterology, West China Hospital, Sichuan University, No. 37 Guo Xue Alley, Wu Hou District, Chengdu, 610041, China
| | - Chun-Cheng Wu
- Department of Gastroenterology, West China Hospital, Sichuan University, No. 37 Guo Xue Alley, Wu Hou District, Chengdu, 610041, China
| | - Lian-Song Ye
- Department of Gastroenterology, West China Hospital, Sichuan University, No. 37 Guo Xue Alley, Wu Hou District, Chengdu, 610041, China
| | - Yu-Hang Zhang
- Department of Gastroenterology, West China Hospital, Sichuan University, No. 37 Guo Xue Alley, Wu Hou District, Chengdu, 610041, China
| | - Long He
- Department of Gastroenterology, West China Hospital, Sichuan University, No. 37 Guo Xue Alley, Wu Hou District, Chengdu, 610041, China
| | - Jing Feng
- Department of Gastroenterology, Zhongshan Hospital, Xiamen University, Xiamen, China
| | - Wan-Hong Zhang
- Department of Gastroenterology, Cangxi People's Hospital, Guangyuan, China
| | - Jun Wang
- Department of Gastroenterology, Affiliated Hospital of North Sichuan Medical College, Nanchong, China
| | - Xin Chen
- The First People's Hospital of Shuangliu District, Chengdu, China
| | - Yan-Xing Hu
- Xiamen Innovision Medical Technology Co, Ltd., Xiamen, China
| | - Kai-Hua Zhang
- ERCDF, Ministry of Education and School of Computing and Software, Nanjing University of Information Science and Technology, Nanjing, China
| | - Bing Hu
- Department of Gastroenterology, West China Hospital, Sichuan University, No. 37 Guo Xue Alley, Wu Hou District, Chengdu, 610041, China.
| |
Collapse
|
28
|
Jin J, Zhang Q, Dong B, Ma T, Mei X, Wang X, Song S, Peng J, Wu A, Dong L, Kong D. Automatic detection of early gastric cancer in endoscopy based on Mask region-based convolutional neural networks (Mask R-CNN)(with video). Front Oncol 2022; 12:927868. [PMID: 36338757 PMCID: PMC9630732 DOI: 10.3389/fonc.2022.927868] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Accepted: 09/05/2022] [Indexed: 12/04/2022] Open
Abstract
The artificial intelligence (AI)-assisted endoscopic detection of early gastric cancer (EGC) has been preliminarily developed. The currently used algorithms still exhibit limitations of large calculation and low-precision expression. The present study aimed to develop an endoscopic automatic detection system in EGC based on a mask region-based convolutional neural network (Mask R-CNN) and to evaluate the performance in controlled trials. For this purpose, a total of 4,471 white light images (WLIs) and 2,662 narrow band images (NBIs) of EGC were obtained for training and testing. In total, 10 of the WLIs (videos) were obtained prospectively to examine the performance of the RCNN system. Furthermore, 400 WLIs were randomly selected for comparison between the Mask R-CNN system and doctors. The evaluation criteria included accuracy, sensitivity, specificity, positive predictive value and negative predictive value. The results revealed that there were no significant differences between the pathological diagnosis with the Mask R-CNN system in the WLI test (χ2 = 0.189, P=0.664; accuracy, 90.25%; sensitivity, 91.06%; specificity, 89.01%) and in the NBI test (χ2 = 0.063, P=0.802; accuracy, 95.12%; sensitivity, 97.59%). Among 10 WLI real-time videos, the speed of the test videos was up to 35 frames/sec, with an accuracy of 90.27%. In a controlled experiment of 400 WLIs, the sensitivity of the Mask R-CNN system was significantly higher than that of experts (χ2 = 7.059, P=0.000; 93.00% VS 80.20%), and the specificity was higher than that of the juniors (χ2 = 9.955, P=0.000, 82.67% VS 71.87%), and the overall accuracy rate was higher than that of the seniors (χ2 = 7.009, P=0.000, 85.25% VS 78.00%). On the whole, the present study demonstrates that the Mask R-CNN system exhibited an excellent performance status for the detection of EGC, particularly for the real-time analysis of WLIs. It may thus be effectively applied to clinical settings.
Collapse
Affiliation(s)
- Jing Jin
- Key Laboratory of Digestive Diseases of Anhui Province, Department of Gastroenterology, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Qianqian Zhang
- Key Laboratory of Digestive Diseases of Anhui Province, Department of Gastroenterology, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Bill Dong
- School of Computer Science and Technology, University of Science and Technology of China, Hefei, China
| | - Tao Ma
- School of Computer Science and Technology, University of Science and Technology of China, Hefei, China
| | - Xuecan Mei
- Key Laboratory of Digestive Diseases of Anhui Province, Department of Gastroenterology, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Xi Wang
- Key Laboratory of Digestive Diseases of Anhui Province, Department of Gastroenterology, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Shaofang Song
- Research and Development Department, Hefei Zhongna Medical Instrument Co. LTD, Hefei, China
| | - Jie Peng
- Research and Development Department, Hefei Zhongna Medical Instrument Co. LTD, Hefei, China
| | - Aijiu Wu
- Research and Development Department, Hefei Zhongna Medical Instrument Co. LTD, Hefei, China
| | - Lanfang Dong
- School of Computer Science and Technology, University of Science and Technology of China, Hefei, China
| | - Derun Kong
- Key Laboratory of Digestive Diseases of Anhui Province, Department of Gastroenterology, The First Affiliated Hospital of Anhui Medical University, Hefei, China
- *Correspondence: Derun Kong,
| |
Collapse
|
29
|
Meng QQ, Gao Y, Lin H, Wang TJ, Zhang YR, Feng J, Li ZS, Xin L, Wang LW. Application of an artificial intelligence system for endoscopic diagnosis of superficial esophageal squamous cell carcinoma. World J Gastroenterol 2022; 28:5483-5493. [PMID: 36312830 PMCID: PMC9611708 DOI: 10.3748/wjg.v28.i37.5483] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Revised: 08/09/2022] [Accepted: 09/20/2022] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Upper gastrointestinal endoscopy is critical for esophageal squamous cell carcinoma (ESCC) detection; however, endoscopists require long-term training to avoid missing superficial lesions.
AIM To develop a deep learning computer-assisted diagnosis (CAD) system for endoscopic detection of superficial ESCC and investigate its application value.
METHODS We configured the CAD system for white-light and narrow-band imaging modes based on the YOLO v5 algorithm. A total of 4447 images from 837 patients and 1695 images from 323 patients were included in the training and testing datasets, respectively. Two experts and two non-expert endoscopists reviewed the testing dataset independently and with computer assistance. The diagnostic performance was evaluated in terms of the area under the receiver operating characteristic curve, accuracy, sensitivity, and specificity.
RESULTS The area under the receiver operating characteristics curve, accuracy, sensitivity, and specificity of the CAD system were 0.982 [95% confidence interval (CI): 0.969-0.994], 92.9% (95%CI: 89.5%-95.2%), 91.9% (95%CI: 87.4%-94.9%), and 94.7% (95%CI: 89.0%-97.6%), respectively. The accuracy of CAD was significantly higher than that of non-expert endoscopists (78.3%, P < 0.001 compared with CAD) and comparable to that of expert endoscopists (91.0%, P = 0.129 compared with CAD). After referring to the CAD results, the accuracy of the non-expert endoscopists significantly improved (88.2% vs 78.3%, P < 0.001). Lesions with Paris classification type 0-IIb were more likely to be inaccurately identified by the CAD system.
CONCLUSION The diagnostic performance of the CAD system is promising and may assist in improving detectability, particularly for inexperienced endoscopists.
Collapse
Affiliation(s)
- Qian-Qian Meng
- Department of Gastroenterology, Changhai Hospital, Shanghai 200433, China
| | - Ye Gao
- Department of Gastroenterology, Changhai Hospital, Shanghai 200433, China
| | - Han Lin
- Department of Gastroenterology, Changhai Hospital, Shanghai 200433, China
| | - Tian-Jiao Wang
- Department of Gastroenterology, Changhai Hospital, Shanghai 200433, China
| | - Yan-Rong Zhang
- Department of Gastroenterology, Changhai Hospital, Shanghai 200433, China
| | - Jian Feng
- Qingdao Medcare Digital Engineering Co. Ltd., Qingdao Medcare Digital Engineering Co. Ltd., Qingdao 26600, Shandong Province, China
| | - Zhao-Shen Li
- Department of Gastroenterology, Changhai Hospital, Shanghai 200433, China
| | - Lei Xin
- Department of Gastroenterology, Changhai Hospital, Shanghai 200433, China
| | - Luo-Wei Wang
- Department of Gastroenterology, Changhai Hospital, Shanghai 200433, China
| |
Collapse
|
30
|
Tu JX, Lin XT, Ye HQ, Yang SL, Deng LF, Zhu RL, Wu L, Zhang XQ. Global research trends of artificial intelligence applied in esophageal carcinoma: A bibliometric analysis (2000-2022) via CiteSpace and VOSviewer. Front Oncol 2022; 12:972357. [PMID: 36091151 PMCID: PMC9453500 DOI: 10.3389/fonc.2022.972357] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2022] [Accepted: 07/29/2022] [Indexed: 12/09/2022] Open
Abstract
ObjectiveUsing visual bibliometric analysis, the application and development of artificial intelligence in clinical esophageal cancer are summarized, and the research progress, hotspots, and emerging trends of artificial intelligence are elucidated.MethodsOn April 7th, 2022, articles and reviews regarding the application of AI in esophageal cancer, published between 2000 and 2022 were chosen from the Web of Science Core Collection. To conduct co-authorship, co-citation, and co-occurrence analysis of countries, institutions, authors, references, and keywords in this field, VOSviewer (version 1.6.18), CiteSpace (version 5.8.R3), Microsoft Excel 2019, R 4.2, an online bibliometric platform (http://bibliometric.com/) and an online browser plugin (https://www.altmetric.com/) were used.ResultsA total of 918 papers were included, with 23,490 citations. 5,979 authors, 39,962 co-cited authors, and 42,992 co-cited papers were identified in the study. Most publications were from China (317). In terms of the H-index (45) and citations (9925), the United States topped the list. The journal “New England Journal of Medicine” of Medicine, General & Internal (IF = 91.25) published the most studies on this topic. The University of Amsterdam had the largest number of publications among all institutions. The past 22 years of research can be broadly divided into two periods. The 2000 to 2016 research period focused on the classification, identification and comparison of esophageal cancer. Recently (2017-2022), the application of artificial intelligence lies in endoscopy, diagnosis, and precision therapy, which have become the frontiers of this field. It is expected that closely esophageal cancer clinical measures based on big data analysis and related to precision will become the research hotspot in the future.ConclusionsAn increasing number of scholars are devoted to artificial intelligence-related esophageal cancer research. The research field of artificial intelligence in esophageal cancer has entered a new stage. In the future, there is a need to continue to strengthen cooperation between countries and institutions. Improving the diagnostic accuracy of esophageal imaging, big data-based treatment and prognosis prediction through deep learning technology will be the continuing focus of research. The application of AI in esophageal cancer still has many challenges to overcome before it can be utilized.
Collapse
Affiliation(s)
- Jia-xin Tu
- School of Public Health, Nanchang University, Nanchang, China
- Jiangxi Provincial Key Laboratory of Preventive Medicine, Nanchang University, Nanchang, China
| | - Xue-ting Lin
- School of Public Health, Nanchang University, Nanchang, China
- Jiangxi Provincial Key Laboratory of Preventive Medicine, Nanchang University, Nanchang, China
| | - Hui-qing Ye
- School of Public Health, Nanchang University, Nanchang, China
| | - Shan-lan Yang
- School of Public Health, Nanchang University, Nanchang, China
- Jiangxi Provincial Key Laboratory of Preventive Medicine, Nanchang University, Nanchang, China
| | - Li-fang Deng
- School of Public Health, Nanchang University, Nanchang, China
- Jiangxi Provincial Key Laboratory of Preventive Medicine, Nanchang University, Nanchang, China
| | - Ruo-ling Zhu
- School of Public Health, Nanchang University, Nanchang, China
- Jiangxi Provincial Key Laboratory of Preventive Medicine, Nanchang University, Nanchang, China
| | - Lei Wu
- School of Public Health, Nanchang University, Nanchang, China
- Jiangxi Provincial Key Laboratory of Preventive Medicine, Nanchang University, Nanchang, China
- *Correspondence: Lei Wu, ; Xiao-qiang Zhang,
| | - Xiao-qiang Zhang
- Department of Thoracic Surgery, The Second Affiliated Hospital of Nanchang University, Nanchang, China
- *Correspondence: Lei Wu, ; Xiao-qiang Zhang,
| |
Collapse
|
31
|
Fang YJ, Mukundan A, Tsao YM, Huang CW, Wang HC. Identification of Early Esophageal Cancer by Semantic Segmentation. J Pers Med 2022; 12:1204. [PMID: 35893299 PMCID: PMC9331549 DOI: 10.3390/jpm12081204] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Revised: 07/19/2022] [Accepted: 07/22/2022] [Indexed: 02/06/2023] Open
Abstract
Early detection of esophageal cancer has always been difficult, thereby reducing the overall five-year survival rate of patients. In this study, semantic segmentation was used to predict and label esophageal cancer in its early stages. U-Net was used as the basic artificial neural network along with Resnet to extract feature maps that will classify and predict the location of esophageal cancer. A total of 75 white-light images (WLI) and 90 narrow-band images (NBI) were used. These images were classified into three categories: normal, dysplasia, and squamous cell carcinoma. After labeling, the data were divided into a training set, verification set, and test set. The training set was approved by the encoder-decoder model to train the prediction model. Research results show that the average time of 111 ms is used to predict each image in the test set, and the evaluation method is calculated in pixel units. Sensitivity is measured based on the severity of the cancer. In addition, NBI has higher accuracy of 84.724% when compared with the 82.377% accuracy rate of WLI, thereby making it a suitable method to detect esophageal cancer using the algorithm developed in this study.
Collapse
Affiliation(s)
- Yu-Jen Fang
- Department of Internal Medicine, National Taiwan University Hospital, Yun-Lin Branch, No. 579, Sec. 2, Yunlin Rd., Dou-Liu 64041, Taiwan;
- Department of Internal Medicine, National Taiwan University College of Medicine, No. 1 Jen Ai Rd. Sec. 1, Taipei 10051, Taiwan
| | - Arvind Mukundan
- Department of Mechanical Engineering, Advanced Institute of Manufacturing with High Tech Innovations (AIM-HI), Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi 62102, Taiwan; (A.M.); (Y.-M.T.)
| | - Yu-Ming Tsao
- Department of Mechanical Engineering, Advanced Institute of Manufacturing with High Tech Innovations (AIM-HI), Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi 62102, Taiwan; (A.M.); (Y.-M.T.)
- Hitspectra Intelligent Technology Co., Ltd., 4F., No. 2, Fuxing 4th Rd., Qianzhen Dist., Kaohsiung 80661, Taiwan
| | - Chien-Wei Huang
- Department of Gastroenterology, Kaohsiung Armed Forces General Hospital, 2, Zhongzheng 1st. Rd., Lingya Dist., Kaohsiung 80284, Taiwan
- Department of Nursing, Tajen University, 20, Weixin Rd., Yanpu Township, Pingtung 90741, Taiwan
| | - Hsiang-Chen Wang
- Department of Mechanical Engineering, Advanced Institute of Manufacturing with High Tech Innovations (AIM-HI), Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, 168, University Rd., Min Hsiung, Chiayi 62102, Taiwan; (A.M.); (Y.-M.T.)
| |
Collapse
|
32
|
Yoo BS, Houston KV, D'Souza SM, Elmahdi A, Davis I, Vilela A, Parekh PJ, Johnson DA. Advances and horizons for artificial intelligence of endoscopic screening and surveillance of gastric and esophageal disease. Artif Intell Med Imaging 2022; 3:70-86. [DOI: 10.35711/aimi.v3.i3.70] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Revised: 05/18/2022] [Accepted: 06/20/2022] [Indexed: 02/06/2023] Open
Affiliation(s)
- Byung Soo Yoo
- Department of Internal Medicine, Eastern Virginia Medical School, Norfolk, VA 23507, United States
| | - Kevin V Houston
- Department of Internal Medicine, Virginia Commonwealth University, Richmond, VA 23298, United States
| | - Steve M D'Souza
- Department of Internal Medicine, Eastern Virginia Medical School, Norfolk, VA 23507, United States
| | - Alsiddig Elmahdi
- Department of Internal Medicine, Eastern Virginia Medical School, Norfolk, VA 23507, United States
| | - Isaac Davis
- Department of Internal Medicine, Eastern Virginia Medical School, Norfolk, VA 23507, United States
| | - Ana Vilela
- Department of Internal Medicine, Eastern Virginia Medical School, Norfolk, VA 23507, United States
| | - Parth J Parekh
- Division of Gastroenterology, Department of Internal Medicine, Eastern Virginia Medical School, Norfolk, VA 23507, United States
| | - David A Johnson
- Division of Gastroenterology, Department of Internal Medicine, Eastern Virginia Medical School, Norfolk, VA 23507, United States
| |
Collapse
|
33
|
Luo D, Kuang F, Du J, Zhou M, Liu X, Luo X, Tang Y, Li B, Su S. Artificial Intelligence-Assisted Endoscopic Diagnosis of Early Upper Gastrointestinal Cancer: A Systematic Review and Meta-Analysis. Front Oncol 2022; 12:855175. [PMID: 35756602 PMCID: PMC9229174 DOI: 10.3389/fonc.2022.855175] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Accepted: 04/28/2022] [Indexed: 11/17/2022] Open
Abstract
Objective The aim of this study was to assess the diagnostic ability of artificial intelligence (AI) in the detection of early upper gastrointestinal cancer (EUGIC) using endoscopic images. Methods Databases were searched for studies on AI-assisted diagnosis of EUGIC using endoscopic images. The pooled area under the curve (AUC), sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), and diagnostic odds ratio (DOR) with 95% confidence interval (CI) were calculated. Results Overall, 34 studies were included in our final analysis. Among the 17 image-based studies investigating early esophageal cancer (EEC) detection, the pooled AUC, sensitivity, specificity, PLR, NLR, and DOR were 0.98, 0.95 (95% CI, 0.95–0.96), 0.95 (95% CI, 0.94–0.95), 10.76 (95% CI, 7.33–15.79), 0.07 (95% CI, 0.04–0.11), and 173.93 (95% CI, 81.79–369.83), respectively. Among the seven patient-based studies investigating EEC detection, the pooled AUC, sensitivity, specificity, PLR, NLR, and DOR were 0.98, 0.94 (95% CI, 0.91–0.96), 0.90 (95% CI, 0.88–0.92), 6.14 (95% CI, 2.06–18.30), 0.07 (95% CI, 0.04–0.11), and 69.13 (95% CI, 14.73–324.45), respectively. Among the 15 image-based studies investigating early gastric cancer (EGC) detection, the pooled AUC, sensitivity, specificity, PLR, NLR, and DOR were 0.94, 0.87 (95% CI, 0.87–0.88), 0.88 (95% CI, 0.87–0.88), 7.20 (95% CI, 4.32–12.00), 0.14 (95% CI, 0.09–0.23), and 48.77 (95% CI, 24.98–95.19), respectively. Conclusions On the basis of our meta-analysis, AI exhibited high accuracy in diagnosis of EUGIC. Systematic Review Registration https://www.crd.york.ac.uk/PROSPERO/, identifier PROSPERO (CRD42021270443).
Collapse
Affiliation(s)
- De Luo
- Department of Hepatobiliary Surgery, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Fei Kuang
- Department of General Surgery, Changhai Hospital of The Second Military Medical University, Shanghai, China
| | - Juan Du
- Department of Clinical Medicine, Southwest Medical University, Luzhou, China
| | - Mengjia Zhou
- Department of Ultrasound, Seventh People's Hospital of Shanghai University of Traditional Chinese Medicine, Shanghai, China
| | - Xiangdong Liu
- Department of Hepatobiliary Surgery, Zigong Fourth People's Hospital, Zigong, China
| | - Xinchen Luo
- Department of Gastroenterology, Zigong Third People's Hospital, Zigong, China
| | - Yong Tang
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China
| | - Bo Li
- Department of Hepatobiliary Surgery, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Song Su
- Department of Hepatobiliary Surgery, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| |
Collapse
|
34
|
Song D, Wei Y, Hu Y, Sun Y, Liu M, Ren Q, Hu Z, Guo Q, Wang Y, Zhou Y. Identification of immunophenotypes in esophageal squamous cell carcinoma based on immune gene sets. Clin Transl Oncol 2022; 24:1100-1114. [PMID: 35098447 DOI: 10.1007/s12094-021-02749-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Accepted: 12/06/2021] [Indexed: 02/05/2023]
Abstract
PURPOSE Esophageal squamous cell carcinoma (ESCC) is a malignant tumor with high heterogeneity. Research on molecular mechanisms involved in the process of tumor origination and progression is extremely limited to investigating mechanisms of molecular typing for ESCC. METHODS After comprehensively analyzing the gene expression profiles in The Cancer Genome Atlas and Gene Expression Omnibus databases, we identified four immunotypes of ESCC (referred to as C1-C4) based on the gene sets of 28 immune cell subpopulations. The discrepancies in prognostic value, clinical features, drug sensitivity, and tumor components between the immunotypes were individually analyzed. RESULTS The ranking of immune infiltration is C1 > C4 > C3 > C2. These subtypes are characterized by high and low expression of immune checkpoint proteins, enrichment and insufficiency of immune-related pathways, and differential distribution of immune cell subgroups. Poorer survival was observed in the C1 subtype, which we hypothesized could be caused by an immunosuppressive cell population. Fortunately, C1's susceptibility to anti-PD-1 therapy offers hope for patients with poor prognosis in advanced stages. On the other hand, C4 is sensitive to docetaxel, which may offer novel treatment strategies for ESCC in the future. It is worth noting that immunophenotyping is tightly bound to the abundance of stromal components and stem cells, which could explain the tumor immune escape to some extent. Ultimately, determination of hub genes based on the C1 subtypes provides a reference for the discovery of immunotarget drugs against ESCC. CONCLUSION The identification of immunophenotypes in our study provides new therapeutic strategies for patients with ESCC.
Collapse
Affiliation(s)
- Danlei Song
- The First Clinical Medical College, Lanzhou University, Lanzhou, China
- Department of Gastroenterology, Key Laboratory for Gastrointestinal Diseases of Gansu Province, The First Hospital of Lanzhou University, Lanzhou, 730000, Gansu Province, China
| | - Yongjian Wei
- The First Department of Hepatobiliary and Pancreatic Surgery, Cangzhou Central Hospital, Cangzhou, China
| | - Yuping Hu
- The First Clinical Medical College, Lanzhou University, Lanzhou, China
- Hospital of Reproductive Medicine, The First Hospital of Lanzhou University, Lanzhou, China
| | - Yueting Sun
- The First Clinical Medical College, Lanzhou University, Lanzhou, China
- Department of Gastroenterology, Key Laboratory for Gastrointestinal Diseases of Gansu Province, The First Hospital of Lanzhou University, Lanzhou, 730000, Gansu Province, China
| | - Min Liu
- Department of Gastroenterology, Key Laboratory for Gastrointestinal Diseases of Gansu Province, The First Hospital of Lanzhou University, Lanzhou, 730000, Gansu Province, China
| | - Qian Ren
- Department of Gastroenterology, Key Laboratory for Gastrointestinal Diseases of Gansu Province, The First Hospital of Lanzhou University, Lanzhou, 730000, Gansu Province, China
| | - Zenan Hu
- Department of Gastroenterology, Key Laboratory for Gastrointestinal Diseases of Gansu Province, The First Hospital of Lanzhou University, Lanzhou, 730000, Gansu Province, China
| | - Qinghong Guo
- Department of Gastroenterology, Key Laboratory for Gastrointestinal Diseases of Gansu Province, The First Hospital of Lanzhou University, Lanzhou, 730000, Gansu Province, China
| | - Yuping Wang
- Department of Gastroenterology, Key Laboratory for Gastrointestinal Diseases of Gansu Province, The First Hospital of Lanzhou University, Lanzhou, 730000, Gansu Province, China
| | - Yongning Zhou
- The First Clinical Medical College, Lanzhou University, Lanzhou, China.
- Department of Gastroenterology, Key Laboratory for Gastrointestinal Diseases of Gansu Province, The First Hospital of Lanzhou University, Lanzhou, 730000, Gansu Province, China.
| |
Collapse
|
35
|
Abstract
Artificial intelligence (AI) is rapidly developing in various medical fields, and there is an increase in research performed in the field of gastrointestinal (GI) endoscopy. In particular, the advent of convolutional neural network, which is a class of deep learning method, has the potential to revolutionize the field of GI endoscopy, including esophagogastroduodenoscopy (EGD), capsule endoscopy (CE), and colonoscopy. A total of 149 original articles pertaining to AI (27 articles in esophagus, 30 articles in stomach, 29 articles in CE, and 63 articles in colon) were identified in this review. The main focuses of AI in EGD are cancer detection, identifying the depth of cancer invasion, prediction of pathological diagnosis, and prediction of Helicobacter pylori infection. In the field of CE, automated detection of bleeding sites, ulcers, tumors, and various small bowel diseases is being investigated. AI in colonoscopy has advanced with several patient-based prospective studies being conducted on the automated detection and classification of colon polyps. Furthermore, research on inflammatory bowel disease has also been recently reported. Most studies of AI in the field of GI endoscopy are still in the preclinical stages because of the retrospective design using still images. Video-based prospective studies are needed to advance the field. However, AI will continue to develop and be used in daily clinical practice in the near future. In this review, we have highlighted the published literature along with providing current status and insights into the future of AI in GI endoscopy.
Collapse
Affiliation(s)
- Yutaka Okagawa
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.,Department of Gastroenterology, Tonan Hospital, Sapporo, Japan
| | - Seiichiro Abe
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
| | - Masayoshi Yamada
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Ichiro Oda
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Yutaka Saito
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| |
Collapse
|
36
|
Sharma P, Hassan C. Artificial Intelligence and Deep Learning for Upper Gastrointestinal Neoplasia. Gastroenterology 2022; 162:1056-1066. [PMID: 34902362 DOI: 10.1053/j.gastro.2021.11.040] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Revised: 11/09/2021] [Accepted: 11/19/2021] [Indexed: 12/24/2022]
Abstract
Upper gastrointestinal (GI) neoplasia account for 35% of GI cancers and 1.5 million cancer-related deaths every year. Despite its efficacy in preventing cancer mortality, diagnostic upper GI endoscopy is affected by a substantial miss rate of neoplastic lesions due to failure to recognize a visible lesion or imperfect navigation. This may be offset by the real-time application of artificial intelligence (AI) for detection (computer-aided detection [CADe]) and characterization (computer-aided diagnosis [CADx]) of upper GI neoplasia. Stand-alone performance of CADe for esophageal squamous cell neoplasia, Barrett's esophagus-related neoplasia, and gastric cancer showed promising accuracy, sensitivity ranging between 83% and 93%. However, incorporation of CADe/CADx in clinical practice depends on several factors, such as possible bias in the training or validation phases of these algorithms, its interaction with human endoscopists, and clinical implications of false-positive results. The aim of this review is to guide the clinician across the multiple steps of AI development in clinical practice.
Collapse
Affiliation(s)
- Prateek Sharma
- University of Kansas School of Medicine, Kansas City, Missouri; Kansas City Veterans Affairs Medical Center, Kansas City, Missouri
| | - Cesare Hassan
- Humanitas University, Department of Biomedical Sciences, Pieve Emanuele, Italy; Humanitas Clinical and Research Center-IRCCS, Endoscopy Unit, Rozzano, Italy.
| |
Collapse
|
37
|
Mizuno S, Okabayashi K, Ikebata A, Matsui S, Seishima R, Shigeta K, Kitagawa Y. Prediction of pouchitis after ileal pouch-anal anastomosis in patients with ulcerative colitis using artificial intelligence and deep learning. Tech Coloproctol 2022; 26:471-478. [PMID: 35233723 DOI: 10.1007/s10151-022-02602-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Accepted: 02/16/2022] [Indexed: 02/07/2023]
Abstract
BACKGROUND Pouchitis is one of the major postoperative complications of ulcerative colitis (UC), and it is still difficult to predict the development of pouchitis after ileal pouch-anal anastomosis (IPAA) in UC patients. In this study, we examined whether a deep learning (DL) model could predict the development of pouchitis. METHODS UC patients who underwent two-stage restorative proctocolectomy with IPAA at Keio University Hospital were included in this retrospective analysis. The modified pouchitis disease activity index (mPDAI) was evaluated by the clinical and endoscopic findings. Pouchitis was defined as an mPDAI ≥ 5.860; endoscopic pouch images before ileostomy closure were collected. A convolutional neural network was used as the DL model, and the prediction rates of pouchitis after ileostomy closure were evaluated by fivefold cross-validation. RESULTS A total of 43 patients were included (24 males and 19 females, mean age 39.2 ± 13.2 years). Pouchitis occurred in 14 (33%) patients after ileostomy closure. In less than half of the patients, mPDAI scores matched before and after ileostomy closure. Most of patients whose mPDAI scores did not match before and after ileostomy closure had worse mPDAI scores after than before. The prediction rate of pouchitis calculated by the area under the curve using the DL model was 84%. Conversely, the prediction rate of pouchitis using mPDAI before ileostomy closure was 62%. CONCLUSION The prediction rate of pouchitis using the DL model was more than 20% higher than that using mPDAI, suggesting the utility of the DL model as a prediction model for the development of pouchitis. It could also be used to determine early interventions for pouchitis.
Collapse
Affiliation(s)
- S Mizuno
- Department of Surgery, Keio University School of Medicine, 35 Shinano-machi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - K Okabayashi
- Department of Surgery, Keio University School of Medicine, 35 Shinano-machi, Shinjuku-ku, Tokyo, 160-8582, Japan.
| | - A Ikebata
- Department of Surgery, Saitama Medical Center, Saitama, Japan
| | - S Matsui
- Department of Surgery, Keio University School of Medicine, 35 Shinano-machi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - R Seishima
- Department of Surgery, Keio University School of Medicine, 35 Shinano-machi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - K Shigeta
- Department of Surgery, Keio University School of Medicine, 35 Shinano-machi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Y Kitagawa
- Department of Surgery, Keio University School of Medicine, 35 Shinano-machi, Shinjuku-ku, Tokyo, 160-8582, Japan
| |
Collapse
|
38
|
Visaggi P, Barberio B, Gregori D, Azzolina D, Martinato M, Hassan C, Sharma P, Savarino E, de Bortoli N. Systematic review with meta-analysis: artificial intelligence in the diagnosis of oesophageal diseases. Aliment Pharmacol Ther 2022; 55:528-540. [PMID: 35098562 PMCID: PMC9305819 DOI: 10.1111/apt.16778] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Revised: 07/09/2022] [Accepted: 01/09/2022] [Indexed: 12/12/2022]
Abstract
BACKGROUND Artificial intelligence (AI) has recently been applied to endoscopy and questionnaires for the evaluation of oesophageal diseases (ODs). AIM We performed a systematic review with meta-analysis to evaluate the performance of AI in the diagnosis of malignant and benign OD. METHODS We searched MEDLINE, EMBASE, EMBASE Classic and the Cochrane Library. A bivariate random-effect model was used to calculate pooled diagnostic efficacy of AI models and endoscopists. The reference tests were histology for neoplasms and the clinical and instrumental diagnosis for gastro-oesophageal reflux disease (GERD). The pooled area under the summary receiver operating characteristic (AUROC), sensitivity, specificity, positive and negative likelihood ratio (PLR and NLR) and diagnostic odds ratio (DOR) were estimated. RESULTS For the diagnosis of Barrett's neoplasia, AI had AUROC of 0.90, sensitivity 0.89, specificity 0.86, PLR 6.50, NLR 0.13 and DOR 50.53. AI models' performance was comparable with that of endoscopists (P = 0.35). For the diagnosis of oesophageal squamous cell carcinoma, the AUROC, sensitivity, specificity, PLR, NLR and DOR were 0.97, 0.95, 0.92, 12.65, 0.05 and DOR 258.36, respectively. In this task, AI performed better than endoscopists although without statistically significant differences. In the detection of abnormal intrapapillary capillary loops, the performance of AI was: AUROC 0.98, sensitivity 0.94, specificity 0.94, PLR 14.75, NLR 0.07 and DOR 225.83. For the diagnosis of GERD based on questionnaires, the AUROC, sensitivity, specificity, PLR, NLR and DOR were 0.99, 0.97, 0.97, 38.26, 0.03 and 1159.6, respectively. CONCLUSIONS AI demonstrated high performance in the clinical and endoscopic diagnosis of OD.
Collapse
Affiliation(s)
- Pierfrancesco Visaggi
- Gastroenterology UnitDepartment of Translational Research and New Technologies in Medicine and SurgeryUniversity of PisaPisaItaly
| | - Brigida Barberio
- Division of GastroenterologyDepartment of Surgery, Oncology and GastroenterologyUniversity of PadovaPadovaItaly
| | - Dario Gregori
- Unit of Biostatistics, Epidemiology and Public HealthDepartment of Cardiac, Thoracic, Vascular Sciences and Public HealthUniversity of PadovaPadovaItaly
| | - Danila Azzolina
- Unit of Biostatistics, Epidemiology and Public HealthDepartment of Cardiac, Thoracic, Vascular Sciences and Public HealthUniversity of PadovaPadovaItaly
- Department of Medical ScienceUniversity of FerraraFerraraItaly
| | - Matteo Martinato
- Unit of Biostatistics, Epidemiology and Public HealthDepartment of Cardiac, Thoracic, Vascular Sciences and Public HealthUniversity of PadovaPadovaItaly
| | - Cesare Hassan
- Department of Biomedical Sciences, Humanitas UniversityVia Rita Levi Montalcini 420072 Pieve Emanuele, MilanItaly
- IRCCS Humanitas Research Hospitalvia Manzoni 5620089 Rozzano, MilanItaly
| | - Prateek Sharma
- University of Kansas School of Medicine and VA Medical CenterKansas CityMissouriUSA
| | - Edoardo Savarino
- Division of GastroenterologyDepartment of Surgery, Oncology and GastroenterologyUniversity of PadovaPadovaItaly
| | - Nicola de Bortoli
- Gastroenterology UnitDepartment of Translational Research and New Technologies in Medicine and SurgeryUniversity of PisaPisaItaly
| |
Collapse
|
39
|
Tang S, Yu X, Cheang CF, Hu Z, Fang T, Choi IC, Yu HH. Diagnosis of Esophageal Lesions by Multi-Classification and Segmentation Using an Improved Multi-Task Deep Learning Model. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22041492. [PMID: 35214396 PMCID: PMC8876234 DOI: 10.3390/s22041492] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Revised: 01/26/2022] [Accepted: 02/08/2022] [Indexed: 05/03/2023]
Abstract
It is challenging for endoscopists to accurately detect esophageal lesions during gastrointestinal endoscopic screening due to visual similarities among different lesions in terms of shape, size, and texture among patients. Additionally, endoscopists are busy fighting esophageal lesions every day, hence the need to develop a computer-aided diagnostic tool to classify and segment the lesions at endoscopic images to reduce their burden. Therefore, we propose a multi-task classification and segmentation (MTCS) model, including the Esophageal Lesions Classification Network (ELCNet) and Esophageal Lesions Segmentation Network (ELSNet). The ELCNet was used to classify types of esophageal lesions, and the ELSNet was used to identify lesion regions. We created a dataset by collecting 805 esophageal images from 255 patients and 198 images from 64 patients to train and evaluate the MTCS model. Compared with other methods, the proposed not only achieved a high accuracy (93.43%) in classification but achieved a dice similarity coefficient (77.84%) in segmentation. In conclusion, the MTCS model can boost the performance of endoscopists in the detection of esophageal lesions as it can accurately multi-classify and segment the lesions and is a potential assistant for endoscopists to reduce the risk of oversight.
Collapse
Affiliation(s)
- Suigu Tang
- Faculty of Information Technology, Macau University of Science and Technology, Macau 999078, China; (S.T.); (X.Y.); (Z.H.); (T.F.)
| | - Xiaoyuan Yu
- Faculty of Information Technology, Macau University of Science and Technology, Macau 999078, China; (S.T.); (X.Y.); (Z.H.); (T.F.)
| | - Chak-Fong Cheang
- Faculty of Information Technology, Macau University of Science and Technology, Macau 999078, China; (S.T.); (X.Y.); (Z.H.); (T.F.)
- Correspondence:
| | - Zeming Hu
- Faculty of Information Technology, Macau University of Science and Technology, Macau 999078, China; (S.T.); (X.Y.); (Z.H.); (T.F.)
| | - Tong Fang
- Faculty of Information Technology, Macau University of Science and Technology, Macau 999078, China; (S.T.); (X.Y.); (Z.H.); (T.F.)
| | - I-Cheong Choi
- Kiang Wu Hospital, Macau 999078, China; (I.-C.C.); (H.-H.Y.)
| | - Hon-Ho Yu
- Kiang Wu Hospital, Macau 999078, China; (I.-C.C.); (H.-H.Y.)
| |
Collapse
|
40
|
Liu W, Yuan X, Guo L, Pan F, Wu C, Sun Z, Tian F, Yuan C, Zhang W, Bai S, Feng J, Hu Y, Hu B. Artificial Intelligence for Detecting and Delineating Margins of Early ESCC Under WLI Endoscopy. Clin Transl Gastroenterol 2022; 13:e00433. [PMID: 35130184 PMCID: PMC8806389 DOI: 10.14309/ctg.0000000000000433] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Accepted: 10/13/2021] [Indexed: 02/07/2023] Open
Abstract
INTRODUCTION Conventional white light imaging (WLI) endoscopy is the most common screening technique used for detecting early esophageal squamous cell carcinoma (ESCC). Nevertheless, it is difficult to detect and delineate margins of early ESCC using WLI endoscopy. This study aimed to develop an artificial intelligence (AI) model to detect and delineate margins of early ESCC under WLI endoscopy. METHODS A total of 13,083 WLI images from 1,239 patients were used to train and test the AI model. To evaluate the detection performance of the model, 1,479 images and 563 images were used as internal and external validation data sets, respectively. For assessing the delineation performance of the model, 1,114 images and 211 images were used as internal and external validation data sets, respectively. In addition, 216 images were used to compare the delineation performance between the model and endoscopists. RESULTS The model showed an accuracy of 85.7% and 84.5% in detecting lesions in internal and external validation, respectively. For delineating margins, the model achieved an accuracy of 93.4% and 95.7% in the internal and external validation, respectively, under an overlap ratio of 0.60. The accuracy of the model, senior endoscopists, and expert endoscopists in delineating margins were 98.1%, 78.6%, and 95.3%, respectively. The proposed model achieved similar delineating performance compared with that of expert endoscopists but superior to senior endoscopists. DISCUSSION We successfully developed an AI model, which can be used to accurately detect early ESCC and delineate the margins of the lesions under WLI endoscopy.
Collapse
Affiliation(s)
- Wei Liu
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu, Sichuan, China
| | - Xianglei Yuan
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu, Sichuan, China
| | - Linjie Guo
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu, Sichuan, China
| | - Feng Pan
- Department of Gastroenterology, Huai'an First People's Hospital, Huai'an, Jiangsu, China;
| | - Chuncheng Wu
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu, Sichuan, China
| | - Zhongshang Sun
- Department of Gastroenterology, Huai'an First People's Hospital, Huai'an, Jiangsu, China;
| | - Feng Tian
- Department of Gastroenterology, Zigong Fourth People's Hospital, Zigong, Sichuan, China;
| | - Cong Yuan
- Department of Gastroenterology, Affiliated Hospital of North Sichuan Medical College, Nanchong, Sichuan, China;
| | - Wanhong Zhang
- Department of Gastroenterology, Cangxi People's Hospital, Guangyuan, Sichuan, China;
| | - Shuai Bai
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu, Sichuan, China
| | - Jing Feng
- Xiamen Innovision Medical Technology Co, Ltd, Xiamen, Fujian, China.
| | - Yanxing Hu
- Xiamen Innovision Medical Technology Co, Ltd, Xiamen, Fujian, China.
| | - Bing Hu
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu, Sichuan, China
| |
Collapse
|
41
|
Visaggi P, de Bortoli N, Barberio B, Savarino V, Oleas R, Rosi EM, Marchi S, Ribolsi M, Savarino E. Artificial Intelligence in the Diagnosis of Upper Gastrointestinal Diseases. J Clin Gastroenterol 2022; 56:23-35. [PMID: 34739406 PMCID: PMC9988236 DOI: 10.1097/mcg.0000000000001629] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Artificial intelligence (AI) has enormous potential to support clinical routine workflows and therefore is gaining increasing popularity among medical professionals. In the field of gastroenterology, investigations on AI and computer-aided diagnosis (CAD) systems have mainly focused on the lower gastrointestinal (GI) tract. However, numerous CAD tools have been tested also in upper GI disorders showing encouraging results. The main application of AI in the upper GI tract is endoscopy; however, the need to analyze increasing loads of numerical and categorical data in short times has pushed researchers to investigate applications of AI systems in other upper GI settings, including gastroesophageal reflux disease, eosinophilic esophagitis, and motility disorders. AI and CAD systems will be increasingly incorporated into daily clinical practice in the coming years, thus at least basic notions will be soon required among physicians. For noninsiders, the working principles and potential of AI may be as fascinating as obscure. Accordingly, we reviewed systematic reviews, meta-analyses, randomized controlled trials, and original research articles regarding the performance of AI in the diagnosis of both malignant and benign esophageal and gastric diseases, also discussing essential characteristics of AI.
Collapse
Affiliation(s)
- Pierfrancesco Visaggi
- Gastroenterology Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa
| | - Nicola de Bortoli
- Gastroenterology Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa
| | - Brigida Barberio
- Department of Surgery, Oncology, and Gastroenterology, Division of Gastroenterology, University of Padua, Padua
| | - Vincenzo Savarino
- Gastroenterology Unit, Department of Internal Medicine, University of Genoa, Genoa
| | - Roberto Oleas
- Ecuadorean Institute of Digestive Diseases, Guayaquil, Ecuador
| | - Emma M. Rosi
- Gastroenterology Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa
| | - Santino Marchi
- Gastroenterology Unit, Department of Translational Research and New Technologies in Medicine and Surgery, University of Pisa, Pisa
| | - Mentore Ribolsi
- Department of Digestive Diseases, Campus Bio Medico University of Rome, Roma, Italy
| | - Edoardo Savarino
- Department of Surgery, Oncology, and Gastroenterology, Division of Gastroenterology, University of Padua, Padua
| |
Collapse
|
42
|
Li Q, Liu BR. Application of artificial intelligence-assisted endoscopic detection of early esophageal cancer. Shijie Huaren Xiaohua Zazhi 2021; 29:1389-1395. [DOI: 10.11569/wcjd.v29.i24.1389] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
In recent years, artificial intelligence (AI) combined with endoscopy has made an appearance in the diagnosis of early esophageal cancer (EC) and achieved satisfactory results. Due to the rapid progression and poor prognosis of EC, the early detection and diagnosis of EC are of great value for patient prognosis improvement. AI has been applied in the screening of early EC and has shown advantages; notably, it is more accurate than less-experienced endoscopists. In China, the detection of early EC depends on endoscopist expertise and is inevitably subject to interobserver variability. The excellent imaging recognition ability of AI is very suitable for the diagnosis and recognition of EC, thereby reducing the missed diagnosis and helping physicians to perform endoscopy better. This paper reviews the application and relevant progress of AI in the field of endoscopic detection of early EC (including squamous cell carcinoma and adenocarcinoma), with a focus on diagnostic performance of AI to identify different types of endoscopic images, such as sensitivity and specificity.
Collapse
Affiliation(s)
- Qing Li
- Department of Gastroenterology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou 450000, Henan Province, China
| | - Bing-Rong Liu
- Department of Gastroenterology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou 450000, Henan Province, China
| |
Collapse
|
43
|
Bang CS. Artificial Intelligence in the Analysis of Upper Gastrointestinal Disorders. THE KOREAN JOURNAL OF HELICOBACTER AND UPPER GASTROINTESTINAL RESEARCH 2021. [DOI: 10.7704/kjhugr.2021.0030] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
In the past, conventional machine learning was applied to analyze tabulated medical data while deep learning was applied to study afflictions such as gastrointestinal disorders. Neural networks were used to detect, classify, and delineate various images of lesions because the local feature selection and optimization of the deep learning model enabled accurate image analysis. With the accumulation of medical records, the evolution of computational power and graphics processing units, and the widespread use of open-source libraries in large-scale machine learning processes, medical artificial intelligence (AI) is overcoming its limitations. While early studies prioritized the automatic diagnosis of cancer or pre-cancerous lesions, the current expanded scope of AI includes benign lesions, quality control, and machine learning analysis of big data. However, the limited commercialization of medical AI and the need to justify its application in each field of research are restricting factors. Modeling assumes that observations follow certain statistical rules, and external validation checks whether assumption is correct or generalizable. Therefore, unused data are essential in the training or internal testing process to validate the performance of the established AI models. This article summarizes the studies on the application of AI models in upper gastrointestinal disorders. The current limitations and the perspectives on future development have also been discussed.
Collapse
|
44
|
Nawab K, Athwani R, Naeem A, Hamayun M, Wazir M. A Review of Applications of Artificial Intelligence in Gastroenterology. Cureus 2021; 13:e19235. [PMID: 34877212 PMCID: PMC8642128 DOI: 10.7759/cureus.19235] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/03/2021] [Indexed: 02/06/2023] Open
Abstract
Artificial intelligence (AI) is the science that deals with creating 'intelligent machines'. AI has revolutionized medicine because of its application in several fields across medicine like radiology, neurology, ophthalmology, orthopedics and gastroenterology. In this review, we intend to summarize the basics of AI, the application of AI in various gastrointestinal pathologies till date as well as challenges/ problems related to the application of AI in medicine. Literature search using keywords like artificial intelligence, gastroenterology, applications, etc. were used. The literature search was done using Google Scholar, PubMed and ScienceDirect. All the relevant articles were gathered and relevant data were extracted from them. We concluded AI has achieved major feats in the past few decades. It has helped clinicians in diagnosing complex diseases, managing treatments as well as in predicting outcomes, all in all, which helps doctors from all over the globe in dispensing better healthcare services.
Collapse
Affiliation(s)
- Khalid Nawab
- Internal Medicine, Penn State Holy Spirit Hospital, Camp Hill, USA
| | - Ravi Athwani
- Internal Medicine, Penn State Holy Spirit Hospital, Camp Hill, USA
| | - Awais Naeem
- Internal Medicine, Khyber Medical University, Peshawar, PAK
| | | | - Momna Wazir
- Internal Medicine, Hayatabad Medical Complex, Peshawar, PAK
| |
Collapse
|
45
|
Goyal H, Sherazi SAA, Mann R, Gandhi Z, Perisetti A, Aziz M, Chandan S, Kopel J, Tharian B, Sharma N, Thosani N. Scope of Artificial Intelligence in Gastrointestinal Oncology. Cancers (Basel) 2021; 13:5494. [PMID: 34771658 PMCID: PMC8582733 DOI: 10.3390/cancers13215494] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Accepted: 10/27/2021] [Indexed: 12/12/2022] Open
Abstract
Gastrointestinal cancers are among the leading causes of death worldwide, with over 2.8 million deaths annually. Over the last few decades, advancements in artificial intelligence technologies have led to their application in medicine. The use of artificial intelligence in endoscopic procedures is a significant breakthrough in modern medicine. Currently, the diagnosis of various gastrointestinal cancer relies on the manual interpretation of radiographic images by radiologists and various endoscopic images by endoscopists. This can lead to diagnostic variabilities as it requires concentration and clinical experience in the field. Artificial intelligence using machine or deep learning algorithms can provide automatic and accurate image analysis and thus assist in diagnosis. In the field of gastroenterology, the application of artificial intelligence can be vast from diagnosis, predicting tumor histology, polyp characterization, metastatic potential, prognosis, and treatment response. It can also provide accurate prediction models to determine the need for intervention with computer-aided diagnosis. The number of research studies on artificial intelligence in gastrointestinal cancer has been increasing rapidly over the last decade due to immense interest in the field. This review aims to review the impact, limitations, and future potentials of artificial intelligence in screening, diagnosis, tumor staging, treatment modalities, and prediction models for the prognosis of various gastrointestinal cancers.
Collapse
Affiliation(s)
- Hemant Goyal
- Department of Internal Medicine, The Wright Center for Graduate Medical Education, 501 S. Washington Avenue, Scranton, PA 18505, USA
| | - Syed A. A. Sherazi
- Department of Medicine, John H Stroger Jr Hospital of Cook County, 1950 W Polk St, Chicago, IL 60612, USA;
| | - Rupinder Mann
- Department of Medicine, Saint Agnes Medical Center, 1303 E. Herndon Ave, Fresno, CA 93720, USA;
| | - Zainab Gandhi
- Department of Medicine, Geisinger Wyoming Valley Medical Center, 1000 E Mountain Dr, Wilkes-Barre, PA 18711, USA;
| | - Abhilash Perisetti
- Division of Interventional Oncology & Surgical Endoscopy (IOSE), Parkview Cancer Institute, 11050 Parkview Circle, Fort Wayne, IN 46845, USA; (A.P.); (N.S.)
| | - Muhammad Aziz
- Department of Gastroenterology and Hepatology, University of Toledo Medical Center, 3000 Arlington Avenue, Toledo, OH 43614, USA;
| | - Saurabh Chandan
- Division of Gastroenterology and Hepatology, CHI Health Creighton University Medical Center, 7500 Mercy Rd, Omaha, NE 68124, USA;
| | - Jonathan Kopel
- Department of Medicine, Texas Tech University Health Sciences Center, 3601 4th St, Lubbock, TX 79430, USA;
| | - Benjamin Tharian
- Department of Gastroenterology and Hepatology, The University of Arkansas for Medical Sciences, 4301 W Markham St, Little Rock, AR 72205, USA;
| | - Neil Sharma
- Division of Interventional Oncology & Surgical Endoscopy (IOSE), Parkview Cancer Institute, 11050 Parkview Circle, Fort Wayne, IN 46845, USA; (A.P.); (N.S.)
| | - Nirav Thosani
- Division of Gastroenterology, Hepatology & Nutrition, McGovern Medical School, UTHealth, 6410 Fannin, St #1014, Houston, TX 77030, USA;
| |
Collapse
|
46
|
Li N, Jin SZ. Artificial intelligence and early esophageal cancer. Artif Intell Gastrointest Endosc 2021; 2:198-210. [DOI: 10.37126/aige.v2.i5.198] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 09/23/2021] [Accepted: 10/27/2021] [Indexed: 02/06/2023] Open
Abstract
The development of esophageal cancer (EC) from early to advanced stage results in a high mortality rate and poor prognosis. Advanced EC not only poses a serious threat to the life and health of patients but also places a heavy economic burden on their families and society. Endoscopy is of great value for the diagnosis of EC, especially in the screening of Barrett’s esophagus and early EC. However, at present, endoscopy has a low diagnostic rate for early tumors. In recent years, artificial intelligence (AI) has made remarkable progress in the diagnosis of digestive system tumors, providing a new model for clinicians to diagnose and treat these tumors. In this review, we aim to provide a comprehensive overview of how AI can help doctors diagnose early EC and precancerous lesions and make clinical decisions based on the predicted results. We analyze and summarize the recent research on AI and early EC. We find that based on deep learning (DL) and convolutional neural network methods, the current computer-aided diagnosis system has gradually developed from in vitro image analysis to real-time detection and diagnosis. Based on powerful computing and DL capabilities, the diagnostic accuracy of AI is close to or better than that of endoscopy specialists. We also analyze the shortcomings in the current AI research and corresponding improvement strategies. We believe that the application of AI-assisted endoscopy in the diagnosis of early EC and precancerous lesions will become possible after the further advancement of AI-related research.
Collapse
Affiliation(s)
- Ning Li
- Department of Gastroenterology and Hepatology, The Second Affiliated Hospital of Harbin Medical University, Harbin 150086, Heilongjiang Province, China
| | - Shi-Zhu Jin
- Department of Gastroenterology and Hepatology, The Second Affiliated Hospital of Harbin Medical University, Harbin 150086, Heilongjiang Province, China
| |
Collapse
|
47
|
Kröner PT, Engels MML, Glicksberg BS, Johnson KW, Mzaik O, van Hooft JE, Wallace MB, El-Serag HB, Krittanawong C. Artificial intelligence in gastroenterology: A state-of-the-art review. World J Gastroenterol 2021; 27:6794-6824. [PMID: 34790008 PMCID: PMC8567482 DOI: 10.3748/wjg.v27.i40.6794] [Citation(s) in RCA: 74] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Revised: 06/15/2021] [Accepted: 09/16/2021] [Indexed: 02/06/2023] Open
Abstract
The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.
Collapse
Affiliation(s)
- Paul T Kröner
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Megan ML Engels
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Cancer Center Amsterdam, Department of Gastroenterology and Hepatology, Amsterdam UMC, Location AMC, Amsterdam 1105, The Netherlands
| | - Benjamin S Glicksberg
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Kipp W Johnson
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Obaie Mzaik
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Jeanin E van Hooft
- Department of Gastroenterology and Hepatology, Leiden University Medical Center, Amsterdam 2300, The Netherlands
| | - Michael B Wallace
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Division of Gastroenterology and Hepatology, Sheikh Shakhbout Medical City, Abu Dhabi 11001, United Arab Emirates
| | - Hashem B El-Serag
- Section of Gastroenterology and Hepatology, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
| | - Chayakrit Krittanawong
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Cardiology, Michael E. DeBakey VA Medical Center, Houston, TX 77030, United States
| |
Collapse
|
48
|
Xu J, Wang J, Bian X, Zhu JQ, Tie CW, Liu X, Zhou Z, Ni XG, Qian D. Deep Learning for nasopharyngeal Carcinoma Identification Using Both White Light and Narrow-Band Imaging Endoscopy. Laryngoscope 2021; 132:999-1007. [PMID: 34622964 DOI: 10.1002/lary.29894] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Revised: 09/18/2021] [Accepted: 09/28/2021] [Indexed: 12/25/2022]
Abstract
OBJECTIVES/HYPOTHESIS To develop a deep-learning-based automatic diagnosis system for identifying nasopharyngeal carcinoma (NPC) from noncancer (inflammation and hyperplasia), using both white light imaging (WLI) and narrow-band imaging (NBI) nasopharyngoscopy images. STUDY DESIGN Retrospective study. METHODS A total of 4,783 nasopharyngoscopy images (2,898 WLI and 1,885 NBI) of 671 patients were collected and a novel deep convolutional neural network (DCNN) framework was developed named Siamese deep convolutional neural network (S-DCNN), which can simultaneously utilize WLI and NBI images to improve the classification performance. To verify the effectiveness of combining the above-mentioned two modal images for prediction, we compared the proposed S-DCNN with two baseline models, namely DCNN-1 (only considering WLI images) and DCNN-2 (only considering NBI images). RESULTS In the threefold cross-validation, an overall accuracy and area under the curve of the three DCNNs achieved 94.9% (95% confidence interval [CI] 93.3%-96.5%) and 0.986 (95% CI 0.982-0.992), 87.0% (95% CI 84.2%-89.7%) and 0.930 (95% CI 0.906-0.961), and 92.8% (95% CI 90.4%-95.3%) and 0.971 (95% CI 0.953-0.992), respectively. The accuracy of S-DCNN is significantly improved compared with DCNN-1 (P-value <.001) and DCNN-2 (P-value = .008). CONCLUSION Using the deep-learning technology to automatically diagnose NPC under nasopharyngoscopy can provide valuable reference for NPC screening. Superior performance can be obtained by simultaneously utilizing the multimodal features of NBI image and WLI image of the same patient. LEVEL OF EVIDENCE 3 Laryngoscope, 2021.
Collapse
Affiliation(s)
- Jianwei Xu
- Deepwise Joint Lab, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Jun Wang
- Deepwise Joint Lab, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Xianzhang Bian
- Deepwise Joint Lab, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Ji-Qing Zhu
- Department of Endoscopy, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Cheng-Wei Tie
- Department of Endoscopy, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Xiaoqing Liu
- Deepwise Artificial Intelligence Laboratory, Deepwise Healthcare, Beijing, China
| | - Zhiyong Zhou
- Deepwise Joint Lab, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China.,School of Design and Art, Shanghai Dianji University, Shanghai, China
| | - Xiao-Guang Ni
- Department of Endoscopy, National Cancer Center/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Dahong Qian
- Deepwise Joint Lab, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
49
|
Tsai CL, Mukundan A, Chung CS, Chen YH, Wang YK, Chen TH, Tseng YS, Huang CW, Wu IC, Wang HC. Hyperspectral Imaging Combined with Artificial Intelligence in the Early Detection of Esophageal Cancer. Cancers (Basel) 2021; 13:4593. [PMID: 34572819 PMCID: PMC8469506 DOI: 10.3390/cancers13184593] [Citation(s) in RCA: 57] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 09/09/2021] [Accepted: 09/10/2021] [Indexed: 02/08/2023] Open
Abstract
This study uses hyperspectral imaging (HSI) and a deep learning diagnosis model that can identify the stage of esophageal cancer and mark the locations. This model simulates the spectrum data from the image using an algorithm developed in this study which is combined with deep learning for the classification and diagnosis of esophageal cancer using a single-shot multibox detector (SSD)-based identification system. Some 155 white-light endoscopic images and 153 narrow-band endoscopic images of esophageal cancer were used to evaluate the prediction model. The algorithm took 19 s to predict the results of 308 test images and the accuracy of the test results of the WLI and NBI esophageal cancer was 88 and 91%, respectively, when using the spectral data. Compared with RGB images, the accuracy of the WLI was 83% and the NBI was 86%. In this study, the accuracy of the WLI and NBI was increased by 5%, confirming that the prediction accuracy of the HSI detection method is significantly improved.
Collapse
Affiliation(s)
- Cho-Lun Tsai
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Ditmanson Medical Foundation Chiayi Christian Hospital, Chia Yi City 60002, Taiwan; (C.-L.T.); (Y.-H.C.); (T.-H.C.)
| | - Arvind Mukundan
- Department of Mechanical Engineering, Advanced Institute of Manufacturing with High tech Innovations (AIM-HI) and Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi County 62102, Taiwan; (A.M.); (Y.-S.T.)
| | - Chen-Shuan Chung
- Department of Internal Medicine, Far Eastern Memorial Hospital, No.21, Sec. 2, Nanya S. Rd., Banciao Dist., New Taipei City 22060, Taiwan;
| | - Yi-Hsun Chen
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Ditmanson Medical Foundation Chiayi Christian Hospital, Chia Yi City 60002, Taiwan; (C.-L.T.); (Y.-H.C.); (T.-H.C.)
| | - Yao-Kuang Wang
- Division of Gastroenterology, Department of Internal Medicine, Kaohsiung Medical University Hospital, Kaohsiung Medical University, No.100, Tzyou 1st Rd., Sanmin Dist., Kaohsiung City 80756, Taiwan; (Y.-K.W.); (I.-C.W.)
- Department of Medicine, Faculty of Medicine, College of Medicine, Kaohsiung Medical University, No.100, Tzyou 1st Rd., Sanmin Dist., Kaohsiung City 80756, Taiwan
- Graduate Institute of Clinical Medicine, College of Medicine, Kaohsiung Medical University, No.100, Tzyou 1st Rd., Sanmin Dist., Kaohsiung City 80756, Taiwan
| | - Tsung-Hsien Chen
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Ditmanson Medical Foundation Chiayi Christian Hospital, Chia Yi City 60002, Taiwan; (C.-L.T.); (Y.-H.C.); (T.-H.C.)
| | - Yu-Sheng Tseng
- Department of Mechanical Engineering, Advanced Institute of Manufacturing with High tech Innovations (AIM-HI) and Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi County 62102, Taiwan; (A.M.); (Y.-S.T.)
| | - Chien-Wei Huang
- Department of Gastroenterology, Kaohsiung Armed Forces General Hospital, 2, Zhongzheng 1st. Rd., Lingya District, Kaohsiung City 80284, Taiwan
- Department of Nursing, Tajen University, 20, Weixin Rd., Yanpu Township, Pingtung City 90741, Taiwan
| | - I-Chen Wu
- Division of Gastroenterology, Department of Internal Medicine, Kaohsiung Medical University Hospital, Kaohsiung Medical University, No.100, Tzyou 1st Rd., Sanmin Dist., Kaohsiung City 80756, Taiwan; (Y.-K.W.); (I.-C.W.)
- Department of Medicine, Faculty of Medicine, College of Medicine, Kaohsiung Medical University, No.100, Tzyou 1st Rd., Sanmin Dist., Kaohsiung City 80756, Taiwan
| | - Hsiang-Chen Wang
- Department of Mechanical Engineering, Advanced Institute of Manufacturing with High tech Innovations (AIM-HI) and Center for Innovative Research on Aging Society (CIRAS), National Chung Cheng University, 168, University Rd., Min Hsiung, Chia Yi County 62102, Taiwan; (A.M.); (Y.-S.T.)
| |
Collapse
|
50
|
Yang H, Hu B. Early gastrointestinal cancer: The application of artificial intelligence. Artif Intell Gastrointest Endosc 2021; 2:185-197. [DOI: 10.37126/aige.v2.i4.185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/11/2021] [Revised: 06/25/2021] [Accepted: 08/18/2021] [Indexed: 02/06/2023] Open
Abstract
Early gastrointestinal (GI) cancer has been the core of clinical endoscopic work. Its early detection and treatment are tightly associated with patients’ prognoses. As a novel technology, artificial intelligence has been improved and applied in the field of endoscopy. Studies on detection, diagnosis, risk, and prognosis evaluation of diseases in the GI tract have been in development, including precancerous lesions, adenoma, early GI cancers, and advanced GI cancers. In this review, research on esophagus, stomach, and colon was concluded, and associated with the process from precancerous lesions to early GI cancer, such as from Barrett’s esophagus to early esophageal cancer, from dysplasia to early gastric cancer, and from adenoma to early colonic cancer. A status quo of research on early GI cancers and artificial intelligence was provided.
Collapse
Affiliation(s)
- Hang Yang
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| | - Bing Hu
- Department of Gastroenterology, West China Hospital, Sichuan University, Chengdu 610041, Sichuan Province, China
| |
Collapse
|