1
|
Sharafi SM, Ebrahimiadib N, Roohipourmoallai R, Dastjani Farahani A, Imani Fooladi M, Gharehbaghi G, Khalili Pour E. SmartPlus: a computer-based image analysis method to predict continuous-valued vascular abnormality index in Retinopathy of Prematurity. Int J Retina Vitreous 2025; 11:43. [PMID: 40217482 PMCID: PMC11987276 DOI: 10.1186/s40942-025-00668-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2025] [Accepted: 03/31/2025] [Indexed: 04/14/2025] Open
Abstract
Plus disease is characterized by abnormal changes in retinal vasculature of premature infants. Presence of Plus disease is an important criterion for identifying treatment-requiring cases in Retinopathy of Prematurity (ROP). However, diagnosis of Plus disease has been shown to be subjective and there is wide variability in the classification of Plus disease by ROP experts, which is mainly because experts have different cut-points for distinguishing the levels of vascular abnormality. This suggests that a continuous Plus disease severity score may reflect more accurately the behavior of expert clinicians and may better standardize the classification. The effect of using quantitative methods and computer-based image analysis to improve the objectivity of Plus disease diagnosis have been well established. Nevertheless, the current methods are based on categorical classifications of the disease severity and lack the compatibility with the continuous nature of the abnormal changes in retinal vasculatures. In this study, we developed a computer-based method that performs a quantitative analysis of vascular characteristics associated with Plus disease and utilizes them to build a regression model that outputs a continuous spectrum of Plus severity. We evaluated the proposed method against the consensus diagnosis made by four ROP experts on 76 posterior ROP images. The findings of our study indicate that our approach demonstrated a relatively acceptable level of accuracy in evaluating the severity of Plus disease, which is comparable to the diagnostic abilities of experts.
Collapse
Affiliation(s)
- Sayed Mehran Sharafi
- Translational Ophthalmology Research Center, Farabi Eye Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Nazanin Ebrahimiadib
- Ophthalmology Department, College of Medicine, University of Florida, Gainesville, FL, USA
| | - Ramak Roohipourmoallai
- Department of Ophthalmology, Morsani College of Medicine, University of South Florida, Tempa, FL, USA
| | - Afsar Dastjani Farahani
- Retinopathy of Prematurity Department, Farabi Eye Hospital, Tehran University of Medical Sciences, South Kargar Street, Qazvin Square, Tehran, Iran
| | - Marjan Imani Fooladi
- Clinical Pediatric Ophthalmology Department, UPMC, Children's Hospital of Pittsburgh, Pittsburgh, USA
| | - Golnaz Gharehbaghi
- Department of Pediatrics, Ali Asghar Children's Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Elias Khalili Pour
- Retinopathy of Prematurity Department, Farabi Eye Hospital, Tehran University of Medical Sciences, South Kargar Street, Qazvin Square, Tehran, Iran.
| |
Collapse
|
2
|
Cruz-Abrams O, Dodds Rojas R, Abramson DH. Machine learning demonstrates clinical utility in distinguishing retinoblastoma from pseudo retinoblastoma with RetCam images. Ophthalmic Genet 2025; 46:180-185. [PMID: 39834033 DOI: 10.1080/13816810.2025.2455576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2024] [Revised: 12/15/2024] [Accepted: 01/14/2025] [Indexed: 01/22/2025]
Abstract
BACKGROUND Retinoblastoma is diagnosed and treated without biopsy based solely on appearance (with the indirect ophthalmoscope and imaging). More than 20 benign ophthalmic disorders resemble retinoblastoma and errors in diagnosis continue to be made worldwide. A better noninvasive method for distinguishing retinoblastoma from pseudo retinoblastoma is needed. METHODS RetCam imaging of retinoblastoma and pseudo retinoblastoma from the largest retinoblastoma center in the U.S. (Memorial Sloan Kettering Cancer Center, New York, NY) were used for this study. We used several neural networks (ResNet-18, ResNet-34, ResNet-50, ResNet-101, ResNet-152, and a Vision Image Transformer, or VIT), using 80% of images for training, 10% for validation, and 10% for testing. RESULTS Two thousand eight hundred eighty-two RetCam images from patients with retinoblastoma at diagnosis, 1,970 images from pseudo retinoblastoma at diagnosis, and 804 normal pediatric fundus images were included. The highest sensitivity (98.6%) was obtained with a ResNet-101 model, as were the highest accuracy and F1 scores of 97.3% and 97.7%. The highest specificity (97.0%) and precision (97.0%) was attained with a ResNet-152 model. CONCLUSION Our machine learning algorithm successfully distinguished retinoblastoma from retinoblastoma with high specificity and sensitivity and if implemented worldwide will prevent hundreds of eyes from incorrectly being surgically removed yearly.
Collapse
Affiliation(s)
- Owen Cruz-Abrams
- Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, N.Y, US
| | | | - David H Abramson
- Department of Surgery, Memorial Sloan Kettering Cancer Center, New York, N.Y, US
| |
Collapse
|
3
|
Liu S, Liu L, Ma C, Su S, Liu Y, Li B. Association between retinal vascular fractal dimensions and retinopathy of prematurity: an AI-assisted retrospective case-control study. Int Ophthalmol 2025; 45:105. [PMID: 40100468 DOI: 10.1007/s10792-025-03461-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 02/22/2025] [Indexed: 03/20/2025]
Abstract
PURPOSE The main objective of this study was to analyze the fractal dimensions (D(f)) of retinal vasculature in premature infants with retinopathy of prematurity (ROP) and determine their correlation with ROP severity. METHODS We conducted a single-center retrospective case-control study involving 641 premature patients with ROP (641 eyes) and 684 normal preterm infants (684 eyes) matched for corrected gestational age (CGA). Computer-assisted techniques were used to quantify peripapillary retinal vascular D(f), vessel tortuosity (VT), and vessel width (VW). RESULTS Compared to the normal preterm groups, patients with ROP exhibited a significant increase in retinal vascular D(f) by 0.0061 (P = 0.0002). Subgroup analyses revealed a significant association between increasing ROP severity and increased retinal vascular D(f) (P < 0.05). Multivariable-adjusted ordered logistic regression models demonstrated that retinal vascular D(f) (aOR: 3.307, P < 0.0001) was significantly independent and associated with ROP severity. For every 0.1 increase in D(f), the probability of ROP requiring intervention increased by 33.07%. Multiple linear regression models indicated a significant positive correlation between D(f) and VT, as well as VW around the optic disc (P < 0.0001). For every 1 (104 cm-3) increase in VT, D(f) increased by 0.0010. Similarly, for every 1 (μm) increase in VW, D(f) increased by 0.0025. CONCLUSIONS Our findings suggest that increased D(f) in retinal vessels is a pathological characteristic of ROP. This increase may be attributed to the curvature and width of the retinal vasculature in infants with ROP. Quantitative measurement of retinal vascular D(f) could serve as a valuable vascular indicator for assessing the severity of ROP.
Collapse
Affiliation(s)
- Shuai Liu
- School of Information Science and Technology, University of Science and Technology of China, Hefei, 230022, China
- Eye Institute, Affiliated Hospital of Nantong University, Medical School of Nantong University, Nantong, 226006, China
| | - Lei Liu
- School of Information Science and Technology, University of Science and Technology of China, Hefei, 230022, China.
| | - Cuixia Ma
- Anhui Province Maternity and Child Health Hospital, Maternity and Child Health Hospital affiliated to Anhui Medical University, Hefei, 230001, China
| | - Shu Su
- Eye Institute, Affiliated Hospital of Nantong University, Medical School of Nantong University, Nantong, 226006, China
| | - Ying Liu
- Department of Radiology, The First Affiliated Hospital, Jiangxi Medical College, Nanchang University, Jiangxi, 330006, China.
| | - Bin Li
- School of Information Science and Technology, University of Science and Technology of China, Hefei, 230022, China
| |
Collapse
|
4
|
Chen JS, Kalaw FGP, Nudleman ED, Scott NL. Automated Quantitative Assessment of Retinal Vascular Tortuosity in Patients with Sickle Cell Disease. OPHTHALMOLOGY SCIENCE 2025; 5:100658. [PMID: 39886358 PMCID: PMC11780102 DOI: 10.1016/j.xops.2024.100658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2024] [Revised: 11/01/2024] [Accepted: 11/08/2024] [Indexed: 02/01/2025]
Abstract
Objective To quantitatively assess the retinal vascular tortuosity of patients with sickle cell disease (SCD) and retinopathy (SCR) using an automated deep learning (DL)-based pipeline. Design Cross-sectional study. Subjects Patients diagnosed with SCD and screened for SCR at an academic eye center between January 2015 and November 2022 were identified using electronic health records. Eyes of unaffected matched patients (i.e., no history of SCD, hypertension, diabetes mellitus, or retinal occlusive disorder) served as controls. Methods For each patient, demographic data, sickle cell diagnosis, types and total number of sickle cell crises, SCD medications used, ocular and systemic comorbidities, and history of intraocular treatment were extracted. A previously published DL algorithm was used to calculate retinal microvascular tortuosity using ultrawidefield pseudocolor fundus imaging among patients with SCD vs. controls. Main Outcome Measures Cumulative tortuosity index (CTI). Results Overall, 64 patients (119 eyes) with SCD and 57 age- and race-matched controls (106 eyes) were included. The majority of the patients with SCD were females (65.6%) and of Black or African descent (78.1%), with an average age of 35.1 ± 20.1 years. The mean number of crises per patient was 3.4 ± 5.2, and the patients took 0.7 ± 0.9 medications. The mean CTI for eyes with SCD was higher than controls (1.06 ± vs. 1.03 ± 0.02, P < 0.001). On subgroup analysis, hemoglobin S, hemoglobin C, and HbS/beta-thalassemia variants had significantly higher CTIs compared with controls (1.07 vs. 1.03, P < 0.001), but not with sickle cell trait variant (1.04 vs. 1.03 control, P = .2). Univariable analysis showed a higher CTI in patients diagnosed with proliferative SCR, most significantly among those with sea-fan neovascularization (1.06 ± 0.02 vs. 1.04 ± 0.01, P < 0.001) and those with >3 sickle cell crises (1.07 ± 0.02 vs. 1.05 ± 0.02, P < 0.001). Conclusions A DL-based metric of cumulative vascular tortuosity associates with and may be a potential biomarker for SCD and SCR disease severity. Financial Disclosures Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
- Jimmy S. Chen
- Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California, San Diego, La Jolla, California
- UCSD Health Department of Biomedical Informatics, University of California San Diego, La Jolla, California
| | - Fritz Gerald P. Kalaw
- Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California, San Diego, La Jolla, California
- UCSD Health Department of Biomedical Informatics, University of California San Diego, La Jolla, California
| | - Eric D. Nudleman
- Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California, San Diego, La Jolla, California
| | - Nathan L. Scott
- Viterbi Family Department of Ophthalmology, Shiley Eye Institute, University of California, San Diego, La Jolla, California
| |
Collapse
|
5
|
Husain A, Knake L, Sullivan B, Barry J, Beam K, Holmes E, Hooven T, McAdams R, Moreira A, Shalish W, Vesoulis Z. AI models in clinical neonatology: a review of modeling approaches and a consensus proposal for standardized reporting of model performance. Pediatr Res 2024:10.1038/s41390-024-03774-4. [PMID: 39681669 DOI: 10.1038/s41390-024-03774-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/30/2024] [Accepted: 11/10/2024] [Indexed: 12/18/2024]
Abstract
Artificial intelligence (AI) is a rapidly advancing area with growing clinical applications in healthcare. The neonatal intensive care unit (NICU) produces large amounts of multidimensional data allowing AI and machine learning (ML) new avenues to improve early diagnosis, enhance monitoring, and provide highly-targeted treatment approaches. In this article, we review recent clinical applications of AI to important neonatal problems, including sepsis, retinopathy of prematurity, bronchopulmonary dysplasia, and others. For each clinical area, we highlight a variety of ML models published in the literature and examine the future role they may play at the bedside. While the development of these models is rapidly expanding, a fundamental understanding of model selection, development, and performance evaluation is crucial for researchers and healthcare providers alike. As AI plays an increasing role in daily practice, understanding the implications of AI design and performance will enable more effective implementation. We provide a comprehensive explanation of the AI development process and recommendations for a standardized performance metric framework. Additionally, we address critical challenges, including model generalizability, ethical considerations, and the need for rigorous performance monitoring to avoid model drift. Finally, we outline future directions, emphasizing the importance of collaborative efforts and equitable access to AI innovations.
Collapse
Affiliation(s)
- Ameena Husain
- Division of Neonatology, Department of Pediatrics, University of Utah School of Medicine, Salt Lake City, UT, USA.
| | - Lindsey Knake
- Division of Neonatology, Department of Pediatrics, University of Iowa, Iowa City, IA, USA
| | - Brynne Sullivan
- Division of Neonatology, Department of Pediatrics, University of Virginia School of Medicine, Charlottesville, VA, USA
| | - James Barry
- Division of Neonatology, Department of Pediatrics, University of Colorado School of Medicine, Aurora, CO, USA
| | - Kristyn Beam
- Department of Neonatology, Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Emma Holmes
- Division of Newborn Medicine, Department of Pediatrics, Mount Sinai Hospital, New York, NY, USA
| | - Thomas Hooven
- Division of Newborn Medicine, Department of Pediatrics, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Ryan McAdams
- Department of Pediatrics, University of Wisconsin School of Medicine and Public Health, Madison, WI, USA
| | - Alvaro Moreira
- Division of Neonatology, Department of Pediatrics, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA
| | - Wissam Shalish
- Division of Neonatology, Department of Pediatrics, Research Institute of the McGill University Health Center, Montreal Children's Hospital, Montreal, Canada
| | - Zachary Vesoulis
- Division of Newborn Medicine, Department of Pediatrics, Washington University in St. Louis, St. Louis, MO, USA
| |
Collapse
|
6
|
Huang YP, Vadloori S, Kang EYC, Fukushima Y, Takahashi R, Wu WC. Computer-aided detection of retinopathy of prematurity severity assessment via vessel tortuosity measurement in preterm infants' fundus images. Eye (Lond) 2024; 38:3309-3317. [PMID: 39097674 PMCID: PMC11584778 DOI: 10.1038/s41433-024-03285-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2024] [Revised: 07/12/2024] [Accepted: 07/23/2024] [Indexed: 08/05/2024] Open
Abstract
OBJECTIVE To develop a computer-aided diagnostic system for retinopathy of prematurity (ROP) disease using retinal vessel morphological features. METHODS A total of 200 fundus images from 136 preterm infants with stage 1 to 3 ROP were analysed. Two methods were developed to measure vessel tortuosity: the peak-and-valley method and the polynomial curve fitting method. Correlations between temporal artery tortuosity (TAT) and temporal vein tortuosity (TVT) with ROP severity were investigated, and vessel tortuosity relationships with vessel angles (TAA and TVA) and vessel widths (TAW and TVW). A separate dataset from Japan containing 126 images from 97 preterm patients was used for verification. RESULTS Both methods identified similar tortuosity in images without ROP and mild ROP cases. However, the polynomial curve fit method demonstrated enhanced tortuosity detection in stages 2 and 3 ROP compared to the peak and valley method. A strong positive correlation was revealed between ROP severity and increased arterial and venous tortuosity (P < 0.0001). A significant negative correlation between TAA and TAT (r = -0.485, P < 0.0001) and TVA and TVT (r = -0.281, P < 0.0001), and a significant positive correlation between TAW and TAT (r = 0.204, P value = 0.0040) were identified. Similar results were found in the test dataset from Japan. CONCLUSIONS ROP severity was associated with increased retinal tortuosity and retinal vessel width while displaying a decrease in retinal vascular angle. This quantitative analysis of retinal vessels provides crucial insights for advancing ROP diagnosis and understanding its progression.
Collapse
Affiliation(s)
- Yo-Ping Huang
- Department of Electrical Engineering, National Penghu University of Science and Technology, Penghu, 88046, Taiwan.
- Department of Electrical Engineering, National Taipei University of Technology, Taipei, 10608, Taiwan.
- Department of Information and Communication Engineering, Chaoyang University of Technology, Taichung, 41349, Taiwan.
| | - Spandana Vadloori
- Department of Electrical Engineering, National Penghu University of Science and Technology, Penghu, 88046, Taiwan
| | - Eugene Yu-Chuan Kang
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou, 33305, Taiwan
- College of Medicine, Chang Gung University, Taoyuan, 33305, Taiwan
| | - Yoko Fukushima
- Department of Ophthalmology, Osaka University, Osaka, 565-0871, Japan
| | - Rie Takahashi
- Department of Ophthalmology, Fukuoka University, Fukuoka, 814-0180, Japan
| | - Wei-Chi Wu
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou, 33305, Taiwan.
- College of Medicine, Chang Gung University, Taoyuan, 33305, Taiwan.
| |
Collapse
|
7
|
Labib KM, Ghumman H, Jain S, Jarstad JS. A Review of the Utility and Limitations of Artificial Intelligence in Retinal Disorders and Pediatric Ophthalmology. Cureus 2024; 16:e71063. [PMID: 39380780 PMCID: PMC11459419 DOI: 10.7759/cureus.71063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2024] [Accepted: 10/08/2024] [Indexed: 10/10/2024] Open
Abstract
Artificial intelligence (AI) is reshaping ophthalmology by enhancing diagnostic precision and treatment strategies, particularly in retinal disorders and pediatric ophthalmology. This review examines AI's efficacy in diagnosing conditions such as diabetic retinopathy (DR) and age-related macular degeneration (AMD) using imaging techniques, such as optical coherence tomography (OCT) and fundus photography. AI also shows promise in pediatric care, aiding in the screening of retinopathy of prematurity (ROP) and the management of conditions, including pediatric cataracts and strabismus. However, the integration of AI in ophthalmology presents challenges, including ethical concerns regarding algorithm biases, privacy issues, and limitations in data set quality. Addressing these challenges is crucial to ensure AI's responsible and effective deployment in clinical settings. This review synthesizes current research, underscoring AI's transformative potential in ophthalmology while highlighting critical considerations for its ethical use and technological advancement.
Collapse
Affiliation(s)
- Kristie M Labib
- Department of Ophthalmology, University of South Florida Health Morsani College of Medicine, Tampa, USA
| | - Haider Ghumman
- Department of Ophthalmology, University of South Florida Health Morsani College of Medicine, Tampa, USA
| | - Samyak Jain
- Department of Ophthalmology, University of South Florida Health Morsani College of Medicine, Tampa, USA
| | - John S Jarstad
- Department of Ophthalmology, University of South Florida Health Morsani College of Medicine, Tampa, USA
| |
Collapse
|
8
|
Kıran Yenice E, Kara C, Erdaş ÇB. Automated detection of type 1 ROP, type 2 ROP and A-ROP based on deep learning. Eye (Lond) 2024; 38:2644-2648. [PMID: 38918566 PMCID: PMC11385231 DOI: 10.1038/s41433-024-03184-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 06/10/2024] [Accepted: 06/11/2024] [Indexed: 06/27/2024] Open
Abstract
PURPOSE To provide automatic detection of Type 1 retinopathy of prematurity (ROP), Type 2 ROP, and A-ROP by deep learning-based analysis of fundus images obtained by clinical examination using convolutional neural networks. MATERIAL AND METHODS A total of 634 fundus images of 317 premature infants born at 23-34 weeks of gestation were evaluated. After image pre-processing, we obtained a rectangular region (ROI). RegNetY002 was used for algorithm training, and stratified 10-fold cross-validation was applied during training to evaluate and standardize our model. The model's performance was reported as accuracy and specificity and described by the receiver operating characteristic (ROC) curve and area under the curve (AUC). RESULTS The model achieved 0.98 accuracy and 0.98 specificity in detecting Type 2 ROP versus Type 1 ROP and A-ROP. On the other hand, as a result of the analysis of ROI regions, the model achieved 0.90 accuracy and 0.95 specificity in detecting Stage 2 ROP versus Stage 3 ROP and 0.91 accuracy and 0.92 specificity in detecting A-ROP versus Type 1 ROP. The AUC scores were 0.98 for Type 2 ROP versus Type 1 ROP and A-ROP, 0.85 for Stage 2 ROP versus Stage 3 ROP, and 0.91 for A-ROP versus Type 1 ROP. CONCLUSION Our study demonstrated that ROP classification by DL-based analysis of fundus images can be distinguished with high accuracy and specificity. Integrating DL-based artificial intelligence algorithms into clinical practice may reduce the workload of ophthalmologists in the future and provide support in decision-making in the management of ROP.
Collapse
Affiliation(s)
- Eşay Kıran Yenice
- Department of Ophthalmology, University of Health Sciences, Etlik Zübeyde Hanım Maternity and Women's Health Teaching and Research Hospital, Ankara, Turkey.
| | - Caner Kara
- Department of Ophthalmology, Etlik City Hospital, Ankara, Turkey
| | | |
Collapse
|
9
|
Liu S, Liu L, Ma CX, Huang LH, Li B. Changes of the peripapillary vascular parameters in premature infants without retinopathy of prematurity using U-net segmentation. Int J Ophthalmol 2024; 17:1453-1461. [PMID: 39156772 PMCID: PMC11286446 DOI: 10.18240/ijo.2024.08.10] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Accepted: 04/03/2024] [Indexed: 08/20/2024] Open
Abstract
AIM To quantitatively assess the changes in mean vascular tortuosity (mVT) and mean vascular width (mVW) around the optic disc and their correlation with gestational age (GA) and birth weight (BW) in premature infants without retinopathy of prematurity (ROP). METHODS A single-center retrospective study included a total of 133 (133 eyes) premature infants [mean corrected gestational age (CGA) 43.6wk] without ROP as the premature group and 130 (130 eyes) CGA-matched full-term infants as the control group. The peripapillary mVT and mVW were quantitatively measured using computer-assisted techniques. RESULTS Premature infants had significantly higher mVT (P=0.0032) and lower mVW (P=0.0086) by 2.68 (104 cm-3) and 1.85 µm, respectively. Subgroup analysis with GA showed significant differences (P=0.0244) in mVT between the early preterm and middle to late preterm groups, but the differences between mVW were not significant (P=0.6652). The results of the multiple linear regression model showed a significant negative correlation between GA and BW with mVT after adjusting sex and CGA (P=0.0211 and P=0.0006, respectively). For each day increase in GA at birth, mVT decreased by 0.1281 (104 cm-3) and for each 1 g increase in BW, mVT decreased by 0.006 (104 cm-3). However, GA (P=0.9402) and BW (P=0.7275) were not significantly correlated with mVW. CONCLUSION Preterm birth significantly affects the peripapillary vascular parameters that indicate higher mVT and narrower mVW in premature infants without ROP. Alterations in these parameters may provide new insights into the pathogenesis of ocular vascular disease.
Collapse
Affiliation(s)
- Shuai Liu
- School of Information Science and Technology, University of Science and Technology of China, Hefei 230022, Anhui Province, China
- Eye Institute, Affiliated Hospital of Nantong University, Medical School of Nantong University, Nantong 226006, Jiangsu Province, China
| | - Lei Liu
- School of Information Science and Technology, University of Science and Technology of China, Hefei 230022, Anhui Province, China
- Zhejiang Lab, Hangzhou 311121, Zhejiang Province, China
| | - Cui-Xia Ma
- Anhui Province Maternity and Child Health Hospital, Maternity and Child Health Hospital Affiliated to Anhui Medical University, Hefei 230001, Anhui Province, China
| | - Liu-Hui Huang
- Department of Ophthalmology, Tenth People's Hospital Affiliated with Shanghai Tongji University School of Medicine, Shanghai 200072, China
| | - Bin Li
- School of Information Science and Technology, University of Science and Technology of China, Hefei 230022, Anhui Province, China
| |
Collapse
|
10
|
Timkovič J, Nowaková J, Kubíček J, Hasal M, Varyšová A, Kolarčík L, Maršolková K, Augustynek M, Snášel V. Retinal Image Dataset of Infants and Retinopathy of Prematurity. Sci Data 2024; 11:814. [PMID: 39043697 PMCID: PMC11266588 DOI: 10.1038/s41597-024-03409-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Accepted: 05/23/2024] [Indexed: 07/25/2024] Open
Abstract
Retinopathy of prematurity (ROP) represents a vasoproliferative disease, especially in newborns and infants, which can potentially affect and damage the vision. Despite recent advances in neonatal care and medical guidelines, ROP still remains one of the leading causes of worldwide childhood blindness. The paper presents a unique dataset of 6,004 retinal images of 188 newborns, most of whom are premature infants. The dataset is accompanied by the anonymized patients' information from the ROP screening acquired at the University Hospital Ostrava, Czech Republic. Three digital retinal imaging camera systems are used in the study: Clarity RetCam 3, Natus RetCam Envision, and Phoenix ICON. The study is enriched by the software tool ReLeSeT which is aimed at automatic retinal lesion segmentation and extraction from retinal images. Consequently, this tool enables computing geometric and intensity features of retinal lesions. Also, we publish a set of pre-processing tools for feature boosting of retinal lesions and retinal blood vessels for building classification and segmentation models in ROP analysis.
Collapse
Affiliation(s)
- Juraj Timkovič
- University Hospital Ostrava, Clinic of Ophthalmology, Ostrava, 708 52, Czech Republic
- University of Ostrava, Faculty of Medicine, Department of Craniofacial Surgery, Ostrava, 703 00, Czech Republic
| | - Jana Nowaková
- VSB-Technical University of Ostrava, Faculty of Electrical Engineering and Computer Science, Department of Computer Science, Ostrava, 708 00, Czech Republic.
| | - Jan Kubíček
- VSB-Technical University of Ostrava, Faculty of Electrical Engineering and Computer Science, Department of Cybernetics and Biomedical Engineering, Ostrava, 708 00, Czech Republic
| | - Martin Hasal
- VSB-Technical University of Ostrava, Faculty of Electrical Engineering and Computer Science, Department of Computer Science, Ostrava, 708 00, Czech Republic
| | - Alice Varyšová
- VSB-Technical University of Ostrava, Faculty of Electrical Engineering and Computer Science, Department of Cybernetics and Biomedical Engineering, Ostrava, 708 00, Czech Republic
| | - Lukáš Kolarčík
- University Hospital Ostrava, Clinic of Ophthalmology, Ostrava, 708 52, Czech Republic
| | - Kristýna Maršolková
- University Hospital Ostrava, Clinic of Ophthalmology, Ostrava, 708 52, Czech Republic
| | - Martin Augustynek
- VSB-Technical University of Ostrava, Faculty of Electrical Engineering and Computer Science, Department of Cybernetics and Biomedical Engineering, Ostrava, 708 00, Czech Republic
| | - Václav Snášel
- VSB-Technical University of Ostrava, Faculty of Electrical Engineering and Computer Science, Department of Computer Science, Ostrava, 708 00, Czech Republic
| |
Collapse
|
11
|
Chu Y, Hu S, Li Z, Yang X, Liu H, Yi X, Qi X. Image Analysis-Based Machine Learning for the Diagnosis of Retinopathy of Prematurity: A Meta-analysis and Systematic Review. Ophthalmol Retina 2024; 8:678-687. [PMID: 38237772 DOI: 10.1016/j.oret.2024.01.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 01/02/2024] [Accepted: 01/09/2024] [Indexed: 02/17/2024]
Abstract
TOPIC To evaluate the performance of machine learning (ML) in the diagnosis of retinopathy of prematurity (ROP) and to assess whether it can be an effective automated diagnostic tool for clinical applications. CLINICAL RELEVANCE Early detection of ROP is crucial for preventing tractional retinal detachment and blindness in preterm infants, which has significant clinical relevance. METHODS Web of Science, PubMed, Embase, IEEE Xplore, and Cochrane Library were searched for published studies on image-based ML for diagnosis of ROP or classification of clinical subtypes from inception to October 1, 2022. The quality assessment tool for artificial intelligence-centered diagnostic test accuracy studies was used to determine the risk of bias (RoB) of the included original studies. A bivariate mixed effects model was used for quantitative analysis of the data, and the Deek's test was used for calculating publication bias. Quality of evidence was assessed using Grading of Recommendations Assessment, Development and Evaluation. RESULTS Twenty-two studies were included in the systematic review; 4 studies had high or unclear RoB. In the area of indicator test items, only 2 studies had high or unclear RoB because they did not establish predefined thresholds. In the area of reference standards, 3 studies had high or unclear RoB. Regarding applicability, only 1 study was considered to have high or unclear applicability in terms of patient selection. The sensitivity and specificity of image-based ML for the diagnosis of ROP were 93% (95% confidence interval [CI]: 0.90-0.94) and 95% (95% CI: 0.94-0.97), respectively. The area under the receiver operating characteristic curve (AUC) was 0.98 (95% CI: 0.97-0.99). For the classification of clinical subtypes of ROP, the sensitivity and specificity were 93% (95% CI: 0.89-0.96) and 93% (95% CI: 0.89-0.95), respectively, and the AUC was 0.97 (95% CI: 0.96-0.98). The classification results were highly similar to those of clinical experts (Spearman's R = 0.879). CONCLUSIONS Machine learning algorithms are no less accurate than human experts and hold considerable potential as automated diagnostic tools for ROP. However, given the quality and high heterogeneity of the available evidence, these algorithms should be considered as supplementary tools to assist clinicians in diagnosing ROP. FINANCIAL DISCLOSURE(S) Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
- Yihang Chu
- Central South University of Forestry and Technology, Changsha, Hunan, China; State Key Laboratory of Pathogenesis, Prevention and Treatment of High Incidence Diseases in Central Asia, Clinical Medical Research Institute, The First Affiliated Hospital of Xinjiang Medical University, Urumqi, Xinjiang, China
| | - Shipeng Hu
- Central South University of Forestry and Technology, Changsha, Hunan, China
| | - Zilan Li
- Department of Biochemistry, McGill University, Montreal, Quebec, Canada
| | - Xiao Yang
- State Key Laboratory of Pathogenesis, Prevention and Treatment of High Incidence Diseases in Central Asia, Clinical Medical Research Institute, The First Affiliated Hospital of Xinjiang Medical University, Urumqi, Xinjiang, China
| | - Hui Liu
- Central South University of Forestry and Technology, Changsha, Hunan, China.
| | - Xianglong Yi
- Department of Ophthalmology, The First Affiliated Hospital of Xinjiang Medical University, Urumchi, China.
| | - Xinwei Qi
- State Key Laboratory of Pathogenesis, Prevention and Treatment of High Incidence Diseases in Central Asia, Clinical Medical Research Institute, The First Affiliated Hospital of Xinjiang Medical University, Urumqi, Xinjiang, China.
| |
Collapse
|
12
|
Sorrentino FS, Gardini L, Fontana L, Musa M, Gabai A, Maniaci A, Lavalle S, D’Esposito F, Russo A, Longo A, Surico PL, Gagliano C, Zeppieri M. Novel Approaches for Early Detection of Retinal Diseases Using Artificial Intelligence. J Pers Med 2024; 14:690. [PMID: 39063944 PMCID: PMC11278069 DOI: 10.3390/jpm14070690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Revised: 06/24/2024] [Accepted: 06/25/2024] [Indexed: 07/28/2024] Open
Abstract
BACKGROUND An increasing amount of people are globally affected by retinal diseases, such as diabetes, vascular occlusions, maculopathy, alterations of systemic circulation, and metabolic syndrome. AIM This review will discuss novel technologies in and potential approaches to the detection and diagnosis of retinal diseases with the support of cutting-edge machines and artificial intelligence (AI). METHODS The demand for retinal diagnostic imaging exams has increased, but the number of eye physicians or technicians is too little to meet the request. Thus, algorithms based on AI have been used, representing valid support for early detection and helping doctors to give diagnoses and make differential diagnosis. AI helps patients living far from hub centers to have tests and quick initial diagnosis, allowing them not to waste time in movements and waiting time for medical reply. RESULTS Highly automated systems for screening, early diagnosis, grading and tailored therapy will facilitate the care of people, even in remote lands or countries. CONCLUSION A potential massive and extensive use of AI might optimize the automated detection of tiny retinal alterations, allowing eye doctors to perform their best clinical assistance and to set the best options for the treatment of retinal diseases.
Collapse
Affiliation(s)
| | - Lorenzo Gardini
- Unit of Ophthalmology, Department of Surgical Sciences, Ospedale Maggiore, 40100 Bologna, Italy; (F.S.S.)
| | - Luigi Fontana
- Ophthalmology Unit, Department of Surgical Sciences, Alma Mater Studiorum University of Bologna, IRCCS Azienda Ospedaliero-Universitaria Bologna, 40100 Bologna, Italy
| | - Mutali Musa
- Department of Optometry, University of Benin, Benin City 300238, Edo State, Nigeria
| | - Andrea Gabai
- Department of Ophthalmology, Humanitas-San Pio X, 20159 Milan, Italy
| | - Antonino Maniaci
- Department of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
| | - Salvatore Lavalle
- Department of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
| | - Fabiana D’Esposito
- Imperial College Ophthalmic Research Group (ICORG) Unit, Imperial College, 153-173 Marylebone Rd, London NW15QH, UK
- Department of Neurosciences, Reproductive Sciences and Dentistry, University of Naples Federico II, Via Pansini 5, 80131 Napoli, Italy
| | - Andrea Russo
- Department of Ophthalmology, University of Catania, 95123 Catania, Italy
| | - Antonio Longo
- Department of Ophthalmology, University of Catania, 95123 Catania, Italy
| | - Pier Luigi Surico
- Schepens Eye Research Institute of Mass Eye and Ear, Harvard Medical School, Boston, MA 02114, USA
- Department of Ophthalmology, Campus Bio-Medico University, 00128 Rome, Italy
| | - Caterina Gagliano
- Department of Medicine and Surgery, University of Enna “Kore”, Piazza dell’Università, 94100 Enna, Italy
- Eye Clinic, Catania University, San Marco Hospital, Viale Carlo Azeglio Ciampi, 95121 Catania, Italy
| | - Marco Zeppieri
- Department of Ophthalmology, University Hospital of Udine, 33100 Udine, Italy
| |
Collapse
|
13
|
Sharafi SM, Ebrahimiadib N, Roohipourmoallai R, Farahani AD, Fooladi MI, Khalili Pour E. Automated diagnosis of plus disease in retinopathy of prematurity using quantification of vessels characteristics. Sci Rep 2024; 14:6375. [PMID: 38493272 PMCID: PMC10944526 DOI: 10.1038/s41598-024-57072-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Accepted: 03/14/2024] [Indexed: 03/18/2024] Open
Abstract
The condition known as Plus disease is distinguished by atypical alterations in the retinal vasculature of neonates born prematurely. It has been demonstrated that the diagnosis of Plus disease is subjective and qualitative in nature. The utilization of quantitative methods and computer-based image analysis to enhance the objectivity of Plus disease diagnosis has been extensively established in the literature. This study presents the development of a computer-based image analysis method aimed at automatically distinguishing Plus images from non-Plus images. The proposed methodology conducts a quantitative analysis of the vascular characteristics linked to Plus disease, thereby aiding physicians in making informed judgments. A collection of 76 posterior retinal images from a diverse group of infants who underwent screening for Retinopathy of Prematurity (ROP) was obtained. A reference standard diagnosis was established as the majority of the labeling performed by three experts in ROP during two separate sessions. The process of segmenting retinal vessels was carried out using a semi-automatic methodology. Computer algorithms were developed to compute the tortuosity, dilation, and density of vessels in various retinal regions as potential discriminative characteristics. A classifier was provided with a set of selected features in order to distinguish between Plus images and non-Plus images. This study included 76 infants (49 [64.5%] boys) with mean birth weight of 1305 ± 427 g and mean gestational age of 29.3 ± 3 weeks. The average level of agreement among experts for the diagnosis of plus disease was found to be 79% with a standard deviation of 5.3%. In terms of intra-expert agreement, the average was 85% with a standard deviation of 3%. Furthermore, the average tortuosity of the five most tortuous vessels was significantly higher in Plus images compared to non-Plus images (p ≤ 0.0001). The curvature values based on points were found to be significantly higher in Plus images compared to non-Plus images (p ≤ 0.0001). The maximum diameter of vessels within a region extending 5-disc diameters away from the border of the optic disc (referred to as 5DD) exhibited a statistically significant increase in Plus images compared to non-Plus images (p ≤ 0.0001). The density of vessels in Plus images was found to be significantly higher compared to non-Plus images (p ≤ 0.0001). The classifier's accuracy in distinguishing between Plus and non-Plus images, as determined through tenfold cross-validation, was found to be 0.86 ± 0.01. This accuracy was observed to be higher than the diagnostic accuracy of one out of three experts when compared to the reference standard. The implemented algorithm in the current study demonstrated a commendable level of accuracy in detecting Plus disease in cases of retinopathy of prematurity, exhibiting comparable performance to that of expert diagnoses. By engaging in an objective analysis of the characteristics of vessels, there exists the possibility of conducting a quantitative assessment of the disease progression's features. The utilization of this automated system has the potential to enhance physicians' ability to diagnose Plus disease, thereby offering valuable contributions to the management of ROP through the integration of traditional ophthalmoscopy and image-based telemedicine methodologies.
Collapse
Affiliation(s)
- Sayed Mehran Sharafi
- Retinopathy of Prematurity Department, Retina Ward, Farabi Eye Hospital, Tehran University of Medical Sciences, South Kargar Street, Qazvin Square, Tehran, Iran
| | - Nazanin Ebrahimiadib
- Ophthalmology Department, College of Medicine, University of Florida, Gainesville, FL, USA
| | - Ramak Roohipourmoallai
- Department of Ophthalmology, Morsani College of Medicine, University of South Florida, Tempa, FL, USA
| | - Afsar Dastjani Farahani
- Retinopathy of Prematurity Department, Retina Ward, Farabi Eye Hospital, Tehran University of Medical Sciences, South Kargar Street, Qazvin Square, Tehran, Iran
| | - Marjan Imani Fooladi
- Clinical Pediatric Ophthalmology Department, UPMC, Children's Hospital of Pittsburgh, Pittsburgh, PA, USA
| | - Elias Khalili Pour
- Retinopathy of Prematurity Department, Retina Ward, Farabi Eye Hospital, Tehran University of Medical Sciences, South Kargar Street, Qazvin Square, Tehran, Iran.
| |
Collapse
|
14
|
Chen JS, Marra KV, Robles-Holmes HK, Ly KB, Miller J, Wei G, Aguilar E, Bucher F, Ideguchi Y, Coyner AS, Ferrara N, Campbell JP, Friedlander M, Nudleman E. Applications of Deep Learning: Automated Assessment of Vascular Tortuosity in Mouse Models of Oxygen-Induced Retinopathy. OPHTHALMOLOGY SCIENCE 2024; 4:100338. [PMID: 37869029 PMCID: PMC10585474 DOI: 10.1016/j.xops.2023.100338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 05/01/2023] [Accepted: 05/19/2023] [Indexed: 10/24/2023]
Abstract
Objective To develop a generative adversarial network (GAN) to segment major blood vessels from retinal flat-mount images from oxygen-induced retinopathy (OIR) and demonstrate the utility of these GAN-generated vessel segmentations in quantifying vascular tortuosity. Design Development and validation of GAN. Subjects Three datasets containing 1084, 50, and 20 flat-mount mice retina images with various stains used and ages at sacrifice acquired from previously published manuscripts. Methods Four graders manually segmented major blood vessels from flat-mount images of retinas from OIR mice. Pix2Pix, a high-resolution GAN, was trained on 984 pairs of raw flat-mount images and manual vessel segmentations and then tested on 100 and 50 image pairs from a held-out and external test set, respectively. GAN-generated and manual vessel segmentations were then used as an input into a previously published algorithm (iROP-Assist) to generate a vascular cumulative tortuosity index (CTI) for 20 image pairs containing mouse eyes treated with aflibercept versus control. Main Outcome Measures Mean dice coefficients were used to compare segmentation accuracy between the GAN-generated and manually annotated segmentation maps. For the image pairs treated with aflibercept versus control, mean CTIs were also calculated for both GAN-generated and manual vessel maps. Statistical significance was evaluated using Wilcoxon signed-rank tests (P ≤ 0.05 threshold for significance). Results The dice coefficient for the GAN-generated versus manual vessel segmentations was 0.75 ± 0.27 and 0.77 ± 0.17 for the held-out test set and external test set, respectively. The mean CTI generated from the GAN-generated and manual vessel segmentations was 1.12 ± 0.07 versus 1.03 ± 0.02 (P = 0.003) and 1.06 ± 0.04 versus 1.01 ± 0.01 (P < 0.001), respectively, for eyes treated with aflibercept versus control, demonstrating that vascular tortuosity was rescued by aflibercept when quantified by GAN-generated and manual vessel segmentations. Conclusions GANs can be used to accurately generate vessel map segmentations from flat-mount images. These vessel maps may be used to evaluate novel metrics of vascular tortuosity in OIR, such as CTI, and have the potential to accelerate research in treatments for ischemic retinopathies. Financial Disclosures The author(s) have no proprietary or commercial interest in any materials discussed in this article.
Collapse
Affiliation(s)
- Jimmy S. Chen
- Shiley Eye Institute, Viterbi Family Department of Ophthalmology, University of California San Diego, San Diego, California
| | - Kyle V. Marra
- Molecular Medicine, the Scripps Research Institute, San Diego, California
- School of Medicine, University of California San Diego, San Diego, California
| | - Hailey K. Robles-Holmes
- Shiley Eye Institute, Viterbi Family Department of Ophthalmology, University of California San Diego, San Diego, California
| | - Kristine B. Ly
- College of Optometry, Pacific University, Forest Grove, Oregon
| | - Joseph Miller
- Shiley Eye Institute, Viterbi Family Department of Ophthalmology, University of California San Diego, San Diego, California
| | - Guoqin Wei
- Molecular Medicine, the Scripps Research Institute, San Diego, California
| | - Edith Aguilar
- Molecular Medicine, the Scripps Research Institute, San Diego, California
| | - Felicitas Bucher
- Eye Center, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Yoichi Ideguchi
- Molecular Medicine, the Scripps Research Institute, San Diego, California
| | - Aaron S. Coyner
- Casey Eye Institute, Department of Ophthalmology, Oregon Health & Science University, Portland, Oregon
| | - Napoleone Ferrara
- Shiley Eye Institute, Viterbi Family Department of Ophthalmology, University of California San Diego, San Diego, California
| | - J. Peter Campbell
- Casey Eye Institute, Department of Ophthalmology, Oregon Health & Science University, Portland, Oregon
| | - Martin Friedlander
- Molecular Medicine, the Scripps Research Institute, San Diego, California
| | - Eric Nudleman
- Shiley Eye Institute, Viterbi Family Department of Ophthalmology, University of California San Diego, San Diego, California
| |
Collapse
|
15
|
Keles E, Bagci U. The past, current, and future of neonatal intensive care units with artificial intelligence: a systematic review. NPJ Digit Med 2023; 6:220. [PMID: 38012349 PMCID: PMC10682088 DOI: 10.1038/s41746-023-00941-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 10/05/2023] [Indexed: 11/29/2023] Open
Abstract
Machine learning and deep learning are two subsets of artificial intelligence that involve teaching computers to learn and make decisions from any sort of data. Most recent developments in artificial intelligence are coming from deep learning, which has proven revolutionary in almost all fields, from computer vision to health sciences. The effects of deep learning in medicine have changed the conventional ways of clinical application significantly. Although some sub-fields of medicine, such as pediatrics, have been relatively slow in receiving the critical benefits of deep learning, related research in pediatrics has started to accumulate to a significant level, too. Hence, in this paper, we review recently developed machine learning and deep learning-based solutions for neonatology applications. We systematically evaluate the roles of both classical machine learning and deep learning in neonatology applications, define the methodologies, including algorithmic developments, and describe the remaining challenges in the assessment of neonatal diseases by using PRISMA 2020 guidelines. To date, the primary areas of focus in neonatology regarding AI applications have included survival analysis, neuroimaging, analysis of vital parameters and biosignals, and retinopathy of prematurity diagnosis. We have categorically summarized 106 research articles from 1996 to 2022 and discussed their pros and cons, respectively. In this systematic review, we aimed to further enhance the comprehensiveness of the study. We also discuss possible directions for new AI models and the future of neonatology with the rising power of AI, suggesting roadmaps for the integration of AI into neonatal intensive care units.
Collapse
Affiliation(s)
- Elif Keles
- Northwestern University, Feinberg School of Medicine, Department of Radiology, Chicago, IL, USA.
| | - Ulas Bagci
- Northwestern University, Feinberg School of Medicine, Department of Radiology, Chicago, IL, USA
- Northwestern University, Department of Biomedical Engineering, Chicago, IL, USA
- Department of Electrical and Computer Engineering, Chicago, IL, USA
| |
Collapse
|
16
|
Hoyek S, Cruz NFSD, Patel NA, Al-Khersan H, Fan KC, Berrocal AM. Identification of novel biomarkers for retinopathy of prematurity in preterm infants by use of innovative technologies and artificial intelligence. Prog Retin Eye Res 2023; 97:101208. [PMID: 37611892 DOI: 10.1016/j.preteyeres.2023.101208] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 08/16/2023] [Accepted: 08/18/2023] [Indexed: 08/25/2023]
Abstract
Retinopathy of prematurity (ROP) is a leading cause of preventable vision loss in preterm infants. While appropriate screening is crucial for early identification and treatment of ROP, current screening guidelines remain limited by inter-examiner variability in screening modalities, absence of local protocol for ROP screening in some settings, a paucity of resources and an increased survival of younger and smaller infants. This review summarizes the advancements and challenges of current innovative technologies, artificial intelligence (AI), and predictive biomarkers for the diagnosis and management of ROP. We provide a contemporary overview of AI-based models for detection of ROP, its severity, progression, and response to treatment. To address the transition from experimental settings to real-world clinical practice, challenges to the clinical implementation of AI for ROP are reviewed and potential solutions are proposed. The use of optical coherence tomography (OCT) and OCT angiography (OCTA) technology is also explored, providing evaluation of subclinical ROP characteristics that are often imperceptible on fundus examination. Furthermore, we explore several potential biomarkers to reduce the need for invasive procedures, to enhance diagnostic accuracy and treatment efficacy. Finally, we emphasize the need of a symbiotic integration of biologic and imaging biomarkers and AI in ROP screening, where the robustness of biomarkers in early disease detection is complemented by the predictive precision of AI algorithms.
Collapse
Affiliation(s)
- Sandra Hoyek
- Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA
| | - Natasha F S da Cruz
- Bascom Palmer Eye Institute, University of Miami Leonard M. Miller School of Medicine, Miami, FL, USA
| | - Nimesh A Patel
- Department of Ophthalmology, Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, USA
| | - Hasenin Al-Khersan
- Bascom Palmer Eye Institute, University of Miami Leonard M. Miller School of Medicine, Miami, FL, USA
| | - Kenneth C Fan
- Bascom Palmer Eye Institute, University of Miami Leonard M. Miller School of Medicine, Miami, FL, USA
| | - Audina M Berrocal
- Bascom Palmer Eye Institute, University of Miami Leonard M. Miller School of Medicine, Miami, FL, USA.
| |
Collapse
|
17
|
Patel SN, Al-Khaled T, Kang KB, Jonas KE, Ostmo S, Ventura CV, Martinez-Castellanos MA, Anzures RGAS, Campbell JP, Chiang MF, Chan RVP. Characterization of Errors in Retinopathy of Prematurity Diagnosis by Ophthalmologists-in-Training in Middle-Income Countries. J Pediatr Ophthalmol Strabismus 2023; 60:344-352. [PMID: 36263934 DOI: 10.3928/01913913-20220609-02] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
PURPOSE To characterize common errors in the diagnosis of retinopathy of prematurity (ROP) among ophthalmologistsin-training in middle-income countries. METHODS In this prospective cohort study, 200 ophthalmologists-in-training from programs in Brazil, Mexico, and the Philippines participated. A secure web-based educational system was developed using a repository of more than 2,500 unique image sets of ROP, and a reference standard diagnosis was established by combining the clinical diagnosis and the image-based diagnosis by multiple experts. Twenty web-based cases of wide-field retinal images were presented, and ophthalmologists-in-training were asked to diagnose plus disease, zone, stage, and category for each eye. Trainees' responses were compared to the consensus reference standard diagnosis. Main outcome measures were frequency and types of diagnostic errors were analyzed. RESULTS The error rate in the diagnosis of any category of ROP was between 48% and 59% for all countries. The error rate in identifying type 2 or pre-plus disease was 77%, with a tendency for overdiagnosis (27% underdiagnosis vs 50% overdiagnosis; mean difference: 23.4; 95% CI: 12.1 to 34.7; P = .005). Misdiagnosis of treatment-requiring ROP as type 2 ROP was most commonly associated with incorrectly identifying plus disease (plus disease error rate = 18% with correct category diagnosis vs 69% when misdiagnosed; mean difference: 51.0; 95% CI: 49.3 to 52.7; P = .003). CONCLUSIONS Ophthalmologists-in-training from middle-income countries misdiagnosed ROP more than half of the time. Identification of plus disease was the salient factor leading to incorrect diagnosis. These findings emphasize the need for improved access to ROP education to improve competency in diagnosis among ophthalmologists-in-training in middle-income countries. [J Pediatr Ophthalmol Strabismus. 2023;60(5):344-352.].
Collapse
|
18
|
Al-Khaled T, Patel SN, Valikodath NG, Jonas KE, Ostmo S, Allozi R, Hallak J, Campbell JP, Chiang MF, Chan RVP. Characterization of Errors in Retinopathy of Prematurity Diagnosis by Ophthalmologists-in-Training in the United States and Canada. J Pediatr Ophthalmol Strabismus 2023; 60:337-343. [PMID: 36263935 DOI: 10.3928/01913913-20220609-01] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
PURPOSE To identify the prominent factors that lead to misdiagnosis of retinopathy of prematurity (ROP) by ophthalmologists-in-training in the United States and Canada. METHODS This prospective cohort study included 32 ophthalmologists-in-training at six ophthalmology training programs in the United States and Canada. Twenty web-based cases of ROP using wide-field retinal images were presented, and ophthalmologists-in-training were asked to diagnose plus disease, zone, stage, and category for each eye. Responses were compared to a consensus reference standard diagnosis for accuracy, which was established by combining the clinical diagnosis and the image-based diagnosis by multiple experts. The types of diagnostic errors that occurred were analyzed with descriptive and chi-squared analysis. Main outcome measures were frequency of types (category, zone, stage, plus disease) of diagnostic errors; association of errors in zone, stage, and plus disease diagnosis with incorrectly identified category; and performance of ophthalmologists-in-training across postgraduate years. RESULTS Category of ROP was misdiagnosed at a rate of 48%. Errors in classification of plus disease were most commonly associated with misdiagnosis of treatment-requiring (plus error rate = 16% when treatment-requiring was correctly diagnosed vs 81% when underdiagnosed as type 2 or pre-plus; mean difference: 64.3; 95% CI: 51.9 to 76.7; P < .001) and type 2 or pre-plus (plus error rate = 35% when type 2 or pre-plus was correctly diagnosed vs 76% when overdiagnosed as treatment-requiring; mean difference: 41.0; 95% CI: 28.4 to 53.5; P < .001) disease. The diagnostic error rate of postgraduate year (PGY)-2 trainees was significantly higher than PGY-3 trainees (PGY-2 category error rate = 61% vs PGY-3 = 35%; mean difference, 25.4; 95% CI: 17.7 to 33.0; P < .001). CONCLUSIONS Ophthalmologists-in-training in the United States and Canada misdiagnosed ROP nearly half of the time, with incorrect identification of plus disease as a leading cause. Integration of structured learning for ROP in residency education may improve diagnostic competency. [J Pediatr Ophthalmol Strabismus. 2023;60(5):337-343.].
Collapse
|
19
|
Liu S, Zhao H, Huang L, Ma C, Wang Q, Liu L. Vascular features around the optic disc in familial exudative vitreoretinopathy: findings and their relationship to disease severity. BMC Ophthalmol 2023; 23:139. [PMID: 37020201 PMCID: PMC10074868 DOI: 10.1186/s12886-023-02884-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 03/24/2023] [Indexed: 04/07/2023] Open
Abstract
BACKGROUND Familial exudative vitreoretinopathy (FEVR) is a rare congenital disorder of retinal vascular development. We aimed to study the vascular characteristics around the optic disc in neonates with FEVR and the relationship with disease severity. METHODS A retrospective, case-control study including 43 (58 eyes) newborn patients with FEVR at stages 1 to 3 and 30 (53 eyes) age-matched normal full-term newborns was conducted. The peripapillary vessel tortuosity (VT), vessel width (VW) and vessel density (VD) were quantified by computer technology. The t-distributed stochastic neighbor embedding (t-SNE) algorithm was used to visualize the relationship between the severity of FEVR and the characteristics of perioptic disc vascular parameters. RESULTS The peripapillary VT, VW and VD were significantly increased in the FEVR group compared with the control group (P < 0.05). Subgroup analysis showed that VW and VD increased significantly with progressing FEVR stage (P < 0.05). And only VT in stage 3 FEVR was significantly increased compared with stage 1 and stage 2 (P < 0.05). After controlling the confounders, ordinal logistic regression analysis indicated that the VW (aOR: 1.75, P = 0.0002) and VD (aOR: 2.41, P = 0.0170) were significantly independent correlated with the FEVR stage, but VT (aOR: 1.07, P = 0.5454) was not correlated with FEVR staging. Visual analysis based on the t-SNE algorithm showed that peri-optic disc vascular parameters had a continuity along the direction of FEVR severity. CONCLUSIONS In the neonatal population, there were significant differences in peripapillary vascular parameters between patients with FEVR and normal subjects. Quantitative measurement of vascular parameters around the optic disc can be used as one of the indicators to assess the severity of FEVR.
Collapse
Affiliation(s)
- Shuai Liu
- Anhui Province Maternity and Child Health Hospital, Maternity and Child Health Hospital affiliated to Anhui Medical University, Hefei, 230001, China
| | - Hongwei Zhao
- School of Information Science and Technology, University of Science and Technology of China, Hefei, 230022, Anhui, China
| | - Liuhui Huang
- Department of Ophthalmology, Tenth People's Hospital, Shanghai Tongji University School of Medicine, Shanghai, 200072, China
| | - Cuixia Ma
- Anhui Province Maternity and Child Health Hospital, Maternity and Child Health Hospital affiliated to Anhui Medical University, Hefei, 230001, China
| | - Qiong Wang
- Anhui Province Maternity and Child Health Hospital, Maternity and Child Health Hospital affiliated to Anhui Medical University, Hefei, 230001, China
| | - Lei Liu
- School of Information Science and Technology, University of Science and Technology of China, Hefei, 230022, Anhui, China.
| |
Collapse
|
20
|
Wu CT, Lin TY, Lin CJ, Hwang DK. The future application of artificial intelligence and telemedicine in the retina: A perspective. Taiwan J Ophthalmol 2023; 13:133-141. [PMID: 37484624 PMCID: PMC10361422 DOI: 10.4103/tjo.tjo-d-23-00028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Accepted: 04/02/2023] [Indexed: 07/25/2023] Open
Abstract
The development of artificial intelligence (AI) and deep learning provided precise image recognition and classification in the medical field. Ophthalmology is an exceptional department to translate AI applications since noninvasive imaging is routinely used for the diagnosis and monitoring. In recent years, AI-based image interpretation of optical coherence tomography and fundus photograph in retinal diseases has been extended to diabetic retinopathy, age-related macular degeneration, and retinopathy of prematurity. The rapid development of portable ocular monitoring devices coupled with AI-informed interpretations allows possible home monitoring or remote monitoring of retinal diseases and patients to gain autonomy and responsibility for their conditions. This review discusses the current research and application of AI, telemedicine, and home monitoring devices on retinal disease. Furthermore, we propose a future model of how AI and digital technology could be implemented in retinal diseases.
Collapse
Affiliation(s)
- Chu-Ting Wu
- Department of Medical Education, Taipei Veterans General Hospital, Taipei, Taiwan
- Department of Medicine, School of Medicine, Tzu Chi University, Hualien, Taiwan
| | - Ting-Yi Lin
- Doctoral Degree Program of Translational Medicine, National Yang Ming Chiao Tung University and Academia Sinica, Taipei, Taiwan
| | - Cheng-Jun Lin
- Department of Biological Science and Technology, Institute of Biological Science and Technology, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
- Institute of Population Health Sciences, National Health Research Institutes, Zhunan, Miaoli County, Taiwan
| | - De-Kuang Hwang
- Department of Ophthalmology, Taipei Veterans General Hospital, Taipei, Taiwan
- Department of Medicine, School of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| |
Collapse
|
21
|
GabROP: Gabor Wavelets-Based CAD for Retinopathy of Prematurity Diagnosis via Convolutional Neural Networks. Diagnostics (Basel) 2023; 13:diagnostics13020171. [PMID: 36672981 PMCID: PMC9857608 DOI: 10.3390/diagnostics13020171] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Revised: 12/12/2022] [Accepted: 12/19/2022] [Indexed: 01/05/2023] Open
Abstract
One of the most serious and dangerous ocular problems in premature infants is retinopathy of prematurity (ROP), a proliferative vascular disease. Ophthalmologists can use automatic computer-assisted diagnostic (CAD) tools to help them make a safe, accurate, and low-cost diagnosis of ROP. All previous CAD tools for ROP diagnosis use the original fundus images. Unfortunately, learning the discriminative representation from ROP-related fundus images is difficult. Textural analysis techniques, such as Gabor wavelets (GW), can demonstrate significant texture information that can help artificial intelligence (AI) based models to improve diagnostic accuracy. In this paper, an effective and automated CAD tool, namely GabROP, based on GW and multiple deep learning (DL) models is proposed. Initially, GabROP analyzes fundus images using GW and generates several sets of GW images. Next, these sets of images are used to train three convolutional neural networks (CNNs) models independently. Additionally, the actual fundus pictures are used to build these networks. Using the discrete wavelet transform (DWT), texture features retrieved from every CNN trained with various sets of GW images are combined to create a textural-spectral-temporal demonstration. Afterward, for each CNN, these features are concatenated with spatial deep features obtained from the original fundus images. Finally, the previous concatenated features of all three CNN are incorporated using the discrete cosine transform (DCT) to lessen the size of features caused by the fusion process. The outcomes of GabROP show that it is accurate and efficient for ophthalmologists. Additionally, the effectiveness of GabROP is compared to recently developed ROP diagnostic techniques. Due to GabROP's superior performance compared to competing tools, ophthalmologists may be able to identify ROP more reliably and precisely, which could result in a reduction in diagnostic effort and examination time.
Collapse
|
22
|
Eilts SK, Pfeil JM, Poschkamp B, Krohne TU, Eter N, Barth T, Guthoff R, Lagrèze W, Grundel M, Bründer MC, Busch M, Kalpathy-Cramer J, Chiang MF, Chan RVP, Coyner AS, Ostmo S, Campbell JP, Stahl A. Assessment of Retinopathy of Prematurity Regression and Reactivation Using an Artificial Intelligence-Based Vascular Severity Score. JAMA Netw Open 2023; 6:e2251512. [PMID: 36656578 PMCID: PMC9857423 DOI: 10.1001/jamanetworkopen.2022.51512] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/20/2023] Open
Abstract
IMPORTANCE One of the biggest challenges when using anti-vascular endothelial growth factor (VEGF) agents to treat retinopathy of prematurity (ROP) is the need to perform long-term follow-up examinations to identify eyes at risk of ROP reactivation requiring retreatment. OBJECTIVE To evaluate whether an artificial intelligence (AI)-based vascular severity score (VSS) can be used to analyze ROP regression and reactivation after anti-VEGF treatment and potentially identify eyes at risk of ROP reactivation requiring retreatment. DESIGN, SETTING, AND PARTICIPANTS This prognostic study was a secondary analysis of posterior pole fundus images collected during the multicenter, double-blind, investigator-initiated Comparing Alternative Ranibizumab Dosages for Safety and Efficacy in Retinopathy of Prematurity (CARE-ROP) randomized clinical trial, which compared 2 different doses of ranibizumab (0.12 mg vs 0.20 mg) for the treatment of ROP. The CARE-ROP trial screened and enrolled infants between September 5, 2014, and July 14, 2016. A total of 1046 wide-angle fundus images obtained from 19 infants at predefined study time points were analyzed. The analyses of VSS were performed between January 20, 2021, and November 18, 2022. INTERVENTIONS An AI-based algorithm assigned a VSS between 1 (normal) and 9 (most severe) to fundus images. MAIN OUTCOMES AND MEASURES Analysis of VSS in infants with ROP over time and VSS comparisons between the 2 treatment groups (0.12 mg vs 0.20 mg of ranibizumab) and between infants who did and did not receive retreatment for ROP reactivation. RESULTS Among 19 infants with ROP in the CARE-ROP randomized clinical trial, the median (range) postmenstrual age at first treatment was 36.4 (34.7-39.7) weeks; 10 infants (52.6%) were male, and 18 (94.7%) were White. The mean (SD) VSS was 6.7 (1.9) at baseline and significantly decreased to 2.7 (1.9) at week 1 (P < .001) and 2.9 (1.3) at week 4 (P < .001). The mean (SD) VSS of infants with ROP reactivation requiring retreatment was 6.5 (1.9) at the time of retreatment, which was significantly higher than the VSS at week 4 (P < .001). No significant difference was found in VSS between the 2 treatment groups, but the change in VSS between baseline and week 1 was higher for infants who later required retreatment (mean [SD], 7.8 [1.3] at baseline vs 1.7 [0.7] at week 1) vs infants who did not (mean [SD], 6.4 [1.9] at baseline vs 3.0 [2.0] at week 1). In eyes requiring retreatment, higher baseline VSS was correlated with earlier time of retreatment (Pearson r = -0.9997; P < .001). CONCLUSIONS AND RELEVANCE In this study, VSS decreased after ranibizumab treatment, consistent with clinical disease regression. In cases of ROP reactivation requiring retreatment, VSS increased again to values comparable with baseline values. In addition, a greater change in VSS during the first week after initial treatment was found to be associated with a higher risk of later ROP reactivation, and high baseline VSS was correlated with earlier retreatment. These findings may have implications for monitoring ROP regression and reactivation after anti-VEGF treatment.
Collapse
Affiliation(s)
- Sonja K. Eilts
- Department of Ophthalmology, University Medicine Greifswald, Greifswald, Germany
| | - Johanna M. Pfeil
- Department of Ophthalmology, University Medicine Greifswald, Greifswald, Germany
| | - Broder Poschkamp
- Department of Ophthalmology, University Medicine Greifswald, Greifswald, Germany
| | - Tim U. Krohne
- Department of Ophthalmology, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Nicole Eter
- Department of Ophthalmology, University of Muenster Medical Center, Muenster, Germany
| | - Teresa Barth
- Department of Ophthalmology, University of Regensburg, Regensburg, Germany
| | - Rainer Guthoff
- Department of Ophthalmology, Faculty of Medicine, University of Düsseldorf, Düsseldorf, Germany
| | - Wolf Lagrèze
- Eye Center, Medical Center, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Milena Grundel
- Department of Ophthalmology, University Medicine Greifswald, Greifswald, Germany
| | | | - Martin Busch
- Department of Ophthalmology, University Medicine Greifswald, Greifswald, Germany
| | - Jayashree Kalpathy-Cramer
- Center for Clinical Data Science, Massachusetts General Hospital, Brigham and Women’s Hospital, Boston
| | - Michael F. Chiang
- National Eye Institute, National Institutes of Health, Bethesda, Maryland
- National Library of Medicine, National Institutes of Health, Bethesda, Maryland
| | - R. V. Paul Chan
- Department of Ophthalmology, University of Illinois Chicago, Chicago
| | - Aaron S. Coyner
- Casey Eye Institute, Oregon Health & Science University, Portland
| | - Susan Ostmo
- Casey Eye Institute, Oregon Health & Science University, Portland
| | | | - Andreas Stahl
- Department of Ophthalmology, University Medicine Greifswald, Greifswald, Germany
| |
Collapse
|
23
|
Trifanenkova IG, Tereshchenko AV, Erokhina EV. The state of ocular arterial blood flow in active retinopathy of prematurity. RUSSIAN OPHTHALMOLOGICAL JOURNAL 2022. [DOI: 10.21516/2072-0076-2022-15-4-95-101] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Purpose: to study the state of blood flow in the ocular arteries of patients with various forms, stages and course types of active retinopathy of prematurity (ROP). Material and methods. Colour duplex scanning was performed by colour Doppler mapping and pulsed Doppler sonography for 55 premature babies (55 eyes) with active ROP and 8 premature babies (8 eyes) without ROP signs. The children’s gestation age was 25 to 32 weeks, and the body weight at birth was 680 to1760 g. Blood flow was examined in the ophthalmic artery (OA), the central retinal artery (CRA) and the medial and lateral posterior short ciliary arteries (PSCA). Results. The ophthalmic artery revealed no significant differences between the children with ROP and without ROP, except for a significant increase in the peak systolic velocity (Vsyst) in an unfavorable course of stage III of ROP. The development of aggressive posterior ROP is accompanied by a statistically insignificant decrease in blood flow velocity of OA. Hemodynamic parameters of CRA indicate an increase in peripheral vascular resistance in children with an unfavorable course of ROP. A significant increase of Vsyst in the posterior short ciliary arteries was revealed in children with an unfavorable course of stages I–III of ROP and Vsyst, and Vdiast (diastolic blood flow velocity) in children with aggressive posterior ROP as compared with children without ROP. A pronounced impact of the ROP course (favorable or unfavorable) on the Vsyst, Vdiast, and PI indicators in the posterior short ciliary arteries was revealed. The most informative hemodynamic parameters in predicting the course of active ROP are Vsyst and Vdiast values in the ophthalmic artery and Vsyst in the posterior short ciliary arteries. The least informative were the hemodynamic parameters of the central retinal artery. Conclusion. The assessment of hemodynamic changes in eye arteries may be used as an additional diagnostic criterion in the early diagnosis of ROP.
Collapse
Affiliation(s)
| | | | - E. V. Erokhina
- Kaluga Branch, S.N. Fedorov NMRC MNTK “Eye microsurgery”
| |
Collapse
|
24
|
Martins TGDS, Schor P, Mendes LGA, Fowler S, Silva R. Use of artificial intelligence in ophthalmology: a narrative review. SAO PAULO MED J 2022; 140:837-845. [PMID: 36043665 PMCID: PMC9671570 DOI: 10.1590/1516-3180.2021.0713.r1.22022022] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/04/2021] [Accepted: 02/22/2022] [Indexed: 11/06/2022] Open
Abstract
BACKGROUND Artificial intelligence (AI) deals with development of algorithms that seek to perceive one's environment and perform actions that maximize one's chance of successfully reaching one's predetermined goals. OBJECTIVE To provide an overview of the basic principles of AI and its main studies in the fields of glaucoma, retinopathy of prematurity, age-related macular degeneration and diabetic retinopathy. From this perspective, the limitations and potential challenges that have accompanied the implementation and development of this new technology within ophthalmology are presented. DESIGN AND SETTING Narrative review developed by a research group at the Universidade Federal de São Paulo (UNIFESP), São Paulo (SP), Brazil. METHODS We searched the literature on the main applications of AI within ophthalmology, using the keywords "artificial intelligence", "diabetic retinopathy", "macular degeneration age-related", "glaucoma" and "retinopathy of prematurity," covering the period from January 1, 2007, to May 3, 2021. We used the MEDLINE database (via PubMed) and the LILACS database (via Virtual Health Library) to identify relevant articles. RESULTS We retrieved 457 references, of which 47 were considered eligible for intensive review and critical analysis. CONCLUSION Use of technology, as embodied in AI algorithms, is a way of providing an increasingly accurate service and enhancing scientific research. This forms a source of complement and innovation in relation to the daily skills of ophthalmologists. Thus, AI adds technology to human expertise.
Collapse
Affiliation(s)
- Thiago Gonçalves dos Santos Martins
- MD, PhD. Researcher, Department of Ophthalmology, Universidade Federal de São Paulo (UNIFESP), São Paulo (SP), Brazil; Research Fellow, Department of Ophthalmology, Ludwig Maximilians University (LMU), Munich, Germany; and Doctoral Student, University of Coimbra (UC), Coimbra, Portugal
| | - Paulo Schor
- PhD. Professor, Department of Ophthalmology, Universidade Federal de São Paulo (UNIFESP), São Paulo (SP), Brazil
| | | | - Susan Fowler
- RN, PhD. Certified Neuroscience Registered Nurse (CNRN) and Research Fellow of American Heart Association, Department of Ophthalmology, Orlando Health, Orlando, United States; Researcher, Department of Ophthalmology, Walden University, Minneapolis (MN), United States; and Researcher, Department of Ophthalmology, Thomas Edison State University (TESU), Trenton (NJ), United States
| | - Rufino Silva
- MD, PhD. Fellow of the European Board of Ophthalmology and Professor, Coimbra Institute for Clinical and Biomedical Research (iCBR), Faculty of Medicine, University of Coimbra, Coimbra, Portugal; Fellow, Department of Ophthalmology, Centro Hospitalar e Universitário de Coimbra (CHUC), Coimbra, Portugal; and Researcher, Association for Innovation and Biomedical Research on Light and Image (AIBILI), Coimbra, Portugal
| |
Collapse
|
25
|
Tan Z, Isaacs M, Zhu Z, Simkin S, He M, Dai S. Retinopathy of prematurity screening: A narrative review of current programs, teleophthalmology, and diagnostic support systems. Saudi J Ophthalmol 2022; 36:283-295. [PMID: 36276257 PMCID: PMC9583350 DOI: 10.4103/sjopt.sjopt_220_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Revised: 10/04/2021] [Accepted: 11/12/2021] [Indexed: 01/24/2023] Open
Abstract
PURPOSE Neonatal care in middle-income countries has improved over the last decade, leading to a "third epidemic" of retinopathy of prematurity (ROP). Without concomitant improvements in ROP screening infrastructure, reduction of ROP-associated visual loss remains a challenge worldwide. The emergence of teleophthalmology screening programs and artificial intelligence (AI) technologies represents promising methods to address this growing unmet demand in ROP screening. An improved understanding of current ROP screening programs may inform the adoption of these novel technologies in ROP care. METHODS A critical narrative review of the literature was carried out. Publications that were representative of established or emerging ROP screening programs in high-, middle-, and low-income countries were selected for review. Screening programs were reviewed for inclusion criteria, screening frequency and duration, modality, and published sensitivity and specificity. RESULTS Screening inclusion criteria, including age and birth weight cutoffs, showed significant heterogeneity globally. Countries of similar income tend to have similar criteria. Three primary screening modalities including binocular indirect ophthalmoscopy (BIO), wide-field digital retinal imaging (WFDRI), and teleophthalmology were identified and reviewed. BIO has documented limitations in reduced interoperator agreement, scalability, and geographical access barriers, which are mitigated in part by WFDRI. Teleophthalmology screening may address limitations in ROP screening workforce distribution and training. Opportunities for AI technologies were identified in the context of these limitations, including interoperator reliability and possibilities for point-of-care diagnosis. CONCLUSION Limitations in the current ROP screening include scalability, geographical access, and high screening burden with low treatment yield. These may be addressable through increased adoption of teleophthalmology and AI technologies. As the global incidence of ROP continues to increase, implementation of these novel modalities requires greater consideration.
Collapse
Affiliation(s)
- Zachary Tan
- Centre for Eye Research Australia, University of Melbourne, Melbourne, Brisbane, Australia,Department of Clinical Medicine, Faculty of Medicine, University of Queensland, Brisbane, Australia
| | - Michael Isaacs
- Department of Clinical Medicine, Faculty of Medicine, University of Queensland, Brisbane, Australia,Department of Ophthalmology, Queensland Children's Hospital, Brisbane, Australia
| | - Zhuoting Zhu
- Centre for Eye Research Australia, University of Melbourne, Melbourne, Brisbane, Australia
| | - Samantha Simkin
- Department of Ophthalmology, The University of Auckland, Auckland, New Zealand
| | - Mingguang He
- Centre for Eye Research Australia, University of Melbourne, Melbourne, Brisbane, Australia
| | - Shuan Dai
- Department of Clinical Medicine, Faculty of Medicine, University of Queensland, Brisbane, Australia,Department of Ophthalmology, Queensland Children's Hospital, Brisbane, Australia,Address for correspondence: Dr. Shuan Dai, Assoc. Prof. Shuan Dai, Faculty of Medicine, The University of Queensland, Brisbane, Australia. E-mail:
| |
Collapse
|
26
|
Ferro Desideri L, Rutigliani C, Corazza P, Nastasi A, Roda M, Nicolo M, Traverso CE, Vagge A. The upcoming role of Artificial Intelligence (AI) for retinal and glaucomatous diseases. JOURNAL OF OPTOMETRY 2022; 15 Suppl 1:S50-S57. [PMID: 36216736 PMCID: PMC9732476 DOI: 10.1016/j.optom.2022.08.001] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Revised: 08/14/2022] [Accepted: 08/16/2022] [Indexed: 06/16/2023]
Abstract
In recent years, the role of artificial intelligence (AI) and deep learning (DL) models is attracting increasing global interest in the field of ophthalmology. DL models are considered the current state-of-art among the AI technologies. In fact, DL systems have the capability to recognize, quantify and describe pathological clinical features. Their role is currently being investigated for the early diagnosis and management of several retinal diseases and glaucoma. The application of DL models to fundus photographs, visual fields and optical coherence tomography (OCT) imaging has provided promising results in the early detection of diabetic retinopathy (DR), wet age-related macular degeneration (w-AMD), retinopathy of prematurity (ROP) and glaucoma. In this review we analyze the current evidence of AI applied to these ocular diseases, as well as discuss the possible future developments and potential clinical implications, without neglecting the present limitations and challenges in order to adopt AI and DL models as powerful tools in the everyday routine clinical practice.
Collapse
Affiliation(s)
- Lorenzo Ferro Desideri
- University Eye Clinic of Genoa, IRCCS Ospedale Policlinico San Martino, Genoa, Italy; Department of Neurosciences, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DiNOGMI), University of Genoa, Italy.
| | | | - Paolo Corazza
- University Eye Clinic of Genoa, IRCCS Ospedale Policlinico San Martino, Genoa, Italy; Department of Neurosciences, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DiNOGMI), University of Genoa, Italy
| | | | - Matilde Roda
- Ophthalmology Unit, Department of Experimental, Diagnostic and Specialty Medicine (DIMES), Alma Mater Studiorum University of Bologna and S.Orsola-Malpighi Teaching Hospital, Bologna, Italy
| | - Massimo Nicolo
- University Eye Clinic of Genoa, IRCCS Ospedale Policlinico San Martino, Genoa, Italy; Department of Neurosciences, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DiNOGMI), University of Genoa, Italy
| | - Carlo Enrico Traverso
- University Eye Clinic of Genoa, IRCCS Ospedale Policlinico San Martino, Genoa, Italy; Department of Neurosciences, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DiNOGMI), University of Genoa, Italy
| | - Aldo Vagge
- University Eye Clinic of Genoa, IRCCS Ospedale Policlinico San Martino, Genoa, Italy; Department of Neurosciences, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health (DiNOGMI), University of Genoa, Italy
| |
Collapse
|
27
|
Peng Y, Chen Z, Zhu W, Shi F, Wang M, Zhou Y, Xiang D, Chen X, Chen F. ADS-Net: attention-awareness and deep supervision based network for automatic detection of retinopathy of prematurity. BIOMEDICAL OPTICS EXPRESS 2022; 13:4087-4101. [PMID: 36032570 PMCID: PMC9408258 DOI: 10.1364/boe.461411] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/14/2022] [Revised: 06/17/2022] [Accepted: 06/21/2022] [Indexed: 06/15/2023]
Abstract
Retinopathy of prematurity (ROP) is a proliferative vascular disease, which is one of the most dangerous and severe ocular complications in premature infants. Automatic ROP detection system can assist ophthalmologists in the diagnosis of ROP, which is safe, objective, and cost-effective. Unfortunately, due to the large local redundancy and the complex global dependencies in medical image processing, it is challenging to learn the discriminative representation from ROP-related fundus images. To bridge this gap, a novel attention-awareness and deep supervision based network (ADS-Net) is proposed to detect the existence of ROP (Normal or ROP) and 3-level ROP grading (Mild, Moderate, or Severe). First, to balance the problems of large local redundancy and complex global dependencies in images, we design a multi-semantic feature aggregation (MsFA) module based on self-attention mechanism to take full advantage of convolution and self-attention, generating attention-aware expressive features. Then, to solve the challenge of difficult training of deep model and further improve ROP detection performance, we propose an optimization strategy with deeply supervised loss. Finally, the proposed ADS-Net is evaluated on ROP screening and grading tasks with per-image and per-examination strategies, respectively. In terms of per-image classification pattern, the proposed ADS-Net achieves 0.9552 and 0.9037 for Kappa index in ROP screening and grading, respectively. Experimental results demonstrate that the proposed ADS-Net generally outperforms other state-of-the-art classification networks, showing the effectiveness of the proposed method.
Collapse
Affiliation(s)
- Yuanyuan Peng
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, 215006, China
| | - Zhongyue Chen
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, 215006, China
| | - Weifang Zhu
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, 215006, China
| | - Fei Shi
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, 215006, China
| | - Meng Wang
- Institute of High Performance Computing, ASTAR, Singapore
| | - Yi Zhou
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, 215006, China
| | - Daoman Xiang
- Guangzhou Women and Children's Medical Center, Guangzhou, 510623, China
| | - Xinjian Chen
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, 215006, China
- State Key Laboratory of Radiation Medicine and Protection, Soochow University, Suzhou, 215123, China
| | - Feng Chen
- Guangzhou Women and Children's Medical Center, Guangzhou, 510623, China
| |
Collapse
|
28
|
Khan NC, Perera C, Dow ER, Chen KM, Mahajan VB, Mruthyunjaya P, Do DV, Leng T, Myung D. Predicting Systemic Health Features from Retinal Fundus Images Using Transfer-Learning-Based Artificial Intelligence Models. Diagnostics (Basel) 2022; 12:diagnostics12071714. [PMID: 35885619 PMCID: PMC9322827 DOI: 10.3390/diagnostics12071714] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2022] [Revised: 06/23/2022] [Accepted: 06/24/2022] [Indexed: 12/02/2022] Open
Abstract
While color fundus photos are used in routine clinical practice to diagnose ophthalmic conditions, evidence suggests that ocular imaging contains valuable information regarding the systemic health features of patients. These features can be identified through computer vision techniques including deep learning (DL) artificial intelligence (AI) models. We aim to construct a DL model that can predict systemic features from fundus images and to determine the optimal method of model construction for this task. Data were collected from a cohort of patients undergoing diabetic retinopathy screening between March 2020 and March 2021. Two models were created for each of 12 systemic health features based on the DenseNet201 architecture: one utilizing transfer learning with images from ImageNet and another from 35,126 fundus images. Here, 1277 fundus images were used to train the AI models. Area under the receiver operating characteristics curve (AUROC) scores were used to compare the model performance. Models utilizing the ImageNet transfer learning data were superior to those using retinal images for transfer learning (mean AUROC 0.78 vs. 0.65, p-value < 0.001). Models using ImageNet pretraining were able to predict systemic features including ethnicity (AUROC 0.93), age > 70 (AUROC 0.90), gender (AUROC 0.85), ACE inhibitor (AUROC 0.82), and ARB medication use (AUROC 0.78). We conclude that fundus images contain valuable information about the systemic characteristics of a patient. To optimize DL model performance, we recommend that even domain specific models consider using transfer learning from more generalized image sets to improve accuracy.
Collapse
Affiliation(s)
- Nergis C. Khan
- Byers Eye Institute at Stanford, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA 94305, USA; (N.C.K.); (C.P.); (E.R.D.); (K.M.C.); (V.B.M.); (P.M.); (D.V.D.); (T.L.)
| | - Chandrashan Perera
- Byers Eye Institute at Stanford, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA 94305, USA; (N.C.K.); (C.P.); (E.R.D.); (K.M.C.); (V.B.M.); (P.M.); (D.V.D.); (T.L.)
- Department of Ophthalmology, Fremantle Hospital, Perth, WA 6004, Australia
| | - Eliot R. Dow
- Byers Eye Institute at Stanford, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA 94305, USA; (N.C.K.); (C.P.); (E.R.D.); (K.M.C.); (V.B.M.); (P.M.); (D.V.D.); (T.L.)
| | - Karen M. Chen
- Byers Eye Institute at Stanford, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA 94305, USA; (N.C.K.); (C.P.); (E.R.D.); (K.M.C.); (V.B.M.); (P.M.); (D.V.D.); (T.L.)
| | - Vinit B. Mahajan
- Byers Eye Institute at Stanford, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA 94305, USA; (N.C.K.); (C.P.); (E.R.D.); (K.M.C.); (V.B.M.); (P.M.); (D.V.D.); (T.L.)
| | - Prithvi Mruthyunjaya
- Byers Eye Institute at Stanford, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA 94305, USA; (N.C.K.); (C.P.); (E.R.D.); (K.M.C.); (V.B.M.); (P.M.); (D.V.D.); (T.L.)
| | - Diana V. Do
- Byers Eye Institute at Stanford, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA 94305, USA; (N.C.K.); (C.P.); (E.R.D.); (K.M.C.); (V.B.M.); (P.M.); (D.V.D.); (T.L.)
| | - Theodore Leng
- Byers Eye Institute at Stanford, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA 94305, USA; (N.C.K.); (C.P.); (E.R.D.); (K.M.C.); (V.B.M.); (P.M.); (D.V.D.); (T.L.)
| | - David Myung
- Byers Eye Institute at Stanford, Department of Ophthalmology, Stanford University School of Medicine, Palo Alto, CA 94305, USA; (N.C.K.); (C.P.); (E.R.D.); (K.M.C.); (V.B.M.); (P.M.); (D.V.D.); (T.L.)
- VA Palo Alto Health Care System, Palo Alto, CA 94304, USA
- Correspondence: ; Tel.: +1-650-724-3948
| |
Collapse
|
29
|
Bai A, Carty C, Dai S. Performance of deep-learning artificial intelligence algorithms in detecting retinopathy of prematurity: A systematic review. SAUDI JOURNAL OF OPHTHALMOLOGY : OFFICIAL JOURNAL OF THE SAUDI OPHTHALMOLOGICAL SOCIETY 2022; 36:296-307. [PMID: 36276252 DOI: 10.4103/sjopt.sjopt_219_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Revised: 11/09/2021] [Accepted: 11/12/2021] [Indexed: 11/04/2022]
Abstract
PURPOSE Artificial intelligence (AI) offers considerable promise for retinopathy of prematurity (ROP) screening and diagnosis. The development of deep-learning algorithms to detect the presence of disease may contribute to sufficient screening, early detection, and timely treatment for this preventable blinding disease. This review aimed to systematically examine the literature in AI algorithms in detecting ROP. Specifically, we focused on the performance of deep-learning algorithms through sensitivity, specificity, and area under the receiver operating curve (AUROC) for both the detection and grade of ROP. METHODS We searched Medline OVID, PubMed, Web of Science, and Embase for studies published from January 1, 2012, to September 20, 2021. Studies evaluating the diagnostic performance of deep-learning models based on retinal fundus images with expert ophthalmologists' judgment as reference standard were included. Studies which did not investigate the presence or absence of disease were excluded. Risk of bias was assessed using the QUADAS-2 tool. RESULTS Twelve studies out of the 175 studies identified were included. Five studies measured the performance of detecting the presence of ROP and seven studies determined the presence of plus disease. The average AUROC out of 11 studies was 0.98. The average sensitivity and specificity for detecting ROP was 95.72% and 98.15%, respectively, and for detecting plus disease was 91.13% and 95.92%, respectively. CONCLUSION The diagnostic performance of deep-learning algorithms in published studies was high. Few studies presented externally validated results or compared performance to expert human graders. Large scale prospective validation alongside robust study design could improve future studies.
Collapse
Affiliation(s)
- Amelia Bai
- Department of Ophthalmology, Queensland Children's Hospital, Brisbane, Australia.,Centre for Children's Health Research, Brisbane, Australia.,School of Medical Science, Griffith University, Gold Coast, Australia
| | - Christopher Carty
- Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute Queensland, Griffith University Gold Coast, Australia.,Department of Orthopaedics, Children's Health Queensland Hospital and Health Service, Queensland Children's Hospital, Brisbane, Australia
| | - Shuan Dai
- Department of Ophthalmology, Queensland Children's Hospital, Brisbane, Australia.,School of Medical Science, Griffith University, Gold Coast, Australia.,University of Queensland, Australia
| |
Collapse
|
30
|
Peng Y, Chen Z, Zhu W, Shi F, Wang M, Zhou Y, Xiang D, Chen X, Chen F. Automatic zoning for retinopathy of prematurity with semi-supervised feature calibration adversarial learning. BIOMEDICAL OPTICS EXPRESS 2022; 13:1968-1984. [PMID: 35519283 PMCID: PMC9045915 DOI: 10.1364/boe.447224] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Revised: 01/05/2022] [Accepted: 02/09/2022] [Indexed: 06/14/2023]
Abstract
Retinopathy of prematurity (ROP) is an eye disease, which affects prematurely born infants with low birth weight and is one of the main causes of children's blindness globally. In recent years, there are many studies on automatic ROP diagnosis, mainly focusing on ROP screening such as "Yes/No ROP" or "Mild/Severe ROP" and presence/absence detection of "plus disease". Due to the lack of corresponding high-quality annotations, there are few studies on ROP zoning, which is one of the important indicators to evaluate the severity of ROP. Moreover, how to effectively utilize the unlabeled data to train model is also worth studying. Therefore, we propose a novel semi-supervised feature calibration adversarial learning network (SSFC-ALN) for 3-level ROP zoning, which consists of two subnetworks: a generative network and a compound network. The generative network is a U-shape network for producing the reconstructed images and its output is taken as one of the inputs of the compound network. The compound network is obtained by extending a common classification network with a discriminator, introducing adversarial mechanism into the whole training process. Because the definition of ROP tells us where and what to focus on in the fundus images, which is similar to the attention mechanism. Therefore, to further improve classification performance, a new attention mechanism based feature calibration module (FCM) is designed and embedded in the compound network. The proposed method was evaluated on 1013 fundus images of 108 patients with 3-fold cross validation strategy. Compared with other state-of-the-art classification methods, the proposed method achieves high classification performance.
Collapse
Affiliation(s)
- Yuanyuan Peng
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu 215006, China
| | - Zhongyue Chen
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu 215006, China
| | - Weifang Zhu
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu 215006, China
| | - Fei Shi
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu 215006, China
| | - Meng Wang
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu 215006, China
| | - Yi Zhou
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu 215006, China
| | - Daoman Xiang
- Guangzhou Women and Children's Medical Center, Guangzhou 510623, China
| | - Xinjian Chen
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu 215006, China
- State Key Laboratory of Radiation Medicine and Protection, Soochow University, Suzhou 215123, China
| | - Feng Chen
- Guangzhou Women and Children's Medical Center, Guangzhou 510623, China
| |
Collapse
|
31
|
Tsai AS, Chou HD, Ling XC, Al-Khaled T, Valikodath N, Cole E, Yap VL, Chiang MF, Chan RVP, Wu WC. Assessment and management of retinopathy of prematurity in the era of anti-vascular endothelial growth factor (VEGF). Prog Retin Eye Res 2021; 88:101018. [PMID: 34763060 DOI: 10.1016/j.preteyeres.2021.101018] [Citation(s) in RCA: 43] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Revised: 10/27/2021] [Accepted: 10/29/2021] [Indexed: 02/06/2023]
Abstract
The incidence of retinopathy of prematurity (ROP) continues to rise due to the improved survival of very low birth weight infants in developed countries. This epidemic is also fueled by increased survival of preterm babies with variable use of oxygen and a lack of ROP awareness and screening services in resource-limited regions. Improvements in technology and a basic understanding of the disease pathophysiology have changed the way we screen and manage ROP, educate providers and patients, and improve ROP awareness. Advancements in imaging techniques, expansion of telemedicine services, and the potential for artificial intelligence-assisted ROP screening programs have created opportunities to improve ROP care in areas with a shortage of ophthalmologists trained in ROP. To address the gap in provider knowledge regarding ROP, the Global Education Network for Retinopathy of Prematurity (GEN-ROP) created a web-based tele-education training module that can be used to educate all providers involved in ROP, including non-physician ROP screeners. Over the past 50 years, the treatment of severe ROP has evolved from limited treatment modalities to cryotherapy and laser photocoagulation. More recently, there has been growing evidence to support the use of anti-vascular endothelial growth factor (VEGF) agents for the treatment of severe ROP. However, VEGF is known to be important in organogenesis and microvascular maintenance, and given that intravitreal anti-VEGF treatment can result in systemic VEGF suppression over a period of at least 1-12 weeks, there are concerns regarding adverse effects and long-term ocular and systemic developmental consequences of anti-VEGF therapy. Future research in ophthalmology to address the growing burden of ROP should focus on cost-effective fundus imaging devices, implementation of artificial intelligence platforms, updated treatment algorithms with optimal use of anti-VEGF and careful investigation of its long-term effects, and surgical options in advanced ROP. Addressing these unmet needs will aid the global effort against the ROP epidemic and optimize our understanding and treatment of this blinding disease.
Collapse
Affiliation(s)
- Andrew Sh Tsai
- Singapore National Eye Centre, Singapore; DUKE NUS Medical School, Singapore
| | - Hung-Da Chou
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou, Taiwan; College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Xiao Chun Ling
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou, Taiwan
| | - Tala Al-Khaled
- Department of Ophthalmology & Visual Sciences, University of Illinois at Chicago, Illinois Eye and Ear Infirmary, Chicago, IL, USA
| | - Nita Valikodath
- Department of Ophthalmology & Visual Sciences, University of Illinois at Chicago, Illinois Eye and Ear Infirmary, Chicago, IL, USA
| | - Emily Cole
- Department of Ophthalmology & Visual Sciences, University of Illinois at Chicago, Illinois Eye and Ear Infirmary, Chicago, IL, USA
| | - Vivien L Yap
- Division of Newborn Medicine, Weill Cornell Medicine, New York, NY, USA
| | - Michael F Chiang
- National Eye Institute, National Institutes of Health, Bethesda, MD, USA
| | - R V Paul Chan
- Department of Ophthalmology & Visual Sciences, University of Illinois at Chicago, Illinois Eye and Ear Infirmary, Chicago, IL, USA.
| | - Wei-Chi Wu
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou, Taiwan; College of Medicine, Chang Gung University, Taoyuan, Taiwan.
| |
Collapse
|
32
|
Attallah O. DIAROP: Automated Deep Learning-Based Diagnostic Tool for Retinopathy of Prematurity. Diagnostics (Basel) 2021; 11:2034. [PMID: 34829380 PMCID: PMC8620568 DOI: 10.3390/diagnostics11112034] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Revised: 09/24/2021] [Accepted: 11/01/2021] [Indexed: 12/12/2022] Open
Abstract
Retinopathy of Prematurity (ROP) affects preterm neonates and could cause blindness. Deep Learning (DL) can assist ophthalmologists in the diagnosis of ROP. This paper proposes an automated and reliable diagnostic tool based on DL techniques called DIAROP to support the ophthalmologic diagnosis of ROP. It extracts significant features by first obtaining spatial features from the four Convolution Neural Networks (CNNs) DL techniques using transfer learning and then applying Fast Walsh Hadamard Transform (FWHT) to integrate these features. Moreover, DIAROP explores the best-integrated features extracted from the CNNs that influence its diagnostic capability. The results of DIAROP indicate that DIAROP achieved an accuracy of 93.2% and an area under receiving operating characteristic curve (AUC) of 0.98. Furthermore, DIAROP performance is compared with recent ROP diagnostic tools. Its promising performance shows that DIAROP may assist the ophthalmologic diagnosis of ROP.
Collapse
Affiliation(s)
- Omneya Attallah
- Department of Electronics and Communications Engineering, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria 1029, Egypt
| |
Collapse
|
33
|
Abstract
PURPOSE OF REVIEW Artificial intelligence and deep learning have become important tools in extracting data from ophthalmic surgery to evaluate, teach, and aid the surgeon in all phases of surgical management. The purpose of this review is to highlight the ever-increasing intersection of computer vision, machine learning, and ophthalmic microsurgery. RECENT FINDINGS Deep learning algorithms are being applied to help evaluate and teach surgical trainees. Artificial intelligence tools are improving real-time surgical instrument tracking, phase segmentation, as well as enhancing the safety of robotic-assisted vitreoretinal surgery. SUMMARY Similar to strides appreciated in ophthalmic medical disease, artificial intelligence will continue to become an important part of surgical management of ocular conditions. Machine learning applications will help push the boundaries of what surgeons can accomplish to improve patient outcomes.
Collapse
Affiliation(s)
- Kapil Mishra
- Department of Ophthalmology, Byers Eye Institute at Stanford, Stanford University School of Medicine, Palo Alto, California, USA
| | | |
Collapse
|
34
|
Al-Khaled T, Valikodath NG, Patel SN, Cole E, Chervinko M, Douglas CE, Tsai ASH, Wu WC, Campbell JP, Chiang MF, Paul Chan RV. Addressing the Third Epidemic of Retinopathy of Prematurity Through Telemedicine and Technology: A Systematic Review. J Pediatr Ophthalmol Strabismus 2021; 58:261-269. [PMID: 34288773 DOI: 10.3928/01913913-20210223-01] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
The rising prevalence of retinopathy of prematurity (ROP) in low- and middle-income countries has increased the need for screening at-risk infants. The purpose of this article was to review the impact of tele-medicine and technology on ROP screening programs. Adhering to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, a systematic review was performed using PubMed, Pro-Quest, and Google Scholar bibliographic search engine. Terms searched included retinopathy of prematurity, telemedicine, and tele-ophthalmology. Data regarding internet access and gross domestic product per capita were obtained from the World Bank. Information was also obtained about internet access, speeds, and costs in low-income countries. There has been increasing integration of telemedicine and technology for ROP screening and management. Low-income countries are using available internet options and information and communications technology for ROP screening, which can aid in addressing the unique challenges faced by low-income countries. This provides a promising solution to the third epidemic of ROP by expanding and improving screening and management. Although telemedicine systems may serve as a cost-effective approach to facilitate delivery of health care, programs (especially in lowand middle-income countries) require national support to maintain its infrastructure. [J Pediatr Ophthalmol Strabismus. 2021;58(4):261-269.].
Collapse
|
35
|
Peng Y, Zhu W, Chen Z, Wang M, Geng L, Yu K, Zhou Y, Wang T, Xiang D, Chen F, Chen X. Automatic Staging for Retinopathy of Prematurity With Deep Feature Fusion and Ordinal Classification Strategy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1750-1762. [PMID: 33710954 DOI: 10.1109/tmi.2021.3065753] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Retinopathy of prematurity (ROP) is a retinal disease which frequently occurs in premature babies with low birth weight and is considered as one of the major preventable causes of childhood blindness. Although automatic and semi-automatic diagnoses of ROP based on fundus image have been researched, most of the previous studies focused on plus disease detection and ROP screening. There are few studies focusing on ROP staging, which is important for the severity evaluation of the disease. To be consistent with clinical 5-level ROP staging, a novel and effective deep neural network based 5-level ROP staging network is proposed, which consists of multi-stream based parallel feature extractor, concatenation based deep feature fuser and clinical practice based ordinal classifier. First, the three-stream parallel framework including ResNet18, DenseNet121 and EfficientNetB2 is proposed as the feature extractor, which can extract rich and diverse high-level features. Second, the features from three streams are deeply fused by concatenation and convolution to generate a more effective and comprehensive feature. Finally, in the classification stage, an ordinal classification strategy is adopted, which can effectively improve the ROP staging performance. The proposed ROP staging network was evaluated with per-image and per-examination strategies. For per-image ROP staging, the proposed method was evaluated on 635 retinal fundus images from 196 examinations, including 303 Normal, 26 Stage 1, 127 Stage 2, 106 Stage 3, 61 Stage 4 and 12 Stage 5, which achieves 0.9055 for weighted recall, 0.9092 for weighted precision, 0.9043 for weighted F1 score, 0.9827 for accuracy with 1 (ACC1) and 0.9786 for Kappa, respectively. While for per-examination ROP staging, 1173 examinations with a 4-fold cross validation strategy were used to evaluate the effectiveness of the proposed method, which prove the validity and advantage of the proposed method.
Collapse
|
36
|
Bao Y, Ming WK, Mou ZW, Kong QH, Li A, Yuan TF, Mi XS. Current Application of Digital Diagnosing Systems for Retinopathy of Prematurity. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 200:105871. [PMID: 33309305 DOI: 10.1016/j.cmpb.2020.105871] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2020] [Accepted: 11/18/2020] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVE Retinopathy of prematurity (ROP), a proliferative vascular eye disease, is one of the leading causes of blindness in childhood and prevails in premature infants with low-birth-weight. The recent progress in digital image analysis offers novel strategies for ROP diagnosis. This paper provides a comprehensive review on the development of digital diagnosing systems for ROP to software researchers. It may also be adopted as a guide to ophthalmologists for selecting the most suitable diagnostic software in the clinical setting, particularly for the remote ophthalmic support. METHODS We review the latest literatures concerning the application of digital diagnosing systems for ROP. The diagnosing systems are analyzed and categorized. Articles published between 1998 and 2020 were screened with the two searching engines Pubmed and Google Scholar. RESULTS Telemedicine is a method of remote image interpretation that can provide medical service to remote regions, and yet requires training to local operators. On the basis of image collection in telemedicine, computer-based image analytical systems for ROP were later developed. So far, the aforementioned systems have been mainly developed by virtue of classic machine learning, deep learning (DL) and multiple machine learning. During the past two decades, various computer-aided systems for ROP based on classic machine learning (e.g. RISA, ROPtool, CAIER) became available and have achieved satisfactory performance. Further, automated systems for ROP diagnosis based on DL are developed for clinical applications and exhibit high accuracy. Moreover, multiple instance learning is another method to establish an automated system for ROP detection besides DL, which, however, warrants further investigation in future. CONCLUSION At present, the incorporation of computer-based image analysis with telemedicine potentially enables the detection, supervision and in-time treatment of ROP for the preterm babies.
Collapse
Affiliation(s)
- Yuekun Bao
- Department of Ophthalmology, the First Affiliated Hospital of Jinan University, Guangzhou, China; State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Wai-Kit Ming
- Clinical Medicine, International School, Jinan University, Guangzhou, China
| | - Zhi-Wei Mou
- Department of Rehabilitation, the First Affiliated Hospital of Jinan University, Guangzhou, China
| | - Qi-Hang Kong
- Department of Ophthalmology, the First Affiliated Hospital of Jinan University, Guangzhou, China
| | - Ang Li
- Guangdong - Hong Kong - Macau Institute of CNS Regeneration, Joint International Research Laboratory of CNS Regeneration Ministry of Education, Jinan University, Guangzhou, China; Bioland Laboratory (Guangzhou Regenerative Medicine and Health Guangdong Laboratory), Guangzhou, China.
| | - Ti-Fei Yuan
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, Shanghai, China.
| | - Xue-Song Mi
- Department of Ophthalmology, the First Affiliated Hospital of Jinan University, Guangzhou, China; Changsha Academician Expert Workstation, Aier Eye Hospital Group, Changsha, China.
| |
Collapse
|
37
|
Panda BB, Thakur S, Mohapatra S, Parida S. Artificial intelligence in ophthalmology: A new era is beginning. Artif Intell Med Imaging 2021; 2:5-12. [DOI: 10.35711/aimi.v2.i1.5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Revised: 12/31/2020] [Accepted: 02/12/2021] [Indexed: 02/06/2023] Open
Affiliation(s)
- Bijnya Birajita Panda
- Department ofOphthalmology, S.C.B Medical College and Hospital, Cuttack 753007, Odisha, India
| | - Subhodeep Thakur
- Department ofOphthalmology, S.C.B Medical College and Hospital, Cuttack 753007, Odisha, India
| | - Sumita Mohapatra
- Department ofOphthalmology, S.C.B Medical College and Hospital, Cuttack 753007, Odisha, India
| | - Subhabrata Parida
- Department ofOphthalmology, S.C.B Medical College and Hospital, Cuttack 753007, Odisha, India
| |
Collapse
|
38
|
Li Z, Jiang J, Zhou H, Zheng Q, Liu X, Chen K, Weng H, Chen W. Development of a deep learning-based image eligibility verification system for detecting and filtering out ineligible fundus images: A multicentre study. Int J Med Inform 2020; 147:104363. [PMID: 33388480 DOI: 10.1016/j.ijmedinf.2020.104363] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2020] [Revised: 12/07/2020] [Accepted: 12/08/2020] [Indexed: 12/26/2022]
Abstract
BACKGROUND Recent advances in artificial intelligence (AI) have shown great promise in detecting some diseases based on medical images. Most studies developed AI diagnostic systems only using eligible images. However, in real-world settings, ineligible images (including poor-quality and poor-location images) that can compromise downstream analysis are inevitable, leading to uncertainty about the performance of these AI systems. This study aims to develop a deep learning-based image eligibility verification system (DLIEVS) for detecting and filtering out ineligible fundus images. METHODS A total of 18,031 fundus images (9,188 subjects) collected from 4 clinical centres were used to develop and evaluate the DLIEVS for detecting eligible, poor-location, and poor-quality fundus images. Four deep learning algorithms (AlexNet, DenseNet121, Inception V3, and ResNet50) were leveraged to train models to obtain the best model for the DLIEVS. The performance of the DLIEVS was evaluated using the area under the receiver operating characteristic curve (AUC), sensitivity, and specificity, as compared with a reference standard determined by retina experts. RESULTS In the internal test dataset, the best algorithm (DenseNet121) achieved AUCs of 1.000, 0.999, and 1.000 for the classification of eligible, poor-location, and poor-quality images, respectively. In the external test datasets, the AUCs of the best algorithm (DenseNet121) for detecting eligible, poor-location, and poor-quality images were ranged from 0.999-1.000, 0.997-1.000, and 0.997-0.999, respectively. CONCLUSIONS Our DLIEVS can accurately discriminate poor-quality and poor-location images from eligible images. This system has the potential to serve as a pre-screening technique to filter out ineligible images obtained from real-world settings, ensuring only eligible images will be applied in the subsequent image-based AI diagnostic analyses.
Collapse
Affiliation(s)
- Zhongwen Li
- Ningbo Eye Hospital, Wenzhou Medical University, Ningbo, 315000, China; School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, 325027, China.
| | - Jiewei Jiang
- School of Electronics Engineering, Xi'an University of Posts and Telecommunications, Xi'an, 710121, China
| | - Heding Zhou
- Ningbo Eye Hospital, Wenzhou Medical University, Ningbo, 315000, China
| | - Qinxiang Zheng
- Ningbo Eye Hospital, Wenzhou Medical University, Ningbo, 315000, China; School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, 325027, China
| | - Xiaotian Liu
- Ningbo Eye Hospital, Wenzhou Medical University, Ningbo, 315000, China
| | - Kuan Chen
- School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, 325027, China
| | - Hongfei Weng
- Ningbo Eye Hospital, Wenzhou Medical University, Ningbo, 315000, China
| | - Wei Chen
- Ningbo Eye Hospital, Wenzhou Medical University, Ningbo, 315000, China; School of Ophthalmology and Optometry and Eye Hospital, Wenzhou Medical University, Wenzhou, 325027, China.
| |
Collapse
|
39
|
Azad R, Gilbert C, Gangwe AB, Zhao P, Wu WC, Sarbajna P, Vinekar A. Retinopathy of Prematurity: How to Prevent the Third Epidemics in Developing Countries. Asia Pac J Ophthalmol (Phila) 2020; 9:440-448. [PMID: 32925293 DOI: 10.1097/apo.0000000000000313] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
Retinopathy of prematurity (ROP) is vasoproliferative disease affecting preterm infants and is a leading cause of avoidable childhood blindness worldwide. The world is currently experiencing the third epidemic of ROP, where majority of the cases are from middle-income countries. Over 40% of the world's premature infants were born in India, China, Bangladesh, Pakistan, and Indonesia. Together with other neighboring nations, this region has unique challenges in ROP management. Key aspects of the challenges including heavier and more mature infants developing severe ROP. Current strategies include adoption of national screening guidelines, telemedicine, integrating vision rehabilitation and software innovations in the form of artificial intelligence. This review overviews some of these aspects.
Collapse
Affiliation(s)
- Rajvardhan Azad
- Regional institute of Ophthalmology, Indira Gandhi institute of Medical Sciences, Patna, Bihar, India
| | - Claire Gilbert
- London School of Hygiene & Tropical Medicine, London, United Kingdom
| | | | - Peiquan Zhao
- Department of Ophthalmology, Xinhua Hospital, affiliated to Shanghai Jiaotong, University School of Medicine, Shanghai, China
| | - Wei-Chi Wu
- Department of Ophthalmology, Chang Gung Memorial Hospital, Linkou, Taiwan
- College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | | | | |
Collapse
|
40
|
Antaki F, Bachour K, Kim TN, Qian CX. The Role of Telemedicine to Alleviate an Increasingly Burdened Healthcare System: Retinopathy of Prematurity. Ophthalmol Ther 2020; 9:449-464. [PMID: 32562242 PMCID: PMC7406614 DOI: 10.1007/s40123-020-00275-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2020] [Indexed: 12/23/2022] Open
Abstract
Telemedicine-based remote digital fundus imaging (RDFI-TM) offers a promising platform for the screening of retinopathy of prematurity. RDFI-TM addresses some of the challenges faced by ophthalmologists in examining this vulnerable population in both low- and high-income countries. In this review, we studied the evidence on the use of RDFI-TM and analyzed the practical framework for RDFI-TM systems. We assessed the novel technological advances that can be deployed within RDFI-TM systems including noncontact imaging systems, smartphone-based imaging tools, and deep learning algorithms.
Collapse
Affiliation(s)
- Fares Antaki
- Department of Ophthalmology, Centre Universitaire d'Ophtalmologie (CUO), Hôpital Maisonneuve-Rosemont, Université de Montréal, Montréal, QC, Canada
| | - Kenan Bachour
- Faculty of Medicine and Health Sciences, Université de Sherbrooke, Sherbrooke, QC, Canada
| | - Tyson N Kim
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, USA
| | - Cynthia X Qian
- Department of Ophthalmology, Centre Universitaire d'Ophtalmologie (CUO), Hôpital Maisonneuve-Rosemont, Université de Montréal, Montréal, QC, Canada.
| |
Collapse
|
41
|
Huang YP, Basanta H, Kang EYC, Chen KJ, Hwang YS, Lai CC, Campbell JP, Chiang MF, Chan RVP, Kusaka S, Fukushima Y, Wu WC. Automated detection of early-stage ROP using a deep convolutional neural network. Br J Ophthalmol 2020; 105:1099-1103. [PMID: 32830123 DOI: 10.1136/bjophthalmol-2020-316526] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 06/21/2020] [Accepted: 07/28/2020] [Indexed: 12/14/2022]
Abstract
BACKGROUND/AIM To automatically detect and classify the early stages of retinopathy of prematurity (ROP) using a deep convolutional neural network (CNN). METHODS This retrospective cross-sectional study was conducted in a referral medical centre in Taiwan. Only premature infants with no ROP, stage 1 ROP or stage 2 ROP were enrolled. Overall, 11 372 retinal fundus images were compiled and split into 10 235 images (90%) for training, 1137 (10%) for validation and 244 for testing. A deep CNN was implemented to classify images according to the ROP stage. Data were collected from December 17, 2013 to May 24, 2019 and analysed from December 2018 to January 2020. The metrics of sensitivity, specificity and area under the receiver operating characteristic curve were adopted to evaluate the performance of the algorithm relative to the reference standard diagnosis. RESULTS The model was trained using fivefold cross-validation, yielding an average accuracy of 99.93%±0.03 during training and 92.23%±1.39 during testing. The sensitivity and specificity scores of the model were 96.14%±0.87 and 95.95%±0.48, 91.82%±2.03 and 94.50%±0.71, and 89.81%±1.82 and 98.99%±0.40 when predicting no ROP versus ROP, stage 1 ROP versus no ROP and stage 2 ROP, and stage 2 ROP versus no ROP and stage 1 ROP, respectively. CONCLUSIONS The proposed system can accurately differentiate among ROP early stages and has the potential to help ophthalmologists classify ROP at an early stage.
Collapse
Affiliation(s)
- Yo-Ping Huang
- Department of Electrical Engineering, National Taipei University of Technology, Taipei, Taiwan.,Department of Information and Communication Engineering, Chaoyang University of Technology, Taichung, Taiwan
| | - Haobijam Basanta
- Department of Electrical Engineering, National Taipei University of Technology, Taipei, Taiwan
| | - Eugene Yu-Chuan Kang
- Department of Ophthalmology, Chang Gung Memorial Hospital, Taoyuan, Taiwan.,College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Kuan-Jen Chen
- Department of Ophthalmology, Chang Gung Memorial Hospital, Taoyuan, Taiwan.,College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Yih-Shiou Hwang
- Department of Ophthalmology, Chang Gung Memorial Hospital, Taoyuan, Taiwan.,College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Chi-Chun Lai
- Department of Ophthalmology, Chang Gung Memorial Hospital, Taoyuan, Taiwan.,College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - John P Campbell
- Department of Ophthalmology, Casey Eye Institute, Oregon Health and Science University, Portland, Oregon, USA
| | - Michael F Chiang
- Department of Ophthalmology, Casey Eye Institute, Oregon Health and Science University, Portland, Oregon, USA
| | - Robison Vernon Paul Chan
- Department of Ophthalmology and Visual Sciences, Illinois Eye and Ear Infirmary, Chicago, Illinois, USA
| | - Shunji Kusaka
- Department of Ophthalmology, Kindai University, Osaka, Japan
| | - Yoko Fukushima
- Department of Ophthalmology, Osaka University, Osaka, Japan
| | - Wei-Chi Wu
- Department of Ophthalmology, Chang Gung Memorial Hospital, Taoyuan, Taiwan .,College of Medicine, Chang Gung University, Taoyuan, Taiwan
| |
Collapse
|
42
|
Moraru AD, Costin D, Moraru RL, Branisteanu DC. Artificial intelligence and deep learning in ophthalmology - present and future (Review). Exp Ther Med 2020; 20:3469-3473. [PMID: 32905155 PMCID: PMC7465350 DOI: 10.3892/etm.2020.9118] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Accepted: 06/30/2020] [Indexed: 02/06/2023] Open
Abstract
Since its introduction in 1959, artificial intelligence technology has evolved rapidly and helped benefit research, industries and medicine. Deep learning, as a process of artificial intelligence (AI) is used in ophthalmology for data analysis, segmentation, automated diagnosis and possible outcome predictions. The association of deep learning and optical coherence tomography (OCT) technologies has proven reliable for the detection of retinal diseases and improving the diagnostic performance of the eye's posterior segment diseases. This review explored the possibility of implementing and using AI in establishing the diagnosis of retinal disorders. The benefits and limitations of AI in the field of retinal disease medical management were investigated by analyzing the most recent literature data. Furthermore, the future trends of AI involvement in ophthalmology were analyzed, as AI will be part of the decision-making regarding the scientific investigation, diagnosis and therapeutic management.
Collapse
Affiliation(s)
- Andreea Dana Moraru
- Department of Ophthalmology, 'Grigore T. Popa' University of Medicine and Pharmacy, 700115 Iaşi, Romania.,Department of Ophthalmology, 'N. Oblu' Clinical Hospital, 700309 Iași, Romania
| | - Danut Costin
- Department of Ophthalmology, 'Grigore T. Popa' University of Medicine and Pharmacy, 700115 Iaşi, Romania.,Department of Ophthalmology, 'N. Oblu' Clinical Hospital, 700309 Iași, Romania
| | - Radu Lucian Moraru
- Department of Otorhinolaryngology, Transmed Expert, 700011 Iaşi; 4'Retina Center' Eye Clinic, 700126 Iaşi, Romania
| | - Daniel Constantin Branisteanu
- Department of Ophthalmology, 'Grigore T. Popa' University of Medicine and Pharmacy, 700115 Iaşi, Romania.,'Retina Center' Eye Clinic, 700126 Iași, Romania
| |
Collapse
|
43
|
M. G, V. A, S. MM, H. M. Concept attribution: Explaining CNN decisions to physicians. Comput Biol Med 2020; 123:103865. [DOI: 10.1016/j.compbiomed.2020.103865] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Revised: 06/12/2020] [Accepted: 06/13/2020] [Indexed: 01/06/2023]
|
44
|
Tong Y, Lu W, Deng QQ, Chen C, Shen Y. Automated identification of retinopathy of prematurity by image-based deep learning. EYE AND VISION (LONDON, ENGLAND) 2020; 7:40. [PMID: 32766357 PMCID: PMC7395360 DOI: 10.1186/s40662-020-00206-2] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/20/2020] [Accepted: 07/02/2020] [Indexed: 12/13/2022]
Abstract
BACKGROUND Retinopathy of prematurity (ROP) is a leading cause of childhood blindness worldwide but can be a treatable retinal disease with appropriate and timely diagnosis. This study was performed to develop a robust intelligent system based on deep learning to automatically classify the severity of ROP from fundus images and detect the stage of ROP and presence of plus disease to enable automated diagnosis and further treatment. METHODS A total of 36,231 fundus images were labeled by 13 licensed retinal experts. A 101-layer convolutional neural network (ResNet) and a faster region-based convolutional neural network (Faster-RCNN) were trained for image classification and identification. We applied a 10-fold cross-validation method to train and optimize our algorithms. The accuracy, sensitivity, and specificity were assessed in a four-degree classification task to evaluate the performance of the intelligent system. The performance of the system was compared with results obtained by two retinal experts. Moreover, the system was designed to detect the stage of ROP and presence of plus disease as well as to highlight lesion regions based on an object detection network using Faster-RCNN. RESULTS The system achieved an accuracy of 0.903 for the ROP severity classification. Specifically, the accuracies in discriminating normal, mild, semi-urgent, and urgent were 0.883, 0.900, 0.957, and 0.870, respectively; the corresponding accuracies of the two experts were 0.902 and 0.898. Furthermore, our model achieved an accuracy of 0.957 for detecting the stage of ROP and 0.896 for detecting plus disease; the accuracies in discriminating stage I to stage V were 0.876, 0.942, 0.968, 0.998 and 0.999, respectively. CONCLUSIONS Our system was able to detect ROP and differentiate four-level classification fundus images with high accuracy and specificity. The performance of the system was comparable to or better than that of human experts, demonstrating that this system could be used to support clinical decisions.
Collapse
Affiliation(s)
- Yan Tong
- Eye Center, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| | - Wei Lu
- Eye Center, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| | - Qin-qin Deng
- Eye Center, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| | - Changzheng Chen
- Eye Center, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
| | - Yin Shen
- Eye Center, Renmin Hospital of Wuhan University, Wuhan, 430060 Hubei China
- Medical Research Institute, Wuhan University, Wuhan, Hubei China
| |
Collapse
|
45
|
Sorrentino FS, Jurman G, De Nadai K, Campa C, Furlanello C, Parmeggiani F. Application of Artificial Intelligence in Targeting Retinal Diseases. Curr Drug Targets 2020; 21:1208-1215. [PMID: 32640954 DOI: 10.2174/1389450121666200708120646] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2020] [Revised: 04/20/2020] [Accepted: 04/20/2020] [Indexed: 01/17/2023]
Abstract
Retinal diseases affect an increasing number of patients worldwide because of the aging population. Request for diagnostic imaging in ophthalmology is ramping up, while the number of specialists keeps shrinking. Cutting-edge technology embedding artificial intelligence (AI) algorithms are thus advocated to help ophthalmologists perform their clinical tasks as well as to provide a source for the advancement of novel biomarkers. In particular, optical coherence tomography (OCT) evaluation of the retina can be augmented by algorithms based on machine learning and deep learning to early detect, qualitatively localize and quantitatively measure epi/intra/subretinal abnormalities or pathological features of macular or neural diseases. In this paper, we discuss the use of AI to facilitate efficacy and accuracy of retinal imaging in those diseases increasingly treated by intravitreal vascular endothelial growth factor (VEGF) inhibitors (i.e. anti-VEGF drugs), also including integration and interpretation features in the process. We review recent advances by AI in diabetic retinopathy, age-related macular degeneration, and retinopathy of prematurity that envision a potentially key role of highly automated systems in screening, early diagnosis, grading and individualized therapy. We discuss benefits and critical aspects of automating the evaluation of disease activity, recurrences, the timing of retreatment and therapeutically potential novel targets in ophthalmology. The impact of massive employment of AI to optimize clinical assistance and encourage tailored therapies for distinct patterns of retinal diseases is also discussed.
Collapse
Affiliation(s)
| | - Giuseppe Jurman
- Unit of Predictive Models for Biomedicine and Environment - MPBA, Fondazione Bruno Kessler, Trento, Italy
| | - Katia De Nadai
- Department of Morphology, Surgery and Experimental Medicine, University of Ferrara, Ferrara, Italy
| | - Claudio Campa
- Department of Surgical Specialties, Sant'Anna Hospital, Azienda Ospedaliero Universitaria di Ferrara, Ferrara, Italy
| | - Cesare Furlanello
- Unit of Predictive Models for Biomedicine and Environment - MPBA, Fondazione Bruno Kessler, Trento, Italy
| | - Francesco Parmeggiani
- Department of Morphology, Surgery and Experimental Medicine, University of Ferrara, Ferrara, Italy
| |
Collapse
|
46
|
Diving Deep into Deep Learning: An Update on Artificial Intelligence in Retina. CURRENT OPHTHALMOLOGY REPORTS 2020; 8:121-128. [PMID: 33224635 DOI: 10.1007/s40135-020-00240-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Purpose of Review In the present article, we will provide an understanding and review of artificial intelligence in the subspecialty of retina and its potential applications within the specialty. Recent Findings Given the significant use of diagnostic imaging within retina, this subspecialty is a fitting area for the incorporation of artificial intelligence. Researchers have aimed at creating models to assist in the diagnosis and management of retinal disease as well as in the prediction of disease course and treatment response. Most of this work thus far has focused on diabetic retinopathy, age-related macular degeneration, and retinopathy of prematurity, although other retinal diseases have started to be explored as well. Summary Artificial intelligence is well-suited to transform the practice of ophthalmology. A basic understanding of the technology is important for its effective implementation and growth.
Collapse
|
47
|
Mao J, Luo Y, Liu L, Lao J, Shao Y, Zhang M, Zhang C, Sun M, Shen L. Automated diagnosis and quantitative analysis of plus disease in retinopathy of prematurity based on deep convolutional neural networks. Acta Ophthalmol 2020; 98:e339-e345. [PMID: 31559701 DOI: 10.1111/aos.14264] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2019] [Accepted: 09/06/2019] [Indexed: 12/24/2022]
Abstract
BACKGROUND The purpose of this study was to develop an automated diagnosis and quantitative analysis system for plus disease. The system provides a diagnostic decision but also performs quantitative analysis of the typical pathological features of the disease, which helps the physicians to make the best judgement and communicate the decisions. METHODS The deep learning network provided segmentation of the retinal vessels and the optic disc (OD). Based on the vessel segmentation, plus disease was classified and tortuosity, width, fractal dimension and vessel density were evaluated automatically. RESULTS The trained network achieved a sensitivity of 95.1% with 97.8% specificity for the diagnosis of plus disease. For detection of preplus or worse, the sensitivity and specificity were 92.4% and 97.4%. The quadratic weighted k was 0.9244. The tortuosities for the normal, preplus and plus groups were 3.61 ± 0.08, 5.95 ± 1.57 and 10.67 ± 0.50 (104 cm-3 ). The widths of the blood vessels were 63.46 ± 0.39, 67.21 ± 0.70 and 68.89 ± 0.75 μm. The fractal dimensions were 1.18 ± 0.01, 1.22 ± 0.01 and 1.26 ± 0.02. The vessel densities were 1.39 ± 0.03, 1.60 ± 0.01 and 1.64 ± 0.09 (%). All values were statistically different among the groups. After treatment for plus disease with ranibizumab injection, quantitative analysis showed significant changes in the pathological features. CONCLUSIONS Our system achieved high accuracy of diagnosis of plus disease in retinopathy of prematurity. It provided a quantitative analysis of the dynamic features of the disease progression. This automated system can assist physicians by providing a classification decision with auxiliary quantitative evaluation of the typical pathological features of the disease.
Collapse
Affiliation(s)
- Jianbo Mao
- Eye Hospital of Wenzhou Medical University Wenzhou Medical University Wenzhou China
| | - Yuhao Luo
- Department of Precision Machinery and Instrumentation University of Science and Technology of China Hefei China
| | - Lei Liu
- Department of Electronic Engineering and Information Science University of Science and Technology of China Hefei China
| | - Jimeng Lao
- Eye Hospital of Wenzhou Medical University Wenzhou Medical University Wenzhou China
| | - Yirun Shao
- Eye Hospital of Wenzhou Medical University Wenzhou Medical University Wenzhou China
| | - Min Zhang
- Department of Precision Machinery and Instrumentation University of Science and Technology of China Hefei China
| | - Caiyun Zhang
- Eye Hospital of Wenzhou Medical University Wenzhou Medical University Wenzhou China
| | - Mingzhai Sun
- Department of Precision Machinery and Instrumentation University of Science and Technology of China Hefei China
- Key Laboratory of Precision Scientific Instrumentation of Anhui Higher Education Institutes University of Science and Technology of China Hefei China
| | - Lijun Shen
- Eye Hospital of Wenzhou Medical University Wenzhou Medical University Wenzhou China
| |
Collapse
|
48
|
Patil J, Patil L, Parachuri N, Kumar N, Bandello F, Kuppermann BD, Loewenstein A, Sharma A. Smartphone based ROP (S-ROP) screening-opportunities and challenges. Eye (Lond) 2020; 34:1512-1514. [PMID: 32346107 PMCID: PMC7608357 DOI: 10.1038/s41433-020-0913-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2020] [Revised: 04/16/2020] [Accepted: 04/17/2020] [Indexed: 11/09/2022] Open
Affiliation(s)
- Jayaprakash Patil
- University Hospital of Morecambe Bay NHS Foundation Trust, Lancaster, UK
| | - Laxmi Patil
- University Hospital of Morecambe Bay NHS Foundation Trust, Lancaster, UK
| | - Nikulaa Parachuri
- Lotus Eye Hospital and Institute, Avinashi Road, Coimbatore, TN, India
| | - Nilesh Kumar
- Lotus Eye Hospital and Institute, Avinashi Road, Coimbatore, TN, India
| | - Francesco Bandello
- University Vita-Salute, Scientific Institute San Raffaele, Milano, Italy
| | | | - Anat Loewenstein
- Division of Ophthalmology, Tel Aviv Sourasky Medical Center and Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Ashish Sharma
- Lotus Eye Hospital and Institute, Avinashi Road, Coimbatore, TN, India.
| |
Collapse
|
49
|
Horton MB, Brady CJ, Cavallerano J, Abramoff M, Barker G, Chiang MF, Crockett CH, Garg S, Karth P, Liu Y, Newman CD, Rathi S, Sheth V, Silva P, Stebbins K, Zimmer-Galler I. Practice Guidelines for Ocular Telehealth-Diabetic Retinopathy, Third Edition. Telemed J E Health 2020; 26:495-543. [PMID: 32209018 PMCID: PMC7187969 DOI: 10.1089/tmj.2020.0006] [Citation(s) in RCA: 44] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2020] [Revised: 01/11/2020] [Accepted: 01/11/2020] [Indexed: 12/24/2022] Open
Abstract
Contributors The following document and appendices represent the third edition of the Practice Guidelines for Ocular Telehealth-Diabetic Retinopathy. These guidelines were developed by the Diabetic Retinopathy Telehealth Practice Guidelines Working Group. This working group consisted of a large number of subject matter experts in clinical applications for telehealth in ophthalmology. The editorial committee consisted of Mark B. Horton, OD, MD, who served as working group chair and Christopher J. Brady, MD, MHS, and Jerry Cavallerano, OD, PhD, who served as cochairs. The writing committees were separated into seven different categories. They are as follows: 1.Clinical/operational: Jerry Cavallerano, OD, PhD (Chair), Gail Barker, PhD, MBA, Christopher J. Brady, MD, MHS, Yao Liu, MD, MS, Siddarth Rathi, MD, MBA, Veeral Sheth, MD, MBA, Paolo Silva, MD, and Ingrid Zimmer-Galler, MD. 2.Equipment: Veeral Sheth, MD (Chair), Mark B. Horton, OD, MD, Siddarth Rathi, MD, MBA, Paolo Silva, MD, and Kristen Stebbins, MSPH. 3.Quality assurance: Mark B. Horton, OD, MD (Chair), Seema Garg, MD, PhD, Yao Liu, MD, MS, and Ingrid Zimmer-Galler, MD. 4.Glaucoma: Yao Liu, MD, MS (Chair) and Siddarth Rathi, MD, MBA. 5.Retinopathy of prematurity: Christopher J. Brady, MD, MHS (Chair) and Ingrid Zimmer-Galler, MD. 6.Age-related macular degeneration: Christopher J. Brady, MD, MHS (Chair) and Ingrid Zimmer-Galler, MD. 7.Autonomous and computer assisted detection, classification and diagnosis of diabetic retinopathy: Michael Abramoff, MD, PhD (Chair), Michael F. Chiang, MD, and Paolo Silva, MD.
Collapse
Affiliation(s)
- Mark B. Horton
- Indian Health Service-Joslin Vision Network (IHS-JVN) Teleophthalmology Program, Phoenix Indian Medical Center, Phoenix, Arizona
| | - Christopher J. Brady
- Division of Ophthalmology, Department of Surgery, Larner College of Medicine, University of Vermont, Burlington, Vermont
| | - Jerry Cavallerano
- Beetham Eye Institute, Joslin Diabetes Center, Massachusetts
- Department of Ophthalmology, Harvard Medical School, Boston, Massachusetts
| | - Michael Abramoff
- Department of Ophthalmology and Visual Sciences, The University of Iowa, Iowa City, Iowa
- Department of Biomedical Engineering, and The University of Iowa, Iowa City, Iowa
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, Iowa
- Department of Ophthalmology, Stephen A. Wynn Institute for Vision Research, The University of Iowa, Iowa City, Iowa
- Iowa City VA Health Care System, Iowa City, Iowa
- IDx, Coralville, Iowa
| | - Gail Barker
- Arizona Telemedicine Program, The University of Arizona, Phoenix, Arizona
| | - Michael F. Chiang
- Department of Ophthalmology, Casey Eye Institute, Oregon Health and Science University, Portland, Oregon
- Department of Medical Informatics and Clinical Epidemiology, Oregon Health and Science University, Portland, Oregon
| | | | - Seema Garg
- Department of Ophthalmology, University of North Carolina, Chapel Hill, North Carolina
| | | | - Yao Liu
- Department of Ophthalmology and Visual Sciences, University of Wisconsin-Madison, Madison, Wisconsin
| | | | - Siddarth Rathi
- Department of Ophthalmology, NYU Langone Health, New York, New York
| | - Veeral Sheth
- University Retina and Macula Associates, University of Illinois at Chicago, Chicago, Illinois
| | - Paolo Silva
- Beetham Eye Institute, Joslin Diabetes Center, Massachusetts
- Department of Ophthalmology, Harvard Medical School, Boston, Massachusetts
| | - Kristen Stebbins
- Vision Care Department, Hillrom, Skaneateles Falls, New York, New York
| | | |
Collapse
|
50
|
Lee D, Choi D, Lee Y. Clustering with varying risks of false assignments in discrete latent variable model. Stat Methods Med Res 2020; 29:2932-2944. [PMID: 32216581 DOI: 10.1177/0962280220913067] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In clustering problems, to model the intrinsic structure of unlabeled data, the latent variable models are frequently used. These model-based clustering methods often provide a clustering rule minimizing the total false assignment error. However, in many clustering applications, it is desirable to treat false assignment errors for a certain cluster differently. In this paper, we introduce the false assignment rate for clustering and estimate it by using the extended likelihood approach. We propose VRclust, a novel clustering rule that controls various errors differently across clusters. Real data examples illustrate the usage of estimation of false assignment rate and a simulation study shows that error controls are consistent as the sample size increases.
Collapse
Affiliation(s)
- Donghwan Lee
- Department of Statistics, Ewha Womans University, Seoul, Republic of Korea
| | - Dongseok Choi
- OHSU-PSU School of Public Health, Oregon Health & Science University, Portland, OR, USA.,Graduate School of Dentistry, Kyung Hee University, Seoul, Republic of Korea
| | - Youngjo Lee
- Department of Statistics, Seoul National University, Seoul, Republic of Korea
| |
Collapse
|