|
1
|
Kuo KM, Chang CS. A meta-analysis of the diagnostic test accuracy of artificial intelligence predicting emergency department dispositions. BMC Med Inform Decis Mak 2025; 25:187. [PMID: 40375078 PMCID: PMC12082892 DOI: 10.1186/s12911-025-03010-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2024] [Accepted: 04/23/2025] [Indexed: 05/18/2025] Open
Abstract
BACKGROUND The rapid advancement of Artificial Intelligence (AI) has led to its widespread application across various domains, showing encouraging outcomes. Many studies have utilized AI to forecast emergency department (ED) disposition, aiming to forecast patient outcomes earlier and to allocate resources better; however, a dearth of comprehensive review literature exists to assess the objective performance standards of these predictive models using quantitative evaluations. This study aims to conduct a meta-analysis to assess the diagnostic accuracy of AI in predicting ED disposition, encompassing admission, critical care, and mortality. METHODS Multiple databases, including Scopus, Springer, ScienceDirect, PubMed, Wiley, Sage, and Google Scholar, were searched until December 31, 2023, to gather relevant literature. Risk of bias was assessed using the Prediction Model Risk of Bias Assessment Tool. Pooled estimates of sensitivity, specificity, and area under the receiver operating characteristic curve (AUROC) were calculated to evaluate AI's predictive performance. Sub-group analyses were performed to explore covariates affecting AI predictive model performance. RESULTS The study included 88 articles possessed with 117 AI models, among which 39, 45, and 33 models predicted admission, critical care, and mortality, respectively. The reported statistics for sensitivity, specificity, and AUROC represent pooled summary measures derived from the component studies included in this meta-analysis. AI's summary sensitivity, specificity, and AUROC for predicting admission were 0.81 (95% Confidence Interval [CI] 0.74-0.86), 0.87 (95% CI 0.81-0.91), and 0.87 (95% CI 0.84-0.93), respectively. For critical care, the values were 0.86 (95% CI 0.79-0.91), 0.89 (95% CI 0.83-0.93), and 0.93 (95% CI 0.89-0.95), respectively, and for mortality, they were 0.85 (95% CI 0.80-0.89), 0.94 (95% CI 0.90-0.96), and 0.93 (95% CI 0.89-0.96), respectively. Emergent sample characteristics and AI techniques showed evidence of significant covariates influencing the heterogeneity of AI predictive models for ED disposition. CONCLUSIONS The meta-analysis indicates promising performance of AI in predicting ED disposition, with certain potential for improvement, especially in sensitivity. Future research could explore advanced AI techniques such as ensemble learning and cross-validation with hyper-parameter tuning to enhance predictive model efficacy. TRIAL REGISTRATION This systematic review was not registered with PROSPERO or any other similar registry because the review was completed prior to the opportunity for registration, and PROSPERO currently does not accept registrations for reviews that are already completed. We are committed to transparency and have adhered to best practices in systematic review methodology throughout this study.
Collapse
Affiliation(s)
- Kuang-Ming Kuo
- Department of Business Management, National United University, No. 1, Lienda, Miaoli, 360301, Taiwan
| | - Chao Sheng Chang
- Department of Emergency Medicine, E-Da Hospital, Kaohsiung City, Taiwan.
- Department of Occupational Therapy, I-Shou University, Kaohsiung City, Taiwan.
| |
Collapse
|
|
2
|
Weaver M, Goodin DA, Miller HA, Karmali D, Agarwal AA, Frieboes HB, Suliman SA. Prediction of prolonged mechanical ventilation in the intensive care unit via machine learning: a COVID-19 perspective. Sci Rep 2024; 14:30173. [PMID: 39627490 PMCID: PMC11615281 DOI: 10.1038/s41598-024-81980-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2024] [Accepted: 12/02/2024] [Indexed: 12/06/2024] Open
Abstract
Early recognition of risk factors for prolonged mechanical ventilation (PMV) could allow for early clinical interventions, prevention of secondary complications such as nosocomial infections, and effective triage of hospital resources. This study tested the hypothesis that an ensemble machine learning (ML) analysis of clinical data at time of intubation could identify patients at risk of PMV, using a COVID-19 dataset to classify patients into PMV (> 14 days) and non-PMV (≤ 14 days) groups. While several factors are known to cause PMV, including acid-base, weakness, and delirium, lesser-utilized but routinely measured parameters such as platelet count, glucose levels and fevers may also be relevant. Patient data from a single University Hospital were analyzed via the ML workflow to predict patients at risk of PMV and identify key clinical markers. Model performance was evaluated on a chronologically distinct cohort. The ML workflow identified patients at risk of PMV with AUROCTRAIN=0.960 (F1TRAIN = 0.935) and AUROCTEST=0.804 (F1TEST = 0.800). Top key features for classification included glucose, platelet count, temperature, LVEF, bicarbonate (arterial blood gas), and BMI. Data analysis at intubation time via the proposed workflow offers the potential to accurately predict patients at risk of PMV, with the goal to improve patient management and triage of hospital resources.
Collapse
Affiliation(s)
- Marianna Weaver
- Division of Pulmonary Medicine, University of Louisville, Louisville, KY, 40292, USA
| | - Dylan A Goodin
- Department of Bioengineering, University of Louisville, Lutz Hall 419, Louisville, KY, 40292, USA
| | - Hunter A Miller
- Department of Bioengineering, University of Louisville, Lutz Hall 419, Louisville, KY, 40292, USA
| | - Dipan Karmali
- Division of Pulmonary Medicine, University of Louisville, Louisville, KY, 40292, USA
| | - Apurv A Agarwal
- Division of Pulmonary Medicine, University of Louisville, Louisville, KY, 40292, USA
| | - Hermann B Frieboes
- Department of Bioengineering, University of Louisville, Lutz Hall 419, Louisville, KY, 40292, USA.
- Department of Pharmacology/Toxicology, University of Louisville, Louisville, KY, 40292, USA.
- Center for Predictive Medicine, University of Louisville, Louisville, KY, 40292, USA.
- James Graham Brown Cancer Center, University of Louisville, Louisville, KY, 40292, USA.
| | - Sally A Suliman
- University of Arizona Medical Center Phoenix, Phoenix, AZ, 85004, USA
- Formerly at: Division of Pulmonary Medicine, University of Louisville, Louisville, KY, 40292, USA
| |
Collapse
|
|
3
|
Xu J, Cao Z, Miao C, Zhang M, Xu X. Predicting omicron pneumonia severity and outcome: a single-center study in Hangzhou, China. Front Med (Lausanne) 2023; 10:1192376. [PMID: 37305146 PMCID: PMC10250627 DOI: 10.3389/fmed.2023.1192376] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Accepted: 05/08/2023] [Indexed: 06/13/2023] Open
Abstract
Background In December 2022, there was a large Omicron epidemic in Hangzhou, China. Many people were diagnosed with Omicron pneumonia with variable symptom severity and outcome. Computed tomography (CT) imaging has been proven to be an important tool for COVID-19 pneumonia screening and quantification. We hypothesized that CT-based machine learning algorithms can predict disease severity and outcome in Omicron pneumonia, and we compared its performance with the pneumonia severity index (PSI)-related clinical and biological features. Methods Our study included 238 patients with the Omicron variant who have been admitted to our hospital in China from 15 December 2022 to 16 January 2023 (the first wave after the dynamic zero-COVID strategy stopped). All patients had a positive real-time polymerase chain reaction (PCR) or lateral flow antigen test for SARS-CoV-2 after vaccination and no previous SARS-CoV-2 infections. We recorded patient baseline information pertaining to demographics, comorbid conditions, vital signs, and available laboratory data. All CT images were processed with a commercial artificial intelligence (AI) algorithm to obtain the volume and percentage of consolidation and infiltration related to Omicron pneumonia. The support vector machine (SVM) model was used to predict the disease severity and outcome. Results The receiver operating characteristic (ROC) area under the curve (AUC) of the machine learning classifier using PSI-related features was 0.85 (accuracy = 87.40%, p < 0.001) for predicting severity while that using CT-based features was only 0.70 (accuracy = 76.47%, p = 0.014). If combined, the AUC was not increased, showing 0.84 (accuracy = 84.03%, p < 0.001). Trained on outcome prediction, the classifier reached the AUC of 0.85 using PSI-related features (accuracy = 85.29%, p < 0.001), which was higher than using CT-based features (AUC = 0.67, accuracy = 75.21%, p < 0.001). If combined, the integrated model showed a slightly higher AUC of 0.86 (accuracy = 86.13%, p < 0.001). Oxygen saturation, IL-6, and CT infiltration showed great importance in both predicting severity and outcome. Conclusion Our study provided a comprehensive analysis and comparison between baseline chest CT and clinical assessment in disease severity and outcome prediction in Omicron pneumonia. The predictive model accurately predicts the severity and outcome of Omicron infection. Oxygen saturation, IL-6, and infiltration in chest CT were found to be important biomarkers. This approach has the potential to provide frontline physicians with an objective tool to manage Omicron patients more effectively in time-sensitive, stressful, and potentially resource-constrained environments.
Collapse
Affiliation(s)
- Jingjing Xu
- Department of Radiology, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Zhengye Cao
- Department of Radiology, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Chunqin Miao
- Party and Hospital Administration Office, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Minming Zhang
- Department of Radiology, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Xiaojun Xu
- Department of Radiology, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| |
Collapse
|
|
4
|
Musheyev B, Boparai MS, Kimura R, Janowicz R, Pamlanye S, Hou W, Duong TQ. Longitudinal medical subspecialty follow-up of critically and non-critically ill hospitalized COVID-19 survivors up to 24 months after discharge. Intern Emerg Med 2023; 18:477-486. [PMID: 36719540 PMCID: PMC9887251 DOI: 10.1007/s11739-023-03195-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 01/03/2023] [Indexed: 02/01/2023]
Abstract
Medical specialty usage of COVID-19 survivors after hospital discharge is poorly understood. This study investigated medical specialty usage at 1-12 and 13-24 months post-hospital discharge in critically ill and non-critically ill COVID-19 survivors. This retrospective study followed ICU (N = 89) and non-ICU (N = 205) COVID-19 survivors who returned for follow-up within the Stony Brook Health System post-hospital discharge. Follow-up data including survival, hospital readmission, ongoing symptoms, medical specialty care use, and ICU status were examined 1-12 and 13-24 months after COVID-19 discharge. "New" (not previously seen) medical specialty usage was also identified. Essentially all (98%) patients survived. Hospital readmission was 34%, but functional status scores at discharge were not associated with hospital readmission. Many patients reported ongoing [neuromuscular (50%) respiratory (39%), chronic fatigue (35%), cardiovascular (30%), gastrointestinal (28%), neurocognitive (22%), genitourinary (22%), and mood-related (13%)] symptoms at least once 1-24 months after discharge. Common specialty follow-ups included cardiology (25%), vascular medicine (17%), urology (17%), neurology (16%), and pulmonology (14%), with some associated with pre-existing comorbidities and with COVID-19. Common new specialty visits were vascular medicine (11%), pulmonology (11%), and neurology (9%). ICU patients had more symptoms and follow-ups compared to the non-ICU patients. This study reported high incidence of persistent symptoms and medical specialty care needs in hospitalized COVID-19 survivors 1-24 months post-discharge. Some specialty care needs were COVID-19 related or exacerbated by COVID-19 disease while others were associated with pre-existing medical conditions. Longer follow-up studies of COVID-19 survivor medical care needs are necessary.
Collapse
Affiliation(s)
- Benjamin Musheyev
- Department of Radiology, Montefiore Medical Center and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA
- Renaissance School of Medicine at Stony, Brook University, Stony Brook, New York, USA
| | - Montek S Boparai
- Renaissance School of Medicine at Stony, Brook University, Stony Brook, New York, USA
| | - Reona Kimura
- Renaissance School of Medicine at Stony, Brook University, Stony Brook, New York, USA
| | - Rebeca Janowicz
- Department of Physical and Occupational Therapy, Renaissance School of Medicine at Stony Brook Medicine, Stony Brook, New York, USA
| | - Stacey Pamlanye
- Department of Physical and Occupational Therapy, Renaissance School of Medicine at Stony Brook Medicine, Stony Brook, New York, USA
| | - Wei Hou
- Department of Family, Population and Preventative Medicine, Renaissance School of Medicine at Stony Brook University, Stony Brook, New York, USA
| | - Tim Q Duong
- Department of Radiology, Montefiore Medical Center and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA.
| |
Collapse
|
|
5
|
Duanmu H, Ren T, Li H, Mehta N, Singer AJ, Levsky JM, Lipton ML, Duong TQ. Deep learning of longitudinal chest X-ray and clinical variables predicts duration on ventilator and mortality in COVID-19 patients. Biomed Eng Online 2022; 21:77. [PMID: 36242040 PMCID: PMC9568988 DOI: 10.1186/s12938-022-01045-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Accepted: 09/16/2022] [Indexed: 11/10/2022] Open
Abstract
Objectives To use deep learning of serial portable chest X-ray (pCXR) and clinical variables to predict mortality and duration on invasive mechanical ventilation (IMV) for Coronavirus disease 2019 (COVID-19) patients. Methods This is a retrospective study. Serial pCXR and serial clinical variables were analyzed for data from day 1, day 5, day 1–3, day 3–5, or day 1–5 on IMV (110 IMV survivors and 76 IMV non-survivors). The outcome variables were duration on IMV and mortality. With fivefold cross-validation, the performance of the proposed deep learning system was evaluated by receiver operating characteristic (ROC) analysis and correlation analysis. Results Predictive models using 5-consecutive-day data outperformed those using 3-consecutive-day and 1-day data. Prediction using data closer to the outcome was generally better (i.e., day 5 data performed better than day 1 data, and day 3–5 data performed better than day 1–3 data). Prediction performance was generally better for the combined pCXR and non-imaging clinical data than either alone. The combined pCXR and non-imaging data of 5 consecutive days predicted mortality with an accuracy of 85 ± 3.5% (95% confidence interval (CI)) and an area under the curve (AUC) of 0.87 ± 0.05 (95% CI) and predicted the duration needed to be on IMV to within 2.56 ± 0.21 (95% CI) days on the validation dataset. Conclusions Deep learning of longitudinal pCXR and clinical data have the potential to accurately predict mortality and duration on IMV in COVID-19 patients. Longitudinal pCXR could have prognostic value if these findings can be validated in a large, multi-institutional cohort.
Collapse
Affiliation(s)
- Hongyi Duanmu
- Department of Radiology, Albert Einstein College of Medicine, Bronx, NY, 10461, USA
| | - Thomas Ren
- Department of Radiology, Albert Einstein College of Medicine, Bronx, NY, 10461, USA
| | - Haifang Li
- Department of Radiology, Albert Einstein College of Medicine, Bronx, NY, 10461, USA
| | - Neil Mehta
- Department of Radiology, Albert Einstein College of Medicine, Bronx, NY, 10461, USA
| | - Adam J Singer
- Department of Emergency Medicine, Renaissance School of Medicine, Stony Brook University, Stony Brook, NY, 11794, USA
| | - Jeffrey M Levsky
- Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, 10461, USA
| | - Michael L Lipton
- Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, 10461, USA
| | - Tim Q Duong
- Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, NY, 10461, USA.
| |
Collapse
|
|
6
|
Nneji GU, Cai J, Monday HN, Hossin MA, Nahar S, Mgbejime GT, Deng J. Fine-Tuned Siamese Network with Modified Enhanced Super-Resolution GAN Plus Based on Low-Quality Chest X-ray Images for COVID-19 Identification. Diagnostics (Basel) 2022; 12:diagnostics12030717. [PMID: 35328271 PMCID: PMC8947640 DOI: 10.3390/diagnostics12030717] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Revised: 03/05/2022] [Accepted: 03/09/2022] [Indexed: 12/20/2022] Open
Abstract
Coronavirus disease has rapidly spread globally since early January of 2020. With millions of deaths, it is essential for an automated system to be utilized to aid in the clinical diagnosis and reduce time consumption for image analysis. This article presents a generative adversarial network (GAN)-based deep learning application for precisely regaining high-resolution (HR) CXR images from low-resolution (LR) CXR correspondents for COVID-19 identification. Respectively, using the building blocks of GAN, we introduce a modified enhanced super-resolution generative adversarial network plus (MESRGAN+) to implement a connected nonlinear mapping collected from noise-contaminated low-resolution input images to produce deblurred and denoised HR images. As opposed to the latest trends of network complexity and computational costs, we incorporate an enhanced VGG19 fine-tuned twin network with the wavelet pooling strategy in order to extract distinct features for COVID-19 identification. We demonstrate our proposed model on a publicly available dataset of 11,920 samples of chest X-ray images, with 2980 cases of COVID-19 CXR, healthy, viral and bacterial cases. Our proposed model performs efficiently both on the binary and four-class classification. The proposed method achieves accuracy of 98.8%, precision of 98.6%, sensitivity of 97.5%, specificity of 98.9%, an F1 score of 97.8% and ROC AUC of 98.8% for the multi-class task, while, for the binary class, the model achieves accuracy of 99.7%, precision of 98.9%, sensitivity of 98.7%, specificity of 99.3%, an F1 score of 98.2% and ROC AUC of 99.7%. Our method obtains state-of-the-art (SOTA) performance, according to the experimental results, which is helpful for COVID-19 screening. This new conceptual framework is proposed to play an influential role in addressing the issues facing COVID-19 examination and other diseases.
Collapse
Affiliation(s)
- Grace Ugochi Nneji
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.D.)
| | - Jingye Cai
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.D.)
- Correspondence:
| | - Happy Nkanta Monday
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (H.N.M.); (G.T.M.)
| | - Md Altab Hossin
- School of Management and Economics, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Saifun Nahar
- Department of Information System and Technology, University of Missouri St. Louis, St. Louis, MO 63121, USA;
| | - Goodness Temofe Mgbejime
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (H.N.M.); (G.T.M.)
| | - Jianhua Deng
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.D.)
| |
Collapse
|
|
7
|
Lu JY, Hou W, Duong TQ. Longitudinal prediction of hospital-acquired acute kidney injury in COVID-19: a two-center study. Infection 2022; 50:109-119. [PMID: 34176087 PMCID: PMC8235913 DOI: 10.1007/s15010-021-01646-1] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Accepted: 06/20/2021] [Indexed: 02/06/2023]
Abstract
BACKGROUND To investigate the temporal characteristics of clinical variables of hospital-acquired acute kidney injury (AKI) in COVID-19 patients and to longitudinally predict AKI onset. METHODS There were 308 hospital-acquired AKI and 721 non-AKI (NAKI) COVID-19 patients from Stony Brook Hospital (New York, USA) data, and 72 hospital-acquired AKI and 303 NAKI COVID-19 patients from Tongji Hospital (Wuhan, China). Demographic, comorbidities, and longitudinal (3 days before and 3 days after AKI onset) clinical variables were used to compute odds ratios for and longitudinally predict hospital-acquired AKI onset. RESULTS COVID-19 patients with AKI were more likely to die than NAKI patients (31.5% vs 6.9%, adjusted p < 0.001, OR = 4.67 [95% CI 3.1, 7.0], Stony Brook data). AKI developed on average 3.3 days after hospitalization. Procalcitonin was elevated prior to AKI onset (p < 0.05), peaked, and remained elevated (p < 0.05). Alanine aminotransferase, aspartate transaminase, ferritin, and lactate dehydrogenase peaked the same time as creatinine, whereas D-dimer and brain natriuretic peptide peaked a day later. C-reactive protein, white blood cell and lymphocyte showed group differences - 2 days prior (p < 0.05). Top predictors were creatinine, procalcitonin, white blood cells, lactate dehydrogenase, and lymphocytes. They predicted AKI onset with areas under curves (AUCs) of 0.78, 0.66, and 0.56 at 0, - 1, and - 2 days prior, respectively. When tested on the Tongji Hospital data, the AUCs were 0.80, 0.79, and 0.77, respectively. CONCLUSIONS Time-locked longitudinal data provide insight into AKI progression. Commonly clinical variables reasonably predict AKI onset a few days prior. This work may lead to earlier recognition of AKI and treatment to improve clinical outcomes.
Collapse
Affiliation(s)
- Justin Y. Lu
- grid.251993.50000000121791997Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY 10467 USA
| | - Wei Hou
- grid.459987.e0000 0004 6008 5093Department of Family, Population & Preventive Medicine, Stony Brook Medicine, 101 Nicolls Rd, Stony Brook, NY USA
| | - Tim Q. Duong
- grid.251993.50000000121791997Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY 10467 USA
| |
Collapse
|
|
8
|
Celaya-Padilla JM, Villagrana-Bañuelos KE, Oropeza-Valdez JJ, Monárrez-Espino J, Castañeda-Delgado JE, Oostdam ASHV, Fernández-Ruiz JC, Ochoa-González F, Borrego JC, Enciso-Moreno JA, López JA, López-Hernández Y, Galván-Tejada CE. Kynurenine and Hemoglobin as Sex-Specific Variables in COVID-19 Patients: A Machine Learning and Genetic Algorithms Approach. Diagnostics (Basel) 2021; 11:2197. [PMID: 34943434 PMCID: PMC8700648 DOI: 10.3390/diagnostics11122197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 11/21/2021] [Accepted: 11/21/2021] [Indexed: 11/16/2022] Open
Abstract
Differences in clinical manifestations, immune response, metabolic alterations, and outcomes (including disease severity and mortality) between men and women with COVID-19 have been reported since the pandemic outbreak, making it necessary to implement sex-specific biomarkers for disease diagnosis and treatment. This study aimed to identify sex-associated differences in COVID-19 patients by means of a genetic algorithm (GALGO) and machine learning, employing support vector machine (SVM) and logistic regression (LR) for the data analysis. Both algorithms identified kynurenine and hemoglobin as the most important variables to distinguish between men and women with COVID-19. LR and SVM identified C10:1, cough, and lysoPC a 14:0 to discriminate between men with COVID-19 from men without, with LR being the best model. In the case of women with COVID-19 vs. women without, SVM had a higher performance, and both models identified a higher number of variables, including 10:2, lysoPC a C26:0, lysoPC a C28:0, alpha-ketoglutaric acid, lactic acid, cough, fever, anosmia, and dysgeusia. Our results demonstrate that differences in sexes have implications in the diagnosis and outcome of the disease. Further, genetic and machine learning algorithms are useful tools to predict sex-associated differences in COVID-19.
Collapse
Affiliation(s)
- Jose M. Celaya-Padilla
- Unidad Académica de Ingeniería Eléctrica, Universidad Autónoma de Zacatecas, Jardín Juárez 147, Centro, Zacatecas 98000, Mexico; (J.M.C.-P.); (K.E.V.-B.)
| | - Karen E. Villagrana-Bañuelos
- Unidad Académica de Ingeniería Eléctrica, Universidad Autónoma de Zacatecas, Jardín Juárez 147, Centro, Zacatecas 98000, Mexico; (J.M.C.-P.); (K.E.V.-B.)
| | - Juan José Oropeza-Valdez
- Unidad de Investigación Biomédica de Zacatecas, Instituto Mexicano del Seguro Social, Centro, Zacatecas 98000, Mexico; (J.J.O.-V.); (J.E.C.-D.); (J.C.F.-R.); (F.O.-G.); (J.A.E.-M.)
| | - Joel Monárrez-Espino
- Department of Health Research, Christus Muguerza del Parque Hospital Chihuahua, University of Monterrey, San Pedro Garza García 66238, Mexico;
| | - Julio E. Castañeda-Delgado
- Unidad de Investigación Biomédica de Zacatecas, Instituto Mexicano del Seguro Social, Centro, Zacatecas 98000, Mexico; (J.J.O.-V.); (J.E.C.-D.); (J.C.F.-R.); (F.O.-G.); (J.A.E.-M.)
- Cátedras-CONACyT, Consejo Nacional de Ciencia y Tecnología, Ciudad de México 03940, Mexico
| | - Ana Sofía Herrera-Van Oostdam
- Doctorado en Ciencias Biomédicas Básicas, Centro de Investigación en Ciencias de la Salud y Biomedicina, Universidad Autónoma de San Luis Potosí, San Luis Potosí 78210, Mexico;
| | - Julio César Fernández-Ruiz
- Unidad de Investigación Biomédica de Zacatecas, Instituto Mexicano del Seguro Social, Centro, Zacatecas 98000, Mexico; (J.J.O.-V.); (J.E.C.-D.); (J.C.F.-R.); (F.O.-G.); (J.A.E.-M.)
| | - Fátima Ochoa-González
- Unidad de Investigación Biomédica de Zacatecas, Instituto Mexicano del Seguro Social, Centro, Zacatecas 98000, Mexico; (J.J.O.-V.); (J.E.C.-D.); (J.C.F.-R.); (F.O.-G.); (J.A.E.-M.)
- Área de Ciencias de la Salud, Universidad Autónoma de Zacatecas, Carretera Zacatecas–Guadalajara kilometro 6, Ejido la Escondida, Zacatecas 98160, Mexico
| | - Juan Carlos Borrego
- Departamento de Epidemiología, Hospital General de Zona #1 “Emilio Varela Luján”, Instituto Mexicano del Seguro Social, Centro, Zacatecas 98000, Mexico;
| | - Jose Antonio Enciso-Moreno
- Unidad de Investigación Biomédica de Zacatecas, Instituto Mexicano del Seguro Social, Centro, Zacatecas 98000, Mexico; (J.J.O.-V.); (J.E.C.-D.); (J.C.F.-R.); (F.O.-G.); (J.A.E.-M.)
| | - Jesús Adrián López
- Laboratorio de MicroRNAs y Cáncer, Unidad Académica de Ciencias Biológicas, Universidad Autónoma de Zacatecas, Zacatecas 98000, Mexico;
| | - Yamilé López-Hernández
- Cátedras-CONACyT, Consejo Nacional de Ciencia y Tecnología, Ciudad de México 03940, Mexico
- Metabolomics and Proteomics Laboratory, Autonomous University of Zacatecas, Zacatecas 98000, Mexico
| | - Carlos E. Galván-Tejada
- Unidad Académica de Ingeniería Eléctrica, Universidad Autónoma de Zacatecas, Jardín Juárez 147, Centro, Zacatecas 98000, Mexico; (J.M.C.-P.); (K.E.V.-B.)
| |
Collapse
|
|
9
|
Musheyev B, Janowicz R, Borg L, Matarlo M, Boyle H, Hou W, Duong TQ. Characterizing non-critically ill COVID-19 survivors with and without in-hospital rehabilitation. Sci Rep 2021; 11:21039. [PMID: 34702883 PMCID: PMC8548441 DOI: 10.1038/s41598-021-00246-1] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2021] [Accepted: 10/05/2021] [Indexed: 12/16/2022] Open
Abstract
This study investigated pre-COVID-19 admission dependency, discharge assistive equipment, discharge medical follow-up recommendation, and functional status at hospital discharge of non-critically ill COVID-19 survivors, stratified by those with (N = 155) and without (N = 162) in-hospital rehabilitation. “Mental Status”, intensive-care-unit (ICU) Mobility, and modified Barthel Index scores were assessed at hospital discharge. Relative to the non-rehabilitation patients, rehabilitation patients were older, had more comorbidities, worse pre-admission dependency, were discharged with more assistive equipment and supplemental oxygen, spent more days in the hospital, and had more hospital-acquired acute kidney injury, acute respiratory failure, and more follow-up referrals (p < 0.05 for all). Cardiology, vascular medicine, urology, and endocrinology were amongst the top referrals. Functional scores of many non-critically ill COVID-19 survivors were abnormal at discharge (p < 0.05) and were associated with pre-admission dependency (p < 0.05). Some functional scores were negatively correlated with age, hypertension, coronary artery disease, chronic kidney disease, psychiatric disease, anemia, and neurological disorders (p < 0.05). In-hospital rehabilitation providing restorative therapies and assisting discharge planning were challenging in COVID-19 circumstances. Knowledge of the functional status, discharge assistive equipment, and follow-up medical recommendations at discharge could enable appropriate and timely post-discharge care. Follow-up studies of COVID-19 survivors are warranted as many will likely have significant post-acute COVID-19 sequela.
Collapse
Affiliation(s)
- Benjamin Musheyev
- Department of Radiology, Montefiore Medical Center and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA.,Renaissance School of Medicine at Stony Brook University, Stony Brook University, Stony Brook, NY, USA
| | - Rebeca Janowicz
- Department of Physical and Occupational Therapy, Renaissance School of Medicine at Stony Brook Medicine, Stony Brook, NY, USA
| | - Lara Borg
- Department of Physical and Occupational Therapy, Renaissance School of Medicine at Stony Brook Medicine, Stony Brook, NY, USA
| | - Michael Matarlo
- Department of Physical and Occupational Therapy, Renaissance School of Medicine at Stony Brook Medicine, Stony Brook, NY, USA
| | - Hayle Boyle
- Department of Physical and Occupational Therapy, Renaissance School of Medicine at Stony Brook Medicine, Stony Brook, NY, USA
| | - Wei Hou
- Department of Family, Population and Preventative Medicine, Renaissance School of Medicine at Stony Brook University, Stony Brook, NY, USA.
| | - Tim Q Duong
- Department of Radiology, Montefiore Medical Center and Albert Einstein College of Medicine, 111 E 210th St, Bronx, NY, 10467, USA.
| |
Collapse
|
|
10
|
Predicting Mechanical Ventilation and Mortality in COVID-19 Using Radiomics and Deep Learning on Chest Radiographs: A Multi-Institutional Study. Diagnostics (Basel) 2021; 11:diagnostics11101812. [PMID: 34679510 PMCID: PMC8535062 DOI: 10.3390/diagnostics11101812] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Revised: 09/23/2021] [Accepted: 09/24/2021] [Indexed: 01/19/2023] Open
Abstract
In this study, we aimed to predict mechanical ventilation requirement and mortality using computational modeling of chest radiographs (CXRs) for coronavirus disease 2019 (COVID-19) patients. This two-center, retrospective study analyzed 530 deidentified CXRs from 515 COVID-19 patients treated at Stony Brook University Hospital and Newark Beth Israel Medical Center between March and August 2020. Linear discriminant analysis (LDA), quadratic discriminant analysis (QDA), and random forest (RF) machine learning classifiers to predict mechanical ventilation requirement and mortality were trained and evaluated using radiomic features extracted from patients' CXRs. Deep learning (DL) approaches were also explored for the clinical outcome prediction task and a novel radiomic embedding framework was introduced. All results are compared against radiologist grading of CXRs (zone-wise expert severity scores). Radiomic classification models had mean area under the receiver operating characteristic curve (mAUCs) of 0.78 ± 0.05 (sensitivity = 0.72 ± 0.07, specificity = 0.72 ± 0.06) and 0.78 ± 0.06 (sensitivity = 0.70 ± 0.09, specificity = 0.73 ± 0.09), compared with expert scores mAUCs of 0.75 ± 0.02 (sensitivity = 0.67 ± 0.08, specificity = 0.69 ± 0.07) and 0.79 ± 0.05 (sensitivity = 0.69 ± 0.08, specificity = 0.76 ± 0.08) for mechanical ventilation requirement and mortality prediction, respectively. Classifiers using both expert severity scores and radiomic features for mechanical ventilation (mAUC = 0.79 ± 0.04, sensitivity = 0.71 ± 0.06, specificity = 0.71 ± 0.08) and mortality (mAUC = 0.83 ± 0.04, sensitivity = 0.79 ± 0.07, specificity = 0.74 ± 0.09) demonstrated improvement over either artificial intelligence or radiologist interpretation alone. Our results also suggest instances in which the inclusion of radiomic features in DL improves model predictions over DL alone. The models proposed in this study and the prognostic information they provide might aid physician decision making and efficient resource allocation during the COVID-19 pandemic.
Collapse
|
|
11
|
Yildiz H, Castanares-Zapatero D, Pierman G, Pothen L, De Greef J, Aboubakar Nana F, Rodriguez-Villalobos H, Belkhir L, Yombi JC. Validation of Neutrophil-to-Lymphocyte Ratio Cut-off Value Associated with High In-Hospital Mortality in COVID-19 Patients. Int J Gen Med 2021; 14:5111-5117. [PMID: 34511993 PMCID: PMC8420786 DOI: 10.2147/ijgm.s326666] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2021] [Accepted: 08/20/2021] [Indexed: 12/18/2022] Open
Abstract
Introduction The neutrophil-to-lymphocyte ratio (NLR) could be a predictive factor of severe COVID-19. However, most relevant studies are retrospective, and the optimal NLR cut-off point has not been determined. The objective of our research was identification and validation of the best NLR cut-off value on admission that could predict high in-hospital mortality in COVID-19 patients. Methods Medical files of all patients admitted for COVID-19 pneumonia in our dedicated COVID-units between March and April 2020 (derivation cohort) and between October and December 2020 (validation cohort) were reviewed. Results Two hundred ninety-nine patients were included in the study (198 in the derivation and 101 in the validation cohort, respectively). Youden’s J statistic in the derivation cohort determined the optimal cut-off value for the performance of NLR at admission to predict mortality in hospitalized patients with COVID-19. The NLR cut-off value of 5.94 had a sensitivity of 62% and specificity of 64%. In ROC curve analysis, the AUC was 0.665 [95% CI 0.530–0.801, p= 0.025]. In the validation cohort, the best predictive cut-off value of NLR was 6.4, which corresponded to a sensitivity of 63% and a specificity of 64% with AUC 0.766 [95% CI 0.651–0.881, p <0.001]. When the NLR cut-off value of 5.94 was applied in the validation cohort, there was no significant difference in death and survival in comparison with the derivation NLR cut-off. Net reclassification improvement (NRI) analysis showed no significant classification change in outcome between both NLR cut-off values (NRI:0.012, p=0.31). Conclusion In prospective analysis, an NLR value of 5.94 predicted high in-hospital mortality upon admission in patients hospitalized for COVID-19 pneumonia.
Collapse
Affiliation(s)
- Halil Yildiz
- Department of Internal Medicine and Infectious Diseases, Cliniques Universitaires Saint-Luc, Université Catholique de Louvain (UCLouvain), Brussels, Belgium
| | | | - Guillaume Pierman
- Department of Internal Medicine and Infectious Diseases, Cliniques Universitaires Saint-Luc, Université Catholique de Louvain (UCLouvain), Brussels, Belgium
| | - Lucie Pothen
- Department of Internal Medicine and Infectious Diseases, Cliniques Universitaires Saint-Luc, Université Catholique de Louvain (UCLouvain), Brussels, Belgium
| | - Julien De Greef
- Department of Internal Medicine and Infectious Diseases, Cliniques Universitaires Saint-Luc, Université Catholique de Louvain (UCLouvain), Brussels, Belgium
| | - Frank Aboubakar Nana
- Department of Pneumology, Cliniques Universitaires Saint-Luc, UCLouvain, Brussels, Belgium
| | | | - Leila Belkhir
- Department of Internal Medicine and Infectious Diseases, Cliniques Universitaires Saint-Luc, Université Catholique de Louvain (UCLouvain), Brussels, Belgium
| | - Jean Cyr Yombi
- Department of Internal Medicine and Infectious Diseases, Cliniques Universitaires Saint-Luc, Université Catholique de Louvain (UCLouvain), Brussels, Belgium
| |
Collapse
|
|
12
|
Aktar S, Talukder A, Ahamad MM, Kamal AHM, Khan JR, Protikuzzaman M, Hossain N, Azad AKM, Quinn JMW, Summers MA, Liaw T, Eapen V, Moni MA. Machine Learning Approaches to Identify Patient Comorbidities and Symptoms That Increased Risk of Mortality in COVID-19. Diagnostics (Basel) 2021; 11:1383. [PMID: 34441317 PMCID: PMC8393412 DOI: 10.3390/diagnostics11081383] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 07/12/2021] [Accepted: 07/29/2021] [Indexed: 02/06/2023] Open
Abstract
Providing appropriate care for people suffering from COVID-19, the disease caused by the pandemic SARS-CoV-2 virus, is a significant global challenge. Many individuals who become infected may have pre-existing conditions that may interact with COVID-19 to increase symptom severity and mortality risk. COVID-19 patient comorbidities are likely to be informative regarding the individual risk of severe illness and mortality. Determining the degree to which comorbidities are associated with severe symptoms and mortality would thus greatly assist in COVID-19 care planning and provision. To assess this we performed a meta-analysis of published global literature, and machine learning predictive analysis using an aggregated COVID-19 global dataset. Our meta-analysis suggested that chronic obstructive pulmonary disease (COPD), cerebrovascular disease (CEVD), cardiovascular disease (CVD), type 2 diabetes, malignancy, and hypertension as most significantly associated with COVID-19 severity in the current published literature. Machine learning classification using novel aggregated cohort data similarly found COPD, CVD, CKD, type 2 diabetes, malignancy, and hypertension, as well as asthma, as the most significant features for classifying those deceased versus those who survived COVID-19. While age and gender were the most significant predictors of mortality, in terms of symptom-comorbidity combinations, it was observed that Pneumonia-Hypertension, Pneumonia-Diabetes, and Acute Respiratory Distress Syndrome (ARDS)-Hypertension showed the most significant associations with COVID-19 mortality. These results highlight the patient cohorts most likely to be at risk of COVID-19-related severe morbidity and mortality, which have implications for prioritization of hospital resources.
Collapse
Affiliation(s)
- Sakifa Aktar
- Department of Computer Science and Engineering, Bangabandhu Sheikh Mujibur Rahman Science and Technology University, Gopalganj 8100, Bangladesh; (S.A.); (M.M.A.); (M.P.)
| | - Ashis Talukder
- Statistics Discipline, Khulna University, Khulna 9208, Bangladesh;
| | - Md. Martuza Ahamad
- Department of Computer Science and Engineering, Bangabandhu Sheikh Mujibur Rahman Science and Technology University, Gopalganj 8100, Bangladesh; (S.A.); (M.M.A.); (M.P.)
| | - A. H. M. Kamal
- Department of Computer Science and Engineering, Jatiya Kabi Kazi Nazrul Islam University, Trishal, Mymensingh 2220, Bangladesh;
| | - Jahidur Rahman Khan
- Health Research Institute, University of Canberra, Canberra, ACT 2617, Australia;
| | - Md. Protikuzzaman
- Department of Computer Science and Engineering, Bangabandhu Sheikh Mujibur Rahman Science and Technology University, Gopalganj 8100, Bangladesh; (S.A.); (M.M.A.); (M.P.)
| | - Nasif Hossain
- School of Tropical Medicine and Global Health, Nagasaki University, Nagasaki 852-8523, Japan;
| | - A. K. M. Azad
- Faculty of Science, Engineering & Technology, Swinburne University of Technology Sydney, Sydney, VIC 2150, Australia;
| | - Julian M. W. Quinn
- The Garvan Institute of Medical Research, Healthy Ageing Theme, Darlinghurst, NSW 2010, Australia; (J.M.W.Q.); (M.A.S.)
| | - Mathew A. Summers
- The Garvan Institute of Medical Research, Healthy Ageing Theme, Darlinghurst, NSW 2010, Australia; (J.M.W.Q.); (M.A.S.)
- St Vincent’s Clinical School, Faculty of Medicine, University of New South Wales, Sydney, NSW 2010, Australia
| | - Teng Liaw
- School of Health & Rehabilitation Sciences, The University of Queensland, Brisbane, QLD 4072, Australia;
| | - Valsamma Eapen
- World Health Organization (WHO) Centre on eHealth, School of Public Health and Community Medicine, Faculty of Medicine, University of New South Wales, Sydney, NSW 2052, Australia;
| | - Mohammad Ali Moni
- The Garvan Institute of Medical Research, Healthy Ageing Theme, Darlinghurst, NSW 2010, Australia; (J.M.W.Q.); (M.A.S.)
- School of Health & Rehabilitation Sciences, The University of Queensland, Brisbane, QLD 4072, Australia;
- World Health Organization (WHO) Centre on eHealth, School of Public Health and Community Medicine, Faculty of Medicine, University of New South Wales, Sydney, NSW 2052, Australia;
- School of Psychiatry, Faculty of Medicine, University of New South Wales, Sydney, NSW 2052, Australia
| |
Collapse
|