Diagnostic accuracy and quality of artificial intelligence models in irritable bowel syndrome: A systematic review

Table 2 Quality assessment of the included studies

Ref.	Diagnostic accuracy				Machine learning
	Patient selection1	Index test1	Reference standard1	Flow & timing1	Predictors2	Outcomes2	Analysis2	Data processing3	Model specification3	Training/validation3	Performance metrics3	Transparency3
Shepherd et al[17]	0 (clinic-based sample)	1 (ANN model)	1 (Rome II)	0 (no external validation)	1 (ANN)	1 (Rome II)	1 (cross-validation used)	1 (time binning and normalization)	1 (ANN model with hidden layers)	1 (4-fold cross-validation)	1 (sensitivity, specificity calculated)	0 (limited code transparency)
Aggio et al[18]	1 (diverse control)	1 (SVM and PLS pipeline)	1 (CRP and WCC levels)	1 (partial external validation)	1 (SVM)	1 (definition)	1 (multiple CV methods for robustness)	1 (normalized gas values)	1 (SVM with PLS setup)	1 (Monte Carlo and 10-fold cross-validation)	1 (ROC, sensitivity)	0 (no full code access)
Mao et al[19]	0 (specific IBS subtypes)	1 (multi-class SVM based on ROIs)	1 (Rome IV)	0 (no external validation)	1 (SVM)	1 (Rome IV)	0 (limited test sets)	1 (SPM preprocessing for ROIs)	1 (SVM for IBS classification)	1 (10-fold cross-validation)	1 (AUC, sensitivity, specificity)	0 (limited data sharing)
Fukui et al[8]	1 (multicenter approach)	1 (RF and KNN models)	1 (Rome IV and histological standards)	0 (no external validation)	1 (adjusted predictors)	1 (Rome IV and histological standards)	0 (no external testing)	1 (batch effect adjustment)	1 (RF and KNN classifiers)	1 (nested CV)	1 (AUC and AUPR)	1 (full settings provided, partial sharing)
Su et al[9]	1 (matched control)	1 (RF model)	1 (standard enzyme-linked diagnosis)	1 (robust cross-validation)	1 (enzyme activity focus)	1 (enzyme-based diagnosis)	1 (5-fold cross-validation)	1 (normalization for enzyme analysis)	1 (RF model with grid search)	1 (5-fold cross-validation)	1 (comprehensive ROC analysis)	1 (standard software in R)
Tanaka et al[20]	1 (broad sample selection)	1 (RF validated with Bray-Curtis)	1 (Rome IV and microbial standards)	1 (rigorous cross-validation	1 (RF)	1 (Rome IV for microbial analysis)	1 (external validation)	1 (Bray-Curtis dissimilarity for microbiome)	1 (RF validated externally)	1 (nested CV with external testing)	1 (AUROC and AUPR)	1 (code and dataset on GitHub)

¹Quality assessment of diagnostic accuracy studies-2.

²Prediction model risk of bias assessment tool-artificial intelligence.

³Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis-artificial intelligence.

1 point if the criterion is met (indicating low risk of bias or high methodological rigor) and 0 point if the criterion is not met. ANN: Artificial neural network; SVM: Support vector machine; PLS: Partial least squares; CRP: C-reactive protein; WCC: White blood cell count; CV: Cross-validation; ROC: Receiver operating characteristic curve; IBS: Irritable bowel syndrome; ROI: Regions of interest; RF: Random forest; KNN: K-nearest neighbors; SPM: Statistical parametric mapping; AUC: Area under the curve; AUPR: Area under the precision-recall curve; AUROC: Areas under receiver operating characteristic curve.