©The Author(s) 2025.
World J Gastrointest Oncol. Oct 15, 2025; 17(10): 109792
Published online Oct 15, 2025. doi: 10.4251/wjgo.v17.i10.109792
Published online Oct 15, 2025. doi: 10.4251/wjgo.v17.i10.109792
Table 2 Likert scale scores for questions generated by chat generative pretrained transformer
| Question | Parameter | Rater 1 | Rater 2 | Rater 3 | mean ± SD |
| Q1 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ1 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q2 | Accuracy | 4 | 4 | 4 | 4 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ2 | Accuracy | 4 | 5 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q3 | Accuracy | 5 | 5 | 4 | 4.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ3 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 3 | 2 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q4 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ4 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q5 | Accuracy | 5 | 6 | 6 | 5.67 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ5 | Accuracy | 5 | 6 | 6 | 5.67 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q6 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ6 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q7 | Accuracy | 4 | 5 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 2 | 3 | 2 | 2.33 ± 0.47 | |
| RQ7 | Accuracy | 4 | 5 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Q8 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ8 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q9 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ9 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q10 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ10 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q11 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ11 | Accuracy | 6 | 5 | 6 | 5.67 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q12 | Accuracy | 6 | 5 | 6 | 5.67 ± 0.47 |
| Completeness | 3 | 2 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ12 | Accuracy | 6 | 6 | 5 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 2 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q13 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ13 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q14 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 3 | 3 | 2 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 2 | 2.67 ± 0.47 | |
| RQ14 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 2 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q15 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 3 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ15 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q16 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ16 | Accuracy | 5 | 6 | 6 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q17 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ17 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 3 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q18 | Accuracy | 6 | 5 | 6 | 5.67 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ18 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q19 | Accuracy | 6 | 6 | 5 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ19 | Accuracy | 6 | 5 | 6 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q20 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 2 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ20 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q21 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ21 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q22 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ22 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q23 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ23 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q24 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 2 | 3 | 2 | 2.33 ± 0.47 | |
| RQ24 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Comprehensibility | 2 | 3 | 2 | 2.33 ± 0.47 | |
| Q25 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ25 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q26 | Accuracy | 5 | 5 | 6 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ26 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q27 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ27 | Accuracy | 5 | 5 | 5 | 5 ± 0 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q28 | Accuracy | 4 | 5 | 6 | 5 ± 1 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ28 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 2 | 3 | 2.33 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q29 | Accuracy | 5 | 4 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ29 | Accuracy | 5 | 4 | 4 | 4.33 ± 0.47 |
| Completeness | 2 | 2 | 2 | 2 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| Q30 | Accuracy | 5 | 6 | 5 | 5.33 ± 0.47 |
| Completeness | 2 | 3 | 3 | 2.67 ± 0.47 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 | |
| RQ30 | Accuracy | 6 | 6 | 5 | 5.67 ± 0.47 |
| Completeness | 3 | 3 | 3 | 3 ± 0 | |
| Comprehensibility | 3 | 3 | 3 | 3 ± 0 |
- Citation: Wang SS, Gao H, Lin PY, Qian TC, Du Y, Xu L. Evaluating chat generative pretrained transformer in answering questions on endoscopic mucosal resection and endoscopic submucosal dissection. World J Gastrointest Oncol 2025; 17(10): 109792
- URL: https://www.wjgnet.com/1948-5204/full/v17/i10/109792.htm
- DOI: https://dx.doi.org/10.4251/wjgo.v17.i10.109792