OpenEvidence performs at similar levels compared to current and previous GPT models on orthopedic training and education questions

doi:10.5312/wjo.v17.i6.118593

Advanced Search

BPG is committed to discovery and dissemination of knowledge

Home / Archive / Volume 17, Issue 6

This Article

(25)

(28)

(0)

(293)

Peer-Review Report of This Article

CrossCheck and Google Search of This Article

Academic Rules and Norms of This Article

Citation of this article

Corresponding Author of This Article

Research Domain of This Article

Article-Type of This Article

Open-Access Policy of This Article

Times Cited Counts in Google of This Article

Journal Information of This Article

Publication Name

World Journal of Orthopedics

ISSN

2218-5836

Publisher of This Article

Baishideng Publishing Group Inc, 7041 Koll Center Parkway, Suite 160, Pleasanton, CA 94566, USA

Observational Study

Copyright: ©Author(s) 2026. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution-NonCommercial (CC BY-NC 4.0) license. No commercial re-use. See permissions. Published by Baishideng Publishing Group Inc.

World J Orthop. Jun 18, 2026; 17(6): 118593
Published online Jun 18, 2026. doi: 10.5312/wjo.v17.i6.118593

Table 3 Text-only question characteristics by language model and response accuracy (n = 94), n (%)

	GPT-4		GPT-5		OE
		P value¹		P value¹		P value¹
Total correct	76 (81)		83 (88)		76 (81)
Specialty		0.6		> 0.9		0.8
Basic science	16 (89)		17 (94)		16 (89)
Foot and ankle	4 (80)		4 (100)		4 (100)
Hand	2 (100)		2 (100)		2 (100)
Knee and sports	8 (73)		9 (82)		8 (73)
Pathology	4 (100)		4 (100)		4 (100)
Pediatrics	7 (88)		7 (88)		7 (88)
Recon	11 (85)		11 (85)		11 (85)
Shoulder and elbow	5 (71)		7 (88)		5 (63)
Spine	13 (87)		13 (87)		11 (73)
Trauma	6 (55)		9 (82)		8 (73)
Perceived importance		0.3		0.3		0.5
A	13 (76)		17 (100)		14 (82)
B	12 (71)		14 (82)		11 (65)
C	15 (75)		18 (90)		17 (85)
D	17 (85)		16 (80)		17 (85)
E	19 (95)		18 (90)		17 (85)
Question complexity		0.025		0.3		0.9
1	19 (95)		17 (85)		17 (85)
2	19 (95)		20 (100)		16 (80)
3	16 (80)		18 (90)		17 (85)
4	13 (65)		17 (85)		16 (80)
5	9 (64)		11 (79)		10 (71)

¹Fisher’s exact test; Wilcoxon rank sum test.

OE: OpenEvidence.

Full Size Table

Citation: Javid K, Driessche A, Clymer C, Abbas MJ, Pantuso A, Maier LM, Hoegler J, Hakeos WM, Guthrie ST. OpenEvidence performs at similar levels compared to current and previous GPT models on orthopedic training and education questions. World J Orthop 2026; 17(6): 118593
URL: https://www.wjgnet.com/2218-5836/full/v17/i6/118593.htm
DOI: https://dx.doi.org/10.5312/wjo.v17.i6.118593

Javid K, Driessche A, Clymer C, Abbas MJ, Pantuso A, Maier LM, Hoegler J, Hakeos WM, Guthrie ST. OpenEvidence performs at similar levels compared to current and previous GPT models on orthopedic training and education questions. World J Orthop 2026; 17(6): 118593 [DOI: 10.5312/wjo.v17.i6.118593]

All content on this site: Copyright © 1993-2026 Baishideng Publishing Group Inc, its licensors, and contributors. All rights are reserved, including those for text and data mining, AI training, and similar technologies. For all open access content, the relevant licensing terms apply.