DeepGut: A collaborative multimodal large language model framework for digestive disease assisted diagnosis and treatment

Figure 1 DeepGut structure. LLM: Large language model.

Figure 2 Fusion layer structure. LLM: Large language model.

Figure 3 Objective evaluation results. DA: Diagnostic accuracy; DC: Diagnostic completeness; TPA: Treatment plan accuracy; TPC: Treatment plan completeness.

Figure 4 Overall results of the subjective expert evaluation. A: Scores for the output of each patient; B: Summary of the subjective metrics.

Figure 5 The detailed evaluation results for the five selected cases. A: Case 6; B: Case 7; C: Case 8; D: Case 9; E: Case 10.