Foundation models: Insights and implications for gastrointestinal cancer

Table 6 Summary of key studies of multimodal large language models in the field of gastrointestinal cancer

Model	Year	Vision architecture	Vision dataset	WSIs	Text model	Text dataset	Parameters	Tissues	Generative	Open source link
PLIP[136]	2023	CLIP	OpenPath	28K	CLIP	OpenPath	NA	32	Captioning	https://github.com/PathologyFoundation/plip
HistGen[137]	2023	DINOv2, ViT-L	Multiple	55K	LGH Module	TCGA	Approximately 100M	32	Report generation	https://github.com/dddavid4real/HistGen
PathAlign[138]	2023	PathSSL	Custom	350K	BLIP-2	Diagnostic reports	Approximately 100M	32	Report generation	https://github.com/elonybear/PathAlign
CHIEF[139]	2024	CTransPath	14 Sources	60K	CLIP	Anatomical information	27.5M, 63M	19	No	https://github.com/hms-dbmi/CHIEF
PathGen[140]	2024	LLaVA, CLIP	TCGA	7K	CLIP	1.6M pairs	13B	32	WSI assistant	https://github.com/PathFoundation/PathGen-1.6M
PathChat[141]	2024	UNI	Multiple	999K	LLaMa 2	Pathology instructions	13B	20	AI assistant	https://github.com/fedshyvana/pathology_mllm_training
PathAsst[142]	2024	PathCLIP	PathCap	207K	Vicuna-13B	Pathology instructions	13B	32	AI assistant	https://github.com/superjamessyx/Generative-Foundation-AI-Assistant-for-Pathology
ProvGigaPath[143]	2024	ViT	Prov-Path	171K	OpenCLIP	17K Reports	1135	31	No	https://github.com/prov-gigapath/prov-gigapath
TITAN[144]	2024	ViT	Mass340K	336K	CoCa	Medical reports	Approximately 5B	20	Report generation	https://github.com/your-repo/TITAN
CONCH[145]	2024	ViT	Multiple	21K	GPTstyle	1.17M pairs	NA	19	Captioning	http://github.com/mahmoodlab/CONCH
SlideChat[146]	2024	CONCHLongNet	TCGA	4915	Qwen2.5-7B	Slide Instructions	7B	10	WSI assistant	https://github.com/uni-medical/SlideChat
PMPRG[147]	2024	MR-ViT	Custom	7422	GPT-2	Pathology Reports	NA	2	Multi-organ report	https://github.com/hvcl/Clinical-grade-PathologyReport-Generation
MuMo[148]	2024	MnasNet	Custom	429	Transformer	PathoRadio Reports	NA	1	No	https://github.com/czifan/MuMo
ConcepPath[149]	2024	ViT-B, CONCH	Quilt-1M	2243	CLIPGPT	PubMed	Approximately 187M	3	No	https://github.com/HKU-MedAI/ConcepPath
GPT-4V[150]	2024	Phikon ViT-B	CRC-7K, MHIST etc.	338K	GPT-4	NA	40M	3	Report generation	https://github.com/Dyke-F/GPT-4V-In-Context-Learning
MINIM[151]	2024	Stable diffusion	Multiple	NA	BERT, CLIP	Multiple	NA	6	Report generation	https://github.com/WithStomach/MINIM
PathM3[152]	2024	ViT-g/14	PatchGastric	991	FlanT5XL	PatchGastric	NA	1	WSI assistant	NA
FGCR[153]	2024	ResNet50	Custom, GastrADC	3598, 991	BERT	NA	9.21 Mb	6	Report generation	https://github.com/hudingyi/FGCR
PromptBio[154]	2024	PLIP	TCGA, CPTAC	482, 105	GPT-4	NA	NA	1	Report generation	https://github.com/DeepMed-Lab-ECNU/PromptBio
HistoCap[155]	2024	ViT	NA	10K	BERT, BioBERT	GTEx datasets	NA	40	Report generation	https://github.com/ssen7/histo_cap_transformers
mSTAR[156]	2024	UNI	TCGA	10K	BioBERT	Pathology Reports 11K	NA	32	Report generation	https://github.com/Innse/mSTAR
GPT-4 Enhanced[157]	2025	CTransPath	TCGA	NA	GPT-4	ASCO, ESMO, Onkopedia	NA	4	Recommendation generation	https://github.com/Dyke-F/LLM_RAG_Agent
PRISM[158]	2025	Virchow, ViT-H	Virchow dataset	587K	BioGPT	195K Reports	632M	17	Report generation	NA
HistoGPT[159]	2025	CTransPath, UNI	Custom	15K	BioGPT	Pathology Reports	30M to 1.5B	1	WSI assistant	https://github.com/marrlab/HistoGPT
PathologyVLM[160]	2025	PLIP, CLIP	PCaption-0.8M	NA	LLaVA	PCaption-0.5M	NA	Multi	Report generation	https://github.com/ddw2AIGROUP2CQUP/PA-LLaVA
MUSK[161]	2025	Transformer	TCGA	33K	Transformer	PubMed Central	675M	33	Question answering	https://github.com/Lilab-stanford/MUSK

WSIs: Whole-slide images; ViT: Vision Transformer; NA: Not available.