Deep learning applied to the imaging diagnosis of hepatocellular carcinoma

Table 2 Main characteristics of the studies that evaluate deep learning for liver tumor diagnosis throughout images or clinical data

Ref.	Country	Deep learning method	Accuracy	Sensitivity	Specificity	AUROC	DLS performance compared	Multicenter validation	Conclusion
Hamm et al[8], 2019	United States	Proof-of-concept validation CNN	92%	92%	98%	0.992	Better than radiologists	Not done	DLS was feasibility for classifying lesions with typical imaging features from six common hepatic lesion types
Yamashita et al[14], 2020	United States	CNN architectures: custom-made network and transfer learning-based network	60.4%	NA	NA	LR-1/2: 0.85. LR-3: 0.90. LR-4: 0.63. LR-5: 0.82	Transfer learning model was better	Performed	There is a feasibility of CNN for assigning LI-RADS categories from a relatively small dataset but highlights the challenges of model development and validation
Shi et al[23], 2020	China	Three CDNs	Model-A: 83.3%, B: 81.1%, C: 85.6%	NA	NA	Model-A: 0.925; B: 0.862; C: 0.920	Three model compared, A and C with better results	Not done	Three-phase CT protocol without precontrast showed similar diagnosis accuracy as four-phase protocol in differentiating HCC. It can reduce the radiation dose
Yasaka et al[25], 2018	Japan	CNN	84%	Category1: A: 71%; B: 33%; C: 94%; D: 90%; E: 100%	NA	0.92	Not applicable	Not done	Deep learning with CNN showed high diagnostic performance in differentiation of liver masses at dynamic CT
Trivizakis et al[28], 2019	Greece	3D and 2D CNN	83%	93%	67%	0.80	Superior compared with 2D CNN model	Not done	3D CNN architecture can bring significant benefit in DW-MRI liver discrimination and potentially in numerous other tissue classification problems based on tomographic data, especially in size-limited, disease specific clinical datasets
Wang et al[41], 2019	United States	Proof-of-concept “interpretable” CNN	88%	82.9%	NA	NA	Not applicable	Not done	This interpretable deep learning system demonstrates proof of principle for illuminating portions of a pre-trained deep neural network’s decision-making, by analyzing inner layers and automatically describing features contributing to predictions
Frid-Adar et al[45], 2018	Israel	GANs	Classic data: 78.6%. Synthetic data: 85.7%	Classic data: 78.6%. Synthetic data: 85.7%	Classic data: 88.4%. Synthetic data: 92.4%	NA	Synthetic data augmentation is better than classic data augmentation	Not done	This approach to synthetic data augmentation can generalize to other medical classification applications and thus support radiologists’ efforts to improve diagnosis
Wang et al[47], 2019	Japan	CNN with clinical data	NA	NA	NA	Clinical model: 0.723. Model: A: 0.788; B: 0.805; C: 0825.	Combined model C present with better results	Not done	The AUC of the combined model is about 0.825, which is much better than the models using clinical data only or CT image only
Sato et al[48], 2019	Japan	Fully connected neural network with 4 layers of neurons using only biomarkers, gradient boosting (non-linear model) and others	DLS: 83.54%. Gradient boosting: 87.34%	Gradient boosting: 93.27%	Gradient boosting: 75.93%	DLS: 0.884. Gradient boosting: 0.940	Deep learning was not the optimal classifier in the current study	Not done	The gradient boosting model reduced the misclassification rate by about half compared with a single tumor marker. The model can be applied to various kinds of data and thus could potentially become a translational mechanism between academic research and clinical practice
Naeem et al[49], 2020	Pakistan	MLP, SVM, RF, and J48 using ten-fold cross-validation	MLP: 99%	NA	NA	MLP: 0.983. SVM: 0.966. RF: 0.964. J48: 0.959	MLP model present with better results	Radiopaedia dataset	Our proposed system has the capability to verify the results on different MRI and CT scan databases, which could help radiologists to diagnose liver tumors

¹Five categories: A: Classic hepatocellular carcinomas; B: Malignant liver tumors other than classic and early hepatocellular carcinomas; C: Indeterminate masses or mass like lesions (including early hepatocellular carcinomas and dysplastic nodules) and rare benign liver masses other than hemangiomas and cysts; D: Hemangiomas; E: Cysts. AUC: Area under the curve; AUROC: Area under the receiver operating characteristic curve; CDNs: Convolutional dense networks CNN: Convolutional neural network; CT: Computed tomography; DLS: Deep learning system; DW-MRI: Diffusion weighted magnetic resonance imaging; GANs: Generative adversarial networks; HCC: Hepatocellular carcinoma; LI-RADS: Liver Imaging Reporting and Data System; LR: LI-RADS; MLP: Multiplayer perceptron; MRI: Magnetic resonance imaging; NA: Not available; RF: Random forest; SVM: Support vector machine.