Preliminary study of automatic gastric cancer risk classification from photofluorography

Abstract

AIM

To perform automatic gastric cancer risk classification using photofluorography for realizing effective mass screening as a preliminary study.

METHODS

We used data for 2100 subjects including X-ray images, pepsinogen I and II levels, PGI/PGII ratio, Helicobacter pylori (H. pylori) antibody, H. pylori eradication history and interview sheets. We performed two-stage classification with our system. In the first stage, H. pylori infection status classification was performed, and H. pylori-infected subjects were automatically detected. In the second stage, we performed atrophic level classification to validate the effectiveness of our system.

RESULTS

Sensitivity, specificity and Youden index (YI) of H. pylori infection status classification were 0.884, 0.895 and 0.779, respectively, in the first stage. In the second stage, sensitivity, specificity and YI of atrophic level classification for H. pylori-infected subjects were 0.777, 0.824 and 0.601, respectively.

CONCLUSION

Although further improvements of the system are needed, experimental results indicated the effectiveness of machine learning techniques for estimation of gastric cancer risk.

Key Words: Gastric cancer, Helicobacter pylori, Mass screening, Photofluorography, Automatic data processing

Core tip: We developed an automatic gastric cancer risk classification system that analyzes X-ray images as a preliminary study. To evaluate the effectiveness of our system, we performed a retrospective analysis of patients who underwent photofluorography and ABC (D) stratification by blood inspection. From the experimental results, we found that machine learning techniques might have a potential for extracting additional gastric cancer risk information. The collaborative use of image-based risk information and ABC (D) stratification will provide more reliable gastric cancer risk information.

INTRODUCTION

Gastric cancer remains the third leading cause of cancer mortality in the world, and East Asian countries, including China, South Korea and Japan, have the highest mortality rates[1,2]. In Japan, the number of gastric cancer-related deaths each year is approximately 50000, and there has been no change over the past several decades.

Many studies on gastric cancer have been carried out, and epidemiological studies have revealed that Helicobacter pylori (H. pylori) infection is a main cause of gastric cancer[3,4]. Consequently, in 1994, the International Agency for Research on Cancer (IARC) at the World Health Organization (WHO) declared that H. pylori infection can be classified as a group I carcinogen[5]. An animal experiment using Mongolian gerbils[6] and a prospective cohort study by Uemura et al[7] indicated that the main cause of gastric cancer is H. pylori infection. It has also been reported that about half of the world’s population is infected with H. pylori and that its prevalence is highly variable depending on age, geography and economic factors[8]. Although auto-immunization, drug-induced suffering and infectious diseases can cause gastritis and/or gastric cancer, most cases are due to H. pylori infection[9,10]. In Japan, the incidence of H. pylori-negative gastric cancer was reported to be 0.3%-0.6%[11,12], and almost all cases of gastric cancer are derived from H. pylori-induced gastritis. Moreover, H. pylori infection rates in Japan differ according to the year of birth, and generations born in the 1970s or later have extremely low infection rates[13]. Meanwhile, recent studies have shown that H. pylori eradication therapy reduces the risk for development of gastric cancer[14,15]. H. pylori eradication therapy for H. pylori-infected patients with gastritis has been covered by national health insurance since February 2013 in Japan, the first country in the world to do so. Hence, mass screening methods with consideration of gastric cancer risk are required[16,17].

ABC (D) stratification combining serum pepsinogen (PG) and H. pylori antibody has gradually been introduced for evaluation of gastric cancer risk[18]. It has been reported that the combination of these serum markers is effective for evaluating pre-malignant conditions of the gastric mucosa[19]. Since pre-malignant stages of atrophic gastritis, intestinal metaplasia and dysplasia, which can be detected from serum markers, lead to gastric adenocarcinoma, ABC (D) stratification is expected to become a new standard non-invasive inspection method for evaluation of gastric cancer risk[20]. On the other hand, the effectiveness of photofluorography and endoscopy for gastric cancer mass screening has also been evaluated. Hence, evaluation of gastric cancer risk from clinical image data is a crucial issue for the mass screening.

Recently, it has been reported that ABC (D) stratification and radiological findings of photofluorography have a good correlation with gastric cancer risk[21]. Since the main cause of gastric cancer and its risk factors have been clarified, a diagnostic technique for gastric cancer risk and/or H. pylori infection from photofluorography would play an important role in risk-based mass screening[22,23].

In this study, we performed a preliminary investigation of automatic gastric cancer risk classification using photofluorography for realizing effective risk-based mass screening.

MATERIALS AND METHODS

We performed a preliminary study for classification of gastric cancer risk from photofluorography. Then we developed an automatic risk classification system utilizing machine learning techniques for achieving our objective.

Study subjects

Data for X-ray images (8-bit gray scale, 1024 × 1024 pixels), H. pylori antibody, pepsinogen I (PG I) level, pepsinogen II (PG II) level, PGI/PGII ratio, H. pylori eradication history and interview sheets were used in this study. These data were acquired at the Medical Examination Center of Yamagata City Medical Association that specializes in gastric cancer mass screening from April 2012 to March 2013. We used X-ray images of eight positions for each subject. H. pylori antibody titers were measured by enzyme-linked immunosorbent assay kits (E Plate Eiken H. pylori, Eiken Chemical Co., Ltd., Tokyo, Japan). PG I level and PG II level were measured by Auto pepsinogen I BML-2G and Auto pepsinogen II BML-2 (BML, Inc., Ltd., Saitama, Japan), respectively. The cut-off value of H. pylori antibody titers was 10 U/mL, and the cut-off values of PG levels were PG I < 70 ng/mL and PG I/PG II ratio < 3. Subjects in whom these serum markers were measured were categorized into three or four groups corresponding to their gastric cancer risk as shown in Table 1. In ABC (D) stratification, group A is defined as a very low gastric cancer risk group, group B is defined as a middle-risk group, and groups C and D are defined as high-risk groups, with group D generally being included in group C[21].

Table 1 ABC (D) stratification.

	A	B	C (D)
H. pylori antibody level	-	+	+ (-)
PG levels	-	-	+

Patients with H. pylori antibody level ≥ 10 U/mL were classified as (+) and patients with PG I ≤ 70 ng/mL and PG I/PG II ratio ≤ 3 were classified as (+). H. pylori: Helicobacter pylori.

Automatic gastric cancer risk classification system

We developed an automatic gastric cancer risk classification system for identification of H. pylori infection status and atrophic level from photofluorography. In the first stage, H. pylori infection status classification was performed. In the second stage, atrophic level classification was applied to H. pylori-infected subjects. First, for gastric cancer risk classification, we derived image features from X-ray images for representing changes inside the stomach caused by H. pylori infection. In training procedures, we calculated more efficient image features that had high correlations with values of H. pylori antibody and serum markers. Specifically, we obtained new image features by projecting the original image features to a space that provided high correlations with values of PG levels and H. pylori antibody titers via Kernel Canonical Correlation Analysis (KCCA)[24]. Next, we classified these image features by a Support Vector Machine (SVM)[25]. An SVM technique is a machine learning technique that is often used for classification problems. Since multiple X-ray images were taken for each subject, the classification results of all X-ray images were integrated by an accuracy-based voting method. The values of H. pylori antibody and serum markers were used only in training procedures, and our system enabled classification of the risk of gastric cancer from only X-ray image information. Namely, if we want to estimate gastric cancer risk via our system, input data are only X-ray images, and calculated image features are automatically converted to new features considering PG levels and H. pylori antibody titers for the gastric cancer risk classification. A more detailed mathematical explanation of our system is given in[26].

Statistical analysis

The verification method was 15-fold cross-validation. The gold standard for evaluating our system was the result of ABC (D) stratification by blood inspection. Sensitivity, specificity and Youden index (YI) were used as evaluation criteria for each stage’s classification. A receiver operating characteristic (ROC) curve was generated based on each stage’s classification result. ROC curves were obtained by changing the threshold that determines gastric cancer risk. Accuracy, precision, false positive rate and false negative rate were calculated. We also utilized a confusion matrix for evaluation of our system. A confusion matrix is often used in the field of machine learning, and it represents information about actual and predicted classification results obtained by a classification system. In this study, Togo R, Ishihara K, Ogawa T and Haseyama M from the Graduate School of Information Science and Technology, Hokkaido University took charge of the statistical analysis since they have an advanced knowledge of statistical analysis.

RESULTS

The total number of subjects was 2535, and subjects who had undergone H. pylori eradication therapy and had suspected false negative results in ABC (D) stratification were excluded as shown in Figure 1. Specifically, we excluded 175 subjects who had undergone H. pylori eradication therapy, and we excluded 260 subjects in group A with PG I levels ≤ 30 ng/mL, PG II levels ≥ 15 ng/mL or PG I/PG II ratio < 4. If the training data included data for such subjects, it would have caused classification performance degradation since the correlation between radiological findings and ABC (D) stratification results for them might be eliminated. Consequently, data for 2100 subjects (1057 males and 1043 females; mean age, 50.36 ± 9.43 years) were used for analysis. There were 1130 subjects (53.8%) in group A, 508 subjects (24.2%) in group B and 462 subjects (22.0%) in group C (D).

Figure 1 Target selection flowchart. H. pylori: Helicobacter pylori.

Our system was evaluated with 16800 X-ray images for 2100 subjects. In the first stage, we performed H. pylori infection status classification. The number of subjects classified into each class is shown as a confusion matrix in Table 2. Of the 970 subjects who belonged to groups B and C (D) in ABC (D) stratification, 868 were correctly classified into the high gastric cancer risk group (H. pylori infection) using only X-ray image information. Also, of the 1130 subjects who belonged to group A in ABC (D) stratification, 999 were correctly classified into the low gastric cancer group (H. pylori non-infection). On the other hand, 102 of the 2100 subjects (4.8%) were incorrectly classified into the H. pylori non-infection group in our system. Specifically, sensitivity (H. pylori infection), specificity (H. pylori non-infection) and YI were 0.884, 0.895 and 0.779, respectively. Other evaluation criteria were as follows: accuracy was 0.889, precision was 0.907, false positive rate was 0.105 and false negative rate was 0.116. Figure 2 shows examples of X-ray images correctly or incorrectly classified in the first stage. The ROC curve of the first stage that was obtained by changing the threshold determining H. pylori infection is shown in Figure 3.

Table 2 Confusion matrix for the first stage.

		Predicted class
		H. pylori non-infection	H. pylori infection
True class	Group A	979	151
	Group B or C (D)	102	868

H. pylori: Helicobacter pylori.

Figure 2 Examples of X-ray images correctly or incorrectly classified in the first stage. A: True class: Group B or C (D). Predicted class: H. pylori infection (Correct classification); B: True class: Group B or C (D). Predicted class: H. pylori infection (Correct classification); C: True class: Group B or C (D). Predicted class: H. pylori non-infection (Incorrect classification); D: True class: Group A. Predicted class: H. pylori non-infection (Correct classification); E: True class: Group A. Predicted class: H. pylori non-infection (Correct classification); F: True class: Group A. Predicted class: H. pylori infection (Incorrect classification). H. pylori: Helicobacter pylori.

Figure 3 Receiver operating characteristic curve of the first stage generated by changing the threshold.

Next, we examined whether our system can be applied to more specific atrophic level classification. In the supplementary experiment of the second stage, we focused on H. pylori-infected subjects and applied atrophic level classification to them. The number of subjects classified into each class is shown as a confusion matrix in Table 3. The experimental results showed that 364 of the 462 subjects who belonged to group C (D) in ABC (D) stratification were correctly classified into the severe atrophic level group based on the condition of the stomach shown in X-ray images. Sensitivity (severe), specificity (non-severe) and YI in the second stage were 0.777, 0.824 and 0.601, respectively. Other evaluation criteria were as follows: accuracy was 0.800, precision was 0.809, false positive rate was 0.176 and false negative rate was 0.223. Figure 4 shows examples of X-ray images correctly or incorrectly classified in the second stage. The ROC curve of the second stage that was obtained by changing the threshold determining the severity of atrophic level is shown in Figure 5.

Table 3 Confusion matrix for the second stage.

		Predicted class
		Non-severe	Severe
True class	Group B	331	177
	Group C (D)	98	364

Figure 4 Examples of X-ray images correctly or incorrectly classified in the second stage. A: True class: Group C (D). Predicted class: Severe (Correct classification); B: True class: Group C (D). Predicted class: Severe (Correct classification); C: True class: Group C (D). Predicted class: Non-severe (Incorrect classification); D: True class: Group B. Predicted class: Non-severe (Correct classification); E: True class: Group B. Predicted class: Non-severe (Correct classification); F: True class: Group B. Predicted class: Severe (Incorrect classification).

Figure 5 Receiver operating characteristic curve of the second stage generated by changing the threshold.

DISCUSSION

It is a critical issue to evaluate gastric cancer risk for realizing effective gastric cancer mass screening[27]. H. pylori eradication therapy as primary prevention and early detection of gastric cancer as secondary prevention should be implemented more effectively. Concretely, it is necessary to identify individuals with a high gastric cancer risk for more detailed examination and continuous gastric cancer screening based on their H. pylori infection status and atrophic level.

ABC (D) stratification has already been introduced in some areas for gastric cancer risk screening. However, ABC (D) stratification may have a disadvantage for detecting individuals with high gastric cancer risk. Since individuals in whom H. pylori has been eradicated and individuals with a high atrophic level who have a high gastric cancer risk are often classified into group A in ABC (D) stratification[28-30], the false-negative rate is a problem. Thus, since even if individuals in group A in ABC (D) stratification can develop gastric cancer[31], the combined use of image-based inspection is mandatory for evaluation of gastric cancer risk[32]. Photofluorography or endoscopy remains the gold standard of gastric cancer mass screening in Japan since clinicians can examine conditions of the stomach through the images. Hence, supporting image-based inspections will lead to more efficient gastric cancer mass screening.

Endoscopy is superior to photofluorography for detection of cancerous lesions in image-based inspections[33]. In Japan, endoscopy has been recommended for gastric cancer mass screening programs in addition to photofluorography since 2016. Results of studies in South Korea have provided useful suggestions. In South Korea, a selective (i.e., photofluorography or endoscopy) gastric cancer mass screening program was started in 2002[34,35]. Lee et al[33] reported that the proportion of individuals who underwent endoscopic examination in the National Cancer Screening Program (NCSP) in South Korea increased greatly from 31.15% in 2002 to 72.55% in 2011. The NCSP provides biennial gastric cancer mass screening with either photofluorography or endoscopy for men and women over 40 years of age. On the other hand, the proportion of individuals who underwent photofluorography in the NCSP decreased from 68.85% in 2002 to 32.8% in 2011. Lee et al[33] also reported that the rate of participation in the NCSP increased from 7.40% in 2002 to 45.40% in 2011, and the number of individuals examined by photofluorography increased in accordance with an overall increase in the percentage of participants in the NCSP in South Korea. This indicates the importance of automatic gastric cancer risk classification systems for photofluorography even under the condition of selective gastric cancer mass screening. In Japan, it will take a long time to establish endoscopic examinations due to an insufficient number of medical specialists and regional disparities of clinicians. The uneven distribution of clinicians who have experience in endoscopy is a bottleneck for endoscopic mass screening. Furthermore, the number of individuals who can be examined in one day by endoscopy is much smaller than the number of individuals who can be examined by photofluorography. Although photofluorography involves radiation exposure, facilities have been constructed and inspection methods have been established. Each type of inspection has advantages and disadvantages, the above-described situation should be considered for establishing a gastric cancer risk classification system[36].

In this study, we developed an automatic gastric cancer risk classification system as a preliminary study. Our system analyzes X-ray images and provides H. pylori infection status or atrophic severity level. It should be noted that the most important classification is the first stage, and the second stage is a supplementary experiment to verify whether our system can perform more detailed atrophic level classification. Experimental results indicated that risk-based information can be provided by our system. In the first stage, the most important risk classification, 88.9% of the subjects were correctly classified into the low gastric cancer risk group (H. pylori non-infection) and the high risk group (H. pylori infection). The purpose of our system is to improve the final accuracy of clinicians’ diagnosis by providing risk-based information from image data. Gastric cancer risk information based on X-ray images is useful for identification of high-risk individuals and for reducing the burden on clinicians. Results of studies on identification of risk information for gastric cancer from photofluorography and examination of its application should be helpful for the future of gastric cancer mass screening. Moreover, the threshold determining each risk group in our system can be continuously changed depending on the demands of clinicians. Namely, it is possible to decrease false negative cases by enhancing sensitivity based on the threshold for gastric cancer mass screening. Therefore, the combination of the results of ABC (D) stratification and our system will provide more reliable information for clinicians.

As an example of gastric cancer mass screening using our system, more specific examinations can be performed for individuals who have positive results in the first stage and had not received H. pylori eradication therapy are led to more specific examinations. The Japanese national health insurance now covers H. pylori eradication therapy for H. pylori-infected patients with gastritis detected by endoscopic examination. If those patients have positive results in the examination, H. pylori eradication therapy will be conducted and they will be followed up by gastric cancer screening.

Our study has some limitations. First, although the gold standard of our system was ABC (D) stratification and H. pylori eradication history, there are often contain false negative or false positive cases. Ideally, H. pylori infection status and atrophic level should be evaluated by radiological findings of photofluorography or endoscopy, and these results should be used for the gold standard. However, since this preliminary study focused on mass screening data, we utilized ABC (D) stratification as the simplest inspection with a high objectivity. Secondly, the exclusion rule of this study is our limitation. The advantage of image-based risk information is that gastric cancer risk information can be estimated from individuals who have undergone H. pylori eradication therapy since the presence or absence of atrophy of the stomach remains a key factor for them. However, H. pylori-eradicated individuals and individuals with suspected false negative results of ABC (D) stratification were excluded from our study due to the lack of a gold standard of ABC (D) stratification. Instead, we performed a supplemental experiment for evaluation of stomach atrophy in this study. We will target H. pylori-eradicated individuals and suspected false negative individuals as a future work.

We presented a gastric cancer risk classification system using photofluorography as a preliminary study. The first step of our experimental results indicates that gastric cancer risk information can be provided by machine learning techniques. Although further investigation and improvements of the system are needed, it is expected that collaborative use of image-based risk information derived by our system and ABC (D) stratification will enable more accurate evaluation of gastric cancer risk.

ARTICLE HIGHLIGHTS

Research background

Gastric cancer is one of the most common malignancies, and has the highest mortality rates in East Asian countries. Although ABC (D) stratification is effective method for evaluating gastric cancer risk, photofluorography still plays an important role in gastric cancer mass screening since image-based evaluation is mandatory.

Research motivation

If gastric cancer risk information can be provided automatically by analyzing X-ray images, it would be helpful for the future of gastric cancer mass screening.

Research objectives

The aim of this study was investigation of potential of machine learning techniques using photofluorography.

Research methods

We developed an automatic gastric cancer risk classification system for identification of Helicobacter pylori infection status and atrophic level from photofluorography. All of 2100 patients’ data were acquired at the Medical Examination Center of Yamagata City Medical Association in Japan, from April 2012 to March 2013. From DICOM data, we extracted the image data while securing anonymity.

Research results

Experimental results suggested that image-based risk information can be calculated by our system.

Research conclusions

Although further investigation and improvement of the system are needed, this retrospective study indicated that machine learning techniques analyzing X-ray images can provide effective gastric cancer risk information. Also, we discussed the potential of machine learning techniques and the future of gastric cancer mass screening.

Research perspectives

In the field of breast cancer, computer-aided supporting systems have already become a part of routine clinical work for detection of breast cancer or abnormalities. Gastric cancer as well as breast cancer requires effective and highly accurate mass screening. We believe that this preliminary study will contribute the next step of the future of gastric cancer mass screening.