Browse > Article
http://dx.doi.org/10.3745/JIPS.02.0127

Class-Labeling Method for Designing a Deep Neural Network of Capsule Endoscopic Images Using a Lesion-Focused Knowledge Model  

Park, Ye-Seul (Dept. of Electrical and Computer Engineering, Ajou University)
Lee, Jung-Won (Dept. of Electrical and Computer Engineering, Ajou University)
Publication Information
Journal of Information Processing Systems / v.16, no.1, 2020 , pp. 171-183 More about this Journal
Abstract
Capsule endoscopy is one of the increasingly demanded diagnostic methods among patients in recent years because of its ability to observe small intestine difficulties. It is often conducted for 12 to 14 hours, but significant frames constitute only 10% of whole frames. Thus, it has been designed to automatically acquire significant frames through deep learning. For example, studies to track the position of the capsule (stomach, small intestine, etc.) or to extract lesion-related information (polyps, etc.) have been conducted. However, although grouping or labeling the training images according to similar features can improve the performance of a learning model, various attributes (such as degree of wrinkles, presence of valves, etc.) are not considered in conventional approaches. Therefore, we propose a class-labeling method that can be used to design a learning model by constructing a knowledge model focused on main lesions defined in standard terminologies for capsule endoscopy (minimal standard terminology, capsule endoscopy structured terminology). This method enables the designing of a systematic learning model by labeling detailed classes through differentiation of similar characteristics.
Keywords
Capsule Endoscopy; Class-labeling Method; Deep Learning; Knowledge Base (KB); Ontology;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Lujan-Sanchis, E. Perez-Cuadrado-Robles, J. Garcia-Lledo, J, F. J. Fernandez, L. Elli, V. A. Jimenez- Garcia, et al., "Role of capsule endoscopy in suspected celiac disease: a European multi-centre study," World Journal of Gastroenterology, vol. 23, no. 4, pp. 703-711, 2017.   DOI
2 H. Chen, X. Wu, G. Tao, and Q. Peng, "Automatic content understanding with cascaded spatial-temporal deep framework for capsule endoscopy videos," Neurocomputing, vol. 229, pp. 77-87, 2017   DOI
3 Y. Yuan and M. Q. H. Meng, "Deep learning for polyp recognition in wireless capsule endoscopy images," Medical Physics, vol. 44, no. 4, pp. 1379-1389, 2017.   DOI
4 P. Li, Z. Li, F. Gao, L. Wan, and J. Yu, "Convolutional neural networks for intestinal hemorrhage detection in wireless capsule endoscopy images," in Proceedings of 2017 IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, China, 2017, pp. 1518-1523.
5 T. Zhou, G. Han, B. N. Li, Z. Lin, E. J. Ciaccio, P. H. Green, and J. Qin, "Quantitative analysis of patients with celiac disease by video capsule endoscopy: a deep learning method," Computers in Biology and Medicine, vol. 85, pp. 1-6, 2017.   DOI
6 L. Aabakken, B. Rembacken, O. LeMoine, K. Kuznetsov, J. F. Rey, T. Rosch, G. Eisen, P. Cotton, and M. Fujino, "Minimal standard terminology for gastrointestinal endoscopy-MST 3.0," Endoscopy, vol. 41, no. 8, pp. 727-728, 2009.   DOI
7 L. Y. Korman, M. Delvaux, G. Gay, F. Hagenmuller, M. Keuchel, S. Friedman, et al., "Capsule endoscopy structured terminology (CEST): proposal of a standardized and structured terminology for reporting capsule endoscopy procedures," Endoscopy, vol. 37, no. 10, pp. 951-959, 2005.   DOI
8 S. Bejakovic, R. Kumar, T. Dassopoulos, G. Mullin, and G. Hager, "Analysis of Crohn's disease lesions in capsule endoscopy images," in Proceedings of 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan, 2009, pp. 2793-2798.
9 R. Kumar, Q. Zhao, S. Seshamani, G. Mullin, G. Hager, and T. Dassopoulos, "Assessment of Crohn's disease lesions in wireless capsule endoscopy images," IEEE Transactions on Biomedical Engineering, vol. 59, no. 2, pp. 355-362, 2011.   DOI
10 E. Gal, A. Geller, G. Fraser, Z. Levi, and Y. Niv, "Assessment and validation of the new capsule endoscopy Crohn's disease activity index (CECDAI)," Digestive Diseases and Sciences, vol. 53, no. 7, pp. 1933-1937, 2008.   DOI
11 S. Segui, M. Drozdzal, G. Pascual, P. Radeva, C. Malagelada, F. Azpiroz, and J. Vitria, "Generic feature learning for wireless capsule endoscopy analysis," Computers in Biology and Medicine, vol. 79, pp. 163-172, 2016.   DOI
12 X. Jia and M. Q. H. Meng, "A study on automated segmentation of blood regions in wireless capsule endoscopy images using fully convolutional networks," in Proceedings of 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI), Melbourne, Australia, 2017, pp. 179-182.
13 D. Moneghini, G. Missale, L. Minelli, and R. Cestari, "P.18.2 upper and lower gastrointestinal lesions overlooked at conventional endoscopy and further diagnosed with small bowel capsule endoscopy: the crucial role of endoscopic experience in patients with obscure gastrointestinal bleeding," Digestive and Liver Disease, vol. 48(Suppl. 2), p. e216, 2016.
14 A. Bar-Gil Shitrit, B. Koslowsky, D. M. Livovsky, D. Shitrit, K. Paz, T. Adar, S. N. Adler, and E. Goldin, "A prospective study of fecal calprotectin and lactoferrin as predictors of small bowel Crohn's disease in patients undergoing capsule endoscopy," Scandinavian Journal of Gastroenterology, vol. 52, no. 3, pp. 328-333, 2017.   DOI
15 M. Fischer, S. Siva, J. M. Wo, and H. M. Fadda, "Assessment of small intestinal transit times in ulcerative colitis and Crohn's disease patients with different disease activity using video capsule endoscopy," AAPS Pharmscitech, vol. 18, no. 2, pp. 404-409, 2017.   DOI
16 B. Taha, N. Werghi, and J. Dias, "Automatic polyp detection in endoscopy videos: a survey," in Proceedings of 2017 13th IASTED International Conference on Biomedical Engineering (BioMed), Innsbruck, Austria, 2017, pp. 233-240.
17 X. Jia and M. Q. H. Meng, "A deep convolutional neural network for bleeding detection in wireless capsule endoscopy images," in Proceedings of 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, 2016, pp. 639-642.
18 X. Jia and M. Q. H. Meng, "Gastrointestinal bleeding detection in wireless capsule endoscopy images using handcrafted and CNN features," in Proceedings of 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Seogwipo, Korea, 2017, pp. 3154-3157.
19 X. Li, H. Zhang, X. Zhang, H. Liu, and G. Xie, "Exploring transfer learning for gastrointestinal bleeding detection on small-size imbalanced endoscopy images," in Proceedings of 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Seogwipo, Korea, 2017, pp. 1994-1997.
20 X. Wu, H. Chen, T. Gan, J. Chen, C. W. Ngo, and Q. Peng, "Automatic hookworm detection in wireless capsule endoscopy images," IEEE Transactions on Medical Imaging, vol. 35, no. 7, pp. 1741-1752, 2016.   DOI
21 E. J. Ciaccio, C. A. Tennyson, G. Bhagat, S. K. Lewis, and P. H. Green, "Classification of videocapsule endoscopy image patterns: comparative analysis between patients with celiac disease and normal individuals," Biomedical Engineering Online, vol. 9, article no. 44, 2010.
22 H. Nakawala, R. Bianchi, L. E. Pescatori, O. De Cobelli, G. Ferrigno, and E. De Momi, ""Deep-Onto" network for surgical workflow and context recognition," International Journal of Computer Assisted Radiology and Surgery, vol. 14, no. 4, pp. 685-696, 2019.   DOI
23 K. Pogorelov, K. R. Randel, C. Griwodz, S. L. Eskeland, T. de Lange, D. Johansen, et al., "Kvasir: a multiclass image dataset for computer aided gastrointestinal disease detection," in Proceedings of the 8th ACM on Multimedia Systems Conference, Taipei, Taiwan, 2017, pp. 164-169.
24 J. Chen, Y. Zou, and Y. Wang, "Wireless capsule endoscopy video summarization: a learning approach based on Siamese neural network and support vector machine," in Proceedings of 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico, 2016, pp. 1303-1308.
25 K. Yan, Y. Peng, V. Sandfort, M. Bagheri, Z. Lu, and R. M. Summers, "Holistic and comprehensive annotation of clinically significant findings on diverse CT images: learning from radiology reports and label ontology," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, 2019, pp. 8523-8532.
26 T. Zheng, Y. Gao, F. Wang, C. Fan, X. Fu, M. Li, Y. Zhang, S. Zhang, and H. Ma, "Detection of medical text semantic similarity based on convolutional neural network," BMC Medical Informatics and Decision Making, vol. 19, article no.156, 2019.