Browse > Article
http://dx.doi.org/10.7472/jksii.2020.21.4.117

Design of Video Pre-processing Algorithm for High-speed Processing of Maritime Object Detection System and Deep Learning based Integrated System  

Song, Hyun-hak (Information and communication, Hoseo University)
Lee, Hyo-chan (Information and communication, Hoseo University)
Lee, Sung-ju (Information and communication, Hoseo University)
Jeon, Ho-seok (Information and communication, Hoseo University)
Im, Tae-ho (Information and communication, Hoseo University)
Publication Information
Journal of Internet Computing and Services / v.21, no.4, 2020 , pp. 117-126 More about this Journal
Abstract
A maritime object detection system is an intelligent assistance system to maritime autonomous surface ship(MASS). It detects automatically floating debris, which has a clash risk with objects in the surrounding water and used to be checked by a captain with a naked eye, at a similar level of accuracy to the human check method. It is used to detect objects around a ship. In the past, they were detected with information gathered from radars or sonar devices. With the development of artificial intelligence technology, intelligent CCTV installed in a ship are used to detect various types of floating debris on the course of sailing. If the speed of processing video data slows down due to the various requirements and complexity of MASS, however, there is no guarantee for safety as well as smooth service support. Trying to solve this issue, this study conducted research on the minimization of computation volumes for video data and the increased speed of data processing to detect maritime objects. Unlike previous studies that used the Hough transform algorithm to find the horizon and secure the areas of interest for the concerned objects, the present study proposed a new method of optimizing a binarization algorithm and finding areas whose locations were similar to actual objects in order to improve the speed. A maritime object detection system was materialized based on deep learning CNN to demonstrate the usefulness of the proposed method and assess the performance of the algorithm. The proposed algorithm performed at a speed that was 4 times faster than the old method while keeping the detection accuracy of the old method.
Keywords
Ship Detection; Deep Learning; Image Processing; Binarization; Horizon Detection; Multi Connected-component Labeling;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 M. Antonini, T. H. Vu, C. Min, A. Montanari, A. Mathur, and F. Kawsar, "Resource Characterisation of Personal-Scale Sensing Models on Edge Accelerators," in Proceedings of the First International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things - AIChallengeIoT'19, 2019. https://doi.org/10.1145/3363347.3363363
2 T. Praczyk, "A quick algorithm for horizon line detection in marine images," Journal of Marine Science and Technology, vol. 23, no. 1, pp. 164-177, Jul. 2017. https://doi.org/10.1007/s00773-017-0464-8   DOI
3 C. Y. Jeong, H. S. Yang, and K. Moon, "Fast horizon detection in maritime images using region-of-interest," International Journal of Distributed Sensor Networks, vol. 14, no. 7, pp. 1-11, Jul. 2018. https://doi.org/10.1177/1550147718790753
4 J.-R. Lee, K.-R. Bae, and B. Moon, "A Hardware Architecture of Hough Transform Using an Improved Voting Scheme," The Journal of Korea Information and Communications Society, vol. 38A, no. 9, pp. 773-781, Sep. 2013. https://doi.org/10.7840/kics.2013.38A.9.773
5 L. Di Stefano and A. Bulgarelli, "A simple and efficient connected components labeling algorithm," in Proceedings 10th International Conference on Image Analysis and Processing, pp. 322-327, 1999. https://doi.org/10.1109/ICIAP.1999.797615
6 D. Bradley and G. Roth, "Adaptive Thresholding using the Integral Image," Journal of Graphics Tools, vol. 12, no. 2, pp. 13-21, Jan. 2007. https://doi.org/10.1080/2151237X.2007.10129236   DOI
7 N. Otsu, "A Threshold Selection Method from Gray-Level Histograms," IEEE Transactions on Systems, Man, and Cybernetics, vol. 9, no. 1, pp. 62-66, Jan. 1979. https://doi.org/10.1109/TSMC.1979.4310076   DOI
8 Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, no. 7553, pp. 436-444, May 2015. https://doi.org/10.1038/nature14539   DOI
9 A. Krizhevsky and G. Hinton, "Convolutional Deep Belief Networks on CIFAR-10", Unpublished Manuscript, Vol.40, pp. 1-9, 2010.
10 H. Rezatofighi, N. Tsoi, J. Gwak, A. Sadeghian, I. Reid, and S. Savarese, "Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression," in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019. https://doi.org/10.1109/CVPR.2019.00075
11 S. Li and K. S. Fung, "Maritime autonomous surface ships (MASS): implementation and legal issues," Maritime Business Review, vol. 4, no. 4, pp. 330-339, Nov. 2019. https://doi.org/10.1108/MABR-01-2019-0006   DOI
12 J. S. Lee, S. K. Lee, D. W. Kim, S. J. Hong, and S. I. Yang, "Trends on Object Detection Techniques Based on Deep Learning," Electronics and Telecommunications Trends, vol. 33, no. 4, pp. 23-32, Aug. 2018. https://doi.org/10.22648/ETRI.2018.J.330403   DOI
13 S. W. Lee, G. D. Lee, J. G. Ko, S. J. Lee, and W. Y. Yoo, "Recent Trends of Object and Scene Recognition Technologies for Mobile/ Embedded Devices," Electronics and Telecommunications Trends, vol. 34, no. 6, pp. 133-144, Dec. 2019. https://doi.org/10.22648/ETRI.2019.J.340612
14 N. S. Sanjay and A. Ahmadinia, "MobileNet-Tiny: A Deep Neural Network-Based Real-Time Object Detection for Rasberry Pi," IEEE International Conference On Machine Learning And Applications (ICMLA), 2019. https://doi.org/10.1109/ICMLA.2019.00118
15 H. Zhao, W. Zhang, H. Sun, and B. Xue, "Embedded Deep Learning for Ship Detection and Recognition," Future Internet, vol. 11, no. 2, p. 53, Feb. 2019. https://doi.org/10.3390/fi11020053   DOI