IEMEK Journal of Embedded Systems and Applications (대한임베디드공학회논문지)

Institute of Embedded Engineering of Korea (대한임베디드공학회)
권호 표지
DOI QR코드

DOI QR Code

Deep Learning based Distress Awareness System for Small Boat

딥러닝 기반 소형선박 승선자 조난 인지 시스템

  • Received : 2022.06.24
  • Accepted : 2022.09.19
  • Published : 2022.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

According to statistics conducted by the Korea Coast Guard, the number of accidents on small boats under 5 tons is increasing every year. This is because only a small number of people are on board. The previously developed maritime distress and safety systems are not well distributed because passengers must be equipped with additional remote equipment. The purpose of this study is to develop a distress awareness system that recognizes man over-board situations in real time. This study aims to present the part of the passenger tracking system among the small ship's distress awareness situational system that can generate passenger's location information in real time using deep learning based object detection and tracking technologies. The system consisted of the following steps. 1) the passenger location information is generated in the form of Bounding box using its detection model (YOLOv3). 2) Based on the Bounding box data, Deep SORT predicts the Bounding box's position in the next frame of the image with Kalman filter. 3) When the actual Bounding Box is created within the range predicted by Kalman-filter, Deep SORT repeats the process of recognizing it as the same object. 4) If the Bounding box deviates the ship's area or an error occurs in the number of tracking occupant, the system is decided the distress situation and issues an alert. This study is expected to complement the problems of existing technologies and ensure the safety of individuals aboard small boats.

Keywords

References

  1. J. S. Yoo, S. J. Baek, Y. S. Lee, "Marine Distress/Rescue System for Marine Vessel Accident Response," Proceeding of KIIT Conference., pp. 463-465, 2017 (in Korean).
  2. Korea Coast Guard, "2020 Statistical Yearbook of Marine Accident," 2020 (in Korean).
  3. B. H. Jeong, "The Operational Concept and Technology Development of GMDSS, a Global Distress Safety System for Ships," Journal of Semiconductor Technology and Science., Vol. 24, No. 10, pp. 1250-1254, 1997 (in Korean).
  4. J. J. Kim, C. H. Hong, D. J. Kim, B. B.l Lee, J. D. Kim, K. N. Ko "The Device for Generation the Distress Signal and Monitoring System for a Survivor based on WSN," Proceeding of KIIT Conference., pp. 215-217, 2010 (in Korean).
  5. S. J. Jeong, J. H. Yim, "Implementation of the Passenger Positioning Systems using Beacon," Journal of the Korea Institute of Information and Communication Engineering., Vol. 20, No. 1, pp. 153-160, 2016 (in Korean). https://doi.org/10.6109/JKIICE.2016.20.1.153
  6. J. S. Yoo, S. J. Baik, Y. S. Lee, "Rescue System for Marine Vessel Accident Response," Proceedings of KIIT Conference., pp. 463-465, 2017 (in Korean).
  7. K. Yun, L. Nguyen, T. Nguyes, D. Kim, S. Eldin, A. Huyen, E. Chow, "Small Target Detection for Search and Rescue Operations Using Distributed Deep Learning and Synthetic Data Generation," In Pattern Recognition and Tracking XXX, Vol. 10995, pp. 38-43, SPIE, 2019
  8. M. E. N. Gomes, D. Macedo, C. Zanchettin, P. S. G. de-Mattos-Neto, A. Oliveira, "Multi-human fall Detection and Localization in Videos," Computer Vision and Image Understanding, 220, 103442, 2022. https://doi.org/10.1016/j.cviu.2022.103442
  9. J, Redmon, A. Farbadi, "YOLOv3: An Incremental Improvement, "arXiv preprint, arXiv:1804.02767, 2018.
  10. N. Wojke, A. Bewley, D. Paulus, "Simple Online and Realtime Tracking with a Deep Association Metric," IEEE International Conference on Image Processing (ICIP), pp. 3645-3649, 2017.
  11. L. Zheng, Z. Bie, Y. Wang, J. Su, C. Wang, S, Q. Tian, "Mars: A Video Benchmark for Large-scale Person Re-identification," In European Conference on Computer Vision, pp. 868-884, 2016.
  12. S. Ren, K. He, R. Girshick, J. Sun, "Faster R-CNN: Toward Real-time Object Detection with Region Proposal Networks," Advances in Neural Information Processing System, No. 28, 2015.
  13. K. Zhou, Y. Yang, A. Cavallaro, T. Xiang, "Omni-scale Feature Learning for Person Re-identification," In Proceedings of the IEEE/CVF International Conference on Computer Vision., pp. 3702-3712, 2019
  14. D. Bolya, C. Zhou, F. Xiao, Y. J. Lee, "YOLACT: Real-time Instance Segmentation," In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9157-9166, 2019.
  15. A. Milan, L. Leal-Taixe, I. Reid, S. Roth, K. Schindler, "MOT16: A Benchmark for Multi-Object Tracking," arXiv preprint, arXiv:1603.00831, 2016.