Browse > Article
http://dx.doi.org/10.7472/jksii.2022.23.4.57

Deep Learning Based Rescue Requesters Detection Algorithm for Physical Security in Disaster Sites  

Kim, Da-hyeon (Dept. of Software, Korea National University of Transportation)
Park, Man-bok (Dept. of Electronic Engineering, Korea National University of Transportation)
Ahn, Jun-ho (Dept. of Software, Korea National University of Transportation)
Publication Information
Journal of Internet Computing and Services / v.23, no.4, 2022 , pp. 57-64 More about this Journal
Abstract
If the inside of a building collapses due to a disaster such as fire, collapse, or natural disaster, the physical security inside the building is likely to become ineffective. Here, physical security is needed to minimize the human casualties and physical damages in the collapsed building. Therefore, this paper proposes an algorithm to minimize the damage in a disaster situation by fusing existing research that detects obstacles and collapsed areas in the building and a deep learning-based object detection algorithm that minimizes human casualties. The existing research uses a single camera to determine whether the corridor environment in which the robot is currently located has collapsed and detects obstacles that interfere with the search and rescue operation. Here, objects inside the collapsed building have irregular shapes due to the debris or collapse of the building, and they are classified and detected as obstacles. We also propose a method to detect rescue requesters-the most important resource in the disaster situation-and minimize human casualties. To this end, we collected open-source disaster images and image data of disaster situations and calculated the accuracy of detecting rescue requesters in disaster situations through various deep learning-based object detection algorithms. In this study, as a result of analyzing the algorithms that detect rescue requesters in disaster situations, we have found that the YOLOv4 algorithm has an accuracy of 0.94, proving that it is most suitable for use in actual disaster situations. This paper will be helpful for performing efficient search and rescue in disaster situations and achieving a high level of physical security, even in collapsed buildings.
Keywords
Risk of building; Physical security; Deep learning; Disaster sites; Object detection;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Pubulic data portal, "Ministry of Public Administration and Security Accident Status," 2021. https://www.data.go.kr/data/15014225/fileData.do
2 Ministry of the Interior and Safety, "2020 Disaster Yearbook (Social Disaster)," 2021. https://www.mois.go.kr/frt/bbs/type001/commonSelect BoardArticle.do;jsessionid=S6OLepLuc-2k5BZUsGkjYiqS.node30?bbsId=BBSMSTR_000000000014&nttId=89259
3 National Fire Protection Association, "Standard for the Organization and Deployment of Fire Suppression Operations, Emergency Medical Operations, and Special Operations to the Public by Career Fire Departments," 2020. https://www.nfpa.org/codes-and-standards/all-codesand-standards/list-of-codes-and-standards/detail?code=1710
4 Telecommunications Technology Association, "physical security," 2022 http://terms.tta.or.kr/dictionary/dictionaryView.do?subject= %EB%AC%BC%EB%A6%AC%EC%A0%81%%EB%B3%B4%EC%95%88
5 The Science Times, "A 'swarm drone' capable of searching a disaster site," 2019. https://www.sciencetimes.co.kr/news/%EB%AF%B8%EC%A7%80%EC%9D%98-%ED%99%98%EA%B2%BD%EC%9D%84-%ED%83%90%ED%97%98%ED%95%98%EB%8A%94-%EA%B5%B0%EC%A7%91-%EB%93%9C%EB%A1%A0/
6 Y. W Shin and J. H Park, "Analysis of the Effectiveness of Fire Drone Missions at Disaster Sites: An Empirical Approach," Fire Science and Engineering, Vol. 34, No. 5, pp. 112-119, 2020. https://doi.org/10.7731/KIFSE.cba54f4c   DOI
7 FEMA USAR Structural Collapse Technician Student Manual - rule of 3's in survival https://www.fema.gov/pdf/emergency/usr/module1c2.pdf
8 H. S. Moon and W. S. Lee, "Development and Verification of A Module for Positioning Buried Persons in Collapsed Area," Journal of the Korea Academia-Industrial cooperation Society, Vol. 17, No. 12 pp. 427-436, 2016. http://dx.doi.org/10.5762/KAIS.2016.17.12.427   DOI
9 IEEE Spectrum, "Paris Firefighters Used This Remote-Controlled Robot to Extinguish the Notre Dame Blaze," 2019. https://spectrum.ieee.org/colossus-the-firefighting-robotthat-helped-save-notre-dame
10 J. H. Cho, Y. I. Chung and H. H. Park, "A Study on the Improvement of Physical and Personnel Security System in Industry Field," Korea police studies review, Vol.17 No.2, pp.269-290, 2018. https://doi.org/10.38084/2018.17.2.11   DOI
11 A. Bochkovskiy, C. Y. Wang and H. Y. M. Liao, "YOLOv4: Optimal Speed and Accuracy of Object Detection," arXiv, 2020. https://arxiv.org/abs/2004.10934
12 N. H. Park, Y. C. Ahn and Y. J. Hwang, "A Study on the Development of a Remote Control Drone for Disaster Response," The Korean Society of Disaster Information, Vol. 15, No. 4, pp. 578-589, 2019. https://doi.org/10.15683/kosdi.2019.12.31.578   DOI
13 S. J. Kim, D. G. Shin, J. H. Pyo, J. S. Shin, M. L. Jin and J. H Suh, "A Multi-Sensor Module of Snake Robot for Searching Survivors in Narrow Space," Journal of Korea Robotics Society, Vol. 16, No. 4, pp. 291-298, 2021. https://doi.org/10.7746/jkros.2021.16.4.291   DOI
14 S. S. Kim and D. Y. Shin, "Current Status of Technology Development and Policy Recommendations of Disaster Robot for Inaccessible Disaster Site," Journal of the Korea Academia-Industrial cooperation Society, Vol. 22, No. 11 pp. 270-276, 2021. https://doi.org/10.5762/KAIS.2021.22.11.270   DOI
15 T. Y. Lin, P. Dollar, R. Girshick, K. He, B. Hariharan and S. Belongie, "Feature Pyramid Networks for Object Detection," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2117-2125, 2017. http://arxiv.org/abs/1612.03144v2
16 M. Tan, R. Pang and Q. V. Le, "EfficientDet: Scalable and Efficient Object Detection," Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10781-10790, 2020. http://arxiv.org/abs/1911.09070
17 W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Y. Fu and A. C. Berg, "SSD: Single Shot MultiBox Detector," European Conference on Computer Vision (ECCV), pp. 21-37, 2016. http://arxiv.org/abs/1512.02325
18 D. Kim, C. Kim, and J. Ahn, "Vision-based Recognition Algorithm for Up-To-Date Indoor Digital Map Generations at Damaged Buildings," Computers Materials Continua, Vol. 72, No. 2, pp. 2765-2781, 2022. https://doi.org/10.32604/cmc.2022.025116   DOI
19 S. Ren, K. He, R. Girshick and J. Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 39, No. 6, pp. 1137-1149, 2017. https://doi.org/10.1109/TPAMI.2016.2577031   DOI
20 T. Y. Lin, P. Goyal, R. Girshick, K. He and P. Dollar, "Focal Loss for Dense Object Detection," Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 2980-2988, 2017. http://arxiv.org/abs/1708.02002v2
21 OMOROBOT, "OMO R1," 2021. https://omorobot.com/docs/omo-r1/
22 Jeonju MBC, "[rescue site] Fire scene and emergency situation (Jeonju Wansan Fire Station)," 2019. https://youtu.be/0_QU9Pz0phA
23 Y. Y. Woo and J. L. Lee, "Utilization of Drone Technology in Physical Security and Its Limitations," Police Science Institute, Vol. 32, No.3, pp. 255-284. 2018. https://doi.org/10.35147/knpsi.2018.32.3.255   DOI
24 COCO, "COCO-2017". 2017. https://cocodataset.org/#home