Browse > Article
http://dx.doi.org/10.9708/jksci.2019.24.03.087

Deep Learning based violent protest detection system  

Lee, Yeon-su (Dept. of Software, Sangmyung University)
Kim, Hyun-chul (Dept. of Software, Sangmyung University)
Abstract
In this paper, we propose a real-time drone-based violent protest detection system. Our proposed system uses drones to detect scenes of violent protest in real-time. The important problem is that the victims and violent actions have to be manually searched in videos when the evidence has been collected. Firstly, we focused to solve the limitations of existing collecting evidence devices by using drone to collect evidence live and upload in AWS(Amazon Web Service)[1]. Secondly, we built a Deep Learning based violence detection model from the videos using Yolov3 Feature Pyramid Network for human activity recognition, in order to detect three types of violent action. The built model classifies people with possession of gun, swinging pipe, and violent activity with the accuracy of 92, 91 and 80.5% respectively. This system is expected to significantly save time and human resource of the existing collecting evidence.
Keywords
Collecting evidence; drone; deep learning; detection; AWS;
Citations & Related Records
연도 인용수 순위
  • Reference
1 ZHANG, Jianming, et al. A real-time chinese traffic sign detection algorithm based on modified YOLOv2. Algorithms, Vol. 10 Issue 4, p127. 13p, Dec2017.
2 GoogleAPI "https://support.google.com/webmasters/answer/1061943?hl=ko"
3 Google crawling using selenium "https://www.slideshare.net/winglessagl/seleniu-61525457"
4 Image capture FFmpeg "https://www.ffmpeg.org/"
5 Thumos Challenge2015 "http://www.thumos.info/download.html"
6 Large Scale Visual Recognition Challenge 2014"http://www.image-net.org/challenges/LSVRC/2014/"
7 SZEGEDY, Christian, et al. Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition. CVPR , p. 1-9, June 2015.
8 Labeling Yolo_mark "https://github.com/AlexeyAB/Yolo_mark"
9 REDMON, Joseph; FARHADI, Ali. YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition. CVPR, p. 7263-7271, July 2017.
10 Lin, Tsung-Yi, et al. "Feature pyramid networks for object detection." CVPR. Vol. 1. No. 2. July 2017.
11 Tistory Blog yeonsu "http://yeonsuuu-uuu.tistory.com/"
12 Live streaming RTMP Server "http://blog.manycam.com/rtmp-live-stream/#.XATy5hMzbcM"
13 SINGH, Amarjot; PATIL, Devendra; OMKAR, S. N. Eye in the Sky: Real-time Drone Surveillance System (DSS) for Violent Individuals Identification using ScatterNet Hybrid Deep Learning Network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, p. 1629-1637, June 2018
14 AWS(AmazonWebService) "https://aws.amazon.com/?nc2=h_lg"
15 Naver about protest "https://terms.naver.com/entry.nhn?docId=1820712&cid=46634&categoryId=46634"
16 ChosunIlbo, ratio of demonstration "http://news.chosun.com/site/data/html_dir/2018/11/03/2018110300250.html"
17 Navernews research about drone "http://www.sportsseoul.com/news/read/617479"
18 CatChaser(2016)ByRobertBond Nvidia "https://devblogs.nvidia.com/ai-cat-chaser-jetson-tx1-caffe"
19 How To Do Real Time Object Detection OnDroneVideoStreams "https://blog.nanonets.com/real-time-object-detection-for-drones/?utm_source=facebook&utm_medium=social&utm_campaign=drone&utm_content=group_DeepLearnng&fbclid=IwAR34ULqditi4eM3Gvm-Ic84lM6LDA9ElQR6bmFaIsqRRJ1_hgauCgMTa-v8"
20 REDMON, Joseph; FARHADI, Ali. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767, April 2018.
21 AWS Amazon Simple Storage Service "https://aws.amazon.com/s3/?nc2=type_a"