Browse > Article
http://dx.doi.org/10.22937/IJCSNS.2021.21.4.18

Abnormal Crowd Behavior Detection Using Heuristic Search and Motion Awareness  

Usman, Imran (College of Computing and Informatics, Saudi Electronic University)
Albesher, Abdulaziz A. (College of Computing and Informatics, Saudi Electronic University)
Publication Information
International Journal of Computer Science & Network Security / v.21, no.4, 2021 , pp. 131-139 More about this Journal
Abstract
In current time, anomaly detection is the primary concern of the administrative authorities. Suspicious activity identification is shifting from a human operator to a machine-assisted monitoring in order to assist the human operator and react to an unexpected incident quickly. These automatic surveillance systems face many challenges due to the intrinsic complex characteristics of video sequences and foreground human motion patterns. In this paper, we propose a novel approach to detect anomalous human activity using a hybrid approach of statistical model and Genetic Programming. The feature-set of local motion patterns is generated by a statistical model from the video data in an unsupervised way. This features set is inserted to an enhanced Genetic Programming based classifier to classify normal and abnormal patterns. The experiments are performed using publicly available benchmark datasets under different real-life scenarios. Results show that the proposed methodology is capable to detect and locate the anomalous activity in the real time. The accuracy of the proposed scheme exceeds those of the existing state of the art in term of anomalous activity detection.
Keywords
abnormal behavior detection; genetic programming; crowd analysis; motion pattern; anomaly;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. B. Mabrouk and E. Zagrouba, "Abnormal behavior recognition for intelligent video surveillance systems: A review," Expert Syst. Appl., vol. 91, pp. 480_491, Jan. 2018.   DOI
2 B. Ramachandra and M. J. Jones, "Street Scene: A new dataset and evaluation protocol for video anomaly detection," arXiv, pp. 2569-2578, 2019.
3 "GPLAB - A Genetic Programming Toolbox for MATLAB." [Online]. Available: http://gplab.sourceforge.net/. [Accessed: 01-Apr-2019].
4 M. Ravanbakhsh, M. Nabi, H. Mousavi, E. Sangineto, and N. Sebe ,"Plug-and-play CNN for crowd motion analysis: An application in abnormal event detection," Proc. - 2018 IEEE Winter Conf. Appl. Comput. Vision, WACV 2018, vol. 2018-January, pp. 1689-1698, 2018, doi: 10.1109/WACV.2018.00188.   DOI
5 W. Sultani, "Real-world Anomaly Detection in Surveillance Videos," pp. 6479-6488.
6 H. Wei, Y. Xiao, R. Li, and X. Liu, "Crowd abnormal detection using two-stream Fully Convolutional Neural Networks norm single frame norm optical flow norm," 2018, doi:10.1109/ICMTMA. 2018.00087.   DOI
7 X. Zhang, Q. Zhang, S. Hu, C. Guo, and H. Yu, "Energy Level-Based Abnormal Crowd Behavior Detection," Sensors, vol. 18, no. 2, Feb. 2018.
8 R. T. Ionescu, F. S. Khan, M. I. Georgescu, and L. Shao, "Object-centric auto-encoders and dummy anomalies for abnormal event detection in video," arXiv, pp. 7842-7851, 2018.
9 J. Wang and L. Xia, "Abnormal behavior detection in videos using deep learning," Cluster Comput., vol. 22, no. s4, pp. 9229-9239, 2019, doi: 10.1007/s10586-018-2114-2.   DOI
10 X. Zhang, Q. Zhang, S. Hu, C. Guo, and H. Yu, "Energy Level-Based Abnormal Crowd Behavior Detection," Sensors, vol. 18, no. 2, Feb. 2018.
11 S. Chaudhary, M. Aamir, and C. Bhatnagar, "Multiple Anomalous Activity Detection in Videos," Procedia Comput. Sci., vol. 125, pp. 336-345, 2018, doi: 10.1016/j.procs.2017.12.045.   DOI
12 A. A. Afiq et al., "A review on classifying abnormal behavior in crowd scene," J. Vis. Commun. Image Represent., vol. 58, pp. 285-303, 2019, doi: 10.1016/j.jvcir.2018.11.035.   DOI
13 E. Duman and O. A. Erdem, "Anomaly Detection in Videos Using Optical Flow and Convolutional Autoencoder," IEEE Access, vol. 7, pp. 183914-183923, 2019, doi: 10.1109/ACCESS.2019.2960654.   DOI
14 C. Direkoglu, "Abnormal Crowd Behavior Detection Using Motion Information Images and Convolutional Neural Networks," IEEE Access, vol. 8, pp. 80408-80416, 2020, doi: 10.1109/ACCESS.2020.2990355.   DOI
15 Y. Zhu, "Motion-Aware Feature for Improved Video Anomaly Detection," p. 12.
16 Q. Sun, H. Liu, and T. Harada, "Online growing neural gas for anomaly detection in changing surveillance scenes," Pattern Recognit., vol. 64, pp. 187-201, Apr. 2017, doi: 10.1016/j.patcog.2016.09.016.   DOI
17 G. Vallathan, A. John, C. Thirumalai, S. K. Mohan, G. Srivastava, and J. C. W. Lin, "Suspicious activity detection using deep learning in secure assisted living IoT environments," J. Supercomput., no. 0123456789, 2020, doi: 10.1007/s11227-020-03387-8.   DOI
18 L. Kratz and K. Nishino, "Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models," in 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 1446-1453.
19 S.Kullback and R.A.Leibler, "On Information and sufficiency," Ann.Math.Stat.,vol.22,no.1,pp.79-86, Mar. 1951.   DOI
20 T. A. Myrvoll and F. K. Soong, "On divergence based clustering of normal distributions and its application to HMM adaptation," EUROSPEECH 2003 - 8th Eur. Conf. Speech Commun. Technol., pp. 1517-1520, 2003.
21 "UCSD Anomaly Detection Dataset." http://www.svcl.ucsd.edu/projects/anomaly/dataset.html (accessed Apr. 16, 2021).
22 W. Liu, W. Luo, D. Lian, and S. Gao, "Future Frame Prediction for Anomaly Detection -- A New Baseline," ArXiv171209867 Cs, Mar. 2018, Accessed: Apr. 19, 2021. [Online]. Available: http://arxiv.org/abs/1712.09867.
23 "Monitoring Human Activity - Home," Apr. 17, 2018. http://mha.cs.umn.edu/ (accessed Apr. 17, 2018).
24 M. Sabokrou, M. Fayyaz, M. Fathy, Z. Moayed, and R. Klette, "Deep- anomaly : Fully convolutional neural network for fast anomaly detection in crowded scenes Mohammad Sabokrou," Comput. Vis. Image Underst., vol. 172, no. February, pp. 88-97, 2018, doi: 10.1016/j.cviu.2018.02.006.   DOI
25 N. Nayan, S. S. Sahu, and S. Kumar, "Detecting anomalous crowd behavior using correlation analysis of optical flow," Signal, Image Video Process., vol. 13, no. 6, pp. 1233-1241, 2019, doi: 10.1007/s11760-019-01474-9.   DOI
26 R. Nawaratne, D. Alahakoon, D. De Silva, and X. Yu, "Spatiotemporal anomaly detection using deep learning for real-time video surveillance," IEEE Trans. Ind. Informatics, vol. 16, no. 1, pp. 393-402, 2020, doi: 10.1109/TII.2019.2938527.   DOI
27 L. Lazaridis, A. Dimou, and P. Daras, "Abnormal Behavior Detection in Crowded Scenes Using Density Heatmaps and Optical Flow," 2018 26th Eur. Signal Process. Conf., pp. 2060-2064, 2018.
28 M. Ye, X. Peng, W. Gan, W. Wu, and Y. Qiao, "AnoPCN: Video Anomaly Detection via Deep Predictive Coding Network," in Proceedings of the 27th ACM International Conference on Multimedia, New York, NY, USA, Oct. 2019, pp. 1805-1813, doi: 10.1145/3343031.3350899.   DOI
29 B. Wang, M. Ye, X. Li, F. Zhao, and J. Ding, "Abnormal crowd behavior detection using high-frequency and spatiotemporal features," Mach. Vis. Appl., vol. 23, no. 3, pp. 501-511, May 2012, doi: 10.1007/s00138-011-0341-0.   DOI
30 R. Mehran, A. Oyama, and M. Shah, "Abnormal crowd behavior detection using social force model," in 2009 IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2009, pp. 935-942, doi: 10.1109/CVPR.2009.5206641.   DOI
31 Y. Zhao, B. Deng, C. Shen, Y. Liu, H. Lu, and X.-S. Hua, "Spatio-Temporal AutoEncoder for Video Anomaly Detection," in Proceedings of the 25th ACM international conference on Multimedia, New York, NY, USA, Oct. 2017, pp. 1933-1941, doi: 10.1145/3123266.3123451.   DOI
32 K. Pawar and V. Attar, "Deep learning approaches for videobased anomalous activity detection," World Wide Web, vol. 22, no. 2, pp. 571-601, 2019, doi: 10.1007/s11280-018-0582-1.   DOI
33 I. Usman, "Anomalous Crowd Behavior Detection in Time Varying Motion Sequences," in 2019 4th World Conference on Complex Systems (WCCS), Apr. 2019, pp. 1-5, doi: 10.1109/ICoCS.2019.8930795.   DOI
34 B. R. Kiran, D. M. Thomas, and R. Parakkal, "An overview of deep learning based methods for unsupervised and semi-supervised anomaly detection in videos," J. Imag., vol. 4, no. 2, p. 36, 2018.   DOI
35 Z. Fan, J. Yin, Y. Song, and Z. Liu, "Real-time and accurate abnormal behavior detection in videos," Mach. Vis. Appl., vol. 31, no. 7-8, pp. 1-13, 2020, doi: 10.1007/s00138-020-01111-3.   DOI
36 W. Luo, W. Liu, and S. Gao, "A Revisit of Sparse Coding Based Anomaly Detection in Stacked RNN Framework," in 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Oct. 2017, pp. 341-349, doi: 10.1109/ICCV.2017.45.   DOI
37 C. Dhiman and D. K. Vishwakarma, "A review of state-of-the-art techniques for abnormal human activity recognition," Eng. Appl. Artif. Intell., vol. 77, pp. 21_45, Jan. 2018.   DOI
38 T. Wang, "Abnormal event detection based on analysis of movement information of video sequence," Optik, vol. 152, pp. 50_60, Jan. 2018.   DOI
39 W. G. Aguilar et al., "Statistical abnormal crowd behavior detection and simulation for real-time applications," In International Conference on Intelligent Robotics and Applications, Springer, Cham., vol. 10463 LNAI, pp. 671-682, 2017, doi: 10.1007/978-3-319-65292-4_58.   DOI
40 Y. Liu, K. Hao, X. Tang, and T. Wang, "Abnormal Crowd Behavior Detection Based on Predictive Neural Network," Proc. 2019 IEEE Int. Conf. Artif. Intell. Comput. Appl. ICAICA 2019, pp. 221-225, 2019, doi: 10.1109/ICAICA.2019.8873488.   DOI
41 K. Singh, S. Rajora, D. K. Vishwakarma, G. Tripathi, S. Kumar, and G. S. Walia, "Crowd anomaly detection using Aggregation of Ensembles of fine-tuned ConvNets," Neurocomputing, vol. 371, pp. 188-198, 2020, doi: 10.1016/j.neucom.2019.08.059.   DOI
42 L. Xia and Z. Li, "A new method of abnormal behavior detection using LSTM network with temporal attention mechanism," J. Supercomput., no. 0123456789, 2020, doi: 10.1007/s11227-020-03391-y.   DOI