Browse > Article
http://dx.doi.org/10.9717/kmms.2019.22.12.1415

A New CSR-DCF Tracking Algorithm based on Faster RCNN Detection Model and CSRT Tracker for Drone Data  

Farhodov, Xurshid (Dept. of IT Convergence and Application Engineering, Pukyong National University)
Kwon, Oh-Heum (Dept. of IT Convergence and Application Engineering, Pukyong National University)
Moon, Kwang-Seok (Dept. of Electronics Engineering, Pukyong National University)
Kwon, Oh-Jun (Dept. of Computer Software Engineering, Dongeui University)
Lee, Suk-Hwan (Dept. of Information Security, Tongmyong University)
Kwon, Ki-Ryong (Dept. of IT Convergence and Application Engineering, Pukyong National University)
Publication Information
Abstract
Nowadays object tracking process becoming one of the most challenging task in Computer Vision filed. A CSR-DCF (channel spatial reliability-discriminative correlation filter) tracking algorithm have been proposed on recent tracking benchmark that could achieve stat-of-the-art performance where channel spatial reliability concepts to DCF tracking and provide a novel learning algorithm for its efficient and seamless integration in the filter update and the tracking process with only two simple standard features, HoGs and Color names. However, there are some cases where this method cannot track properly, like overlapping, occlusions, motion blur, changing appearance, environmental variations and so on. To overcome that kind of complications a new modified version of CSR-DCF algorithm has been proposed by integrating deep learning based object detection and CSRT tracker which implemented in OpenCV library. As an object detection model, according to the comparable result of object detection methods and by reason of high efficiency and celerity of Faster RCNN (Region-based Convolutional Neural Network) has been used, and combined with CSRT tracker, which demonstrated outstanding real-time detection and tracking performance. The results indicate that the trained object detection model integration with tracking algorithm gives better outcomes rather than using tracking algorithm or filter itself.
Keywords
Object Tracking; CSR-DCF; Object Detection; CNN; Faster R-CNN; OpenCV; DNN Module; CSRT; Drone; Deep Learning;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 A. Yilmaz, O. Javed, and M. Shah, "Object Tracking: A Survey," ACM Computing Surveys, Vol. 38, No. 4, pp.1-45, 2006.   DOI
2 A. Ali, A. Jalil, J.W. Niu, X.K. Zhao, S. Rathore, J. Ahmed, et al., “Visual Object Tracking-classical and Contemporary Approaches,” Frontiers of Computer Science, Vol. 10, No. 1, pp. 167-188, 2016.   DOI
3 A.H.A. El-Shafie and S.E.D. Habib, "A Survey on Hardware Implementations of Visual Object Trackers," Electrical Engineering and Systems Science, Image and Video Processing, arXiv:1711.02441, 2017.
4 P. Viola and M. Jones, "Robust Real-time Object Detection," Proceeding of Second International Workshop on Statistical and Computational Theories of Vision-modeling, Learning, Computing, and Sampling, pp.1-45, 2001.
5 J.B. Lim and I.K. Ha, “Analysis of Drone Target Search Performance According to Environment Change,” Journal of Korea Multimedia Society, Vol. 22, No. 10, pp. 1178-1186, 2019.   DOI
6 N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," Proceeding of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 20-25, 2005.
7 A. Krizhevsky, I. Sutskever, and Geoffrey E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks," Proceeding of the 25th International Conference on Neural Information Processing Systems, Vol. 1, pp. 1097-1105, 2012.
8 R. Girshick, J. Donahue, T. Darrell, and J. Malik, “Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation,” Computer Vision and Pattern Recognition, Vol. 1, No. 1, pp. 1-8, 2014.
9 R. Girshick, "Fast R-CNN," Computer Vision and Pattern Recognition, Vol. 1, No. 1, pp.1-9, 2015.   DOI
10 R. Girshick, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," Computer Vision and Pattern Recognition, Vol. 1, No. 1, pp. 1-14, 2016.
11 Object Detection, https://en.m.wikipedia.org/wiki/Object_detection, Oct. 2018.
12 S. Phon-Amnuaisuk, K.T. Murata, P. Pavarangkoon, K. Yamamoto, and T. Mizuhara, "Exploring the Applications of Faster R-CNN and Single-shot Multi-box Detection in a Smart Nursery Domain," Computer Vision and Pattern Recognition, arXiv:1808.08675v1, 2018.
13 R.C. Gonzalez and R.E. Woods, Digital Image Processing. Pearson(4 edition), 2017.
14 Faster RCNN, https://towardsdatascience.com/faster-rcnn-object-detection-f865e5ed7fc4, Nov. 2018.
15 Region Proposal Network (RPN)-Backbone of Faster RCNN, https://medium.com/egen/region-proposal-network-rpn-backbone-offaster-r-cnn-4a744a38d7f9, Aug. 2018.
16 Understanding the Impact of Learning Rate on Neural Network Performance, https://machinelearningmastery.com/understand-thedynamics-of-learning-rate-on-deep-learning-neural-networks/, Jan. 2019.
17 A. Lukezic, T. Vojir, L.C. Zajc, J. Matas, and M. Kristan, "Discriminative Correlation Filter Tracker with Channel and Spatial Reliability," International Journal of Computer Vision: Vol. 126, Issue 7, pp. 671-688, 2018.   DOI
18 OpenCV Dnn Module, Net Class Reference, https://docs.opencv.org/master/db/d30/classcv_1_1dnn_1_1Net.html, Nov. 2018.