Browse > Article
http://dx.doi.org/10.14372/IEMEK.2021.16.6.323

Reinforced Feature of Dynamic Search Area for the Discriminative Model Prediction Tracker based on Multi-domain Dataset  

Lee, Jun Ha (Korea Institute of Industrial Technology, Kyungpook National University)
Won, Hong-In (Korea Institute of Industrial Technology)
Kim, Byeong Hak (Korea Institute of Industrial Technology)
Publication Information
Abstract
Visual object tracking is a challenging area of study in the field of computer vision due to many difficult problems, including a fast variation of target shape, occlusion, and arbitrary ground truth object designation. In this paper, we focus on the reinforced feature of the dynamic search area to get better performance than conventional discriminative model prediction trackers on the condition when the accuracy deteriorates since low feature discrimination. We propose a reinforced input feature method shown like the spotlight effect on the dynamic search area of the target tracking. This method can be used to improve performances for deep learning based discriminative model prediction tracker, also various types of trackers which are used to infer the center of the target based on the visual object tracking. The proposed method shows the improved tracking performance than the baseline trackers, achieving a relative gain of 38% quantitative improvement from 0.433 to 0.601 F-score at the visual object tracking evaluation.
Keywords
Visual object tracking; Deep learning; Reinforced feature; Discriminative model prediction;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T. Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollar, C. L. Zitnick, "Microsoft coco: Common Objects in Context," European Conference on Computer Vision. Springer, Cham, pp. 740-755, 2014.
2 G. Bhat, M. Danelljan, L. V. Gool, R. Timofte, "Learning Discriminative Model Prediction for Tracking," Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6182-6191, 2019.
3 B. Li, J. Yan, W. Wu, Z. Zhu, X. Hu., "High Performance Visual Tracking with Siamese Region Proposal Network," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8971-8980, 2018.
4 M. Danelljan, L. V. Gool, R. Timofte, "Probabilistic Regression for Visual Tracking," Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7183-7192, 2020.
5 B. H. Kim, D. Khan, C. Bohak, W. Choi, H. J. Lee, M. Y. Kim, "V-RBNN Based Small Drone Detection in Augmented Datasets for 3D LADAR System," Sensors, Vol. 18, No. 11, pp. 3825, 2018.   DOI
6 B. H. Kim, D. Khan, W. Choi, M. Y. Kim, "Real-time Counter-UAV System for Long Distance Small Drones Using Double Pan-tilt Scan Laser Radar," Laser Radar Technology and Applications XXIV. International Society for Optics and Photonics, pp. 11005, 2019.
7 M. Kristan, A. Leonardis, J. Matas, M. Felsberg, "The Eighth Visual Object Tracking VOT2020 Challenge Results," European Conference on Computer Vision. Springer, Cham, pp. 547-601, 2020.
8 L. Cehovin, "TraX: The Visual Tracking Exchange Protocol and Library," Neurocomputing, Vol. 260, pp. 5-8, 2017.   DOI
9 M. Z. Mekuc, C. Bohak, S. Hudoklin, B. H. Kim , R. Romih, M. Y. Kim, M. Marolt, "Automatic Segmentation of Mitochondria and Endolysosomes in Volumetric Electron Microscopy Data," Computers in Biology and Medicine, Vol. 119, pp. 103693, 2020.   DOI
10 N. Dalal, B. Triggs, "Histograms of Oriented Gradients for Human Detection," 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), Ieee, Vol. 1, pp. 886-893, 2005.
11 T. Lindeberg , "Scale Invariant Feature Transform," pp. 10491, 2012.
12 E. Rosten, T. Drummond, "Machine Learning for High-speed Corner Detection," European conference on computer vision. Springer, Berlin, Heidelberg, pp. 430-443, 2006.
13 S. Kamthania, "A Novel Deep Learning rbm Based Algorithm for Securing Containers," in 2019 IEEE International WIE Conference on Electrical and Computer Engineering (WIECON-ECE), pp. 1-7, 2019.
14 H. C. Shin, H. R. Roth, M. Gao, L. Lu, Z. Xu, I. Nogues, J. Yao, D. Mollura, R. M. Summers, "Deep Convolutional Neural Networks for Computer-aided Detection: Cnn Architectures, Dataset Characteristics and Transfer Learning," IEEE, Vol. 35. No. 5, pp. 1285-1298, 2016.
15 S. C. Huang, C. Fan-Chieh, C. Yi-Sheng, "Efficient Contrast Enhancement Using Adaptive Gamma Correction with Weighting Distribution," IEEE Transactions on Image Processing, Vol. 22, No. 3, pp. 1032-1041, 2012.   DOI
16 L. Huang, X. Zhao, K. Huang, "Got-10k: A Large High-diversity Benchmark for Generic Object Tracking in the Wild," IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019.
17 M. Danelljan, G. Bhat, F. S. Khan, M. Felsberg, "Atom: Accurate Tracking by Overlap Maximization," Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4660-4669, 2019.
18 L. Hou, W. Wan, K. H. Lee, J. N. Hwang, G. Okopal, J, Pitton, "Robust Human Tracking Based on DPM Constrained Multiple-kernel from a Moving Camera," Journal of Signal Processing Systems, Vol. 86, No. 1, pp. 27-39, 2017.   DOI
19 S. J. Lee, B. H. Kim, M. Y. Kim, "Multi-Saliency Map and Machine Learning Based Human Detection for the Embedded Top-View Imaging System," IEEE Access, Vol. 9, pp. 70671-70682, 2021.   DOI
20 L. Bertinetto, J. Valmadre. J. F. Henriques. A. Vedaldi, P. H. S. Torr, "Fully-convolutional Siamese Networks for Object Tracking," European Conference on Computer Vision. Springer, Cham, pp. 850-865, 2016.
21 B. H. Kim, A. Lukezic, J. H. Lee, H. M. Jung, M. Y. Kim, "Global Motion-aware Robust Vobject Tracking for Electro Optical Targeting Systems," Sensors, Vol. 20, No. 2, pp. 566, 2020.   DOI
22 K. Chen, J. Pang, J. Wang, Y. Xiong, X. Li, S. Sun, W. Feng, Z. Liu, J. Shi, W. Ouyang, C. C. Loy, D. Lin, "Hybrid Task Cascade for Instance Segmentation," Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4974-4983, 2019.
23 B. H. Kim, M. Y. Kim, Y. S. Chae, "Background Registration-based Adaptive Noise Filtering of LWIR/MWIR Imaging Sensors for UAV Applications," Sensors, Vol. 18, No. 1, pp. 60, 2018.   DOI
24 I. El-Feghi, A. Tahar, M. Ahmadi, "Efficient Features Extraction for Fingerprint Classification with Multi Layer Perceptron Neural Network," in Eighth International Multi-Conference on Systems, Signals Devices, pp. 1-4, 2011.
25 B. H. Kim, C. Bohak, K. H. Kwon, M. Y. Kim, "Cross Fusion-based low Dynamic and Simage Enhancement for Infrared Search and Tracking Systems," IEEE Access, Vol. 8, pp. 15347-15359, 2020.   DOI
26 H. M. Jung, B. H. Kim, M. Y. Kim, "Residual Forward-Subtracted U-Shaped Network for Dynamic and Static Image Restoration," IEEE Access, Vol. 8, pp. 145401-145412, 2020.   DOI
27 H. Bay, A. Ess, T. Tuytelaars, L. V. Gool, "Surf: Speeded up Robust Features." European conference on computer vision, Springer, Berlin, Heidelberg, Vol. 110, No. 3, pp. 346-359, 2006.
28 Y. Wang, Q. Chen, B. Zhang, "Image Enhancement Based on Equal Area Dualistic Sub-image Histogram Equalization Method," IEEE transactions on Consumer Electronics, Vol. 45, No. 1, pp. 68-75, 1999.   DOI
29 P. Liu, H. Zhang, K. Zhang, L. Lin, W. Zuo, "Multi-level Wavelet-CNN for Image Restoration", Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), pp. 773-782, 2018.
30 H. M. Jung, B. H. Kim, M. Y. Kim, "Residual Forward-Subtracted U-Shaped Network for Dynamic and Static Image Restoration," IEEE Access, Vol. 8, pp. 145401-145412, 2020.   DOI
31 H. Fan, L. Lin, F. Yang, P. Chu, G. Deng, "Lasot: A high-quality benchmark for large-scale single object tracking," Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 5374-5383, 2019.
32 M. Muller, A. Bibi, S. Giancola, S. Alsubaihi, B. Ghanem, "Trackingnet: A Large-scale Dataset and Benchmark for Object Tracking in the Wild," Proceedings of the European Conference on Computer Vision (ECCV), pp. 300-317, 2018.
33 W. Li, Z. Dou, L. Qi, "Communication Protocol Classification Based on lstm and dbn," IEEE Access, Vol. 8, pp. 91818-91828, 2020.   DOI