KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Extended kernel correlation filter for abrupt motion tracking

  • Zhang, Huanlong (College of electric and information engineering, Zhengzhou University of Light Industry) ;
  • Zhang, Jianwei (Software Engineering College, Zhengzhou University of Light Industry) ;
  • Wu, Qinge (College of electric and information engineering, Zhengzhou University of Light Industry) ;
  • Qian, Xiaoliang (College of electric and information engineering, Zhengzhou University of Light Industry) ;
  • Zhou, Tong (College of electric and information engineering, Zhengzhou University of Light Industry) ;
  • FU, Hengcheng (College of electric and information engineering, Zhengzhou University of Light Industry)
  • Received : 2017.02.19
  • Accepted : 2017.05.16
  • Published : 2017.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The Kernelized Correlation Filters (KCF) tracker has caused the extensive concern in recent years because of the high efficiency. Numerous improvements have been made successively. However, due to the abrupt motion between the consecutive image frames, these methods cannot track object well. To cope with the problem, we propose an extended KCF tracker based on swarm intelligence method. Unlike existing KCF-based trackers, we firstly introduce a swarm-based sampling method to KCF tracker and design a unified framework to track smooth or abrupt motion simultaneously. Secondly, we propose a global motion estimation method, where the exploration factor is constructed to search the whole state space so as to adapt abrupt motion. Finally, we give an adaptive threshold in light of confidence map, which ensures the accuracy of the motion estimation strategy. Extensive experimental results in both quantitative and qualitative measures demonstrate the effectiveness of our proposed method in tracking abrupt motion.

Keywords

References

  1. H. Zhang, S. Hu, X. Zhang, and L. Luo, "Visual Tracking via Constrained Incremental Nonnegative Matrix Factorization," IEEE signal processing letters, vol. 22, no. 9, pp.1350-1353, September, 2015. https://doi.org/10.1109/LSP.2015.2404856
  2. T. Zhang, B. Ghanem, S. Liu, C. Xu and N. Ahuja, "Robust Visual Tracking via Exclusive Context Modeling," IEEE Transactions on Cybernetics, vol. 46, no.1, pp. 51-63, January, 2016. https://doi.org/10.1109/TCYB.2015.2393307
  3. D. Wang and H. Lu, "Fast and Robust Object Tracking via Probability Continuous Outlier Model," IEEE Transaction on Image Processing, vol. 24, no. 12, pp. 5166-5176, December, 2015. https://doi.org/10.1109/TIP.2015.2478399
  4. T. Zhang, S. Liu, N. Ahuja, M.-H. Yang and B. Ghanem, "Robust Visual Tracking Via Consistent Low-Rank Sparse Learning," International Journal of Computer Vision, vol. 111, no. 2, pp. 171-190, January, 2015. https://doi.org/10.1007/s11263-014-0738-0
  5. H. Zhang, Y. Wang, L. Luo, X. Lu, M. Zhang, "SIFT flow for abrupt motion tracking via adaptive samples selection with sparse representation," Neurocomputing, vol. 249, no. 2, pp. 253-265, August, 2017. https://doi.org/10.1016/j.neucom.2017.04.024
  6. S. Hare, et al., "Struck: Structured Output Tracking with Kernels," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 10, pp. 2096-2109, October, 2016. https://doi.org/10.1109/TPAMI.2015.2509974
  7. D. S. Bolme, et al., "Visual object tracking using adaptive correlation filters," in Proc. of 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2544-2550, August, 2010.
  8. J. F. Henriques, et al., "High-Speed Tracking with Kernelized Correlation Filters," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 37, no. 3, pp. 583-596, March, 2015. https://doi.org/10.1109/TPAMI.2014.2345390
  9. M. Tang, and J. Feng, "Multi-Kernel Correlation Filter for Visual Tracking," in Proc. of the IEEE International Conference on Computer Vision (ICCV), pp. 3038-3046, December, 2015.
  10. M. Danelljan, G. Hger, F.S. Khan, and M. Felsberg, "Accurate scale estimation for robust visual tracking," in Proc. of the British Machine Vison Conference BMVC, September, 2014.
  11. Y. Li and J. Zhu, "A scale adaptive kernel correlation filter tracker with feature integration," in Proc. of Computer Vison-ECCV 2014 Workshops, vol. 8926, pp. 254-265, September, 2014.
  12. K. Zhang, L. Zhang, Q. Liu, D. Zhang, and M.-H. Yang, "Fast visual tracking via dense spatiotemporal context learning," in ECCV, vol. 8693, pp. 127-141, 2014.
  13. T. Liu, G. Wang, and Q. Yang, "Real-time part-based visual tracking via adaptive correlation filters," in Proc. of the IEEE Conference on Computer Vison and Pattern Recognition, pp. 4902-4912, October, 2015.
  14. Y. Li, J. Zhu and Steven C.H., Hoi, "Reliable patch trackers Robust visual tracking by exploiting reliable patches," in Proc of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 353-361, October, 2015.
  15. S. Liu, T. Zhang, X. Cao and C. Xu, "Structural Correlation Filter for Robust Visual Tracking," in Proc of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4312-4320, December, 2016.
  16. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking." IEEE Trans. Pattern Anal. Mach. Intell, vol. 25, no. 5, pp. 564-577, May, 2003. https://doi.org/10.1109/TPAMI.2003.1195991
  17. D. Ross, J. Lim , R. Lin and M-H yang, "Incremental learning for robust visual tracking," International Journal of Computer Vision, vol. 77, no. 1-3, pp. 125-141, May, 2008. https://doi.org/10.1007/s11263-007-0075-7
  18. D. Wang and H. Lu, "Fast and Robust Object Tracking via Probability Continuous Outlier Model," IEEE Transaction on Image Processing, vol. 24, no. 12, pp. 5166-5176, December, 2015. https://doi.org/10.1109/TIP.2015.2478399
  19. J. Kwon and K. M. Lee, "Visual tracking decomposition," in Proc of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1269-1276, August, 2010.
  20. X. Mei and H. Ling, "Robust visual tracking using L1 minimization," in Proc of Computer Vision and Pattern Recognition (CVPR), IEEE Conference on, pp.1436-1443, November, 2009.
  21. C. Bao, Y. Wu., H. Ling and H. Ji, "Real time robust l1 tracker using accelerated proximal gradient approach," in Proc of Computer Vision and Pattern Recognition (CVPR), IEEE Conference on, pp.1830-1837, July, 2012.
  22. T. Zhou, B. Harish, F. Liu and J. Yang, "Graph Regularized and Locality-constrained Coding for Robust Visual Tracking," IEEE Transactions on Circuits and Systems for Video Technology, vol. pp, no. 99, June, 2016.
  23. T. Zhang, B. Ghanem and S. Liu, "Robust Visual Tracking via Structured Multi- Task Sparse Learning," International Journal of Computer Vision, vol. 101, no. 2, pp. 367-388, January, 2013. https://doi.org/10.1007/s11263-012-0582-z
  24. T. Zhang, A. Bibi and B. Ghanem, "In Defense of Sparse Tracking: Circulant Sparse Tracker," Computer Vision and Pattern Recognition (CVPR), pp. 3880-3888, December, 2016.
  25. T. Zhang, S. Liu, C. Xu, S. Yan, B. Ghanem, N. Ahuja, and M.-H. Yang, "Structural Sparse Tracking," Computer Vision and Pattern Recognition (CVPR), pp. 150-158, October, 2015.
  26. S. Avidan, "Support vector tracking," IEEE Trans. Pattern Anal. Mach. Intell, vol. 26, no . 8, pp.1064-1072, August, 2004. https://doi.org/10.1109/TPAMI.2004.53
  27. H. Grabner, M. Grabner, and H. Bischof, "Real-time tracking via on-line boosting," in Proc. of the British Machine Vision Conference, pp. 47-56, January, 2006.
  28. B. Babenko, M. Yang, and S. Belongie, "Visual tracking with online multiple instance learning," in Proc. of the IEEE International Conference on Computer Vision and Pattern Recognition, pp. 983-990, August, 2009.
  29. N. Wang, M. Yang, and D.Y. Yeung, "Learning a deep compact image representation for visual tracking," in Nips, pp. 809-817, January, 2013.
  30. J. Gao, T. Zhang, X. Yang and C. Xu, "Deep Relative Tracking. IEEE Transactions on Image Processing," vol. 26, no. 4, pp. 1845-1858, January, 2017. https://doi.org/10.1109/TIP.2017.2656628
  31. H. Li, Y. Li, and F. Porikli, "Deeptrack: Learning discriminativefeature representations by convolutional neural networks for visual tracking," in Proc. of the British Machine Vision Conference. BMVCPress, January, 2014.
  32. L.Wang, T. Liu, G.Wang, K. L. Chan, and Q. Yang, "Video tracking using learned hierarchical features. Image Processing," IEEE Transactions on, vol. 24, no. 4, pp. 1424-1435, April, 2015. https://doi.org/10.1109/TIP.2015.2403231
  33. S. Bandyopadhyay, et al., "A Simulated Annealing-Based Multiobjective Optimization Alg orithm: AMOSA," IEEE Transactions on Evolutionary Computation, vol. 12, no.3, pp. 26 9- 283, June, 2008. https://doi.org/10.1109/TEVC.2007.900837
  34. J. F. Henrigues, R. Caseiro, P. Martins, and J. Batista, "Exploiting the circulant structure of tracking-by-detection with kernels," in Computer Vison-ECCV 2012, vol. 7575, pp. 702-715, 2012.
  35. K. Zhang, L. Zhang, and M.-H. Yang, "Fast compressive tracking," The IEEE Transactions on Pattern Analysis Machine Intelligence, vol. 36, no. 10, pp. 2002-2015, 2014. https://doi.org/10.1109/TPAMI.2014.2315808
  36. D. Wang, H. Lu and M. Yang, "Robust Visual Tracking via Least Soft-threshold Squares," IEEE Transaction on Circuits and Systems for Video Technology, vol. 26, no. 9, pp. 1709-1721, September, 2016. https://doi.org/10.1109/TCSVT.2015.2462012
  37. Y. Wu, J. Lim and M.-H. Yang, "Online Object Tracking: A Benchmark," in Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411-2418, October, 2013.

Cited by

  1. A new visual tracking approach based on salp swarm algorithm for abrupt motion tracking vol.14, pp.3, 2017, https://doi.org/10.3837/tiis.2020.03.013
  2. Fast motion tracking based on moth-flame optimization and kernel correlation filter vol.39, pp.3, 2017, https://doi.org/10.3233/jifs-192172