Browse > Article
http://dx.doi.org/10.3837/tiis.2019.01.018

Adaptive Weight Collaborative Complementary Learning for Robust Visual Tracking  

Wang, Benxuan (Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence, Jiangnan University)
Kong, Jun (Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence, Jiangnan University)
Jiang, Min (Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence, Jiangnan University)
Shen, Jianyu (Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence, Jiangnan University)
Liu, Tianshan (Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence, Jiangnan University)
Gu, Xiaofeng (Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence, Jiangnan University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.13, no.1, 2019 , pp. 305-326 More about this Journal
Abstract
Discriminative correlation filter (DCF) based tracking algorithms have recently shown impressive performance on benchmark datasets. However, amount of recent researches are vulnerable to heavy occlusions, irregular deformations and so on. In this paper, we intend to solve these problems and handle the contradiction between accuracy and real-time in the framework of tracking-by-detection. Firstly, we propose an innovative strategy to combine the template and color-based models instead of a simple linear superposition and rely on the strengths of both to promote the accuracy. Secondly, to enhance the discriminative power of the learned template model, the spatial regularization is introduced in the learning stage to penalize the objective boundary information corresponding to features in the background. Thirdly, we utilize a discriminative multi-scale estimate method to solve the problem of scale variations. Finally, we research strategies to limit the computational complexity of our tracker. Abundant experiments demonstrate that our tracker performs superiorly against several advanced algorithms on both the OTB2013 and OTB2015 datasets while maintaining the high frame rates.
Keywords
Visual tracking; correlation filter; complementary learning; adaptive weight; collaborative model;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 J. Gao, H. Ling, W. Hu, and J. Xing, "Transfer learning based visual tracking with gaussian processes regression," in Proc. of European Conference on Computer Vision, pp. 188-203, September 6-12, 2014.
2 J. Zhang, S. Ma, and S. Sclaroff, "MEEM: robust tracking via multiple experts using entropy minimization," in Proc. of European Conference on Computer Vision, pp. 188-203, September 6-12, 2014.
3 S. Hare, S. Golodetz, A. Saffari, V. Vineet, M.-M. Cheng, S. L. Hicks, and P. H. Torr, "Struck: Structured output tracking with kernels," IEEE transactions on pattern analysis and machine intelligence, vol. 38, no. 10, pp. 2096-2109, October, 2016.   DOI
4 J. F. Henriques, C. Rui, P. Martins, and J. Batista, "High-Speed Tracking with Kernelized Correlation Filters," IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 37, no. 3, pp. 583-596, March, 2015.   DOI
5 M. Danelljan, F. Shahbaz Khan, M. Felsberg, and J. Van de Weijer, "Adaptive color attributes for real-time visual tracking," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1090-1097, June 23-28, 2014.
6 M. Danelljan, G. Hager, F. S. Khan, and M. Felsberg, "Accurate Scale Estimation for Robust Visual Tracking," in Proc. of British Machine Vision Conference, pp. 65.1-65.11, September 1-5, 2014.
7 M. Danelljan, G. Hager, F. S. Khan, and M. Felsberg, "Discriminative Scale Space Tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 8, pp. 1561-1575, August, 2017.   DOI
8 C. Ma, X. Yang, C. Zhang, and M.-H. Yang, "Long-term correlation tracking," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5388-5396, June 7-13, 2015.
9 L. Bertinetto, J. Valmadre, J. F. Henriques, A. Vedaldi, and P. H. Torr, "Fully-convolutional siamese networks for object tracking," in Proc. of European Conference on Computer Vision, pp. 850-865, October 8-16, 2016.
10 R. Tao, E. Gavves, and A. W. Smeulders, "Siamese instance search for tracking," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1420-1429, June 27-30, 2016.
11 L. Bertinetto, J. Valmadre, S. Golodetz, O. Miksik, and P. H. S. Torr, "Staple: Complementary Learners for Real-Time Tracking," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1401-1409, June 27-30, 2016.
12 M. Danelljan, G. Hager, F. Shahbaz Khan, and M. Felsberg, "Learning spatially regularized correlation filters for visual tracking," in Proc. of the IEEE International Conference on Computer Vision, pp. 4310-4318, December 7-13, 2015.
13 S. Walk, N. Majer, K. Schindler, and B. Schiele, "New features and insights for pedestrian detection," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1030-1037, June 13-18, 2010.
14 J. Choi, H. J. Chang, J. Jeong, Y. Demiris, and Y. C. Jin, "Visual Tracking Using Attention-Modulated Disintegration and Integration," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4321-4330, June 27-30, 2016.
15 T. Zhang, C. Xu, and M. H. Yang, "Learning Multi-task Correlation Particle Filters for Visual Tracking," IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018.
16 M. Danelljan, G. Bhat, F. S. Khan, and M. Felsberg, "ECO: Efficient Convolution Operators for Tracking," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6931-6939, July 21-26, 2017.
17 H. Nam and B. Han, "Learning Multi-domain Convolutional Neural Networks for Visual Tracking," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4293-4302, June 27-30, 2016.
18 J. Gao, T. Zhang, X. Yang, and C. Xu, "Deep Relative Tracking," IEEE Transactions on Image Processing, vol. 26, no. 4, pp. 1845-1858, April, 2017.   DOI
19 K. Nummiaro, E. Koller-Meier, and L. Van Gool, "An adaptive color-based particle filter," Image and vision computing, vol. 21, no. 1, pp. 99-110, January, 2003.   DOI
20 P. Perez, C. Hue, J. Vermaak, and M. Gangnet, "Color-based probabilistic tracking," European Conference on Computer Vision, pp. 661-675, May 28-31, 2002.
21 H. Possegger, T. Mauthner, and H. Bischof, "In defense of color-based model-free tracking," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2113-2120, June 7-12, 2015.
22 T. Kobayashi, A. Hidaka, and T. Kurita, "Selection of histograms of oriented gradients features for pedestrian detection," in Proc. of Int. Conference on Neural Information Processing, pp. 598-607, November 13-16, 2007.
23 Y. Li and J. Zhu, "A Scale Adaptive Kernel Correlation Filter Tracker with Feature Integration," in Proc. of European Conference on Computer Vision, pp. 254-265, September 6-12, 2014.
24 M. Danelljan, G. Hager, F. S. Khan, and M. Felsberg, "Adaptive Decontamination of the Training Set: A Unified Formulation for Discriminative Visual Tracking," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1430-1438, June 27-30, 2016.
25 J. Ning, J. Yang, S. Jiang, L. Zhang, and M.-H. Yang, "Object tracking via dual linear structured SVM and explicit feature map," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4266-4274, June 27-30, 2016.
26 M. Danelljan, G. Hager, F. Shahbaz Khan, and M. Felsberg, "Convolutional features for correlation filter based visual tracking," in Proc. of the IEEE International Conference on Computer Vision Workshops, pp. 621-629, December 7-13, 2015.
27 D. S. Bolme, J. R. Beveridge, B. A. Draper, and Y. M. Lui, "Visual object tracking using adaptive correlation filters," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2544-2550, June 13-18, 2010.
28 Y. H. Jang, J. K. Suh, K. J. Kim, and Y. J. Choi, "Robust Target Model Update for Mean-shift Tracking with Background Weighted Histogram," KSII Transactions on Internet & Information Systems, vol. 10, pp. 181-207, March, 2016.
29 C. Bo and D. Wang, "Robust Online Object Tracking with a Structured Sparse Representation Model," KSII Transactions on Internet & Information Systems, vol. 10, no. 5, pp. 2346-2362, May, 2016.   DOI
30 X. Zhu, X. Song, X. Chen, Y. Bai, and H. Lu, "Size Aware Correlation Filter Tracking with Adaptive Aspect Ratio Estimation," KSII Transactions on Internet & Information Systems, vol. 11, no. 2, pp. 805-825, February, 2017.   DOI
31 Y. Wu, J. Lim, and M. H. Yang, "Online Object Tracking: A Benchmark," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2411-2418, June 23-28, 2013.
32 Y. Wu, J. Lim, and M. H. Yang, "Object Tracking Benchmark," IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 37, no. 9, pp. 1834-1848, September, 2015.   DOI