KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Surf points based Moving Target Detection and Long-term Tracking in Aerial Videos

  • Zhu, Juan-juan (School of Aerospace science and technology, Xidian University) ;
  • Sun, Wei (School of Aerospace science and technology, Xidian University) ;
  • Guo, Bao-long (School of Aerospace science and technology, Xidian University) ;
  • Li, Cheng (School of Aerospace science and technology, Xidian University)
  • Received : 2016.01.23
  • Accepted : 2016.10.13
  • Published : 2016.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

A novel method based on Surf points is proposed to detect and lock-track single ground target in aerial videos. Videos captured by moving cameras contain complex motions, which bring difficulty in moving object detection. Our approach contains three parts: moving target template detection, search area estimation and target tracking. Global motion estimation and compensation are first made by grids-sampling Surf points selecting and matching. And then, the single ground target is detected by joint spatial-temporal information processing. The temporal process is made by calculating difference between compensated reference and current image and the spatial process is implementing morphological operations and adaptive binarization. The second part improves KALMAN filter with surf points scale information to predict target position and search area adaptively. Lastly, the local Surf points of target template are matched in this search region to realize target tracking. The long-term tracking is updated following target scaling, occlusion and large deformation. Experimental results show that the algorithm can correctly detect small moving target in dynamic scenes with complex motions. It is robust to vehicle dithering and target scale changing, rotation, especially partial occlusion or temporal complete occlusion. Comparing with traditional algorithms, our method enables real time operation, processing $520{\times}390$ frames at around 15fps.

Keywords

References

  1. Xianbin Cao, Jinhe Lan, Pingkun Yan, Xuelong Li, "KLT Feature Based Vehicle Detection and Tracking in Airborne Videos," in Proc. of Sixth International Conference on Image and Graphics, pp.673-678, 2011.
  2. E. Molina, Z. Zhu, "Persistent Aerial Video Registration and Fast Multi-View Mosaicing," IEEE Trans. on Image Processing, vol.23, no.5, pp.2184-2192, 2014. https://doi.org/10.1109/TIP.2014.2313183
  3. Peter Reinartz, Marie Lachaise and Elisabeth Schmeer, Thomas Krauss, Hartmut Runge, "Traffic monitoring with serial images from airborne cameras," ISPRS Journal of Photogrammetry and Remote Sensing, Vol.61,pp.149-158, 2006. https://doi.org/10.1016/j.isprsjprs.2006.09.009
  4. Subhabrata Bhattacharya, Haroon Idrees, Imran Saleemi, Saad Ali, "Moving Object Detection and Tracking in Forward Looking Infra-Red Aerial Imagery," Machine Vision Beyond Visible Spectrum Augmented Vision and Reality, Vol.21, pp.221-252, 2011.
  5. Yunfei Wang, Zhaoxiang Zhang, Yunhong Wang, "Moving Object Detection in Aerial Video," in Proc. of International Conf. on Machine Learning and Applications, vol.2, pp.446-450, 2012.
  6. Ido Leichter, Michael Lindenbaum, Ehud Rivlin, "Mean Shift tracking with multiple reference color histograms," Computer Vision and Image Understanding, Vol.114, pp.400-408, 2010. https://doi.org/10.1016/j.cviu.2009.12.006
  7. Myung Hwangbo, Jun-Sik Kim, and Takeo Kanade, "Inertial-Aided KLT Feature Tracking for a Moving Camera," Intelligent Robots and Systems, pp.909-916, 2009.
  8. Hsu-Yung Cheng, Chih-Chia Weng, Yi-Ying Chen, "Vehicle detection in aerial surveillance using dynamic Bayesian networks," IEEE Trans. on Image Processing, vol.21, no.4, pp.2152-2159, 2012. https://doi.org/10.1109/TIP.2011.2172798
  9. Yingqian YANG, Fuqiang LIU, "Vehicle detection methods from an unmanned aerial vehicle platform," in Proc. of IEEE International Conference on Vehicular Electronics and Safety, pp.411-416, 2012.
  10. Xu Zhang, Baolong Guo, Yunyi Yan, Wei Sun, Meng Yi, "Image Retrieval Method Based on IPDSH and SRIP," KSII Transactions on Internet and Information Systems, vol.8, no.5, pp.1676-1689, 2014. https://doi.org/10.3837/tiis.2014.05.010
  11. Szottka, I. and Butenuth, M, "Tracking multiple vehicles in airborne image sequences of complex urban environments," Urban Remote Sensing Event, pp. 13-16, 2011.
  12. Q. Miao, G. Wang, C. Shi, X Lin, Z Ruan, "A new framework for on-line object tracking based on SURF," Pattern Recognition Letters, vol.32, pp.1564-1571, 2011. https://doi.org/10.1016/j.patrec.2011.05.017
  13. D.N. Ta, W.C. Chen, N. Gelfand, and K. Pulli, "SURF Trac: Efficient tracking and continuous object recognition using local feature descriptors," CVPR, pp. 2937-2944, 2009.
  14. Vijay Mahadevan and Nuno Vasconcelos, "Biologically Inspired Object Tracking Using Center-Surround Saliency Mechanisms," IEEE Transactions on Pattern Analysisand Machine Intelligence, vol.35, no.3, pp.541-554, 2013. https://doi.org/10.1109/TPAMI.2012.98
  15. Zhongyu Lou, Guang Jiang, ChengkeWu, "2D scale-adaptive tracking based on projective geometry," Multimed Tools Appl, vol.72, pp.905-924, 2014. https://doi.org/10.1007/s11042-013-1407-y
  16. Tomas Vojir , Jana Noskova, Jiri Matas, "Robust scale-adaptive mean-shift fortracking," Pattern Recognition Letters, vol.49, pp.250-258, 2014. https://doi.org/10.1016/j.patrec.2014.03.025
  17. J. Ning, L. Zhang, D. Zhang, "Robust mean-shift tracking with corrected background-weighted histogram," IET Computer Vision, vol.6, pp.62-69, 2012. https://doi.org/10.1049/iet-cvi.2009.0075
  18. Li Sun and Guizhong Liu, "Visual Object Tracking Based on Combination of Local Description and Global Representation," IEEE Transactionson Circuitsand Systems for Video Technology, vol.21, no.4, pp.408-420, April 2011. https://doi.org/10.1109/TCSVT.2010.2087815
  19. Zhaowei Cai, Longyin Wen, Zhen Lei, Nuno Vasconcelos, and Stan Z. Li, "Robust Deformable and Occluded Object Tracking With Dynamic Graph," IEEE Transactions on Image Processing, vol.23, no.12, pp.5497-5509, December, 2014. https://doi.org/10.1109/TIP.2014.2364919
  20. Bouachir, W., Bilodeau, G.-A, "Structure-aware keypoint tracking for partial occlusion handling," IEEE Conf. on Applications of Computer Vision (WACV), pp.877-884, 2014.
  21. Zarezade, A., Rabiee, H.R., Soltani-Farani, A., Khajenezhad, A., "Patchwise Joint Sparse Tracking With Occlusion Detection," IEEE Transactions on Image Processing, vol.23, no.10, pp.4496-4510, 2014. https://doi.org/10.1109/TIP.2014.2346029
  22. Bing-Fei Wu, Chih-Chung Kao, Cheng-Lung Jen, Yen-Feng Li, Ying-Han Chen, Jhy-Hong Juang, "A Relative-Discriminative-Histogram-of-Oriented-Gradients-Based Particle Filter Approach to Vehicle Occlusion Handling and Tracking," IEEE Transactions on Industrial Electronics, vol.61, no.8, pp.4228-4237, 2014. https://doi.org/10.1109/TIE.2013.2284131
  23. D.G. Lowe, "Distinctive image features from scale-invariant key points," International Journal of Computer Vision, Vol.60, pp.91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  24. H. Bay, T. Tuytelaars, and L. Van Gool, "Surf: Speeded up robust features," European Conference on Computer Vision, pp.404-417, 2006.
  25. Saad Ali, Mubarak Shah, "COCOA-Tracking in Aerial Imagery," SPIE Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications, Orlando, 2006.
  26. D. Comaniciu, V. Ramesh, P. Meer, "Real-Time Tracking of Non-Rigid Objects using Mean Shift," in Proc. of IEEE Conf. Computer Vision and Pattern Recognition, South Carolina, Vol. 2, pp.142-149, 2000.
  27. Y Chai, H Hong, T Kim, "Disjoint Particle Filter to Track Multiple Objects in Real-time," KSII Transactions on Internet and Information Systems (TIIS), Vol.8, No.5, pp.1711-1725, May 2014. https://doi.org/10.3837/tiis.2014.05.012

Cited by

  1. WePBAS: A Weighted Pixel-Based Adaptive Segmenter for Change Detection vol.19, pp.12, 2016, https://doi.org/10.3390/s19122672
  2. A reliable quasi-dense corresponding points for structure from motion vol.14, pp.9, 2020, https://doi.org/10.3837/tiis.2020.09.012