KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

A Motion Detection Approach based on UAV Image Sequence

  • Cui, Hong-Xia (College of Information Science and Technology, Bohai University) ;
  • Wang, Ya-Qi (College of Information Science and Technology, Bohai University) ;
  • Zhang, FangFei (Institute of Foresty, Beijing Foresty University) ;
  • Li, TingTing (College of Information Science and Technology, Bohai University)
  • Received : 2016.10.08
  • Accepted : 2017.12.28
  • Published : 2018.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Aiming at motion analysis and compensation, it is essential to conduct motion detection with images. However, motion detection and tracking from low-altitude images obtained from an unmanned aerial system may pose many challenges due to degraded image quality caused by platform motion, image instability and illumination fluctuation. This research tackles these challenges by proposing a modified joint transform correlation algorithm which includes two preprocessing strategies. In spatial domain, a modified fuzzy edge detection method is proposed for preprocessing the input images. In frequency domain, to eliminate the disturbance of self-correlation items, the cross-correlation items are extracted from joint power spectrum output plane. The effectiveness and accuracy of the algorithm has been tested and evaluated by both simulation and real datasets in this research. The simulation experiments show that the proposed approach can derive satisfactory peaks of cross-correlation and achieve detection accuracy of displacement vectors with no more than 0.03pixel for image pairs with displacement smaller than 20pixels, when addition of image motion blurring in the range of 0~10pixel and 0.002variance of additive Gaussian noise. Moreover,this paper proposes quantitative analysis approach using tri-image pairs from real datasets and the experimental results show that detection accuracy can be achieved with sub-pixel level even if the sampling frequency can only attain 50 frames per second.

Keywords

References

  1. Whitehead K., Hugenholtz C., et al. "Remote sensing of the environment with small unmanned aircraft systems," Journal of Unmanned Vehicle Systems, vol.2, no.3, pp. 69-85, 2014 https://doi.org/10.1139/juvs-2014-0006
  2. Lin Z., "UAV borne low altitude photogrammetry system," in Proc. of International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XXXIX-B1, pp. 415-423, 2012.
  3. Cui H., Lin Z., et al., "Multiview Photogrammetry Using Low Altitude Digital Images From Unmanned Airship," Optical Electrical Engineering , vol.35, no.7, pp.73-78, 2008.
  4. Taha Z., Tang Y.R., Yap K. C., "Development of an onboard system for flight data collection of a small-scale UAV helicopter," Mechatronics, vol.21, no.1, pp. 132-144, 2011. https://doi.org/10.1016/j.mechatronics.2010.09.008
  5. Smidl V., Hofman R., "Tracking of atmospheric release of pollution using unmanned aerial Vehicles," Atmospheric Environment, vol.67, pp.425-436, 2013. https://doi.org/10.1016/j.atmosenv.2012.10.054
  6. Malihi S.,Maboudi M., Pourmomen M., "Misalignment Calibration of Ultracam D and XP," ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Inf. Sci., vol XXXIX-B1, pp. 577-579, 2012
  7. Alamus R., Kornus W. and Talaya J., "Studies on DMC geometry," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 60, no. 6, pp. 375-386, 2006. https://doi.org/10.1016/j.isprsjprs.2006.05.006
  8. Pejic, M., "Airborne digital sensors: LH Systems ADS 40," Military Technical Courier, vol. 52, no.1, pp.87-98, 2004.
  9. Tchernykh, V., Harnisch, B., "Compensation of focal plane image motion perturbations with optical correlator in feedback loop," in Proc.of Sensors, Systems, and Next-Generation Satellites, vol. 5570, pp.280-288, 2004.
  10. Janschek, K., Tchernykh, V., Dyblenko, S, "Performance analysis of opto-mechatronic image stabilization for a compact space camera," Control Engineering Practice, vo.15, no.30, pp. 333-347, 2007. https://doi.org/10.1016/j.conengprac.2006.02.010
  11. Qian, Y.X., Hong, X.T., Jin, W.M., "Motion measurement of dual-CCD imaging system based on optical correlator," Chinese Journal of Lasers, vol.40, no.7, pp.160-165, 2013.
  12. Fan, C., Li, Y.C., Fu, H.L., Liang, Y., "Research on measurement method of image motion of space camera based on optical correlator," Acta Optica Sinica, vol.31, no.7, pp.1213-1216, 2011.
  13. Feng, D., Feng, M., Ozer, E., Fukuda, Y., "A vision-based sensor for noncontact structural displacement measurement," Sensors, vo.15, no.7, pp. 16557-16575, 2015. https://doi.org/10.3390/s150716557
  14. Schumacher, T., Shariati, A., "Monitoring of structures and mechanical systems using virtual visual sensors for video analysis: Fundamental concept and proof of feasibility," Sensors , vol.13, no.12, pp.16551-16564, 2013. https://doi.org/10.3390/s131216551
  15. Fukuda, Y., Feng, M.Q., Narita, Y., Kaneko, S., et al. "Vision-based displacement sensor for monitoring dynamic response using robust object search algorithm," IEEE Sensors Journal, vol, 13, no.13, pp. 1928-1931, 2010.
  16. Li, C., Yin, S., Yu F., "Non zero-order joint transform correlator," Opt. Eng. Vol.37, no.1, 58-65, 1998. https://doi.org/10.1117/1.601856
  17. Javidi, B., Wang, J., "Binary nonlinear joint transform correlation with median and subset median Thresholding," Applied Optics, vol.30, no.8, 967-976, 1991. https://doi.org/10.1364/AO.30.000967
  18. Hong X, Qian Y., "High-accuracy measurement of sub-pixel image motion based on hybrid photoelectirc joint transform correlator," Acta Optica Sinica, vol.35, no.2, 321-331, 2015.
  19. Heng, L., Lee, G., Pollefeys, M, "Self-Calibration and Visual SLAM with a Multi-Camera System on a Micro Aerial Vehicle," Autonomous Robots, vo.39, no.3, pp.259-277, 2015. https://doi.org/10.1007/s10514-015-9466-8
  20. Canny J., "A computational approach to edge detection," Readings in Computer Vision, pp. 184-203, 1987.
  21. Haralick, R. M., "Digital step edges from zero-crossings of second directional derivatives," Readings in Computer Vision, pp 216-226, 1987.
  22. Yi, H., Zhao, H., Li, Y., "Improved digital processing method used for image motion measurement based on hybrid opto-digital joint transform correlator," Chinese Optics Letters, 8, 989-992, 2010. https://doi.org/10.3788/COL20100810.0989
  23. Ouchi, K., "Ship detection based on coherence image derived from cross-correlation of multilook SAR images," IEEE Trans.geosci.remote Sens.lett, vol.1, no.3, 184-187, 2004. https://doi.org/10.1109/LGRS.2004.827462
  24. Zhang, D., Guo, J., Lei, X., Zhu, C.G., "A High-Speed Vision-Based Sensor for Dynamic Vibration Analysis Using Fast Motion Extraction Algorithms," Sensors, vol. 16, no. 4, 57201-57217, 2016.
  25. Pal, S.K., King, R.A., "Image enhancement using fuzzy sets". IEEE Electronics Letters, vol.16, no.10, 376-378, 1980. https://doi.org/10.1049/el:19800267
  26. Pushpa, D., Pate,V., Kumar, T., Sadhna, M. A., " Novel Fuzzy Image Enhancement using S-Shaped Membership Function", International Journal of Computer Science and Information Technologies, vol.6 ,no.1.564-569,2015.
  27. Madasu, H., Devendra, Jha., "An Optimal Fuzzy System for Color Image Enhancement", IEEE Transactions on Image Processing, vol.15,no.10,pp. 2956-2966,2006. https://doi.org/10.1109/TIP.2006.877499
  28. Loo, C., Alam, M., "Invariant object tracking using fringe-adjusted joint transform correlator," Optical Engineering, vol.43, no.9, pp.2175-2183, 2004. https://doi.org/10.1117/1.1779622
  29. Wu, D., Zhang, Y., Cao, L., "Improved algorithm of fuzzy edge detection," Laser&Infrared, vol.40, no.12, 1374-1377, 2010.
  30. Bhandari A., Kumar A., Singh G., "Modified artificial bee colony based computationally efficient multilevel thresholding for satellite image segmentation using Kapur's, Otsu and Tsallis functions," Expert Systems with Applications , vol. 42, no. 3, pp. 1573-1601, 2014. https://doi.org/10.1016/j.eswa.2014.09.049

Cited by

  1. A System for the Detection of Persons in Intelligent Buildings Using Camera Systems—A Comparative Study vol.20, pp.12, 2020, https://doi.org/10.3390/s20123558