Browse > Article
http://dx.doi.org/10.3837/tiis.2018.03.014

A Motion Detection Approach based on UAV Image Sequence  

Cui, Hong-Xia (College of Information Science and Technology, Bohai University)
Wang, Ya-Qi (College of Information Science and Technology, Bohai University)
Zhang, FangFei (Institute of Foresty, Beijing Foresty University)
Li, TingTing (College of Information Science and Technology, Bohai University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.12, no.3, 2018 , pp. 1224-1242 More about this Journal
Abstract
Aiming at motion analysis and compensation, it is essential to conduct motion detection with images. However, motion detection and tracking from low-altitude images obtained from an unmanned aerial system may pose many challenges due to degraded image quality caused by platform motion, image instability and illumination fluctuation. This research tackles these challenges by proposing a modified joint transform correlation algorithm which includes two preprocessing strategies. In spatial domain, a modified fuzzy edge detection method is proposed for preprocessing the input images. In frequency domain, to eliminate the disturbance of self-correlation items, the cross-correlation items are extracted from joint power spectrum output plane. The effectiveness and accuracy of the algorithm has been tested and evaluated by both simulation and real datasets in this research. The simulation experiments show that the proposed approach can derive satisfactory peaks of cross-correlation and achieve detection accuracy of displacement vectors with no more than 0.03pixel for image pairs with displacement smaller than 20pixels, when addition of image motion blurring in the range of 0~10pixel and 0.002variance of additive Gaussian noise. Moreover,this paper proposes quantitative analysis approach using tri-image pairs from real datasets and the experimental results show that detection accuracy can be achieved with sub-pixel level even if the sampling frequency can only attain 50 frames per second.
Keywords
Fourier transform; fuzzy edge detection; motion detection; UAV; photogrammetric mapping and remote sensing;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Alamus R., Kornus W. and Talaya J., "Studies on DMC geometry," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 60, no. 6, pp. 375-386, 2006.   DOI
2 Pejic, M., "Airborne digital sensors: LH Systems ADS 40," Military Technical Courier, vol. 52, no.1, pp.87-98, 2004.
3 Tchernykh, V., Harnisch, B., "Compensation of focal plane image motion perturbations with optical correlator in feedback loop," in Proc.of Sensors, Systems, and Next-Generation Satellites, vol. 5570, pp.280-288, 2004.
4 Janschek, K., Tchernykh, V., Dyblenko, S, "Performance analysis of opto-mechatronic image stabilization for a compact space camera," Control Engineering Practice, vo.15, no.30, pp. 333-347, 2007.   DOI
5 Qian, Y.X., Hong, X.T., Jin, W.M., "Motion measurement of dual-CCD imaging system based on optical correlator," Chinese Journal of Lasers, vol.40, no.7, pp.160-165, 2013.
6 Fan, C., Li, Y.C., Fu, H.L., Liang, Y., "Research on measurement method of image motion of space camera based on optical correlator," Acta Optica Sinica, vol.31, no.7, pp.1213-1216, 2011.
7 Feng, D., Feng, M., Ozer, E., Fukuda, Y., "A vision-based sensor for noncontact structural displacement measurement," Sensors, vo.15, no.7, pp. 16557-16575, 2015.   DOI
8 Schumacher, T., Shariati, A., "Monitoring of structures and mechanical systems using virtual visual sensors for video analysis: Fundamental concept and proof of feasibility," Sensors , vol.13, no.12, pp.16551-16564, 2013.   DOI
9 Fukuda, Y., Feng, M.Q., Narita, Y., Kaneko, S., et al. "Vision-based displacement sensor for monitoring dynamic response using robust object search algorithm," IEEE Sensors Journal, vol, 13, no.13, pp. 1928-1931, 2010.
10 Li, C., Yin, S., Yu F., "Non zero-order joint transform correlator," Opt. Eng. Vol.37, no.1, 58-65, 1998.   DOI
11 Canny J., "A computational approach to edge detection," Readings in Computer Vision, pp. 184-203, 1987.
12 Javidi, B., Wang, J., "Binary nonlinear joint transform correlation with median and subset median Thresholding," Applied Optics, vol.30, no.8, 967-976, 1991.   DOI
13 Hong X, Qian Y., "High-accuracy measurement of sub-pixel image motion based on hybrid photoelectirc joint transform correlator," Acta Optica Sinica, vol.35, no.2, 321-331, 2015.
14 Heng, L., Lee, G., Pollefeys, M, "Self-Calibration and Visual SLAM with a Multi-Camera System on a Micro Aerial Vehicle," Autonomous Robots, vo.39, no.3, pp.259-277, 2015.   DOI
15 Haralick, R. M., "Digital step edges from zero-crossings of second directional derivatives," Readings in Computer Vision, pp 216-226, 1987.
16 Pal, S.K., King, R.A., "Image enhancement using fuzzy sets". IEEE Electronics Letters, vol.16, no.10, 376-378, 1980.   DOI
17 Yi, H., Zhao, H., Li, Y., "Improved digital processing method used for image motion measurement based on hybrid opto-digital joint transform correlator," Chinese Optics Letters, 8, 989-992, 2010.   DOI
18 Ouchi, K., "Ship detection based on coherence image derived from cross-correlation of multilook SAR images," IEEE Trans.geosci.remote Sens.lett, vol.1, no.3, 184-187, 2004.   DOI
19 Zhang, D., Guo, J., Lei, X., Zhu, C.G., "A High-Speed Vision-Based Sensor for Dynamic Vibration Analysis Using Fast Motion Extraction Algorithms," Sensors, vol. 16, no. 4, 57201-57217, 2016.
20 Pushpa, D., Pate,V., Kumar, T., Sadhna, M. A., " Novel Fuzzy Image Enhancement using S-Shaped Membership Function", International Journal of Computer Science and Information Technologies, vol.6 ,no.1.564-569,2015.
21 Bhandari A., Kumar A., Singh G., "Modified artificial bee colony based computationally efficient multilevel thresholding for satellite image segmentation using Kapur's, Otsu and Tsallis functions," Expert Systems with Applications , vol. 42, no. 3, pp. 1573-1601, 2014.   DOI
22 Madasu, H., Devendra, Jha., "An Optimal Fuzzy System for Color Image Enhancement", IEEE Transactions on Image Processing, vol.15,no.10,pp. 2956-2966,2006.   DOI
23 Loo, C., Alam, M., "Invariant object tracking using fringe-adjusted joint transform correlator," Optical Engineering, vol.43, no.9, pp.2175-2183, 2004.   DOI
24 Wu, D., Zhang, Y., Cao, L., "Improved algorithm of fuzzy edge detection," Laser&Infrared, vol.40, no.12, 1374-1377, 2010.
25 Taha Z., Tang Y.R., Yap K. C., "Development of an onboard system for flight data collection of a small-scale UAV helicopter," Mechatronics, vol.21, no.1, pp. 132-144, 2011.   DOI
26 Whitehead K., Hugenholtz C., et al. "Remote sensing of the environment with small unmanned aircraft systems," Journal of Unmanned Vehicle Systems, vol.2, no.3, pp. 69-85, 2014   DOI
27 Lin Z., "UAV borne low altitude photogrammetry system," in Proc. of International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XXXIX-B1, pp. 415-423, 2012.
28 Cui H., Lin Z., et al., "Multiview Photogrammetry Using Low Altitude Digital Images From Unmanned Airship," Optical Electrical Engineering , vol.35, no.7, pp.73-78, 2008.
29 Smidl V., Hofman R., "Tracking of atmospheric release of pollution using unmanned aerial Vehicles," Atmospheric Environment, vol.67, pp.425-436, 2013.   DOI
30 Malihi S.,Maboudi M., Pourmomen M., "Misalignment Calibration of Ultracam D and XP," ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Inf. Sci., vol XXXIX-B1, pp. 577-579, 2012