Browse > Article
http://dx.doi.org/10.3837/tiis.2014.09.013

Improved image alignment algorithm based on projective invariant for aerial video stabilization  

Yi, Meng (Institute of Intelligent Control and Image Engineering, Xidian University)
Guo, Bao-Long (Institute of Intelligent Control and Image Engineering, Xidian University)
Yan, Chun-Man (College of Physics and Electronic Engineering, Northwest Normal University)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.8, no.9, 2014 , pp. 3177-3195 More about this Journal
Abstract
In many moving object detection problems of an aerial video, accurate and robust stabilization is of critical importance. In this paper, a novel accurate image alignment algorithm for aerial electronic image stabilization (EIS) is described. The feature points are first selected using optimal derivative filters based Harris detector, which can improve differentiation accuracy and obtain the precise coordinates of feature points. Then we choose the Delaunay Triangulation edges to find the matching pairs between feature points in overlapping images. The most "useful" matching points that belong to the background are used to find the global transformation parameters using the projective invariant. Finally, intentional motion of the camera is accumulated for correction by Sage-Husa adaptive filtering. Experiment results illustrate that the proposed algorithm is applied to the aerial captured video sequences with various dynamic scenes for performance demonstrations.
Keywords
Image alignment; Electronic image stabilization; Delaunay triangulation; Projective invariant;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Peter Meer, Sudhir Ramakrishna and Reiner Lenz, "Correspondence of coplanar features through P2-invariant representations," Applications of Invariance in Computer Vision, vol.825, pp. 473-492, 1994.   DOI   ScienceOn
2 Chun-ming Xie, Yan Zhao and Ji-nan Wang, "Application of an improved adaptive Kalman filter to transfer alignment of airborne missile INS," Proc. SPIE, vol.7, no.129, pp.260-266, 2008.
3 Andrey Litvin, Janusz Konrad and William C. Karl, "Probabilistic video stabilization using Kalman filtering and mosaicking," IS&T/SPIE Symposium on Electronic Imaging, Image and Video Communications and Proc, 2003.
4 Yasuyuki Matsushita, Eyal Ofek, Xiaoou Tang and Heung-Yeung Shum, "Full-frame Video Stabilization," Microsoft Research Asia. CVPR, 2005.
5 Feng Liu and Hailin Jin, "Content-preserving warps for 3D video stabilization," Proceeding SIGGRAPH'09 ACM SIGGRAPH, vol.28, no.3, 2009.
6 Lucio Mercenaro, Gianni Vernazza and Carlo S. Regazzoni, "Image stabilization algorithms for video-surveillance applicaion," In Proc. ICIP, pp.349-352, 2001.
7 Tao Zhao and Ram Nevatia, "Car detection in low resolution aerial images," Image and vision computing, vol.21, no.8, pp.693-703, 2003.   DOI   ScienceOn
8 Gary. F.Templeton, "Video image stabilization and registration technology," communications of the ACM, vol.49, no.2, pp.15-18, 2006.
9 Sheng-Che Hsu, Sheng-Fu Liang and Chin-Teng Lin, "A robust digital image stabilization technique based on inverse triangle method and background detection," Transactions on Consumer Electronics, vol.51, no.2, pp.335-345, 2005.   DOI   ScienceOn
10 Chi-Han Chuang,Yung-Chi-Lo and Chin-Chun Chang, "Multiple object motion detection for robust image stabilization using blocak based hough transform," IIH-MSP, pp.623-625, 2010.
11 Puglisi Giovanni and Battiato Sebastiano, "A robust image alignment algorithm for video stabilization purposes," Transactions on circuits and systems for video technology, vol.21, no.10, pp.1390-1401, 2011.   DOI   ScienceOn
12 Battiato Sebastiano and Rastislav Lukac, "Video stabilization techniques," Encyclopedia of Multimedia. New York: Springer-Verlag, pp. 941-945, 2008.
13 Ben Tordoff and David W Murray, "Guided sampling and consensus for motion estimation," European Conference n Computer Vision, 2002.
14 Filippo Vella, Alfio Castoorina, Massimo Mancuso and Giuseppe Messina, "Digital image stabilization by adaptive block motion vectors filtering," IEEE Trans. on Consumer Electronics, vol.48, no.3, pp. 796-801, 2002.   DOI   ScienceOn
15 Sung-Jea Ko, Sung-Hee Lee and Kyung-Hoon Lee, "Digital image stabilizing algorithms based on bit-plane matching," IEEE Trans. on Consumer Electronics, vol.44, no.3, pp. 617-622, 1998.   DOI   ScienceOn
16 S. Erturk, "Digital image stabilization with sub-image phase correlation based global motion estimation," IEEE Trans. on Consumer Electronics, vol. 49, no.4, pp.1320-1325, 2003.   DOI   ScienceOn
17 Cheng-Hua Pai, Yu-Ping Lin and Gerard G. Medioni, "Moving Object Detection on a Runway Prior to Landing Using an Onboard Infrared Camera," CVPR'07, pp.17-22, 2007.
18 Sebastiano Battiato, Arcangelo Ranieri Bruna and Giovanni Puglisi, "A robust block based image/video registraiton approach for mobile imaging devices," Trans.Multimedia. vol.12, no.7, pp.622-635, 2010.   DOI   ScienceOn
19 Juan-Juan Zhu and Bao-Long Guo, "Global point tracking based panoramic image stabilization system," Optoelectronics Letters, vol.5, no.1, pp.61-63, 2009.   DOI
20 Junlan Yang, Dan Schonfelda and Magdi Mohamed, "Robust video stabilization based on particle filter tracking of projected camera motion," Trans.Circuits Syst.Video Technol, vol.19, no.7, pp.945-954, 2009.   DOI   ScienceOn
21 J.M.Wang, H.P.Chou, S.W. Chen and C.S. Fuh, "Video stabilization for a hand-held camera Based on 3D Motion Model," ICIP, pp.7-10, 2009.
22 David G. Lowe, Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, vol.60, no.2, pp.91-110, 2004.   DOI   ScienceOn
23 Lianming Xu, Zhongliang Deng and Ling Fang. "Research on an Anti-Perturbation Kalman Filter Algorithm," Journal of Networks, vol.6, no.10, pp.1430-1436, 2011.
24 Cordelia Schmid, Roger Mohr and Christian Bauckhage, "Evaluation of interest point detectors," Int. J. Comput. Vis., vol.37, no.2, pp.151-172, 2000.   DOI   ScienceOn
25 Chris Harris and Mike Stephens. "A combined corner and edge detector," Alvey vision conference, pp. 147-152, 1988.
26 Lidong Xu and Xinggang Lin, "Digital image stabilization based on circular block matching," IEEE Trans. on Consumer Electronics, vol.52, no.2, pp.566-574, 2006.   DOI   ScienceOn
27 Qing Zhu, Bo Wu, and Neng Wan, "A Subpixel location method for interest points by means of the harris interest strength," Photogrammetric Record, vol.22, no.120, pp. 321-335, 2007.   DOI   ScienceOn
28 Krystian Mikolajczyk and Cordelia Schmid, "An affine invariant interest point detector," in Proc. of European Conference on Computer Vision, ECCV, pp.128-142, 2002.
29 Hany Farid and Eero. P. Simoncelli, Differentiation of discrete multi-dimensional signals, IEEE Transctions on Image Processing, vol.13, no.4, pp. 496-508, 2004.   DOI   ScienceOn
30 Qing Zhu, Yunsheng Zhang, Bo Wu and Yeting Zhang, "Multiple Close-range Image Matching Based on a Self-adaptive Triangle Constraint," Photogrammetric Record, vol.25, no.132, pp.437-453, 2010.   DOI   ScienceOn
31 Emanuele Trucco, "Geometric Invariance in Computer Vision. Cambridge," MA: MIT Press, 1992.
32 Lianming Xu, Zhongliang Deng and Ling Fang, Research on an Anti-Perturbation Kalman Filter Algorithm," Journal of Networks, vol.6, no.10, pp.1430-1436, 2011.
33 Tinne Tuytelaars and Krystian Mikolajczyk, "Local invariant feature detectors: a survey," Foundations and Trends in Computer Graphics and Vision, vol.3, no.3, pp.177-280, 2008.
34 Martin A. Fischler and Robert C. Bolles, "Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography," Commun.ACM, pp.381-395, 1981.
35 Franco P. Preparata and Michael I. Shamos, "Computational geometry: An introduction," New York: Springer-Verlag, pp.95-226, 1985.
36 Chen. H., Liang. C.K., Peng. Y.C., Chang. H.A, "Integration of digital stabilizer with video codec for digital video cameras," Trans.Circuits Syst. Video Technol, vol.17, no.7, pp. 801-813, 2007.   DOI   ScienceOn