Browse > Article

ROI-Based 3D Video Stabilization Using Warping  

Lee, Tae-Hwan (School of Electronic Engineering, Inha University)
Song, Byung-Cheol (School of Electronic Engineering, Inha University)
Publication Information
Journal of the Institute of Electronics Engineers of Korea SP / v.49, no.2, 2012 , pp. 76-82 More about this Journal
Abstract
As the portable camcorder becomes popular, various video stabilization algorithms for de-shaking of camera motion have been developed. In the past, most video stabilization algorithms were based on 2-dimensional camera motion, but recent algorithms show much better performance by considering 3-dimensional camera motion. Among the previous video stabilization algorithms, 3D video stabilization algorithm using content-preserving warps is known as the state-of-the art owing to its superior performance. But, the major demerit of the algorithm is its high computational complexity. So, we present a computationally light full-frame warping algorithm based on ROI (region-of-interest) while providing comparable visual quality to the state-of-the art in terms of ROI. First, a proper ROI with a target depth is chosen for each frame, and full-frame warping based on the selected ROI is applied.
Keywords
video stabilization; 3D motion; segmentation; content preserving warping; full frame warping;
Citations & Related Records
연도 인용수 순위
  • Reference
1 K. Ratakonda, "Real-time digital video stabilization for multi-media applications," IEEE International Symposium on Circuits and Systems, pp. 69-72, 1998.
2 Y. M. Yeh, H. C. Chiang, and S. J. Wang, "A digital camcorder image stabilizer based on gray coded bit-plane block matching," IPPR Conf. Computer Vision, Graphics and Image Processing, Taipei, Taiwan, pp.244-251, 2000.
3 Y. Matsushita, E. Ofek, W. Ge, X. Tang, and H. Y. Shum, "Full-frame video stabilization with motion inpainting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 7, pp. 1150-1163, 2006.   DOI
4 S. Battiato, G. Gallo, G. Puglisi, and S. Scellato, "SIFT features tracking for video stabilization", ICIAP, pp. 825-830, 2007.
5 F. Liu, M. Gleicher, H. Jin, and A. Agarwala, "Content-preserving warps for 3D video stabilization," ACM SIGGRAPH, New York, NY, USA, pp. 1-9, 2009.
6 J. M. Wang, H. P. Chou, S. W. Chen, and C. S. Fuh, "Video stabilization for a hand-held camera based on 3d motion model," IEEE International Conference on Image Processing, pp. 3477-3480, 2009.
7 G. Zhang, W. Hua, X. Qin, Y. Shao, and H. Bao. "Video stabilization based on a 3D perspective camera model," The Visual Computer.
8 M. Alexa, D. Cohen-Or, and D. Levin, "As-rigid-as-possible shape interpolation," ACM SIGGRAPH, New Orleans, USA, pp. 157-164, 2000.
9 T. Igarashi, T. Moscovich, and J. F. Hughes, "As-rigid-as-possible shape manipulation," ACM Trans. Graph., pp.1134-1141, 2005.
10 R. Gal, O. Sorkine, and D. Cohen-Or, "Feature-aware texturing," Eurographics Symposium on Rendering, pp. 297-303, 2006.
11 S. Schaefer, T. McPhail, and J.Warren, "Image deformation using moving least squares," ACM Trans. Graph., vol. 25, no. 3, pp. 533-540, 2006.   DOI   ScienceOn
12 S. Avidan et al., "Seam carving for content-aware image resizing," ACM Trans. Graphics, vol. 26, no. 3, 2007.
13 J. Lee and S. Y. Shin, "General construction of time-domain filters for orientation data," IEEE Trans. Visualization and Computer Graphics, vol. 8, no. 2, pp. 119-128, 2002.   DOI   ScienceOn
14 R. I. Hartley and A. Zisserman, "Multiple view geometry in computer vision," Cambridge University Press, 2000.
15 P. S. Heckbert, "Fundamentals of texture mapping and image warping", Master thesis, Computer Science Division, UC Berkeley, 1989.
16 J. More, "The Levenberg-Marquardt algorithm, implementation, and theory", Springer-Verlag, numerical analysis edition, 1977.
17 B. Triggs, P. McLauchlan, R. I. Hartley, and A. Fitzgibbon, "Bundle adjustment-a modern synthesis." Vision Algorithms: Theory and Practice, pp. 298-373, 1999.
18 T. Jebara, A. Azarbayejani, and A. Pentland, "3D structure from 2D motion", IEEE Signal Processing Magazine, vol. 16, no. 3, pp. 66-84, 1999.   DOI   ScienceOn