Browse > Article
http://dx.doi.org/10.5573/ieie.2014.51.12.130

Video Deblurring using Camera Motion Estimation and Patch-wise Deconvolution  

Jeong, Woojin (Dept. of Computer Science & Engineering, Hanyang University)
Park, Jin Wook (Dept. of Computer Science & Engineering, Hanyang University)
Lee, Jong Min (Dept. of Computer Science & Engineering, Hanyang University)
Song, Tae Eun (Optronics System Group, Samsung Thales)
Choi, Wonju (Optronics System Group, Samsung Thales)
Moon, Young Shik (Dept. of Computer Science & Engineering, Hanyang University)
Publication Information
Journal of the Institute of Electronics and Information Engineers / v.51, no.12, 2014 , pp. 130-139 More about this Journal
Abstract
Undesired camera shaking can make a blur effect, which causes a degradation of video quality. We propose an efficient method of removing the blur effects on video captured from a single camera. The proposed method has a sequential process that is applied to each frame. The first stage is to estimate the camera motion for each frame. In order to estimate the camera motion, we compute the optical flow using 3 consecutive frames. Then a patch-wise image deconvolution is applied. During the deconvolution, edge prediction is used to improve the quality of image deconvolution. After patch-wise image deconvolution, deblurred patches are integrated into an image to produce a deblurred frame. The above process is performed for each frame. The experimental result shows that the proposed method removes the blur effect efficiently.
Keywords
deblurring; video deblurring; camera motion; motion estimation; patch;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Q. Shan, J. Jia, and A. Agarwala, "High-quality motion deblurring from a single image," ACM Transactions on Graphics (TOG), Vol. 27, No. 3, 2008.
2 R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, and W. T. Freeman, "Removing camera shake from a single photograph," ACM Transaction on Graphics(TOG), Vol. 25, No. 3, pp. 787-794, 2006
3 S. H. Cho, and S. Y. Lee, "Fast motion deblurring," ACM Transactions on Graphics (TOG), Vol. 28, No. 5, 2009.
4 L. Xu, and J. Jia, "Two-phase kernel estimation for robust motion deblurring," In Computer Vision-ECCV 2010, pp. 157-170, Springer Berlin Heidelberg, 2010.
5 L. Yuan, J. Sun, L. Quan, and H. Y. Shum, "Image deblurring with blurred/noisy image pairs," ACM Transactions on Graphics (TOG), Vol. 26, No. 3, 2007.
6 N. Joshi, S. B. Kang, C. L. Zitnick, and R. Szeliski, "Image deblurring using inertial measurement sensors," ACM Transactions on Graphics (TOG), Vol. 29, No. 4, 2010.
7 M. Ben-Ezra, and S. K. Nayar, "Motion deblurring using hybrid imaging," Computer Vision and Pattern Recognition (CVPR), Vol. 1, 2003.
8 Y. W. Tai, H. Du, M. S. Brown, and S. Lin, "Image/video deblurring using a hybrid camera," Computer Vision and Pattern Recognition (CVPR), Vol. 1, 2003.
9 Y. Li, S. B. Kang, N. Joshi, S. and M. Seitz, "Generating sharp panoramas from motion-blurred videos," Computer Vision and Pattern Recognition (CVPR), pp. 2424-2431, 2010.
10 S. H. Cho, J. Wang, and S. Y. Lee, "Video deblurring for hand-held cameras using patch-based synthesis," ACM Transactions on Graphics (TOG) Vol. 31, No. 4, 2012.
11 N. D. Narvekar, and L. J. Karam, "A no-reference image blur metric based on the cumulative probability of blur detection (CPBD)," IEEE Transactions on Image Processing, Vol. 20, No. 9, pp. 2678-2683, 2011.   DOI   ScienceOn
12 B. D. Lucas, and T. Kanade, "An iterative image registration technique with an application to stereo vision," International Joint Conferences on Artificial Intelligence (IJCAI), Vol. 81, 1981.
13 C. W. Son, and H. M. Park, "Fast Multiple-Image-Based Deblurring Method," Journal of The Institute of Electronics Engineers of Korea, Vol. 49-SP, No. 4, pp. 49-57, 2012.   과학기술학회마을
14 E. Mair, G. Hager, D. Burschka, M. Suppa, and G. Hirzinger, "Adaptive and generic corner detection based on the accelerated segment test," Computer Vision-ECCV 2010. Springer Berlin Heidelberg, pp. 183-196. 2010.
15 D. G. Lowe, "Object recognition from local scale-invariant features," The proceedings of the seventh IEEE international conference on computer vision, Vol. 2. 1999.