IEIE Transactions on Smart Processing and Computing

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

Efficient Rolling Shutter Distortion Removal using Hierarchical Block-based Motion Estimation

  • Lee, Donggeun (School of Electrical, Electronics, and Commun. Eng., KOREATECH) ;
  • Choi, Kang-Sun (Interdisciplinary Program in Creative Engineering, KOREATECH)
  • Received : 2013.12.20
  • Accepted : 2014.05.12
  • Published : 2014.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper reports an efficient algorithm for accurate rolling shutter distortion removal. A hierarchical global motion estimation approach for a group of blocks reduces the level of computation by three orders of magnitude. In addition, the motion of each scanline is determined accurately by averaging two candidates obtained through cubic spline interpolation. The experimental results show that the proposed method produces accurate motion information with significant computation reduction and corrects the rolling shutter distortion effectively.

Keywords

References

  1. A. El Gamal and H. Eltoukhy, "CMOS image sensors," IEEE Circuits and Devices Mag., vol. 21, no. 3, pp. 6-20, Mar. 2005.
  2. Z. Zhou, B. Pain, and E. R. Fossum, "Frame-transfer CMOS active pixel sensor with pixel binning," IEEE Trans. Electron Devices, vol. 44, no. 10, pp. 1764-1768, Oct. 1997. https://doi.org/10.1109/16.628834
  3. S. Lauxtermann, P. Schwider, P. Seitz, H. Bloss, J. Ernst, and H. Firla,"A high speed CMOS imager acquiring 5000 frames/sec,," in Proc. Int. Electron Devices Meeting, Tech. Dig., Washington, DC, 1999, pp. 875-878.
  4. M. Wany and G. Paul, "CMOS image sensor with NMOS-only global shutter and enhanced responsivity," IEEE Trans. Electron Devices, vol. 50, no. 1, pp. 57-62, Jan. 2003. https://doi.org/10.1109/TED.2002.807253
  5. C. Jia, L.E. Brian, "Probabilistic 3-D motion estimation for rolling shutter video rectification from visual and inertial measurements," IEEE International Workshop on Multimedia Signal Processing, pp. 203-208, Sep. 2012.
  6. C. Geyer, M. Meingast, and S. Sastry, "Geometric models of rollingshutter cameras," in Proc. Omnidirectional Vision, Camera Networks and Nonclassical Cameras, Oct. 2005, pp. 12-19.
  7. O. Ait-Aider, N. Andreff, J. M. Lavest, and P. Martinet, "Exploiting rolling shutter distortions for simultaneous object pose and velocity computation using a single view," in Proc. 4th IEEE Int. Conf. Computer Vision Systems, Jan. 2006, pp. 35-41.
  8. O. Ait-Aider and A. Bartoli, "Kinematics from lines in a single rolling shutter image," in Proc. Conf. Computer Vision and Pattern Recognition, Minneapolis, MN, Jun. 2007, pp. 1-6.
  9. G. Sasaki and Y. Nara, "Image processor and camera system," U.S. Patent Application Publication, No. 2007/0120997 A1, May 31, 2007.
  10. C.-K. Liang, L.-W. Chang, and H H. Chen, "Analysis and compensation of rolling shutter effect," IEEE Trans. on Image Processing, vol.17, pp. 1323-1330, Aug. 2008. https://doi.org/10.1109/TIP.2008.925384
  11. Y. J. Koh, J.-H. Kim, and C.-S. Kim, "Removing rolling shutter distortion using the block-based motion interpolation," IEEK Conf. on Electronics, pp. 451-452, Oct. 2013.