Browse > Article
http://dx.doi.org/10.14372/IEMEK.2014.9.6.335

An Implementation of Real-time Image Warping Using FPGA  

Ryoo, Jung Rae (SeoulTech)
Lee, Eun Sang (WITHROBOT Co. Ltd.)
Doh, Tae-Yong (Hanbat National University)
Publication Information
IEMEK Journal of Embedded Systems and Applications / v.9, no.6, 2014 , pp. 335-344 More about this Journal
Abstract
As a kind of 2D spatial coordinate transform, image warping is a basic image processing technique utilized in various applications. Though image warping algorithm is composed of relatively simple operations such as memory accesses and computations of weighted average, real-time implementations on embedded vision systems suffer from limited computational power because the simple operations are iterated as many times as the number of pixels. This paper presents a real-time implementation of a look-up table(LUT)-based image warping using an FPGA. In order to ensure sufficient data transfer rate from memories storing mapping LUT and image data, appropriate memory devices are selected by analyzing memory access patterns in an LUT-based image warping using backward mapping. In addition, hardware structure of a parallel and pipelined architecture is proposed for fast computation of bilinear interpolation using fixed-point operations. Accuracy of the implemented hardware is verified using a synthesized test image, and an application to real-time lens distortion correction is exemplified.
Keywords
Image warping; Look-up table; Real-time; FPGA; Backward mapping; Fixed-point operation;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 M. Brown, D.G. Lowe, "Automatic panoramic image stitching using invariant features," International Journal of Computer Vision, Vol. 74, No. 1, pp. 59-73, 2007.   DOI   ScienceOn
2 S.-M. Lee, "Fast laser triangular measurement system using ARM and FPGA," IEMEK J. Embed. Sys. Appl., Vol. 8, No. 1, pp. 25-29, 2013 (in Korean).
3 J. Park, S.-C. Byun, B.-U. Lee, "Lens distortion correction using ideal image coordinates," IEEE Transactions on Consumer Electronics, Vol. 55, No. 3, pp. 987-991, 2009.   DOI
4 Z. Chen, C. Wu, H.T. Tsui, "A new image rectification algorithm," Pattern Recognition Letters, Vol. 24, No. 1-3, pp. 251-260, 2003.   DOI
5 W. Yu, "An embedded camera lens distortion correction method for mobile computing applications," IEEE Transactions on Consumer Electronics, Vol. 49, No. 4, pp. 894-901, 2003.   DOI
6 K.T. Gribbon, C.T. Johnston, D.G. Bailey, "A real-time FPGA implementation of a barrel distortion correction algorithm with bilinear interpolation," Proc. of the Image and Vision Computing New Zealand 2003, pp. 408-413, 2003.
7 C. Vancea, S. Nedevschi, "LUT-based image rectification module implemented in FPGA," Proceedings of IEEE International Conference on Intelligent Computer Communication and Processing, pp. 147-154, 2007.
8 S. Oh, G. Kim, "FPGA-based fast image warping with data-parallelization schemes," IEEE Transactions on Consumer Electronics, Vol. 54, No. 4, pp. 2053-2059, 2008.   DOI
9 A. Serguienko, Evaluation of image warping algorithms for implementation in FPGA, Master thesis, Linkopings universitet, Sweden, 2008.
10 P. Greisen, S. Heinzle, M. Gross, A. P Burg, "An FPGA-based processing pipeline for high-definition stereo video," Journal of Image and Video Processing, Vol. 2011, No. 18, pp. 1-13, 2011.
11 P. Giacon, S. Saggin, G. Tommasi, M. Busti, "Implementing DSP Algorithms Using Spartan-3 FPGAs," DPS Magazine, Issue 1, pp. 16-19, 2005.
12 D.-J. Kim, Y.-S. Park, "An implementation of FPGA embedded system for real-time SONAR signal display using the triple buffering method," IEMEK J. Embed. Sys. Appl., Vol. 9, No. 3, pp. 173-182, 2014 (in Korean).   과학기술학회마을   DOI
13 E.L. Oberstar, "Fixed-point representation & fractional math," Tech. Report, Oberstar Consulting, 2007.
14 M.D. Ciletti, Advanced Digital Design with the Verilog HDL, Prentice Hall, 2010.
15 Y. Hwang, M. Song, "Design of a CMOS image sensor based on a 10-bit two-step single-slope ADC," Journal of Semiconductor Technology and Science, Vol. 14, No. 2, pp. 246-251, 2014.   DOI
16 J. Weng, P. Cohen, M. Herniou, "Camera calibration with distortion models and accuracy evaluation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 14, No. 10, pp. 965-980, 1992.   DOI   ScienceOn