Journal of Multimedia Information System

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Binary Image Based Fast DoG Filter Using Zero-Dimensional Convolution and State Machine LUTs

  • Lee, Seung-Jun (Dept. of Electrical and Computer Engineering, The University of Akron) ;
  • Lee, Kye-Shin (Dept. of Electrical and Computer Engineering, The University of Akron) ;
  • Kim, Byung-Gyu (Dept. of IT Engineering, Sookmyung Women's University)
  • Received : 2018.03.13
  • Accepted : 2018.05.10
  • Published : 2018.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

This work describes a binary image based fast Difference of Gaussian (DoG) filter using zero-dimensional (0-d) convolution and state machine look up tables (LUTs) for image and video stitching hardware platforms. The proposed approach for using binary images to obtain DoG filtering can significantly reduce the data size compared to conventional gray scale based DoG filters, yet binary images still preserve the key features of the image such as contours, edges, and corners. Furthermore, the binary image based DoG filtering can be realized with zero-dimensional convolution and state machine LUTs which eliminates the major portion of the adder and multiplier blocks that are generally used in conventional DoG filter hardware engines. This enables fast computation time along with the data size reduction which can lead to compact and low power image and video stitching hardware blocks. The proposed DoG filter using binary images has been implemented with a FPGA (Altera DE2-115), and the results have been verified.

Keywords

References

  1. R. Szeliski, "Image alignment and stitching: a tutorial," Found. Trends. Comput. Graph. Vis., vol. 2, pp. 1-104, 2006. https://doi.org/10.1561/0600000009
  2. S. Chen, "QuickTime VR - An image based approach to virtual environmental navigation," SIGGRAPH 95, vol. 29, pp. 29-38, 1995.
  3. R. Szeliski and H. Shum, "Creating full view panoramic image mosaics and environmental maps," SIGGRAPH 97, vol. 31, pp. 251-258, 1999.
  4. M. Brown and D. G. Lowe, "Automatic panoramic image stitching using invariant features," Int. J. Computer Vision, vol. 74, pp. 59-73, 2007 https://doi.org/10.1007/s11263-006-0002-3
  5. M. Alawad and M. Lin, "Stochastic-based deep convolutional networks with reconfigurable logic fabric," IEEE Trans. Multi-Scale Comp. Syst., vol. 2, pp. 242-256, 2016. https://doi.org/10.1109/TMSCS.2016.2601326
  6. J. Kim, "Visual correspondence using energy minimization and mutual information," Int. conf. on Comput. Vision (ICCV 2003), Oct. 2003, pp. 1033-1040.
  7. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Trans. Pattern Analysis and Mac. Intell., vol. 27, pp. 1615-1630, 2005. https://doi.org/10.1109/TPAMI.2005.188
  8. D. G. Lowe, "Distinctive image features from scaleinvariant keypoints," vol. 60, pp. 91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  9. S. A. Bakar, M. S. Hitam and W. N. Yussof, "Contentbased image retrieval using SIFT for binary and grey scale images," IEEE ICSIPA 2013, pp. 83-88.
  10. C. Lyu, J. Peng, W. Zhou, S. Yang and Y. Liu, Fellow, "Design of a High Speed 360-degree Panoramic Video Acquisition System Based on FPGA and USB 3.0",IEEE Sensor 2011, pp 3.
  11. Altera TriMatrix Embedded Memory Blocks in Stratix IV Devices https://www.altera.com/en_US/pdfs/literature/hb/stratix-iv/stx4_siv51003.pdf, 2011.
  12. R. Szeliski, Computer Vision: Algorithms and Applications, Draft 2010, pp. 450
  13. T.S. Fleming and B.D. Thomas, "Hardware Acceleration of Matrix Multiplication over Small Prime Finite Fields", Springer-Verlog Berlin Heidelberg 2011, pp 111.