JSTS:Journal of Semiconductor Technology and Science

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지
DOI QR코드

DOI QR Code

A Platform-Based SoC Design for Real-Time Stereo Vision

  • Yi, Jong-Su (School of Electrical and Electronics Engineering, Chung-Ang University) ;
  • Park, Jae-Hwa (Department of Computer Engineering, Chung-Ang University) ;
  • Kim, Jun-Seong (School of Electrical and Electronics Engineering, Chung-Ang University)
  • Received : 2011.12.28
  • Published : 2012.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

A stereo vision is able to build three-dimensional maps of its environment. It can provide much more complete information than a 2D image based vision but has to process, at least, that much more data. In the past decade, real-time stereo has become a reality. Some solutions are based on reconfigurable hardware and others rely on specialized hardware. However, they are designed for their own specific applications and are difficult to extend their functionalities. This paper describes a vision system based on a System on a Chip (SoC) platform. A real-time stereo image correlator is implemented using Sum of Absolute Difference (SAD) algorithm and is integrated into the vision system using AMBA bus protocol. Since the system is designed on a pre-verified platform it can be easily extended in its functionality increasing design productivity. Simulation results show that the vision system is suitable for various real-time applications.

Keywords

References

  1. S. T. Barnard, M. A. Fischler, "Computational Stereo," ACM Computing Surveys (CSUR) archive, Vol.14, pp.553-572, 1982. https://doi.org/10.1145/356893.356896
  2. T. Kanade, A. Yoshida, K. Oda, H. Kano, M. Tanaka, "A stereo machine for video-rate dense depth mapping and its new applications," Computer Vision and Pattern Recognition, pp.196-202, 1996.
  3. J. Woodfill, B. V. Herzen, "Real-time stereo vision on the PARTS reconfigurable computer," IEEE symposium on FPGAs for Custom Computing Machines, pp.242 - 250, 1997.
  4. M. Z. Brown, D. Burschka, G. D. Hager, "Advances in computational stereo," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.25(8), pp.993-1008, Aug. 2003. https://doi.org/10.1109/TPAMI.2003.1217603
  5. A. Sangiovanni-Vincentelli, L. Carloni, F. D. Bernardinis, M. Sgroi, "Benefits and Challenges for Platform-Based Design," Proceedings of Design Automation Conference, pp.409-414, 2004.
  6. S. Park, M. Kim, S. I. Chae, "SoCBase - An integrated solution for platform based design," International SoC Design Conference, pp.329-332, 2004.
  7. D. Han, D. H. Hwang, "A novel stereo matching method for wide disparity range detection," Lecture Notes on Computer Science, Vol.3656, pp.643-650, 2005.
  8. P. de la Hamette, G. Troster, "FingerMouse- Architecture of an ASIC-based Mobile Stereovision Smart Camera," IEEE International Symposium on Wearable Computers, 2006.
  9. S. Park, S. Yoon, S. I. Chae, "Reusable component IP design using refinement-based design environment," Asia and South Pacific Conference on Design Automation, 2006.
  10. H. Hirschmuller, D. Scharstein, "Evaluation of Cost Functions for Stereo Matching," Computer Vision and Pattern Recognition, 2007.
  11. K. Konolige, m. Agrawal, R.C. Bolles, C. Cowan, M. Fischler, B. Gerkey, "Outdoor Mapping and Navigation Using Stereo Vision," Experimental Robotics, Springer Tracts in Advanced Robotics, Vol.39, pp.179-190, 2008. https://doi.org/10.1007/978-3-540-77457-0_17
  12. M. Humenberger, C. Zinner, M. Weber, W. Kubinger, M. Vincze, "A fast stereo matching algorithm suitable for embedded real-time systems," Computer Vision and Image Understanding, Vol. 114, pp.1180-1202, Nov., 2010. https://doi.org/10.1016/j.cviu.2010.03.012
  13. S. Jin, J. Cho, X. D. Pham, K. M. Lee, S. K. Park, M. Kim, J. W. Jeon, "FPGA Design and Implementation of a Real-Time Stereo Vision System," IEEE Transactions on Circuits and Systems for Video Technology, Vol.20(1), pp.15-26, Jan. 2010. https://doi.org/10.1109/TCSVT.2009.2026831
  14. A. Cappalunga, S. Cattani, A. Broggi, M. S. McDaniel, S. Dutta, "Real time 3D terrain elevation mapping using ants Optimization Algorithm and stereo vision," IEEE Intelligent Vehicles Symposium, pp.902-909, 2010.
  15. J.-H. Sun, B.-S. Jeon, J.-W. Lim, M.-t. Lim, "Stereo vision based 3D modeling system for mobile robot," Control Automation and Systems (ICCAS), 2010 International Conference on, pp.71- 75, Oct., 2010.
  16. J. Um, S. Hong, Y.-T. Kim, E. Chung, K.-M. Choi, J.-T. Kong and S.-K. Eo, "ViP: A Practical Approach to Platform-based System Modeling Methodology," Journal of Semiconductor Technology and Science, Vol.5, No.2, pp.89-101, Jun., 2005.
  17. Center for SoC Design Technology Page, http://soc.snu.ac.kr/
  18. Middlebury Stereo Vision Page, http://vision.middlebury.edu/ stereo/