Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Vision-based Walking Guidance System Using Top-view Transform and Beam-ray Model

탑-뷰 변환과 빔-레이 모델을 이용한 영상기반 보행 안내 시스템

  • Lin, Qing (Dept. of Electronic Engineering, Soongsil University) ;
  • Han, Young-Joon (Dept. of Electronic Engineering, Soongsil University) ;
  • Hahn, Hern-Soo (Dept. of Electronic Engineering, Soongsil University)
  • 림청 (숭실대학교 전자공학과) ;
  • 한영준 (숭실대학교 전자공학과) ;
  • 한헌수 (숭실대학교 전자공학과)
  • Received : 2011.10.05
  • Accepted : 2011.10.19
  • Published : 2011.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper presents a walking guidance system for blind pedestrians in an outdoor environment using just one single camera. Unlike many existing travel-aid systems that rely on stereo-vision, the proposed system aims to get necessary information of the road environment by using just single camera fixed at the belly of the user. To achieve this goal, a top-view image of the road is used, on which obstacles are detected by first extracting local extreme points and then verified by the polar edge histogram. Meanwhile, user motion is estimated by using optical flow in an area close to the user. Based on these information extracted from image domain, an audio message generation scheme is proposed to deliver guidance instructions via synthetic voice to the blind user. Experiments with several sidewalk video-clips show that the proposed walking guidance system is able to provide useful guidance instructions under certain sidewalk environments.

본 논문은 야외 환경에서 하나의 카메라를 이용한 시각 장애인을 위한 보행 안내 시스템을 제안한다. 기존의 스테레오 비전을 이용한 보행 지원 시스템과는 다르게 제안된 시스템은 사용자의 허리에 고정된 하나의 카메라를 이용하여 꼭 필요한 정보만을 얻는 것을 목표로 하는 시스템이다. 제안하는 시스템은 먼저 탑-뷰 영상을 생성하고, 생성된 탑-뷰 영상 내 지역적인 코너 극점을 검출한다. 검출된 극점에서 방사형의 히스토그램을 분석하여 장애물을 검출한다. 그리고 사용자 움직임은 사용자에 가까운 지역 안에서 옵티컬 플로우를 사용하여 추정한다. 이렇게 영상으로부터 추출된 정보들을 기반으로 음성 메시지 생성 모듈은 보행 지시 정보를 합성된 음성을 통해 시각 장애인에게 전달한다. 다양한실험 영상들을 사용하여 제안한 보행 안내 시스템이 일반 인도에서 유용한 안내 지시를 제공하는 것이 가능함을 보인다.

Keywords

References

  1. Dimitrios Dakopoulos and Nikolaos G. Bourbakis, "Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Surveyk," IEEE Transactions On Systems, Man, And Cybernetics, Vol. 40, No.1, pp. 25-35, January 2010. https://doi.org/10.1109/TSMCC.2009.2021255
  2. G. Sainarayanan, R. Nagarajan, and S. Yaacob, "Fuzzy Image Processing Scheme for Autonomous Navigation of Human Blind," Appl. Softw. Comput., Vol. 7, No. 1, pp. 257-264, January 2007. https://doi.org/10.1016/j.asoc.2005.06.005
  3. S. Y. Shin, H. Y. Moon, S. B. Pyo, "Image Recognition Using Colored-hear Transformation Based On Human Synesthesia ," Journal of The Korean Society of Computer and Information, Vol.13, No.2, pp.135-141, March 2008.
  4. A. Hub, J. Diepstraten, and T. Ertl, "Design and Development of An Indoor Navigation and Object Identification System For The Blind," in Proc. ACM SIGACCESS Accessibility Computing, No. 77-78, pp. 147-152, January 2004.
  5. J. L. G.-Mora, A. R.-Hernandez, L. F. R.-Ramos, L. Diaz-Saco, and N. Sosa, "Development of A New Space Perception System for Blind People Based on The Creation of A Virtual Acoustic Space," http://www.iac.es/proyect/eavi.
  6. L. A. Johnson and C. M. Higgins, "A Navigation Aid For The Blind Using Tactile-visual Sensory Substitution," in Proc. 28th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc., NewYork, pp.6298-6292, 2006.
  7. D. Dakopoulos, S. K. Boddhu, and N.Bourbakis, "A 2D Vibration Array Assistive Device For Visually Impaired," in Proc. 7th IEEE Int. Conf. Bioinf. Bioeng. ,Boston, MA, Vol.1, pp.930-937, 2007.
  8. S. Meers and K. Ward, "A Substitute Vision System for Providing 3D Perception and GPS Navigation via Electro-tactile Stimulation," in Proc. Int. Conf. Sens. Technol., New Zealand, November, 2005.
  9. Yi Hu, B. J. Shin, C. W. Lee, " Place Modeling and Recognition using Distribution of Scale Invariant Features," Journal of The Korean Society of Computer and Information, Vol.13, No.4, pp.51-58, July 2008.
  10. Bruhn, Weickert, Feddern, Kohlberger, and Schnorr, "Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow Methods," International Journal of Computer Vision, Vol.61, No.3, 211-231, 2005.