IEMEK Journal of Embedded Systems and Applications (대한임베디드공학회논문지)

Institute of Embedded Engineering of Korea (대한임베디드공학회)
권호 표지
DOI QR코드

DOI QR Code

An Implementation of Stereo Image Based Sighted Guiding Device Platform for the Visually Impaired

시각장애인을 위한 스테레오 영상기반 보행환경정보안내 단말 플랫폼 개발

  • Received : 2018.02.06
  • Accepted : 2018.03.23
  • Published : 2018.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

This paper describes a device platform which the blind can wear to keep path and to get surrounding information during their independent walking. Compared to the existing technologies, the proposed device could be used indoors and outdoors, and maps need not be provided in advance. It is composed of a glasses type device equipped with image sensors, and a portable device that analyzes sensor data for sighted guiding. RGB images and depth images are extracted to generate a walking map based on feature points. It also can cope with the risk of collision with bollard, color cone by applying vertical obstacle detection technology based on floor detection.

Keywords

References

  1. http://www.senderogroup.com/products/shopseeingeyegps.html
  2. https://www.applevis.com/apps/ios/navigation/blindsquare
  3. https://folio.openknowl.com/project/7950
  4. https://www.microsoft.com/en-us/seeing-ai/
  5. https://www.samsungrelumino.com/home
  6. https://en.wikipedia.org/wiki/Simultaneous_localization_and_mapping
  7. G. Klein, D. Murray, "Parallel Tracking and mapping for small AR workspaces," Proceedings of IEEE International Symposium on Mixed and Augmented Reality, pp 225-234, 2007.
  8. R. Wang, M. Schworer, D. Cremers, "Stereo DSO: Large-scale Direct Sparse Visual Odometry With Stereo Cameras," Proceedings of International Conference on Computer Vision, 2017.
  9. J. Engel T. Schops D. Cremers, "LSD-SLAM: Large-scale Direct Monocular SLAM," Proceedings of European Conference on Computer Vision, pp. 834-849, 2014.
  10. R. Mur-Artal, J.D. Tardos, “ORB-SLAM2: an Open-source SLAM System for Monocular, Stereo and RGB-D Cameras,” IEEE Transactions on Robotics, Vol. 33, No. 5, pp. 1255-1262, 2016.
  11. J. Long, E. Shelhamer, T. Darrell, "Fully Convolutional Networks for Semantic Segmentation," Proceedings of IEEE conference on computer vision and pattern recognition, pp. 3431-3440, 2015.
  12. O. Ryssakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, L. Fei-Fei., “ImageNet Large Scale Visual Recognition Challenge,” International Journal of Computer Vision, Vol. 115, No. 3, pp. 211-252, 2014. https://doi.org/10.1007/s11263-015-0816-y
  13. S. Ren, K. He, R. Girshick, J. Sun, "Faster R-CNN: Towards Real-time Object Detection With Region Proposal Networks," Proceedings of Advances in neural information processing systems, pp. 91-99, 2015.
  14. W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Fu, A. C. Berg, "SSD: Single Shot MultiBox Detector," Proceedings of European conference on computer vision, pp. 21-37, 2016.
  15. J. Redmon, S. Divvala, R. Girshick, A. Farhadi, "You Only Look Once: Unified, Real-time Object Detection," Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779-788, 2015.
  16. J. Redmon and A. Farhadi, "Yolo9000: Better, Faster, Stronger," Proceedings of the IEEE Computer Vision Foundation, pp. 7263-7271, 2016.
  17. M. Apte, S. Mangat, P. Sekhar, "YOLO Net on iOS," 2017.
  18. https://en.wikipedia.org/wiki/VHDL
  19. https://developer.nvidia.com/embedded/buy/jetson-tx2