Browse > Article
http://dx.doi.org/10.14372/IEMEK.2018.13.2.73

An Implementation of Stereo Image Based Sighted Guiding Device Platform for the Visually Impaired  

Oh, Bonjin (ETRI)
Park, Sangheon (ETRI)
Kim, Juwan (ETRI)
Publication Information
IEMEK Journal of Embedded Systems and Applications / v.13, no.2, 2018 , pp. 73-81 More about this Journal
Abstract
This paper describes a device platform which the blind can wear to keep path and to get surrounding information during their independent walking. Compared to the existing technologies, the proposed device could be used indoors and outdoors, and maps need not be provided in advance. It is composed of a glasses type device equipped with image sensors, and a portable device that analyzes sensor data for sighted guiding. RGB images and depth images are extracted to generate a walking map based on feature points. It also can cope with the risk of collision with bollard, color cone by applying vertical obstacle detection technology based on floor detection.
Keywords
Sighted guiding device; The visually impaired; SLAM; Vertical obstacle detection;
Citations & Related Records
연도 인용수 순위
  • Reference
1 http://www.senderogroup.com/products/shopseeingeyegps.html
2 https://www.applevis.com/apps/ios/navigation/blindsquare
3 https://folio.openknowl.com/project/7950
4 https://www.microsoft.com/en-us/seeing-ai/
5 https://www.samsungrelumino.com/home
6 https://en.wikipedia.org/wiki/Simultaneous_localization_and_mapping
7 G. Klein, D. Murray, "Parallel Tracking and mapping for small AR workspaces," Proceedings of IEEE International Symposium on Mixed and Augmented Reality, pp 225-234, 2007.
8 R. Wang, M. Schworer, D. Cremers, "Stereo DSO: Large-scale Direct Sparse Visual Odometry With Stereo Cameras," Proceedings of International Conference on Computer Vision, 2017.
9 J. Engel T. Schops D. Cremers, "LSD-SLAM: Large-scale Direct Monocular SLAM," Proceedings of European Conference on Computer Vision, pp. 834-849, 2014.
10 R. Mur-Artal, J.D. Tardos, “ORB-SLAM2: an Open-source SLAM System for Monocular, Stereo and RGB-D Cameras,” IEEE Transactions on Robotics, Vol. 33, No. 5, pp. 1255-1262, 2016.
11 J. Long, E. Shelhamer, T. Darrell, "Fully Convolutional Networks for Semantic Segmentation," Proceedings of IEEE conference on computer vision and pattern recognition, pp. 3431-3440, 2015.
12 O. Ryssakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, L. Fei-Fei., “ImageNet Large Scale Visual Recognition Challenge,” International Journal of Computer Vision, Vol. 115, No. 3, pp. 211-252, 2014.   DOI
13 S. Ren, K. He, R. Girshick, J. Sun, "Faster R-CNN: Towards Real-time Object Detection With Region Proposal Networks," Proceedings of Advances in neural information processing systems, pp. 91-99, 2015.
14 W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Fu, A. C. Berg, "SSD: Single Shot MultiBox Detector," Proceedings of European conference on computer vision, pp. 21-37, 2016.
15 J. Redmon, S. Divvala, R. Girshick, A. Farhadi, "You Only Look Once: Unified, Real-time Object Detection," Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779-788, 2015.
16 J. Redmon and A. Farhadi, "Yolo9000: Better, Faster, Stronger," Proceedings of the IEEE Computer Vision Foundation, pp. 7263-7271, 2016.
17 M. Apte, S. Mangat, P. Sekhar, "YOLO Net on iOS," 2017.
18 https://en.wikipedia.org/wiki/VHDL
19 https://developer.nvidia.com/embedded/buy/jetson-tx2