DOI QR코드

DOI QR Code

Face Recognition and Notification System for Visually Impaired People

시각장애인을 위한 얼굴 인식 및 알림 시스템

  • Received : 2016.08.01
  • Accepted : 2016.12.26
  • Published : 2017.02.28

Abstract

We propose a face recognition and notification system that can transform visual face information into tactile signals in order to help visually impaired people. The proposed system consists of a glasses type camera, a mobile computer and an electronic cane. The glasses type camera captures the frontal view of the user, and sends this image to mobile computer. The mobile computer starts to search for human's face in the image when obstacles are detected by ultrasonic sensors. In a case that human's face is detected, the mobile computer identifies detected face. At this time, Adaboost and compressive sensing are used as a detector and a classifier, respectively. After the identification procedures of the detected face, the identified face information is sent to controller attached to a cane using a Bluetooth communication. The controller generates motor control signals using Pulse Width Modulation (PWM) according to the recognized face labels. The vibration motor generates vibration patterns to inform the visually impaired person of the face recognition result. The experimental results of face recognition and notification system show that proposed system is helpful for visually impaired people by providing person identification results in front of him/her.

Keywords

References

  1. M. A. Hussain, M. G. Ullah, A. Fareed, B. Sohail, "The smartcane for blind people an electronically smart stick to aid mobility," International Journal of Computer Science and Information Security Vol. 14, No. 4, pp. 276-285, 2016.
  2. S. Chumkamon, P. Tuvaphanthaphiphat, P. Keeratiwintakorn, "A blind navigation system using RFID for indoor environments," Proceedings of IEEE International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, Vol. 2, pp. 765-768, 2008.
  3. J. Faria, S. Lopes H. Fernandes, P. Marins, J. Barroso, "Electronic white cane for blind people navigation assistance," Proceedings of IEEE World Automation Congress, pp. 1-7, 2010.
  4. Y. Jin, J. Kim, B. Kim, R. Mallipeddi, M. Lee, "Smart cane: face recognition system for blind," Proceedings of the International Conference on Human-Agent Interaction, pp. 145-148, 2015.
  5. M. Barr, "Pulse width modulation," Embedded systems programming, pp.103-104, 2001.
  6. K. Narusawa, "Vibration motor," U.S. Patent No. 6,081,055, 27 Jun 2000.
  7. W. Zhao, R. Chellappa, P. J. Phillips, A. Rosenfeld, "Face recognition: a literature survey," ACM computing surveys, pp. 399-458, 2003.
  8. A. Krizhevsky, I. Sutskever, G. E. Hinton, "Imagenet classification with deep convolutional neural networks," Advances in neural information processing systems. pp. 1097-1105, 2012.
  9. H. Masnadi-Shirazi, "Adaboost face detection," CSE 252C fall, 2004.
  10. P. Viola, M. Jones, "Rapid object detection using a boosted cascade of simple features," Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1. pp. 511-518, 2001.
  11. F. Bernhard, A. Ernst, "Face detection with the modified census transform," Automatic Face and Gesture Recognition, pp. 91-96, 2004.
  12. R. Zabih, J. Woodfill. "Non-parametric local transforms for computing visual correspondence," European conference on computer vision, pp. 151-158, 1994.
  13. B. Froba, A. Ernst, "Face detection with the modified census transform," Automatic Face and Gesture Recognition, pp. 91-96, 2004.
  14. Q. Shi, A. Eriksson, A. Van Den Hengel, C. Shen, "Is face recognition really a compressive sensing problem?," Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 553-560, 2011.
  15. W. Gander, "Algorithms for the QR decomposition," Seminar fur Angewandte Mathematik: research report. 1980.
  16. N. Dalal, B. Triggs, "Histograms of oriented gradients for human detection," Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 886-893, 2005.
  17. P. Viola, M. J. Jones, "Robust real-time face detection," International journal of computer vision, pp. 137-154, 2004.