Journal of Biomedical Engineering Research (대한의용생체공학회:의공학회지)

The Korean Society of Medical and Biological Engineering (대한의용생체공학회)
권호 표지
DOI QR코드

DOI QR Code

Unconstrained e-Book Control Program by Detecting Facial Characteristic Point and Tracking in Real-time

얼굴의 특이점 검출 및 실시간 추적을 이용한 e-Book 제어

  • Kim, Hyun-Woo (Department of Biomedical Engineering, Graduate School of Yonsei University) ;
  • Park, Joo-Yong (Department of Biomedical Engineering, Graduate School of Yonsei University) ;
  • Lee, Jeong-Jick (Department of Biomedical Engineering, Graduate School of Yonsei University) ;
  • Yoon, Young-Ro (Department of Biomedical Engineering, Graduate School of Yonsei University)
  • 김현우 (연세대학교 대학원 의공학부) ;
  • 박주용 (연세대학교 대학원 의공학부) ;
  • 이정직 (연세대학교 대학원 의공학부) ;
  • 윤영로 (연세대학교 대학원 의공학부)
  • Received : 2013.12.07
  • Accepted : 2014.04.15
  • Published : 2014.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study is about e-Book program based on human-computer interaction(HCI) system for physically handicapped person. By acquiring background knowledge of HCI, we know that if we use vision-based interface we can replace current computer input devices by extracting any characteristic point and tracing it. We decided betweeneyes as a characteristic point by analyzing facial input image using webcam. But because of three-dimensional structure of glasses, the person who is wearing glasses wasn't suitable for tracing between-eyes. So we changed characteristic point to the bridge of the nose after detecting between-eyes. By using this technique, we could trace rotation of head in real-time regardless of glasses. To test this program's usefulness, we conducted an experiment to analyze the test result on actual application. Consequently, we got 96.5% rate of success for controlling e-Book under proper condition by analyzing the test result of 20 subjects.

Keywords

References

  1. K.D. Kwon, "Statistics of disabled person", Employment Development Institute, Nov. 2012.
  2. J. Varona, C. Manresa-Yee, F.J.parales, "Hands-free visionbased interface for computer accessibility", JNCA, vol. 31, pp. 357-374, 2008. https://doi.org/10.1016/j.jnca.2008.03.003
  3. Y. Li, S. Wang, X. Ding, "Eye/eyes tracking based on a unified deformable template and particle filtering", Pattern Recognition Letters, vol. 31, pp. 1377-1387, 2010. https://doi.org/10.1016/j.patrec.2010.02.013
  4. G.H. Shin and J.C. Chun, "Vision-based Multimodal Human Computer Interface based on Parallel Tracking of Eye and Hand Motion", International Conference on Convergence Information Technology, Gyeongju, Korea, Nov. 2007, pp. 2443-2448.
  5. K. Arai and R. Mardiyanto, "Camera Mouse Including "Ctrl-Alt-Del" Key Operation Using Gaze, Blink, and Mouth Shape", IJACSA, vol. 4, no. 3, pp. 183-191, 2013.
  6. K. Arai and R. Mardiyanto, "Eye-based Human Computer Interaction Allowing Phoning, Reading E-Book/E-Comic/ELearning, Internet Browsing, and TV information Extraction", IJHCI, vol. 2, no. 12, pp. 26-32, 2011.
  7. M. Nebete, M. Lokhande, K. Ahire, "Design an Eye Tracking Mouse", IJARCCE, vol. 2, issue 2, pp. 1118-1121, Feb. 2013.
  8. S. Kawato and J. Ohya, "Real-time of Nodding and Headshaking by Detecting and Tracking the "Between Eyes", in Proc. 4th IEEE International Conference on Automatic Face and Gesture Recognition, Mar. 2000, pp. 40-45.
  9. J.H. Jung, S.I. NA, J.H. Lee, M.C. Shin and D.S. Jung, "Robust Face Detection using Geometric Luminance Distribution Mask and Color Model under Illumination Variation", Proc. Of KIISE Fall Conference, vol. 32, no. 2, 2005, pp. 913-915.
  10. A. Giachetti, "Matching techniques to compute image motion", Image and Vision Computing, vol. 18, pp. 247-260, 2000. https://doi.org/10.1016/S0262-8856(99)00018-9
  11. R. Stiefelhagen, J. Yang, and A. Waibel, "Tracking eyes and monitoring eye gaze", Proceedings of the workshop on perceptual user interfaces, Alberta, Canada, Oct. 1997, pp. 98-100.
  12. S. Shan, W. Gao, B. Cao, D. Zhao, "Illumination Normalization for Robust Face Recognition Against Varying Light Conditions", IEEE International Workshop on Analysis and Modeling of Faces and Gestures, Nice, France, Oct. 2003, pp. 157-164.
  13. W. Chen, M. Joo and S. Wu, "Illumination Compensation and Normalization for Robust Face Recognition Using Discrete Cosine Transform in Logarithm Domain", IEEE T SYST MAN CY B, vol. 36, no. 2, pp. 458-466, 2006. https://doi.org/10.1109/TSMCB.2005.857353