Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

A Design of the Finite State Machine to Control User's Gaze on a Screen

화면 응시 제어를 위한 유한 상태 기계 설계

  • Moon, Bong-Hee (Dept. of Computer Science, Sookmyung Women's University)
  • 문봉희 (숙명여자대학교 컴퓨터과학부)
  • Received : 2010.12.01
  • Accepted : 2011.01.26
  • Published : 2011.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

A finite state machine was designed to control user's gaze on the screen when the user is monitoring the. It consists of a set of situations where pupils are gazed and a set of states which decide the gaze on a screen or sleeping. The states were especially classified into main states, pre-states and potential states. The machine uses the situation history, which decide current state using continuous previous situation and current situation, and improves the accuracy to control the gaze on a screen. We implemented the machine with the data which were get using a pupil detection method, and tested the verification of the system with monitoring operations. The experimentation using the method which get date from real images shows advantage of decision whether it is temporary gaze or long-term gaze.

화면을 모니터링하고 있는 시스템에서 사용자가 시선을 화면에 집중하고 있는가를 판단하고 제어할 수 있는 유한 상태 기계를 설계 및 구현하였다. 유한 상태 기계는 화면을 응시하고 있는 눈동자의 상황에 대한 집합과 화면에 집중하고 있는 상태의 집합을 이를 기반으로 구성되었다. 특히 상태 집합을 3종류-주요 상태, 예비 상태, 잠재 상태로 분류하였다. 이전의 상황과 현재의 상황을 연계하여 현 상태를 판단하는 상황 이력을 이용함으로써 판단의 정확도를 높였다. 이 유한 상태 기계에 대하여, 기존의 눈동자 검출 방법에서 얻은 눈동자 위치 데이터를 이용하여 시뮬레이터를 구현하고 작동과정의 모니터링을 통하여 검증하였다. 실제 눈동자의 이미지를 바탕으로 실험한 결과로 상황 이력을 이용한 판정은 현재의 응시 상태가 1회성 또는 장기적인 상태인가를 판단할 수 있는 장점을 보였다.

Keywords

References

  1. Zafersavas, "TrackEye: Real-Time Tracking of Human Eyes Using a Webcam," http://www.codeproject.com/KB/cpp/TrackEye.aspx
  2. Bonghee Moon, "A Method for the Detection of an Open/Closed Eye and a Pupil using Black and White Bipolarization," Journal of The Korea Society of Computer and Information, Vol. 14, No. 12, pp.89-96, Dec. 2009.
  3. Kim Hyeong gyun, Jung gi bong, "Real-time Face Detection System using YCbCr Information and AdaBoost Algorithm," Journal of The Korea Society of Computer and Information, Vol. 13, No. 5, pp.19-26, Sep. 2009.
  4. Woo-Ram Lee, Dong-Guk Hwang, Byoung-Min Jun, "Face Detection Using Geometrical Information of Face and Hair Region," Journal of the Korean institute of communication sciences, Vol. 34, No. 2, pp. 194-199, Feb. 2009.
  5. Daedong Hwang, Gyeyoung Kim, "Component-Based Face Detection using T-type Structure," KSCI review, Vol. 16, No. 2, pp.227-230, Dec. 2008.
  6. Young-Jae Park, Seok-Woo Jang, Gye-Young Kim, "A Study Extraction of Skin Region and Lip Using Skin Color of Eye Zone," Journal of The Korea Society of Computer and Information, Vol. 14, No. 4, pp.19-30, Apr. 2009.
  7. Chung-Kyue Kim, Chang-Zeng Lee, Jong-Seung Park, "A Study on the Indirect Interface Control System of the Automatic Extraction of the Eye Region followed by the Gaze Tracing," Journal of The Korea institute of information technology, Vol. 6, No. 4, Aug. 2008.
  8. W.M.K.W.M. Khairosfaizal, A. J. Nor'aini, "Eyes detection in facial images using Circular Hough Transform," CSPA 2009, pp.238 - 242, March 6-8, 2009.
  9. I. K. Kallel, D. S. Masmoudi, N. Derbel, "Fast pupil location for better iris detection," SSD '09, pp.1-6, Mar. 23-26, 2009.
  10. A. Basit, M.Y. Javed, S. Masood, "Non-circular pupil localization in iris images," ICET 2008, pp.228-231, Oct. 18-19, 2008.
  11. Y. Ebisawa, "Robust pupil detection by image difference with positional compensation," VECIMS '09, pp.143-148, May 11-13, 2009.
  12. M. H. Sigari, "Driver Hypo-vigilance Detection Based on Eyelid Behavior," CAPR '09, pp.426 - 429, Feb. 4-6, 2009.
  13. G. Zhang, B. Cheng, R. Feng, X. Zhang, "A Real-Time Adaptive Learning Method for Driver Eye Detection," DICTA '08, pp.300-304, Dec. 1-3, 2008.
  14. P. R. Tabrizi, R. A. Zoroofi, "Open/Closed Eye Analysis for Drowsiness Detection," IPTA 2008, pp.1-7, Nov. 23-26, 2008.
  15. J.R. Parket, A.Q. Duong, "Gaze Tracking: A Sclera Recognition Approach," ICSMS '09, pp.3836-3841, Oct. 2009.
  16. H. M. Peixoto, A. M. G. Guerreiro, A. D. D. Neto, "Image processing for eye detection and classification of the gaze direction," IJCNN '09, pp. 2475-2480, June 14-19, 2009.
  17. T. Miyake, T. Asakawa, T. Yoshida, T. Imamura, "Detection of view direction with a single camera and its application using eye gaze," IECON '09, pp.2037-2043, 2009.
  18. B. L. Nguyen, "Eye Gaze Tracking," RIVF '09, pp.1-4, 2009.
  19. Finite State Machine, http://en.wikipedia.org/wiki/Finite_state_machine
  20. T. Juan, S. Sanjeevan, J.J. Navarro, "Dynamic history-length fitting: a third level of adaptivity for branch prediction," ISCA '98, pp.155-166, 1998.
  21. S. Reches, S. Weiss, "Implementation and analysis of path history in dynamic branch prediction schemes," IEEE Trans. on Computers, vol. 47, No. 8, pp.907-912, Aug. 1998. https://doi.org/10.1109/12.707596