• Title/Summary/Keyword: Gaze-Tracking

Search Result 166, Processing Time 0.025 seconds

Real-Time Eye Tracking Using IR Stereo Camera for Indoor and Outdoor Environments

  • Lim, Sungsoo;Lee, Daeho
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.8
    • /
    • pp.3965-3983
    • /
    • 2017
  • We propose a novel eye tracking method that can estimate 3D world coordinates using an infrared (IR) stereo camera for indoor and outdoor environments. This method first detects dark evidences such as eyes, eyebrows and mouths by fast multi-level thresholding. Among these evidences, eye pair evidences are detected by evidential reasoning and geometrical rules. For robust accuracy, two classifiers based on multiple layer perceptron (MLP) using gradient local binary patterns (GLBPs) verify whether the detected evidences are real eye pairs or not. Finally, the 3D world coordinates of detected eyes are calculated by region-based stereo matching. Compared with other eye detection methods, the proposed method can detect the eyes of people wearing sunglasses due to the use of the IR spectrum. Especially, when people are in dark environments such as driving at nighttime, driving in an indoor carpark, or passing through a tunnel, human eyes can be robustly detected because we use active IR illuminators. In the experimental results, it is shown that the proposed method can detect eye pairs with high performance in real-time under variable illumination conditions. Therefore, the proposed method can contribute to human-computer interactions (HCIs) and intelligent transportation systems (ITSs) applications such as gaze tracking, windshield head-up display and drowsiness detection.

Head Orientation-based Gaze Tracking (얼굴의 움직임을 이용한 응시점 추적)

  • ;R.S. Ramakrishna
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 1999.10b
    • /
    • pp.401-403
    • /
    • 1999
  • 본 논문에서 우리는 제약이 없는 배경화면에서 얼굴의 움직임을 이용한 응시점 추적을 위해 얼굴의 특징점(눈, 코, 그리고 입)들을 찾고 head orientation을 구하는 효?거이고 빠른 방법을 제안한다. 얼굴을 찾는 방법이 많이 연구 되어 오고 있으나 많은 부분이 효과적이지 못하거나 제한적인 사항을 필요로 한다. 본 논문에서 제안한 방법은 이진화된 이미지에 기초하고 완전 그래프 매칭을 이용한 유사성을 구하는 방법이다. 즉, 임의의 임계치 값에 의해 이진화된 이미지를 레이블링 한 후 각 쌍의 블록에 대한 유사성을 구한다. 이때 두 눈과 가장 유사성을 갖는 두 블록을 눈으로 선택한다. 눈을 찾은 후 입과 코를 찾아간다. 360$\times$240 이미지의 평균 처리 속도는 0.2초 이내이고 다음 탐색영역을 예상하여 탐색 영역을 줄일 경우 평균 처리속도는 0.15초 이내였다. 그리고 본 논문에서는 얼굴의 움직임을 구하기 위해 각 특징점들이 이루는 각을 기준으로 한 템플릿 매칭을 이용했다. 실험은 다양한 조명환경과 여러 사용자를 대상으로 이루어졌고 속도와 정확성면에서 좋은 결과를 보였다. 도한, 명안정보만을 사용하므로 흑백가메라에서도 사용가능하여 경제적 효과도 기대할 수 있다.

  • PDF

Facial Feature Tracking and Head Orientation-based Gaze Tracking

  • Ko, Jong-Gook;Kim, Kyungnam;Park, Seung-Ho;Kim, Jin-Young;Kim, Ki-Jung;Kim, Jung-Nyo
    • Proceedings of the IEEK Conference
    • /
    • 2000.07a
    • /
    • pp.11-14
    • /
    • 2000
  • In this paper, we propose a fast and practical head pose estimation scheme fur eye-head controlled human computer interface with non-constrained background. The method we propose uses complete graph matching from thresholded images and the two blocks showing the greatest similarity are selected as eyes, we also locate mouth and nostrils in turn using the eye location information and size information. The average computing time of the image(360*240) is within 0.2(sec) and we employ template matching method using angles between facial features for head pose estimation. It has been tested on several sequential facial images with different illuminating conditions and varied head poses, It returned quite a satisfactory performance in both speed and accuracy.

  • PDF

Eye Perception Difference Between the Conservative and the Liberal : Verification of Personal Tendency using Eye-tracking Machine

  • Kwon, Mahnwoo
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.8
    • /
    • pp.1171-1177
    • /
    • 2021
  • Measuring and evaluation of audience's visual message perception are crucial process for scientific production of visual content. This study tried to evaluate the difference of viewer's awareness of visual object depends on his or her inherent characteristics like conservatism using an eye tracker system. Especially, this experiment tested research questions about positive correlation between conservatism and peoples' eye movements following the sound visual messages. 57 subjects participated in the test. Two different groups were exposed to two visual elements representing 'the conservative' and 'the liberal'. The results showed that people tended to have different way of seeing visual objects according to their inherent characteristics. Also by comparing the gaze time at the object and area of interest(AOI) in visual, this study is able to verify the existence of 'positive way of seeing' and 'negative way of seeing'. The two different ways of seeing have their own trail of eye movement.

Development of Real-Time Vision-based Eye-tracker System for Head Mounted Display (영상정보를 이용한 HMD용 실시간 아이트랙커 시스템)

  • Roh, Eun-Jung;Hong, Jin-Sung;Bang, Hyo-Choong
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.35 no.6
    • /
    • pp.539-547
    • /
    • 2007
  • In this paper, development and tests of a real-time eye-tracker system are discussed. The tracker system tracks a user's gaze point through movement of eyes by means of vision-based pupil detection. The vision-based method has an advantage of detecting the exact positions of user's eyes. An infrared camera and a LED are used to acquire a user's pupil image and to extract pupil region, which was hard to extract with software only, from the obtained image, respectively. We develop a pupil-tracking algorithm with Kalman filter and grab the pupil images by using DSP(Digital Signal Processing) system for real-time image processing technique. The real-time eye-tracker system tracks the movements of user's pupils to project their gaze point onto a background image.

Clinical Convergence Study on Attention Processing of Individuals with Social Anxiety Tendency : Focusing on Positive Stimulation in Emotional Context (사회불안성향자의 주의 과정에 관한 임상 융합 연구 : 정서맥락에서 긍정 자극을 중심으로)

  • Park, Ji-Yoon;Yoon, Hyae-Young
    • Journal of the Korea Convergence Society
    • /
    • v.9 no.3
    • /
    • pp.79-90
    • /
    • 2018
  • The purpose of this study was to investigate the difference of individuals with social anxiety tendency and normal people according to existence of emotional context in attention processing for positive facial stimulation. To do this, we investigated attentional processing for positive face stimuli in a condition without/with emotional context. SADS and CES-D were administered to 800 undergraduate students in D city and the social anxiety group (SA, n=24) and the normal control group (NC, n=24) were selected. In order to measure the two factors of attention process (attention engagement and attention disengagement), first gaze direction and first gaze time were measured through eye-movement tracking. The results show that the SA group exhibited faster attention disengagement from positive face stimuli compared to the NC group in the condition without context. But, when the positive context presented with positive face stimuli, there is no difference between SA and NC. This result suggests that the positive background affects emotional processing of social anxiety disorder.

Application of Eye Tracker for Study on the Effect of Analytic Proof Learning of Gifted Students (수학영재 학생들의 분석적 증명 학습 효과 검증을 위한 시선추적기의 활용)

  • Jung, Kyung-Woo;Yun, Jong-Gug;Lee, Kwang Ho
    • Communications of Mathematical Education
    • /
    • v.32 no.3
    • /
    • pp.275-296
    • /
    • 2018
  • The purpose of this study is to investigate the change of gaze and the change of the proof learning achievement after learning the analytic method for proof to mathematical gifted students using eye tracking technique. In order to complete the purpose of this study, a mixed method research was used, that is a combination of quantitative and qualitative research methods. Quantitative analysis was conducted based on the data obtained through the eye tracker, and qualitative analysis was also done using post interview data to make up for the quantitative analysis. The subjects of this study were 8 mathematical gifted 3rd grade middle school students in the gifted education center. The conclusions of this study are as follows. First, the learning of analysis leads to a change of gaze in the proof learning of students. The students, after learning the analysis, moved their gaze from the bottom to the top when solving the proof problem, and the occupancy rate of the gaze to the bottom of the proof was higher than the higher part. Second, the change of gaze caused by the learning of the analysis have a correlation with the achievement of the proof learning and it can be seen that the method learning improves the achievement of the proof learning of the students.

Explosion Casting: An Efficient Selection Method for Overlapped Virtual Objects in Immersive Virtual Environments (몰입 가상현실 환경에서 겹쳐진 가상객체들의 효율적인 선택을 위한 펼침 시각화를 통한 객체 선택 방법)

  • Oh, JuYoung;Lee, Jun
    • The Journal of the Korea Contents Association
    • /
    • v.18 no.3
    • /
    • pp.11-18
    • /
    • 2018
  • To interact with a virtual object in immersive virtual environment, the target object should be selected quickly and accurately. Conventional 3D ray casting method using a direction of user's hand or head allows the user to select an object quickly. However, accuracy problem occurs when selecting an object using conventional methods among occlusion of objects. In this paper, we propose a region of interest based selection method that enables to select an object among occlusion of objects using a combination of gaze tracking and hand gesture recognition. When a user looks at a group of occlusion of objects, the proposed method recognizes user's gaze input, and then region of interest is set by gaze input. If the user wants to select an object among them, the user gives an activation hand gesture. Then, the proposed system relocates and visualizes all objects on a virtual active window. The user can select an object by a selecting hand gesture. Our experiment verified that the user can select an object correctly and accurately.

A Study on real time Gaze Discimination Using Kalman Fillter (Kalman-Filer를 이용한 효과적인 실시간 시선검출)

  • Jeong, You-Sun;Hong, Sung-Soo
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.5 no.4
    • /
    • pp.399-405
    • /
    • 2010
  • In this paper, the movement faces the problem of the difficult points upon the gaze of the user that corrective action is needed to solve the identification system offers a new perspective. Using the Kalman filter using the position information of the current head position estimated the future. In order to determine the authenticity of the face features of the face structural element information and the processing time is relatively fast horizontal and vertical histogram analysis method to detect the elements of the face. and people grow and infrared bright pupil effect obtained by constructing a real-time pupil detection, tracking and pupil - geulrinteu vectors are extracted.

The Comparison of Eye Movement in Measuring Tasks between the Underachievers and the Overachievers (측정과제에서 학습부진아와 학습우수아의 안구운동 비교)

  • Choi, Hyun-Dong;Shin, Won Sub;Shin, Dong-Hoon
    • Journal of Korean Elementary Science Education
    • /
    • v.33 no.1
    • /
    • pp.181-194
    • /
    • 2014
  • The purpose of this study was to analyze the difference between eye movements according to science achievement of elementary school students on measuring tasks. Science achievement was graded by the results of Korea national achievement test conducted in 2012. As an assessment tool to check measuring task, two measuring measure problems from TSPS(Test of Science Process Skill; developed in 1994) which were suitable for eye tracking system were adopted. The subjects of this study were 3 underachievers and 3 overachievers from 6th grade who agreed to participate in the research. SMI was used to collect EMD (eye movement data). Experiment 3.2 and BeGaze 3.2 programs were used to plan experiment and analyze EMD. As a result, eye movements of participants in measuring task did not show the path to the common gaze by groups. To solve the problem of using specific measuring strategies related to the correct answer. Underachiever who failed in measuring tasks don't have enough measurement capabilities and lack eye movement through the area of interest for cognitive thinking. These results show that elementary school science curriculum dealing with measuring have to reflect a lot of step-by-step learning requires.