• 대한인간공학회지
• /
• 제31권4호
• /
• pp.601-607
• /
• 2012

Objective: The aim of this study is to classify between intentional and natural blinks in vision based eye tracking system. Through implementing the classification method, we expect that the great eye tracking method will be designed which will perform well both navigation and selection interactions. Background: Currently, eye tracking is widely used in order to increase immersion and interest of user by supporting natural user interface. Even though conventional eye tracking system is well focused on navigation interaction by tracking pupil movement, there is no breakthrough selection interaction method. Method: To determine classification threshold between intentional and natural blinks, we performed experiment by capturing eye images including intentional and natural blinks from 12 subjects. By analyzing successive eye images, two features such as eye closed duration and pupil size variation after eye open were collected. Then, the classification threshold was determined by performing SVM(Support Vector Machine) training. Results: Experimental results showed that the average detection accuracy of intentional blinks was 97.4% in wearable eye tracking system environments. Also, the detecting accuracy in non-wearable camera environment was 92.9% on the basis of the above used SVM classifier. Conclusion: By combining two features using SVM, we could implement the accurate selection interaction method in vision based eye tracking system. Application: The results of this research might help to improve efficiency and usability of vision based eye tracking method by supporting reliable selection interaction scheme.

• Journal of Multimedia Information System
• /
• 제7권1호
• /
• pp.11-16
• /
• 2020

Deep Learning has become the most important technology in the field of artificial intelligence machine learning, with its high performance overwhelming existing methods in various applications. In this paper, an interactive window service based on object recognition technology is proposed. The main goal is to implement an object recognition technology using this deep learning technology to remove the existing eye tracking technology, which requires users to wear eye tracking devices themselves, and to implement an eye tracking technology that uses only usual cameras to track users' eye. We design an interactive system based on efficient eye detection and pupil tracking method that can verify the user's eye movement. To estimate the view-direction of user's eye, we initialize to make the reference (origin) coordinate. Then the view direction is estimated from the extracted eye pupils from the origin coordinate. Also, we propose a blink detection technique based on the eye apply ratio (EAR). With the extracted view direction and eye action, we provide some augmented information of interest without the existing complex and expensive eye-tracking systems with various service topics and situations. For verification, the user guiding service is implemented as a proto-type model with the school map to inform the location information of the desired location or building.

• 전기학회논문지
• /
• 제66권7호
• /
• pp.1111-1116
• /
• 2017

In this paper, we developed bio-signal based eye tracking system using electrooculogram (EOG) and electromyogram (EMG) which measured simultaneously from same electrodes. In this system, eye gazing position can be estimated using EOG signal and we can use EMG signal at the same time for additional command control interface. For EOG signal processing, PLA algorithms are applied to reduce processing complexity but still it can guarantee less than 0.2 seconds of reaction delay time. Also, we developed dual machine learning structure and it showed robust and enhanced tracking performances. Compare to conventional EOG based eye tracking system, developed system requires relatively light hardware system specification with only two skin contact electrodes on both sides of temples and it has advantages on application to mobile equipments or wearable devices. Developed system can provide a different UX for consumers and especially it would be helpful to disabled persons with application to orthotics for those of quadriplegia or communication tools for those of intellectual disabilities.

• 한국콘텐츠학회논문지
• /
• 제19권7호
• /
• pp.91-98
• /
• 2019

본 연구는 유아 시선 추적 연구의 특성을 분석하고, 이를 바탕으로 유아를 대상으로 하는 시선 추적 장치를 개발하여, 자료수집 기능을 실험하는데 목적을 두었다. 시선 추적은 눈의 위치와 움직임을 측정하고 분석하는 과정을 통하여, 인간의 인지 및 사고에 대한 과학적인 자료를 제공한다. 본 연구에서 제작한 시선 추적 장치 카메라 모듈은 국내에서 쉽게 구할 수 있는 일반 부품을 활용하여 구성하였고, 분석 소프트웨어는 Arrington Research의 Viewpoint를 사용하였다. 본 연구에서 개발된 시선 추적 장치의 정확도를 검증하기 위하여 시선 추적 전문 기업 Tobii의 시선 추적 장치에서 수집된 시선 추적 자료와 비교하였다. 시선 추적 자료 수집은 만 5세 유아 52명을 대상으로 이루어졌으며, 테스트 결과 유효도를 t 검증으로 분석한 결과 두 시스템 간에 유의한 차이가 나타나지 않았다. 이러한 결과는 본 연구에서 개발한 시선 추적 장치가 일정한 실험 환경 내에서 유아의 시선 추적 자료를 수집하는데 적절한 수준의 정확도를 보여준다는 것을 나타낸다.

• 스마트미디어저널
• /
• 제10권1호
• /
• pp.9-15
• /
• 2021

본 논문에서 고안된 시선추적 시스템은 루게릭(Lou Gehrig's)이나 각종 근육 관련 질환으로 신체가 부자연스러운 분들을 위해 쉽게 접근할 수 있도록 고안된 안구기반 컴퓨터 입력 장치로, 약 1,700명 정도로 추산되는 국내 루게릭 환자 수와 각종사고나 질환에 의해 몸을 움직이기 힘든 환자의 수를 합쳐 잠재적 수요만 국내 3만 명에 이르는 사용자를 위한 안구입력 장치이다. 이 안구 입력 장치는 소수의 사용자를 위한 장치이기 때문에 시중에서는 수많은 종류의 상용기기가 제공되고 있어, 이 잠재적 사용자들이 사용하기에는 가격도 비싸고 사용방법도 어려워, 접근성이 많이 떨어지고 있다. 그 이유로는, 각 개인의 경제사정과 스마트 디바이스에 대한 개별 사용 경험도 조금씩 달라 시중 시선추적 시스템을 사용해보기에는 비용 면이나 사용성 면에서 접근하기가 어려운 경우가 대부분이라 할 수 있다. 이에 따라, 저가의 기기지만 엄선된 부품과 사용하기 편리한 기술을 통해 IT 기기로의 접근성을 개선하여 사용자들에게 쉬운 접근이 가능하도록 하는 시도는 반드시 필요하다. 이에, 본 논문에서는 여러 종류의 시선추적 시스템을 사용했던 사용자들의 자발적 VoC(Voice of Customer)를 통해 기존 시스템의 부족한 점을 개선하고, 사용성 테스트를 통해 이를 만족하는 시스템을 보완/설계함으로써 훨씬 더 많은 사람 및 환자들이 편리하게 사용할 수 있게하고, 기존 PCCR 시스템 대비 계산량을 15배 이상 줄이는 동시에, 시선 오차도 0.5~1도 이내로 보완된 우수한 성능의 시선추적 시스템을 제안한다.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2005년도 심포지엄 논문집 정보 및 제어부문
• /
• pp.33-35
• /
• 2005

We propose an eye gaze tracking system under natural head movements. The system consists of one CCD camera and two front-surface mirrors. The mirrors rotate to follow head movements in order to keep the eye within the view of the camera. However, the mirror controller cannot guarantee the fast head movements, because the frame rate is generally 30Hz. To overcome this problem, we applied Kalman predictor to estimate next eye position from the current eye image. In the results, our system allows the subjects head to move 50cm horizontally and 40cm vertically, with the speed about 10cm/sec and 6cm/sec, respectively. And spatial gaze resolutions are about 4.5 degree and 4.5 degree, respectively, and the gaze estimation accuracy is 92% under natural head movements.

• 제어로봇시스템학회논문지
• /
• 제16권1호
• /
• pp.90-95
• /
• 2010

This paper describes the development of integrated head and eye tracker system. Vision based head tracker is performed and it has 7mm error in 300mm translation. The epi-polar method and point matching are used for determining a position of head and rotational degree. High brightness LEDs are installed on helmet and the installed pattern is very important to match the points of stereo system. Eye tracker also uses LED for constant illumination. A Position of gazed object(3m distance) is determined by pupil tracking and eye tracker has 1~5 pixel error. Integration of result data of each tracking system is important. RS-232C communication is applied to integrated system and triggering signal is used for synchronization.

• 제어로봇시스템학회논문지
• /
• 제15권3호
• /
• pp.265-272
• /
• 2009

In this paper, a simple optical method that uses an infrared(IR) cut filter is proposed to minimize variation of eye image by external infrared(IR) sources in a video based head mounted eye tracking system that is used in the field of sports. For this, the IR cut filter is attached to a head mount of the eye tracking system, and the camera with an IR LED is located between the IR cut filter and eye. In this structure, external IR is blocked by the IR cut filter, and the IR intensity on the eye can be controlled by the IR LED. Therefore, the illumination condition of the camera to capture the eye can be stable without being affected by external IR illuminations. To verify the proposed idea, variation of the eye image and intensity of the IR with/without the IR cut filter is measured under various illumination conditions. The measured data show that the IR cut filter method can block external IR effectively, and complex pupil detection algorithms can be replaced by a simple binarized method.

• 대한인간공학회지
• /
• 제19권1호
• /
• pp.77-90
• /
• 2000

The aim of this study is to develop and evaluate an efficient camera calibration method for vision-based head tracking. Tracking head movements is important in the design of an eye-controlled human/computer interface. A vision-based head tracking system was proposed to allow the user's head movements in the design of the eye-controlled human/computer interface. We proposed an efficient camera calibration method to track the 3D position and orientation of the user's head accurately. We also evaluated the performance of the proposed method. The experimental error analysis results showed that the proposed method can provide more accurate and stable pose (i.e. position and orientation) of the camera than the conventional direct linear transformation method which has been used in camera calibration. The results of this study can be applied to the tracking head movements related to the eye-controlled human/computer interface and the virtual reality technology.

• 디지털산업정보학회논문지
• /
• 제20권2호
• /
• pp.27-36
• /
• 2024

Accidents or disease can lead to acquired voice dysphonia. In this case, we propose a new input interface based on eye movements to facilitate communication for patients. Unlike the existing method that presents the English alphabet as it is, we reorganized the layout of the alphabet to support the Korean alphabet and designed it so that patients can enter words by themselves using only eye movements, gaze, and blinking. The proposed interface not only reduces fatigue by minimizing eye movements, but also allows for easy and quick input through an intuitive arrangement. For natural communication, we also implemented a system that allows patients who are unable to speak to communicate with their own voice. The system works by tracking eye movements to record what the patient is trying to say, then using Glow-TTS and Multi-band MelGAN to reconstruct their own voice using the learned voice to output sound.