• Journal of Multimedia Information System
• /
• 제7권1호
• /
• pp.11-16
• /
• 2020

Deep Learning has become the most important technology in the field of artificial intelligence machine learning, with its high performance overwhelming existing methods in various applications. In this paper, an interactive window service based on object recognition technology is proposed. The main goal is to implement an object recognition technology using this deep learning technology to remove the existing eye tracking technology, which requires users to wear eye tracking devices themselves, and to implement an eye tracking technology that uses only usual cameras to track users' eye. We design an interactive system based on efficient eye detection and pupil tracking method that can verify the user's eye movement. To estimate the view-direction of user's eye, we initialize to make the reference (origin) coordinate. Then the view direction is estimated from the extracted eye pupils from the origin coordinate. Also, we propose a blink detection technique based on the eye apply ratio (EAR). With the extracted view direction and eye action, we provide some augmented information of interest without the existing complex and expensive eye-tracking systems with various service topics and situations. For verification, the user guiding service is implemented as a proto-type model with the school map to inform the location information of the desired location or building.

• 대한인간공학회지
• /
• 제35권5호
• /
• pp.391-401
• /
• 2016

Objective: This study aims to examine domestic literature on eye-tracking in the design area, and to present new eye-tracking application directions. Background: Eye-tracking was introduced in the experimental psychology field for the first time in the 1950s. Eye-tracking has high utilization values in the design application area because eye-tracking can accumulate data on what people see, providing the quantitative values on eye movement. Method: This study examined the papers published in domestic journals, as well as the papers presented in conferences from 2000 to 2016 through DBPIA. Results: Although the use of eye-tracking technology was slightly meager in the product design area, it has been actively used for the evaluation analyses of preference and attention in architecture/public design. Eye-tracking also presented a method to design advertisement that is helpful to advertisement effect measurement, and product salesin the advertisement design area. Since detail psychological analysis is possible, the application of eye-tracking in the studies related with user interface has been active. Conclusion: The eye-tracking technology is projected to be actively used as a new interface means, such as in helping in disabled people's communication and in device control, in addition to conventional application areas. Application: This study would be of help to find future research areas of eye-tracking.

• 한국초등과학교육학회지:초등과학교육
• /
• 제35권3호
• /
• pp.288-304
• /
• 2016

The purpose of this study is a review of previous studies and principles of eye-tracking techniques that are actively applied in recent elementary science education. Also it proposes to utilize the direction of eye tracking techniques in elementary science education research. Recent eye-tracking technology was developed, using the infrared pupil and the corneal reflection can be safely and accurately track the eye movements of the participants. Eye tracking has the advantage of higher temporal resolution, accessibility, convenience, objectivity, stability and safety. Analysis of the previous studies, there was a difference in the study design and analysis. The workshops and seminars are needed for accurate understanding of eye-tracking method in elementary science education research. In conclusion, the eye-tracking can be utilized such as effectiveness analysis of teaching materials and media, behaviors analysis of teachers and students in a real class, cognitive strategies and attention analysis of the student, discriminating tool of various education evaluation, etc.

• 한국정보전자통신기술학회논문지
• /
• 제2권3호
• /
• pp.61-69
• /
• 2009

본 논문에서는 새로운 실시간 시선 추적 방식을 제안하고자한다. 기존의 시선추적 방식은 사용자가 머리를 조금만 움직여도 잘못된 결과를 얻을 수가 있었고 각각의 사용자에 대하여 교정 과정을 수행할 필요가 있었다. 제안된 시선 추적 방법은 적외선 조명과 Generalized Regression Neural Networks(GRNN)를 이용함으로써 교정 과정 없이 머리의 움직임이 큰 경우에도 견실하고 정확한 시선 추적을 가능하도록 하였고 매핑 기능을 일반화함으로써 각각의 교정과정을 생략 할 수 있게 하여 학습에 참여하지 않은 다른 사용자도 시선 추적을 가능케 하였다. 실험결과 얼굴의 움직임이 있는 경우에는 평균 90%, 다른 사용자에 대해서는 평균 85%의 시선 추적 결과를 나타내었다.

• 한국건축시공학회:학술대회논문집
• /
• 한국건축시공학회 2021년도 봄 학술논문 발표대회
• /
• pp.275-276
• /
• 2021

In the construction industry, many of the inspection activities have been conducted by experts' eyes. The inspection performance of this kind of method is highly influenced by experience and knowledge of the expert. The experts who have fluent experience may show better inspection performance than the novice. The problem is the deficiency of experts in the near future due to the acceleration of retirement of the aging expert. Eye-tracking technology can be a solution to effectively educate the novice through transferring the knowledge of an expert and to advance the inspection activities using experts' eyes. This study, as an initial step to suggest the solution, (1) figured out the state of the art of eye-tracking technology, (2) reviewed the previous research to improve the inspection in construction using experts' eye, (3) explored the potential of the application area of eye-tracking technology, and (4) established the framework to develop the advanced inspection method in two application area which are construction site safety management and infrastructure performance measurement.

• Architectural research
• /
• 제22권4호
• /
• pp.155-162
• /
• 2020

Numerous scholars have explored the modeling, control, and optimization of energy systems in buildings, offering new insights about technology and environments that can advance industry innovation. Eye trackers deliver objective eye-gaze data about visual and attentional processes. Due to its flexibility, accuracy, and efficiency in research, eye tracking has a control scheme that makes measuring rapid eye movement in three-dimensional space possible (e.g., virtual reality, augmented reality). Because eye movement is an effective modality for digital interaction with a virtual environment, tracking how users scan a visual field and fix on various digital objects can help designers optimize building environments and materials. Although several scholars have conducted Virtual Reality studies in three-dimensional space, scholars have not agreed on a consistent way to analyze eye tracking data. We conducted eye tracking experiments using objects in three-dimensional space to find an objective way to process quantitative visual data. By applying a 12 × 12 grid framework for eye tracking analysis, we investigated how people gazed at objects in a virtual space wearing a headmounted display. The findings provide an empirical base for a standardized protocol for analyzing eye tracking data in the context of virtual environments.

• 한국멀티미디어학회논문지
• /
• 제23권4호
• /
• pp.566-573
• /
• 2020

Computers are the most common tool when using the Internet and utilizing a mouse to select and execute objects. Eye tracking technology is welcomed as an alternative technology to help control computers for users who cannot use their hands due to their disabilities. However, the pointer execution method of the existing eye tracking technique causes many malfunctions. Therefore, in this paper, we developed a gaze tracking interface that combines voice commands to solve the malfunction problem when the upper limb disabled uses the existing gaze tracking technology to execute computer menus and objects. Usability verification was conducted through comparative experiments regarding the improvements of the malfunction. The upper limb disabled who are hand-impaired use eye tracking technology to move the pointer and utilize the voice commands, such as, "okay" while browsing the computer screen for instant clicks. As a result of the comparative experiments on the reduction of the malfunction of pointer execution with the existing gaze interfaces, we verified that our system, Eye-Voice, reduced the malfunction rate of pointer execution and is effective for the upper limb disabled to use.

• 한국멀티미디어학회논문지
• /
• 제23권12호
• /
• pp.1454-1463
• /
• 2020

An important factor in eye-tracking PC interface for general paralyzed patients is the implementation of the mouse interface, for manipulating the GUI. With a successfully implemented mouse interface, users can generate mouse events exactly at the point of their choosing. However, it is difficult to define this interaction in the eye-tracking interface. This problem has been defined as the Midas touch problem and has been a major focus of eye-tracking research. There have been many attempts to solve this problem using blink, voice input, etc. However, it was not suitable for general paralyzed patients because some of them cannot wink or speak. In this paper, we propose a mouth-pop-up, eye-tracking mouse interface that solves the Midas touch problem as well as becoming a suitable interface for general paralyzed patients using a common RGB camera. The interface presented in this paper implements a mouse interface that detects the opening and closing of the mouth to activate a pop-up menu that the user can select the mouse event. After implementation, a performance experiment was conducted. As a result, we found that the number of malfunctions and the time to perform tasks were reduced compared to the existing method.

• 융합정보논문지
• /
• 제11권1호
• /
• pp.20-27
• /
• 2021

시선추적은 NUI 기술 중의 하나로 사용자가 응시하는 곳을 추적을 통해 알아낸다. 이 기술은 텍스트를 입력하거나 GUI를 제어할 수 있도록 하고 더 나아가 사용자의 시선 분석도 가능하게 하여 상업 광고 등에 응용될 수 있도록 한다. 시선추적 시스템은 영상의 품질과 사용자 움직임의 자유도에 따라 허용범위가 달라진다. 따라서 시선추적의 정밀도를 미리 추정하는 방법이 필요하다. 시선추적의 정확도는 하드웨어적인 변수 외에도 시선추적 알고리즘을 어떻게 구현하느냐에 따라 많은 영향을 받는다. 이에 따라 본 논문에서는 영상에서 동공 중심의 가능한 최대 이동 거리의 추정으로 동공 중심이 한 픽셀 움직일 때 시선은 몇 도가 바뀌는지 즉, 이론적 최대 분해능이 얼마인지를 추정하는 방법을 제시한다.

• 대한인간공학회지
• /
• 제19권1호
• /
• pp.77-90
• /
• 2000

The aim of this study is to develop and evaluate an efficient camera calibration method for vision-based head tracking. Tracking head movements is important in the design of an eye-controlled human/computer interface. A vision-based head tracking system was proposed to allow the user's head movements in the design of the eye-controlled human/computer interface. We proposed an efficient camera calibration method to track the 3D position and orientation of the user's head accurately. We also evaluated the performance of the proposed method. The experimental error analysis results showed that the proposed method can provide more accurate and stable pose (i.e. position and orientation) of the camera than the conventional direct linear transformation method which has been used in camera calibration. The results of this study can be applied to the tracking head movements related to the eye-controlled human/computer interface and the virtual reality technology.