• Title/Summary/Keyword: Eye-Gaze Tracking

Search Result 131, Processing Time 0.021 seconds

Communication Support System for ALS Patient Based on Text Input Interface Using Eye Tracking and Deep Learning Based Sound Synthesi (눈동자 추적 기반 입력 및 딥러닝 기반 음성 합성을 적용한 루게릭 환자 의사소통 지원 시스템)

  • Park Hyunjoo;Jeong Seungdo
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.20 no.2
    • /
    • pp.27-36
    • /
    • 2024
  • Accidents or disease can lead to acquired voice dysphonia. In this case, we propose a new input interface based on eye movements to facilitate communication for patients. Unlike the existing method that presents the English alphabet as it is, we reorganized the layout of the alphabet to support the Korean alphabet and designed it so that patients can enter words by themselves using only eye movements, gaze, and blinking. The proposed interface not only reduces fatigue by minimizing eye movements, but also allows for easy and quick input through an intuitive arrangement. For natural communication, we also implemented a system that allows patients who are unable to speak to communicate with their own voice. The system works by tracking eye movements to record what the patient is trying to say, then using Glow-TTS and Multi-band MelGAN to reconstruct their own voice using the learned voice to output sound.

A Study on Neuro Sports Marketing by using Pupil's Size of Men: Focusing on Basketball Game (남성의 동공 크기를 이용한 뉴로 스포츠 마케팅의 접근 방법: 농구 경기를 중심으로)

  • Ko, Eui-Suk;Song, Ki-Hyeon;Cho, Soo-Hyun;Kim, Jong-Ha
    • Science of Emotion and Sensibility
    • /
    • v.20 no.1
    • /
    • pp.31-40
    • /
    • 2017
  • The present study used one of research techniques which is eye gaze tracking for neuromarketing. When pupil's size of men dilated over than three sigma (0.135%), the interest and eye movement in observation were measured. According to statistical analysis of previous studies, three sigma range is meaningful therefore sigma range was used as operational definition because 'pupil dilatation' is difficult to be define in eye gaze tracking data. Pictures of basketball games were selected as visual stimuli and 90% effective ratio of total 7,200 data were calculated. Thus, 29 of 34 participants were used for test. Pupil's size was calculated by applying pupil's width and height into a formular; [Pupil's size = Pupil width/2${\times}$Pupil height/$2{\times}{\pi}$]. In conclusion, billboard utilized for sports marketing had meaningless effects because gaze frequency to basketball player and surrounding environment was higher than that to billboard when participantsas game spectators diltaed their pupil's size over than three sigma. Thus, it was required using new marketing strategies like neuromarketing to increase utility through the present study.

3D First Person Shooting Game by Using Eye Gaze Tracking (눈동자 시선 추적에 의한 3차원 1인칭 슈팅 게임)

  • Lee, Eui-Chul;Park, Kang-Ryoung
    • The KIPS Transactions:PartB
    • /
    • v.12B no.4 s.100
    • /
    • pp.465-472
    • /
    • 2005
  • In this paper, we propose the method of manipulating the gaze direction of 3D FPS game's character by using eye gaze detection from the successive images captured by USB camera, which is attached beneath HMB. The proposed method is composed of 3 parts. At first, we detect user's pupil center by real-time image processing algorithm from the successive input images. In the second part of calibration, when the user gaze on the monitor plane, the geometric relationship between the gazing position of monitor and the detected position of pupil center is determined. In the last part, the final gaze position on the HMD monitor is tracked and the 3D view in game is controlled by the gaze position based on the calibration information. Experimental results show that our method can be used for the handicapped game player who cannot use his(or her) hand. Also, it can Increase the interest and the immersion by synchronizing the gaze direction of game player and the view direction of game character.

A Development of Video Monitoring System on Real Time (실시간 영상감시 시스템 개발)

  • Cho, Hyun-Seob
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.8 no.2
    • /
    • pp.240-244
    • /
    • 2007
  • Non-intrusive methods based on active remote IR illumination fur eye tracking is important for many applications of vision-based man-machine interaction. One problem that has plagued those methods is their sensitivity to lighting condition change. This tends to significantly limit their scope of application. In this paper, we present a new real-time eye detection and tracking methodology that works under variable and realistic lighting conditions. Based on combining the bright-pupil effect resulted from IR light and the conventional appearance-based object recognition technique, our method can robustly track eyes when the pupils are not very bright due to significant external illumination interferences. The appearance model is incorporated in both eyes detection and tracking via the use of support vector machine and the mean shift tracking. Additional improvement is achieved from modifying the image acquisition apparatus including the illuminator and the camera.

  • PDF

Analysis of Visual Attention in Bank Brand Logo using Eye-Tracking (시선추적장치를 활용한 은행 브랜드 로고의 시각적 주의집중도 분석 연구)

  • Park, Min Hee;Hwang, Mi Kyung;Kim, Chee Yong;Kwon, Mahn Woo
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.9
    • /
    • pp.1210-1218
    • /
    • 2020
  • This study selected brand logos of six South Korean and Chinese banks including KB, IBK, SH, ICBC, ABC, and SISB, conducted Eye Tracking experiment among 36 South Korean and Chinese university students(Nine male and female students, respectively), and analyzed the difference of visual attention of consumers on bank brand logo, symbol, Korean/Chinese character logo types as well as the difference of visual attention of these consumers on English logo types. Results were represented by using statistics and visualization including GAZEPLOT, HEATMAP, and visual expression. Results showed that most generally gazed logo types more often and longer than symbols when they watched bank brand logos. A slight difference was observed between both groups in terms of gazing English logo types. This study has a implication that it proposed the possibility of drawing quantitative and reliable outcomes by utilizing eye tracking device and approaching in an objective standpoint beyond a methodological aspect on bank brand logo primarily leaning over the analysis of case research or design development. Moreover, findings are expected to serve as basic data for proposing the direction of special bank brand logo design and marketing strategies.

Relationship between consumer behavior, perception of nutritional information, and menu factors on fast food using eye-tracking: A study on university students in Jeonju

  • Kyungjong Min;Kunjong Lee;Heajung Chung
    • Food Science and Preservation
    • /
    • v.31 no.3
    • /
    • pp.408-422
    • /
    • 2024
  • This study analyzed the factors that influence menu choices through eye-tracking and questionnaires in menu design. Demographic data of subjects coincided with choosing a menu and eye-tracking data. Hot Crispy Chicken Burger is the most popular menu. The study found that regardless of the selected menu, the menu name (35.5 seconds), price (21.6 seconds), and image (16.0 seconds) were viewed the longest, followed by country of origin (8.81 seconds), calories (4.6 seconds), and special indications (p<0.05). The menu name and image were checked more frequently, while calorie information was checked less often. As a result of analyzing various factors that influence menu selection through, Consumer experience and image greatly influenced menu choices. Therefore, if you want to receive a menu selection, it is considered effective to make good use of the menu name and image. In results of principal component analysis (PCA) by gender showed. Men had the longest price in the fixation duration. But, for females, there was a significant difference in gaze fixation when they took the exam, with menu names and special indications being important selection criteria. Since the results show that selection criteria and information acquisition methods differ depending on gender, this research is thought to be able to suggest directions for menu design.

Using POSTIT Eye Gaze Tracking in Real-time (POSTIT정보 이용한 실시간 눈동자 시선 추적)

  • Kim, Mi-Kyung;Choi, Yeon-Seok;Cha, Eui-Young
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2012.05a
    • /
    • pp.750-753
    • /
    • 2012
  • A method detecting the position of eyes and tracking a gaze point of eyes in realtime using POSIT is suggested in this paper. This algorithm find out a candidate area of eyes using topological characteristics of eyes and then decides the center of eyes using physical characteristics of eyes. To find the eyes, a nose and a mouth are used for POSIT. The experimental results show that proposed method effectively performed detection of eyes in facial image in FERET databases and gave high performance when used for tracking a gaze point of eyes.

  • PDF

A Study on Manipulating Method of 3D Game in HMD Environment by using Eye Tracking (HMD(Head Mounted Display)에서 시선 추적을 통한 3차원 게임 조작 방법 연구)

  • Park, Kang-Ryoung;Lee, Eui-Chul
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.45 no.2
    • /
    • pp.49-64
    • /
    • 2008
  • Recently, many researches about making more comfortable input device based on gaze detection technology have been done in human computer interface. However, the system cost becomes high due to the complicated hardware and there is difficulty to use the gaze detection system due to the complicated user calibration procedure. In this paper, we propose a new gaze detection method based on the 2D analysis and a simple user calibration. Our method used a small USB (Universal Serial Bus) camera attached on a HMD (Head-Mounted Display), hot-mirror and IR (Infra-Red) light illuminator. Because the HMD is moved according to user's facial movement, we can implement the gaze detection system of which performance is not affected by facial movement. In addition, we apply our gaze detection system to 3D first person shooting game. From that, the gaze direction of game character is controlled by our gaze detection method and it can target the enemy character and shoot, which can increase the immersion and interest of game. Experimental results showed that the game and gaze detection system could be operated at real-time speed in one desktop computer and we could obtain the gaze detection accuracy of 0.88 degrees. In addition, we could know our gaze detection technology could replace the conventional mouse in the 3D first person shooting game.

Design of Korean eye-typing interfaces based on multilevel input system (단계식 입력 체계를 이용한 시선 추적 기반의 한글 입력 인터페이스 설계)

  • Kim, Hojoong;Woo, Sung-kyung;Lee, Kunwoo
    • Journal of the HCI Society of Korea
    • /
    • v.12 no.4
    • /
    • pp.37-44
    • /
    • 2017
  • Eye-typing is one kind of human-computer interactive input system which is implemented by location data of gaze. It is widely used as an input system for paralytics because it does not require physical motions other than the eye movement. However, eye-typing interface based on Korean character has not been suggested yet. Thus, this research aims to implement the eye-typing interface optimized for Korean. To begin with, design objectives were established based on the features of eye-typing: significant noise and Midas touch problem. Multilevel input system was introduced to deal with noise, and an area free from input button was applied to solve Midas touch problem. Then, two types of eye-typing interfaces were suggested on phonological consideration of Korean where each syllable is generated from combination of several phonemes. Named as consonant-vowel integrated interface and separated interface, the two interfaces are designed to input Korean in phases through grouped phonemes. Finally, evaluation procedures composed of comparative experiments against the conventional Double-Korean keyboard interface, and analysis on flow of gaze were conducted. As a result, newly designed interfaces showed potential to be applied as practical tools for eye-typing.

Use of gaze entropy to evaluate situation awareness in emergency accident situations of nuclear power plant

  • Lee, Yejin;Jung, Kwang-Tae;Lee, Hyun-Chul
    • Nuclear Engineering and Technology
    • /
    • v.54 no.4
    • /
    • pp.1261-1270
    • /
    • 2022
  • This study was conducted to investigate the possibility of using gaze entropy to evaluate an operator's situation awareness in an emergency accident situation of a nuclear power plant. Gaze entropy can be an effective measure for evaluating an operator's situation awareness at a nuclear power plant because it can express gaze movement as a single comprehensive number. In order to determine the relationship between situation awareness and gaze entropy for an emergency accident situation of a nuclear power plant, an experiment was conducted to measure situation awareness and gaze entropy using simulators created for emergency accident situations LOCA, SGTR, SLB, and LOV. The experiment was to judge the accident situation of nuclear power plants presented in the simulator. The results showed that situation awareness and Shannon, dwell time, and Markov entropy had a significant negative correlation, while visual attention entropy (VAE) did not show any significant correlation with situation awareness. The results determined that Shannon entropy, dwell time entropy, and Markov entropy could be used as measures to evaluate situation awareness.