• Title/Summary/Keyword: Gaze point

Search Result 66, Processing Time 0.028 seconds

Improving Eye-gaze Mouse System Using Mouth Open Detection and Pop Up Menu (입 벌림 인식과 팝업 메뉴를 이용한 시선추적 마우스 시스템 성능 개선)

  • Byeon, Ju Yeong;Jung, Keechul
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.12
    • /
    • pp.1454-1463
    • /
    • 2020
  • An important factor in eye-tracking PC interface for general paralyzed patients is the implementation of the mouse interface, for manipulating the GUI. With a successfully implemented mouse interface, users can generate mouse events exactly at the point of their choosing. However, it is difficult to define this interaction in the eye-tracking interface. This problem has been defined as the Midas touch problem and has been a major focus of eye-tracking research. There have been many attempts to solve this problem using blink, voice input, etc. However, it was not suitable for general paralyzed patients because some of them cannot wink or speak. In this paper, we propose a mouth-pop-up, eye-tracking mouse interface that solves the Midas touch problem as well as becoming a suitable interface for general paralyzed patients using a common RGB camera. The interface presented in this paper implements a mouse interface that detects the opening and closing of the mouth to activate a pop-up menu that the user can select the mouse event. After implementation, a performance experiment was conducted. As a result, we found that the number of malfunctions and the time to perform tasks were reduced compared to the existing method.

Development of Real-Time Vision-based Eye-tracker System for Head Mounted Display (영상정보를 이용한 HMD용 실시간 아이트랙커 시스템)

  • Roh, Eun-Jung;Hong, Jin-Sung;Bang, Hyo-Choong
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.35 no.6
    • /
    • pp.539-547
    • /
    • 2007
  • In this paper, development and tests of a real-time eye-tracker system are discussed. The tracker system tracks a user's gaze point through movement of eyes by means of vision-based pupil detection. The vision-based method has an advantage of detecting the exact positions of user's eyes. An infrared camera and a LED are used to acquire a user's pupil image and to extract pupil region, which was hard to extract with software only, from the obtained image, respectively. We develop a pupil-tracking algorithm with Kalman filter and grab the pupil images by using DSP(Digital Signal Processing) system for real-time image processing technique. The real-time eye-tracker system tracks the movements of user's pupils to project their gaze point onto a background image.

Analysis of Players' Eye-Movement Patterns by Playing Experience in FPS Game (FPS게임 플레이경험에 따른 플레이어의 시선경로 패턴 분석)

  • Choi, GyuHyeok;Kim, Mijin
    • Smart Media Journal
    • /
    • v.5 no.2
    • /
    • pp.33-41
    • /
    • 2016
  • FPS Games are usually centered on a combat game play where the player plays through a first-person perspective as the in-game character, in order to strike the opponent in accordance with each level's objective. In such type of game play, the decision making that leads the player to take certain actions is carried out based on the player's visual cognitive information, and information collected both directly/indirectly via previous game play experiences. Particularly in the case of a FPS game where the mutual interaction between the player and each game level is the key, an analysis of a FPS game player's visual cognitive information can provide intelligence which can help design or adjust structures of a game level. For this thesis, a sample group has been collected and divided into a novice group and an expert group based on their level of experience with FPS games. Then, using eye-tracking equipments, the point of gaze of players in each group were recorded whilst they were playing levels of a well-known FPS title. The point of gaze in the moment the player starts to take actions -right before/after the start of a combat- was recorded in 500 play videos, and as a result each group's intrinsic pattern of gaze could be identified. Through these results, the author plans to develop a methodology that can enhance the difficulty setting and the playability of FPS game levels.

Facial Point Classifier using Convolution Neural Network and Cascade Facial Point Detector (컨볼루셔널 신경망과 케스케이드 안면 특징점 검출기를 이용한 얼굴의 특징점 분류)

  • Yu, Je-Hun;Ko, Kwang-Eun;Sim, Kwee-Bo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.22 no.3
    • /
    • pp.241-246
    • /
    • 2016
  • Nowadays many people have an interest in facial expression and the behavior of people. These are human-robot interaction (HRI) researchers utilize digital image processing, pattern recognition and machine learning for their studies. Facial feature point detector algorithms are very important for face recognition, gaze tracking, expression, and emotion recognition. In this paper, a cascade facial feature point detector is used for finding facial feature points such as the eyes, nose and mouth. However, the detector has difficulty extracting the feature points from several images, because images have different conditions such as size, color, brightness, etc. Therefore, in this paper, we propose an algorithm using a modified cascade facial feature point detector using a convolutional neural network. The structure of the convolution neural network is based on LeNet-5 of Yann LeCun. For input data of the convolutional neural network, outputs from a cascade facial feature point detector that have color and gray images were used. The images were resized to $32{\times}32$. In addition, the gray images were made into the YUV format. The gray and color images are the basis for the convolution neural network. Then, we classified about 1,200 testing images that show subjects. This research found that the proposed method is more accurate than a cascade facial feature point detector, because the algorithm provides modified results from the cascade facial feature point detector.

Exercise rehabilitation for recurrent extraocular muscle movement limitation after pediatric blowout fracture surgery: a case report

  • Jeong Do Park;Syeo Young Wee;Se Young Kim
    • Archives of Craniofacial Surgery
    • /
    • v.24 no.3
    • /
    • pp.133-138
    • /
    • 2023
  • White-eyed blowout fractures with extraocular muscle (EOM) entrapment necessitate emergency surgical intervention. However, even after surgery, diplopia or EOM motion limitations may persist due to the incomplete reduction of soft tissue herniation caused by inadequate dissection or unresolved muscle strangulation. In this report, we present a case of postoperative EOM movement limitation in a 5-year-old girl who experienced recurrent restriction in the upward gaze of her right eye 14 days after surgery. Instead of revision surgery, the patient was treated with targeted EOM exercises focusing on the inferior rectus muscle and inferior oblique muscle. The patient was instructed to slowly move her pupils from the central point to the upper and outer sides, then in a straight line from the central point to the lower and inner sides before returning to the center point. On the 28th postoperative day, 2 weeks after initiating the exercises, the patient's EOM motion fully recovered. This case highlights the effectiveness of EOM exercises as a non-surgical treatment approach for improving recurrent EOM movement limitations in the absence of soft tissue herniation following surgical management of blowout fractures in children.

A Study for Detecting a Gazing Point Based on Reference Points (참조점을 이용한 응시점 추출에 관한 연구)

  • Kim, S.I.;Lim, J.H.;Cho, J.M.;Kim, S.H.;Nam, T.W.
    • Journal of Biomedical Engineering Research
    • /
    • v.27 no.5
    • /
    • pp.250-259
    • /
    • 2006
  • The information of eye movement is used in various fields such as psychology, ophthalmology, physiology, rehabilitation medicine, web design, HMI(human-machine interface), and so on. Various devices to detect the eye movement have been developed but they are too expensive. The general methods of eye movement tracking are EOG(electro-oculograph), Purkinje image tracker, scleral search coil technique, and video-oculograph(VOG). The purpose of this study is to embody the algorithm which tracks the location of the gazing point at a pupil. Two kinds of location data were compared to track the gazing point. One is the reference points(infrared LEDs) which is effected from the globe. Another is the center point of the pupil which is gained with a CCD camera. The reference point was captured with the CCD camera and infrared lights which were not recognized by human eyes. Both of images which were thrown and were not thrown an infrared light on the globe were captured and saved. The reflected reference points were detected with the brightness difference between the two saved images. In conclusion, the circumcenter theory of a triangle was used to look for the center of the pupil. The location of the gazing point was relatively indicated with the each center of the pupil and the reference point.

Balanced Tucking of the Levator Muscle and Müller's Muscle in Blepharoptosis (거근건막 전진을 병용한 Müller Turking에 의한 안검하수의 교정)

  • Park, Jang Woo;Shin, Ho Sung;Park, Eun Soo;Kim, Yong Bae
    • Archives of Plastic Surgery
    • /
    • v.33 no.2
    • /
    • pp.149-154
    • /
    • 2006
  • The levator and $M{\ddot{u}}ller^{\prime}s$ muscle balanced tucking was performed to correction myogenic or aponeurotic blepharoptosis. Through the blepharoplasty incision, the upper half of tarsal plate was exposed and the orbital was opened to show the levator aponeurosis. the $M{\ddot{u}}ller^{\prime}s$ muscle dissected from the upper border of the tarsal plate and from the posteriorly located conjunctiva with sharp scissors. $M{\ddot{u}}ller^{\prime}s$ muscle was advanced about 3 mm to 8 mm on anterior surface of the tarsal plate and fixed approximately upper one third of the tarsal plate with three horizontal 6-0 Nylon mattress sutures. The amount of tucking of $M{\ddot{u}}ller^{\prime}s$ muscle was controlled by the location of the upper eyelid margin 2 mm below the upper limbus in primary gaze after first temporary fixations suture in the maximum superior point of the limbus. The amount of advancement of levator aponeurosis was controlled by the location of the upper eyelid margin 1 mm below the upper limbus in primary gaze after first temporary fixations suture in the maximum superior point of the limbus. And then levator aponeurosis was fixed with three horizontal 6-0 Nylon mattress on beside the point that was tucked $M{\ddot{u}}ller^{\prime}s$ muscle. We have been thirty cases with levator and $M{\ddot{u}}ller^{\prime}s$ muscle balanced tucking from January 2004 to Jun 2005. 3 cases were traumatic blepharoptosis with 3-5 mm ptosis and poor levator function. 27 cases were myogenic or aponeurotic blepharoptosis with 2-5 mm ptosis with and more than 4 mm of levator function. the age of the patients ranged from 6 to 78 years. The levator aponeurosis and $M{\ddot{u}}ller^{\prime}s$ muscle tucking procedure can reduce the amount of the levator and $M{\ddot{u}}ller^{\prime}s$ muscle resection, and improve discomfort when the patients open eyes.

A Study on the Visual Attention of Sexual Appeal Advertising Image Utilizing Eye Tracking (아이트래킹을 활용한 성적소구광고 이미지의 시각적 주의에 관한 연구)

  • Hwang, Mi-Kyung;Kwon, Mahn-Woo;Lee, Sang-Ho;Kim, Chee-Yong
    • Journal of the Korea Convergence Society
    • /
    • v.11 no.10
    • /
    • pp.207-212
    • /
    • 2020
  • This study analyzes the Soju(Korean alcohol) advertisement image, which is relatively easy to interpret subjectively, among sexual appeal advertisements that stimulate consumers' curiosity, where the image is verified through AOI (area of interest) 3 areas (face, body, product), and eye-tracking, one of the psychophysiological indicators. The result of the analysis reveals that visual attention, the interest in the advertising model, was higher in the face than in the body shape. Contrary to the prediction that men would be more interested in body shape than women, both men and women showed higher interest in the face than a body. Besides, it was derived that recognition and recollection of the product were not significant. This study is significant in terms of examining the pattern of visual attention such as the gaze point and gaze time of male and female consumers on sexual appeal advertisements. In further, the study looks forward to bringing a positive influence to the soju advertisement image by presenting the expression method that the soju advertisement image should pursue as well as the appropriate marketing direction.

Utilizing Usability Metrics to Evaluate a Subway Map Design

  • Jung, Kwang Tae
    • Journal of the Ergonomics Society of Korea
    • /
    • v.36 no.4
    • /
    • pp.343-353
    • /
    • 2017
  • Objective: This study aims to evaluate the efficiency of two representative subway map design types, namely a diagram type and a geographical type using physiological metrics, performance metrics, and self-reported metrics, which are representative usability metrics. Background: Subway maps need to be designed in order for users to quickly search and recognize subway line information. Although most cities' subway maps currently use the diagram type designed by Henry Beck, New York City's subway map has recently been changed to the subway map type combined with the geographical type designed by Michael Hertz. However, not many studies on its efficiency are found, and the studies that are available mainly depend on questionnaire surveys or take on a subjective behavioral study type based on experts' experiences. In this regard, evaluation through a more objective method is needed. Method: This study employed usability metrics as a method to evaluate the efficiency of information search targeting the diagram type and geographical type subway maps used mostly as subway maps. To this end, physiological metrics obtained through eye tracking, task completion time, representative metric of task performance, and subjective evaluation metrics were used for the suitability evaluation of subway map designs. Results: In the result of gaze movement distance analysis, no significant difference was shown in the two design types in terms of a process finding a departure station from the starting point and a process finding a transfer station between the departure station and arrival station (destination). However, the gaze movement distance in the process finding the arrival station at the departure station was significantly shorter in the geographical type, rather than in the diagram type. The analysis of task completion time showed a result similar to the gaze movement distance analysis result. Task completion time was significantly shorter in the geographical type, rather than in the diagram type, which is in the process finding the arrival station at the departure station. In other information search processes, no significant difference was shown. As a result of subjective evaluation metrics analysis, no significant difference was revealed in the two design types. Conclusion: An analysis on the two representative subway map design types was carried out via the adoption of usability metrics. As a result, although no significant difference was shown in some information search processes, it was revealed that information search was easier in the geographical type overall. Also, it was found that usability metrics can be effectively used to evaluate the design types of subway maps. Application: The study results can be used to set design direction to offer ease in information search on subway lines. The study also can be used as a method to evaluate a subway map's design type.

Magritte's drawings and Lacan's Subject theory: Gaze, Encounter with the world (마그리트 회화와 라캉의 주체론 - 응시, 세계와의 조우)

  • Baek, Jin-Hwa
    • The Journal of Art Theory & Practice
    • /
    • no.5
    • /
    • pp.7-24
    • /
    • 2007
  • The subject is connected with a structure named "The Symbolic" to Lacan, but he denied that the subject is explained simply as a fruit of language and "Other". From his point of view, passing through Subject, De-formation and Crack over it is designated as foundation of generation and creation rather than our destined defect. It should not be understood that subject of "The Real" is a concept of the subject free itself from restraint of "The Symbolic". However, this does not mean he asserts "Subject" is something incapable of being controlled by the unknown power. The problem is that this autonomous existence meets inside of it with something "more than one's own self" by "circulating around itself" like a permanent star. This is the indication of a "stranger in the middle of my privacy", or "extimit$\'{e}$", a coined-word by Lacan. Perhaps "Subject" is nothing more than the name of distance of object which is "too hot" to come close, and of this circulating movement. It's because of this object that the real subject stands against generalization and the subject can't be restored to any place in symbolic order-even though it is empty. The part which is told from Lacan's structural theory, that is to say, an importance to Lacan is that his Subject theory is not suggested or denied as a manual structure. On the contrary, it is a study of the relationship between the settled symbol that included in "real subject which is a unconscious one" and the symbolic subject hold- that is a metaphysical subject in general meaning. In Lacan's enlarged concept of subject beyond symbolic reality, it is noticeable that it gives justifiability to the union of a medium of different nature in artistic expression. We can recognize that the unconscious world is a living space which enables it to be a "condition of human being", not something dark under the surface of water through Magritte's(Rene Magritte, 1898~1967) surrealistic works. In other words, Magritte's art secures a core dimension of human nature through a mysterious gap of conscious and settled space. Magritte's drawings often evokes strange and unsettling feelings in people who view his paintings. This is because routine objects are found in "unsuitable" places from which we usually find them in our everyday lives. "Reality" in Magritte's paintings makes it aware that it is a strained field of concealment and disclosure basically between truths, and we can learn that his behavior to overturn to paint in-visible things is finally an effort to restore the "real subject" to the viewer's reality. In other words, such reversion arouses a nostalgic desire for the objects existing in their original appearance as they are - natural condition that our gaze had not been distorted yet by anamorphic stains. - and the state when we are conscious of them normally. Such desire offers an opportunity for us to get out of mental depression rather than operates to us as an abnormal crack. It's a successive process of effort to search for lost subject and Paradise Lost facing up to reality of subject human that is to be a subject of world and life are ousted from their place by structure and authority of culture.

  • PDF