• Title/Summary/Keyword: Gaze correction

Search Result 22, Processing Time 0.032 seconds

Robot Control Interface Using Gaze Recognition (시선 인식을 이용한 로봇 인터페이스 개발)

  • Park, Se Hyun
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.7 no.1
    • /
    • pp.33-39
    • /
    • 2012
  • In this paper, we propose robot control interface using gaze recognition which is not limited by head motion. Most of the existing gaze recognition methods are working well only if the head is fixed. Furthermore the methods require a correction process per each person. The interface in this paper uses a camera with built-in infrared filter and 2 LED light sources to see what direction the pupils turn to and can send command codes to control the system, thus it doesn't need any correction process per each person. The experimental results showed that the proposed interface can control the system exactly by recognizing user's gaze direction.

A Simple Eye Gaze Correction Scheme Using 3D Affine Transformation and Image In-painting Technique

  • Ko, Eunsang;Ho, Yo-Sung
    • Journal of Multimedia Information System
    • /
    • v.5 no.2
    • /
    • pp.83-86
    • /
    • 2018
  • Owing to high speed internet technologies, video conferencing systems are exploited in our home as well as work places using a laptop or a webcam. Although eye contact in the video conferencing system is significant, most systems do not support good eye contact due to improper locations of cameras. Several ideas have been proposed to solve the eye contact problem; however, some of them require complicated hardware configurations and expensive customized hardwares. In this paper, we propose a simple eye gaze correction method using the three-dimensional (3D) affine transformation. We also apply an image in-painting method to fill empty holes that are caused by round-off errors from the coordinate transformation. From experiments, we obtained visually improved results.

Depth Video Post-processing for Immersive Teleconference (원격 영상회의 시스템을 위한 깊이 영상 후처리 기술)

  • Lee, Sang-Beom;Yang, Seung-Jun;Ho, Yo-Sung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.6A
    • /
    • pp.497-502
    • /
    • 2012
  • In this paper, we present an immersive videoconferencing system that enables gaze correction between users in the internet protocol TV (IPTV) environment. The proposed system synthesizes the gaze corrected images using the depth estimation and the virtual view synthesis algorithms as one of the most important techniques of 3D video system. The conventional processes, however, causes several problems, especially temporal inconsistency of a depth video. This problem leads to flickering artifacts discomforting viewers. Therefore, in order to reduce the temporal inconsistency problem, we exploit the joint bilateral filter which is extended to the temporal domain. In addition, we apply an outlier reduction operation in the temporal domain. From experimental results, we have verified that the proposed system is sufficient to generate the natural gaze-corrected image and realize immersive videoconferencing.

Eye-Gaze Interaction On Computer Screen Evaluation

  • Ponglangka, Wirot;Sutakcom, Udom
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.84-88
    • /
    • 2005
  • Eye gaze positions evaluation on computer screen uses the human eye as an input device for computer systems is that it gives low resolution. We proposes a method to determine the eye gaze positions on the screen by using two-eye displacements as the information for mapping, and the perspective projection is applied to map the displacements to a position on a computer screen. The experiments were performed on 20 persons and a 17-inch monitor is used with the screen resolution of 1024x768 pixels. Gaze detection error was 3.18 cm (RMS error), with screen is divided into 5x8 and 7x10 positions on a 17-inch monitor. The results showed 100% and 96% correction, respectively.

  • PDF

Gaze Recognition Interface Development for Smart Wheelchair (지능형 휠체어를 위한 시선 인식 인터페이스 개발)

  • Park, S.H.
    • Journal of rehabilitation welfare engineering & assistive technology
    • /
    • v.5 no.1
    • /
    • pp.103-110
    • /
    • 2011
  • In this paper, we propose a gaze recognition interface for smart wheelchair. The gaze recognition interface is a user interface which recognize the commands using the gaze recognition and avoid the detected obstacles by sensing the distance through range sensors on the way to driving. Smart wheelchair is composed of gaze recognition and tracking module, user interface module, obstacle detector, motor control module, and range sensor module. The interface in this paper uses a camera with built-in infra red filter and 2 LED light sources to see what direction the pupils turn to and can send command codes to control the system, thus it doesn't need any correction process per each person. The results of the experiment showed that the proposed interface can control the system exactly by recognizing user's gaze direction.

User-Calibration Free Gaze Tracking System Model (사용자 캘리브레이션이 필요 없는 시선 추적 모델 연구)

  • Ko, Eun-Ji;Kim, Myoung-Jun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.18 no.5
    • /
    • pp.1096-1102
    • /
    • 2014
  • In remote gaze tracking system using infra-red LEDs, calibrating the position of reflected light is essential for computing pupil position in captured images. However, there are limitations in reducing errors because variable locations of head and unknown radius of cornea are involved in the calibration process as constants. This study purposes a gaze tracking method based on pupil-corneal reflection that does not require user-calibration. Our goal is to eliminate the correction process of glint positions, which require a prior calibration, so that the gaze calculation is simplified.

Eye Contact System Using Depth Fusion for Immersive Videoconferencing (실감형 화상 회의를 위해 깊이정보 혼합을 사용한 시선 맞춤 시스템)

  • Jang, Woo-Seok;Lee, Mi Suk;Ho, Yo-Sung
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.52 no.7
    • /
    • pp.93-99
    • /
    • 2015
  • In this paper, we propose a gaze correction method for realistic video teleconferencing. Typically, cameras used in teleconferencing are installed at the side of the display monitor, but not in the center of the monitor. This system makes it too difficult for users to contact each eyes. Therefore, eys contact is the most important in the immersive videoconferencing. In the proposed method, we use the stereo camera and the depth camera to correct the eye contact. The depth camera is the kinect camera, which is the relatively cheap price, and estimate the depth information efficiently. However, the kinect camera has some inherent disadvantages. Therefore, we fuse the kinect camera with stereo camera to compensate the disadvantages of the kinect camera. Consecutively, for the gaze-corrected image, view synthesis is performed by 3D warping according to the depth information. Experimental results verify that the proposed system is effective in generating natural gaze-corrected images.

Correcting the gaze depth by using DNN (DNN을 이용한 응시 깊이 보정)

  • Seok-Ho Han;Hoon-Seok Jang
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.16 no.3
    • /
    • pp.123-129
    • /
    • 2023
  • if we know what we're looking at, we can get a lot of information. Due to the development of eye tracking, Information on gaze point can be obtained through software provided by various eye tracking equipments. However, it is difficult to estimate accurate information such as the actual gaze depth. If it is possible to calibrate the eye tracker with the actual gaze depth, it will enable the derivation of realistic and accurate results with reliable validity in various fields such as simulation, digital twin, VR, and more. Therefore, in this paper, we experiment with acquiring and calibrating raw gaze depth using an eye tracker and software. The experiment involves designing a Deep Neural Network (DNN) model and then acquiring gaze depth values provided by the software for specified distances from 300mm to 10,000mm. The acquired data is trained through the designed DNN model and calibrated to correspond to the actual gaze depth. In our experiments with the calibrated model, we were able to achieve actual gaze depth values of 297mm, 904mm, 1,485mm, 2,005mm, 3,011mm, 4,021mm, 4,972mm, 6,027mm, 7,026mm, 8,043mm, 9,021mm, and 10,076mm for the specified distances from 300mm to 10,000mm.

Acquired Simulated Brown Syndrome Combined with Blepharoptosis after Upper Blepharoplasty (상안검성형술 후 발생한 후천성 유사 브라운증후군과 안검하수의 치험례)

  • Do, Eon Rok;Ha, Won Ho;Park, Dae Hwan
    • Archives of Craniofacial Surgery
    • /
    • v.13 no.2
    • /
    • pp.130-134
    • /
    • 2012
  • Purpose: Brown syndrome is motility disorder of the eyeball which shows limited elevation in adduction and occurs very rarely after eye surgery. The authors have experienced a case of strabismus-like Brown syndrome combined with blepharoptosis and report this case with the review of literatures. Methods: A 28-year-old female suffered from hypotropia in the primary gaze and severe blepharoptosis with diplopia of the right eye after upper blepharoplasty. Rotation showed an inability to elevate the adducted right eye. She underwent extraocular muscle surgery about the 7 mm tucking of the right superior rectus muscle and 6 mm recession of right inferior rectus muscle. Intraoperatively, injury of the superior rectus muscle and foreign body were observed. Seven months after the extraocular surgery, the patient underwent frontalis muscle transfer on the right upper eyelid for the correction of blepharoptosis. Results: Postoperatively, the patient was orthophoric in the primary gaze, and she had improvements in the correction of blepharoptosis and eyeball movement. Conclusion: Repeated eyelid surgeries increase the risk of ocular motility disorder. Careful approach is essential for the proper treatment and successful outcome in secondary surgeries.

Systematic Review of Reciprocal Changes after Spinal Reconstruction Surgery : Do Not Miss the Forest for the Trees

  • Kim, Chang-Wook;Hyun, Seung-Jae;Kim, Ki-Jeong
    • Journal of Korean Neurosurgical Society
    • /
    • v.64 no.6
    • /
    • pp.843-852
    • /
    • 2021
  • The purpose of this review was to synthesize the research on global spinal alignment and reciprocal changes following cervical or thoracolumbar reconstruction surgery. We carried out a search of PubMed, EMBASE, and Cochrane Library for studies through May 2020, and ultimately included 11 articles. The optimal goal of a truly balanced spine is to maintain the head over the femoral heads. When spinal imbalance occurs, the human body reacts through various compensatory mechanisms to maintain the head over the pelvis and to retain a horizontal gaze. Historically, deformity correction has focused on correcting scoliosis and preventing scoliotic curve progression. Following substantial correction of a spinal deformity, reciprocal changes take place in the flexible segments proximal and distal to the area of correction. Restoration of lumbar lordosis following surgery to correct a thoracolumbar deformity induces reciprocal changes in T1 slope, cervical lordosis, pelvic shift, and lower extremity parameters. Patients with cervical kyphosis exhibit different patterns of reciprocal changes depending on whether they have head-balanced or trunk-balanced kyphosis. These reciprocal changes should be considered to in order to prevent secondary spine disorders. We emphasize the importance of evaluating the global spinal alignment to assess postoperative changes.