• Title/Summary/Keyword: Gaze-Based Interaction

Search Result 33, Processing Time 0.025 seconds

3D Gaze-based Stereo Image Interaction Technique (3차원 시선기반 입체영상 인터랙션 기법)

  • Ki, Jeong-Seok;Jeon, Kyeong-Won;Jo, Sang-Woo;Kwon, Yong-Moo;Kim, Sung-Kyu
    • 한국HCI학회:학술대회논문집
    • /
    • 2007.02a
    • /
    • pp.512-517
    • /
    • 2007
  • There are several researches on 2D gaze tracking techniques for the 2D screen for the Human-Computer Interaction. However, the researches for the gaze-based interaction to the stereo images or contents are not reported. The 3D display techniques are emerging now for the reality service. Moreover, the 3D interaction techniques are much more needed in the 3D contents service environments. This paper addresses gaze-based 3D interaction techniques on stereo display, such as parallax barrier or lenticular stereo display. This paper presents our researches on 3D gaze estimation and gaze-based interaction to stereo display.

  • PDF

3D Interaction Technique on Stereo Display System

  • Kwon, Yong-Moo;Ki, Jeong-Seok;Jeon, Kyeong-Won;Kim, Sung-Kyu
    • 한국정보디스플레이학회:학술대회논문집
    • /
    • 2007.08b
    • /
    • pp.1235-1238
    • /
    • 2007
  • There are several researches on 2D gaze tracking techniques to the 2D screen for the Human-Computer Interaction. However, the researches for the gaze-based interaction to the stereo images or 3D contents are not reported. This paper presents a gaze-based 3D interaction technique on autostereoscopic display system.

  • PDF

3D Gaze Estimation and Interaction Technique (3차원 시선 추출 및 상호작용 기법)

  • Ki, Jeong-Seok;Jeon, Kyeong-Won;Kim, Sung-Kyu;Sohn, Kwang-Hoon;Kwon, Yong-Moo
    • Journal of Broadcast Engineering
    • /
    • v.11 no.4 s.33
    • /
    • pp.431-440
    • /
    • 2006
  • There are several researches on 2D gaze tracking techniques for the 2D screen for the Human-Computer Interaction. However, the researches for the gaze-based interaction to the stereo images or contents are not reported. The 3D display techniques are emerging now for the reality service. Moreover, the 3D interaction techniques are much more needed in the 3D contents service environments. This paper addresses gaze-based 3D interaction techniques on stereo display, such as parallax barrier or lenticular stereo display. This paper presents our researches on 3D gaze estimation and gaze-based interaction to stereo display.

Gaze Mirroring-based Intelligent Information System for Making User's Latent Interest (사용자의 잠재적 흥미를 인식하기 위한 주시 모방 모델 기반의 지능형 정보 시스템)

  • Park, Hye-Sun;Hirayama, Takatsugu;Matsuyama, Takashi
    • Journal of Intelligence and Information Systems
    • /
    • v.16 no.3
    • /
    • pp.37-54
    • /
    • 2010
  • The information system that preserves and presents information collections, records, processes, retrievals, is applied in various fields recently and is supporting man's many activities. Conventional information systems are based on the reactive interaction model. Such reactive systems respond to only specific instructions, i.e. the defined commands, from the user. To go beyond the reactive interaction, it is necessary that the interactive dynamic interaction based information system which understands human's action and intention autonomously and then provides sensible information adapted to the user. Therefore, we propose a Gaze Mirroring-based intelligent information system for making user's latent interest using the internal state estimation methods based on the interactive dynamic interaction. Then, the proposed Gaze Mirroring method is that an anthropomorphic agent(avatar) actively established the joint attention with the user by imitating user's eye-gaze behavior. We verify that the Gaze Mirroring can elicit the user's behavior reflecting the latent interestand contribute to improving the accuracy of interest estimation. We also have confidence that the Gaze Mirroring promotes the self-awareness of interest. Such a Gaze Mirroring-based intelligent information system also provides suitable information to user by making user's latent interest using the internal state estimation.

Non-intrusive Calibration for User Interaction based Gaze Estimation (사용자 상호작용 기반의 시선 검출을 위한 비강압식 캘리브레이션)

  • Lee, Tae-Gyun;Yoo, Jang-Hee
    • Journal of Software Assessment and Valuation
    • /
    • v.16 no.1
    • /
    • pp.45-53
    • /
    • 2020
  • In this paper, we describe a new method for acquiring calibration data using a user interaction process, which occurs continuously during web browsing in gaze estimation, and for performing calibration naturally while estimating the user's gaze. The proposed non-intrusive calibration is a tuning process over the pre-trained gaze estimation model to adapt to a new user using the obtained data. To achieve this, a generalized CNN model for estimating gaze is trained, then the non-intrusive calibration is employed to adapt quickly to new users through online learning. In experiments, the gaze estimation model is calibrated with a combination of various user interactions to compare the performance, and improved accuracy is achieved compared to existing methods.

Webcam-Based 2D Eye Gaze Estimation System By Means of Binary Deformable Eyeball Templates

  • Kim, Jin-Woo
    • Journal of information and communication convergence engineering
    • /
    • v.8 no.5
    • /
    • pp.575-580
    • /
    • 2010
  • Eye gaze as a form of input was primarily developed for users who are unable to use usual interaction devices such as keyboard and the mouse; however, with the increasing accuracy in eye gaze detection with decreasing cost of development, it tends to be a practical interaction method for able-bodied users in soon future as well. This paper explores a low-cost, robust, rotation and illumination independent eye gaze system for gaze enhanced user interfaces. We introduce two brand-new algorithms for fast and sub-pixel precise pupil center detection and 2D Eye Gaze estimation by means of deformable template matching methodology. In this paper, we propose a new algorithm based on the deformable angular integral search algorithm based on minimum intensity value to localize eyeball (iris outer boundary) in gray scale eye region images. Basically, it finds the center of the pupil in order to use it in our second proposed algorithm which is about 2D eye gaze tracking. First, we detect the eye regions by means of Intel OpenCV AdaBoost Haar cascade classifiers and assign the approximate size of eyeball depending on the eye region size. Secondly, using DAISMI (Deformable Angular Integral Search by Minimum Intensity) algorithm, pupil center is detected. Then, by using the percentage of black pixels over eyeball circle area, we convert the image into binary (Black and white color) for being used in the next part: DTBGE (Deformable Template based 2D Gaze Estimation) algorithm. Finally, using DTBGE algorithm, initial pupil center coordinates are assigned and DTBGE creates new pupil center coordinates and estimates the final gaze directions and eyeball size. We have performed extensive experiments and achieved very encouraging results. Finally, we discuss the effectiveness of the proposed method through several experimental results.

Gaze Interaction Using Half Blink Selection and The Wearable AR System (반 깜박임 선택을 이용한 응시 상호작용과 착용형 AR 시스템)

  • Park, Hyung-Min;Lee, Jae-Young;Lee, Seok-Han;Choi, Jong-Soo
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.46 no.5
    • /
    • pp.91-100
    • /
    • 2009
  • In this paper, we propose a wearable augmented reality system using gaze interaction. Gaze interaction has been considered to be the potential of easy, natural and fast way of interaction and becomes a suitable way in optical see-through HMD based wearable AR. Our system recognizes user's gaze point, half blink motion and displays the information of object seen by user to HMD. Half blink selection technique avoids the Midas touch problem and represents user's intention correctly. We've developed a AR annotation system and estimated the usability of gaze interaction. The accuracy and robustness of our technique is verified on the experimental results.

A Study on Interaction of Gaze-based User Interface in Mobile Virtual Reality Environment (모바일 가상현실 환경에서의 시선기반 사용자 인터페이스 상호 작용에 관한 연구)

  • Kim, Mingyu;Lee, Jiwon;Jeon, Changyu;Kim, Jinmo
    • Journal of the Korea Computer Graphics Society
    • /
    • v.23 no.3
    • /
    • pp.39-46
    • /
    • 2017
  • This study proposes a gaze-based user interface to provide user oriented interaction suitable for the virtual reality environment on mobile platforms. For this purpose, a mobile platform-based three-dimensional interactive content is produced, to test whether the proposed interface increases user satisfaction through the interactions in a mobile virtual reality environment. The gaze-based interface, the most common input method for mobile virtual reality content, is designed by considering two factors: the field of view and the feedback system. The performance of the proposed gaze-based interface is analyzed by conducting experiments on whether or not it offers motives for user interest, effects of enhanced immersion, differentiated formats from existing ones, and convenience in operating content.

A Gaze Tracking based on the Head Pose in Computer Monitor (얼굴 방향에 기반을 둔 컴퓨터 화면 응시점 추적)

  • 오승환;이희영
    • Proceedings of the IEEK Conference
    • /
    • 2002.06c
    • /
    • pp.227-230
    • /
    • 2002
  • In this paper we concentrate on overall direction of the gaze based on a head pose for human computer interaction. To decide a gaze direction of user in a image, it is important to pick up facial feature exactly. For this, we binarize the input image and search two eyes and the mouth through the similarity of each block ( aspect ratio, size, and average gray value ) and geometric information of face at the binarized image. We create a imaginary plane on the line made by features of the real face and the pin hole of the camera to decide the head orientation. We call it the virtual facial plane. The position of a virtual facial plane is estimated through projected facial feature on the image plane. We find a gaze direction using the surface normal vector of the virtual facial plane. This study using popular PC camera will contribute practical usage of gaze tracking technology.

  • PDF

Analysis of the Fashion Shops' Images Applying Gaze Frequency (주시빈도를 적용한 패션숍 파사드 이미지 분석)

  • Yeo, Mi;Oh, Sun Ae
    • Korean Institute of Interior Design Journal
    • /
    • v.22 no.6
    • /
    • pp.212-219
    • /
    • 2013
  • This study uses a fashion shop facade design to track human gaze, find gaze frequency for gaze time for the gaze points along the path of sight, and expose the importance of facade design and figure out the value through theoretical systematization. Thus, this study employed the measurement method in physiological psychology which is sight-tracking device with eye-tracking to perform effective data evaluation. To find gaze frequency and study the contents to reflect on the facade, precedent study review, and case study of facade design to collect stimulants to be used in eye-tracking experiment were executed. And the eye-tracking experiment which traces the movement of eye[pupil] was performed. As the result of analyzing gaze frequency, The characteristics of such gaze path formation made the characteristics for gaze frequency even clearer. What was characteristic in the analysis result according to 'average value for gaze time' was that only 8 out of 2000 areas showed over 1 second of frequency and, and all other shoed less than 1 second of gaze time. This indicates that human sight endlessly jumps around, and that it 'Stay' where it has interest. This study found the average of the frequency of this 'Stay' in facade design. This study well presents the major points to add value to the design of the space of facade based on scientific measurement/analysis data obtained through visual understanding. Through such, this study is thought to be able to have a positive interaction with marketing by forming a theoretical background bringing utility to purchase environment and assisting in sales increase.