• Title/Summary/Keyword: Gaze depth

Search Result 18, Processing Time 0.032 seconds

Evaluation of Gaze Depth Estimation using a Wearable Binocular Eye tracker and Machine Learning (착용형 양안 시선추적기와 기계학습을 이용한 시선 초점 거리 추정방법 평가)

  • Shin, Choonsung;Lee, Gun;Kim, Youngmin;Hong, Jisoo;Hong, Sung-Hee;Kang, Hoonjong;Lee, Youngho
    • Journal of the Korea Computer Graphics Society
    • /
    • v.24 no.1
    • /
    • pp.19-26
    • /
    • 2018
  • In this paper, we propose a gaze depth estimation method based on a binocular eye tracker for virtual reality and augmented reality applications. The proposed gaze depth estimation method collects a wide range information of each eye from the eye tracker such as the pupil center, gaze direction, inter pupil distance. It then builds gaze estimation models using Multilayer perceptron which infers gaze depth with respect to the eye tracking information. Finally, we evaluated the gaze depth estimation method with 13 participants in two ways: the performance based on their individual models and the performance based on the generalized model. Through the evaluation, we found that the proposed estimation method recognized gaze depth with 90.1% accuracy for 13 individual participants and with 89.7% accuracy for including all participants.

Correcting the gaze depth by using DNN (DNN을 이용한 응시 깊이 보정)

  • Seok-Ho Han;Hoon-Seok Jang
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.16 no.3
    • /
    • pp.123-129
    • /
    • 2023
  • if we know what we're looking at, we can get a lot of information. Due to the development of eye tracking, Information on gaze point can be obtained through software provided by various eye tracking equipments. However, it is difficult to estimate accurate information such as the actual gaze depth. If it is possible to calibrate the eye tracker with the actual gaze depth, it will enable the derivation of realistic and accurate results with reliable validity in various fields such as simulation, digital twin, VR, and more. Therefore, in this paper, we experiment with acquiring and calibrating raw gaze depth using an eye tracker and software. The experiment involves designing a Deep Neural Network (DNN) model and then acquiring gaze depth values provided by the software for specified distances from 300mm to 10,000mm. The acquired data is trained through the designed DNN model and calibrated to correspond to the actual gaze depth. In our experiments with the calibrated model, we were able to achieve actual gaze depth values of 297mm, 904mm, 1,485mm, 2,005mm, 3,011mm, 4,021mm, 4,972mm, 6,027mm, 7,026mm, 8,043mm, 9,021mm, and 10,076mm for the specified distances from 300mm to 10,000mm.

Depth Video Post-processing for Immersive Teleconference (원격 영상회의 시스템을 위한 깊이 영상 후처리 기술)

  • Lee, Sang-Beom;Yang, Seung-Jun;Ho, Yo-Sung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.6A
    • /
    • pp.497-502
    • /
    • 2012
  • In this paper, we present an immersive videoconferencing system that enables gaze correction between users in the internet protocol TV (IPTV) environment. The proposed system synthesizes the gaze corrected images using the depth estimation and the virtual view synthesis algorithms as one of the most important techniques of 3D video system. The conventional processes, however, causes several problems, especially temporal inconsistency of a depth video. This problem leads to flickering artifacts discomforting viewers. Therefore, in order to reduce the temporal inconsistency problem, we exploit the joint bilateral filter which is extended to the temporal domain. In addition, we apply an outlier reduction operation in the temporal domain. From experimental results, we have verified that the proposed system is sufficient to generate the natural gaze-corrected image and realize immersive videoconferencing.

Eye Contact System Using Depth Fusion for Immersive Videoconferencing (실감형 화상 회의를 위해 깊이정보 혼합을 사용한 시선 맞춤 시스템)

  • Jang, Woo-Seok;Lee, Mi Suk;Ho, Yo-Sung
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.52 no.7
    • /
    • pp.93-99
    • /
    • 2015
  • In this paper, we propose a gaze correction method for realistic video teleconferencing. Typically, cameras used in teleconferencing are installed at the side of the display monitor, but not in the center of the monitor. This system makes it too difficult for users to contact each eyes. Therefore, eys contact is the most important in the immersive videoconferencing. In the proposed method, we use the stereo camera and the depth camera to correct the eye contact. The depth camera is the kinect camera, which is the relatively cheap price, and estimate the depth information efficiently. However, the kinect camera has some inherent disadvantages. Therefore, we fuse the kinect camera with stereo camera to compensate the disadvantages of the kinect camera. Consecutively, for the gaze-corrected image, view synthesis is performed by 3D warping according to the depth information. Experimental results verify that the proposed system is effective in generating natural gaze-corrected images.

Method for Automatic Switching Screen of OST-HMD using Gaze Depth Estimation (시선 깊이 추정 기법을 이용한 OST-HMD 자동 스위칭 방법)

  • Lee, Youngho;Shin, Choonsung
    • Smart Media Journal
    • /
    • v.7 no.1
    • /
    • pp.31-36
    • /
    • 2018
  • In this paper, we propose automatic screen on / off method of OST-HMD screen using gaze depth estimation technique. The proposed method uses MLP (Multi-layer Perceptron) to learn the user's gaze information and the corresponding distance of the object, and inputs the gaze information to estimate the distance. In the learning phase, eye-related features obtained using a wearable eye-tracker. These features are then entered into the Multi-layer Perceptron (MLP) for learning and model generation. In the inference step, eye - related features obtained from the eye tracker in real time input to the MLP to obtain the estimated depth value. Finally, we use the results of this calculation to determine whether to turn the display of the HMD on or off. A prototype was implemented and experiments were conducted to evaluate the feasibility of the proposed method.

The Identification of Females Fans Identify with the Male Beauty Influencers in SNS - Focusing on Jacques Lacan's Gaze (SNS에 남성 뷰티 인플루언서를 향한 여성 팬의 동일시 - 라캉의 응시 이론을 중심으로)

  • LI LINGJIE
    • Trans-
    • /
    • v.15
    • /
    • pp.57-79
    • /
    • 2023
  • This study aims to explore the strategies and effects of SNS images used by four popular male beauty influencers to gain identification with their female fans. The research selected four male beauty influencers, namely Li Jiaqi, Jeffree Star, James Charles, and Bretman Rock, with a high number of subscribers on Instagram, YouTube, and TikTok as of July 21, 2023. By observing the content they posted on SNS, the study analyzed the types, characteristics, and relevance of male beauty influencer images with their female fans using Lacan's gaze theory. Additionally, concepts related to gaze, such as the mirror stage, the screen, and objet petit a, were supplemented to conduct an in-depth analysis of the characteristics of male beauty influencer images and the motivations of female viewers. The study results suggest that male beauty influencers can maintain an intimate relationship, referred to as 'girl-friendship,' with their female fans through the identification formed by the homogeneity within the feminized mirror images. Furthermore, male beauty influencers can transform female viewers from being seen as objects to seeing them as subjects by presenting images that embrace diversity in gender identity, challenging the traditional notions of societal gender norms. Therefore, the images of male beauty influencers not only challenge gender stereotypes but also cater to the demands for independence and equality of modern young women, promote understanding of feminine gaze, and explore the potential for democratization and inclusivity on social media platforms from a new perspective.

Real-time Eye Contact System Using a Kinect Depth Camera for Realistic Telepresence (Kinect 깊이 카메라를 이용한 실감 원격 영상회의의 시선 맞춤 시스템)

  • Lee, Sang-Beom;Ho, Yo-Sung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.4C
    • /
    • pp.277-282
    • /
    • 2012
  • In this paper, we present a real-time eye contact system for realistic telepresence using a Kinect depth camera. In order to generate the eye contact image, we capture a pair of color and depth video. Then, the foreground single user is separated from the background. Since the raw depth data includes several types of noises, we perform a joint bilateral filtering method. We apply the discontinuity-adaptive depth filter to the filtered depth map to reduce the disocclusion area. From the color image and the preprocessed depth map, we construct a user mesh model at the virtual viewpoint. The entire system is implemented through GPU-based parallel programming for real-time processing. Experimental results have shown that the proposed eye contact system is efficient in realizing eye contact, providing the realistic telepresence.

Illness Experience of Women with Breast cancer in Korea: Using Feminist Phenomenology (페미니스트 현상학을 이용한 한국 유방암 환자의 질병체험)

  • Park, Eun-Young;Yi, Myung-Sun
    • Korean Journal of Adult Nursing
    • /
    • v.21 no.5
    • /
    • pp.504-518
    • /
    • 2009
  • Purpose: The purpose is to explore the illness experience of Korean women with breast cancer using feminist phenomenology. Methods: Data were collected by individual in-depth interviews from ten women with total mastectomy. The data were analyzed using Colaizzi's method from feminist perspective to reveal implicit socio-cultural norms that oppress women with breast cancer. Results: Two categories and seven major themes emerged: cancer-related experience (1) unfairness of having breast cancer; (2) being confined to the gaze of the others; patriarchy-related experience (3) hardness of being daughter-in-law; (4) struggling to keep on being good mother; (5) continued housework as duty; (6) recognizing self as precious wife, and (7) awakening of true self. All participants felt it was very unfair to get breast cancer because they had done their best for roles of mother, wife, and daughter-in-law. They struggled to free themselves from the social disgrace like the roles imposed by the patriarchal society. By awakening their true selves, they could manage a balance between other-oriented life and self-oriented life. Conclusion: Oncology nurses need to provide psychosocial support for women with breast cancer in finding their true selves in a traditional patriarchal society where women are oppressed and breast cancer is stigmatized.

  • PDF

Face Detection based Real-time Eye Gaze Correction Method Using a Depth Camera (거리 카메라를 이용한 얼굴 검출 기반 실시간 시선 보정 방법)

  • Jo, Hoon;Ra, Moon-Soo;Kim, Whoi-Yul;Kim, Deuk-Hwa
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2012.11a
    • /
    • pp.151-154
    • /
    • 2012
  • 본 논문에서는 화상통신의 현실감을 증진시킬 수 있는 화자 간 시선 맞춤 시스템을 제안한다. 제안하는 방법은 Kinect 거리 카메라로부터 입력된 영상에서 화자의 얼굴 영역을 획득하여 화자의 시선이 카메라를 응시하도록 획득한 영역을 변환한 후에 원본 영상과 합성한다. Kinect 거리 카메라에서 획득한 얼굴 영역에는 다양한 형태의 잡음이 많아 미디언 필터와 모폴로지 연산을 통해 얼굴 영역의 잡음을 제거한다. 화자의 위치에 상관 없이 화자가 카메라를 응시하는 영상을 생성하기 위해서 Kinect 가 제공하는 거리 정보를 이용하여 시선 보정 각도와 회전 축을 획득한다. 시선이 보정된 얼굴 영역은 원본 영상에서 존재하지 않는 영역을 포함하고 있기 때문에, 원본 영상의 각 화소를 삼각형 메쉬로 구성한 후 해당 영역을 보간하여 최종적으로 시선이 보정된 영상을 생성한다. 제안하는 방법은 시선 맞춤 영상을 생성하는 데 필수적인 눈과 주변 얼굴 영역만 선택해서 변환하므로 영상의 왜곡이 적고 실시간 처리가 가능하다는 장점이 있다. 또한 카메라와 화자 사이의 거리 정보를 이용해 화자의 위치에 적응적인 시선 맞춤 영상을 생성할 수 있다. 실험을 통해 Intel i5 CPU 를 장착한 PC에서 $320{\times}240$ 크기의 영상을 사용할 경우 초당 약 35 프레임의 보정된 영상을 생성하여 제안하는 방법이 실시간 처리가 가능하다는 것을 확인하였다.

  • PDF

Expressional Characteristics of Interior Design Presented in the Food and Beverage Spaces of Yukio Hashimoto (하시모토 유키오의 식음공간에 나타난 디자인 표현특성)

  • Ko, Myung-Ae;Kim, Moon-Duck
    • Korean Institute of Interior Design Journal
    • /
    • v.26 no.2
    • /
    • pp.101-109
    • /
    • 2017
  • The food and beverage spaces of modern industrial society have transformed from a simple space for meals into a space of culture, communication and experience as society becomes more complex and diverse along side economic growth. An interior designer who is rapidly rising on this flow of change is Yukio Hashimoto. While working for interior design firm Super Potato, which highlights food and beverage spaces, he was much affected by the expression methods of representative designer Takashi Sugimoto, who makes use of natural elements. By using these expression methods that make use of natural elements in his own creation of spatial ambience and elements of experience and by adding his own differentiated expression methods, he emphasizes an effective spatial expression for food and beverage spaces. The design characteristics of Yukio Hashimoto's food and beverage spaces are as follows. First natural elements like light and water are recreated as memories of nature after being established through a methodology that allows these elements to penetrate his own thoughts. Second, he pursues a hybrid design through the harmony between past tradition and current expressive techniques. Third, he expresses objets of light through a formative sense of shape expressed with light.. Fourth, he establishes an axis in the interior space by light and structure and endows a strong directionality that induces symmetric characteristics, gaze, and movement.. Fifth, he installs lights at the bottom of weighty materials and expresses a sense of floating by light. Sixth, he uses an illusion technique that makes use of the ambiguity and depth of space resulting from reflecting materials like mirrors. The study hopes that such design expression characteristics of food and beverage spaces can be used as data for interior designers to apply and develop a new design vocabulary.