• Title/Summary/Keyword: eye-tracking method

Search Result 175, Processing Time 0.021 seconds

System Development for Measuring Group Engagement in the Art Center (공연장에서 다중 몰입도 측정을 위한 시스템 개발)

  • Ryu, Joon Mo;Choi, Il Young;Choi, Lee Kwon;Kim, Jae Kyeong
    • Journal of Intelligence and Information Systems
    • /
    • v.20 no.3
    • /
    • pp.45-58
    • /
    • 2014
  • The Korean Culture Contents spread out to Worldwide, because the Korean wave is sweeping in the world. The contents stand in the middle of the Korean wave that we are used it. Each country is ongoing to keep their Culture industry improve the national brand and High added value. Performing contents is important factor of arousal in the enterprise industry. To improve high arousal confidence of product and positive attitude by populace is one of important factor by advertiser. Culture contents is the same situation. If culture contents have trusted by everyone, they will give information their around to spread word-of-mouth. So, many researcher study to measure for person's arousal analysis by statistical survey, physiological response, body movement and facial expression. First, Statistical survey has a problem that it is not possible to measure each person's arousal real time and we cannot get good survey result after they watched contents. Second, physiological response should be checked with surround because experimenter sets sensors up their chair or space by each of them. Additionally it is difficult to handle provided amount of information with real time from their sensor. Third, body movement is easy to get their movement from camera but it difficult to set up experimental condition, to measure their body language and to get the meaning. Lastly, many researcher study facial expression. They measures facial expression, eye tracking and face posed. Most of previous studies about arousal and interest are mostly limited to reaction of just one person and they have problems with application multi audiences. They have a particular method, for example they need room light surround, but set limits only one person and special environment condition in the laboratory. Also, we need to measure arousal in the contents, but is difficult to define also it is not easy to collect reaction by audiences immediately. Many audience in the theater watch performance. We suggest the system to measure multi-audience's reaction with real-time during performance. We use difference image analysis method for multi-audience but it weaks a dark field. To overcome dark environment during recoding IR camera can get the photo from dark area. In addition we present Multi-Audience Engagement Index (MAEI) to calculate algorithm which sources from sound, audience' movement and eye tracking value. Algorithm calculates audience arousal from the mobile survey, sound value, audience' reaction and audience eye's tracking. It improves accuracy of Multi-Audience Engagement Index, we compare Multi-Audience Engagement Index with mobile survey. And then it send the result to reporting system and proposal an interested persons. Mobile surveys are easy, fast, and visitors' discomfort can be minimized. Also additional information can be provided mobile advantage. Mobile application to communicate with the database, real-time information on visitors' attitudes focused on the content stored. Database can provide different survey every time based on provided information. The example shown in the survey are as follows: Impressive scene, Satisfied, Touched, Interested, Didn't pay attention and so on. The suggested system is combine as 3 parts. The system consist of three parts, External Device, Server and Internal Device. External Device can record multi-Audience in the dark field with IR camera and sound signal. Also we use survey with mobile application and send the data to ERD Server DB. The Server part's contain contents' data, such as each scene's weights value, group audience weights index, camera control program, algorithm and calculate Multi-Audience Engagement Index. Internal Device presents Multi-Audience Engagement Index with Web UI, print and display field monitor. Our system is test-operated by the Mogencelab in the DMC display exhibition hall which is located in the Sangam Dong, Mapo Gu, Seoul. We have still gotten from visitor daily. If we find this system audience arousal factor with this will be very useful to create contents.

Wavelet Transform-based Face Detection for Real-time Applications (실시간 응용을 위한 웨이블릿 변환 기반의 얼굴 검출)

  • 송해진;고병철;변혜란
    • Journal of KIISE:Software and Applications
    • /
    • v.30 no.9
    • /
    • pp.829-842
    • /
    • 2003
  • In this Paper, we propose the new face detection and tracking method based on template matching for real-time applications such as, teleconference, telecommunication, front stage of surveillance system using face recognition, and video-phone applications. Since the main purpose of paper is to track a face regardless of various environments, we use template-based face tracking method. To generate robust face templates, we apply wavelet transform to the average face image and extract three types of wavelet template from transformed low-resolution average face. However template matching is generally sensitive to the change of illumination conditions, we apply Min-max normalization with histogram equalization according to the variation of intensity. Tracking method is also applied to reduce the computation time and predict precise face candidate region. Finally, facial components are also detected and from the relative distance of two eyes, we estimate the size of facial ellipse.

Autostereoscopic Display based on Dual Layer Parallax Barrier (이중 계층 패렐랙스 배리어 기반의 무안경식 3D 디스플레이)

  • Lee, Hyun;Lee, Eung-Don;Um, Gi-Mun;Cheong, Won-Sik;Lee, Sung-Jung
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.68-76
    • /
    • 2011
  • We introduce a parallax barrier type autostereoscopic display in order to overcome the limited viewing angle of the conventional parallax barrier type displays. The proposed method adopts a special structure of double pairs of ITO that have a common TN-LC at the core of the conventional parallax barrier. Compared with the conventional parallax barrier type displays, the proposed display uses moving parallax barriers and eye tracking system to make stereoscopic view images adapted to the movement of viewer. We implemented a prototype of the proposed dual layer parallax barrier system, and verified that the proposed autostereoscopic display maintains seamless 3D views even when a viewer's head is moving.

Current Status of Korean Fashion Design Sensibility Evaluation Methods and Their Application Overseas (국내 패션디자인 감성평가 연구방법의 현황과 해외 적용 방안에 대한 연구)

  • An, Hyosun;Lee, Inseong
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • v.40 no.4
    • /
    • pp.660-668
    • /
    • 2016
  • In the $21^{st}$ century of digital information society, design is changing from an analog era that focuses on logical and rational knowledge to a new paradigm of an era focused on sensible communications that can react fast. Design becomes to fulfill sensible needs; moreover, full efforts are being made in the academic research of sensibility evaluation for the conceptualization, quantization, and visualization of design sensibilities based on the measurement and evaluation of sensibility. This study provides insight into a sensibility evaluation method to understand the global user's sensibility in the fashion design field. As for research methods, first, measurement methods of physical, psychological, and physiological reactions to design sensibility were examined through written research on sensibility evaluation in both domestic and overseas research. Next, studies on sensibility during the past 15 years from 2000 to 2014 in the field of domestic fashion design were analyzed to grasp research trends in sensibility evaluation methods; subsequently, suitable sensibility evaluation methods for current fashion design were discussed. As a result of the study, it was shown that most sensibility evaluation studies in the field of domestic fashion design are based on surveys using sensibility terms. However, it requires the process of translating among different terms in different lingual cultures and within the limits of a uniformed evaluation. In this regard, recent cases of overseas design studies have been applying new methods to measure physiological reactions such as eye tracking methods combined with IT. The analysis of multilateral sensibility evaluation methods in this study have significant meaning for use as basic data to establish a planning for an evaluation scale to measure the sensibility of global consumers towards modern fashion design more quantitatively.

Real-time pupil motion recognition and efficient character selection system using FPGA and OpenCV (FPGA와 OpenCV를 이용한 실시간 눈동자 모션인식과 효율적인 문자 선택 시스템)

  • Lee, Hee Bin;Heo, Seung Won;Lee, Seung Jun;Yu, Yun Seop
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2018.10a
    • /
    • pp.393-394
    • /
    • 2018
  • In this paper, the new system which improve the previously reported "Implementation to human-computer interface system with motion tracking using OpenCV and FPGA" is introduced and in this system, a character selection system for the physically uncomfortable patients is proposed. Using OpenCV, the eye area is detected, the pupil position is determined, and then the results are sent to the FPGA, and the character is selected finally. The method to minimize the pupil movement of the patient is used to output the character according to the user's intention. Using OpenCV, various computer vision algorithms can be easily applied, and using programmable FPGA, a pupil motion recognition and character selection system are implemented with a low cost.

  • PDF

Dynamic Parameter Visualization and Noise Suppression Techniques for Contrast-Enhanced Ultrasonography (조영증강 초음파진단을 위한 동적 파라미터 가시화기법 및 노이즈 개선기법)

  • Kim, Ho-Joon
    • Journal of KIISE
    • /
    • v.42 no.7
    • /
    • pp.910-918
    • /
    • 2015
  • This paper presents a parameter visualization technique to overcome the limitation of the naked eye in contrast-enhanced ultrasonography. A method is also proposed to compensate for the distortion and noise in ultrasound image sequences. Meaningful parameters for diagnosing liver disease can be extracted from the dynamic patterns of the contrast enhancement in ultrasound images. The visualization technique can provide more accurate information by generating a parametric image from the dynamic data. Respiratory motions and noise from micro-bubble in ultrasound data may cause a degradation of the reliability of the diagnostic parameters. A multi-stage algorithm for respiratory motion tracking and an image enhancement technique based on the Markov Random Field are proposed. The usefulness of the proposed methods is empirically discussed through experiments by using a set of clinical data.

Analysis on Evaluating Learner's Attention States in a Virtual Environment and Retained Memory after VR Learning (가상현실 학습자의 주의집중상태와 학습 후 기억내용에 관한 영향분석)

  • Park, Kyoung-Shin
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.10
    • /
    • pp.1835-1844
    • /
    • 2007
  • Recently there have been some positive evidences on the effects of learning in a virtual environment. However, most of these educational VR systems were not deeply considered in the design of drawing a learner's attention on lesson contents, which would help enhance retained memory. Hence, a study was conducted to measure 17 subjects' attention states using EEC, ECG, GSR, and eye-tracking and their behaviors while they were given guided search task or exploration task in a virtual environment consisting of five major events. It also analyzed the subject's remembered items after their VR experiences using a surrey. This paper Int describes an overview of the ocean virtual environment used in this study, and it then explains the experimental design, apparatus, and method. It will also discuss the results by a detail analysis (in a whole VR session as well as event-related 10-second 33 sub-sessions) with the subjects' attention states and their retained memory after the learning.

Estimating Location in Real-world of a Observer for Adaptive Parallax Barrier (적응적 패럴랙스 베리어를 위한 사용자 위치 추적 방법)

  • Kang, Seok-Hoon
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.23 no.12
    • /
    • pp.1492-1499
    • /
    • 2019
  • This paper propose how to track the position of the observer to control the viewing zone using an adaptive parallax barrier. The pose is estimated using a Constrained Local Model based on the shape model and Landmark for robust eye-distance measurement in the face pose. Camera's correlation converts distance and horizontal location to centimeter. The pixel pitch of the adaptive parallax barrier is adjusted according to the position of the observer's eyes, and the barrier is moved to adjust the viewing area. This paper propose a method for tracking the observer in the range of 60cm to 490cm, and measure the error, measurable range, and fps according to the resolution of the camera image. As a result, the observer can be measured within the absolute error range of 3.1642cm on average, and it was able to measure about 278cm at 320×240, about 488cm at 640×480, and about 493cm at 1280×960 depending on the resolution of the image.

Saliency Attention Method for Salient Object Detection Based on Deep Learning (딥러닝 기반의 돌출 객체 검출을 위한 Saliency Attention 방법)

  • Kim, Hoi-Jun;Lee, Sang-Hun;Han, Hyun Ho;Kim, Jin-Soo
    • Journal of the Korea Convergence Society
    • /
    • v.11 no.12
    • /
    • pp.39-47
    • /
    • 2020
  • In this paper, we proposed a deep learning-based detection method using Saliency Attention to detect salient objects in images. The salient object detection separates the object where the human eye is focused from the background, and determines the highly relevant part of the image. It is usefully used in various fields such as object tracking, detection, and recognition. Existing deep learning-based methods are mostly Autoencoder structures, and many feature losses occur in encoders that compress and extract features and decoders that decompress and extend the extracted features. These losses cause the salient object area to be lost or detect the background as an object. In the proposed method, Saliency Attention is proposed to reduce the feature loss and suppress the background region in the Autoencoder structure. The influence of the feature values was determined using the ELU activation function, and Attention was performed on the feature values in the normalized negative and positive regions, respectively. Through this Attention method, the background area was suppressed and the projected object area was emphasized. Experimental results showed improved detection results compared to existing deep learning methods.

Method Extracting Observation Data by Spatial Factor for Analysis of Selective Attention of Vision (시각의 선택적 주의집중 분석을 위한 공간요소별 주시데이터 추출방법)

  • Kim, Jong-Ha;Kim, Ju-Yeon
    • Science of Emotion and Sensibility
    • /
    • v.18 no.4
    • /
    • pp.3-14
    • /
    • 2015
  • This study has extracted observation data by spatial factor for the analysis of subjects' selective attention with the objects of public space at the entrance of subway stations. The methods extracting observation data can be summarized as the following. First, the frequency analysis by lattice was prevalent for those methods, but there is a limitation to the analysis of the observation data. On the contrary, the method extracting observation data by factor applied in this study can make it clear if any sight is concentrated on any particular factors in a space. Second, the results from the extracted data corresponding to the observation area can be objectified while the method setting up the observation area by applying the radius of fovea. Third, time-sequential trace of observation results of relevant factors was possible through hourly analysis of spatial factors. The consideration of the results of "corresponding spatial scope" which is the object of this study will reveal that the more the observation time, the less the degree of attention it receives. Fourth, the frequency of observation superiority was applied for the analysis of the sections with selective attention by time scope; this revealed that men and women had intensive observation in time scope I (52.4 %) and in time scope IV (24.0 %), respectively.