• 제목/요약/키워드: 가상휴먼

검색결과 67건 처리시간 0.029초

Gaze Matching Based on Multi-microphone for Remote Tele-conference (멀티 마이크로폰 기반 원격지 간 화상회의 시선 일치 기법)

  • Lee, Daeseong;Jo, Dongsik
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 한국정보통신학회 2021년도 추계학술대회
    • /
    • pp.429-431
    • /
    • 2021
  • Recently, as an alternative to replace face-to-face meetings, video conferencing systems between remote locations has increased. However, video conferencing systems have limitations in terms of mismatch of the eyes of remote users. Therefore, it is necessary to apply a technology that can increase the level of immersion in video conferences by matching the gaze information of participants between different remote locations. In this paper, we propose a novel technique to realize video conferencing with the same gaze by estimating the speaker's location based on a multi-microphone. Using our method, it can be applied to various fields such as robot interaction and virtual human interface as well as video conferencing between remote locations.

  • PDF

Predicting Sensitivity of Motion Sickness using by Pattern of Cardinal Gaze Position (기본 주시눈 위치의 패턴을 이용한 영상멀미의 민감도 예측)

  • Park, Sangin;Lee, Dong Won;Mun, Sungchul;Whang, Mincheol
    • Journal of the Korea Convergence Society
    • /
    • 제9권11호
    • /
    • pp.227-235
    • /
    • 2018
  • The aim of this study is to predict the sensitivity of motion sickness (MS) using pattern of cardinal gaze position (CGP) before experiencing the virtual reality (VR) content. Twenty volunteers of both genders (8 females, mean age $28.42{\pm}3.17$) participated in this experiment. They was required to measure the pattern of CGP for 5 minute, and then watched VR content for 15 minute. After watching VR content, subjective experience for MS reported from participants using by 'Simulator Sickness Questionnaire (SSQ)'. Statistical significance between CGP and SSQ score were confirmed using Pearson correlation analysis and independent t-test, and prediction model was extracted from multiple regression model. PCPA & PCPR indicators from CGP revealed significantly difference and strong or moderate positive correlation with SSQ score. Extracted prediction model was tested using correlation coefficient and mean error, SSQ score between subjective rating and prediction model showed strong positive correlation and low difference.

A Study on 3D Virtual Restoration and Convergence Utilization of Gas Masks for Digital Reproduction of War Cultural Heritage (전쟁 문화유산 디지털 재현을 위한 방독면 3D 가상 복원 및 융합 활용 연구)

  • Hyoung-Ki Ahn;Seung-Jun Oh;Ho-Yeon Lee;Young-Guy Lee
    • Journal of Internet of Things and Convergence
    • /
    • 제9권1호
    • /
    • pp.89-95
    • /
    • 2023
  • In January 2007, the Remains Excavation and Investigation Team of the Ministry of National Defense was established, and full-scale excavation of remains was promoted. Currently, the scope of the excavation is being expanded to Baekma Hill within the DMZ, where fierce battles were fought during the Korean War. Now, many remains and remains are being excavated in Baekma hill. Most are in damaged condition. Therefore, in this study, the original form of the excavated remains was restored using 3D scanning and 3D modeling. This digital restoration method can be an alternative to compensate for the disadvantages of the manual method. Currently, various digital restorations using 3D technology are active in the field of cultural heritage. Digitally restored materials can be used as basic data for digital heritage. Based on this, various contents related to excavation of remains and patriots and veterans can be developed. Furthermore, if digital human restoration is made based on the excavated remains, it will be possible to reproduce the appearance of the dead.

Laser Pointer Interaction System Based on Image Processing (영상처리 기반의 레이저 포인터 인터랙션 시스템)

  • Kim, Nam-Woo;Lee, Seung-Jae;Lee, Joon-Jae;Lee, Byung-Gook
    • Journal of Korea Multimedia Society
    • /
    • 제11권3호
    • /
    • pp.373-385
    • /
    • 2008
  • The evolution of input device for computer has pretty much slowed down after the introduction of mouse as feinting input device. Even though stylus and touch screen were invented later on which provide some alternatives, all these methods were designed to have close range interaction with computer. There are not many options available for user to interact with computer from afar, which is especially needed during presentation. Therefore, in this paper, we try to fill the gap by proposing a laser pointer interaction system to allow user to give pointing input command to the computer from some distance away using only laser pointer, which is cheap and readily available. With the combination of image processing based software, we could provide mouse-like pointing interaction with computer. The proposed system works well not only in currently plane screen, but also in flexible screen by incorporating the feature of non-linear coordinate mapping algorithm in our system so that our system can support non-linear environment, such as curved and flexible wall.

  • PDF

Design and Implementation of a Stereoscopic Image Control System based on User Hand Gesture Recognition (사용자 손 제스처 인식 기반 입체 영상 제어 시스템 설계 및 구현)

  • Song, Bok Deuk;Lee, Seung-Hwan;Choi, HongKyw;Kim, Sung-Hoon
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • 제26권3호
    • /
    • pp.396-402
    • /
    • 2022
  • User interactions are being developed in various forms, and in particular, interactions using human gestures are being actively studied. Among them, hand gesture recognition is used as a human interface in the field of realistic media based on the 3D Hand Model. The use of interfaces based on hand gesture recognition helps users access media media more easily and conveniently. User interaction using hand gesture recognition should be able to view images by applying fast and accurate hand gesture recognition technology without restrictions on the computer environment. This paper developed a fast and accurate user hand gesture recognition algorithm using the open source media pipe framework and machine learning's k-NN (K-Nearest Neighbor). In addition, in order to minimize the restriction of the computer environment, a stereoscopic image control system based on user hand gesture recognition was designed and implemented using a web service environment capable of Internet service and a docker container, a virtual environment.

Effect of Simulator Sickness Caused by Head-mounted Display on the Stability of the Pupillary Rhythm (머리착용 디스플레이에 의해 유발된 멀미 증상이 동공 리듬의 안정성에 미치는 영향)

  • Park, Sangin;Lee, Don Won;Mun, Sungchul;Kim, Hong-Ik;Whang, Mincheol
    • Science of Emotion and Sensibility
    • /
    • 제21권4호
    • /
    • pp.43-54
    • /
    • 2018
  • The aim of this study is to determine the effect of motion sickness on pupil rhythm. Sixteen volunteers of both genders (8 male, 8 female, mean age $25.67{\pm}2.43$ years) experienced VR contents in both 2D and HMD versions for 15 minutes, and their pupillary rhythms were compared. The irregular pattern of the pupillary rhythms, as demonstrated by increasing mean pupil diameter (mPD) and standard deviation of the pupil diameter (sPD), revealed motion sickness after experiencing HMD condition. The pupillary response is strongly related to the cognitive load, and the motion sickness can be interpreted as a change in the cognitive load caused by the increasing volume of visual information that must be processed and the conflict or inconsistency between different sensory modalities. The method proposed in this study could be a non-contact measurement method for the monitoring of motion sickness using a web-camera rather than previous sensor-based methods.

Pupil Data Measurement and Social Emotion Inference Technology by using Smart Glasses (스마트 글래스를 활용한 동공 데이터 수집과 사회 감성 추정 기술)

  • Lee, Dong Won;Mun, Sungchul;Park, Sangin;Kim, Hwan-jin;Whang, Mincheol
    • Journal of Broadcast Engineering
    • /
    • 제25권6호
    • /
    • pp.973-979
    • /
    • 2020
  • This study aims to objectively and quantitatively determine the social emotion of empathy by collecting pupillary response. 52 subjects (26 men and 26 women) voluntarily participated in the experiment. After the measurement of the reference of 30 seconds, the experiment was divided into the task of imitation and spontaneously self-expression. The two subjects were interacted through facial expressions, and the pupil images were recorded. The pupil data was processed through binarization and circular edge detection algorithm, and outlier detection and removal technique was used to reject eye-blinking. The pupil size according to the empathy was confirmed for statistical significance with test of normality and independent sample t-test. Statistical analysis results, the pupil size was significantly different between empathy (M ± SD = 0.050 ± 1.817)) and non-empathy (M ± SD = 1.659 ± 1.514) condition (t(92) = -4.629, p = 0.000). The rule of empathy according to the pupil size was defined through discriminant analysis, and the rule was verified (Estimation accuracy: 75%) new 12 subjects (6 men and 6 women, mean age ± SD = 22.84 ± 1.57 years). The method proposed in this study is non-contact camera technology and is expected to be utilized in various virtual reality with smart glasses.