• Title/Summary/Keyword: Head-tracking

Search Result 245, Processing Time 0.027 seconds

A Space Skew and Crosstalk Cancellation Scheme Based on Indoor Spacial Information Using Self-Generating Sounds (자체발성음을 이용한 실내공간정보 획득 및 공간뒤틀림/상호간섭 제거기법)

  • Kim, Yeong-Moon;Yoo, Seung-Soo;Lee, Ki-Seung;Kim, Sun-Yong
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.2C
    • /
    • pp.246-253
    • /
    • 2010
  • In this paper, a method of removing the space skew and cross-talk cancellation is proposed where the self-generated signals from the subject are used to obtain the subject's location. In the proposed method, the good spatial sound image is maintained even when the listener moves from the sweet spot. Two major parts of the proposed method are as follows: listener position tracking using the stimuli from the subject and removal of the space skew and cross-talk signals. Listener position tracking is achieved by estimation of the time difference of arrival (TDoA). The position of the listener is then computed using the Talyer-series estimation method. The head-related transfer functions (HRTF) are used to remove the space skew and cross-talk signals, where the direction of the HRTF is given by the one estimated from the listener position tracking. The performance evaluation is carried out on the signals from the 100 subjects that are composed of the 50 female and 50 male subjects. The positioning accuracy is achieved by 70%~90%, under the condition that the mean squared positioning error is less than $0.07m^2$. The subjective listening test is also conducted where the 27 out of the 30 subjects are participated. According to the results, 70% of the subjects indicates that the overall quality of the reproduced sound from the proposed method are improved, regardless of the subject's position.

Processing of syntactic dependency in Korean relative clauses: Evidence from an eye-tracking study (안구이동추적을 통해 살펴본 관계절의 통사처리 과정)

  • Lee, Mi-Seon;Yong, Nam-Seok
    • Korean Journal of Cognitive Science
    • /
    • v.20 no.4
    • /
    • pp.507-533
    • /
    • 2009
  • This paper examines the time course and processing patterns of filler-gap dependencies in Korean relative clauses, using an eyetracking method. Participants listened to a short story while viewing four pictures of entities mentioned in the story. Each story is followed by an auditorily presented question involving a relative clause (subject relative or dative relative). Participants' eye movements in response to the question were recorded. Results showed that the proportion of looks to the picture corresponding to a filler noun significantly increased at the relative verb affixed with a relativizer, and was largest at the filler where the fixation duration on the filler picture significantly increased. These results suggest that online resolution of the filler-gap dependency only starts at the relative verb marked with a relativiser and is finally completed at the filler position. Accordingly, they partly support the filler-driven parsing strategy for Korean, as for head-initial languages. In addition, the different patterns of eye movements between subject relatives and dative relatives indicate the role of case markers in parsing Korean sentences.

  • PDF

Development of a Listener Position Adaptive Real-Time Sound Reproduction System (청취자 위치 적응 실시간 사운드 재생 시스템의 개발)

  • Lee, Ki-Seung;Lee, Seok-Pil
    • The Journal of the Acoustical Society of Korea
    • /
    • v.29 no.7
    • /
    • pp.458-467
    • /
    • 2010
  • In this paper, a new audio reproduction system was developed in which the cross-talk signals would be reasonably cancelled at an arbitrary listener position. To adaptively remove the cross-talk signals according to the listener's position, a method of tracking the listener position was employed. This was achieved using the two microphones, where the listener direction was estimated using the time-delay between the two signals from the two microphones, respectively. Moreover, room reverberation effects were taken into consideration where linear prediction analysis was involved. To remove the cross-talk signals at the left-and right-ears, the paths between the sources and the ears were represented using the KEMAR head-related transfer functions (HRTFs) which were measured from the artificial dummy head. To evaluate the usefulness of the proposed listener tracking system, the performance of cross-talk cancellation was evaluated at the estimated listener positions. The performance was evaluated in terms of the channel separation ration (CSR), a -10 dB of CSR was experimentally achieved although the listener positions were more or less deviated. A real-time system was implemented using a floating-point digital signal processor (DSP). It was confirmed that the average errors of the listener direction was 5 degree and the subjects indicated that 80 % of the stimuli was perceived as the correct directions.

Real-time Human Pose Estimation using RGB-D images and Deep Learning

  • Rim, Beanbonyka;Sung, Nak-Jun;Ma, Jun;Choi, Yoo-Joo;Hong, Min
    • Journal of Internet Computing and Services
    • /
    • v.21 no.3
    • /
    • pp.113-121
    • /
    • 2020
  • Human Pose Estimation (HPE) which localizes the human body joints becomes a high potential for high-level applications in the field of computer vision. The main challenges of HPE in real-time are occlusion, illumination change and diversity of pose appearance. The single RGB image is fed into HPE framework in order to reduce the computation cost by using depth-independent device such as a common camera, webcam, or phone cam. However, HPE based on the single RGB is not able to solve the above challenges due to inherent characteristics of color or texture. On the other hand, depth information which is fed into HPE framework and detects the human body parts in 3D coordinates can be usefully used to solve the above challenges. However, the depth information-based HPE requires the depth-dependent device which has space constraint and is cost consuming. Especially, the result of depth information-based HPE is less reliable due to the requirement of pose initialization and less stabilization of frame tracking. Therefore, this paper proposes a new method of HPE which is robust in estimating self-occlusion. There are many human parts which can be occluded by other body parts. However, this paper focuses only on head self-occlusion. The new method is a combination of the RGB image-based HPE framework and the depth information-based HPE framework. We evaluated the performance of the proposed method by COCO Object Keypoint Similarity library. By taking an advantage of RGB image-based HPE method and depth information-based HPE method, our HPE method based on RGB-D achieved the mAP of 0.903 and mAR of 0.938. It proved that our method outperforms the RGB-based HPE and the depth-based HPE.

Development of Real-Time Vision-based Eye-tracker System for Head Mounted Display (영상정보를 이용한 HMD용 실시간 아이트랙커 시스템)

  • Roh, Eun-Jung;Hong, Jin-Sung;Bang, Hyo-Choong
    • Journal of the Korean Society for Aeronautical & Space Sciences
    • /
    • v.35 no.6
    • /
    • pp.539-547
    • /
    • 2007
  • In this paper, development and tests of a real-time eye-tracker system are discussed. The tracker system tracks a user's gaze point through movement of eyes by means of vision-based pupil detection. The vision-based method has an advantage of detecting the exact positions of user's eyes. An infrared camera and a LED are used to acquire a user's pupil image and to extract pupil region, which was hard to extract with software only, from the obtained image, respectively. We develop a pupil-tracking algorithm with Kalman filter and grab the pupil images by using DSP(Digital Signal Processing) system for real-time image processing technique. The real-time eye-tracker system tracks the movements of user's pupils to project their gaze point onto a background image.

3D View Controlling by Using Eye Gaze Tracking in First Person Shooting Game (1 인칭 슈팅 게임에서 눈동자 시선 추적에 의한 3차원 화면 조정)

  • Lee, Eui-Chul;Cho, Yong-Joo;Park, Kang-Ryoung
    • Journal of Korea Multimedia Society
    • /
    • v.8 no.10
    • /
    • pp.1293-1305
    • /
    • 2005
  • In this paper, we propose the method of manipulating the gaze direction of 3D FPS game's character by using eye gaze detection from the successive images captured by USB camera, which is attached beneath HMD. The proposed method is composed of 3 parts. In the first fart, we detect user's pupil center by real-time image processing algorithm from the successive input images. In the second part of calibration, the geometric relationship is determined between the monitor gazing position and the detected eye position gazing at the monitor position. In the last fart, the final gaze position on the HMB monitor is tracked and the 3D view in game is control]ed by the gaze position based on the calibration information. Experimental results show that our method can be used for the handicapped game player who cannot use his (or her) hand. Also, it can increase the interest and immersion by synchronizing the gaze direction of game player and that of game character.

  • PDF

Arrangement of Disposal Holes According to the Features of Groundwater Flow (지하수 유동 특성을 이용한 심층처분의 처분공 배치 방안)

  • Ko, Nak-Youl;Baik, Min-Hoon
    • Journal of Nuclear Fuel Cycle and Waste Technology(JNFCWT)
    • /
    • v.14 no.4
    • /
    • pp.321-329
    • /
    • 2016
  • Based on the results of groundwater flow system modeling for a hypothetical deep geological repository site, quantitative and spatial distributions of groundwater flow rates at the positions of deposition holes, groundwater travel length and time from the positions to the surface environment were analyzed and used to suggest a method for determining locations of deposition holes. The hydraulic head values at the depth of the deposition holes and a particle tracking method were used to calculate the ground-water flow rates and groundwater travel length and time, respectively. From the results, an approach to designing a layout of deposition holes was suggested by selecting relatively favorable positions for maintaining performance of the disposal facility and screening some positions of deposition holes that did not comply with specific constraints for the groundwater flow rates, travel length and time. In addition, a method for determining a geometrical direction for extension of the disposal facility was discussed. Designing the layout of deposition holes with the information of groundwater flow at the disposal depth can contribute to secure performance and safety of the disposal facility.

Dual Stage Actuator System for High Density Magnetic Disk Drives Using a Rotary-type Electrostatic Microatuator (회전구동 정전형 마이크로 액추에이터를 이용한 고트랙밀도 HDD용 이단 구동 시스템)

  • Jung Sunghwan;Choi Jae-Joon;Park Jihwang;Lee Chang-Ho;Kim Cheol-Soon;Min Dong-Ki;Kim Young-Hoon;Lee Seung-Hi;Jeon Jong Up
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.22 no.10 s.175
    • /
    • pp.174-185
    • /
    • 2005
  • This paper presents the design, fabrication, and testing results of a dual stage actuator system for a fine positioning of magnetic heads in magnetic disk drives. A novel rotary microactuator which is electrostatically driven and utilized as a secondary actuator was designed. The stator and rotor electrodes in the microactuator was revised to have the optimal shapes and hence produces much higher rotational torque compared with the conventional comb-shape electrodes. The microactuators were successfully fabricated using SoG(silicon on glass) processing technology, which is known as being cost-effective. The fabricated microactuator has the structural thickness of $45{\mu}m$ with the gap width of approximately $3{\mu}m$. The dynamic characteristic of microactuator/slider assembly was investigated, and its natural frequency and DC gain were measured to be 3.4kHz and 32nm/V, respectively. The microactuator/slider assembly was integrated into a HDD model V10 of Samsung Electronics Co. and a dual servo algorithm was tested to explore the tracking performance of dual stage actuator system where the LDV signals instead of magnetic head signals were used. Experimental results indicate that this system achieves the tracking accuracy of 30nm. This value corresponds to a track density of 85,000 track per inch(TPI), which is about 3 times greater than that of current hard disk drives.

Robot Navigation Control using Laserscanner to Restrict Human Movement (인간행동제약을 위한 레이저파인더 기반의 로봇주행제어)

  • Jin, Tae-Seok
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.17 no.5
    • /
    • pp.1070-1075
    • /
    • 2013
  • In this research, we describe a security robot system and ongoing research results to control human's wrong direction in order to forbid human to enter security zone. Proposed robot system surveils a security area with equipped laserscanner sensor usually. When it detect walking human who is for the area, robot calculates his velocity vector, plans own path to forestall and interrupts him who want to head restricted area and starts to move along the estimated trajectory. The walking human is assumed to be a point-object and projected onto an scanning plane to form a geometrical constraint equation that provides position data of the human based on the kinematics of the mobile robot. While moving the robot continues these processes for adapting change of situation. After arriving at an opposite position human's walking direction, the robot advises him not to be headed more and change his course. The experimental results of estimating and tracking of the human in the wrong direction with the mobile robot are presented.

Desing of VR Contents for Visual Function Enhancement (VR 기반 시기능 강화 콘텐츠 설계 및 제작)

  • Yong-Ju Kim;Sang-Joong Jung
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.23 no.2
    • /
    • pp.70-75
    • /
    • 2022
  • With the spread of various digital devices, devices have become commonplace in modern society. Moreover, due to the increase in device usage and online learning while staying indoors during the COVID-19 pandemic, symptoms such as an increase in myopia in children due to eye fatigue, an increase in young presbyopia, and dry eye syndrome are increasing, and now people are paying attention to eye health. This is different from before. There are various prescriptions for eye health, but in this paper, we would like to propose a training method for enhancing visual function using VR contents. The analog methods of the existing teaching aids for visual function reinforcement training were planned and produced as digital contents, and VR-based training contents were selected from among the various methods carried out with teaching aids at the visual function training center, which can be made into contents. was developed with In the training process for each content, it was proposed to apply eye tracking to the VR device in order to give the user feedback on their participation in the training so that the management and concentration of the training process could be analyzed.