• Journal of Broadcast Engineering
• /
• v.24 no.6
• /
• pp.1002-1012
• /
• 2019

360VR content requires short latency, such as immediate response to viewers' viewport changes and high quality video delivery. It is necessary to consider efficient transmission that guarantees the QoE(Quality of Experience) of the 360VR contents with limited bandwidth. Several research has been introduced to reduce overall bandwidth consumption by predicting a user's viewport and allocating different bit rates to the area corresponding to the viewport. In this paper, we propose novel viewport prediction scheme that uses sound source location information of 360VR contents as auditory recognition information along with visual recognition information. Also, we propose efficient transmission algorithm by allocating a bit rate properly based on improved viewport prediction. The proposed scheme improves the accuracy of the viewport prediction and provides high quality videos to tiles corresponding to the user's viewpoint within the limited bandwidth.

• International Journal of Advanced Culture Technology
• /
• v.9 no.4
• /
• pp.194-203
• /
• 2021

Virtual reality is being increasingly used for healing and therapy for mental health. In this study, we developed VR-based immersive content that enables virtual travel without the limitations of time and physical conditions. We aim to develop and produce VR content for relaxation and meditation using the beautiful natural scenery. To make realistic and immersive content, we took a video of natural sceneries with a small UAV connected to a VR camera. The content was developed through stitching, video editing and post-processing of the initially captured video data, and then the created VR video was inserted into the VR device. The produced content will be helpful for stress and used to heal the mind and body of exhausted modern people by providing the place with great scenery and sound in an immersive way at any time.

• The Journal of the Acoustical Society of Korea
• /
• v.38 no.6
• /
• pp.637-650
• /
• 2019

This paper analyzes the limitations of binaural sound that is reproduced with headphones based on Ambisonics for Virtual Reality (VR) audio. VR audio can be provided with binaural sound that compensates head rotation of a listener. Ambisonics is widely used for recording and reproducing ambient sound fields around a listener in VR audio, and the First order Ambisonics (FOA) is still being used for VR audio because of its simplicity. However, the maximum frequencies with this order is too low to perfectly reproduce ear signals, and thus the binaural reproduction has inherent limitations in terms of spectrum and sound localization. This paper investigates these limitations by comparing the signals arrived at ear positions in the reference field and the reproduced field. An incidence wave is defined as a reference field, and reproduced over virtual loudspeakers. Frequency responses, inter-aural level differences, and inter-aural phase differences are compared. The results show, above the maximum cut off frequency in general, that the reproduced levels decrease, and the horizontal localization can be provided only around the forward direction.

• Journal of Korea Game Society
• /
• v.20 no.3
• /
• pp.25-34
• /
• 2020

This study is a VR system design designed to evaluate the impact of interaction on user experience analyzed by developer's perspective for the interactive VR fashion show. In the VR fashion show design, we produced an interactive system through the four interactive elements of camera viewpoint, cloth, effects, and sound. The interactive design system is proposed based on three application facto rs in VR space design: speed, range, and mapping. The study focused on the user experience based on format conversion to apply the Unity3D engine using 3D model, animation, 2D UI design, and simulation.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2022.01a
• /
• pp.369-372
• /
• 2022

본 논문에서는 장애물 객체의 회전 벡터를 이용하여 VR 환경에서의 효율적으로 음향 처리 및 합성하는 방법을 제안한다. 현실에서 소리와 장애물이 있을 때, 소리는 장애물의 형태에 따라 퍼지면서 전파되는 형태를 보여준다. 이 같은 특징을 가상현실 환경에 유사하게 음향 처리하고자 하며 이를 위해 장애물 객체의 위치와 소리의 근원지 위치를 입력으로 소리의 전파 형태를 근사한다. 이때 모서리 부근에서 표현되는 소리의 회전을 계산하기 위해 장애물의 회전벡터(Curl vector)를 기반으로 소리의 회전을 추출하였으며, 장애물 형태를 컨볼루션(Convolution)하여 소리가 바깥 방향으로 전파되는 형태를 모델링한다. 또한, 장애물과 소리 벡터 사이의 거리, 소리 근원지와 소리 벡터 사이의 거리를 계산하여 소리의 크기를 감쇠 시켜 주며, 최종적으로 장애물 주변으로 퍼지는 벡터 모양인 외부벡터를 합성하여 장애물로부터 외부로 퍼지는 벡터의 방향을 설정한다. 본 논문에서 제안하는 방법을 이용한 소리는 장애물과의 거리와 형태를 고려하여 퍼지는 사운드 벡터 형태를 보여주며, 소리 위치에 따라 소리 감소 패턴이 변경되고, 장애물 모양에 따라 흐름이 조절되는 결과를 보여준다. 이 같은 실험은 실제 현실에서 소리가 장애물의 모양에 따라 나타나는 소리의 변화 및 패턴을 거의 유사하게 표현할 수 있다.

• Proceedings of KOSOMES biannual meeting
• /
• 2003.11a
• /
• pp.45-51
• /
• 2003

The ship's signal sound dispersed by air, obstacles, and noises due to absorption, reflection, and disturbances, respectively. It is one of the factors of marine casualties by misjudgment if receiving direction The last target of this study is to prevent inherent marine casualty using the analysis-evaluation techniques if the interferences of ship's signal sound. In this work, three-dimensional sound field control model is proposed to simulate various sound transmitting characteristics according to sea environments at sea The efficiency test of the model was carried out using VR-based ship simulator.

• The Journal of the Korea Contents Association
• /
• v.20 no.9
• /
• pp.271-284
• /
• 2020

Good reviews that Half-Life: Alyx received created a turning point for the vitalization of the VR market with an uncertain future due to the absence of a revenue model together with the increased sales of VR equipment. Based on previous studies, this study categorized the characteristics of VR games according to graphs, first-person system, interface, controller, interaction technology, sound and stories. The analysis results show that the seven elements corresponded with "interactions" and "virtual images," which represent the completion level of games as part of VR components, and were connected to one another, which led to the proposal of an upper-rank concept "presence" to put them together. "Immersiveness," which represents users' emotions as part of VR components, was analyzed with the immersion theory to assign tasks of proper difficulty level for users' abilities. In the research process, the Delphi technique and FGI were administered to a panel of 15 experts to ensure objectivity. Finally, "presence" and "immersiveness" are characteristics in proportion to each other and can be valid concepts in future analysis of VR games as well as Half-Life: Alyx, which led to the proposal a new concept framework called 'presence effects' by combining the two words.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.12 no.4
• /
• pp.163-172
• /
• 2004

Nowadays, to analyze the dynamic characteristics of the automotive driving system, the computer simulation linked up with VR(Virtual Reality) technology is treated as the useful method with the improvement of computing ability. In this paper, the VR simulation system has been developed to investigate the driving characteristics of the ASV(Advanced Safety Vehicle) equipped with an ACC(Adaptive Cruise Control) system. For the purpose, VR environment which generates 3D graphic and sound information of the vehicle, the road, the facilities, and the terrain has been organized for the driving reality. Mathematical models of vehicle dynamic analysis including the ACC model have been constructed for computer simulation. The ACC modulates the throttle and brake functions to regulate the vehicle speed so that vehicles could keep proper spacing. Also, the real-time simulation algorithm synchronizes vehicle dynamic simulation with the graphic rendering. With the developed VR simulation system, simple scenarios are applied to analyze the dynamic characteristics. It is shown that the VR simulation system could be useful to evaluate the adaptive cruise controlled vehicle on various driving conditions.

• Journal of Mechanical Science and Technology
• /
• v.20 no.1
• /
• pp.29-41
• /
• 2006

Nowadays, with the advancement of computers, computer simulation linked with VR (Virtual Reality) technology has become a useful method for designing the automotive driving system. In this paper, the VR simulation system was developed to investigate the driving performances of the ASV (Advanced Safety Vehicle) equipped with an ACC (Adaptive Cruise Control) system. For this purpose, VR environment which generates visual and sound information of the vehicle, road, facilities, and terrain was organized for the realistic driving situation. Mathematical models of vehicle dynamic analysis, which includes the ACC algorithm, have been constructed for computer simulation. The ACC algorithm modulates the throttle and the brake functions of vehicles to regulate their speeds so that the vehicles can keep proper spacing. Also, the real-time simulation algorithm synchronizes vehicle dynamics simulation with VR rendering. With the developed VR simulation system, several scenarios are applied to evaluate the adaptive cruise controlled vehicle for various driving situations.

• Journal of Broadcast Engineering
• /
• v.24 no.2
• /
• pp.227-233
• /
• 2019

In this paper, we propose a deep neural network-based sound interpolation method for realizing virtual reality sound. Through this method, sound between two points is generated by using acoustic signals obtained from two points. Sound interpolation can be performed by statistical methods such as arithmetic mean or geometric mean, but this is insufficient to reflect actual nonlinear acoustic characteristics. In order to solve this problem, in this study, the sound interpolation is performed by training the deep neural network based on the acoustic signals of the two points and the target point, and the experimental results show that the deep neural network-based sound interpolation method is superior to the statistical methods.