• Journal of the Korea Society of Computer and Information
• /
• v.19 no.2
• /
• pp.57-65
• /
• 2014

The role of sound in producing 3D animation clip is one of the important factor to maximize the immersive effects of the scene. Especially interaction between video and sound makes the scene expressions more apparent, which is diversely applied in video production. One of these interaction techniques, the out-focussing technique is frequently used in both real video and 3D animation field. But in 3D animation, out-focussing is not easily implemented as in music videos or explosion scenes in real video shots. This paper analyzes the sound data to synchronize the depth of field with it. The novel out-focussing technique is proposed, where the object's field of depth is controlled by beat rhythm in the sound data.

• Journal of Broadcast Engineering
• /
• v.27 no.5
• /
• pp.738-750
• /
• 2022

In this study, we reviewed and discussed whether auditory stimuli with short length can evoke emotion-related neurological responses. The findings implicate that if personalized sound tracks are provided to XR users based on machine learning or probability network models, user experiences in XR environment can be enhanced. We also investigated that the arousal-relaxed factor evoked by short auditory sound can make distinct patterns in functional connectivity characterized from background EEG signals. We found that coherence in the right hemisphere increases in sound-evoked arousal state, and vice versa in relaxed state. Our findings can be practically utilized in developing XR sound bio-feedback system which can provide preference sound to users for highly immersive XR experiences.

• The Journal of the Acoustical Society of Korea
• /
• v.30 no.4
• /
• pp.197-206
• /
• 2011

In this paper, we proposes the virtual sound source panning algorithm in the multichannel system. Recently, High-definition (HD) and Ultrahigh-definition (UHD) video formats are accepted for the multimedia applications and they provide the high-quality resolution pixels and the wider view angle. The audio format also needs to generate the wider sound field and more immersive sound effects. However, the conventional stereo system cannot satisfy the desired sound quality in the latest multimedia system. Therefore, the various multichannel systems that can make more improved sound field generation are proposed. In the mutichannel system, the conventional panning algorithms have acoustic problems about directivity and timbre of the virtual sound source. To solve these problems in the arbitrary positioned multichannel loudspeaker system, we proposed the virtual sound source panning algorithm using multiple vectors base nonnegative amplitude panning gains. The proposed algorithm can be easily controlled by the gain control function to generate an accurate localization of the virtual sound source and also it is available for the both symmetric and asymmetric loudspeakers format. Its performance of sound localization is evaluated by subjective tests comparing with conventional amplitude panning algorithms, e.g. VBAP and MDAP, in the symmetric and asymmetric formats.

• Cartoon and Animation Studies
• /
• s.17
• /
• pp.37-51
• /
• 2009

Immersion is the key factor in determining success or failure for fictional narrative animations. It does matter to not only for the socio-economic achievements like box-office success but to the asthetical achievement, immersion is very important prerequisite character that are raised in terms of research needs. Fictional narrative animation shares the audience's immersive method with the narrative content and Virtual Reality, since animation has the character which narrates itself with the visual image format (including sound) and added the fact that 3D format which emphasizes realism compared with the recent 2D animation has been ubiquitous phenomenon. In other words, the artistic for called 'animation' is located between the view point that text has the immersive point intrinsic and oppositely, specific function of the certain media which stays extrinsic of the text enforce the participants into the immersion. In any case, the subject who experience immersion is the audience, so the most useful theory to research the phenomenon 'immersion' is Constructivism cognitive narrotologic approach which lies the peader-spectator as the centric notion and is more useful than text analysis or research on the visual effects. In this study, research and review about the studies on the audience's immersive experience would be preceded particularly aroud the constructivism theories, and examine the uniqueness and naures of the animation which makes the audience immersive.

• Electronics and Telecommunications Trends
• /
• v.31 no.3
• /
• pp.81-90
• /
• 2016

현재, 극장 사운드를 중심으로 객체기반 오디오 기술을 포함하는 하이브리드 포맷의 사운드 서비스가 점차 확산되고 있으며, 미국, 유럽, 한국 등에서는 차세대 방송용 오디오에 객체기반 오디오 기술의 도입을 적극적으로 고려하고 있다. 객체기반 오디오 기술은 콘텐츠의 제작단계에서 재생환경을 고려할 필요가 없고, 현장의 음향을 신호와 3차원 공간정보로 구분하여 음향공간의 정보를 그대로 표현함으로써, 재생단말에서 3차원 공간정보를 활용하여 재생할 수 있게 한다. 이러한 객체기반 실감음향 기술개발을 위해서는 편리한 제작 및 3차원 공간정보 표현 기술이 필요하며, 청취환경에서는 객체기반 실감음향 콘텐츠를 제작자의 의도대로 렌더링할 수 있는 재생 및 제어 기술이 필요하다. 이에 객체기반 실감음향 기술이 포함되는 하이브리드 오디오 기술의 현황에 대하여 살펴보고자 한다.

• ETRI Journal
• /
• v.38 no.5
• /
• pp.829-837
• /
• 2016

In this paper, we introduce extension tools for MPEG Surround, which were recently adopted as MPEG-H 3D Audio tools by the ISO/MPEG standardization group. MPEG-H 3D Audio is a next-generation technology for representing spatial audio in an immersive manner. However, considerably large numbers of input signals can degrade the compression performance during a low bitrate operation. The proposed extension of MPEG Surround was basically designed based on the original MPEG Surround technology, where the limitations of MPEG Surround were revised by adopting a new coding structure. The proposed MPEG-H 3D Audio technologies will play a pivotal role in dramatically improving the sound quality during a lower bitrate operation.

• Journal of The Institute of Information and Telecommunication Facilities Engineering
• /
• v.10 no.4
• /
• pp.143-147
• /
• 2011

The system using augmented reality can save the time and cost. It is verified in various fields under the possibility of a technology by solving unrealistic feeling in the virtual space. Therefore, augmented reality has a variety of the potential to be used. Generally, multimodal senses such as visual/auditory/tactile feed back are well known as a method for enhancing the immersion in case of interaction with virtual object. By adapting tangible object we can provide touch sensation to users. a 3D model of the same scale overlays the whole area of the tangible object; thus, the marker area is invisible. This contributes to enhancing immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In this paper, sound feedback is considered. By further improving immersion learning augmented reality for children with the initial step learning content is presented. Augmented reality is in the intermediate stages between future world and real world as well as its adaptability is estimated more than virtual reality.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.11a
• /
• pp.128-130
• /
• 2018

이 논문은 3D 입체 음향에 대한 좌표 취득 및 표출 방법을 제안한다. 3차원 좌표를 추정하기 위해 다시점 영상의 색상 영상을 통해 중간 시점의 깊이 영상을 생성한다. 깊이 영상 내에서 객체에 대한 이미지 좌표와 깊이 정보를 이용하여 3차원 좌표를 취득한다. 실험 결과를 통해 깊이 영상에서 도출된 객체의 좌표를 음원의 좌표로 설정하여 3D 입체 음향 표출의 효율을 높일 수 있음을 확인한다.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.44 no.2 s.314
• /
• pp.37-46
• /
• 2007

In this paper, we propose technologies for enhancing the immersive realization of virtual objects in AR-based product design. Generally, multimodal senses such as visual/auditory/tactile feedback are well known as a method for enhancing the immersion in case of interaction with virtual objects. By adapting tangible objects we can provide touch sensation to users. A 3D model of the same scale overlays the whole area of the tangible object so the marker area is invisible. This contributes to enhancing immersion. Also, the hand occlusion problem when the virtual objects overlay the user's hands is partially solved, providing more immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In our work, both vibrotactile feedback through page motors, pneumatic tactile feedback, and sound feedback are considered. In our scenario, a game-phone model is selected, by way of proposed augmented vibrotactile feedback, hands occlusion-reduced visual effects and sound feedback are provided to users. These proposed methodologies will contribute to a better immersive realization of the conventional AR system.

• Journal of Korea Multimedia Society
• /
• v.15 no.4
• /
• pp.560-568
• /
• 2012

As for the implementation technology of virtual space, the experience method becomes multifunctional and it recognizes movement, sound, temperature and pressure and is expanding to the studies on the interaction possible intelligent interaction technology field between contents and users. The virtual reality technology is being studied to apply the 3D graphic technology and physical phenomena to virtual space to increase the sense of reality and use hardware devices to the virtual environment to increase immersive experience. The production of interactive contents about the virtual underwater environment needs bidirectional interface technology to connect hardware devices and ocean contents in order to increase the sense of a user to increase the sense of immersion. In this study, it tried to express the virtual underwater environment with the sense of actuality and reality from the analysis of the environmental factors according to changes in depth of water and from the application of the normalized underwater physical laws. Also it was to develop sensory contents having to experience the skin scuba without directly entering the water by connecting a sensory simulator about the skin scuba with the virtual underwater environment.