• ETRI Journal
• /
• v.44 no.1
• /
• pp.73-84
• /
• 2022

The moving picture experts group (MPEG) immersive video (MIV) technology has been actively developed and standardized to efficiently deliver immersive video to viewers in order for them to experience immersion and realism in various realistic and virtual environments. Such services are provided by MIV technology, which uses multiview videos as input. The pruning process, which is an important component of MIV technology, reduces interview redundancy in multiviews videos. The primary aim of the pruning process is to reduce the amount of data that available video codec must handle. In this study, two approaches are presented to improve the existing pruning algorithm. The first method determines the order in which images are pruned. The amount of overlapping region between the source views is then used to determine the pruning order. The second method considers global region-wise color similarity to minimize matching ambiguity when determining the pruning area. The proposed methods are evaluated under common test condition of MIV, and the results show that incorporating the proposed methods can improve both objective and subjective quality.

• Electronics and Telecommunications Trends
• /
• v.37 no.3
• /
• pp.52-63
• /
• 2022

Immersive media, also known as spatial media, has become essential with the decrease in face-to-face activities in the COVID-19 pandemic era. Teleconference, metaverse, and digital twin have been developed with high expectations as immersive media services, and the demand for hyper-realistic media is increasing. Under these circumstances, MPEG-I Immersive Media is being standardized as a technologies of navigable virtual reality, which is expected to be launched in the first half of 2024, and the Audio Group is working to standardize the immersive audio technology. Following this trend, this article introduces the trend in MPEG-I immersive audio standardization. Further, it describes the features of the immersive audio rendering technology, focusing on the structure and function of the RM0 base technology, which was chosen after evaluating all the technologies proposed in the January 2022 "MPEG Audio Meeting."

• Journal of Multimedia Information System
• /
• v.8 no.4
• /
• pp.277-284
• /
• 2021

Despite skepticism about commercial potential, the stereoscopic 3D cinema is still a form that any filmmaker can choose to employ for its aesthetics and its immersive potential. Based on a haptic illusion, the stereoscopic media content requires a new perspective different from the principle of 2D media content in terms of creation and acceptance. This paper examines the technical and aesthetic issues of stereoscopic 3D film production from the perspective of today's emerging realistic and immersive media through a case study. One of the key factors for successful content creation and research and development in stereoscopic 3D cinema is the combination of artistic principles together with technical mastering of the new image technology. The purpose of this paper is to outline the principal challenges and research topics in stereoscopic 3D cinema through a case study of stereoscopic 3D pilot film production for the 'User-Selective UHD Stereoscopic Media Service Platform' of the ETRI (Electronics and Telecommunications Research Institute). This paper intends to examine stereoscopic 3D filmmaking workflow and production methodologies, as well as technical elements and aesthetic issues.

• Journal of the Optical Society of Korea
• /
• v.18 no.1
• /
• pp.32-36
• /
• 2014

A tangible floating display that can provide different perspective views without special glasses being introduced. The proposed system can display perspective floating images in the space in front of the system with the help of concave mirrors. In order to avoid wearing special equipment to interact and deliver the sense of touch, the proposed system adopted an ultrasound focusing technology. For providing an immersive experience to the viewers, the proposed system consists of a tangible floating display system and a multiple-view imaging system for generating three lenticular displays in front of the users.

• Journal of Digital Convergence
• /
• v.19 no.12
• /
• pp.435-441
• /
• 2021

In recent years, with thedevelopment of digital media technology immersive experiential exhibitions that provide realistic and realistic exhibition experiences to the audience are increasing In this study, the representative cases of these immersiveexperiential exhibitions were analyzed with a focus on the elements of the exhibition design. We also introduced the exhibition case of 'A Hero's Adventure' which was held and operated by applying game design elements to thethe directing planning of an immersive experience exhibition. In addition, the effects and utilization methods of the exhibition that applied game planning elements such as challenges goals conflicts rules and wins and losses were considered.

• Journal of Broadcast Engineering
• /
• v.25 no.5
• /
• pp.723-733
• /
• 2020

In this paper, MPEG-I Immersive Audio Standardization and related trends are presented. MPEG-I Immersive Audio, which is under the development of standard documents at the exploration stage, can make a user interact with a virtual scene in 6 DoF manner and perceive sounds realistic and matching the user's spatial audio experience in the real world, in VR/AR environments that are expected as killer applications in hyper-connected environments such as 5G/6G. In order to do this, MPEG Audio Working Group has discussed the system architecture and related requirements for the spatial audio experience in VR/AR, audio evaluation platform (AEP) and encoder input format (EIF) for assessing the performance of submitted proponent technologies, and evaluation procedures.

• ETRI Journal
• /
• v.44 no.1
• /
• pp.24-37
• /
• 2022

Virtual view synthesis, which generates novel views similar to the characteristics of actually acquired images, is an essential technical component for delivering an immersive video with realistic binocular disparity and smooth motion parallax. This is typically achieved in sequence by warping the given images to the designated viewing position, blending warped images, and filling the remaining holes. When considering 6DoF use cases with huge motion, the warping method in patch unit is more preferable than other conventional methods running in pixel unit. Regarding the prior case, the quality of synthesized image is highly relevant to the means of blending. Based on such aspect, we proposed a novel blending architecture that exploits the similarity of the directions of rays and the distribution of depth values. By further employing the proposed method, results showed that more enhanced view was synthesized compared with the well-designed synthesizers used within moving picture expert group (MPEG-I). Moreover, we explained the GPU-based implementation synthesizing and rendering views in the level of real time by considering the applicability for immersive video service.

• Electronics and Telecommunications Trends
• /
• v.32 no.5
• /
• pp.1-9
• /
• 2017

This study focuses on the ongoing immersive Giga Media service platform technology developed by the Electronics and Telecommunications Research Institute(ETRI) for various projects of the Giga KOREA Foundation[1] to achieve a smart ICT environment including wireless-based Giga service by 2020. This technology enables an immersive realistic Tele-Experience service that supports immersive real-world interaction as if sharing one's surroundings in a particular location through a high-speed network among remote users. It is expected to contribute greatly to the activation of smart ICT.

• ETRI Journal
• /
• v.44 no.1
• /
• pp.7-9
• /
• 2022

• KIPS Transactions on Software and Data Engineering
• /
• v.9 no.3
• /
• pp.109-122
• /
• 2020

In recent, projection mapping, which has attracted high attention in the field of realistic media, is regarded as a technology to increase the users' immersion. However, most existing methods perform projection mapping on static objects. In this paper, we developed a technology to track the movements of users and dynamically map the media contents to the users' bodies. The projected media content is built by predefined gestures just using the user's bare hands without the special devices. An interactive immersive media system has been implemented by integrating these dynamic projection mapping technologies and gesture-based drawing technologies. The proposed realistic media system recognizes the movements and open / closed states of the user 's hands, selects the functions necessary to draw a picture. The users can freely draw the picture by changing the color of the brush using the colors of any real objects. In addition, the user's drawing is dynamically projected on the user's body, allowing the user to design and wear his t-shirt in real-time.