• Journal of Broadcast Engineering
• /
• v.24 no.6
• /
• pp.1035-1052
• /
• 2019

Recently, as the demand for immersive videos increases, efficient video processing techniques for omnidirectional immersive video is actively developed by MPEG-I. While the omnidirectional video provides a larger degree of freedom for a free viewpoint, the size of the video increases significantly. Furthermore, in order to compress 6 degree-of-freedom (6 DoF) videos that support motion parallax, it is required to develop a codec to yield better coding efficiency. In this paper, we develop a 6 DoF codec using Versatile Video Coding (VVC) as the next generation video coding standard. To the authors' best knowledge, this is the first VVC-based 6 DoF video codec toward the future ISO/IEC 23090 Part 7 (Metadata for Immersive Media (Video)) MPEG-I standardization. The experiments were conducted on the seven test video sequences specified in Common Test Condition (CTC) in two operation modes of TMIV (Test Model for Immersive Media) software. It is demonstrated that the proposed codec improves coding performance around 33.8% BD-rate reduction in the MIV (Metadata for Immersive Video) mode and 30.2% BD-rate reduction in the MIV view mode as compared to the state-of-the-art TMIV reference software. We also show the performance comparisons using Immersive Video PSNR (IV-PSNR) and Mean Structural Similarity (MSSIM).

• ETRI Journal
• /
• v.44 no.1
• /
• pp.62-72
• /
• 2022

In this study, we propose a multi-GPU-based 8KVR stitching system that operates in real time on both local and cloud machine environments. The proposed system first obtains multiple 4 K video inputs, decodes them, and generates a stitched 8KVR video stream in real time. The generated 8KVR video stream can be downloaded and rendered omnidirectionally in player apps on smartphones, tablets, and head-mounted displays. To speed up processing, we adopt group-of-pictures-based distributed decoding/encoding and buffering with the NV12 format, along with multi-GPU-based parallel processing. Furthermore, we develop several algorithms such as equirectangular projection-based color correction, real-time CG overlay, and object motion-based seam estimation and correction, to improve the stitching quality. From experiments in both local and cloud machine environments, we confirm the feasibility of the proposed 8KVR stitching system with stitching speed of up to 83.7 fps for six-channel and 62.7 fps for eight-channel inputs. In addition, in an 8KVR live streaming test on the 5G MEC/cloud, the proposed system achieves stable performances with 8 K@30 fps in both indoor and outdoor environments, even during motion.

• Journal of Multimedia Information System
• /
• v.8 no.4
• /
• pp.277-284
• /
• 2021

Despite skepticism about commercial potential, the stereoscopic 3D cinema is still a form that any filmmaker can choose to employ for its aesthetics and its immersive potential. Based on a haptic illusion, the stereoscopic media content requires a new perspective different from the principle of 2D media content in terms of creation and acceptance. This paper examines the technical and aesthetic issues of stereoscopic 3D film production from the perspective of today's emerging realistic and immersive media through a case study. One of the key factors for successful content creation and research and development in stereoscopic 3D cinema is the combination of artistic principles together with technical mastering of the new image technology. The purpose of this paper is to outline the principal challenges and research topics in stereoscopic 3D cinema through a case study of stereoscopic 3D pilot film production for the 'User-Selective UHD Stereoscopic Media Service Platform' of the ETRI (Electronics and Telecommunications Research Institute). This paper intends to examine stereoscopic 3D filmmaking workflow and production methodologies, as well as technical elements and aesthetic issues.

• Electronics and Telecommunications Trends
• /
• v.32 no.5
• /
• pp.1-9
• /
• 2017

This study focuses on the ongoing immersive Giga Media service platform technology developed by the Electronics and Telecommunications Research Institute(ETRI) for various projects of the Giga KOREA Foundation[1] to achieve a smart ICT environment including wireless-based Giga service by 2020. This technology enables an immersive realistic Tele-Experience service that supports immersive real-world interaction as if sharing one's surroundings in a particular location through a high-speed network among remote users. It is expected to contribute greatly to the activation of smart ICT.

• The Journal of the Korea Contents Association
• /
• v.21 no.5
• /
• pp.654-667
• /
• 2021

This study examined the perceived fit between the characteristics of immersive technology and the type of media art affects commitment, satisfaction, and revisit intention. The results showed that the quality of projection mapping and the reputation of original art had a positive effect on the perceived fit whereas the accessibility of original art had a negative effect on the perceived fit. In addition, the reputation of original art and the perception of fit increased the commitment of the media art exhibition, which positively affected the satisfaction and revisit intention. This study provides theoretical and practical implications regarding the effect of immersive technology and media art type of digital media art.

• Journal of Digital Convergence
• /
• v.19 no.12
• /
• pp.435-441
• /
• 2021

In recent years, with thedevelopment of digital media technology immersive experiential exhibitions that provide realistic and realistic exhibition experiences to the audience are increasing In this study, the representative cases of these immersiveexperiential exhibitions were analyzed with a focus on the elements of the exhibition design. We also introduced the exhibition case of 'A Hero's Adventure' which was held and operated by applying game design elements to thethe directing planning of an immersive experience exhibition. In addition, the effects and utilization methods of the exhibition that applied game planning elements such as challenges goals conflicts rules and wins and losses were considered.

• Electronics and Telecommunications Trends
• /
• v.33 no.2
• /
• pp.48-55
• /
• 2018

Immersive media, which maximizes the viewer's sense of presence and immersion, has been developed in the form of 3D stereoscopic media and UHD media. Going one step further, VR media, which can provide immersive experiences within an artificially created environment, have recently been considered a type of next-generation media. Within this trend, numerous IT and broadcasting companies around the world are actively investing their time and resources to boost the emerging VR industry. In this paper, we introduce the representative VR media acquisition and broadcasting service technologies that are leading the current VR industry.

• Informatization Policy
• /
• v.24 no.1
• /
• pp.3-29
• /
• 2017

The purpose of this research is to understand immersive media such as virtual reality, augmented reality, mixed reality, 360-degree videos etc. from the perspective of user-based approach. 3D videos were once expected as the next-generation industry, but soon it further evolved into UHD and are now followed by immersive media represented by virtual reality. As the virtual reality plays an important role, the current research tries to bring up implications that can be applied to the industrial field along with academic understanding through six theoretical approaches related to virtual reality such as media richness, interactivity, presence, body-ownership, user experience, and visual perception. These six theories were used in immersive media studies such as 3D videos. Media richness and interactivity are the main factors forming positive or negative attitude, presence explains why users are immersed, user experience accounts for total psychological reaction, and visual perception explains how complex the experience of seeing is. Especially, although there is less media research applied, the body-ownership is likely to be not only used in virtual reality research, but immersive media research. The user-based theories related to virtual reality will provide various implications for immersive media researchers as well as hardware and content creators of virtual reality.

• International Journal of Internet, Broadcasting and Communication
• /
• v.15 no.2
• /
• pp.196-201
• /
• 2023

In recent years, virtual reality (VR) technology has been widely used in many industrial fields, especially in the fields of medical treatment, games, film and television, to improve the interaction between medical teaching and practical treatment. On the gaming side, the production of virtual reality gaming screens and scenes became increasingly popular, greatly expanding the form of the visual experience. But VR is no longer confined to the health care, education and entertainment industries. During this time, the news media industry has also begun to integrate virtual reality into interviews and user interactions. This study aims to analyze the development of VR technology from the perspectives of immersive VR news experience, real reporting, and prospects, and analyze and think about the interactive participation of media users, the transformation of traditional media, and the upgrading of practitioners' roles.

• Broadcasting and Media Magazine
• /
• v.19 no.1
• /
• pp.22-30
• /
• 2014