• Journal of Broadcast Engineering
• /
• v.25 no.6
• /
• pp.1004-1012
• /
• 2020

We present a novel content-preserving seam estimation algorithm for real-time high-resolution video stitching. Seam estimation is one of the fundamental steps in image/video stitching. It is to minimize visual artifacts in the transition areas between images. Typical seam estimation algorithms are based on optimization methods that demand intensive computations and large memory. The algorithms, however, often fail to avoid objects and results in cropped or duplicated objects. They also lack temporal consistency and induce flickering between frames. Hence, we propose an efficient and temporarily-consistent seam estimation algorithm that utilizes a straight line. The proposed method also uses convolutional neural network-based instance segmentation to locate seam at out-of-objects. Experimental results demonstrate that the proposed method produces visually plausible stitched videos with minimal visual artifacts in real-time.

• Journal of Broadcast Engineering
• /
• v.23 no.1
• /
• pp.63-73
• /
• 2018

These days, VR contents are created in three ways: CG based method, game engine based method, and live action shooting method. The most universal method is live action shooting. So far, most live actions are shot with action cams. Therefore, this method is different from professional image production method for movies and TV dramas. This study tries to point out the difference between professional image production method and action cam based shooting method, and proposes an alternative. The proposed method is log shooting based HDR filming and editing. As the result of test shooting and editing, the proposed method was able to obtain more color information than conventional action cam based shooting method and thereby to implement high-definition images which are hard in an action cam.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2020.07a
• /
• pp.433-435
• /
• 2020

본 논문에서 저작권 보호 기술 적용을 위해 실감형 360도 영상의 강인성 정보를 이용하여 UCI 운영을 위한 응용 메타데이터 요소를 제안한다. 오늘날 멀티미디어 콘텐츠의 산업의 규모가 비약적으로 커지고 있음에 따라 이를 효과적으로 관리 및 유통할 수 있는 콘텐츠 고유의 식별체계가 요구되고 있다. 현재 국내에서 운용 중인 대표 식별자는 정통부가 개발한 UCI가 활용되고 있다. UCI는 다양한 멀티미디어 콘텐츠를 효과적으로 관리 및 유통할 수 있으나 저작권 보호 기술에 직접적으로 연관이 되어 있지 않아 이를 보완할 수 있는 기술이 요구된다. 본 논문에서는 UCI와 직접으로 연동할 수 있는 실감형 360도 동영상 응용 메타데이터 요소 및 운영 방법을 제안하여 저작권 보호 기술을 적용할 수 있도록 한다.

• Journal of the Korean Institute of Telematics and Electronics
• /
• v.27 no.10
• /
• pp.146-153
• /
• 1990

A new 3-D segmentation-based coding technique is proposed for transmitting the motion video with reasonablly acceptable quality even at a very low bit rate. Only meaningful motion areas are extracted by using two change detection masks and a current frame is directly segmented rather than a difference frame itself so that a good quality of image can be obtained at high compression ratios. Through the experiments, the sequence of Miss America is reconstructed with visually acceptable quality at the very high compression ratio of 360:1.

• Journal of Korea Game Society
• /
• v.20 no.6
• /
• pp.43-52
• /
• 2020

This paper presents a fast pattern tracking method using location prediction in cubemap video for 360-degree VR. A spherical cubemap frame has six face textures and searching a pattern is much slower than a flat image. To overcome the limitation, we propose a method of predicting the location of target pattern using Kalman filter and reducing the search area by considering only textures of predicted location. The experimental results showed that the proposed system is much faster than the previous method of searching all six faces and also gives accurate pattern tracking performance.

• Journal of IKEEE
• /
• v.24 no.2
• /
• pp.419-425
• /
• 2020

The market size of immersive 360-degree video contents, which are noted as one of the main technology of the fourth industry, increases every year. However, since most of the images are distributed through illegal distribution networks such as Torrent after the DRM gets lifted, the damage caused by illegal copying is also increasing. Although filtering technology is used as a technology to respond to these issues in 2D videos, most of those filtering technology has issues in that it has to overcome the technical limitation such as huge feature-point data volume and the related processing capacity due to ultra high resolution such as 4K UHD or higher in order to apply the existing technology to immersive 360° videos. To solve these problems, this paper proposes a feature-point recognition ratio improvement method for immersive 360-degree videos using deep learning technology.

• Journal of Broadcast Engineering
• /
• v.21 no.5
• /
• pp.714-725
• /
• 2016

With the recent emergence of VR contents, a lot of attention has been drawn on actual image based VR 360° video production using photography system. It was very complicated and difficult to make conventional VR contents. Therefore, such making was performed only in a research level. These days, as cameras have been made smaller, VR live-action has become more common in contents makers. In the circumstance, this study tries to compare a variety of contents making equipment based on action-cam that is mainly used for producing VR contents, and suggest their problems. To solve the problems, this study uses a cinema grade camera to do VR filming. As a result, it is revealed that, in order to make VR contents with quality, it is necessary to use a cinema grade camera, rather than an action cam, and to conduct technical research for standard lens based contents.

• Electronics and Telecommunications Trends
• /
• v.32 no.5
• /
• pp.39-48
• /
• 2017

Since the world's first 3D commercial film with red-blue glasses was introduced in 1922, remarkable progress has been made in the field of 3D video. 3D video content gained enormous popularity with the movie "Avatar," which greatly increased the sale of 3D TVs. This momentum has weakened owing to lack of 3D content. However, the recent trend of virtual reality (VR) and augmented reality (AR) made 360 VR video and 3D games using a head mounted display wide spread. All these experiences mentioned above require wearing glasses to enjoy 3D content. Super multi-view content technology, on the other hand, enables viewers to enjoy 3D content without glasses on a super multi-view display. In this article, we introduce the technologies used to make super multi-view content, interact with it, and author content, which are developed by ETRI.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2019.11a
• /
• pp.259-260
• /
• 2019

MPEG-I Visual group is actively working on enhancing immersive experiences with up to six degree of freedom (6DoF). In virtual space of 3DoF+, which is defined as an extension of 360 video with limited changes of the view position in a sitting position, looking at the scene from another viewpoint (another position in space) requires rendering additional viewpoints using multiple videos taken at the different locations at the same time. In the MPEG-I Visual workgroup, methods of efficient coding and transmission of 3DoF+ video are being studied, and they released Test Model for Immersive Media (TMIV) recently. This paper presents the enhanced clustering method which can pack the patches into atlas efficiently in TMIV. The experimental results show that the proposed method achieves significant BD-rate reduction in terms of various end-to-end evaluation methods.

• 한국IT서비스학회:학술대회논문집
• /
• 2006.11a
• /
• pp.360-365
• /
• 2006

VoD (Video-on-Demand) 서비스는 가입자가 원하는 컨텐츠를 실시간으로 전송하는 서비스의 형태이다. 오늘날은 방대한 양의 멀티미디어 데이터를 효율적으로 압축하고 보다 빠르게 전송할 수 있는 시스템의 발달이 가속화되고 있고 이는 VoD 서비스의 증가로도 이어지고 있다. 그러므로 가입자가 원하는 컨텐츠를 보다 효과적으로 제공할 수 있는 VoD 서비스의 방법을 찾는 것은 중요한 일이다. 본 논문에서는 기존의 NVoD (Near-VoD) 서비스 또는 TVoD (True-VoD) 서비스 만을 제공함으로서 생길 수 있는 단점을 없애고 장점만 살릴 수 있는 방법을 제안하였다. 이는 기존의 가입자단에 Buffer를 제공하여 NVoD를 TVoD화 함으로서 가능하게 하였다. 또한, 본 논문에서 제안한 방법이 필요한 버퍼의 크기를 제시하고 전체적인 알고리즘을 제시하여 이를 구체화 하였다.