• Journal of Broadcast Engineering
• /
• v.22 no.4
• /
• pp.484-495
• /
• 2017

The development of display devices and the increase of network transmission bandwidth bring demands for over 2K high resolution video such as panorama video, 4K ultra-high definition commercial broadcasting, and ultra-wide viewing video. To compress these image sequences with significant amount of data, High Efficiency Video Coding (HEVC) standard with the highest coding efficiency is a promising solution. HEVC, the latest video coding standard, provides high encoding efficiency using various advanced encoding tools, but it also requires significant amounts of computation complexity compared to previous coding standards. In particular, the complexity of HEVC decoding process is a imposing challenges on real-time playback of ultra-high resolution video. To accelerate the HEVC decoding process for ultra high resolution video, this paper introduces a data-level parallel video decoding method using slice and/or tile supported by HEVC. Moreover, deblocking filter process is further parallelized. The proposed method distributes independent decoding operations of each tile and/or each slice to multiple threads as well as deblocking filter operations. The experimental results show that the proposed method facilitates executions up to 2.0 times faster than the HEVC reference software for 4K videos.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.11 no.8
• /
• pp.767-772
• /
• 2016

The purpose of this paper is to develop a gimbal system installed in the UFV(unmanned flight vehicles) for 360 degree VR video. In particular, even if the UFV rotated any direction the camera position is fiexd to minimize the shaking using the gyro sensor and the camera system is stable for taking $360^{\circ}$ panorama VR images.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2011.07a
• /
• pp.406-409
• /
• 2011

최근 방송과 통신의 융합으로 방송 통신 융합형 서비스가 활발해지고 있고, 사용자의 요구사항이 높아지고 있는 가운데 무선 채널을 이용한 인터랙티브 비디오 스트리밍 서비스는 가장 큰 서비스로 자리 잡고 있다. 인터랙티브 비디오 서비스중 하나인 파노라마 비디오는 기존의 고정적인 시청환경을 사용자가 능동적으로 선택할 수 있다는 측면에서 발전의 가능성이 큰 분야 중 하나이다. 하지만 넓은 시점을 가진 파노라마 비디오는 높은 대역폭이 요구된다는 단점이 있다. 이에 본 논문은 사용자가 파노라마 비디오 서비스를 받을 때 시청 시점을 변경시키면서 사용되는 비트율을 시공간적 필터를 사용하여 줄일 수 있는 방법을 제안한다. 이를 이용하여 고 대역폭 사용이 불가피한 파노라마 비디오 스트리밍 서비스의 요구 대역폭을 줄임으로서 인터렉티브 비디오의 스트리밍 서비스분야에서 효율적인 대역폭 사용을 위한 기술로 사용될 수 있음을 확인 할 수 있다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2017.11a
• /
• pp.218-220
• /
• 2017

Recently, stitching techniques are used for obtaining wide FOV, e.g., panorama contents, from normal cameras. Despite many proposed algorithms, the no objective quality evaluation method is developed, so the comparison of algorithms are performed only in subjective way. The paper proposes a 'Delaunay-triangulation based objective assessment method' for evaluating the geometric and photometric distortions of stitched or warped images. The reference and target images are segmented by Delaunay-triangulation based on matched points between two images, the average Euclidian distance is used for geometric distortion measure, and the average or histogram of PSNR for photometric measure. We shows preliminary results with several test images and stitching methods for demonstrate the benefits and application.

• Journal of information and communication convergence engineering
• /
• v.11 no.4
• /
• pp.298-306
• /
• 2013

The scale invariant feature transform (SIFT) is an effective algorithm used in object recognition, panorama stitching, and image matching. However, due to its complexity, real-time processing is difficult to achieve with current software approaches. The increasing availability of parallel computers makes parallelizing these tasks an attractive approach. This paper proposes a novel parallel approach for SIFT algorithm implementation using a block filtering technique in a Gaussian convolution process on the SIMD Pixel Processor. This implementation fully exposes the available parallelism of the SIFT algorithm process and exploits the processing and input/output capabilities of the processor, which results in a system that can perform real-time image and video compression. We apply this implementation to images and measure the effectiveness of such an approach. Experimental simulation results indicate that the proposed method is capable of real-time applications, and the result of our parallel approach is outstanding in terms of the processing performance.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.2 no.3
• /
• pp.39-52
• /
• 2009

Scale Invariant Feature Transform (SIFT) is an effective algorithm in object recognition, panorama stitching, and image matching, however, due to its complexity, real time processing is difficult to achieve with software approaches. This paper proposes using a reconfigurable hardware processor with integer half kernel. The integer half kernel Gaussian reduces the Gaussian pyramid complexity in about half [] and the reconfigurable processor carries out a parallel implementation of a full search Fast SIFT algorithm. We use a low memory, fine grain single instruction stream multiple data stream (SIMD) pixel processor that is currently being developed. This implementation fully exposes the available parallelism of the SIFT algorithm process and exploits the processing and I/O capabilities of the processor which results in a system that can perform real time image and video compression. We apply this novel implementation to images and measure the effectiveness. Experimental simulation results indicate that the proposed implementation is capable of real time applications.

• Journal of information and communication convergence engineering
• /
• v.2 no.1
• /
• pp.52-57
• /
• 2004

In this paper, we propose a panorama-based object tracking scheme for wide-view surveillance systems that can detect and track moving objects with a pan-tilt camera. A dynamic mosaic of the background is progressively integrated in a single image using the camera motion information. For the camera motion estimation, we calculate affine motion parameters for each frame sequentially with respect to its previous frame. The camera motion is robustly estimated on the background by discriminating between background and foreground regions. The modified block-based motion estimation is used to separate the background region. Each moving object is segmented by image subtraction from the mosaic background. The proposed tracking system has demonstrated good performance for several test video sequences.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2014.04a
• /
• pp.921-924
• /
• 2014

본 논문에서는 다시점 파노라마 동영상의 효율적인 재생을 위해서 분할 및 선택적 재생 기법을 통해 데이터의 전송 및 재생을 제한하는 방법을 제안한다. 큐브 파노라마로 제작된 다시점 파노라마 동영상을 분할전송을 통해 사용자가 필요로 하는 부분만 전송하는 방법으로 콘텐츠 전송의 효율을 높일 수 있도록 하며, 데이터를 해상도 및 화질에 따라 다른 레이어로 구성하여 디바이스 및 전송속도에 따라 차등적으로 서비스 될 수 있도록 한다. 콘텐츠의 분할 재생 시 발생하는 동기화 문제를 해결하고 이러한 과정을 안드로이드 디바이스를 통해 직접 테스트를 진행해서, 원할한 서비스가 제공 될 수 있도록 하였다.

• Journal of Broadcast Engineering
• /
• v.20 no.5
• /
• pp.728-737
• /
• 2015

Stitching algorithm obtain a descriptor of the feature points extracted from multiple images, and create a single image through the matching process between the each of the feature points. In this paper, a feature extraction and matching techniques for the creation of a high-speed panorama using video input is proposed. Features from Accelerated Segment Test(FAST) is used for the feature extraction at high speed. A new feature point matching process, different from the conventional method is proposed. In the matching process, by tracking region containing the feature point through the Mean shift vector required for matching is obtained. Obtained vector is used to match the extracted feature points. In order to remove the outlier, the RANdom Sample Consensus(RANSAC) method is used. By obtaining a homography transformation matrix of the two input images, a single panoramic image is generated. Through experimental results, we show that the proposed algorithm improve of speed panoramic image generation compared to than the existing method.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.18 no.6
• /
• pp.63-68
• /
• 2018

Offloading is a method of communicating, processing, and receiving results from some of the applications performed on local computers to overcome the limitations of computing resources and computational speed.Recently, it has been applied in mobile games, multimedia data, 360-degree video processing, and image processing for Internet broadcasting to speed up processing and reduce battery consumption in the mobile computing sector. This paper implements a viewer that enables users to convert various flat-panel images and view contents in a wireless Internet environment and presents actual results of an experiment so that users can easily understand the images. The 360 degree spherical image is successfully converted to a plane image with Double Panorama, Quad, Single Rectangle, 360 Overview + 3 Rectangle depending on the image acquisition position of the 360 degree camera through the interface. During the experiment, more than 100 360 degree spherical images were successfully converted into plane images through the interface below.