• Journal of Broadcast Engineering
• /
• v.20 no.4
• /
• pp.497-508
• /
• 2015

Current communication networks consist of channels with various throughputs, protocols, and packet loss rates. Moreover, there are also diverse user multimedia consumption devices having different capabilities and screen sizes. Thus, a practical necessity of scalability on video coding have been gradually increasing. Recently, The Scalable High Efficiency Video Coding(SHVC) standard is developed by Joint Collaborative Team on Video Coding(JCT-VC) organized in cooperation with MPEG of ISO/IEC and VCEG of ITU-T. This paper introduces coding tools of SHVC including adopted and unadopted tools discussed in the process of the SHVC standardization. Furthermore, the individual tool and combined tool set are evaluated in terms of coding efficiency relative to a single layer coding structure. This analysis would be useful for developing a fast SHVC encoder as well as researching on a new scalable coding tool.

• Journal of Broadcast Engineering
• /
• v.20 no.3
• /
• pp.388-397
• /
• 2015

High Efficiency Video Coding (HEVC)/H.265 is a new video coding standard which is known as high compression ratio compared to the previous standard, Advanced Video Coding (AVC)/H.264. Due to achievement of high efficiency, HEVC sacrifices the time complexity. To apply HEVC to the market applications, one of the key requirements is the fast encoding. To achieve the fast encoding, exploiting thread-level parallelism is widely chosen mechanism since multi-threading is commonly supported based on the multi-core computer architecture. In this paper, we implement both the Tile-level parallelism and the Frame-level parallelism for HEVC encoding on multi-core platform. Based on the implementation, we present two approaches in combining the Tile-level parallelism with Frame-level parallelism. The first approach creates the fixed number of tile per frame while the second approach creates the number of tile per frame adaptively according to the number of frame in parallel and the number of available worker threads. Experimental results show that both improves the parallel scalability compared to the one that use only tile-level parallelism and the second approach achieves good trade-off between parallel scalability and coding efficiency for both Full-HD (1080 x 1920) and 4K UHD (3840 x 2160) sequences.

• Journal of Broadcast Engineering
• /
• v.21 no.5
• /
• pp.651-661
• /
• 2016

최근의 디지털 사이니지는 대형 고해상도 디스플레이를 이용해 사용자에게 초고해상도 파노라마형태의 볼거리를 제공하거나 사용자와 인터렉션 등을 통해 맞춤형광고를 제공하는 등 다양한 형태로 발전하고 있다. 또 개방형 디지털 사이니지의 발전과 함께 대형 멀티 사이니지를 이용한 초고화질 영상콘텐츠를 다양한 서비스 단말장치의 연동과 웹기반의 상호운용성을 갖춘 관리시스템이 활발히 연구될 것으로 보인다. 본 논문에서는 수십대에서 백여대 이상의 고해상도 디스플레이를 연동하여 초고해상도 영상표출의 기술의 구현방안과 정형화된 영상 해상도가 아닌 초고화질 영상의 개별 콘텐츠에 대한 동기화 시키는 기술을 이용하여 멀티 콘텐츠 플레이 단말기에서 고해상도 영상을 Play Sync하는 기술을 연구한다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2016.11a
• /
• pp.107-109
• /
• 2016

본 논문에서는 4K UHD 입력 영상을 실시간으로 부호화하기 위해 적용되는 GOP 단위 또는 IDR 주기 단위의 병렬 부호화 구조를 지원하도록 R-${\lambda}$ 모델 기반의 율 제어 방법을 개선하는 비트 분배(bit allocation) 방법을 제안한다. GOP 단위 또는 IDR 주기 단위의 병렬 부호화기 내에서 율 제어기를 작동시키는 경우, 계층적 B 구조에서 같은 계층에 있는 프레임 간에는 상호간에 얼마만큼의 비트를 소모 하였는지에 대한 정보를 공유 할 수 없기 때문에 기존의 비트 분배 방식으로는 비트 예산(bit budget) 관리가 불가능하다. 이를 해결하기 위해 본 논문에서는, 기존의 R-${\lambda}$ 모델 기반 율 제어 방법을 개선하여 부호화 순서에 의한 시간 순서 방향의 비트 예산 갱신 기반 비트 분배하던 방식으로부터, GOP 마다 비트를 할당한 후 계층적 B 구조에서의 계층이 깊어지는 방향으로 비트 예산을 갱신하여 비트를 분배하는 방식으로 율 배분 방식을 개선하였다. 실험 결과를 통해 R-${\lambda}$ 모델 기반 율 제어의 기존 비트 분배 방식보다 제안 방법에 의한 목표 비트 율 달성 오차가 감소함을 확인하였다.

• Journal of Broadcast Engineering
• /
• v.26 no.2
• /
• pp.167-174
• /
• 2021

Recently, deep learning technology is widely used in various computer vision applications, such as object recognition, classification, and image generation. In particular, the deep learning-based super-resolution has been gaining significant performance improvement. Fast super-resolution convolutional neural network (FSRCNN) is a well-known model as a deep learning-based super-resolution algorithm that output image is generated by a deconvolutional layer. In this paper, we propose an FPGA-based convolutional neural networks accelerator that considers parallel computing efficiency. In addition, the proposed method proposes Optimal-FSRCNN, which is modified the structure of FSRCNN. The number of multipliers is compressed by 3.47 times compared to FSRCNN. Moreover, PSNR has similar performance to FSRCNN. We developed a real-time image processing technology that implements on FPGA.

• Journal of Broadcast Engineering
• /
• v.20 no.1
• /
• pp.68-81
• /
• 2015

Owing to the latest development of component and media processing technologies, UHDTV as a successor of the HDTV is expected that this will be coming soon realization. Accordingly, an audio technology that provides a 5.1-channel surround sound in home should be contemplating on what services should be provided with the advent of UHDTV era. In fact, however, the market of 5.1-channel audio is struggling, due to the difficulty of installation and maintenance of the multi speakers in a home. Meanwhile, the movie sound market for a long time been used in 5.1 and 7.1-channel sound formats, have changed as Dolby ATMOS, IOSONO, AURO3D etc. are launched one after another with the introduction of hybrid audio technologies that include the ceiling and object-based sounds. This very object-based audio technology is assured to be introduced in the home theater and broadcast audio market, and this change in audio technology is expected to be a breath of pioneering technological advances and market growth from the channel-based audio market that lacks flexibility. In this paper, we will investigate a suitable realistic audio solution for UHDTV, and introduce hybrid audio technologies, which is expected to be an audio technology for UHDTV, and we will describe the hybrid audio content format and reproduction methods in a home and consider the future prospects of realistic audio.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.19 no.5
• /
• pp.1189-1198
• /
• 2015

Recently, with rapid development of digital broadcasting technology, high-definition video service increased interest and demand. supplied mobile and image device support that improve 4~16 time existing Full HD. Such as high-definition contents supply, proposed compression for high-efficiency video codec (HEVC). Therefore, watermarking technology is necessary applying HEVC for protecting ownership and intellectual property. In this paper, analysis of prediction mode in intra frame and study feasibility of watermarking in re-encoding based HEVC. Proposed detect un-changed blocks in intra frame, using the result of analysis prediction mode.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2013.11a
• /
• pp.1483-1486
• /
• 2013

최근 무선통신의 급격한 발전과 스마트 기기의 확산으로 인해 Tving, pooq 등 다양한 모바일 방송 서비스가 급속도로 증가하고 있다. 또한 다양한 영상처리 기법 등이 등장함에 따라 4K, 8K급의 UHD 동영상들이 속속들이 등장하고 있다. 이로 인해 트랜스코딩을 통해 가공되는 동영상의 포맷 및 해상도 또한 매우 다양해질 것으로 전망된다. 현재까지의 트랜스코딩 연구사례는 사용자의 이동환경을 고려한 안정적 QoS 보장 또는 서버의 부하를 줄이기 위한 분산처리 기법 등의 연구 위주로 진행되어 온 것이 현실이다. 하지만 상기 조건(adaptive streaming 및 서버부하 처리)들을 충족시키긴 위해선 보다 효율적인 트랜스코딩 시스템의 제공이 선행 되어야 할 것이다. 이에 따라 본 논문에서는 사용자 관점에서 보다 빨리 스트리밍 서비스를 제공 받기 위하여 우선순위 큐 알고리즘을 적용한 시스템을 설계 및 구현하였다. 검증을 위하여 4가지 콘테이너(.MOV, .FLV, .MKV, .AVI)를 실험대상으로 하였고, 비교 대상 트랜스코딩 시스템은 상용 스트리밍 서비스인 YouTube를 활용하였다. 성능 측정결과, 총 트랜스코딩 완료시간은 YouTube에 비해 41.61%로 시간이 단축되었다. 또한 모바일 TV시청자가 55%를 차지한다는 점을 고려하여 컨트롤 서버에서는 최단시간 서비스 제공을 위하여 저해상도부터 추출하여 스트리밍 서버를 통해 송출하도록 구현하였다. 본 연구결과는 트랜스코딩 성능개선 뿐만 아니라 모바일 대상자를 위한 맞춤형 서비스를 보다 빨리 제공할 수 있을 것이며, 그 수요는 점차 증대될 것으로 예상된다.

• Journal of Broadcast Engineering
• /
• v.22 no.2
• /
• pp.193-206
• /
• 2017

In this paper, we propose a rate control method based on the $R-{\lambda}$ model that supports a parallel encoding structure in GOP levels or IDR period levels for 4K UHD input video in real-time. For this, a slice-level bit allocation method is proposed for parallel encoding instead of sequential encoding. When a rate control algorithm is applied in the GOP level or IDR period level parallelism, the information of how many bits are consumed cannot be shared among the frames belonging to a same frame level except the lowest frame level of the hierarchical B structure. Therefore, it is impossible to manage the bit budget with the existing bit allocation method. In order to solve this problem, we improve the bit allocation procedure of the conventional ones that allocate target bits sequentially according to the encoding order. That is, the proposed bit allocation strategy is to assign the target bits in GOPs first, then to distribute the assigned target bits from the lowest depth level to the highest depth level of the HEVC hierarchical B structure within each GOP. In addition, we proposed a processing method that is used to improve subjective image qualities by allocating the bits according to the coding complexities of the frames. Experimental results show that the proposed bit allocation method works well for frame-level parallel HEVC software encoders and it is confirmed that the performance of our rate controller can be improved with a more elaborate bit allocation strategy by using the preprocessing results.