• Title/Summary/Keyword: Inter-layer prediction

Search Result 38, Processing Time 0.021 seconds

Selective Inter-layer Residual Prediction Coding and Fast Mode Decision for Spatial Enhancement Layers in Scalable Video Coding (스케일러블 비디오 부호화에서 선택적 계층간 차분 신호 부호화 및 공간적 향상 계층에서의 모드 결정)

  • Lee, Bum-Shik;Hahm, Sang-Jin;Park, Chang-Seob;Park, Keun-Soo;Kim, Mun-Churl
    • Journal of Broadcast Engineering
    • /
    • v.12 no.6
    • /
    • pp.596-610
    • /
    • 2007
  • In order to reduce the complexity of SVC encoding, we introduce a fast mode decision method in the enhancement layers of spatial scalability by selectively performing the inter-layer residual prediction of SVC. The Inter-layer residual prediction coding in Scalable Video Coding has a large advantage of enhancing the coding efficiency since it utilizes the correlation between two residuals from a lower spatial layer and its next higher spatial layer. However, this entails the dramatical increase in the complexity of SVC encoders. The proposed method is to analyze the characteristics of integer transform coefficients for the subtracted signal for two residuals from lower and upper spatial layers. Then it selectively performs the inter-layer residual prediction coding and rate-distortion optimizations in the upper spatial enhancement layer if the SAD values of residuals exceed adaptive threshold values. Therefore, by classifying the residuals according to the properties of integer-transform coefficients only with SAD of residuals between two layers, the SVC encoder can perform the inter-layer residual coding selectively, thus significantly reducing the total required encoding time. The proposed method results in reduction of the total encoding time with 51.5% in average while maintaining the RD performance with negligible amounts of quality degradation.

A Fast Inter-layer Mode Decision Method inScalable Video Coding (공간적 스케일러블 비디오 부호화에서 계층간 모드 고속 결정 방법)

  • Lee, Bum-Shik;Hahm, Sang-Jin;Park, Chang-Seob;Park, Keun-Soo;Kim, Mun-Churl
    • Journal of Broadcast Engineering
    • /
    • v.12 no.4
    • /
    • pp.360-372
    • /
    • 2007
  • We propose a fast inter-layer mode decision method by utilizing coding information of base layer upward its enhancement layer inscalable video coding (SVC), also called MPEG-4 part 10 Advanced Video Coding Amendment 3 or H.264 Scalable Extension (SE) which is being standardized. In this paper, when the motion vectors from the base layer have zero motion (0, 0) in inter-layer motion prediction or the Integer Transform coefficients of the residual between current MB and the motion compensated MB by the predicted motion vectors from the base layer are all zero, the block mode of the corresponding block to be encoded at the enhancement layer is determined to be the $16{\times}16$ mode. In addition, if the predicted mode of the MB to be encoded at the enhancement layer is not equal to the $16{\times}16$ mode, then the rate-distortion optimization is only performed on the reduced candidated modes which are same or smaller partitioned modes. Our proposed method exhibits the complexity reduction in encoding time up to 72%. Nevertheless, it shows negligible PSNR degradation and bit rate increase up to 0.25dB and 1.73%, respectively.

An Efficient coding Method for Motion Prediction Flag in the Scalable Video Encoding Standard (스케일러블 동영상 부호화 표준에서 움직임 예측 플래그를 위한 효율적인 부호화 방식)

  • Moon, Yong-Ho;Eom, Il-Kyu;Ha, Seok-Wun
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.9 no.2
    • /
    • pp.81-86
    • /
    • 2014
  • In the scalable video coding standard, inter-layer prediction based on the coding information of the base layer was adopted to increase the coding performance. This prediction tool results in new syntax elements called motion_prediction_flag (mPF) and residul_prediction_flag(rPF), which are carried to notify the motion vector predictor (MVP) and reference block required in the motion compensation of the decoder. In this paper, an efficient coding method for mPF is proposed to enhance coding efficiency of the salable video coding standard. Through an analysis on the transmission of mPF based on the relationship between the MVPs, we discover the conditions where mPF is unnecessary at the decoder and suggest a modified rate-distortion (RD) cost function to make RD optimization more effective. Simulation results show that the proposed method offers BD rate savings of approximately 1.4%, compared with the conventional SVC standard.

Phase Mode Decision Scheme for Fast Encoding in H.264 SVC (H.264/AVC 스케일러블 비디오 코딩에서 빠른 부호화를 위한 단계적 모드 선택 기법)

  • Goh, Gyeong-Eun;Kang, Jin-Mi;Cho, Mi-Sook;Chung, Ki-Dong
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.14 no.8
    • /
    • pp.793-797
    • /
    • 2008
  • To achieve flexible visual contents adaptation for multimedia communications, the ISO/IEC MPEG & ITU-T VCEG form the JVT to develop an SVC amendment for the H.264/AVC standard. JVT uses inter-layer prediction that can improve the rate-distortion efficiency of the enhancement layer. But inter-layer prediction causes computational complexity to be increased. In this paper, we propose a fast mode decision for inter frame coding. It makes use of the correlation between optimized prediction mode and its RD cost. Experimental results show that the proposed schemes save up to 38% of encoding time with a negligible coding loss and bit-rate increase.

A Deep Learning based Inter-Layer Reference Picture Generation Method for Improving SHVC Coding Performance (SHVC 부호화 성능 개선을 위한 딥러닝 기반 계층간 참조 픽처 생성 방법)

  • Lee, Wooju;Lee, Jongseok;Sim, Dong-Gyu;Oh, Seoung-Jun
    • Journal of Broadcast Engineering
    • /
    • v.24 no.3
    • /
    • pp.401-410
    • /
    • 2019
  • In this paper, we propose a reference picture generation method for Inter-layer prediction based deep learning to improve the SHVC coding performance. A description will be given of a structure for performing filtering using a VDSR network on a DCT-IF based upsampled picture to generate a new reference picture and a training method for generating a reference picture between SHVC Inter-layer. The proposed method is implemented based on SHM 12.0. In order to evaluate the performance, we compare the method of generating Inter-layer predictor by applying dictionary learning. As a result, the coding performance of the enhancement layer showed a bitrate reduction of up to 13.14% compared to the method using dictionary learning, a bitrate reduction of up to 15.39% compared to SHM, and a bitrate reduction of 6.46% on average.

An Efficient Mode Decision Method for Fast Intra Encoding in the SVC Enhancement Layer (SVC 향상 계층의 빠른 인트라 부호화를 위한 효율적인 모드 결정 방법)

  • Cho, Mi-Sook;Kang, Jin-Mi;Chung, Ki-Dong
    • Journal of Korea Multimedia Society
    • /
    • v.14 no.7
    • /
    • pp.872-883
    • /
    • 2011
  • SVC is an emerging video coding standard as an extension of H.264/AVC. This standard uses inter prediction, intra prediction and a new inter-layer prediction to improve coding performance of enhancement layers. However, it has high computational complexity. In this paper, we propose an efficient intra prediction mode decision method in the spatial enhancement layer to reduce the computational complexity. The proposed method consists of two phases. In the first phase, Intra_BL mode is selected using the RD cost of Intra_BL in advance. We exploit the fact that the RD cost and prediction mode are similar to those of neighbor macroblocks. In the second phase, we predict the enhancement layer mode using correlation between intra mode of enhancement layer and that of the base layer. Experimental results show that the proposed method could save from 48.15% to 56.32% in encoding time while degradation in video quality is negligible.

An Efficient Mode Decision Method for Fast Intra Prediction of SVC (SVC에서 빠른 인트라 예측을 위한 효율적인 모드 결정 방법)

  • Cho, Mi-Sook;Kang, Jin-Mi;Chung, Ki-Dong
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.15 no.4
    • /
    • pp.280-283
    • /
    • 2009
  • To improve coding performance of scalable video coding which is an emerging video coding standard as an extension of H.264/AVC, SVC uses not only intra prediction and inter prediction but inter-layer prediction. This causes a problem that computational complexity is increased. In this paper, we propose an efficient intra prediction mode decision method in spatial enhancement layer to reduce the computational complexity. The proposed method selects Inra_BL mode using RD cost of Intra_BL in advance. After that, intra mode is decided by only comparing DC modes. Experimental results show that the proposed method reduces 59% of the computation complexity of intra prediction coding, while the degradation in video quality is negligible.

Overview of Inter-Component Coding in 3D-HEVC (3D-HEVC를 위한 인터-컴포넌트 부호화 방법)

  • Park, Min Woo;Lee, Jin Young;Kim, Chanyul
    • Journal of Broadcast Engineering
    • /
    • v.20 no.4
    • /
    • pp.545-556
    • /
    • 2015
  • A HEVC-compatible 3D video coding method (3D-HEVC) has been recently developed as an extension of the high efficiency video coding (HEVC) standard. In order to efficiently deal with the multi-view video plus depth (MVD) format, 3D-HEVC exploits an inter-component prediction which allows the prediction between texture and depth map images in addition to a temporal prediction used in the conventional single layer video coding such as H.264/AVC and HEVC. The performance of the inter-component prediction is normally affected by the accuracy of the disparity vector, and thus it is important to have an accurate disparity vector used for the inter-component prediction. This paper, therefore, introduces a disparity derivation method and inter-component algorithms using the disparity vector for the efficient 3D video coding. Simulation results show that the 3D-HEVC provides higher coding performance compared with the simulcast approach using HEVC and the simple multi-view extension (MH-HEVC).

Adaptive Inter-layer Filter Selection Mechanism for Improved Scalable Extensions of High Efficiency Video Coding (SHVC) (스케일러블 HEVC 부호화 효율 개선을 위한 계층 간 적응적 필터 선택 알고리즘)

  • Lee, Jong-Hyeok;Kim, Byung-Gyu
    • Journal of Digital Contents Society
    • /
    • v.18 no.1
    • /
    • pp.141-147
    • /
    • 2017
  • Scalable extension of High Efficiency Video Coding (SHVC) standard uses the up-sampled residual data from the base layer to make a residual data in the enhancement layer. This paper describes an efficient algorithm for improving coding gain by using the filtered residual signal of base layer in the Scalable extension of High Efficiency Video Coding (SHVC). The proposed adaptive filter selection mechanism uses the smoothing and sharpening filters to enhance the quality of inter-layer prediction. Based on two filters and the existing up-sampling filter, a rate-distortion (RD)-cost fuction-based competitive scheme is proposed to get better quality of video. Experimental results showed that average BD-rate gains of 1.5%, 2.1%, and 1.7% for Y, U and V components, respectively, were achieved, compared with SHVC reference software 5.0, which is based on HEVC reference model (HM) 13.

Low-complexity generalized residual prediction for SHVC

  • Kim, Kyeonghye;Jiwoo, Ryu;Donggyu, Sim
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.2 no.6
    • /
    • pp.345-349
    • /
    • 2013
  • This paper proposes a simplified generalized residual prediction (GRP) that reduces the computational complexity of spatial scalability in scalable high efficiency video coding (SHVC). GRP is a coding tool to improve the inter prediction by adding a residual signal to the inter predictor. The residual signal was created by carrying out motion compensation (MC) of both the enhancement layer (EL) and up-sampled reference layer (RL) with the motion vector (MV) of the EL. In the MC process, interpolation of the EL and the up-sampled RL are required when the MV of the EL has sub-pel accuracy. Because the up-sampled RL has few high frequency components, interpolation of the up-sampled RL does not give significantly new information. Therefore, the proposed method reduces the computational complexity of the GRP by skipping the interpolation of the up-sampled RL. The experiment on SHVC software (SHM-2.0) showed that the proposed method reduces the decoding time by 10 % compared to conventional GRP. The BD-rate loss of the proposed method was as low as 1.0% on the top of SHM-2.0.

  • PDF