• IEIE Transactions on Smart Processing and Computing
• /
• 제4권6호
• /
• pp.422-433
• /
• 2015

In this paper, we demonstrate inter-layer prediction tools for scalable video coders. The proposed scalable coder is designed to support not only spatial, quality and temporal scalabilities, but also view scalability. In addition, we propose quad-tree inter-layer prediction tools to improve coding efficiency at enhancement layers. The proposed inter-layer prediction tools generate texture prediction signal with exploiting texture, syntaxes, and residual information from a reference layer. Furthermore, the tools can be used with inter and intra prediction blocks within a large coding unit. The proposed framework guarantees the rate distortion performance for a base layer because it does not have any compulsion such as constraint intra prediction. According to experiments, the framework supports the spatial scalable functionality with about 18.6%, 18.5% and 25.2% overhead bits against to the single layer coding. The proposed inter-layer prediction tool in multi-loop decoding design framework enables to achieve coding gains of 14.0%, 5.1%, and 12.1% in BD-Bitrate at the enhancement layer, compared to a single layer HEVC for all-intra, low-delay, and random access cases, respectively. For the single-loop decoding design, the proposed quad-tree inter-layer prediction can achieve 14.0%, 3.7%, and 9.8% bit saving.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2009년도 정보 및 제어 심포지움 논문집
• /
• pp.225-227
• /
• 2009

International standard specification, H.264/SVC improved from H.264/AVC, is set up so as to promote free use of huge multimedia data in various channel environments.;H.264/AVC is a international standard speicification for video compression, adopted and commercialized as standard for DMB broadcasting by JVT of ISO/IEC MPEG and ITU-T VCEG. SVC standard uses 'intra/inter prediction' in AVC as well as 'inter-layer intra prediction', 'inter-layer motion prediction' and 'inter-layer residual prediction' to improve efficiency of encoding. Among prediction technologies, 'inter-layer intra prediction' is to use co-located block of up sampled sublevels as a prediction signal. At this time, application of interpolation is one of the most important factors to determine encoding efficiency. SVC's currently using poly-phase FIR filter of 4-tap and 2-tap respectively to luma components. This paper is written for the purpose of analyzing encoding performance according to the interpolation. For this purpose, we applied poly-phase FIR filter of '2-tap', '4-tap' and '6-tap' respectively to luma components and then measured bit-rate, PNSR and running time of interpolation filter. We're expecting that the analysis results of this paper will be utilized for effective application of interpolation filter. SVC standard uses 'intra/inter prediction' in AVC as well as 'inter-layer intra prediction', 'inter-layer motion prediction' and 'inter-layer residual prediction' to improve efficiency of encoding.

• 한국방송∙미디어공학회:학술대회논문집
• /
• 한국방송∙미디어공학회 2020년도 추계학술대회
• /
• pp.136-139
• /
• 2020

본 논문에서는 최근 대두되고 있는 심층신경망 압축 연구에서 가중치 공유와 관련하여 심층신경망 모델 압축방법 Inter-Layer Kernel Prediction을 제안한다. 제안 방법은 영상 압축에서 사용되는 프레임 간 prediction 방법을 응용한 컨볼루션 신경망 가중치 공유 및 모델 압축 방법이다. 본 논문은 레이어 간 유사한 kernel들이 존재한다는 것을 발견하고 이를 기반으로 Inter-Layer Kernel Prediction을 사용하여 기존 모델 가중치를 보다 더 적은 비트로 표현하여 저장하는 방법을 제안한다. 제안 방법은 CIFAR10/100으로 학습된 ResNet에서 약 4.1 배의 압축률을 달성했으며 CIFAR10으로 학습된 ResNet110에서는 오히려 기존 Baseline 모델에 비해 0.04%의 성능 향상을 기록했다.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2005년도 학술대회 논문집 정보 및 제어부문
• /
• pp.195-197
• /
• 2005

In the scalable extension of H.264/AVC, spatial scalability is provided residual information as encoding layered spatial resolution between layers. We use the inter-layer prediction to remove this redundancy. In the inter-layer prediction, as the prediction we can use the signal that is the upsampled signal of the lower resolution layer. In this case, coding efficiency can be different from optimal prediction by kinds of interpolation filter. This paper indicates technique to choose the interpolation filter and to enhance coding efficiency for finding more correct prediction in intra macroblock.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2005년도 학술대회 논문집 정보 및 제어부문
• /
• pp.189-191
• /
• 2005

In the scalable extension of H.264/AVC, the codec is based on a layered approach to enable spatial scalability. In each layer, the basic concepts of motion compensated prediction and intra prediction are employed as in standard H.264/AVC. Additionally inter-layer prediction algorithm between successive spatial layers is applied to remove redundancy. In the inter-layer prediction, as the prediction we can use the signal that is the upsampled signal of the lower resolution layer. In this case, coding efficiency can be variable as the kinds of interpolation filter. In this paper, we investigate the approach to select the interpolation filter for residual signal in order to optimal prediction.

• 한국정보과학회논문지:정보통신
• /
• 제35권6호
• /
• pp.549-556
• /
• 2008

멀티미디어 통신에서 융통성 있는 비주얼 콘텐츠를 제공하기 위해 ISO/IEC MPEG & ITU-T VCEG의 JVT는 H.264/AVC 표준에 기반을 둔 확장 형식으로 SVC를 표준화하였다. JVT는 H.264/AVC SVC의 압축 효율을 높이기 위해 기존 H.264/AVC에서 제공하는 인터 예측(inter prediction) 과 인트라 예측(intra prediction) 뿐만 아니라 계층 간의 중복요소을 제거하는 계층 간 예측을 추가로 수행한다. 계층 간 예측 방법은 기본계층에서 코딩된 데이타를 재사용하여 향상계층의 비트율-왜곡(rate-distortion) 효율을 향상시킨다. 그러나 계층 간 예측을 추가로 수행함으로써 계산 복잡도가 높아지는 문제점이 있다. 본 논문에서는 이러한 계산 복잡도를 감소시키기 위해 계층 간 예측 중 기본계층의 잔여 신호값을 이용하는 예측 과정에서 효율적인 잔여신호 업 샘플링의 기법을 제안한다. 실험 결과 코딩 효율을 유지하면서 예측과정의 계산복잡도를 약 30% 줄일 수 있었다.

• ETRI Journal
• /
• 제35권6호
• /
• pp.990-1000
• /
• 2013

This paper describes the scalable extension of High Efficiency Video Coding (HEVC) to provide flexible high-quality digital video content services. The proposed scalable codec is designed on multi-loop decoding architecture to support inter-layer sample prediction and inter-layer motion parameter prediction. Inter-layer sample prediction is enabled by inserting the reconstructed picture of the reference layer (RL) into the decoded picture buffer of the enhancement layer (EL). To reduce the motion parameter redundancies between layers, the motion parameter of the RL is used as one of the candidates in merge mode and motion vector prediction in the EL. The proposed scalable extension can support scalabilities with minimum changes to the HEVC and provide average Bj${\o}$ntegaard delta bitrate gains of about 24% for spatial scalability and of about 21% for SNR scalability compared to simulcast coding with HEVC.

• IEIE Transactions on Smart Processing and Computing
• /
• 제4권6호
• /
• pp.434-442
• /
• 2015

In this paper, we propose an integrated spatial and view scalable video codec based on high efficiency video coding (HEVC). The proposed video codec is developed based on similarity and uniqueness between the scalable extension and 3D multi-view extension of HEVC. To improve compression efficiency using the proposed scalable multi-view video codec, inter-layer and inter-view predictions are jointly employed by using high-level syntaxes that are defined to identify view and layer information. For the inter-view and inter-layer predictions, a decoded picture buffer (DPB) management algorithm is also proposed. The inter-view and inter-layer motion predictions are integrated into a consolidated prediction by harmonizing with the temporal motion prediction of HEVC. We found that the proposed scalable multi-view codec achieves bitrate reduction of 36.1%, 31.6% and 15.8% on the top of ${\times}2$, ${\times}1.5$ parallel scalable codec and parallel multi-view codec, respectively.

• ETRI Journal
• /
• 제32권4호
• /
• pp.577-587
• /
• 2010

The layered coding structure of scalable video coding (SVC) with adaptive inter-layer prediction causes noticeable computational complexity increments when compared to existing video coding standards. To lighten the computational complexity of SVC, we present a fast algorithm to speed up the inter-mode decision process. The proposed algorithm terminates inter-mode decision early in the enhancement layers by estimating the rate-distortion (RD) cost from the macroblocks of the base layer and the enhancement layer in temporal, spatial, and inter-layer directions. Moreover, a search range decision algorithm is also proposed in this paper to further increase the motion estimation speed by using the motion vector information from temporal, spatial, or inter-layer domains. Simulation results show that the proposed algorithm can determine the best mode and provide more efficient total coding time saving with very slight RD performance degradation for spatial and quality scalabilities.

• 방송공학회논문지
• /
• 제15권5호
• /
• pp.653-664
• /
• 2010

일반적으로 현재 사용되는 비디오 코덱들은 모두 시간적 공간적 특성을 적절히 고려하여 차분 신호를 엔트로피 부호화한다. 스케일러블 비디오 부호화(SVC, Scalable Video Coding)는 계층 간의 중복성을 제거하고자 새로운 3가지 예측 기술을 도입하였음에도 계층간 예측된 신호에는 여전히 이전의 엔트로피 부호화 방법을 그대로 사용하고 있다. 실험결과에 따르면 계층 간 예측 방법을 이용하여 취득한 차분신호는 기존의 시간적 공간적 예측 방법을 통하여 얻은 차분 신호와는 다른 특성을 갖고 있다. 본 논문에서는 계층 간 예측 기술을 통해 얻은 차분신호에 대하여 엔트로피 부호화시 해당 차분 신호가 갖는 특성이 적절히 고려된 엔트로피 부호화 방법을 제안한다. 계층 간 텍스쳐 예측을 통해 얻은 차분 신호를 엔트로피 부호화하기 위하여 부호화된 블록 패턴(Coded Block Pattern, CBP) 표를 재설계한다. 이에 대한 실험 결과는 새롭게 재설계된 CBP 표가 기존의 JSVM 9.18 대비 4CIF 해상도의 영상에 대해 평균 2.20%, CIF 해상도의 영상에 대해 평균 1.14% 의 BD-Bitrate가 감소된다.