• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.11C
• /
• pp.940-947
• /
• 2010

Motion Compensated Frame Interpolation(MCFI) has been used to reduce motion jerkiness for dynamic scenes and motion blurriness for LCD-panel display as post processing for high quality display. However, MCFI that directly uses the motion information often suffers from annoying artifacts such as blockiness, ghost effects, and deformed structures. So in this paper, we propose a novel edge-based adaptively weighted vector median filter as post-processing. At first, the proposed method generates an edge direction map through a sobel mask and a weighted maximum frequent filter. And then, outlier MVs are removed by average of angle difference and replaced by a median MV of $3{\times}3$ window. Finally, weighted vector median filter adjusts the weighting values based on edge direction derived from spatial coherence between the edge direction continuity and motion vector. The results show that the performance of PSNR and SSIM are higher up to 0.5 ~ 1 dB and 0.4 ~ 0.8 %, respectively.

• Journal of IKEEE
• /
• v.13 no.4
• /
• pp.110-115
• /
• 2009

The motion compensation is the most time-consuming and complex unit in the H.264 decoder. The performance of the motion compensation is determined by the calculation of pixel interpolation. The quarter-pixel interpolation is achieved using 6-tap horizontal or vertical FIR filters for luminance data and bilinear FIR filters for chroma data. We propose the architecture for interpolation of luminance and chroma data in H.264 decoders. It is composed of dual-channel pipelined processing elements and can interpolate integer-, half- and quarter-pixel data. The number of the processing cycles is different depending on the position. The processing elements are composed of adders and shifters to reduce the complexity while the accuracy of the pixel data are maintained. We design interpolators for luminance and chroma data using Verilog-HDL and verify the function and performance by implementing using an FPGA.

• Journal of IKEEE
• /
• v.17 no.4
• /
• pp.459-468
• /
• 2013

Under nonlinear characteristics of frames, we propose the frame interpolation using GRNN to enhance the visual picture quality. By full search with block size of 128x128~1x1 to reduce blocky artifact and image overlay, we select the frame having block of minimum error and re-estimate the nonlinear moving vector using GRNN. We compare our scheme with forward(backward) motion compensation, bidirectional motion compensation when the object movement is large or the object image includes zoom-in and zoom-out or camera focus has changed. Experimental results show that the proposed method provides better performance in subjective image quality compared to conventional MCFI methods.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2017.06a
• /
• pp.66-69
• /
• 2017

본 논문에서는 프레임율 향상 기법 (Frame Rate Up-Conversion, FRUC)에 사용되는 새로운 움직임 예측(motion estimation)알고리즘을 제시한다. 제안된 알고리즘은 단 방향 움직임 예측(unilateral motion estimation)에 의해 순방향 및 역방향의 움직임 벡터(motion vector)를 독립적으로 추정한다. 움직임 벡터를 찾은 후, weighted motion vector smoothing(WMVS)가 적용된다. 다음으로, 보간 프레임 (interpolated frame)의 관점에서 현재 블록의 인접 블록들의 모션 벡터들을 후보들로 사용하여 현재 블록과 가장 잘 일치하는 움직임 벡터를 찾는다. 그 후, 선택된 움직임 벡터를 현재 블록의 유도 움직임 벡터 (guidance motion vector)로 정한다. 그런 다음 motion vector shifting error 를 없애기 위해 motion vector refinement (MVR)가 진행된다. 마지막 단계에서는 각 움직임 벡터의 신뢰도를 계산하여 순방향 및 역방향 움직임 벡터 중 최종 움직임 벡터를 선택한다.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.47 no.5
• /
• pp.165-174
• /
• 2010

The H.264/AVC standard obtained better performance than previous compression standards, but it also increased the computational complexity of CODEC simultaneously. Various techniques recently included at the KTA software developed by VCEG also were increasing its complexity. Especially adaptive interpolation filter has more complexity than two times due to development for coding efficiency. In this paper, we propose low-complexity filter bank to improve speed up of decoding and coding gain. We consists of filter bank of a fixed-simple filter for low-complexity and adaptive interpolation filter for high coding efficiency. Then we compensated using optimal filter at each macroblock-level or frame-level. Experimental results shows a similar coding efficiency compared to existing adaptive interpolation filter and decoding speed of approximately 12% of the entire decoder gained.

• Journal of Broadcast Engineering
• /
• v.8 no.3
• /
• pp.297-305
• /
• 2003

In this paper, we propose a wavelet based fast motion estimation algorithm for video sequence encoding with very low bit-rate. By using one of properties oi wavelet transform, multi-resolution analysis(MRA) property and spatial Interpolation of an image, we are able to reduce both prediction error and computational complexity at the same time. Especially, by defining a significant block(SB) based on the differential information of wavelet coefficients between successive frames, the proposed algorithm makes up a defect of multi-resolution motion estimation(MRME) algorithm of increasing the number of motion vectors. As experimental results. we can reduce the computational load up to 70% but also improve PSNR up to about 0.1 ∼ 1.2 dB comparing with the MRME algorithm.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2017.11a
• /
• pp.107-109
• /
• 2017

HEVC 표준은 정수 화소로 표현된 신호에 DCT-II 를 기반으로 하는 보간 필터를 사용하여 부화소 신호를 생성한다. 움직임 보상 및 예측의 성능 향상을 위해서 부화소 신호를 생성하는 방법을 이용한다. HEVC 표준은 부화소를 각각 1/4-화소 단위로 생성을 하며, 부화소를 생성하기 위해서 길이가 다른 각각의 DCT 보간 필터를 사용하고 있다. 1/2-화소를 생성하는 경우에는 필터의 길이가 8 인 DCT 기반 보간 필터를 사용하며, 1/4-화소와 3/4-화소의 경우에는 필터의 길이가 7 인 DCT 기반 보간 필터를 사용한다. 본 논문에서는 DST-VII을 기반으로 하는 보간 필터를 제안하여, CTU-Level 단위로 RDO 과정을 통해 최적화된 보간 필터를 선택하여 사용한다. 본 논문에서 제안하는 방법은 HEVC 표준보다 BD-rate 가 Low Delay B 와 Random Access configurations 에서 각각 0.6%와 0.6%의 성능 향상을 가져오며 Low Delay P configuration 에서 0.5%의 성능감소를 보인다.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.3
• /
• pp.20-29
• /
• 2008

In this paper, we propose a do-interlacing algorithm using integral projection-based motion estimation considering Region Of Interest(ROI). The proposed motion estimation method finds the motion of the given ROI accurately with low computational cost. In order to incorporate the motion estimation in do-interlacing, an entire image is first segmented into multiple ROIs according to the temporally predicted block-wise motion types and spatial positions. Then, motion vectors of respective ROIs are obtained by the integral projection method. In this paper, totally five ROIs, one for the global motion and four for the local motions, are made, and therefore, five motion vectors are produced for each field. By using the estimated motion vectors, motion compensation is performed for increasing the vortical resolution of the converted frames. Finally, do-interlaced frames are obtained by effectively combining the results of motion compensation and stable intra-field do-interlacing according to the reliability of motion compensation. Experimental results show that the proposed algorithm provides better image quality than existing algorithms in both subjective and objective measures.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.11a
• /
• pp.53-56
• /
• 2009

최근 HD 방송의 실현과 함께 HDTV가 빠르게 상용화되면서 고화질 비디오를 더 효율적으로 압축하기 위한 기술 개발이 활발하게 진행되고 있다. 최신 표준 비디오 압축 방식인 H.264/AVC에서는 고정 6탭 필터를 사용하여 참조 영상을 보간하고 움직임 예측을 수행하는데, 이의 압축 효율을 향상시키기 위하여 고정 필터를 개선한 비분리 적응형 보간 필터가 개발되었다. 하지만 비분리 적응형 보간 필터는 압축률뿐만 아니라 계산량도 증가하는 단점이 있기 때문에 2차원 필터를 1차원 필터의 연결로 모델링 한 분리 적응형 보간 필터가 개발되었고, 그 결과 압축률은 비슷하게 유지하면서 계산량을 훨씬 줄일 수 있게 되었다. 분리 적응형 보간 필터는 1차원 필터 모델링을 할 때, 수평방향의 필터링 수행 후 수직방향 필터링을 하기 때문에 이를 통해 만들어진 보간 영상은 원 영상의 수평방향에 대한 특성을 더 많이 반영하게 된다. 따라서 수직방향으로 더 높은 주파수 특성을 갖는 영상의 경우에는 효율이 떨어지게 된다. 이를 고려하여 본 논문에서는 영상의 수직방향 주파수 특성을 더 많이 반영할 수 있는 보간 필터를 추가함으로써 영상의 주파수 특성에 따라 보간 필터를 적응적으로 선택하는 향상된 분리 적응형 보간 필터를 제안한다. 제안한 알고리즘을 이용할 경우 기존의 분리 적응형 보간 필터에 비해 움직임 예측 및 보상이 더 정확하게 이뤄질 수 있으며, 부호화 효율이 향상됨을 확인할 수 있다.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.51 no.12
• /
• pp.150-159
• /
• 2014

The latest video coding standard, HEVC can improve the coding efficiency significantly compared with the H.264/AVC. However the HEVC encoder requires much larger computational complexities. The longer 8-tap interpolation filter of the HEVC which is used in a non-integer motion estimation is one of the reasons and this paper aims to reduce the computational complexities. First of all, three shorter-tap interpolation filters for a motion estimation process are tested rather than the use of a standard interpolation filter. In addition, the fast searching strategies to reduce the number of comparisons for choosing the best non-integer motion vector are proposed. Finally, the interpolation process is selectively applied according to the searching strategy. By combining all of the techniques, the experimental results show that the encoding times can be reduced by 13.6%, 18.5% and 21.1% with the coding efficiency penalties of 0.7%, 1.5% and 2.5%, respectively. For the full-HD video sequences, the coding efficiency penalties are reduced to 0.4%, 1.1% and 1.6% at the same level of the encoding time savings, which shows the effectiveness of the proposed schemes for the high resolution video sequences.