• 제목/요약/키워드: Motion compensated frame interpolation

Search Result 35, Processing Time 0.023 seconds

Performance Comparison of Block-based Distortion Estimations for FRUC Techniques (FRUC 기술을 위한 블록별 왜곡 크기 추정기법의 성능비교)

  • Kim, Jin-Soo
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2011.10a
    • /
    • pp.927-929
    • /
    • 2011
  • Since DVC (Distributed Video Coding) and FRUC (Frame Rate Up Conversion) techniques need to have an efficient motion compensated frame interpolation algorithms. Conventional works of these applications have mainly focused on the performance improvement of overall system. But, in some applications, it is necessary to evaluate how well the MCI (Motion Compensated Interpolation) frame matches the original frame. For this aim, this paper deals with the modeling methods for evaluating the block-based matching cost. First, several matching criteria, which have already been dealt with the motion compensated frame interpolation, are introduced and then combined to make estimate models for the size of MSE (Mean Square Error) noise of the MCI frame to original one. Through computer simulations, it is shown that the block-based cost evaluation models are tested and can be effectively used for estimating the MSE noise.

  • PDF

Reliability Evaluation Method Based on Spatio-Temporal Statistical Characteristics for Motion Compensated Interpolated Frame (움직임 보상 보간 프레임에 대한 시공간적 통계특성에 기초한 블록기반의 신뢰도 평가 방법)

  • Kim, Jin-Soo
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.5
    • /
    • pp.28-36
    • /
    • 2013
  • Motion-compensated frame interpolation (MCFI) techniques in video signal processing have many application areas. Frame rate up-conversion (FRUC) or distributed video coding (DVC) technique needs an effective MCFI algorithm. For these applications, it is necessary to develop an effective post-processing technique to improve visual qualities or to reduce virtual channel noises, resulting in the reduced channel bit rate. This paper proposes a reliability evaluation method based on spatio-temporal characteristics for motion-compensated interpolated blocks. The proposed algorithm investigates the temporal matching characteristics for current frame and then is designed in such a way that it can measure temporal characteristics as well as the spatial ones. Through computer simulations, it is shown that the proposed method outperforms the conventional temporal matching method.

Efficient Motion Compensated Interpolation Technique Using Image Resizing (영상의 크기 변환을 이용한 효율적인 움직임 보상 보간 기법)

  • Kwon, Hye-Gyung;Lee, Chang-Woo
    • Journal of Broadcast Engineering
    • /
    • v.18 no.4
    • /
    • pp.599-608
    • /
    • 2013
  • Motion compensated interpolation (MCI) techniques are used for increasing the frame rate and generating the side information in the distributed video coding (DVC) system. In this paper, an efficient MCI technique using the image resizing in the DCT or LiftLT domain is proposed, and the performance of the MCI technique using various sub-pixel generation techniques is analyzed. Extensive computer simulations show that the proposed method produces the superior results compared to the conventional methods.

Frame Rate Up-Conversion Using Pyramid Structure and Quadtree (피라미드 구조와 쿼드트리를 이용한 프레임율 증가 변환)

  • Lee, Jichan;Kim, Jun-Geon;Lee, Junho;Kim, Kisun;Lee, Daeho
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2014.11a
    • /
    • pp.90-92
    • /
    • 2014
  • 본 논문에서는 피라미드 구조와 쿼드트리를 이용하는 움직임 보상 프레임 보간(motion compensated frame interpolation, MCFI)의 새로운 방법을 제안한다. 일반적인 MCFI 방법에서는 고정된 크기의 프레임과 블록에서 움직임 벡터(motion vector, MV)를 이용하여 두 프레임 사이의 프레임 영상을 추정한다. 그러나 이와 같은 방법은, 큰다양한 방향으로 움직이는 물체들의 MV 나 큰 움직임을 추정하기 어렵다. 이러한 문제점을 해결하기 위해서 본 논문에서는 블록 크기와 정합 영역이 가변적으로 적용될 수 있는 피라미드 구조와 쿼드트리를 이용한 프레임 보간 기법(pyramid structure and quadtree motion compensated frame interpolation, PQ-MCFI)를 제안한다. 제안하는 기법은 물체들이 빠르게 움직이는 장면과 다양한 방향으로 움직이는 장면에서 이전의 기법에 비해서 높은 PSNR 을 보이며, 실제 인간의 시각적인 측면에서는 더욱 정밀한 결과를 보인다.

  • PDF

Adaptive Extended Bilateral Motion Estimation Considering Block Type and Frame Motion Activity (블록의 성질과 프레임 움직임을 고려한 적응적 확장 블록을 사용하는 프레임율 증강 기법)

  • Park, Daejun;Jeong, Jechang
    • Journal of Broadcast Engineering
    • /
    • v.18 no.3
    • /
    • pp.342-348
    • /
    • 2013
  • In this paper, a novel frame rate up conversion (FRUC) algorithm using adaptive extended bilateral motion estimation (AEBME) is proposed. Conventionally, extended bilateral motion estimation (EBME) conducts dual motion estimation (ME) processes on the same region, therefore involves high complexity. However, in this proposed scheme, a novel block type matching procedure is suggested to accelerate the ME procedure. We calculate the edge information using sobel mask, and the calculated edge information is used in block type matching procedure. Based on the block type matching, decision will be made whether to use EBME. Motion vector smoothing (MVS) is adopted to detect outliers and correct outliers in the motion vector field. Finally, overlapped block motion compensation (OBMC) and motion compensated frame interpolation (MCFI) are adopted to interpolate the intermediate frame in which OBMC is employed adaptively based on frame motion activity. Experimental results show that this proposed algorithm has outstanding performance and fast computation comparing with EBME.

Distortion Estimation Using Block-Adaptive Matching Characteristics for Motion Compensated Interpolation Frame (움직임 보상 보간 프레임에 대한 블록 적응적 정합 특성을 이용한 왜곡 예측 기법)

  • Kim, Jin-Soo;Kim, Jae-Gon;Seo, Kwang-Deok
    • Journal of Broadcast Engineering
    • /
    • v.16 no.6
    • /
    • pp.1058-1068
    • /
    • 2011
  • Video FRUC (Frame Rate Up Conversion) is one of the main issues that have arisen in recent years with the explosive growth of video sources and display formats in consumer electronics. Most advanced FRUC algorithms adopt an efficient motion interpolation technique to determine the motion vector field of interpolated frames. But, in some application areas such as post processing in receiver side, it is necessary to evaluate how well the MCI (Motion Compensated Interpolation) frame was reconstructed. In order to achieve this aim, first, this paper introduces some cost functions to estimate the reliability of a block in the MCI frame. Then, by using these functions, this paper proposes two distortion estimation models for evaluating how much noise was produced in the MCI frame. Through computer simulations, it is shown that the proposed estimation methods perform effectively in estimating the noises of the MCI frame.

Frame Rate Up-Conversion with Occlusion Detection Function (폐색영역탐지 기능을 갖는 프레임율 변환)

  • Kim, Nam-Uk;Lee, Yung-Lyul
    • Journal of Broadcast Engineering
    • /
    • v.20 no.2
    • /
    • pp.265-272
    • /
    • 2015
  • A new technology on video frame rate up-conversion (FRUC) is presented by combining the median filter and motion estimation (ME) with an occlusion detection (OD) method. First, ME is performed to have a motion vector. Then, the OD method is used to refine motion vector in the occlusion region. Since the wrong motion vector can be obtained with high possibility in the occluded area, a median filtering that less depends on the motion vector is applied to that area, and since the motion vector is continuous and robust in the non-occluded area, BDMC(Bi-Directional Motion Compensated interpolation) is applied to obtain interpolated image in that area. BDMC using the bi-directional motion vectors achieves good results when continuity and robustness of the motion vector is higher. Experimental results show that the proposed algorithm provides better performance than the conventional approach. The average gain of PSNR (Peak Signal to Noise Ratio) is approximately 0.16 dB in the test sequences compared with BDMC.

Efficient Distributed Video Coding System and Performance Analysis Using Lapped Transform (Lapped Transform을 이용한 효율적인 분산 동영상 부호화 시스템 및 성능해석)

  • Kang, Soo-Kyung;Lee, Chang-Woo
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.36 no.9C
    • /
    • pp.564-572
    • /
    • 2011
  • Distributed video coding (DVC) system has been proposed to reduce encoder complexity by using the correlation of frames in decoders. Since the block based motion estimation operation is not performed in the encoder of DVC system, lapped transforms, in which adjacent two blocks are transformed into one block, can be efficiently used in the DVC system. In this paper, an efficient DVC system using lapped transforms is proposed. The overlapped block motion compensated interpolation is used to produce side information, and the corresponding correlation noise between original Wyner-Ziv frame and side information is modeled. Extensive computer simulations show that the proposed DVC system outperforms conventional DVC systems.

Effective Frame Rate Up-conversion Using Bi-directional Motion Estimation (양방향 움직임 추정을 이용한 효과적인 프레임 레이트 변환 알고리즘)

  • Park, Byung-Tae;Jung, You-Young;Ko, Sung-Jea
    • Proceedings of the IEEK Conference
    • /
    • 2000.09a
    • /
    • pp.429-432
    • /
    • 2000
  • We propose a new frame rate up-conversion algorithm for high quality video. In the proposed scheme bidirectional motion estimation (ME) is performed to construct the motion vector. (MV) field for the frame to be interpolated. Unlike conventional motion-compensated interpolation (MCI) algorithms, the proposed technique does not produce any overlapped pixel and hole region in the interpolated frame, and thus can utilize the overlapped block motion compensation technique to reduce the blocking artifacts. The proposed algoritm is very simple to implement on consumer products when compared to conventional MCI methods. Computer simulation shows a high visual performance of the proposed frame rate up-conversion algorithm.

  • PDF

Frame Rate up-conversion Algorithm using Adaptive Overlapped Block Motion Compensation (적응적 중첩 블록 움직임 보상을 이용한 프레임 율 향상 알고리즘)

  • Lee, Kangjun
    • Journal of Broadcast Engineering
    • /
    • v.24 no.5
    • /
    • pp.785-790
    • /
    • 2019
  • In this paper, a new bilateral frame rate up-conversion algorithm using adaptive overlapped block motion compensation is proposed. In this algorithm, the adaptive overlapped block motion compensation is based on the motion complexity of the reference region. As the motion complexity is determined by the size of the previously coded motion estimation prediction, the overlapped block motion compensation method is selected without any additional computational complexity. Experimental results show that the proposed algorithm provides better image quality than conventional methods both objectively and subjectively.