• Title/Summary/Keyword: Motion Vector Extrapolation

Search Result 6, Processing Time 0.039 seconds

Whole Frame Error Concealment with an Adaptive PU-based Motion Vector Extrapolation for HEVC

  • Kim, Seounghwi;Lee, Dongkyu;Oh, Seoung-Jun
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.4 no.1
    • /
    • pp.16-21
    • /
    • 2015
  • Most video services are transmitted in wireless networks. In a network environment, a packet of video is likely to be lost during transmission. For this reason, numerous error concealment (EC) algorithms have been proposed to combat channel errors. On the other hand, most existing algorithms cannot conceal the whole missing frame effectively. To resolve this problem, this paper proposes a new Adaptive Prediction Unit-based Motion Vector Extrapolation (APMVE) algorithm to restore the entire missing frame encoded by High Efficiency Video Coding (HEVC). In each missing HEVC frame, it uses the prediction unit (PU) information of the previous frame to adaptively decide the size of a basic unit for error concealment and to provide a more accurate estimation for the motion vector in that basic unit than can be achieved by any other conventional method. The simulation results showed that it is highly effective and significantly outperforms other existing frame recovery methods in terms of both objective and subjective quality.

Whole Frame Error Concealment with an Adaptive PU-based Motion Vector Extrapolation and Boundary Matching (적응적인 PU 기반 움직임 벡터 외삽과 경계 정합을 통한 프레임 전체 오류 은닉 방법에 관한 연구)

  • Kim, Seounghwi;Lee, Dongkyu;Oh, Seoung-Jun
    • Journal of Broadcast Engineering
    • /
    • v.20 no.4
    • /
    • pp.533-544
    • /
    • 2015
  • Recently, most of the video services are usually transmitted in wireless networks. In networks environment, a packet of video is likely to be lost during transmission. For this reason, this paper proposes a new Error Concealment (EC) algorithm. For High Efficiency Video Coding (HEVC) bitstreams, the proposed algorithm includes Adaptive Prediction Unit-based Motion Vector Extrapolation (APMVE) and Boundary Matching (BM) algorithm, which employs both the temporal and spatial correlation. APMVE adaptively decides a Error Concealment Basic Unit (ECBU) by using the PU information of the previous frame and BM employing the spatial correlation is applied to only unreliable blocks. Simulation results show that the proposed algorithm provides the higher subjective quality by reducing blocking artifacts which appear in other existing algorithms.

PU-based Motion Vector Extrapolation for HEVC Error Concealment (HEVC 오류 은닉을 위한 PU 기반 움직임 벡터 외삽법)

  • Kim, Sangmin;Lee, Dong-Kyu;Park, Dongmin;Oh, Seoung-Jun
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2014.06a
    • /
    • pp.209-210
    • /
    • 2014
  • 최근 인터넷 상에서 제공되는 영상 서비스에 대한 요구가 증가하고 있다. 하지만 네트워크 환경에서 전송되는 데이터는 오류로 인하여 쉽게 손실될 수 있다. 특히 HEVC(High Efficiency Video Coding)와 같이 높은 압축률로 압축된 정보에 대한 전송 오류는 영상 복원에 심각한 영향을 끼친다. 따라서 네트워크 환경에서 일정한 화질을 유지하기 위한 오류 은닉(Error Concealment : EC) 방법이 필요하다. 본 논문은 HEVC EC 를 위한 PU(Prediction Unit) 기반 움직임 벡터 외삽법(Motion Vector Extrapolation : MVE) 모델을 제안한다. PU 는 예측의 기본 단위로써 PU 내에 동일한 물체가 포함될 확률이 높다. 따라서, 이 모델은 손실된 프레임의 이전 프레임이 갖는 PU 정보를 이용하여 PU 단위로 외삽(extrapolation)을 실시한다. 또한, 손실된 블록과 외삽 블록간의 관계를 고려하여 겹쳐진(overlapped) 외삽 블록 중 가장 작은 PU 크기를 EC 기본 단위로 결정한다. 이 방법은 PU 정보를 반영함으로써 블록 경계 오류(block artifact)를 감소시킨다.

  • PDF

Fast Algorithm Based on Successive Elimination Algorithm for Multi-Reference Motion Estimation (다중 참조영상 움직임 추정에 적응을 위한 연속 제거 알고리즘 기반 고속화 알고리즘)

  • Kim Young-Moon;Lee Jae-Eun;Lim Chan;Kang Hyun-Soo
    • Journal of Korea Multimedia Society
    • /
    • v.8 no.7
    • /
    • pp.889-897
    • /
    • 2005
  • This paper presents a new fast motion estimation algorithm for multi-reference frames. We first analyze the experimental results of the successive elimination algorithm, which is a fast version of full search algorithm, being applied to Multi-reference frames. Based on the analysis, a new scheme for alleviating its computational burden is introduced. In the proposed method, the motion vector for the immediately previous reference frame is found by applying the successive elimination algorithm, while the motion vector for other reference frames is estimated by extrapolation of the already obtained motion vector. Adaptively restricting the motion search area to the local area centered on the estimated motion vector, the proposed method provides dramatic computational complexity reduction but slight quality degradation. The proposed method is evaluated by experiments for some image sequences.

  • PDF

Extra-phase Image Generation for Its Potential Use in Dose Evaluation for a Broad Range of Respiratory Motion

  • Lee, Hyun Su;Choi, Chansoo;Kim, Chan Hyeong;Han, Min Cheol;Yeom, Yeon Soo;Nguyen, Thang Tat;Kim, Seonghoon;Choi, Sang Hyoun;Lee, Soon Sung;Kim, Jina;Hwang, JinHo;Kang, Youngnam
    • Journal of Radiation Protection and Research
    • /
    • v.44 no.3
    • /
    • pp.103-109
    • /
    • 2019
  • Background: Four-dimensional computed tomographic (4DCT) images are increasingly used in clinic with the growing need to account for the respiratory motion of the patient during radiation treatment. One of the reason s that makes the dose evaluation using 4DCT inaccurate is a change of the patient respiration during the treatment session, i.e., intrafractional uncertainty. Especially, when the amplitude of the patient respiration is greater than the respiration range during the 4DCT acquisition, such an organ motion from the larger respiration is difficult to be represented with the 4DCT. In this paper, the method to generate images expecting the organ motion from a respiration with extended amplitude was proposed and examined. Materials and Methods: We propose a method to generate extra-phase images from a given set of the 4DCT images using deformable image registration (DIR) and linear extrapolation. Deformation vector fields (DVF) are calculated from the given set of images, then extrapolated according to respiratory surrogate. The extra-phase images are generated by applying the extrapolated DVFs to the existing 4DCT images. The proposed method was tested with the 4DCT of a physical 4D phantom. Results and Discussion: The tumor position in the generated extra-phase image was in a good agreement with that in the gold-standard image which is separately acquired, using the same 4DCT machine, with a larger range of respiration. It was also found that we can generate the best quality extra-phase image by using the maximum inhalation phase (T0) and maximum exhalation phase (T50) images for extrapolation. Conclusion: In the present study, a method to construct extra-phase images that represent expanded respiratory motion of the patient has been proposed and tested. The movement of organs from a larger respiration amplitude can be predicted by the proposed method. We believe the method may be utilized for realistic simulation of radiation therapy.