• 제목/요약/키워드: Affine Motion Estimation

검색결과 27건 처리시간 0.023초

다목적 비디오 부호화를 위한 고속 어파인 움직임 예측 방법 (Fast Affine Motion Estimation Method for Versatile Video Coding)

  • 정승원;전동산
    • 한국산업융합학회 논문집
    • /
    • 제25권4_2호
    • /
    • pp.707-714
    • /
    • 2022
  • Versatile Video Coding (VVC) is the most recent video coding standard, which had been developed by Joint Video Expert Team (JVET). It can improve significant coding performance compared to the previous standard, namely High Efficiency Video Coding (HEVC). Although VVC can achieve the powerful coding performance, it requires the tremendous computational complexity of VVC encoder. Especially, affine motion compensation (AMC) was adopted the block-based 4-parameter or 6-parameter affine prediction to overcome the limit of translational motion model while VVC require the cost of higher encoding complexity. In this paper, we proposed the early termination of AMC that determines whether the affine motion estimation for AMC is performed or not. Experimental results showed that the proposed method reduced the encoding complexity of affine motion estimation (AME) up to 16% compared to the VVC Test Model 17 (VTM17).

Modified Particle Filtering for Unstable Handheld Camera-Based Object Tracking

  • Lee, Seungwon;Hayes, Monson H.;Paik, Joonki
    • IEIE Transactions on Smart Processing and Computing
    • /
    • 제1권2호
    • /
    • pp.78-87
    • /
    • 2012
  • In this paper, we address the tracking problem caused by camera motion and rolling shutter effects associated with CMOS sensors in consumer handheld cameras, such as mobile cameras, digital cameras, and digital camcorders. A modified particle filtering method is proposed for simultaneously tracking objects and compensating for the effects of camera motion. The proposed method uses an elastic registration algorithm (ER) that considers the global affine motion as well as the brightness and contrast between images, assuming that camera motion results in an affine transform of the image between two successive frames. By assuming that the camera motion is modeled globally by an affine transform, only the global affine model instead of the local model was considered. Only the brightness parameter was used in intensity variation. The contrast parameters used in the original ER algorithm were ignored because the change in illumination is small enough between temporally adjacent frames. The proposed particle filtering consists of the following four steps: (i) prediction step, (ii) compensating prediction state error based on camera motion estimation, (iii) update step and (iv) re-sampling step. A larger number of particles are needed when camera motion generates a prediction state error of an object at the prediction step. The proposed method robustly tracks the object of interest by compensating for the prediction state error using the affine motion model estimated from ER. Experimental results show that the proposed method outperforms the conventional particle filter, and can track moving objects robustly in consumer handheld imaging devices.

  • PDF

다각형 정합 알고리듬을 이용한 affine 변환 움직임 보상 (Motion Compensation by Affine Transform using Polygonal Matching Algorithm)

  • 박효석;황찬식
    • 전자공학회논문지S
    • /
    • 제36S권1호
    • /
    • pp.60-69
    • /
    • 1999
  • 초저속 동영상 부호화에서 블록화 현상을 해결하기 위해 affine 변환을 이용한 움직임 보상 방법이 제안되었고 움직임 추정에서 정밀한 움직임 추정하기 위해 육각형 정합 알고리듬이 제안되었다. Affine 변환에서 영상을 삼각형 조각들로 나눌 때 삼각형 형태와 물체가 불일치할수록 보상 영상의 예측 에러가 증가하고 일그러짐 현상이 나타난다. 본 논문에서는 이러한 문제점을 해결하기 위해 영상의 윤곽 정보에 따라 다른 형태의 삼각형 조각들로 나누고, 또한 윤곽 정보가 복잡한 부분은 삼각형을 세분화하는 알고리듬을 제안한다. 제안한 방법에서 정밀한 움직밍 벡터를 추정할 때 이웃하는 삼각형 조각 형태 차이로 인하여 다각형 정합 알고리듬을 제안하고 H.263과 성능르 비교한다.

  • PDF

동영상에서의 내용기반 메쉬를 이용한 모션 예측 (Content Based Mesh Motion Estimation in Moving Pictures)

  • 김형진;이동규;이두수
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2000년도 하계종합학술대회 논문집(4)
    • /
    • pp.35-38
    • /
    • 2000
  • The method of Content-based Triangular Mesh Image representation in moving pictures makes better performance in prediction error ratio and visual efficiency than that of classical block matching. Specially if background and objects can be separated from image, the objects are designed by Irregular mesh. In this case this irregular mesh design has an advantage of increasing video coding efficiency. This paper presents the techniques of mesh generation, motion estimation using these mesh, uses image warping transform such as Affine transform for image reconstruction, and evaluates the content based mesh design through computer simulation.

  • PDF

동적 모자이크 기반의 압축 (Dynamic Mosaic based Compression)

  • 박동진;김동규;정영기
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2003년도 하계종합학술대회 논문집 Ⅳ
    • /
    • pp.1944-1947
    • /
    • 2003
  • In this paper, we propose a dynamic-based compression system by creating mosaic background and transmitting the change information. A dynamic mosaic of the background is progressively integrated in a single image using the camera motion information. For the camera motion estimation, we calculate affine motion parameters for each frame sequentially with respect to its previous frame. The camera motion is robustly estimated on the background by discriminating between background and foreground regions. The modified block-based motion estimation is used to separate the back-ground region.

  • PDF

계층적 모션 추정을 통한 장면 분할 기법 (Scene Segmentation using a Hierarchical Motion Estimation Technique)

  • 김모곤;우종선;정순기
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2002년도 하계종합학술대회 논문집(3)
    • /
    • pp.203-206
    • /
    • 2002
  • We propose the new algorithm for scene segmentation. The proposed system consists motion estimation module and motion segmentation module. The former estimates 2D-motion value for each pixel position from two images transformed by wavelet. The latter determine scene segments well fitting on dominant affine motion models. What distinguishes proposed algorithm from other methods is that it needs not other post-processing for scene segmentation. We can manipulate both multimedia data and objects in virtual environment using proposed algorithm.

  • PDF

A LOCALIZED GLOBAL DEFORMATION MODEL TO TRACK MYOCARDIAL MOTION USING ECHOCARDIOGRAPHY

  • Ahn, Chi Young
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • 제18권2호
    • /
    • pp.181-192
    • /
    • 2014
  • In this paper, we propose a robust real-time myocardial border tracking algorithm for echocardiography. Commonly, after an initial contour of LV border is traced at one or two frame from the entire cardiac cycle, LV contour tracking is performed over the remaining frames. Among a variety of tracking techniques, optical flow method is the most widely used for motion estimation of moving objects. However, when echocardiography data is heavily corrupted in some local regions, the errors bring the tracking point out of the endocardial border, resulting in distorted LV contours. This shape distortion often occurs in practice since the data acquisition is affected by ultrasound artifacts, dropout or shadowing phenomena of cardiac walls. The proposed method deals with this shape distortion problem and reflects the motion realistic LV shape by applying global deformation modeled as affine transform partitively to the contour. We partition the tracking points on the contour into a few groups and determine each affine transform governing the motion of the partitioned contour points. To compute the coefficients of each affine transform, we use the least squares method with equality constraints that are given by the relationship between the coefficients and a few contour points showing good tracking results. Many real experiments show that the proposed method supports better performance than existing methods.

컨텐트 적응적 비정형 메쉬를 이용한 전방향 움직임보상 (Forward Motion Compensation Content-Adaptive Irregular Meshes)

  • Jeon, Byeungwoo
    • 대한전자공학회논문지SP
    • /
    • 제38권2호
    • /
    • pp.149-159
    • /
    • 2001
  • 기존의 블록기반 움직임 예측방법은 특히 저전송률 비디오 압축에 사용 될 경우 움직임 필드에서의 블록화 현상이나 불안정한 움직임 예측과 같은 문제를 수반한다. 본 논문은 이러한 단점을 극복하기 위해 H.263의 기존 블록기반 DCT부호화 구조를 최대한 유지하면서 비정형 삼각형 메쉬에 기반한 새로운 움직임 보상 방법을 수용할 수 있는 하나의 방법을 제안한다. 제안방법은 복원된 이전 프레임 영상을 최소의 제어점들을 이용해 표현하기 위해, 주어진 영상의 컨텐트에 적응적으로 삼각형 비정형 메쉬를 설정한다. 그리고 Affine변환에 기반한 매칭을 이용해, 설정된 각 제어점의 움직임벡터를 구한 후, 이를 이용해 각 메쉬를 Affine변환하여 예측된 현재 프레임을 얻는 전방향 움직임 보상을 제안한다. 이 방법은 컨텐트에 적응적으로 설정된 메쉬 정보를 보내지 않아도 되는 장점이 있다. 실제 비디오 데이터를 이용해 실험한 결과 제안방법이 객관적 및 주관적 화질 평가에서 기존의 블록기반 H.263 방법보다 개선되었음을 알 수 있다.

  • PDF

Active Object Tracking using Image Mosaic Background

  • Jung, Young-Kee;Woo, Dong-Min
    • Journal of information and communication convergence engineering
    • /
    • 제2권1호
    • /
    • pp.52-57
    • /
    • 2004
  • In this paper, we propose a panorama-based object tracking scheme for wide-view surveillance systems that can detect and track moving objects with a pan-tilt camera. A dynamic mosaic of the background is progressively integrated in a single image using the camera motion information. For the camera motion estimation, we calculate affine motion parameters for each frame sequentially with respect to its previous frame. The camera motion is robustly estimated on the background by discriminating between background and foreground regions. The modified block-based motion estimation is used to separate the background region. Each moving object is segmented by image subtraction from the mosaic background. The proposed tracking system has demonstrated good performance for several test video sequences.

적응적 M-estimators 강건 예측 알고리즘 (An Adaptive M-estimators Robust Estimation Algorithm)

  • 장석우;김진욱
    • 한국컴퓨터정보학회논문지
    • /
    • 제10권2호
    • /
    • pp.21-30
    • /
    • 2005
  • 강건 예측 기법은 오류 자료(outliers)를 제거하고 정상 자료(non-outliers)만으로 모델의 파라미터를 구하는 통계적인 방법으로 잘 알려져 있다 기존의 문헌에 소개된 많은 강건 예측 알고리즘들이 있으나 컴퓨터 비전 및 영상 처리 분야에서 가장 많이 사용되는 알고리즘은 M-estimators와 LMS(least-median of squares) 방법이다. 이 중 M-estimators는 어파인 모델(affine model)의 파라미터 측정에 있어 최적의 방법으로 잘 알려져 있다. 그러나 M-estimators는 통계적인 효율성이 높지만 초기화가 적절히 수행되지 않으면 오류 자료를 제거하는 데 문제점을 가진다 따라서 본 논문에서는 이런 문제점을 해결하기 위해 연속적인 시그모이드(sigmoid) 가중치 함수를 사용하여 오류 자료와 정상 자료를 효과적으로 분리하면서 어파인 모델의 파라미터를 효과적으로 측정하는 적응적인 M-estimators 강건 예측 알고리즘을 제안한다. 실험에서는 기존의 강건 예측 방법과 제안된 적응적 강건 예측 방법의 성능을 비교 및 분석하여 제안된 방법의 우수함을 보인다.

  • PDF