• Title/Summary/Keyword: Video matching

Search Result 445, Processing Time 0.105 seconds

VLSI Design for Motion Estimation Based on Bit-plane Matching (비트 플레인 정합에 의한 움직임 추정기의 VLSI 설계)

  • Go, Yeong-Gi;O, Hyeong-Cheol;Go, Seong-Je
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.38 no.5
    • /
    • pp.509-517
    • /
    • 2001
  • Full-search algorithm requires large amount of computation which causes time delay or very complex hardware architecture for real time implementation. In this paper, we propose a fast motion estimator based on bit-plane matching, which reduce the computational complexity and the hardware cost. In the proposed motion estimator, the conventional motion estimation algorithms are applied to the binary images directly extracted from the video sequence. Furthermore, in the proposed VLSI motion estimator, we employ a Pair of processing cores that calculate the motion vector continuously By controlling the data flow in a systolic fashion using the internal shift registers in the processing cores, we avoid using SRAM (local memory) so that we remove the time overhead for accessing the local memory and adopt lower-cost fabrication technology. We modeled and tested the proposed motion estimator in VHDL, and then synthesized the whole system which has been integrated in a 0.6-$\mu$m triple-metal CMOS chip of size 8.15 X 10.84$\textrm{mm}^2$.

  • PDF

The Design of Repeated Motion on Adaptive Block Matching Algorithm in Real-Time Image (실시간 영상에서 반복적인 움직임에 적응한 블록정합 알고리즘 설계)

  • Kim Jang-Hyung;Kang Jin-Suk
    • Journal of Korea Multimedia Society
    • /
    • v.8 no.3
    • /
    • pp.345-354
    • /
    • 2005
  • Since motion estimation and motion compensation methods remove the redundant data to employ the temporal redundancy in images, it plays an important role in digital video compression. Because of its high computational complexity, however, it is difficult to apply to high-resolution applications in real time environments. If we have a priori knowledge about the motion of an image block before the motion estimation, the location of a better starting point for the search of an exact motion vector can be determined to expedite the searching process. In this paper presents the motion detection algorithm that can run robustly about recusive motion. The motion detection compares and analyzes two frames each other, motion of whether happened judge. Through experiments, we show significant improvements in the reduction of the computational time in terms of the number of search steps without much quality degradation in the predicted image.

  • PDF

Fast Disparity Estimation Method Considering Temporal and Spatial Redundancy Based on a Dynamic Programming (시.공간 중복성을 고려한 다이내믹 프로그래밍 기반의 고속 변이 추정 기법)

  • Yun, Jung-Hwan;Bae, Byung-Kyu;Park, Se-Hwan;Song, Hyok;Kim, Dong-Wook;Yoo, Ji-Sang
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.33 no.10C
    • /
    • pp.787-797
    • /
    • 2008
  • In this paper, we propose a fast disparity estimation method considering temporal and spatial redundancy based on a dynamic programming for stereo matching. For the first step, the dynamic programming is performed to estimate disparity vectors with correlation between neighboring pixels in an image. Next, we efficiently compensate regions, which disparity vectors are not allocated, with neighboring disparity vectors assuming that disparity vectors in same object are quite similar. Moreover, in case of video sequence, we can decrease a complexity with temporal redundancy between neighboring frames. For performance comparison, we generate an intermediate-view image using the estimated disparity vector. Test results show that the proposed algorithm gives $0.8{\sim}2.4dB$-increased PSNR(peak signal to noise ratio) compared to a conventional block matching algorithm, and the proposed algorithm also gives approximately 0.1dB-increased PSNR and $48{\sim}68%$-lower complexity compared to the disparity estimation method based on general dynamic programming.

Fast Motion Estimation Algorithm via Minimum Error for Each Step (단계별 최소에러를 통한 고속 움직임 예측 알고리즘)

  • Kim, Jong Nam
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.8
    • /
    • pp.1531-1536
    • /
    • 2016
  • In this paper, we propose a fast motion estimation algorithm which is important in performance of video encoding. Even though so many fast algorithms for motion estimation have been published due to its tremendous computational amount of for full search algorithm, efforts for reducing computations in motion estimation still remain. In the paper, we propose an algorithm that reduces unnecessary computations only, while keeping prediction quality the same as that of the full search. The proposed algorithm does not calculate block matching error for each candidate at once to find motion vectors but divides the calculation procedure into several steps and calculates partial sum of block errors. By doing that, we can estimate the minimum error point early and get the enhancement of calculation speed by reducing unnecessary computations. The proposed algorithm uses smaller computations than conventional fast search algorithms with the same prediction quality as full search.

Block-based Reliability Evaluation Method for FRUC Techniques Using Bi-lateral Symmetrical Motion Estimation (양방향 대칭형 탐색에 기초한 FRUC기법을 위한 블록기반 신뢰성 평가 방법)

  • Park, Se-jeong;Kim, Jin-soo
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2012.10a
    • /
    • pp.867-869
    • /
    • 2012
  • FRUC(Frame Rate Up Conversion) is core techniques for higher quality terminals or low channel rate. For these applications, in this paper, we propose a block-based reliability evaluation method for FRUC techniques using bi-lateral symmetrical motion estimation. First, in order to measure the reliability, by introducing cost evaluation tools such as motion vector consistency as well as temporal matching and spatial matching characteristics and then by combining these tools, we propose an efficient method which arrange the blocks according to distortion size. Through several simulations, it is shown that the proposed method is very effective in finding the high distortion blocks. Furthermore, it is expected that the proposed method can be effectively utilized in FRUC techniques and Distributed Video Coding technologies.

  • PDF

Error Concealment Using Gradient Vectors in H.264 Decoder (H.264 디코더에서 기울기 벡터를 이용한 에러복원 방법)

  • Jeon Sung-Hoon;Yoo Jae-Myeong;Lee Guee-Sang
    • The KIPS Transactions:PartB
    • /
    • v.13B no.3 s.106
    • /
    • pp.197-204
    • /
    • 2006
  • Recent advances in information technology have resulted in rapid growth in the mobile communication. With this explosive growth, reliable transmission and error concealment technique become increasingly important to offer high quality multimedia services. In this paper, we propose an improved BMA(Boundary Matching Algorithm) method using gradient vectors to conceal channel errors in inter-frames of H.264 video images. General BMA method computes the sum of pixel differences of adjacent pixels of the candidate block and its neighbouring blocks, assuming that adjacent pixels have almost the same value. In real images, however, there exist some gradients, which means that the pixel values are increasing or decreasing in a specific direction. In this paper, we develop a precise estimation method of errors in candidates blocks using gradient information and try to recover lost blocks with this technique. Experimental results show the improvement of picture quality about $1{\sim}3dB$ compared to existing methods.

Fast Motion Estimation Algorithms Through Adaptive Application of the Hadamard Transform (하다마드 변환의 적응적 적용을 이용한 고속 움직임 예측 알고리즘)

  • Lee, Hyuk;Kim, Jong-Ho;Jin, Soon-Jong;Jeong, Je-Chang
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.32 no.8C
    • /
    • pp.712-719
    • /
    • 2007
  • In this paper, we propose a new, effective, fast motion estimation algorithms using $4{\times}4$ pixels Hadamard transform. The Hadamard transform has the advantage of simplicity because it uses only addition and subtraction. Motion estimation is composed of three stages. First, it should be decided whether to terminate the search early and use a previous motion vector with DC(Direct Current) coefficients. Then the adaptive matching scan order for motion estimation should be determined according to the image complexity using AC(Alternating Current) coefficients. Experimentally, we adapted this algorithms to MVFAST and PMVFAST algorithms, and the proposed algorithms turn out to be very efficient in terms of computational speed while remaining almost the same in terms of PSNR(Peak Signal-to-Noise Ratio) compared to MVFAST and PMVFAST algorithms.

Confidence Map based Multi-view Image Generation Method from Stereoscopic Images (양안식 영상을 이용한 신뢰도 기반의 다시점 영상 생성 방법)

  • Kim, Do Young;Ho, Yo-Sung
    • Smart Media Journal
    • /
    • v.2 no.4
    • /
    • pp.27-33
    • /
    • 2013
  • Multi-view video system provides both realistic 3D feelings and free-view navigation. But it is hard to transmit too huge data, so we send only two or three view images and generate intermediate view image using depth information. In this paper, we propose high quality multi-view image generation method from stereoscopic images. Since the stereo matching method does not provide accurate disparity values for all the pixels, especially at the occlusion area, we propose an occlusion handling method using the background pixels at first. We also apply a joint bilateral filtering to enhance the disparity map at the object boundary since it can affect the quality of synthesized images significantly. Finally, we can generate virtual view images at intermediate view positions using confidence map to reduce bad pixel and hole's error. Experimental results show the proposed method performs better than the conventional method.

  • PDF

An Adaptive Block Matching Algorithm Based on Temporal Correlations (시간적 상관성을 이용한 적응적 블록 정합 알고리즘)

  • Yoon, Hyo-Sun;Lee, Guee-Sang
    • The KIPS Transactions:PartB
    • /
    • v.9B no.2
    • /
    • pp.199-204
    • /
    • 2002
  • Since motion estimation and motion compensation methods remove the redundant data to employ the temporal redundancy in images, it plays an important role in digital video compression. Because of its high computational complexity, however, it is difficult to apply to high-resolution applications in real time environments. If we have information about the motion of an image block before the motion estimation, the location of a better starting point for the search of an exact motion vector can be determined to expedite the searching process. In this paper, we present an adaptive motion estimation approach bated on temporal correlations of consecutive image frames that defines the search pattern and determines the location of the initial search point adaptively. Through experiments, compared with DS(Diamond Search) algorithm, the proposed algorithm is about 0.1∼0.5(dB) better than DS in terms of PSNR(Peak Signal to Noise Ratio) and improves as high as 50% compared with DS in terms of average number of search point per motion vector estimation.

Estimation of Drone Velocity with Sum of Absolute Difference between Multiple Frames (다중 프레임의 SAD를 이용한 드론 속도 측정)

  • Nam, Donho;Yeom, Seokwon
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.20 no.3
    • /
    • pp.171-176
    • /
    • 2019
  • Drones are highly utilized because they can efficiently acquire long-distance videos. In drone operation, the speed, which is the magnitude of the velocity, can be set, but the moving direction cannot be set, so accurate information about the drone's movement should be estimated. In this paper, we estimate the velocity of the drone moving at a constant speed and direction. In order to estimate the drone's velocity, the displacement of the target frame to minimize the sum of absolute difference (SAD) of the reference frame and the target frame is obtained. The ground truth of the drone's velocity is calculated using the position of a certain matching point over all frames. In the experiments, a video was obtained from the drone moving at a constant speed at a height of 150 meters. The root mean squared error (RMSE) of the estimated velocities in x and y directions and the RMSE of the speed were obtained showing the reliability of the proposed method.