• Title/Summary/Keyword: Disparity estimation

Search Result 171, Processing Time 0.023 seconds

Stereo Object Tracking System using Multiview Image Reconstruction Scheme (다시점 영상복원 기법을 이용한 스테레오 물체추적 시스템)

  • Ko, Jung-Hwan;Ohm, Woo-Young
    • 전자공학회논문지 IE
    • /
    • v.43 no.2
    • /
    • pp.54-62
    • /
    • 2006
  • In this paper, a new stereo object tracking system using the disparity motion vector is proposed. In the proposed method, the time-sequential disparity motion vector can be estimated from the disparity vectors which are extracted from the sequence of the stereo input image pair and then using these disparity motion vectors, the area where the target object is located and its location coordinate are detected from the input stereo image. Basing on this location data of the target object, the pan/tilt embedded in the stereo camera system can be controlled and as a result, stereo tracking of the target object can be possible. From some experiments with the 2 frames of the stereo image pairs having $256\times256$ pixels, it is shown that the proposed stereo tracking system can adaptively track the target object with a low error ratio of about 3.05 % on average between the detected and actual location coordinates of the target object.

Adaptively Compensated-Disparity Prediction Scheme for Stereo Image Compression and Reconstruction (스테레오 영상 압축 및 복원을 위한 적응적 변이보상 예측기법)

  • 배경훈;김은수
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.27 no.7A
    • /
    • pp.676-682
    • /
    • 2002
  • In this paper, an effective stereo image compression and reconstruction technique using a new adaptively compensated-disparity prediction scheme is proposed. That is, by adaptively predicting the mutual correlation between the stereo image using the proposed method, the bandwidth of the stereo input image can be compressed to the level of the conventional 2D image and the predicted image also can be effectively reconstructed using this transmitted reference image and disparity data in the receiver. Especially, in the proposed method, once the feature values are extracted from the input stereo image, then the matching window size for the predicted image reconstruction is adaptively selected in accordance with the magnitude of this feature values. From this adaptive disparity estimation method, reduction of the mismatching probability of the disparity vectors is expected and as a result, the image quality in the reconstructed image can be improved. In addition, from some experiments using the CCETT's stereo images of 'Fichier', 'Manege' and 'Tunnel', it is shown that the proposed method improves the PSNR of the reconstructed image to about 9.08 dB on average by comparing with that of the conventional methods. And also, it is found that there is almost no difference between the original image and the predicted image reconstructed through the proposed method by comparison to that of the conventional methods.

A Study on Estimation of Regularizing Parameters for Energy-Based Stereo Matching (에너지 기반 스테레오 매칭에서의 정합 파라미터 추정에 관한 연구)

  • Hahn, Hee-Il;Ryu, Dae-Hyun
    • Journal of Korea Multimedia Society
    • /
    • v.14 no.2
    • /
    • pp.288-294
    • /
    • 2011
  • In this paper we define the probability models for determining the disparity map given stereo images and derive the methods for solving the problem, which is proven to be equivalent to an energy-based stereo matching. Under the assumptions the difference between the pixel on the left image and the corresponding pixel on the right image and the difference between the disparities of the neighboring pixels are exponentially distributed, a recursive approach for estimating the MRF regularizing parameter is proposed. The proposed method alternates between estimating the parameters with the intermediate disparity map and estimating the disparity map with the estimated parameters, after computing it with random initial parameters. Our algorithm is applied to the stereo matching algorithms based on the dynamic programming and belief propagation to verify its operation and measure its performance.

Edge-Preserving Directional Regularization Technique for Disparity Estimation and Intermediate View Reconstruction of Stereoscopic Images (경계-보존 방향성 평활화를 이용한 양안 영상의 변이 추정과 중간 시점 영상의 재구성)

  • 김미현;강문기;이철희;최윤식;손광훈
    • Journal of Broadcast Engineering
    • /
    • v.4 no.1
    • /
    • pp.59-67
    • /
    • 1999
  • In this paper, we study two important topics in stereoscopic image communication system. One is a disparity estimation (DE) method to obtain the depth information of a scene at the transmitter and the other is an intermediate view reconstruction(IVR) method at the receiver. We propose a new DE method using an edge-preserving directional regularization technique. The proposed DE method smooths disparity vectors in smooth regions and preserves edges without over-smoothing problem. It provides better reconstructed stereoscopic images and improved coding efficiency than the existing regularization techniques. In addition. we propose a new IVR method using interpolation and extrapolation techniques. The proposed IVR method preserves edge regions as well as occlusion regions well. Thus. it gives better intermediate views than the existing IVR methods.

  • PDF

A hardware architecture based on the NCC algorithm for fast disparity estimation in 3D shape measurement systems (고밀도 3D 형상 계측 시스템에서의 고속 시차 추정을 위한 NCC 알고리즘 기반 하드웨어 구조)

  • Bae, Kyeong-Ryeol;Kwon, Soon;Lee, Yong-Hwan;Lee, Jong-Hun;Moon, Byung-In
    • Journal of Sensor Science and Technology
    • /
    • v.19 no.2
    • /
    • pp.99-111
    • /
    • 2010
  • This paper proposes an efficient hardware architecture to estimate disparities between 2D images for generating 3D depth images in a stereo vision system. Stereo matching methods are classified into global and local methods. The local matching method uses the cost functions based on pixel windows such as SAD(sum of absolute difference), SSD(sum of squared difference) and NCC(normalized cross correlation). The NCC-based cost function is less susceptible to differences in noise and lighting condition between left and right images than the subtraction-based functions such as SAD and SSD, and for this reason, the NCC is preferred to the other functions. However, software-based implementations are not adequate for the NCC-based real-time stereo matching, due to its numerous complex operations. Therefore, we propose a fast pipelined hardware architecture suitable for real-time operations of the NCC function. By adopting a block-based box-filtering scheme to perform NCC operations in parallel, the proposed architecture improves processing speed compared with the previous researches. In this architecture, it takes almost the same number of cycles to process all the pixels, irrespective of the window size. Also, the simulation results show that its disparity estimation has low error rate.

Virtual View Rendering for 2D/3D Freeview Video Generation (2차원/3차원 자유시점 비디오 재생을 위한 가상시점 합성시스템)

  • Min, Dong-Bo;Sohn, Kwang-Hoon
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.45 no.4
    • /
    • pp.22-31
    • /
    • 2008
  • In this paper, we propose a new approach for efficient multiview stereo matching and virtual view generation, which are key technologies for 3DTV. We propose semi N-view & N-depth framework to estimate disparity maps efficiently and correctly. This framework reduces the redundancy on disparity estimation by using the information of neighboring views. The proposed method provides a user 2D/3D freeview video, and the user can select 2D/3D modes of freeview video. Experimental results show that the proposed method yields the accurate disparity maps and the synthesized novel view is satisfactory enough to provide user seamless freeview videos.

Stereoscopic Sequence Coding Using MPEG-2 MVP (MPEG-2 UP를 이용한 스테레오 동영상부호화)

  • Bae, Tae-Min;Park, Jin-U;Lee, Ho-Geun;Ha, Yeong-Ho
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.38 no.4
    • /
    • pp.353-361
    • /
    • 2001
  • A new stereoscopic codec. structure using MPEG-2 multiview profile is presented in this paper. In the suggested codec., the left image is coded with motion estimation in the base layer and the right image is coded with disparity estimation in the enhancement layer. Since it is possible to calculate rough motion of the right image sequence with disparity and motion of the left image sequence, motion compensation of the enhancement layer is performed without motion estimation. To apply this mathod to MVP codec., the prediction mode of base layer and enhancement layer is restricted, and B picture mode in the base layer is removed. Since the proposed codec. does not perform motion estimation in the enhancement layer encoding and prediction mode of base layer is restricted, it's structure is simple and reduces the encoding time. We compared the SNR of encoded image with three different structured codec., and the experimental results show suggested codec. have comparable result.

  • PDF

Detection of View Reversal in a Stereo Video

  • Son, Ji Deok;Song, Byung Cheol
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.2 no.5
    • /
    • pp.317-321
    • /
    • 2013
  • This paper proposes a detection algorithm for view reversal in a stereoscopic video using a disparity map and motion vector field. We obtain the disparity map of a stereo image was obtained using a specific stereo matching algorithm and classify the image into the foreground and background. Next, the motion vector field of the image on a block basis was produced using a full search algorithm. Finally, the stereo image was considered to be reversed when the foreground moved toward the background and the covered region was in the foreground. The proposed algorithm achieved a good detection rate when the background was covered sufficiently by its moving foreground.

  • PDF

DEM Estimation Using Two Stage Stereo Matching Method (2단계 스테레오 정합기법을 이용한 DEM 추정)

  • Nam, Chang-Woo;Woo, Dong-Min
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.49 no.12
    • /
    • pp.659-666
    • /
    • 2000
  • A stereo matching has been an important tool for reconstructing three dimensional terrain. By using stereo matching technique, DEM(Digital Elevaton Map) can be generated by the disparity from a reference image to a target image. Generally disparity map can be evaluated by matching the reference image to the target image and if the role of the reference and the target are interchanged, a different DEM can be obtained. In this paper, we propose a new fusion technique to estimate the optimal DEM by eliminating the false DEM due to occlusion. To detect the false DEM, we utilize two measure of accuracy: self-consistency and cross-correlation score. We test the effectiveness of the proposed methods with a quantitative analysis using simulated images. Experimental result indicate that the proposed methods show 24.4% and 33.1% improvement over either DEM.

  • PDF