• Title/Summary/Keyword: disparity map

Search Result 207, Processing Time 0.025 seconds

Improved Disparity Map Computation on Stereoscopic Streaming Video with Multi-core Parallel Implementation

  • Kim, Cheong Ghil;Choi, Yong Soo
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.2
    • /
    • pp.728-741
    • /
    • 2015
  • Stereo vision has become an important technical issue in the field of 3D imaging, machine vision, robotics, image analysis, and so on. The depth map extraction from stereo video is a key technology of stereoscopic 3D video requiring stereo correspondence algorithms. This is the matching process of the similarity measure for each disparity value, followed by an aggregation and optimization step. Since it requires a lot of computational power, there are significant speed-performance advantages when exploiting parallel processing available on processors. In this situation, multi-core CPU may allow many parallel programming technologies to be realized in users computing devices. This paper proposes parallel implementations for calculating disparity map using a shared memory programming and exploiting the streaming SIMD extension technology. By doing so, we can take advantage both of the hardware and software features of multi-core processor. For the performance evaluation, we implemented a parallel SAD algorithm with OpenMP and SSE2. Their processing speeds are compared with non parallel version on stereoscopic streaming video. The experimental results show that both technologies have a significant effect on the performance and achieve great improvements on processing speed.

A New EDGE-BASED Stereo Correspondence Method for Snake-Based Object Segmentation (스네이크 기반 객체 추출을 위한 새로운 에지 기반 스테레오 일치화 방법)

  • Park, Min-Gyu;Alattar, Ashraf;Jang, Jong-Whan
    • The KIPS Transactions:PartB
    • /
    • v.15B no.4
    • /
    • pp.269-274
    • /
    • 2008
  • In this paper, we propose a new stereo correspondence method for generating excellent external energy for snake-based object segmentation methods in stereo images. Our method first generates an edge-based disparity map by performing stereo correspondence between multi-level edge maps of the stereo image pair. Only edges of similar strength are considered for matching. To filter the disparity map for edges of the object of interest, the method estimates the object's disparity value by matching the pattern of edges of the region of interest in the left image against candidate patterns in the right image. The filtered edge map is then used to generate external energy for the snake. The proposed method has been tested on two snake models and results show a noticeable enhancement on performance of the snake when compared with other methods.

Computation of Stereo Dense Disparity Maps Using Region Segmentation (영상에서의 분할정보를 사용한 스테레오 조밀 시차맵 생성)

  • Lee, Bum-Jong;Park, Jong-Seung;Kim, Chung-Kyue
    • The KIPS Transactions:PartB
    • /
    • v.15B no.6
    • /
    • pp.517-526
    • /
    • 2008
  • Stereo vision is a fundamental method for measuring 3D structures by observing them from two cameras placed on different positions. In order to reconstruct 3D structures, it is necessary to create a disparity map from a pair of stereo images. To create a disparity map we compute the matching cost for each point correspondence and compute the disparity that minimizes the sum of the whole matching costs. In this paper, we propose a method to estimate a dense disparity map using region segmentation. We segment each scanline using region homogeneity properties. Using the segmented regions, we prohibit false matches in the stereo matching process. Disparities for pixels that failed in matching are filled by interpolating neighborhood disparities. We applied the proposed method to various stereo images of real environments. Experimental results showed that the proposed method is stable and potentially viable in practical applications.

A stereo matching algorithm in pixel-based disparity space image (화소기반 변이공간영상에서의 스테레오 정합)

  • 김철환;이호근;하영호
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.6C
    • /
    • pp.848-856
    • /
    • 2004
  • In this paper, a fast stereo matching algorithm based on pixel-wise matching strategy, which can get a stable and accurate disparity map, is proposed. Since a stereo image pair has small differences each other and the differences between left and right images are just caused by horizontal shifts with some order, the matching using a large window will not be needed within a given search range. However, disparity results of conventional pixel-based matching methods are somewhat unstable and wrinkled, the principal direction of disparities is checked by the accumulated cost along a path on array with the dynamic programming method. Experimental results showed that the proposed method could remove almost all disparity noise and set a good quality disparity map in very short time.

Image Disparity Estimation through Type-based Stereo Matching (유형기반 스테레오 정합을 통한 영상변이 측정)

  • Kim Gye-Young;Jang Seok-Woo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.11 no.2 s.40
    • /
    • pp.83-92
    • /
    • 2006
  • This paper describes an image disparity estimation method using region-based stereo matching. Region-based disparity estimation yields a disparity map as the unit of segmented region. However it estimates disparity imprecisely because it not only has matching errors but also applies an identical way to disparity estimation, which does not consider each type of matched regions. To solve this problem, we proposes a disparity estimation method which considers the type of matched regions. That is, the proposed method classifies whole matched regions into a similar-matched region, a dissimilar-matched region, a false-matched region and a miss-matched region. We then performs proper disparity estimation for each type of matched regions. This method minimizes the error in estimating disparity which is caused by inaccurate matching and also improves the accuracy of disparity of the well-matched regions. The experimental results show the improved accuracy of the proposed method.

  • PDF

Stereo Disparity Estimation by Analyzing the Type of Matched Regions (정합영역의 유형분석에 의한 스테레오 변이 추정)

  • Kim Sung-Hun;Lee Joong-Jae;Kim Gye-Young;Choi Hyung-Il
    • Journal of KIISE:Software and Applications
    • /
    • v.33 no.1
    • /
    • pp.69-83
    • /
    • 2006
  • This paper describes an image disparity estimation method using a segmented-region based stereo matching. Segmented-region based disparity estimation yields a disparity map as the unit of segmented region. However, there is a problem that it estimates disparity imprecisely. The reason is that because it not only have matching errors but also apply an identical way to disparity estimation, which is not considered each type of matched regions. To solve this problem, we proposes a disparity estimation method which is considered the type of matched regions. That is, the proposed method classifies whole matched regions into similar-matched region, dissimilar-matched region, false-matched region and miss-matched region by analyzing the type of matched regions. We then performs proper disparity estimation for each type of matched regions. This method minimizes the error in estimating disparity which is caused by inaccurate matching and also improves the accuracy of disparity of the well-matched regions. For the purpose of performance evaluations, we perform tests on a variety of scenes for synthetic, indoor and outdoor images. As a result of tests, we can obtain a dense disparity map which has the improved accuracy. The remarkable result is that the accuracy of disparity is also improved considerably for complex outdoor images which are barely treatable in the previous methods.

Local Stereo Matching Method based on Improved Matching Cost and Disparity Map Adjustment (개선된 정합 비용 및 시차 지도 재생성 기반 지역적 스테레오 정합 기법)

  • Kang, Hyun Ryun;Yun, In Yong;Kim, Joong Kyu
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.54 no.5
    • /
    • pp.65-73
    • /
    • 2017
  • In this paper, we propose a stereo matching method to improve the image quality at the hole and the disparity discontinuity regions. The stereo matching method extracts disparity map finding corresponding points between stereo image pair. However conventional stereo matching methods have a problem about the tradeoff between accuracy and precision with respect to the length of the baseline of the stereo image pair. In addition, there are hole and disparity discontinuity regions which are caused by textureless regions and occlusion regions of the stereo image pair. The proposed method extracts initial disparity map improved at disparity discontinuity and miss-matched regions using modified AD-Census-Gradient method and adaptive weighted cost aggregation. And then we conduct the disparity map refinement to improve at miss-matched regions, while also improving the accuracy of the image. Experimental results demonstrate that the proposed method produces high-quality disparity maps by successfully improving miss-matching regions and accuracy while maintaining matching performance compared to existing methods which produce disparity maps with high matching performance. And the matching performance is increased about 3.22(%) compared to latest stereo matching methods in case of test images which have high error ratio.

Real-time Virtual View Synthesis using Virtual Viewpoint Disparity Estimation and Convergence Check (가상 변이맵 탐색과 수렴 조건 판단을 이용한 실시간 가상시점 생성 방법)

  • Shin, In-Yong;Ho, Yo-Sung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.1A
    • /
    • pp.57-63
    • /
    • 2012
  • In this paper, we propose a real-time view interpolation method using virtual viewpoint disparity estimation and convergence check. For the real-time process, we estimate a disparity map at the virtual viewpoint from stereo images using the belief propagation method. This method needs only one disparity map, compared to the conventional methods that need two disparity maps. In the view synthesis part, we warp pixels from the reference images to the virtual viewpoint image using the disparity map at the virtual viewpoint. For real-time acceleration, we utilize a high speed GPU parallel programming, called CUDA. As a result, we can interpolate virtual viewpoint images in real-time.

Effective Route Decision of an Automatic Moving Robot(AMR) using a 2D Spatial Map of the Stereo Camera System

  • Lee, Jae-Soo;Han, Kwang-Sik;Ko, Jung-Hwan
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.20 no.9
    • /
    • pp.45-53
    • /
    • 2006
  • This paper proposes a method for an effective intelligent route decision for automatic moving robots(AMR) using a 2D spatial map of a stereo camera system. In this method, information about depth and disparity map are detected in the inputting images of a parallel stereo camera. The distance between the automatic moving robot and the obstacle is detected, and a 2D spatial map is obtained from the location coordinates. Then the relative distances between the obstacle and other objects are deduced. The robot move automatically by effective and intelligent route decision using the obtained 2D spatial map. From experiments on robot driving with 240 frames of stereo images, it was found that the error ratio of the calculated distance to the measured distance between objects was very low, 1.52[%] on average.

Smart AGV system using the 2D spatial map

  • Ko, Junghwan;Lee, Jong-Yong
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.8 no.4
    • /
    • pp.54-57
    • /
    • 2016
  • In this paper, the method for an effective and intelligent route decision of the automatic ground vehicle (AGV) using a 2D spatial map of the stereo camera system is proposed. The depth information and disparity map are detected in the inputting images of a parallel stereo camera. The distance between the automatic moving robot and the obstacle detected and the 2D spatial map obtained from the location coordinates, and then the relative distance between the obstacle and the other objects obtained from them. The AGV moves automatically by effective and intelligent route decision using the obtained 2D spatial map. From some experiments on robot driving with 480 frames of the stereo images, it is analyzed that error ratio between the calculated and measured values of the distance between the objects is found to be very low value of 1.57% on average, respectably.