• Journal of Korea Multimedia Society
• /
• v.17 no.2
• /
• pp.132-142
• /
• 2014

Stereo camera is drawing attention as an essential sensor for future intelligence robot system since it has the advantage of acquiring not only distance but also other additive information for an object. However, it cannot match correlated point on target image for low textured region or periodic patterned region such as wall of building or room. In this paper, we propose a stereo matching technique that increase the matching performance by fusing belief propagation stereo matching algorithm and local distance measurements of 2D-laser range finder in order to overcome this kind of limitation. The proposed technique adds laser measurements by referring quad-tree based segment information on to the local-evidence of belief propagation stereo matching algorithm, and calculates compatibility function by reflecting over-segmented information. Experimental results of the proposed method using simulation and real test images show that the distance information for some low textured region can be acquired and the discontinuity of depth information is preserved by using segmentation information.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.8C
• /
• pp.680-688
• /
• 2010

In this paper, we present a dynamic programming(DP)-based stereo matching method using image segmentation algorithm. DP has been a classical and popular optimization method for various computer vision problems including stereo matching. However, the performance of conventional DP has not been satisfactory when it is applied to the stereo matching since the vertical correlation between scanned lines has not been properly considered. In the proposed algorithm, accurate edge information is first obtained from segmented image information then we considers the discontinuity of disparity and occlusions region based on the obtained edge information. The experimental results applied to the Middlebury stereo images demonstrate that the proposed algorithm has better performances in stereo matching than the previous DP based algorithms.

• Journal of Institute of Control, Robotics and Systems
• /
• v.7 no.9
• /
• pp.758-765
• /
• 2001

This paper proposes a method to automatically extract stable visual landmarks from sensory data. Given a 2D occupancy map, a mobile robot first extracts vertical line features which are distinct and on vertical planar surfaces, because they are expected to be observed reliably from various viewpoints. Since the feature information such as position and length includes uncertainty due to errors of vision and motion, the robot then reduces the uncertainty by matching the planar surface containing the features to the map. As a result, the robot obtains modeled stable visual landmarks from extracted features. This extraction process is performed on-line to adapt to an actual changes of lighting and scene depending on the robot’s view. Experimental results in various real scenes show the validity of the proposed method.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2012.07a
• /
• pp.83-86
• /
• 2012

본 논문에서는 다양한 변이 추정 방식 중 영역기반(Area-based) 알고리듬과 특정기반(Feature-based) 알고리듬을 결합한 하이브리드(Hybrid) 변이추정 알고리듬을 제안한다. 제안하는 알고리듬은 Features from Accelerated Segment Test(FAST) 코너 점 추출기[2]를 이용하여 좌, 우 영상 각각의 특징 점을 추출한 후, 특징 점들의 정보를 이용한 스테레오 정함을 통해 신뢰도 높은 초기 변이지도(Disparity map)를 생생하게 된다. 그러나 생성된 초기 변이지도는 조밀하지 못하므로, 조밀한 변이 지도를 획득하기 위해 특징점이 추출된 영역에 대해서는 추정된 초기 변이 값을 이웃 픽셀과의 색 유사도를 고려하여 전파시키고 특징 점이 추출되지 않은 영역에 대해서는 이진 윈도우(Binary window)를 활용한 영역기반 변이추정 알고리듬[1]을 이용하여 변이 값을 추정한다. 이를 통해, 제안 알고리듬은 특징 기반 알고리듬에서 발생할 수 있는 보간법 문제를 해결함과 동시에 신뢰도가 높은 초기 변이지도를 사용함으로써, 영역 기반 알고리듬의 정합 오차를 줄여 신뢰도 높은 변이지도를 생생할 수 있다. 실험 결과 추정된 초기 변이지도는 ground truth와 비교 시 약 99%이상의 정확도를 보이며, 특징 점이 추출된 영역에서 기존의 영역기반 알고리듬보다 더 정확한 변이 값이 추정되었음을 확인하였다.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.25 no.10B
• /
• pp.1821-1831
• /
• 2000

In this paper we propose a new adaptive stereo object tracking system that can extract the object from the complex background and foreground noises by using the image-based SAD algorithm and control the convergence angle and pan/tilt of cameras by using optical BPEJTC. From the experimental results the proposed stereo tracking system is found to track the object adpatively under the circumstance of complex and changing background noises and the possibility of real-time implementation of the proposed system by using the optical system is also suggested.

• The KIPS Transactions:PartB
• /
• v.12B no.4 s.100
• /
• pp.429-436
• /
• 2005

A simple stereo matching algorithm using population-based incremental learning(PBIL) is proposed in this paper to decrease the general problem of genetic algorithms, such as memory consumption and inefficiency of search. PBIL is a variation of genetic algorithms using stochastic search and competitive teaming based on a probability vector. The structure of PBIL is simpler than that of other genetic algorithm families, such as serial and parallel ones, due to the use of a probability vector. The PBIL strategy is simplified and adapted for stereo matching circumstances. Thus, gene pool, chromosome crossover, and gene mutation we removed, while the evolution rule, that fitter chromosomes should have higher survival probabilities, is preserved. As a result, memory space is decreased, matching rules are simplified and computation cost is reduced. In addition, a scheme controlling the distance of neighbors for disparity smoothness is inserted to obtain a wide-area consistency of disparities, like a result of coarse-to-fine matchers. Because of this scheme, the proposed algorithm can produce a stable disparity map with a small fixed-size window. Finally, an alterative version of the proposed algorithm without using probability vector is also presented for simpler set-ups.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.14 no.5
• /
• pp.1217-1230
• /
• 2010

The dynamic programming based methods, a kind of globally optimizing stereo matching methods, has the inherent advantage that the occlusion regions can be found during the process. But it also has a serious drawback of streaking phenomena. This paper focuses on reducing the streaking phenomena by adjusting the penalties in calculating the cost matrix and re-establishing the optimal path in the back-tracing process using the boundary information of the image. Especially we use a pixel expansion method in re-establishing the path, which is the results from expanding the pixel information of the ones just left the boundaries. Experiments with the four image pairs provided by the Middlebury site showed the results that the proposed method has the disparity error ratio of 6.33% and the rank is 29, which is competitive to the best method among the previously published dynamic programming based methods.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.11a
• /
• pp.269-272
• /
• 2009

본 논문에서는 변이지도의 정확도 향상을 위하여, 비용 함수를 이용한 교차 일치성 검사 기법을 제안하고, 다양한 조건의 실험을 통하여 제안한 알고리듬이 효율적임을 보였다. 좌우 변이정보를 이용하는 교차 일치성 검사로 오정합을 검출하는 방법을 시도해왔다. 하지만 이러한 방법은 물체의 경계에서 발생하는 오정합을 찾기가 어렵다. 본 논문에서는 최종 변이의 신뢰도 향상을 위해 교차 일치성 검사의 정확도를 높이는 방법을 제안하였다. 일반적으로 영역 기반 스테레오정합 방법은 물체의 경계에서 정확도 높지 못하다. 이러한 문제점을 해결하기 위해 정합창의 크기를 늘리거나 특징 점을 이용한 적응적 가변 정합창을 적용하는 방법을 시도하였다. 하지만, 여전히 기존 교차 일치성 검사를 통한 오정합 검출은 부정확하다. 이러한 영역의 비용 함수 값들을 비교한 결과 첫 번째와 두 번째 값의 차이가 적거나 크게 나타난다. 제안한 방법은 기존 방법에 비해 오정합 검출 능력을 향상 시킨다. 제안한 방법의 결과를 확인하기 위해 스테레오 비전에서 많이 사용되는 영상을 적용하고 분석하였다. 또한, 기존 교차 일치성 검사 방법과 제안한 방법의 객관적으로 비교하기 위해 전체 영역에 대한 오차율 (error ratio)과 교차 일치성 검사로 유효하다고 판단된 변이 값 중 실제 변이 값과 일치하지 않은 변이값의 오차율을 비교하였다. 실험 결과 기존 방법에 비해 제안한 방법이 1~5%정도 낮은 오차율을 보였다

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.47 no.6
• /
• pp.82-90
• /
• 2010

In this paper, A new stereo matching method based on reliability space is proposed to acquire 3D information from 2D image. In conventional stereo matching methods, speed is sacrificed to achieve high accuracy. To increase the matching speed while maintaining a high accuracy, this paper proposes this stereo matching method. It first makes the disparity space image for comparing all of the pixels on the stereo images. Then it produce reliability space through analyzing this value. and, By comparing the reliability space according to disparity, it makes disparity map. Moreover, the parts that make regional boundary errors are corrected by classifying the boundary of each region with the reference to color edge. The performance of the proposed stereo matching method is verified by various experiments. As a result, calculation cost is reduced by 30.6%, while the image quality of proposed method has similar performance with the existing method.

• Transactions of the Korean Society of Automotive Engineers
• /
• v.11 no.1
• /
• pp.201-210
• /
• 2003

In this paper, we propose a new binocular stereo correspondence method by maximizing a fitness formulated by integrating two constraints of edge similarity and disparity smoothness simultaneously. The proposed stereopsis focusing to measure distances to leading vehicles on roads uses intensity gradients as matching attribute. In contrast to the previous work of area-based stereo matching, in which matching unit is a pixel, the matching unit of the proposed method becomes an area itself which is obtained by selecting a series of pixels enclosed by two pixels on the left and right boundaries of an object. This approach allows us to cope with real-time processing and to avoid window size selection problems arising from conventional area-based stereo.