• Journal of Mechanical Science and Technology
• /
• 제17권10호
• /
• pp.1411-1422
• /
• 2003

The detection of free spaces between obstacles in a scene is a prerequisite for navigation of a mobile robot. Especially for stereo vision-based navigation, the problem of correspondence between two images is well known to be of crucial importance. This paper describes multi-range approach of area-based stereo matching for grid mapping and visual navigation in uncertain environment. Camera calibration parameters are optimized by evolutionary algorithm for successful stereo matching. To obtain reliable disparity information from both images, stereo images are to be decomposed into three pairs of images with different resolution based on measurement of disparities. The advantage of multi-range approach is that we can get more reliable disparity in each defined range because disparities from high resolution image are used for farther object a while disparities from low resolution images are used for close objects. The reliable disparity map is combined through post-processing for rejecting incorrect disparity information from each disparity map. The real distance from a disparity image is converted into an occupancy grid representation of a mobile robot. We have investigated the possibility of multi-range approach for the detection of obstacles and visual mapping through various experiments.

• Journal of Information Display
• /
• 제5권4호
• /
• pp.31-37
• /
• 2004

In this paper, an effective method for reconstruction of stereoscopic image pair through the regularized adaptive disparity estimation is proposed. Although the conventional adaptive disparity window matching can sharply improve the PSNR of a reconstructed stereo image, but there still exist some problems of overlapping between the matching windows and disallocation of the matching windows, because the size of the matching window tend to changes adaptively in accordance with the magnitude of the feature values. In the proposed method, the problems relating to the conventional adaptive disparity estimation scheme can be solved and the predicted stereo image can be more effectively reconstructed by regularizing the extimated disparity vector with the neighboring disparity vectors. From the experimental results, it is found that the proposed algorithm show improvements the PSNR of the reconstructed right image by about 2.36${\sim}$2.76 dB, on average, compared with that of conventional algorithms.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 1991년도 한국자동제어학술회의논문집(국내학술편); KOEX, Seoul; 22-24 Oct. 1991
• /
• pp.1192-1197
• /
• 1991

This paper describes a method of extracting the 3-D coordinates of feature points of an object from two images taken by one camera. The first image is from a CCD camera before approaching the object and the second image is from same camera after approaching the object along the optical axis. In the two images, the feature points appear at different position on the screen due to image enlargement. From the change of positions of feature points their world coordinates are calculated. In this paper, the correspondence problem is solved by image shrinking and correlation.

• 융합신호처리학회논문지
• /
• 제13권1호
• /
• pp.12-18
• /
• 2012

스테레오 대응성은 스테레오 비전에서 중요한 문제이다. 본 논문은 다해상도 기법과 AD-Census를 이용한 유전 알고리즘 기반의 스테레오 정합 기법을 제안한다. 정합 환경을 최적화 문제로 간주하여 유전 알고리즘으로 변위를 탐색한다. 그리고 에지 픽셀을 이용한 적응적 염색체 구조와 교배 방식을 적용한다. 비용함수는 스테레오 정합에서 주로 고려할 수 있는 제약 조건으로 구성하였고, 변위오차를 줄이기 위해 AD-Census 척도를 사용하였다. 처리의 효율을 높이기 위해 영상 피라미드 방법을 적용하여 최저해상도에서 최초 변위 도를 계산한다. 그리고 최초 변위도는 다음 해상도 단계로 전파되어, 보간된 후 지역 특징 벡터를 이용하여 정제를 수행한다. 실험을 통해 제안한 방법이 다른 유전 알고리즘 기반 기법들에 비해 변위 탐색 시간을 감소시킬 뿐만 아니라 정합의 타당성을 보증함을 확인하고자 한다.

• ETRI Journal
• /
• 제33권4호
• /
• pp.506-516
• /
• 2011

In this paper, we develop a registration method to eliminate the geometric inconsistency between the stereo-images and light detection and ranging (LIDAR) data obtained by an airborne multisensor system. This method consists of three steps: registration primitive extraction, correspondence establishment, and exterior orientation parameter (EOP) adjustment. As the primitives, we employ object points and linked edges from the stereo-images and planar patches and intersection edges from the LIDAR data. After extracting these primitives, we establish the correspondence between them, being classified into vertical and horizontal groups. These corresponding pairs are simultaneously incorporated as stochastic constraints into aerial triangulation based on the bundle block adjustment. Finally, the EOPs of the images are adjusted to minimize the inconsistency. The results from the application of our method to real data demonstrate that the inconsistency between both data sets is significantly reduced from the range of 0.5 m to 2 m to less than 0.05 m. Hence, the results show that the proposed method is useful for the data fusion of aerial images and LIDAR data.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2001년도 ICCAS
• /
• pp.101.1-101
• /
• 2001

This paper describes a grid mapping for a vision based mobile robot in uncertain indoor environment. The map building is a prerequisite for navigation of a mobile robot and the problem of feature correspondence across two images is well known to be of crucial Importance for vision-based mapping We use a stereo matching algorithm obtained by singular value decomposition of an appropriate correspondence strength matrix. This new correspondence strength means a correlation weight for some local measurements to quantify similarity between features. The visual range data from the reconstructed disparity image form an occupancy grid representation. The occupancy map is a grid-based map in which each cell has some value indicating the probability at that location ...

• 한국생산제조학회지
• /
• 제26권2호
• /
• pp.223-229
• /
• 2017

Recently, robotic bin-picking tasks have drawn considerable attention, because flexibility is required in robotic assembly tasks. Generally, stereo camera systems have been used widely for robotic bin-picking, but these have two limitations: First, computational burden for solving correspondence problem on stereo images increases calculation time. Second, errors in image processing and camera calibration reduce accuracy. Moreover, the errors in robot kinematic parameters directly affect robot gripping. In this paper, we propose a method of correcting the bin-picking error by using trinocular vision system which consists of two stereo cameras andone hand-eye camera. First, the two stereo cameras, with wide viewing angle, measure object's pose roughly. Then, the 3rd hand-eye camera approaches the object, and corrects the previous measurement of the stereo camera system. Experimental results show usefulness of the proposed method.

• 전자공학회논문지B
• /
• 제32B권1호
• /
• pp.39-49
• /
• 1995

Stereo vision is useful to obtain three dimensional depth information from two images taken from different view points. In this paper, we reduce searching area for correspondence by using the intra-scanline constraint, and utilize the inter-scanline constraint and the property of disparity continuity among the neighboring pixels for relaxation. Nodes with 3-D stucture are located on the axes of two views, and have matching possibility of correspondent pixels of two images. A matching is accepted if a node at the intersection of the disparity axes has the greatest matching possibility. Otherwise, the matching possibility of the node is updated by relaxation with the cooperation of neighboring nodes. Further relaxation with competition of two views is applied to a matching possibility of randomly selected node. The consensus of two views increases the confidence of matching, and removes a blurring phenomenon on the discontinuity of object. This approach has been tested with various types of image such as random dot stereogram and aerial image, and the experimental results show good matching performance.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2002년도 ITC-CSCC -3
• /
• pp.1666-1669
• /
• 2002

In the process of creating architectural scenes from photographs using Model-based Stereo 〔1〕, the geometric model is used as prior information to solve correspondence problems and recover the depth or disparity of real scenes. This paper presents an Image Subregioning algorithm that divides left and right images into several rectangular sub-images. The division is done according to the estimated depth of real scenes using a Heuristic Approach. The depth difference between the reality and the model can be partitioned into each depth level. This reduces disparity search range in the Similarity Function. For architectural scenes with complex depth, experiments using the above approach show that accurate disparity maps and better results when rendering scenes can be achieved by the proposed algorithm.

• 산업공학
• /
• 제11권2호
• /
• pp.93-106
• /
• 1998

This paper suggests a stereo vision-based algorithm for the 3-dimensional inspection of a crimped terminal. The crimped terminal is one of wire harness assemblies which transmit current or signals between a pair of electrical or electronic assemblies. Four types of nonconformities considered includes terminal rolling, band up/down, twist, and crimp height. To obtain stereo image correspondence, an algorithm using Hough transform is proposed. Coordinate transform is then applied to evaluate the degree of 3-dimensional nonconformities. The algorithm has been successfully tested on a number of real specimens collected from a wire harness factory. The test results show the feasibility of the proposed algorithm.