• Korean Journal of Remote Sensing
• /
• v.35 no.5_1
• /
• pp.727-736
• /
• 2019

In this paper, we present how to create a point cloud for a target area using multiple unmanned aerial vehicle images and to remove the gaps and overlapping points between datasets. For this purpose, first, IBA (Incremental Bundle Adjustment) technique was applied to correct the position and attitude of UAV platform. We generate a point cloud by using MDR (Multi-Dimensional Relaxation) matching technique. Next, we register point clouds based on observation vectors between stereo images by doing this we remove gaps between point clouds which are generated from different stereo pairs. Finally, we applied an occupancy grids based integration algorithm to remove duplicated points to create an integrated point cloud. The experiments were performed using UAV images, and our experiments show that it is possible to remove gaps and duplicate points between point clouds generated from different stereo pairs.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.15 no.7
• /
• pp.1583-1590
• /
• 2011

As the existing radiation scanning systems use 2-dimensional radiation scanned images, the low accuracy has been pointed out as a problem of it. This research analyzes the applicability of the stereo image processing technique to X-ray scanned images. Two 2-dimensional radiation images which have different disparity values are acquired from a newly designed stereo image acquisition system which has one additional line sensor to the conventional system. Using a matching algorithm the 3D reconstruction process which find the correspondence between the images is progressed. As the radiation image is just a density information of the scanned object, the direct application of the general stereo image processing techniques to it is inefficient. To overcome this limitation of a stereo image processing in radiation area, we reconstruct 3-D shapes of the edges of the objects. Also, we proposed a new volume based 3D reconstruction algorithm. Experimental results show the proposed new volume based reconstruction technique can provide more efficient visualization for cargo inspection. The proposed technique can be used for such objects which CT or MRI cannot inspect due to restricted scan environment.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.22 no.2
• /
• pp.198-204
• /
• 2012

Tracking and recognition of robots are required for the cooperation task of robots in various environments. In the paper, a tracking control system of moving robot using stereo image processing, code-book model and fuzzy controller is proposed. First, foreground and background images are separated by using code-book model method. A candidate region is selected based on the color information in the separated foreground image and real distance of the robot is estimated from matching process of depth image that is acquired through stereo image processing. The open and close processing of image are applied and labeling according to the size of mobile robot is used to recognize the moving robot effectively. A fuzzy tracking controller using distance information and mobile information by stereo image processing is designed for effective tracking according to the movement velocity of the target robot. The proposed fuzzy tracking control method is verified through tracking experiments of mobile robots with stereo camera.

• Journal of KIISE:Software and Applications
• /
• v.26 no.12
• /
• pp.1482-1496
• /
• 1999

기존의 스테레오 정합 알고리즘은 크게 명암기반기법과 특징기반기법의 두 가지로 나눌 수 있다. 그리고, 각 기법은 그들 나름대로의 장단점을 갖는다. 본 논문은 이 두 기법을 결합하는 새로운 알고리즘을 제안한다. 본 논문에서는 물체모델링을 목적으로 하기 때문에 배경을 제거하여 정합하는 방법을 사용한다. 이를 위해, 정합요소들과 정합유사함수가 정의되고, 정합유사함수는 두 기법사이의 장단점을 하나의 인수에 의해 조절한다. 그 외에도 거리차 지도의 오류를 제거하는 coarse-to-fine기법, 폐색문제를 해결하는 다중윈도우 기법을 사용하였고, 물체의 표면형태를 알아내기 위해 morphological closing 연산자를 이용하여 물체와 배경을 분리하는 방법을 제안하였다. 이러한 기법들을 기반으로 하여 여러가지 영상에 대해 실험을 수행하였으며, 그 결과들은 본 논문이 제안하는 기법의 효율성을 보여준다. 정합의 결과로 만들어지는 거리차 지도는 3차원 모델링을 통해 가상공간상에서 보여지도록 하였다.Abstract Classical stereo matching algorithms can be classified into two major areas; intensity-based and feature-based stereo matching. Each technique has advantages and disadvantages. This paper proposes a new algorithm which merges two main matching techniques. Since the goal of our stereo algorithm is in object modeling, we use images for which background is removed. Primitives and a similarity function are defined. The matching similarity function selectively controls the advantages and disadvantages of intensity-based and feature-based matching by a parameter.As an additional matching strategy, a coarse-to-fine method is used to remove a errorneous data on the disparity map. To handle occlusions, multiple windowing method is used. For finding the surface shape of an object, we propose a method that separates an object and the background by a morphological closing operator. All processes have been implemented and tested with various image pairs. The matching results showed the effectiveness of our method. From the disparity map computed by the matching process, 3D modeling is possible. 3D modeling is manipulated by VRML(Virtual Reality Manipulation Language). The results are summarized in a virtual reality space.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.26 no.3D
• /
• pp.519-525
• /
• 2006

The traditional area-based matching or efficient matching methods using epipolar geometry and height restriction of stereo images, which have a confined search space for image matching, have still some disadvantages such as mismatching and timeconsuming, especially in the dense metropolitan city that very high and similar buildings exist. To solve these problems, a new image matching method through building recognition has been presented. This paper described building recognition in color stereo images using edge and color information as a elementary study of new matching scheme. We introduce the modified Hausdorff distance for using edge information, and the modified color indexing with 3-D RGB histogram for using color information. Color information or edge information alone is not enough to find conjugate building pairs. For edge information only, building recognition rate shows 46.5%, for color information only, 7.1%. However, building recognition rate distinctly increase 78.5% when both information are combined.

• Proceedings of the KSME Conference
• /
• 2003.11a
• /
• pp.658-663
• /
• 2003

A process of 3-D stereo particle image velocimetry(PIV)was developed for the measurement of an illuminated sliced section field of 3-D complex flows. The present method includes modeling of camera by a calibrator based on the homogeneous coordinate system, transformation of the oblique-angled image to the right-angled image, identification of 2-D velocity vectors by 2-D cross-correlation equation, stereo matching of 2-D velocity vectors of two cameras, accurate calculation of 3-D velocity vectors by homogeneous coordinate system, removal of error vectors by a statistical method followed by a continuity equation criteria, and finally 3-D display as the post processing. An experimental system was also used for the application of the proposed method. Two high speed digital CCD cameras and an Argon-Ion Laser for the illumination were adopted to clarify the time-dependent characteristics of the leading edge extension(LEX) in a highly swept shape applied to a delta wing found in modern air-fighters.

• Journal of Broadcast Engineering
• /
• v.2 no.2
• /
• pp.216-224
• /
• 1997

In this paper, we propose a depth information extraction method for intermediate image synthesis. As stereo matching method, MBS(Multiple-Baseline Stereo) method has been proposed, in which the matching accuracy increases by using the multiple camera, but there are some inherent problems such as computational complexity, boundary overreach(BO) in depth map, and occlusion. So, we propose the modified version of MBS so called Multi-Resolution MBS(MR-MBS). Moreover, we also propose an adaptive occlusion area processing technique to improve the accuracy of the depth information in occlusion area.

• Journal of Institute of Control, Robotics and Systems
• /
• v.22 no.1
• /
• pp.46-52
• /
• 2016

We propose a new type of semi-global matching (SGM) in order to solve a streaking problem arising from conventional SGM. Conventional SGM imposes a penalty to a pixel when the disparity of the pixel differs from that of the previous pixel along a scan path, and thus, disparity changes are not easily allowed, causing the streaking effect. The road surface is an appropriate target for such an effect, because the colors of the surfaces are very similar, and the image pixels corresponding to the surfaces show disparities that change very smoothly along the viewing direction. In contrast to conventional SGM, the new type of SGM imposes penalties depending on the disparity gradients, and thus, the streaking effect is controlled. The experimental results show the effectiveness of the proposed SGM method.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.21 no.10
• /
• pp.1551-1560
• /
• 1997

This study is devoted to the detection of the 3-dimensional point obstacles on the plane by using accumulated scan line images. The proposed accumulating only one scan line allow to process image at real time. And the change of motion of the feature in image is small because of the short time between image frames, so it does not take much time to track features. To obtain recursive optimal obstacles position and robot motion along to the motion of camera, Kalman filter algorithm is used. After using Kalman filter in case of the fixed environment, 3-dimensional obstacles point map is obtained. The position and motion of moving obstacles can also be obtained by pre-segmentation. Finally, to solve the stereo ambiguity problem from multiple matches, the camera motion is actively used to discard mis-matched features. To get relative distance of obstacles from camera, parallel stereo camera setup is used. In order to evaluate the proposed algorithm, experiments are carried out by a small test vehicle.

• Proceedings of the KSRS Conference
• /
• 2002.10a
• /
• pp.516-516
• /
• 2002

With the wide usage of LiDAR data and high-resolution satellite image, 3D modeling of buildings in urban areas has become an important research topic in the photogrammetry and computer vision field for many years. However the previous modeling has its limitations of merely texturing the image to the DSM surface of the study area and does not represent the relief of building surfaces. This study is focused on presenting a system of realistic 3D building modeling from consecutive stereo image sequences using digital camera. Generally when acquiring images through camera, various parameters such as zooming, focus, and attitude are necessary to extract accurate results, which in certain cases, some parameters have to be rectified. It is, however, not always possible or practical to precisely estimate or rectify the information of camera positions or attitudes. In this research, we constructed the collinearity condition of stereo images through extracting the distinctive points from stereo image sequence. In addition, we executed image matching with Graph Cut method, which has a very high accuracy. This system successfully performed the realistic modeling of building with a good visual quality. From the study, we concluded that 3D building modeling of city area could be acquired more realistically.