• Title/Summary/Keyword: Stereo matching

Search Result 611, Processing Time 0.022 seconds

High efficient vision system for volumetric display (입체영상 디스플레이를 위한 고효율 비젼 시스템)

  • Kim, Sang Hyun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.10
    • /
    • pp.5130-5133
    • /
    • 2013
  • Volumetric display has many applications recently in education, 3D movie, medical images but these applications have several problems that need to be overcome. Volumetric display may process a amount of visual data and design the high efficient vision system for realtime display. The stereo data for volumetric display estimated the disparity vectors from the stereoscopic sequences has been transmitted the disparity vectors, motion vectors and residual images with the reference images, and the stereoscopic sequences have been reconstructed at the receiver for 3D display. Central issue for efficient 3D display lies in selecting an appropriate stereo matching with robust vision system. In this paper, high efficient vision system is proposed for efficient stereo image matching and the experimental results represent high efficiency for proposed 3D display system.

Effectual Method FOR 3D Rebuilding From Diverse Images

  • Leung, Carlos Wai Yin;Hons, B.E.
    • 한국정보컨버전스학회:학술대회논문집
    • /
    • 2008.06a
    • /
    • pp.145-150
    • /
    • 2008
  • This thesis explores the problem of reconstructing a three-dimensional(3D) scene given a set of images or image sequences of the scene. It describes efficient methods for the 3D reconstruction of static and dynamic scenes from stereo images, stereo image sequences, and images captured from multiple viewpoints. Novel methods for image-based and volumetric modelling approaches to 3D reconstruction are presented, with an emphasis on the development of efficient algorithm which produce high quality and accurate reconstructions. For image-based 3D reconstruction a novel energy minimisation scheme, Iterated Dynamic Programming, is presented for the efficient computation of strong local minima of discontinuity preserving energyy functions. Coupled with a novel morphological decomposition method and subregioning schemes for the efficient computation of a narrowband matching cost volume. the minimisation framework is applied to solve problems in stereo matching, stereo-temporal reconstruction, motion estimation, 2D image registration and 3D image registration. This thesis establishes Iterated Dynamic Programming as an efficient and effective energy minimisation scheme suitable for computer vision problems which involve finding correspondences across images. For 3D reconstruction from multiple view images with arbitrary camera placement, a novel volumetric modelling technique, Embedded Voxel Colouring, is presented that efficiently embeds all reconstructions of a 3D scene into a single output in a single scan of the volumetric space under exact visibility. An adaptive thresholding framework is also introduced for the computation of the optimal set of thresholds to obtain high quality 3D reconstructions. This thesis establishes the Embedded Voxel Colouring framework as a fast, efficient and effective method for 3D reconstruction from multiple view images.

  • PDF

DEM generation from an IKONOS stereo pair using EpiMatch and Graph-Cut algorithms

  • Kim, Tae-Jung;Im, Yong-Jo;Kim, Ho-Won;Kweon, In-So
    • Proceedings of the KSRS Conference
    • /
    • 2002.10a
    • /
    • pp.524-529
    • /
    • 2002
  • In this paper, we report the development of two DEM (digital elevation model) generation algorithms over urban areas from an IKONOS stereo pair. One ("EpiMatch") is originally developed for SPOT images and modified for IKONOS images. It uses epipolar geometry for accurate DEM generation. The other is based on graph-cut algorithm in 3D voxel space. This algorithm is believed to work better on height discontinuities than EpiMatch. An IKONOS image pair over Taejon city area was used for tests. Using ground control points obtained from differential GPS, camera model was set up and stereo matching applied. As a result, two DEMs over urban areas were produced. Within a DEM from EpiMatch small houses appear as small "cloudy" patches and large apartment and industrial buildings are visually identifiable. Within the DEM from graph-cut we could achieve better height information on building boundaries. The results show that both algorithms can generate DEMs from IKONOS images although more research is required on handling height discontinuities (for "EpiMatch") and on faster computation (for "Graph-cut").

  • PDF

Measurements of the Trajectories of Moving Objects with Video System and Image Matching (비디오 시스템과 영상매칭에 의한 운동물체의 거동측정)

  • 이창경;조우석
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.20 no.3
    • /
    • pp.331-341
    • /
    • 2002
  • In order to extract 3-dimensional information from 2-D image, stereo images are prerequisite. Moreover, for the measurement of moving objects, the synchronized sequential stereo images have to be captured and image matching should be implemented for determining the location of moving objects. In this research, a simple method computing 3-dimensional coordinates from sequential images of moving objects was implemented. The sequential stereo images were captured by a video camera with a beam splitter. Once video images were digitalized by frame grabber, the interest points were extracted and matched in each stereo image, and the coordinates of center of them are calculated using weighted average method. Then, 3-dimensional coordinates of moving objects were computed by DLT algorithms.

Confidence Measure of Depth Map for Outdoor RGB+D Database (야외 RGB+D 데이터베이스 구축을 위한 깊이 영상 신뢰도 측정 기법)

  • Park, Jaekwang;Kim, Sunok;Sohn, Kwanghoon;Min, Dongbo
    • Journal of Korea Multimedia Society
    • /
    • v.19 no.9
    • /
    • pp.1647-1658
    • /
    • 2016
  • RGB+D database has been widely used in object recognition, object tracking, robot control, to name a few. While rapid advance of active depth sensing technologies allows for the widespread of indoor RGB+D databases, there are only few outdoor RGB+D databases largely due to an inherent limitation of active depth cameras. In this paper, we propose a novel method used to build outdoor RGB+D databases. Instead of using active depth cameras such as Kinect or LIDAR, we acquire a pair of stereo image using high-resolution stereo camera and then obtain a depth map by applying stereo matching algorithm. To deal with estimation errors that inevitably exist in the depth map obtained from stereo matching methods, we develop an approach that estimates confidence of depth maps based on unsupervised learning. Unlike existing confidence estimation approaches, we explicitly consider a spatial correlation that may exist in the confidence map. Specifically, we focus on refining confidence feature with the assumption that the confidence feature and resultant confidence map are smoothly-varying in spatial domain and are highly correlated to each other. Experimental result shows that the proposed method outperforms existing confidence measure based approaches in various benchmark dataset.

Building DSMs Generation Integrating Three Line Scanner (TLS) and LiDAR

  • Suh, Yong-Cheol;Nakagawa , Masafumi
    • Korean Journal of Remote Sensing
    • /
    • v.21 no.3
    • /
    • pp.229-242
    • /
    • 2005
  • Photogrammetry is a current method of GIS data acquisition. However, as a matter of fact, a large manpower and expenditure for making detailed 3D spatial information is required especially in urban areas where various buildings exist. There are no photogrammetric systems which can automate a process of spatial information acquisition completely. On the other hand, LiDAR has high potential of automating 3D spatial data acquisition because it can directly measure 3D coordinates of objects, but it is rather difficult to recognize the object with only LiDAR data, for its low resolution at this moment. With this background, we believe that it is very advantageous to integrate LiDAR data and stereo CCD images for more efficient and automated acquisition of the 3D spatial data with higher resolution. In this research, the automatic urban object recognition methodology was proposed by integrating ultra highresolution stereo images and LiDAR data. Moreover, a method to enable more reliable and detailed stereo matching method for CCD images was examined by using LiDAR data as an initial 3D data to determine the search range and to detect possibility of occlusions. Finally, intellectual DSMs, which were identified urban features with high resolution, were generated with high speed processing.

Improving Urban Vegetation Classification by Including Height Information Derived from High-Spatial Resolution Stereo Imagery

  • Myeong, Soo-Jeong
    • Korean Journal of Remote Sensing
    • /
    • v.21 no.5
    • /
    • pp.383-392
    • /
    • 2005
  • Vegetation classes, especially grass and tree classes, are often confused in classification when conventional spectral pattern recognition techniques are used to classify urban areas. This paper reports on a study to improve the classification results by using an automated process of considering height information in separating urban vegetation classes, specifically tree and grass, using three-band, high-spatial resolution, digital aerial imagery. Height information was derived photogrammetrically from stereo pair imagery using cross correlation image matching to estimate differential parallax for vegetation pixels. A threshold value of differential parallax was used to assess whether the original class was correct. The average increase in overall accuracy for three test stereo pairs was $7.8\%$, and detailed examination showed that pixels reclassified as grass improved the overall accuracy more than pixels reclassified as tree. Visual examination and statistical accuracy assessment of four test areas showed improvement in vegetation classification with the increase in accuracy ranging from $3.7\%\;to\;18.1\%$. Vegetation classification can, in fact, be improved by adding height information to the classification procedure.

An active stereo camera modeling (동적 스테레오 카메라 모델링)

  • Do, Kyoung-Mihn;Lee, Kwae-Hi
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.3 no.3
    • /
    • pp.297-304
    • /
    • 1997
  • In stereo vision, camera modeling is very important because the accuracy of the three dimensional locations depends considerably on it. In the existing stereo camera models, two camera planes are located in the same plane or on the optical axis. These camera models cannot be used in the active vision system where it is necessary to obtain two stereo images simultaneously. In this paper, we propose four kinds of stereo camera models for active stereo vision system where focal lengths of the two cameras are different and each camera is able to rotate independently. A single closed form solution is obtained for all models. The influence of the stereo camera model to the field of view, occlusion, and search area used for matching is shown in this paper. And errors due to inaccurate focal length are analyzed and simulation results are shown. It is expected that the three dimensional locations of objects are determined in real time by applying proposed stereo camera models to the active stereo vision system, such as a mobile robot.

  • PDF

Improvement of Disparity Map using Loopy Belief Propagation based on Color and Edge (Disparity 보정을 위한 컬러와 윤곽선 기반 루피 신뢰도 전파 기법)

  • Kim, Eun Kyeong;Cho, Hyunhak;Lee, Hansoo;Wibowo, Suryo Adhi;Kim, Sungshin
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.25 no.5
    • /
    • pp.502-508
    • /
    • 2015
  • Stereo images have an advantage of calculating depth(distance) values which can not analyze from 2-D images. However, depth information obtained by stereo images has due to following reasons: it can be obtained by computation process; mismatching occurs when stereo matching is processing in occlusion which has an effect on accuracy of calculating depth information. Also, if global method is used for stereo matching, it needs a lot of computation. Therefore, this paper proposes the method obtaining disparity map which can reduce computation time and has higher accuracy than established method. Edge extraction which is image segmentation based on feature is used for improving accuracy and reducing computation time. Color K-Means method which is image segmentation based on color estimates correlation of objects in an image. And it extracts region of interest for applying Loopy Belief Propagation(LBP). For this, disparity map can be compensated by considering correlation of objects in the image. And it can reduce computation time because of calculating region of interest not all pixels. As a result, disparity map has more accurate and the proposed method reduces computation time.

Comparison and Analysis of Matching DEM Using KOMPSAT-3 In/Cross-track Stereo Pair (KOMPSAT-3 In/Cross-track 입체영상을 이용한 매칭 DEM 비교 분석)

  • Oh, Kwan-Young;Jeong, Eui-Cheon;Lee, Kwang-Jae;Kim, Youn-Soo;Lee, Won-Jin
    • Korean Journal of Remote Sensing
    • /
    • v.34 no.6_3
    • /
    • pp.1445-1456
    • /
    • 2018
  • The purpose of this study is to compare the quality and characteristics of matching DEMs by using KOMPSAT-3 stereo pair capture in in-track and cross-track. For this purpose, two stereo pairs of KOMPSAT-3 were collected that were taken in the same area. The two stereo pairs have similar stereo geometry elements such as B/H, convergence angle. Sensor modeling for DEM production was performed with RFM affine calibration using multiple GCPs. The GCPs used in the study were extracted from the 0.25 m ortho-image and 5 meter DEM provided by NGII. In addition, matching DEMs were produced at the same resolution as the reference DEMs for a comparison analysis. As a result of the experiment, the horizontal and vertical errors at the CPs indicated an accuracy of 1 to 3 pixels. In addition, the shapes and accuracy of two DEMs produced in areas where the effects of natural or artificial surface land were low were almost similar.