• Title/Summary/Keyword: Stereo Image Matching

Search Result 413, Processing Time 0.032 seconds

A Study on Point Cloud Generation Method from UAV Image Using Incremental Bundle Adjustment and Stereo Image Matching Technique (Incremental Bundle Adjustment와 스테레오 영상 정합 기법을 적용한 무인항공기 영상에서의 포인트 클라우드 생성방안 연구)

  • Rhee, Sooahm;Hwang, Yunhyuk;Kim, Soohyeon
    • Korean Journal of Remote Sensing
    • /
    • v.34 no.6_1
    • /
    • pp.941-951
    • /
    • 2018
  • Utilization and demand of UAV (unmanned aerial vehicle) for the generation of 3D city model are increasing. In this study, we performed an experiment to adjustment position/orientation of UAV with incomplete attitude information and to extract point cloud data. In order to correct the attitude of the UAV, the rotation angle was calculated by using the continuous position information of UAV movements. Based on this, the corrected position/orientation information was obtained by applying IBA (Incremental Bundle Adjustment) based on photogrammetry. Each pair was transformed into an epipolar image, and the MDR (Multi-Dimensional Relaxation) technique was applied to obtain high precision DSM. Each extracted pair is aggregated and output in the form of a single point cloud or DSM. Using the DJI inspire1 and Phantom4 images, we can confirm that the point cloud can be extracted which expresses the railing of the building clearly. In the future, research will be conducted on improving the matching performance and establishing sensor models of oblique images. After that, we will continue the image processing technology for the generation of the 3D city model through the study of the extraction of 3D cloud It should be developed.

Fast 3D Model Extraction Algorithm with an Enhanced PBIL of Preserving Depth Consistency (깊이 일관성을 보존하는 향상된 개체군기반 증가 학습을 이용한 고속 3차원 모델 추출 기법)

  • 이행석;장명호;한규필
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.31 no.1_2
    • /
    • pp.59-66
    • /
    • 2004
  • In this paper, a fast 3D model extraction algorithm with an enhanced PBIL of preserving depth consistency is proposed for the extraction of 3D depth information from 2D images. Evolutionary computation algorithms are efficient search methods based on natural selection and population genetics. 2D disparity maps acquired by conventional matching algorithms do not match well with the original image profile in disparity edge regions because of the loss of fine and precise information in the regions. Therefore, in order to decrease the imprecision of disparity values and increase the quality of matching, a compact genetic algorithm is adapted for matching environments, and the adaptive window, which is controlled by the complexity of neighbor disparities in an abrupt disparity point is used. As the result, the proposed algorithm showed more correct and precise disparities were obtained than those by conventional matching methods with relaxation scheme.

Study on the Building of Digital Terrain Model Using Satellite Remotely Sensed Data and Its Applications (위성 원격탐사 데이타를 이용한 지형표고모델 산출 알고리즘 구축 및 응용)

  • 최윤수
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.13 no.2
    • /
    • pp.141-151
    • /
    • 1995
  • In generating DTM as basic data to GIS, the use of existing map is difficult to aquire current data and the method using airphotos needs cost for stereoplotting and ground control surveying. So, the method of DTM generation by satellite imagery is promising because satellite is able to observe wide area at once. In this study the program for SPOT bundle adjustment and image matching based on Coarse to Fine method is developed and various image enhancement algorithm is used for more accurate DTM generation and also evaluation of accuracy was carried out. Further more, orthophoto, a bird's eye-view, contour map producing, net-work analysis and terrain analysis were performed for GIS applications using generated DTM in this study. Generated DTM using SPOT stereo imagery is useful for GIS applications such as automated mapping, facility management, national geographic information system. Moreover developed automatic DTM generation pro-gram is studied, tested and verified more to be applicable to all the area.

  • PDF

Stereo Image-based 3D Modelling Algorithm through Efficient Extraction of Depth Feature (효율적인 깊이 특징 추출을 이용한 스테레오 영상 기반의 3차원 모델링 기법)

  • Ha, Young-Su;Lee, Heng-Suk;Han, Kyu-Phil
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.32 no.10
    • /
    • pp.520-529
    • /
    • 2005
  • A feature-based 3D modeling algorithm is presented in this paper. Since conventional methods use depth-based techniques, they need much time for the image matching to extract depth information. Even feature-based methods have less computation load than that of depth-based ones, the calculation of modeling error about whole pixels within a triangle is needed in feature-based algorithms. It also increase the computation time. Therefore, the proposed algorithm consists of three phases, which are an initial 3D model generation, model evaluation, and model refinement phases, in order to acquire an efficient 3D model. Intensity gradients and incremental Delaunay triangulation are used in the Initial model generation. In this phase, a morphological edge operator is adopted for a fast edge filtering, and the incremental Delaunay triangulation is modified to decrease the computation time by avoiding the calculation errors of whole pixels and selecting a vertex at the near of the centroid within the previous triangle. After the model generation, sparse vertices are matched, then the faces are evaluated with the size, approximation error, and disparity fluctuation of the face in evaluation stage. Thereafter, the faces which have a large error are selectively refined into smaller faces. Experimental results showed that the proposed algorithm could acquire an adaptive model with less modeling errors for both smooth and abrupt areas and could remarkably reduce the model acquisition time.

Eye Contact System Using Depth Fusion for Immersive Videoconferencing (실감형 화상 회의를 위해 깊이정보 혼합을 사용한 시선 맞춤 시스템)

  • Jang, Woo-Seok;Lee, Mi Suk;Ho, Yo-Sung
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.52 no.7
    • /
    • pp.93-99
    • /
    • 2015
  • In this paper, we propose a gaze correction method for realistic video teleconferencing. Typically, cameras used in teleconferencing are installed at the side of the display monitor, but not in the center of the monitor. This system makes it too difficult for users to contact each eyes. Therefore, eys contact is the most important in the immersive videoconferencing. In the proposed method, we use the stereo camera and the depth camera to correct the eye contact. The depth camera is the kinect camera, which is the relatively cheap price, and estimate the depth information efficiently. However, the kinect camera has some inherent disadvantages. Therefore, we fuse the kinect camera with stereo camera to compensate the disadvantages of the kinect camera. Consecutively, for the gaze-corrected image, view synthesis is performed by 3D warping according to the depth information. Experimental results verify that the proposed system is effective in generating natural gaze-corrected images.

Validation and selection of GCPs obtained from ERS SAR and the SRTM DEM: Application to SPOT DEM Construction

  • Jung, Hyung-Sup;Hong, Sang-Hoon;Won, Joong-Sun
    • Korean Journal of Remote Sensing
    • /
    • v.24 no.5
    • /
    • pp.483-496
    • /
    • 2008
  • Qualified ground control points (GCPs) are required to construct a digital elevation model (DEM) from a pushbroom stereo pair. An inverse geolocation algorithm for extracting GCPs from ERS SAR data and the SRTM DEM was recently developed. However, not all GCPs established by this method are accurate enough for direct application to the geometric correction of pushbroom images such as SPOT, IRS, etc, and thus a method for selecting and removing inaccurate points from the sets of GCPs is needed. In this study, we propose a method for evaluating GCP accuracy and winnowing sets of GCPs through orientation modeling of pushbroom image and validate performance of this method using SPOT stereo pair of Daejon City. It has been found that the statistical distribution of GCP positional errors is approximately Gaussian without bias, and that the residual errors estimated by orientation modeling have a linear relationship with the positional errors. Inaccurate GCPs have large positional errors and can be iteratively eliminated by thresholding the residual errors. Forty-one GCPs were initially extracted for the test, with mean the positional error values of 25.6m, 2.5m and -6.1m in the X-, Y- and Z-directions, respectively, and standard deviations of 62.4m, 37.6m and 15.0m. Twenty-one GCPs were eliminated by the proposed method, resulting in the standard deviations of the positional errors of the 20 final GCPs being reduced to 13.9m, 8.5m and 7.5m in the X-, Y- and Z-directions, respectively. Orientation modeling of the SPOT stereo pair was performed using the 20 GCPs, and the model was checked against 15 map-based points. The root mean square errors (RMSEs) of the model were 10.4m, 7.1m and 12.1m in X-, Y- and Z-directions, respectively. A SPOT DEM with a 20m ground resolution was successfully constructed using a automatic matching procedure.

Visualization of The Three Dimensional Information Using Stereo Camera (스테레오 카메라를 이용한 3차원 정보의 가시화)

  • Lee, Nam-Oh;Park, Soon-Yong;Lee, Seung-Min
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.47 no.4
    • /
    • pp.15-20
    • /
    • 2010
  • The three dimensional information is extracted and visualized using by stereo images of the object and the method for a 3D stereoscopic image is presented by the vergence control algorithm. The matching, which is applied a undistortion of lens and the energy function, is executed for the efficient extraction three dimensional information. Especially, applying the optimized method of matched line to the multi direction of the disparity imges. The disadvantages of multi directional method and reliability expansion method is collected. The matched interesting range of the three dimensional information is visualized using by VRML and more 3D stereoscopic image is visualized through the vergence control according to distance of the object. more improved three dimensional information is provided to observer by visualizing both of them at the same time.

Real-Time Optical Flow Rendering (실시간 영상 생성을 위한 광학 흐름 요소 렌더링)

  • Park, Tae-Joon;Lee, Seungyong;Shin, Sung Yong
    • Journal of the Korea Computer Graphics Society
    • /
    • v.4 no.2
    • /
    • pp.15-28
    • /
    • 1998
  • 최근 영상 기반 렌더링(image-based rendering)을 위한 새로운 접근방법으로서 광학 흐름 요소 렌더링(optical flow rendering)이 제안되었다. 이 방법은 좌우 영상 대응(stereo matching)에서 발생하는 오류와 무관하게 고품질의 영상을 생성할 수 있고 깊이 정보 비교를 통해 기존의 렌더링 방법으로 생성한 영상과 광학 흐름 요소로부터 생성한 영상을 합성할 수 있는 반면에, 한 화소 당 하나 이상의 광학 흐름 요소를 필요로하기 때문에 연산량이 많아져 영상 생성이 느려지는 단점이 있었다. 본 논문에서는 실시간 영상 생성을 위한 광학 흐름 요소 구성법과 영상 생성법을 제안한다. 각각의 광학 흐름 요소가 영상 내에서 화소들의 구간에 대응되도록 개선하여 전체 광학 흐름 요소의 수를 줄였으며, 필터링 탐색법 (filtering search)을 적용하여 전체 광학 흐름 요소를 모두 탐색하는 대신 실제로 영상 생성에 사용되는 광학 흐름 요소만을 탐색함으로써 전체 연산량을 크게 줄였다. 제안된 방법을 SGI Indigo2 Impact 워크스테이션(R10000 CPU; 128 Mbytes)상에서 구현한 결과, 초당 10장 이상의 고속 영상 생성이 가능했다.

  • PDF

A Study on the Distance Measurement Algorithm using Feature-Based Matching for Autonomous Navigation

  • Song, Hyun-Sung;Lee, Ho-Soon;Jeong, Jun-Ik;Son, Kyung-Hee;Rho, Do-Hwan
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.63.2-63
    • /
    • 2001
  • It is necessary to distance measurement to detect about obstacles and front vehicles to autonomously navigate. In this paper, we propose an algorithm using stereo vision. It is as follows this algorithm´s procedure. First, It has detected a front vehicle´s common edges from left and right images by image processing. We select number plate of a front vehicle as edges. Then, we estimate distance by triangle measurement method after stereomatching using corner points of the plate´s edges as feature-based points. Experimental results show errors and values compand with experimental ones after set up distance between vehicles in advance.

  • PDF

Vision Based Map-Building Using Singular Value Decomposition Method for a Mobile Robot in Uncertain Environment

  • Park, Kwang-Ho;Kim, Hyung-O;Kee, Chang-Doo;Na, Seung-Yu
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.101.1-101
    • /
    • 2001
  • This paper describes a grid mapping for a vision based mobile robot in uncertain indoor environment. The map building is a prerequisite for navigation of a mobile robot and the problem of feature correspondence across two images is well known to be of crucial Importance for vision-based mapping We use a stereo matching algorithm obtained by singular value decomposition of an appropriate correspondence strength matrix. This new correspondence strength means a correlation weight for some local measurements to quantify similarity between features. The visual range data from the reconstructed disparity image form an occupancy grid representation. The occupancy map is a grid-based map in which each cell has some value indicating the probability at that location ...

  • PDF