• Title/Summary/Keyword: Stereo Image Matching

Search Result 413, Processing Time 0.024 seconds

The Study for the Reconstruction of two objects using the Stereo X-ray Inspection System (스테레오 X-선 검색장치를 이용한 이중물체 형상복원 연구)

  • Hwang, Young-Gwan;Lee, Nam-Ho;Park, Jong-Won
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.9
    • /
    • pp.4152-4158
    • /
    • 2012
  • The Stereo X-ray inspection system is designed for effectively providing the additional information of objects than the conventional inspection system that offers only 2D cross-section of objects. We studied the geometric improvement of the stereo X-ray inspection system, the stereo matching algorithm of the single object using the edge and the volume reconstruction method for the inspected object. In this paper, we conduct a matching algorithm to find the correspondences between the images and reconstruct 3-D shapes of real objects using the stereo X-ray images. Also, we apply a new 3D reconstruction algorithm for the discrimination of two objects. For the separation of the overlapping objects, we calculate the vector of the object and divide inner and outer voxel of objects. And for the elimination of the overlapping area, we study the reconstruct 3D shapes using the threshold based Z-axis. The experimental results show that the proposed technique can enhance the accuracy of stereo matching and give more efficient visualization for overlap objects in the restricted environment.

Post-processing Method of Point Cloud Extracted Based on Image Matching for Unmanned Aerial Vehicle Image (무인항공기 영상을 위한 영상 매칭 기반 생성 포인트 클라우드의 후처리 방안 연구)

  • Rhee, Sooahm;Kim, Han-gyeol;Kim, Taejung
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_1
    • /
    • pp.1025-1034
    • /
    • 2022
  • In this paper, we propose a post-processing method through interpolation of hole regions that occur when extracting point clouds. When image matching is performed on stereo image data, holes occur due to occlusion and building façade area. This area may become an obstacle to the creation of additional products based on the point cloud in the future, so an effective processing technique is required. First, an initial point cloud is extracted based on the disparity map generated by applying stereo image matching. We transform the point cloud into a grid. Then a hole area is extracted due to occlusion and building façade area. By repeating the process of creating Triangulated Irregular Network (TIN) triangle in the hall area and processing the inner value of the triangle as the minimum height value of the area, it is possible to perform interpolation without awkwardness between the building and the ground surface around the building. A new point cloud is created by adding the location information corresponding to the interpolated area from the grid data as a point. To minimize the addition of unnecessary points during the interpolation process, the interpolated data to an area outside the initial point cloud area was not processed. The RGB brightness value applied to the interpolated point cloud was processed by setting the image with the closest pixel distance to the shooting center among the stereo images used for matching. It was confirmed that the shielded area generated after generating the point cloud of the target area was effectively processed through the proposed technique.

Highly Dense 3D Surface Generation Using Multi-image Matching

  • Noh, Myoung-Jong;Cho, Woo-Sug;Bang, Ki-In
    • ETRI Journal
    • /
    • v.34 no.1
    • /
    • pp.87-97
    • /
    • 2012
  • This study presents an automatic matching method for generating a dense, accurate, and discontinuity-preserved digital surface model (DSM) using multiple images acquired by an aerial digital frame camera. The proposed method consists of two main procedures: area-based multi-image matching (AMIM) and stereo-pair epipolar line matching (SELM). AMIM evaluates the sum of the normalized cross correlation of corresponding image points from multiple images to determine the optimal height of an object point. A novel method is introduced for determining the search height range and incremental height, which are necessary for the vertical line locus used in the AMIM. This procedure also includes the means to select the best reference and target images for each strip so that multi-image matching can resolve the common problem over occlusion areas. The SELM extracts densely positioned distinct points along epipolar lines from the multiple images and generates a discontinuity-preserved DSM using geometric and radiometric constraints. The matched points derived by the AMIM are used as anchor points between overlapped images to find conjugate distinct points using epipolar geometry. The performance of the proposed method was evaluated for several different test areas, including urban areas.

Improved Image Matching Method Based on Affine Transformation Using Nadir and Oblique-Looking Drone Imagery

  • Jang, Hyo Seon;Kim, Sang Kyun;Lee, Ji Sang;Yoo, Su Hong;Hong, Seung Hwan;Kim, Mi Kyeong;Sohn, Hong Gyoo
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.38 no.5
    • /
    • pp.477-486
    • /
    • 2020
  • Drone has been widely used for many applications ranging from amateur and leisure to professionals to get fast and accurate 3-D information of the surface of the interest. Most of commercial softwares developed for this purpose are performing automatic matching based on SIFT (Scale Invariant Feature Transform) or SURF (Speeded-Up Robust Features) using nadir-looking stereo image sets. Since, there are some situations where not only nadir and nadir-looking matching, but also nadir and oblique-looking matching is needed, the existing software for the latter case could not get good results. In this study, a matching experiment was performed to utilize images with differences in geometry. Nadir and oblique-looking images were acquired through drone for a total of 2 times. SIFT, SURF, which are feature point-based, and IMAS (Image Matching by Affine Simulation) matching techniques based on affine transformation were applied. The experiment was classified according to the identity of the geometry, and the presence or absence of a building was considered. Images with the same geometry could be matched through three matching techniques. However, for image sets with different geometry, only the IMAS method was successful with and without building areas. It was found that when performing matching for use of images with different geometry, the affine transformation-based matching technique should be applied.

Virtual Control of Optical Axis of the 3DTV Camera for Reducing Visual Fatigue in Stereoscopic 3DTV

  • Park, Jong-Il;Um, Gi-Mun;Ahn, Chung-Hyun;Ahn, Chie-Teuk
    • ETRI Journal
    • /
    • v.26 no.6
    • /
    • pp.597-604
    • /
    • 2004
  • In stereoscopic television, there is a trade-off between visual comfort and 3-dimensional (3D) impact with respect to the baseline-stretch of a 3DTV camera. It is necessary to adjust the baseline-stretch at an appropriate the distance depending on the contents of a scene if we want to obtain a subjectively optimal quality of an image. However, it is very hard to obtain a small baseline-stretch using commercially available cameras of broadcasting quality where the sizes of the lens and CCD module are large. In order to overcome this limitation, we attempt to freely control the baseline-stretch of a stereoscopic camera by synthesizing the virtual views at the desired location of interval between two cameras. This proposed technique is based on the stereo matching and view synthesis techniques. We first obtain a dense disparity map using a hierarchical stereo matching with the edge-adaptive multiple shifted windows. Then, we synthesize the virtual views using the disparity map. Simulation results with various stereoscopic images demonstrate the effectiveness of the proposed technique.

  • PDF

Disparity estimation using wavelet transformation and reference points (웨이블릿 변환과 기준점을 이용한 변위 추정)

  • 노윤향;고병철;변혜란;유지상
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.27 no.2A
    • /
    • pp.137-145
    • /
    • 2002
  • In the method of 3D modeling, stereo matching method which obtains three dimensional depth information from the two images is taken from the different view points. In general, it is very essential work for the 3D modeling from 2D stereo images to estimate the exact disparity through fading the conjugate pair of pixel from the left and right image. In this paper to solve the problems of the stereo image disparity estimation, we introduce a novel approach method to improve the exactness and efficiency of the disparity. In the first place, we perform a wavelet transformation of the stereo images and set the reference points in the image by the feature-based matching method. This reference points have very high probability over 95 %. In the base of these reference points we can decide the size of the variable block searching windows for estimating dense disparity of area based method and perform the ordering constraint to prevent mismatching. By doing this, we could estimate the disparity in a short time and solve the occlusion caused by applying the fried-sized windows and probable error caused by repeating patterns.

3D Positioning Using a UAV Equipped with a Stereo Camera (스테레오 카메라를 탑재한 UAV를 이용한 3차원 위치결정)

  • Park, Sung-Geun;Kim, Eui-Myoung
    • Journal of Cadastre & Land InformatiX
    • /
    • v.51 no.2
    • /
    • pp.185-198
    • /
    • 2021
  • Researches using UAVs are being actively conducted in the field of quickly constructing 3D spatial information in small areas. In this study, without using ground control points, a stereo camera was mounted on a UAV to collect images and quickly construct three-dimensional positions through image matching, bundle adjustment, and the determination of a scale factor. Through the experiment, when bundle adjustment was performed using stereo constraints, the root mean square error was 1.475m, and when absolute orientation was performed in consideration of a scale, it was found to be 0.029m. Through this, it was found that when using the data processing method of a UAV equipped with a stereo camera proposed in this study, high-accuracy 3D spatial information can be constructed without using ground control points.

High efficient 3D vision system using simplification of stereo image rectification structure (스테레오 영상 교정 구조의 간략화를 이용한 고효율 3D 비젼시스템)

  • Kim, Sang Hyun
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.12 no.6
    • /
    • pp.605-611
    • /
    • 2019
  • 3D Vision system has many applications recently but popularization have many problems that need to be overcome. Volumetric display may process a amount of visual data and design the high efficient vision system for display. In case of stereo system for volumetric display, disparity vectors from the stereoscopic sequences and residual images with the reference images has been transmitted, and the reconstructed stereoscopic sequences have been displayed at the receiver. So central issue for the design of efficient volumetric vision system lies in selecting an appropriate stereo matching and robust vision system. In this paper, we propose high efficient vision system with the reduction of rectification error which can perform the 3D data extraction efficiently with low computational complexity. In experimental results with proposed vision system, the proposed method can perform the 3D data extraction efficiently with reducing rectification error and low computational complexity.

Development of 3-D Stereo PIV by Homogeneous Coordinate System (호모지니어스 좌표계를 이용한 3차원 스테레오 PIV 알고리듬의 개발)

  • Kim, Mi-Young;Choi, Jang-Woon;Nam, Koo-Man;Lee, Young-Ho
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.27 no.6
    • /
    • pp.736-743
    • /
    • 2003
  • A process of 3-D particle image velocimetry, called here, as '3-D stereo PIV' was developed for the measurement of an illuminated slied section field of 3-D complex flows. The present method includes modeling of camera by a calibrator based on the homogeneous coordinate system, transfromation of the oblique-angled image to the right-angled image, identification of 2-D velocity vectors by 2-D cross-correlation equation, stereo matching of 2-D velocity vectors of two cameras, accurate calculation of 3-D velocity vectors by homogeneous coordinate system, removal of error vectors by a statistical method followed by a continuity equation criterior, and finally 3-D animation as the post processing. An experimental system was also used for the application of the proposed method. Three analog CCD cameras and an Argon-Ion Laser(300mW) for illumination were adopted to capture the wake flow behind a bluff obstacle.

Development of 3-D Stereo PIV (3차원 스테레오 PIV 개발)

  • Kim Mi-Young;Choi Jang-Woon;Nam Koo-Man;Lee Young-Ho
    • 한국가시화정보학회:학술대회논문집
    • /
    • 2002.11a
    • /
    • pp.19-22
    • /
    • 2002
  • A process of 3-D particle image velocimetry, called here, as '3-D stereo PIV' was developed for the measurement of a section field of 3-D complex flows. The present method includes modeling of camera by a calibrator based on the homogeneous coordinate system, transfromation of oblique-angled image to transformed image, identification of 2-D velocity vectors by 2-D cross-correlation equation, stereo matching of 2-D velocity vectors of two cameras, accurate calculation of 3-D velocity vectors by homogeneous coordinate system and finally 3-D animation as the post processing. In principle, as two frame images only are necessary for the single instantaneous analysis of a section field of 3-D flow, more effective vectors are obtainable contrary to the previous multi-frame vector algorithm. An experimental system was also used for the application of the proposed method. Three analog CCD cameras and an Argon-Ion Laser(300mW) for illumination were adopted to capture the wake flow behind a bluff obstacle.

  • PDF