• Title/Summary/Keyword: epipolar image

Search Result 94, Processing Time 0.034 seconds

A New Rectification Scheme for Uncalibrated Stereo Image Pairs and Its Application to Intermediate View Reconstruction

  • Ko, Jung-Hwan;Jung, Yong-Woo;Kim, Eun-Soo
    • Journal of Information Display
    • /
    • v.6 no.4
    • /
    • pp.26-34
    • /
    • 2005
  • In this paper, a new rectification scheme to transform the uncalibrated stereo image pair into the calibrated one is suggested and its performance is analyzed by applying this scheme to the reconstruction of the intermediate views for multi-view stereoscopic display. In the proposed method, feature points are extracted from the stereo image pair by detecting the comers and similarities between each pixel of the stereo image pair. These detected feature points, are then used to extract moving vectors between the stereo image pair and the epipolar line. Finally, the input stereo image pair is rectified by matching the extracted epipolar line between the stereo image pair in the horizontal direction. Based on some experiments done on the synthesis of the intermediate views by using the calibrated stereo image pairs through the proposed rectification algorithm and the uncalibrated ones for three kinds of stereo image pairs; 'Man', 'Face' and 'Car', it is found that PSNRs of the intermediate views reconstructed from the calibrated images improved by about 2.5${\sim}$3.26 dB than those of the uncalibrated ones.

Epipolar Resampling from Kompsat-2 and Kompsat-3 (아리랑 위성 2호와 3호를 이용한 이종 영상 간 에피폴라 영상 생성)

  • Song, Jeong-Heon;Oh, Jae-Hong
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.17 no.4
    • /
    • pp.156-166
    • /
    • 2014
  • As of 2014, KARI (Korea Aerospace Research Institute) operates two high-resolution satellites such as Kompsat-2 and Kompsat-3. Kompsat-3 has capability of in-track stereo images acquisition but it is quite limited because the stereo mode lowers the spatial coverage in a trajectory. In this paper we analyze the epipolar geometry from the heterogeneous Kompsat-2 and Kompsat-3 image combination to epipolar resample them for 3D spatial data acquisition. The analysis was carried out using the piecewise approach with RPCs (Rational Polynomial Coefficients) and the result showed the parabolic epipolar curve pattern. We also concluded that the third order polynomial transformation is required for epipolar image resampling. The resampled image pair showed 1 pixel level of y-parallax and can be used for 3D display and digitizing.

EpiLoc: Deep Camera Localization Under Epipolar Constraint

  • Xu, Luoyuan;Guan, Tao;Luo, Yawei;Wang, Yuesong;Chen, Zhuo;Liu, WenKai
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.16 no.6
    • /
    • pp.2044-2059
    • /
    • 2022
  • Recent works have shown that the geometric constraint can be harnessed to boost the performance of CNN-based camera localization. However, the existing strategies are limited to imposing image-level constraint between pose pairs, which is weak and coarse-gained. In this paper, we introduce a pixel-level epipolar geometry constraint to vanilla localization framework without the ground-truth 3D information. Dubbed EpiLoc, our method establishes the geometric relationship between pixels in different images by utilizing the epipolar geometry thus forcing the network to regress more accurate poses. We also propose a variant called EpiSingle to cope with non-sequential training images, which can construct the epipolar geometry constraint based on a single image in a self-supervised manner. Extensive experiments on the public indoor 7Scenes and outdoor RobotCar datasets show that the proposed pixel-level constraint is valuable, and helps our EpiLoc achieve state-of-the-art results in the end-to-end camera localization task.

3-D Recognition of Position using Epipolar Line and Matching from Stereo Image (두개의 영상으로부터 Epipolar Line과 Matching을 이용한 3차원 물체의 위치 인식)

  • Cho, Seok-Je;Park, Kil-Houm;Lee, Kwang-Ho;Kim, Young-Mo;Ha, Yeong-Ho
    • Proceedings of the KIEE Conference
    • /
    • 1987.07b
    • /
    • pp.1441-1444
    • /
    • 1987
  • Extraction of dept.h information from stereo image uses the matching process between them and this requires a lot of computational time. In this paper, a matching using the feature points on the epipolar line is presented to save the computations. Feature points are obtained in both image and correlated each other. With the coordinates of the matched feature points and camera geometry, the position and depth informations are identified.

  • PDF

Stereo cameras calibration bases on Epipolar Rectification and its Application

  • Chaewieang, Pipat;Thepmanee, Teerawat;Kummool, Sart;Jaruvanawat, Anuchit;Sirisantisamrid, Kaset
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.246-249
    • /
    • 2003
  • The constraints necessary guarantee using the comparison of these extrinsic parameters, which each Rotation matrix and Translation Vector must be equal to the either, except the X-axis Translation Vector. Thus, we can not yet calculate the 3D-range measurement in the end of camera calibration. To minimize this disadvantage, the Epipolar Rectification has been proposed in the literature. This paper aims to present the development of Epipolar Rectification to calibrate Stereo cameras. The required computation of the transformation mapping between points in 3D-space is based on calculating the image point that appears on new image plane by using calibrated parameters. This computation is assumed from the rotating the old ones around their optical center until focal planes becomes coplanar, thereby containing the baseline, and the Z-axis of both camera coordinate to be parallel together. The optical center positions of the new extrinsic parameters are the same as the old camera, whereas the new orientation differs from the old ones by the suitable rotations. The intrinsic parameters are the same for both cameras. So that, after completed calibration process, immediately can calculate the 3D-range measurement. And the rectification determines a transformation of each image plane such that pairs of conjugate Epipolar lines become collinear and parallel to one of the image axis. From the experimental results verify the proposed technique are agreed with the expected specifications.

  • PDF

Generation of Epipolar Image Using Different Types of Satellite Sensors Images (이종 위성센서 영상을 이용한 에피폴라 영상 제작)

  • Sung, Mingyu;Choi, Sunyong;Jang, Seji
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.32 no.1
    • /
    • pp.39-47
    • /
    • 2014
  • In this study, the epipolar images were created by both methods of resolution adjustment and piecewise approach using RPC(Rational Polynomial coefficients) and ancillary data of IKONOS-2 and SPOT-5 satellite images whose resolutions are different from each other. The stereo geometry of these two satellite images was analyzed and the RPC block modelling was accomplished for generating epipolar images. In order to evaluate the accuracy of created epipolar images, the y-parallaxes were analyzed for the specific points which were apparently identified in mountainous, plain and urban area. Also the RMSEs of the specific points were calculated using the coordinates from the epipolar stereo images and the coordinates from the block triangulation. Y-parallaxes were within one pixel and the RMSEs were within two meters for X, Y and Z each.

Incorporation of Scene Geometry in Least Squares Correlation Matching for DEM Generation from Linear Pushbroom Images

  • Kim, Tae-Jung;Yoon, Tae-Hun;Lee, Heung-Kyu
    • Proceedings of the KSRS Conference
    • /
    • 1999.11a
    • /
    • pp.182-187
    • /
    • 1999
  • Stereo matching is one of the most crucial parts in DEM generation. Naive stereo matching algorithms often create many holes and blunders in a DEM and therefore a carefully designed strategy must be employed to guide stereo matching algorithms to produce “good” 3D information. In this paper, we describe one such a strategy designed by the use of scene geometry, in particular, the epipolarity for generation of a DEM from linear pushbroom images. The epipolarity for perspective images is a well-known property, i.e., in a stereo image pair, a point in the reference image will map to a line in the search image uniquely defined by sensor models of the image pair. This concept has been utilized in stereo matching by applying epipolar resampling prior to matching. However, the epipolar matching for linear pushbroom images is rather complicated. It was found that the epipolarity can only be described by a Hyperbola- shaped curve and that epipolar resampling cannot be applied to linear pushbroom images. Instead, we have developed an algorithm of incorporating such epipolarity directly in least squares correlation matching. Experiments showed that this approach could improve the quality of a DEM.

  • PDF

A New Intermediate View Reconstruction Scheme based-on Stereo Image Rectification Algorithm (스테레오 영상 보정 알고리즘에 기반한 새로운 중간시점 영상합성 기법)

  • 박창주;고정환;김은수
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.5C
    • /
    • pp.632-641
    • /
    • 2004
  • In this paper, a new intermediate view reconstruction method employing a stereo image rectification algorithm by which an uncalibrated input stereo image can be transformed into the calibrated one is suggested and its performance is analyzed. In the proposed method, feature point are extracted from the stereo image pair though detection of the corners and similarities between each pixel of the stereo image. And then, using these detected feature points, the moving vectors between stereo image and the epipolar line is extracted. Finally, the input stereo image is rectified by matching the extracted epipolar line between the stereo image in the horizontal direction and intermediate views are reconstructed by using these rectified stereo images. From some experiments on synthesis of the intermediate views by using three kinds of stereo image; a CCETT's stereo image of 'Man' and two stereo images of 'Face' & 'Car' captured by real camera, it is analyzed that PSNRs of the intermediate views reconstructed from the calibrated image by using the proposed rectification algorithm are improved by 2.5㏈ for 'Man', 4.26㏈ for 'Pace' and 3.85㏈ for 'Car' than !hose of the uncalibrated ones. This good experimental result suggests a possibility of practical application of the unposed stereo image rectification algorithm-based intermediate view reconstruction view to the uncalibrated stereo images.

On Design of Visual Servoing using an Uncalibrated Camera in 3D Space

  • Morita, Masahiko;Kenji, Kohiyama;Shigeru, Uchikado;Lili, Sun
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.1121-1125
    • /
    • 2003
  • In this paper we deal with visual servoing that can control a robot arm with a camera using information of images only, without estimating 3D position and rotation of the robot arm. Here it is assumed that the robot arm is calibrated and the camera is uncalibrated. We use a pinhole camera model as the camera one. The essential notion can be show, that is, epipolar geometry, epipole, epipolar equation, and epipolar constrain. These play an important role in designing visual servoing. For easy understanding of the proposed method we first show a design in case of the calibrated camera. The design is constructed by 4 steps and the directional motion of the robot arm is fixed only to a constant direction. This means that an estimated epipole denotes the direction, to which the robot arm translates in 3D space, on the image plane.

  • PDF

Epipolar Resampling Module for CAS500 Satellites 3D Stereo Data Processing (국토위성 3차원 데이터 생성을 위한 입체 기하 영상 생성 모듈 제작 및 테스트)

  • Oh, Jaehong;Lee, Changno
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.5_2
    • /
    • pp.939-948
    • /
    • 2020
  • CAS500-1 and CAS500-2 are high-resolution Earth-observing satellites being developed and scheduled to launch for land monitoring of Korea. The satellite information will be used for land usage analysis, change detection, 3D topological monitoring, and so on. Satellite image data of region of interests must be acquired in the stereo mode from different positions for 3D information generation. Accurate 3D processing and 3D display of stereo satellite data requires the epipolar image resampling process considering the pushbroom sensor and the satellite trajectory. This study developed an epipolar image resampling module for CAS-500 stereo data processing and verified its accuracy performance by testing along-track, across-track, and heterogeneous stereo data.