• Title/Summary/Keyword: Epipolar geometry

Search Result 61, Processing Time 0.029 seconds

On Design of Visual Servoing using an Uncalibrated Camera and a Calibrated Robot

  • Uchikado, Shigeru;Morita, Masahiko;Osa, Yasuhiro;Mabuchi, Tesuo;Tanya, Kanya
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2001.10a
    • /
    • pp.23.2-23
    • /
    • 2001
  • In this paper we deal with visual servoing that can control a robot arm with a camera using information of images only, without estimating 3D position and rotation of the robot arm. Here it is assumed that the robot arm is calibrated and the camera is uncalibrated. We use a pinhole camera model as the camera one. The essential notion can be show, that is, epipolar geometry, epipole, epipolar equation, and epipolar constrain. These play an important role in designing visual servoing. For easy understanding of the proposed method we first show a design in case of the calibrated camera. The design is constructed by 4 steps and the directional motion of the robot arm is fixed only to a constant direction. This means that an estimated epipole denotes the direction, to which the robot arm translates in 3D space, on the image plane.

  • PDF

Highly Dense 3D Surface Generation Using Multi-image Matching

  • Noh, Myoung-Jong;Cho, Woo-Sug;Bang, Ki-In
    • ETRI Journal
    • /
    • v.34 no.1
    • /
    • pp.87-97
    • /
    • 2012
  • This study presents an automatic matching method for generating a dense, accurate, and discontinuity-preserved digital surface model (DSM) using multiple images acquired by an aerial digital frame camera. The proposed method consists of two main procedures: area-based multi-image matching (AMIM) and stereo-pair epipolar line matching (SELM). AMIM evaluates the sum of the normalized cross correlation of corresponding image points from multiple images to determine the optimal height of an object point. A novel method is introduced for determining the search height range and incremental height, which are necessary for the vertical line locus used in the AMIM. This procedure also includes the means to select the best reference and target images for each strip so that multi-image matching can resolve the common problem over occlusion areas. The SELM extracts densely positioned distinct points along epipolar lines from the multiple images and generates a discontinuity-preserved DSM using geometric and radiometric constraints. The matched points derived by the AMIM are used as anchor points between overlapped images to find conjugate distinct points using epipolar geometry. The performance of the proposed method was evaluated for several different test areas, including urban areas.

A Study on True Ortho-photo Generation Using Epipolar Geometry and Classification Algorithm (에피폴라 기하와 군집화 알고리즘을 이용한 정밀 정사투영영상 제작에 관한 연구)

  • Oh, Kum-Hui;Hwang, Hyun-Deok;Kim, Jun-Chul;Shin, Sung-Woong
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.26 no.6
    • /
    • pp.633-641
    • /
    • 2008
  • This study introduces the method of detecting and restoring occlusion areas by using epipolar algorithm and K-means classification algorithm for true ortho-photo generation. In the past, the techniques of detecting occlusion areas are using the reference images or information of buildings. But, in this study the occlusion areas can be automatically detected by using DTM data and exterior orientation parameters. The detected occlusion areas can be restored by using anther images or the computed values which are determined in K-means classification algorithm. In addition, this method takes advantages of applying epipolar algorithm in order to find same location in overlapping areas among images.

Epipolar Resampling from Kompsat-2 and Kompsat-3 (아리랑 위성 2호와 3호를 이용한 이종 영상 간 에피폴라 영상 생성)

  • Song, Jeong-Heon;Oh, Jae-Hong
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.17 no.4
    • /
    • pp.156-166
    • /
    • 2014
  • As of 2014, KARI (Korea Aerospace Research Institute) operates two high-resolution satellites such as Kompsat-2 and Kompsat-3. Kompsat-3 has capability of in-track stereo images acquisition but it is quite limited because the stereo mode lowers the spatial coverage in a trajectory. In this paper we analyze the epipolar geometry from the heterogeneous Kompsat-2 and Kompsat-3 image combination to epipolar resample them for 3D spatial data acquisition. The analysis was carried out using the piecewise approach with RPCs (Rational Polynomial Coefficients) and the result showed the parabolic epipolar curve pattern. We also concluded that the third order polynomial transformation is required for epipolar image resampling. The resampled image pair showed 1 pixel level of y-parallax and can be used for 3D display and digitizing.

Stereo cameras calibration bases on Epipolar Rectification and its Application

  • Chaewieang, Pipat;Thepmanee, Teerawat;Kummool, Sart;Jaruvanawat, Anuchit;Sirisantisamrid, Kaset
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.246-249
    • /
    • 2003
  • The constraints necessary guarantee using the comparison of these extrinsic parameters, which each Rotation matrix and Translation Vector must be equal to the either, except the X-axis Translation Vector. Thus, we can not yet calculate the 3D-range measurement in the end of camera calibration. To minimize this disadvantage, the Epipolar Rectification has been proposed in the literature. This paper aims to present the development of Epipolar Rectification to calibrate Stereo cameras. The required computation of the transformation mapping between points in 3D-space is based on calculating the image point that appears on new image plane by using calibrated parameters. This computation is assumed from the rotating the old ones around their optical center until focal planes becomes coplanar, thereby containing the baseline, and the Z-axis of both camera coordinate to be parallel together. The optical center positions of the new extrinsic parameters are the same as the old camera, whereas the new orientation differs from the old ones by the suitable rotations. The intrinsic parameters are the same for both cameras. So that, after completed calibration process, immediately can calculate the 3D-range measurement. And the rectification determines a transformation of each image plane such that pairs of conjugate Epipolar lines become collinear and parallel to one of the image axis. From the experimental results verify the proposed technique are agreed with the expected specifications.

  • PDF

An Epipolar Rectification for Object Segmentation (객체분할을 위한 에피폴라 Rectification)

  • Jeong, Seung-Do;Kang, Sung-Suk;CHo, Jung-Won;Choi, Byung-Uk
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.29 no.1C
    • /
    • pp.83-91
    • /
    • 2004
  • An epipolar rectification is the process of transforming the epipolar geometry of a pair of images into a canonical form. This is accomplished by applying a homography to each image that maps the epipole to a predetermined point. In this process, rectified images transformed by homographies must be satisfied with the epipolar constraint. These homographies are not unique, however, we find out homographies that are suited to system's purpose by means of an additive constraint. Since the rectified image pair be a stereo image pair, we are able to find the disparity efficiently. Therefore, we are able to estimate the three-dimensional information of objects within an image and apply this information to object segmentation. This paper proposes a rectification method for object segmentation and applies the rectification result to the object segmentation. Using color and relative continuity of disparity for the object segmentation, the drawbacks of previous segmentation method, which are that the object is segmented to several region because of having different color information or another object is merged into one because of having similar color information, are complemented. Experimental result shows that the disparity of result image of proposed rectification method have continuity about unique object. Therefore we have confirmed that our rectification method is suitable to the object segmentation.

A New Rectification Scheme for Uncalibrated Stereo Image Pairs and Its Application to Intermediate View Reconstruction

  • Ko, Jung-Hwan;Jung, Yong-Woo;Kim, Eun-Soo
    • Journal of Information Display
    • /
    • v.6 no.4
    • /
    • pp.26-34
    • /
    • 2005
  • In this paper, a new rectification scheme to transform the uncalibrated stereo image pair into the calibrated one is suggested and its performance is analyzed by applying this scheme to the reconstruction of the intermediate views for multi-view stereoscopic display. In the proposed method, feature points are extracted from the stereo image pair by detecting the comers and similarities between each pixel of the stereo image pair. These detected feature points, are then used to extract moving vectors between the stereo image pair and the epipolar line. Finally, the input stereo image pair is rectified by matching the extracted epipolar line between the stereo image pair in the horizontal direction. Based on some experiments done on the synthesis of the intermediate views by using the calibrated stereo image pairs through the proposed rectification algorithm and the uncalibrated ones for three kinds of stereo image pairs; 'Man', 'Face' and 'Car', it is found that PSNRs of the intermediate views reconstructed from the calibrated images improved by about 2.5${\sim}$3.26 dB than those of the uncalibrated ones.

A Frism Mirror Based Stereo Vision : Geometry (프리즘 거울을 이용한 단안렌즈 스테레오비전)

  • 구창운;김충원
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 1999.11a
    • /
    • pp.424-427
    • /
    • 1999
  • 적은 연산으로 정확한 정합점을 추출한다는 것은 고전적인 스테레오비전의 가장 큰 단점이다. 이러한 문제점을 해결하기 위해 효과적인 정합점 검출 알고리듬이 많이 연구되고 있으나, 뚜렷한 해결 방법은 없다. 따라서 본 논문에서는 위와 같은 문제점들을 해결 할 수 있는 거울을 이용한 스테레오 비전 시스템을 제안한다. 제안된 시스템은 보다 저렴한 가격으로 스테레오 시스템을 구추할 수 있으며, 한 대의 카메라만을 사용하기 때문에 칼리브레이션 과정을 간략화 할 수 있다. 거울에 반사된 오른쪽과 왼쪽 영상은 거울의 각도에 의해서 동일 이미지 평면의 좌우에 촬상이 된다. 같은 이미지 평면에 촬상된 두 영상의 epipolar line은 x축과 평행한 scan line을 갖는다. 따라서 본 논문에서 제안한 시스템은 정합점을 추출하기 위한 epipolar 검출 알고리듬이 필요하지 않고 한 대의 카메라만을 사용하기 때문에 칼리브레이션 과정을 간략화 할 수 있다. 또한 동일한 이미지 평면에 오른쪽 이미지와 왼쪽 이미지가 촬상되기 때문에 두 영상의 명암도 차이를 보정하기 위한 정규화 작업도 필요하지 않다. 위와 같은 장점은 고전적인 스테레오 비전에서 발생되는 문제점들을 효과적으로 보완한다. 본 논문에서 제안된 시스템에 대한 프로토타입을 제작하여 실험하였으며, 그 결과를 제시하였다.

  • PDF

Multiview real-feeling mixed-reality system using epipolar geometry (등극선 기하를 이용한 다시점 실감 혼합현실 시스템)

  • 김장헌;김장현
    • Proceedings of the Korea Multimedia Society Conference
    • /
    • 2002.11b
    • /
    • pp.442-445
    • /
    • 2002
  • 기존 증강현실과 같은 합성 추적기법에서, 시점을 확장시켜 깊이감을 얻을 수 있는 다시점 영상기술을 적용하였을 경우 특징추출 및 대응의 연산량은 급격히 증가하며, 넓어진 FOV(field-of-view)는 대응을 어렵게 하여 특징의 흔들림을 초래하고 광원과 가려진 영역의 영향을 증대시켜 시점간의 추적을 어렵게 한다. 이에 본 논문은 등극선 기하조건을 고려한 다시점 실감 영상 합성 추적 기법을 제안한다.

  • PDF