• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.16 no.6
• /
• pp.2044-2059
• /
• 2022

Recent works have shown that the geometric constraint can be harnessed to boost the performance of CNN-based camera localization. However, the existing strategies are limited to imposing image-level constraint between pose pairs, which is weak and coarse-gained. In this paper, we introduce a pixel-level epipolar geometry constraint to vanilla localization framework without the ground-truth 3D information. Dubbed EpiLoc, our method establishes the geometric relationship between pixels in different images by utilizing the epipolar geometry thus forcing the network to regress more accurate poses. We also propose a variant called EpiSingle to cope with non-sequential training images, which can construct the epipolar geometry constraint based on a single image in a self-supervised manner. Extensive experiments on the public indoor 7Scenes and outdoor RobotCar datasets show that the proposed pixel-level constraint is valuable, and helps our EpiLoc achieve state-of-the-art results in the end-to-end camera localization task.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.1121-1125
• /
• 2003

In this paper we deal with visual servoing that can control a robot arm with a camera using information of images only, without estimating 3D position and rotation of the robot arm. Here it is assumed that the robot arm is calibrated and the camera is uncalibrated. We use a pinhole camera model as the camera one. The essential notion can be show, that is, epipolar geometry, epipole, epipolar equation, and epipolar constrain. These play an important role in designing visual servoing. For easy understanding of the proposed method we first show a design in case of the calibrated camera. The design is constructed by 4 steps and the directional motion of the robot arm is fixed only to a constant direction. This means that an estimated epipole denotes the direction, to which the robot arm translates in 3D space, on the image plane.

• Journal of the Korean Association of Geographic Information Studies
• /
• v.17 no.4
• /
• pp.156-166
• /
• 2014

As of 2014, KARI (Korea Aerospace Research Institute) operates two high-resolution satellites such as Kompsat-2 and Kompsat-3. Kompsat-3 has capability of in-track stereo images acquisition but it is quite limited because the stereo mode lowers the spatial coverage in a trajectory. In this paper we analyze the epipolar geometry from the heterogeneous Kompsat-2 and Kompsat-3 image combination to epipolar resample them for 3D spatial data acquisition. The analysis was carried out using the piecewise approach with RPCs (Rational Polynomial Coefficients) and the result showed the parabolic epipolar curve pattern. We also concluded that the third order polynomial transformation is required for epipolar image resampling. The resampled image pair showed 1 pixel level of y-parallax and can be used for 3D display and digitizing.

• Journal of Korean Society for Geospatial Information Science
• /
• v.15 no.4
• /
• pp.81-88
• /
• 2007

The geometry of satellite image captured by linear CCD sensor is different from that of frame camera image. The fact that the exterior orientation parameters for satellite image with linear CCD sensor varies from scan line by scan line, causes the difference of image geometry between frame and linear CCD sensor. Therefore, we need the epipolar geometry for linear CCD image which differs from that of frame camera image. In this paper, we proposed a method of resampling linear CCD satellite image in epipolar geometry under the assumption that image is not formed in perspective projection but in parallel projection, and the sensor model is a 2D affine sensor model based on parallel projection. For the experiment, IKONOS stereo images, which are high resolution linear CCD images, were used and tested. As results, the spatial accuracy of 2D affine sensor model is investigated and the accuracy of epipolar resampled image with RFM was presented.

• Korean Journal of Remote Sensing
• /
• v.18 no.4
• /
• pp.233-242
• /
• 2002

In this paper, an epipolar model without the ephemeris data is proposed. Also, various epipolar models such as the epipolar geometry of perspective sensor, the one proposed by Gupta and Hartley and the one based on the Orun and Natarajan's sensor model are reviewed and their accuracy are quantitatively analyzed using devised measure. Modeling data from ground control points, ground control points, ephemeris data and independent checking points are selected on SPOT over Taejon and Boryung area and KOMPSAT over Taejon and Nonsan area. Based on the results, the epipolar model of perspective sensor and the one by Gupta and Hartley have the average accuracy within 1 pixel but show high errors in several checking points. The proposed epipolarity model provides better results than that of perspective sensor and by Gupta and Hartley. Also, it shows the accuracy similar to the one based on Orun and Natarajan's sensor model.

• Journal of KIBIM
• /
• v.5 no.2
• /
• pp.46-54
• /
• 2015

Vision-based tracking has been proposed as a means to efficiently track a large number of construction resources operating in a congested site. In order to obtain 3D coordinates of an object, it is necessary to employ stereo-vision theories. Detecting and tracking of multiple objects require an entity matching process that finds corresponding pairs of detected entities across the two camera views. This paper proposes an efficient way of entity matching for tracking of construction workers. The proposed method basically uses epipolar geometry which represents the relationship between the two fixed cameras. Each pixel coordinate in a camera view is projected onto the other camera view as an epipolar line. The proposed method finds the matching pair of a worker entity by comparing the proximity of the all detected entities in the other view to the epipolar line. Experimental results demonstrate its suitability for automated entity matching for 3D vision-based tracking of construction workers.

• ETRI Journal
• /
• v.34 no.1
• /
• pp.87-97
• /
• 2012

This study presents an automatic matching method for generating a dense, accurate, and discontinuity-preserved digital surface model (DSM) using multiple images acquired by an aerial digital frame camera. The proposed method consists of two main procedures: area-based multi-image matching (AMIM) and stereo-pair epipolar line matching (SELM). AMIM evaluates the sum of the normalized cross correlation of corresponding image points from multiple images to determine the optimal height of an object point. A novel method is introduced for determining the search height range and incremental height, which are necessary for the vertical line locus used in the AMIM. This procedure also includes the means to select the best reference and target images for each strip so that multi-image matching can resolve the common problem over occlusion areas. The SELM extracts densely positioned distinct points along epipolar lines from the multiple images and generates a discontinuity-preserved DSM using geometric and radiometric constraints. The matched points derived by the AMIM are used as anchor points between overlapped images to find conjugate distinct points using epipolar geometry. The performance of the proposed method was evaluated for several different test areas, including urban areas.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.51 no.5
• /
• pp.212-219
• /
• 2002

In this paper, the epipolar geometry, genera17y used as a pin-hole camera model, is newly adapted to our proposed method that enables the affine reconstruction of the 3D object from two projected views. The proposed method models the projective projection of inherent X-ray imaging system, obviates the need to attach artifirially constructed material on the body, and requires none of the prior-knowledge regarding to intrinsic and extrinsic parameters of two X-ray imaging systems. The optimum numerical solution is obtained by applying the least mean square estimator to corresponding points on two projected X-ray planes. The performance of this proposed method is Quantitatively analyzed using computer synthesized model of Cochlear implantation electrodes. In simulated experiments, the propnsed method is insensitive to the added random noise, the scaling factor change, the center point change, and rotational angular change between two projection planes, as well as enables the stable 3D reconstruction in least square sense even in worst testing cases.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.26 no.6
• /
• pp.633-641
• /
• 2008

This study introduces the method of detecting and restoring occlusion areas by using epipolar algorithm and K-means classification algorithm for true ortho-photo generation. In the past, the techniques of detecting occlusion areas are using the reference images or information of buildings. But, in this study the occlusion areas can be automatically detected by using DTM data and exterior orientation parameters. The detected occlusion areas can be restored by using anther images or the computed values which are determined in K-means classification algorithm. In addition, this method takes advantages of applying epipolar algorithm in order to find same location in overlapping areas among images.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.246-249
• /
• 2003

The constraints necessary guarantee using the comparison of these extrinsic parameters, which each Rotation matrix and Translation Vector must be equal to the either, except the X-axis Translation Vector. Thus, we can not yet calculate the 3D-range measurement in the end of camera calibration. To minimize this disadvantage, the Epipolar Rectification has been proposed in the literature. This paper aims to present the development of Epipolar Rectification to calibrate Stereo cameras. The required computation of the transformation mapping between points in 3D-space is based on calculating the image point that appears on new image plane by using calibrated parameters. This computation is assumed from the rotating the old ones around their optical center until focal planes becomes coplanar, thereby containing the baseline, and the Z-axis of both camera coordinate to be parallel together. The optical center positions of the new extrinsic parameters are the same as the old camera, whereas the new orientation differs from the old ones by the suitable rotations. The intrinsic parameters are the same for both cameras. So that, after completed calibration process, immediately can calculate the 3D-range measurement. And the rectification determines a transformation of each image plane such that pairs of conjugate Epipolar lines become collinear and parallel to one of the image axis. From the experimental results verify the proposed technique are agreed with the expected specifications.