• Journal of Broadcast Engineering
• /
• v.25 no.5
• /
• pp.685-697
• /
• 2020

Immersive media videos, such as panorama and 360-degree videos, must provide a sense of realism as if the user visited the space in the video, so they should be able to represent the reality of the real world. However, in panorama and 360-degree videos, objects appear to overlap or disappear due to parallax between cameras, and such parallax distortion may interfere with immersion of the user's content. Accordingly, although many video stitching algorithms have been proposed to overcome parallax distortion, parallax distortion still occurs due to the low performance of the Object detection module and limitations of the Seam generation method. Therefore, this paper analyzes the limitations of the existing video stitching technology and proposes a method for detecting and correcting parallax distortion of video stitching using the LDPM (Local Differential Pixel Mean) image evaluation method that overcomes the limitations of the video stitching technique.

• Journal of Broadcast Engineering
• /
• v.25 no.6
• /
• pp.882-897
• /
• 2020

Recently, the use of immersive media contents representing Panorama and 360° video is increasing. Since the viewing angle is limited to generate the content through a general camera, image stitching is mainly used to combine images taken with multiple cameras into one image having a wide field of view. However, if the parallax between the cameras is large, parallax distortion may occur in the stitched image, which disturbs the user's content immersion, thus an image stitching overcoming parallax distortion is required. The existing Seam Optimization based image stitching method to overcome parallax distortion uses energy function or object segment information to reflect the location information of objects, but the initial seam generation location, background information, performance of the object detector, and placement of objects may limit application. Therefore, in this paper, we propose an image stitching method that can overcome the limitations of the existing method by adding a weight value set differently according to the type of object to the energy value using object detection based on deep learning.

• Korean Journal of Optics and Photonics
• /
• v.31 no.2
• /
• pp.88-95
• /
• 2020

In this study, we present methods to quantitatively analyze and correct the distortions and biocular parallaxes in a head-up display (HUD). To analyze asymmetrical distortions, five kinds of distortions are proposed and evaluated at five eye positions of an eyebox. The differences between distortions evaluated at the four corners of the eyebox and that at the center are defined as the relative distortions, which occur due to head motion of the driver. We also define the convergence and divergence parallaxes at six biocular positions in the eyebox to quantitatively analyze them. Using these analytical methods, we constrain the degree of biocular parallaxes and distortion changes with eye position to be small, so that an optical system nearly free from them can be obtained by optimization design for HUD optics.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.30 no.1
• /
• pp.21-30
• /
• 2012

When two bands have different look angle in a space-borne camera system, the registration between two bands is required. The registration cannot be modeled with constant parameters because of dynamic of platform and parallax effect. The parallax effect is caused by terrain relief, hence it causes local distortion between two bands. Therefore, the terrain relief correction in order to reduce the parallax effect is required for better registration result, especially for high resolution image data. Such terrain relief correction also can be applied to image data acquired from multiple detectors with different look angle within a band, which is a one of commonly used configuration for a wider swath in space-borne camera system, in order to reduce the distortion between detectors. The RFM is a popular abstract model in remote sensing field, which gives us the relationship between the image plane and geodetic coordinate system. Therefore, we propose a terrain relief correction method based on the RFM. The experiment showed very promising result.

• Korean Journal of Optics and Photonics
• /
• v.20 no.2
• /
• pp.87-93
• /
• 2009

Variation of the observer's viewing position is one of the major causes of image space distortion in the stereoscopic display. Especially, a large image distortion, which is caused by different depth direction positions of the observer's two eyes, is made by the observer's rotation movement in relation to the center of the screen. This is different from distortion of horizontal and depth directional movement of the observer. In this paper, we analyzed distortion of the image space due to the observer's rotation movement and showed the corrected result of distortion through simulation in the stereoscopic display. Finally, we showed that the distortion shape of the observer's rotation movement is different from horizontal and depth directional movement of the observer.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.28 no.6
• /
• pp.599-606
• /
• 2015

International Hydrographic Organization(IHO) adopted standard S-100 as the international standard Geographic Information System(GIS) that can be generally used in the maritime sector. Accordingly, the next-generation system to support navigation information based on GIS standard technology has being developed. AR based navigation information system that supported navigation by overlapping navigation information on the CCTV image has currently being developed. In this study, we considered the application of a transparent display as a method to support efficiently this system. When a transparent display applied, the image distortion caused by using a wide-angle lens for parallax secure, and the disc s, and demonstrated the applicability of the technology by developing a prototype.

• Journal of Broadcast Engineering
• /
• v.24 no.6
• /
• pp.992-1001
• /
• 2019

In many applications, images acquired from multiple cameras are stitched to form an image with a wide viewing angle. We propose a method of estimating a seam line using motion information to stitch multiple images without distortion of the moving object. Existing seam estimation techniques usually utilize an energy function based on image gradient information and parallax. In this paper, we propose a seam estimation technique that prevents distortion of moving object by adding temporal motion information, which is calculated from the gradient information of each frame. We also propose a measure to quantify the distortion level of stitched images and to verify the performance differences between the existing and proposed methods.

• Journal of the Optical Society of Korea
• /
• v.18 no.5
• /
• pp.517-522
• /
• 2014

In this paper we propose an axially distributed image-sensing method with a wide-angle lens to capture the wide-area scene of 3D objects. A lot of parallax information can be collected by translating the wide-angle camera along the optical axis. The recorded wide-area elemental images are calibrated using compensation of radial distortion. With these images we generate volumetric slice images using a computational reconstruction algorithm based on ray back-projection. To show the feasibility of the proposed method, we performed optical experiments for visualization of a partially occluded 3D object.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.37 no.4
• /
• pp.267-277
• /
• 2019

Photogrammetry and computer vision are identical in determining the three-dimensional coordinates of images taken with a camera, but the two fields are not directly compatible with each other due to differences in camera lens distortion modeling methods and camera coordinate systems. In general, data processing of drone images is performed by bundle block adjustments using computer vision-based software, and then the plotting of the image is performed by photogrammetry-based software for mapping. In this case, we are faced with the problem of converting the model of camera lens distortions into the formula used in photogrammetry. Therefore, this study described the differences between the coordinate systems and lens distortion models used in photogrammetry and computer vision, and proposed a methodology for converting them. In order to verify the conversion formula of the camera lens distortion models, first, lens distortions were added to the virtual coordinates without lens distortions by using the computer vision-based lens distortion models. Then, the distortion coefficients were determined using photogrammetry-based lens distortion models, and the lens distortions were removed from the photo coordinates and compared with the virtual coordinates without the original distortions. The results showed that the root mean square distance was good within 0.5 pixels. In addition, epipolar images were generated to determine the accuracy by applying lens distortion coefficients for photogrammetry. The calculated root mean square error of y-parallax was found to be within 0.3 pixels.

• Korean Journal of Remote Sensing
• /
• v.24 no.4
• /
• pp.351-358
• /
• 2008

KOMPSAT-5 will be launched in 2010 carrying a SAR (Synthetic Aperture Radar) system to obtain high resolution images of the earth surface regardless of weather or solar condition. In this paper, the orbits of KOMPSAT-5 and the imaging modes of SAR were analyzed for radargrammetry, and the best image pairs were suggested. We set the pass number from the nearest orbit to a given ground point and selected image pairs for radargrarnmetry, with height sensitivity of parallax higher than 0.5 to achieve enough height resolution and with the value lower than 0.8 to avoid errors from geometric distortion. On the equator, for example, where the distance between two adjacent passes is fixed to 95 km, we solved the orbit geometry and found that the image pairs with the pass numbers of 3-2 and 5-3 are suitable for radargrarnmetry. As the examples with arbitrary latitude, we selected Daejeon and Sejong Antarctic stations and calculated the orbital elements by using STK software. Three image pairs (5-4, 7-5 and 8-5) were found suitable for radargrammetry at Daejeon while 10 pairs (8-6, 9-7, 10-7, 11-8, 12-8, 13-9, 14-9, 15-9, 15-10 and 15-11) at Sejong Antarctic station.