• Proceedings of the KIEE Conference
• /
• 2000.07d
• /
• pp.3047-3049
• /
• 2000

The ability to efficiently and robustly recover accurate 3D terrain models from sets of stereoscopic images is important to many civilian and military applications. To develop an effective and practical terrain modeling system. We propose the methods which detect unreliable elevations in digital elevation maps (DEMs). and fuse several DEMs from multiple sources into an accurate and reliable result. This paper focuses on two key factors for generating robust 3D terrain models. the ability to detect unreliable elevation estimates. and to fuse the reliable elevations into a single optimal terrain model. We apply the correlation score methodology to reconstruct accurate DEM for multi-image and show the method is more effective than the conventional averaging method. The photo-realistic simulator is used for generating four simulated images from ground truth DEM and orthoimage.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.36 no.4
• /
• pp.271-277
• /
• 2018

Generating an epipolar image which is removed a y-parallax from an original image is an essential technique for creating a 3D stereoscopic model or producing a map. In epipolar image production, there is a method of generating epipolar images by estimating the relative orientation parameters after matching the extracted distinct points in two images and a method of generating epipolar images by using the baseline and rotation angles of the two images after determining the exterior orientation parameters In this study, it was proposed a methodology to generate epipolar images using direction cosine in the exterior orientation parameters of the input images, and a method to use the transformation matrix for easy calculation when converting from the original image to the epipolar image. The applicability of the proposed methodology was evaluated by using images taken from the fixed wing and rotary wing drones. As a result, it was found that epipolar images were generated regardless of the type of drones.

• Journal of KIISE:Computer Systems and Theory
• /
• v.33 no.6
• /
• pp.354-362
• /
• 2006

This paper suggests a method for generating high qualify stereo video avatar to support visual communication in a CAVE$^{TM}$-like system. In such a system because of frequent change of light projected onto screens around user, it is not easy to extract user silhouette robustly, which is an essential step to generate a video avatar. In this study, we use an infrared reflective image acquired by a grayscale camera with a longpass filter so that the change of visible light on a screen is blocked to extract robust user silhouette. In addition, using two color cameras positioned at a distance of a binocular disparity of human eyes, we acquire two stereo images of the user for fast generation and stereoscopic display of a high quality video avatar without 3D reconstruction. We also suggest a fitting algorithm of a silhouette mask on an infrared reflective image into an acquired color image to remove background. Generated stereo images of a video avatar are texture mapped into a plane in virtual world and can be displayed in stereoscopic using frame sequential stereo method. Suggested method have advantages that it generates high quality video avatar taster than 3D approach and it gives stereoscopic feeling to a user 2D based approach can not provide.

• Journal of Broadcast Engineering
• /
• v.19 no.1
• /
• pp.31-43
• /
• 2014

A depth map is an important component for stereoscopic image generation. Since the depth map acquired from a depth camera has a low resolution, upsamling a low-resolution depth map to a high-resolution one has been studied past decades. Upsampling methods are evaluated by objective evaluation tools such as PSNR, Sharpness Degree, Blur Metric. As well, the subjective quality is compared using virtual views generated by DIBR (depth image based rendering). However, works on the analysis of the relation between depth map upsampling and stereoscopic images are relatively few. In this paper, we investigate the relationship between subjective evaluation of stereoscopic images and objective performance of upsampling methods using cross correlation and linear regression. Experimental results demonstrate that the correlation of edge PSNR and visual fatigue is the highest and the blur metric has lowest correlation. Further, from the linear regression, we found relative weights of objective measurements. Further we introduce a formulae that can estimate 3D performance of conventional or new upsampling methods.

• Journal of Broadcast Engineering
• /
• v.17 no.2
• /
• pp.305-315
• /
• 2012

Color correction between two or multiple images is very crucial for the development of subsequent algorithms and stereoscopic 3D camera system. Even though various color correction methods are proposed recently, there are few methods for measuring the performance of these methods. In addition, when two images have view variation by camera positions, previous methods for the performance measurement may not be appropriate. In this paper, we propose a method of measuring color difference between corresponding images for color correction. This method finds matching points that have the same colors between two scenes to consider the view variation by correspondence searches. Then, we calculate statistics from neighbor regions of these matching points to measure color difference. From this approach, we can consider misalignment of corresponding points contrary to conventional geometric transformation by a single homography. To handle the case that matching points cannot cover the whole regions, we calculate statistics of color difference from the whole image regions. Finally, the color difference is computed by the weighted summation between correspondence based and the whole region based approaches. This weight is determined by calculating the ratio of occupying regions by correspondence based color comparison.

• Journal of Broadcast Engineering
• /
• v.19 no.3
• /
• pp.362-371
• /
• 2014

Blur variation caused by camera de-focusing provides a proper cue for depth estimation. Depth from Defocus (DFD) technique calculates the blur amount present in an image considering that blur amount is directly related to scene depth. Conventional DFD methods use two defocused images that might yield the low quality of an estimated depth map as well as a reconstructed infocused image. To solve this, a new DFD methodology based on infocused and defocused images is proposed in this paper. In the proposed method, the outcome of Subbaro's DFD is combined with a novel edge blur estimation method so that improved blur estimation can be achieved. In addition, a saliency map mitigates the ill-posed problem of blur estimation in the region with low intensity variation. For validating the feasibility of the proposed method, twenty image sets of infocused and defocused images with 2K FHD resolution were acquired from a camera with a focus control in the experiments. 3D stereoscopic image generated by an estimated depth map and an input infocused image could deliver the satisfactory 3D perception in terms of spatial depth perception of scene objects.

• Journal of Korea Multimedia Society
• /
• v.19 no.3
• /
• pp.548-556
• /
• 2016

Integral imaging is an auto-stereoscopic display method that can produce 3D image of a finite viewing window through an array of micro elemental lenses. Integral imaging requires the pickup part of each elemental images acquisition and display part of reconstruction of the images. The successful reconstructed image depends on various parameters such as distance between lens arrays and display device, focal length of lenses, and a number of the array. In this paper, we present reconstruction emulator for display of Integral imaging in order to adjust parameters for 3D contents reconstruction and to observe the result from different configuration. Especially, we provide the user interface for the emulator to control the distance easily. We have confirmed through various experiments that the emulator adjusted the distance and could check error in the process of creating elemental images.

• Korean Journal of Human Ecology
• /
• v.23 no.4
• /
• pp.653-663
• /
• 2014

In the design of stereoscopic clothing items, the 3D shapes of the space between clothing and body (SCB; Space shape between Clothing and Body) can be very important clues to improve the fit for various body shapes. Therefore, this research suggests a method for extracting the shape of SCB using the mold bra cup as an example. The SCBs were extracted from two kinds of 3D images, a small-breasted women's nude breast images and bra-wearing images. The the mold bra cups were compressed by wearing, and the outer and lower part of the SCBs could not be obtained because of the movement of the breast volume in the bras. Therefore, the SCBs could not be applied to the design of the mold bra cups directly. However, the suggested method can be useful when it is applied to stiffer clothing items and body parts whose shapes are not changed easily, such as a helmet or other body protectors.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.52 no.4
• /
• pp.212-222
• /
• 2003

The ability to efficiently and robustly recover accurate 3D terrain models from sets of stereoscopic images is important to many civilian and military applications. A stereo matching has been an important tool for reconstructing three dimensional terrain. However, there exist many factors causing stereo matching error, such as occlusion, no feature or repetitive pattern in the correlation window, intensity variation, etc. Among them, occlusion can be only resolved by true multi-image stereo. In this paper, we present multi-image stereo method using DEM fusion as one of efficient and reliable true multi-image methods. Elevations generated by all pairs of images are combined by the fusion process which accepts an accurate elevation and rejects an outlier. We propose three fusion schemes: THD(Thresholding), BPS(Best Pair Selection) and MS(Median Selection). THD averages elevations after rejecting outliers by thresholding, while BPS selects the most reliable elevation. To determine the reliability of a elevation or detect the outlier, we employ the measure of self-consistency. The last scheme, MS, selects the median value of elevations. We test the effectiveness of the proposed methods with a quantitative analysis using simulated images. Experimental results indicate that all three fusion schemes showed much better improvement over the conventional binocular stereo in natural terrain of 29 Palms and urban site of Avenches.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.12
• /
• pp.168-175
• /
• 2013

Color consistency in stereoscopic contents is important for 3D display systems. Even with a stereo camera of the same model and with the same hardware settings, complex color discrepancies occur when acquiring high quality stereo images. In this paper, we propose an integrated color matching method that use cumulative histogram in global matching and estimated 3D-distance for the stage of local matching. The distance between the current pixel and the target local region is computed using depth information and the spatial distance in the 2D image plane. The 3D-distance is then used to determine the similarity between the current pixel and the target local region. The overall algorithm is described as follow; First, the cumulative histogram matching is introduced for reducing global color discrepancies. Then, the proposed local color matching is established for reducing local discrepancies. Finally, a weight-based combination of global and local matching is computed. Experimental results show the proposed algorithm has improved global and local error correction performance for stereoscopic contents with respect to other approaches.