• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.2
• /
• pp.728-741
• /
• 2015

Stereo vision has become an important technical issue in the field of 3D imaging, machine vision, robotics, image analysis, and so on. The depth map extraction from stereo video is a key technology of stereoscopic 3D video requiring stereo correspondence algorithms. This is the matching process of the similarity measure for each disparity value, followed by an aggregation and optimization step. Since it requires a lot of computational power, there are significant speed-performance advantages when exploiting parallel processing available on processors. In this situation, multi-core CPU may allow many parallel programming technologies to be realized in users computing devices. This paper proposes parallel implementations for calculating disparity map using a shared memory programming and exploiting the streaming SIMD extension technology. By doing so, we can take advantage both of the hardware and software features of multi-core processor. For the performance evaluation, we implemented a parallel SAD algorithm with OpenMP and SSE2. Their processing speeds are compared with non parallel version on stereoscopic streaming video. The experimental results show that both technologies have a significant effect on the performance and achieve great improvements on processing speed.

• Proceedings of the IEEK Conference
• /
• 2006.06a
• /
• pp.437-438
• /
• 2006

Virtual view synthesis is essential for 3DTV systems, which utilizes the motion parallax cue. In this paper, we propose a multi-step view synthesis algorithm to efficiently reconstruct an arbitrary view from limited number of known views of a 3D scene. We describe an efficient image rectification procedure which guarantees that an interpolation process produce valid views. This rectification method can deal with all possible camera motions. The idea consists of using a polar parameterization of the image around the epipole. Then, to generate intermediate views, we use an efficient dense disparity estimation algorithm considering features of stereo image pairs. Main concepts of the algorithm are based on the region dividing bidirectional pixel matching. The estimated disparities are used to synthesize intermediate view of stereo images. We use computer simulation to show the result of the proposed algorithm.

• Smart Media Journal
• /
• v.2 no.4
• /
• pp.27-33
• /
• 2013

Multi-view video system provides both realistic 3D feelings and free-view navigation. But it is hard to transmit too huge data, so we send only two or three view images and generate intermediate view image using depth information. In this paper, we propose high quality multi-view image generation method from stereoscopic images. Since the stereo matching method does not provide accurate disparity values for all the pixels, especially at the occlusion area, we propose an occlusion handling method using the background pixels at first. We also apply a joint bilateral filtering to enhance the disparity map at the object boundary since it can affect the quality of synthesized images significantly. Finally, we can generate virtual view images at intermediate view positions using confidence map to reduce bad pixel and hole's error. Experimental results show the proposed method performs better than the conventional method.

• Korean Journal of Geomatics
• /
• v.2 no.1
• /
• pp.47-55
• /
• 2002

Remote sensing is the science and art of obtaining information about an object, area or phenomenon through the analysis of data acquired by a device that is not in contact with the object, area, or phenomenon under investigation./sup 1)/ EOC (Electro -Optical Camera) sensor loaded on the KOMPSAT-1 (Korea Multi- Purpose Satellite-1) performs the earth remote sensing operation. EOC can get high-resolution images of ground distance 6.6m during photographing; it is possible to get a tilt image by tilting satellite body up to 45 degrees at maximum. Accordingly, the device developed in this study enables to obtain images by photographing one pair of tilt image for the same point from two different planes. KOMPSAT-1 aims to obtain a Korean map with a scale of 1:25,000 with high resolution. The KOMPSAT-1 developed automated feature extraction system based on stereo satellite image. It overcomes the limitations of sensor and difficulties associated with preprocessing quite effectively. In case of using 6, 7 and 9 ground control points, which are evenly spread in image, with 95% of reliability for horizontal and vertical position, 3-dimensional positioning was available with accuracy of 6.0752m and 9.8274m. Therefore, less than l0m of design accuracy in KOMPSAT-1 was achieved. Also the ground position error of ortho-image, with reliability of 95%, is 17.568m. And elevation error showing 36.82m was enhanced. The reason why elevation accuracy was not good compared with the positioning accuracy used stereo image was analyzed as a problem of image matching system. Ortho-image system is advantageous if accurate altitude and production of digital elevation model are desired. The Korean map drawn on a scale of 1: 25,000 by using the new technique of KOMPSAT-1 EOC image adopted in the present study produces accurate result compared to existing mapping techniques involving high costs with less efficiency.

• Journal of Broadcast Engineering
• /
• v.9 no.3
• /
• pp.185-195
• /
• 2004

This paper presents a multi-depth map fusion method for the 3D scene reconstruction. It fuses depth maps obtained from the stereo matching technique and the depth camera. Traditional stereo matching techniques that estimate disparities between two images often produce inaccurate depth map because of occlusion and homogeneous area. Depth map obtained from the depth camera is globally accurate but noisy and provide a limited depth range. In order to get better depth estimates than these two conventional techniques, we propose a depth map fusion method that fuses the multi-depth maps from stereo matching and the depth camera. We first obtain two depth maps generated from the stereo matching of 3-view images. Moreover, a depth map is obtained from the depth camera for the center-view image. After preprocessing each depth map, we select a depth value for each pixel among them. Simulation results showed a few improvements in some background legions by proposed fusion technique.

• Journal of Biomedical Engineering Research
• /
• v.19 no.5
• /
• pp.531-538
• /
• 1998

This paper represents the design of 3D endoscopic image processing system in order to Improve visualization and enhance the ability of the surgeon to perform delicate endoscopic surgery. The proposed 3D systems have four features of stereo endoscopic image processing The multiplexer give field seauential stereo for recording and for aligning cameras and viewing stereo with 3D monitor. Demultiplexing of the field sequential image which separates out the R and L images for dual TFT-LCD 3D monitor viewed with passive polarized glasses. separable processing of the left and right eye images, and design of TFT-LCD 3D monitor. The viewing angle, zone, and image quality of the Polarization-type Stereoscopic Display (SM500TFT-3D) system which we have developed using 15 Samsung TFT-1.CD with a screen resolution of 1024×768 pixels were measured and compared with those of Electric Shutter-type Stereoscopic Display system. The result of experiments shows that the Polarization-type Stereoscopic Display System using TFT-LCD has a wade viewing angle and zone which Is necessary fort multi-view and it has better image quality and stability of the optical performances than the Electric Shutter-type does.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.12 no.12
• /
• pp.2146-2152
• /
• 2008

In In this paper, we proposed a new JPEG2000 codec using multiresolution-based rendering (MRBR) technique for video compression of 3-dimensional digital cinema. We introduced discrete wavelet transform (DWT) for stereoscopic image and stereo matching technique in the wavelet domain. The disparity was extracted using stereo matching and transmitted with the reference (left) image. Since the generated right image was degraded by the occlusion lesion, the residual image which is generated from difference between the original right image and the generated one was transmitted at the same tine. The disparity data was extracted using the dynamic programming method in the disparity domain. There is high correlation between the higher and lower subbands. Therefore we decreased the calculation amount and enhanced accuracy by restricting the search window and applying the disparity information generated from higher subband.

• Proceedings of the KSRS Conference
• /
• 2003.11a
• /
• pp.248-250
• /
• 2003

An automatic approach and strategy for extracting building information from aerial images using combined image analysis and interpretation techniques is described in this paper. A dense DSM is obtained by stereo image matching. Multi-band classification, DSM, texture segmentation and Normalised Difference Vegetation Index (NDVI) are used to reveal building interest areas. Then, based on the derived approximate building areas, a shape modelling algorithm based on the level set formulation of curve and surface motion has been used to precisely delineate the building boundaries. Data fusion, based on the Dempster-Shafer technique, is used to interpret simultaneously knowledge from several data sources of the same region, to find the intersection of propositions on extracted information derived from several datasets, together with their associated probabilities. A number of test areas, which include buildings with different sizes, shape and roof colour have been investigated. The tests are encouraging and demonstrate that the system is effective for building extraction, and the determination of more accurate elevations of the terrain surface.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.53 no.4
• /
• pp.277-285
• /
• 2004

We present a new hybrid stereo matching technique in terms of the co-operation of area-based stereo and feature-based stereo. The core of our technique is that feature matching is carried out by the reference of the disparity evaluated by area-based stereo. Since the reference of the disparity can significantly reduce the number of feature matching combinations, feature matching error can be drastically minimized. One requirement of the disparity to be referenced is that it should be reliable to be used in feature matching. To measure the reliability of the disparity, in this paper, we employ the self-consistency of the disunity Our suggested technique is applied to the detection of 3D line segments by 2D line matching using our hybrid stereo matching, which can be efficiently utilized in the generation of the rooftop model from urban imagery. We carry out the experiments on our hybrid stereo matching scheme. We generate synthetic images by photo-realistic simulation on Avenches data set of Ascona aerial images. Experimental results indicate that the extracted 3D line segments have an average error of 0.5m and verify our proposed scheme. In order to apply our method to the generation of 3D model in urban imagery, we carry out Preliminary experiments for rooftop generation. Since occlusions are occurred around the outlines of buildings, we experimentally suggested multi-image hybrid stereo system, based on the fusion of 3D line segments. In terms of the simple domain-specific 3D grouping scheme, we notice that an accurate 3D rooftop model can be generated. In this context, we expect that an extended 3D grouping scheme using our hybrid technique can be efficiently applied to the construction of 3D models with more general types of building rooftops.

• Journal of Ubiquitous Convergence Technology
• /
• v.1 no.1
• /
• pp.9-17
• /
• 2007

Feature based stereo matching is an effective way to perform 3D building reconstruction. However, in urban scene, the cluttered background and various building structures may interfere with the performance of building reconstruction. In this paper, we propose a novel method to robustly reconstruct buildings on the basis of rectangle regions. Firstly, we propose a multi-scale linear feature detector to obtain the salient line segments on the object contours. Secondly, candidate rectangle regions are extracted from the salient line segments based on their local information. Thirdly, stereo matching is performed with the list of matching line segments, which are boundary edges of the corresponding rectangles from the left and right image. Experimental results demonstrate that the proposed method can achieve better accuracy on the reconstructed result than pixel-level stereo matching.