• Journal of Broadcast Engineering
• /
• v.17 no.2
• /
• pp.363-373
• /
• 2012

This paper proposes a method to generate a depth image at an arbitrary intermediate view-point, which is targeting a video service for free-view, auto-stereoscopy, holography, etc. It assumes that the leftmost and the rightmost depth images are given and they both have been camera-calibrated and image-rectified. This method calculates and uses a disparity increment per depth value. In this paper, it is obtained by stereo matching for the given two depth image by considering more general cases. The disparity increment is used to find the location in the intermediate view-point depth image (IVPD) for each depth in the given images. Thus, this paper finds two IVPDs, from left image and from right image. Noises are removed and holes are filled in each IVPDs and the two results are combined to get the final IVPD. The proposed method was implemented and applied to several test sequences. The results revealed that the quality of the generated IVPD corresponds to 33.84dB of PSNR in average and it takes about 1 second to generate a HD IVPD. We evaluate that this image quality is quite good by considering the low correspondency among the left images, intermediate images, and the right images in the test sequences. If the execution speed is improved, the proposed method can be a very useful method to generate an IVPD at an arbitrary view-point, we believe.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.17 no.8
• /
• pp.1908-1918
• /
• 2013

Free-view, auto-stereoscopic video service is a next generation broadcasting system which offers a three-dimensional video, images of the various point are needed. This paper proposes a method that parallelizes the algorithm for arbitrary intermediate view-point image fast generation and make it faster using General Propose Graphic Processing Unit(GPGPU) with help of the Compute Unified Device Architecture(CUDA). It uses a parallelized stereo-matching method between the leftmost and the rightmost depth images to obtain disparity information and It use data calculated disparity increment per depth value. The disparity increment is used to find the location in the intermediate view-point image for each depth in the given images. Then, It is eliminate to disocclusions complement each other and remaining holes are filled image using hole-filling method and to get the final intermediate view-point image. The proposed method was implemented and applied to several test sequences. The results revealed that the quality of the generated intermediate view-point image corresponds to 30.47dB of PSNR in average and it takes about 38 frames per second to generate a Full HD intermediate view-point image.

• The KIPS Transactions:PartB
• /
• v.10B no.5
• /
• pp.561-566
• /
• 2003

This paper proposes a new algorithm that generates smooth and realistic transition views from one viewpoint to another view point on the panorama based navigation system. The proposed algorithm is composed with two steps. One is prewarping that aligns the viewing direction in two panorama image, the other is bidirectional disparity morphing (BDM) that generates the intermediate scene from the aligned panorama images. For the prewarping, first of all, we compute the phase correlation between two images in order to get the information such as the displacement, rotation, and scale. Then we align the original images using these information. As soon as finishing the prewarping, we compute the block based disparity vectors (DVs) and smooth them using the two occluding patterns. As we apply these DVs to the BDM, we can get the elaborate intermediate scenes. We make an experiment on the proposed algorithm with real panoramic images and we can get the satisfactory results.

• 한국정보디스플레이학회:학술대회논문집
• /
• 2007.08b
• /
• pp.1490-1493
• /
• 2007

We proposed the method to take 3D image having correct depths to the front and rear directions when the stereogram was displayed to an observer through an optical system. Since the magnified stereogram by lenses was not given correct depth to an observer despite having the same magnified disparity. Consequently, we achieved our goal by relations of compensated disparities to both directions with magnification of lenses, viewing distance and base distance of viewer in AFIS.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.10 no.4
• /
• pp.318-324
• /
• 2017

We introduced a stereo camera on the aircraft to detect flight objects and to estimate the 3D position of them. The Saliency map algorithm based on PCT was proposed to detect a small object between clouds, and then we processed a stereo matching algorithm to find out the disparity between the left and right camera. In order to extract accurate disparity, cost aggregation region was used as a variable region to adapt to detection object. In this paper, we use the detection result as the cost aggregation region. In order to extract more precise disparity, sub-pixel interpolation is used to extract float type-disparity at sub-pixel level. We also proposed a method to estimate the spatial position of an object by using camera parameters. It is expected that it can be applied to image - based object detection and collision avoidance system of autonomous aircraft in the future.

• Journal of KIISE:Software and Applications
• /
• v.33 no.1
• /
• pp.69-83
• /
• 2006

This paper describes an image disparity estimation method using a segmented-region based stereo matching. Segmented-region based disparity estimation yields a disparity map as the unit of segmented region. However, there is a problem that it estimates disparity imprecisely. The reason is that because it not only have matching errors but also apply an identical way to disparity estimation, which is not considered each type of matched regions. To solve this problem, we proposes a disparity estimation method which is considered the type of matched regions. That is, the proposed method classifies whole matched regions into similar-matched region, dissimilar-matched region, false-matched region and miss-matched region by analyzing the type of matched regions. We then performs proper disparity estimation for each type of matched regions. This method minimizes the error in estimating disparity which is caused by inaccurate matching and also improves the accuracy of disparity of the well-matched regions. For the purpose of performance evaluations, we perform tests on a variety of scenes for synthetic, indoor and outdoor images. As a result of tests, we can obtain a dense disparity map which has the improved accuracy. The remarkable result is that the accuracy of disparity is also improved considerably for complex outdoor images which are barely treatable in the previous methods.

• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.48 no.10
• /
• pp.20-24
• /
• 2011

As various 3D contents have been developed recently, number of users who use 3D glasses in the cinema or their house has increased. However, since a stereoscopic image causes visual fatigue, developers also advise children and pregnant against watching it for hours. In this paper, we proposed measurement of level of visual fatigue degree by analyzing histogram obtained from a disparity-map. We used binocular disparity approach which is a fundamental factor occurred by a stereoscopic image. This research can be used as an user discomfort improvement method by referring to a stereoscopic image producing and compensation. To obtain a disparity-map, our proposed method used a census algorithm which is suitable for real-time processing.

• Journal of Korean Ophthalmic Optics Society
• /
• v.16 no.3
• /
• pp.299-305
• /
• 2011

Purpose: In watching 3D stereoscopic display using the binocular disparity, effect of difference of the pupillary distance between the adults and children on the perception of depth were investigated. Methods: The average PD of children was determined from the PD measurements of children of the elementary school of 2nd and 3rd grade in Seoul. The location of crossing visual axes were derived from the relation of the binocular disparity and the PD for the adults and children. Results: The average PD of the children was measured to be 57.3 mm which was smaller than the average PD of the adults that was known to be about 65 mm. As the binocular disparity increases to the positive direction, the crossing location steeply moves farther behind the screen. On the other hand, when the binocular disparity increases to the negative direction, the crossing location gradually moves toward the viewer. For the same amount of the binocular disparity, the crossing locations were derived to be larger for the children than the adults due to the difference of the PD. Therefore, children will perceive larger depth than the adults. Conclusions: Small PD of the viewer causes the larger amount of the depth perception. In producing the stereoscopic images, the average PD of children as well as adults need to be considered.

• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.41 no.4
• /
• pp.91-100
• /
• 2004

In this paper, we propose the method that analyzes the depth of object using 2 images in the disparity algorithm. It also presents the design and implementation of the proposed method for a real time processing. The proposed system uses the vertical strip structure for calculating similar pixel numbers for the processing and converts the depth of object into gray scale images in order to be displayed on various display devices. The hardware using the proposed method is operating with 30 frames/sec and verified by using the Altera APEX 20K1000EBC652-3. The proposed method is also Implemented into It by using the Hynix 0.35${\mu}{\textrm}{m}$ CB35 ASIC library and 256PQFP package.

• Journal of Korea Multimedia Society
• /
• v.19 no.4
• /
• pp.706-716
• /
• 2016

Each year, significant amounts of Stereoscopic 3D(S3D) contents have been introduced. However, viewers who enjoy the contents readily experience a sense of fatigue on account of various factors. Consequently, many improvement studies have been conducted with the domain of disparity by, for example, simply controlling the disparity or optimizing the reaction speed of viewers' eyes to vergence. However, such studies are limited to the disparity domain and therefore are restricted to a limited number of applications. In this study, we attempted to transcend this limitation and analyzed how a reconstruction in color and brightness, as well as disparity and other important features, affects eyes in terms of vergence adaptation. As a result, we found that, the higher the color similarity is, the better it positively affects vergence adaptation during viewing. Based on this analysis, we propose in this paper a similar color extraction method between takes that are applicable to real-life situations. In an evaluation, the algorithm was applied to publicly available S3D contents and produced a converted color optimized image. The vergence adaptation time of this applied contents was significantly decreased. Also it was minimized through color reconstruction, thereby, being resulted in enhancing viewer concentration.