• Proceedings of the Korea Contents Association Conference
• /
• 2011.05a
• /
• pp.499-500
• /
• 2011

Line Disparity Map[1]은 스테레오 영역기반 정합방법에서 블록단위의 영역이 아닌 라인의 기울기를 바탕으로 비교하기 때문에 실시간 스테레오 정합이 가능하다. 따라서 본 논문은 이러한 Line Disparity Map 알고리즘을 사용하여 단순히 관찰로만 사용되어 지는 입체현미경에 스테레오 비전을 기반으로 하는 3D 형상계측 시스템을 개발하여 사람이 손으로 측정하기 힘든 미세의 오브젝트를 측정하는 시스템을 개발하고자 한다.

• ETRI Journal
• /
• v.38 no.5
• /
• pp.996-1007
• /
• 2016

This paper presents new hole-filling methods for generating multiview images by using depth image based rendering (DIBR). Holes appear in a depth image captured from 3D sensors and in the multiview images rendered by DIBR. The holes are often found around the background regions of the images because the background is prone to occlusions by the foreground objects. Background-oriented priority and gradient-oriented priority are also introduced to find the order of hole-filling after the DIBR process. In addition, to obtain a sample to fill the hole region, we propose the fusing of depth and color information to obtain a weighted sum of two patches for the depth (or rendered depth) images and a new distance measure to find the best-matched patch for the rendered color images. The conventional method produces jagged edges and a blurry phenomenon in the final results, whereas the proposed method can minimize them, which is quite important for high fidelity in stereo imaging. The experimental results show that, by reducing these errors, the proposed methods can significantly improve the hole-filling quality in the multiview images generated.

• Smart Media Journal
• /
• v.4 no.4
• /
• pp.111-119
• /
• 2015

As a variety of HMD(Head Mounted Display) has come out, the production of 3D images onto which VR(Virtual Reality) technologies are grafted has been contributed to activating the production of image contents depending on a tangible or immersing type. VR-based image contents have enlarged their applicability across the entertainment industry from animation and game to realistic images. At the same time, the solution development for producing VR image contents has also gained elasticity. However, among those production solutions which have been used until now, fixed stereo camera based photographing has a limit that the binocular disparity of a user is fixed. This does not only restrict a way of expression a producer intends to direct, but also may cause the effect of 3D or space not to be sensed enough as view condition is not considered enough in a user's side. This study is aimed at resolving with skills applying in the latter part of 3D image production the problem that convergence points may be adjusted with restriction, which tends to happen at the time of the production of VR image contents. The later stage of the 3D imaging work analyzes and applies to game engines the significance of adjusting convergence points through the visualization of binocular disparity so that it is available to implement a function that the points could be controlled at random by a user.

• Journal of Digital Contents Society
• /
• v.11 no.2
• /
• pp.177-184
• /
• 2010

These days, as digital producing technique has been developed, 3D imaging technique is used in high-tech computer and T.V. Also study for 3D producing technique is actively in progress. Moreover, as James Cameron's movie, 'Avatar' released in 2009 was a box office hit, the issue about 3D image came to the fore again. At this point, I decided to study the effect of the visual depth caused by the color correction during the post-production stage. The purpose of this study is to offer information about processing effective images through data about the effect of the visual depth that applies the color correction during the post-production stage. Basically, I supposed that color and contract would have effects on depth of 3D image. As a result, I could find out the changes of visual depth, space perception and sense of depth throughout the experiment. Applying this result,, I produced the 15 minutes of 3D advertisement movie and I found out that the color correction during the post-production stage was very effective for 3D depth. The left image and the right image by beam splitter based rig and parallel rig were used for this study. Also I adjusted the strong contrast by the color correction during the post-production stage after correcting convergence and visual depth during editing. As a result, I could produce images which had strong sense of space and sense of depth.

• Convergence Security Journal
• /
• v.13 no.3
• /
• pp.9-15
• /
• 2013

Calculating of matching cost is an important for efficient stereo matching. To investigate the performance of matching process, the concepts of the existing methods are introduced. Also we analyze the performance and merits of them. The simplest matching costs assume constant intensities at matching image locations. We consider matching cost functions which can be distinguished between pixel-based and window-based approaches. The Pixel-based approach includes absolute differences (AD) and sampling-intensitive absolute differences (BT). The window-based approach includes the sum of the absolute differences, the sum of squared differences, the normalized cross-correlation, zero-mean normalized cross-correlation, census transform, and the absolute differences census transform (AD-Census). We evaluate matching cost functions in terms of accuracy and time complexity. In terms of the accuracy, AD-Census method shows the lowest matching error ratio (the best solution). The ZNCC method shows the lowest matching error ratio in non-occlusion and all evaluation part. But it performs high matching error ratio at the discontinuities evaluation part due to blurring effect in the boundary. The pixel-based AD method shows a low complexity in terms of time complexity.

• Journal of Broadcast Engineering
• /
• v.21 no.1
• /
• pp.76-86
• /
• 2016

This study was investigated whether the perceived depth was changed depending on the measurement methods. In the method of direct comparison, virtual object with one of the various binocular disparities was presented in the frontal space with LEDs which were used for depth estimation for a binocular stimulus, while in the method of indirect comparison, visual object was presented in the frontal space but the LEDs were placed rightward at the angle of 45 degree from the mid-sagittal line. In these experimental setup, the depth of binocular stimulus was directly matched that of LED in direct comparison condition. In indirect comparison condition, however, observer estimated the depth of binocular stimulus, turned one's head rightward to the array of LEDs and turned on the LED which was supposed to be the same depth as binocular stimulus. Additionally, it was investigated whether the perceived depth was different depending on observer's stereo acuity. The results showed that perceived depths measured in the direct comparison were more similar to the depth predicted from geometry than those in the indirect comparison, and that the perceived depths from observers with high stereo acuity were similar to the predicted depth from geometry those from observers with low stereo acuity. These results indicated that stereoscopic depths of the binocular stimuli would vivid and compelling when binocular stimuli was simultaneously presented with real objects in the same visual space, like a mixed reality.

• Journal of Broadcast Engineering
• /
• v.11 no.4 s.33
• /
• pp.495-506
• /
• 2006

In this paper, we propose a self-calibration of a multi-camera system using factorization techniques for realistic contents generation. The traditional self-calibration algorithms for multi-camera systems have been focused on stereo(-rig) camera systems or multiple camera systems with a fixed configuration. Thus, it is required to exploit them in 3D reconstruction with a mobile multi-camera system and another general applications. For those reasons, we suggest the robust algorithm for general structured multi-camera systems including the algorithm for a plane-structured multi-camera system. In our paper, we explain the theoretical background and practical usages based on a projective factorization and the proposed affine factorization. We show experimental results with simulated data and real images as well. The proposed algorithm can be used for a 3D reconstruction and a mobile Augmented Reality.

• Journal of Digital Contents Society
• /
• v.17 no.1
• /
• pp.23-31
• /
• 2016

This study aims to develop a stereoscopic image authoring tool to effectively produce e-Book content that enhances user's sense of immersion in 3D environments. The proposed authoring tool consists of three core systems; 3D object editing, stereoscopic image, and image media production systems. First, the object editing system arranges and produces diverse objects that constitute virtual 3D spaces to fit the purpose of the content. In this case, commercial graphic authoring tools are utilized to design efficient data structures that can include produced external models. In addition, the material and textures of objects are made to be revisable and editable into the form wanted by the user. Thereafter, a stereoscopic image system will be implemented to produce the generated virtual scenes into stereoscopic images. This study uses the Anaglyph method so that the user can implement and use stereoscopic image scenes more easily. This method include functions to change the color of stereo cameras and control depth scaling. Finally, an image media production system will be implemented that will enable producing the produced stereoscopic images into single images or videos so that they can be effectively utilized in e-Book content.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 1999.06b
• /
• pp.75-78
• /
• 1999

본 논문에서는 멀티미디어 컨텐트 생성을 위한 입체음향 생성 저작도구 개발에 관하여 논의한다. Windows 95/98, Windows NT 환경의 PC 상에서 동작하는 입체음향 생성 저작도구는 일반적인 음향 편집기가 갖는 편집기능 및 음향 효과 기능 이외에 음상정위 기능, 음장제어 기능의 입체음향 기능을 가지고 있으며 스피커를 통하여 입체음향을 청취할 경우 발생하는 크로스톡크를 제거하는 기능도 가지고 있다. 개발된 저작도구를 이용하여 Mono, Stereo 형태로 저장된 음향파일을 순수한 소프트웨어 만으로 가공하여 바이노럴(Binaural) 형태의 입체음향을 생성하여 가상 음원의 위치 및 이동궤적을 정의할 수 있으며 가상공간이 갖는 공간감을 구현할 수 있다 또한 편리한 사용자 인터페이스 환경을 제공하여 GUI를 통하여 3차원 공간 상의 가상음원의 위치 및 이동 궤적과 가상공간을 사용자가 지정할 수 있도록 하였다 입체음향 생성저작도구는 일반 PC 환경에서 사용자가 가공하고자 하는 임의의 오디오 파일을 입체음향으로 생성할 수 있는 GUI 환경을 제공하며, 저비용으로 효과적인 입체음향 컨텐트를 제작할 수 있도록 함으로써, 게임 및 멀티미디어 컨텐트 제작의 고부가가치화와 입체음향 기술의 산업화에 기여할 것으로 기대된다.

• Journal of Broadcast Engineering
• /
• v.17 no.2
• /
• pp.411-421
• /
• 2012

The stagnant growth in 3D market due to 3D movie contents shortage is encouraging development of techniques for production cost reduction. Elimination of vertical disparity generated during image acquisition requires heaviest time and effort in the whole stereoscopic film-making process. This matter is directly related to competitiveness in the market and is being dealt with as a very important task. The removal of vertical disparity, i.e. image rectification has been treated for a long time in the photogrammetry field. While computer vision methods are focused on fast processing and automation, photogrammetry methods on accuracy and precision. However, photogrammetric approaches have not been tried for the 3D film-making. In this paper, proposed is a photogrammetry-based rectification algorithm that enable to eliminate the vertical disparity precisely by reconstruction of geometric relationship at the time of shooting. Evaluation of proposed algorithm was carried out by comparing the performance with two existing computer vision algorithms. The epipolar constraint satisfaction, epipolar line accuracy and vertical disparity of result images were tested. As a result, the proposed algorithm showed excellent performance than the other algorithms in term of accuracy and precision, and also revealed robustness about position error of tie-points.