• The KIPS Transactions:PartB
• /
• v.15B no.1
• /
• pp.9-16
• /
• 2008

In this paper, we present an algorithm for synthesizing intermediate view image from a stereoscopic pair of images. An image of multiview is need for people in order to easily recognize 3D image. However, if many cameras are use for that, not only does system get more complicated but also transmission rating cause a big trouble. Hence, stereo images are photograph and issue on the sending side and algorithm to generate several intermediate view image is able to be use on the receiving side. The proposed method is based on disparity space image. First of all, disparity space image that is depicted by the gap of pixel followed by disparity of stereo image is generated. Disparity map is made by utilizing disparity space image for searching for optimal disparity path then eventual intermediate view image is generated after occlusion region which does not match is processed. Experimental results illustrate the performance of the proposed technique and we obtained a high quality image of more than 30 dB PSNR.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.41 no.6
• /
• pp.9-18
• /
• 2004

This paper proposes a new and simple stereo matching algorithm using the disparity space image (DSI) technique. First of all, we detect some salient feature points on each scan-line of the image pair and set the matching area using those points and define a simple cost matrix. And we take advantage of matching by pixel-by-pixel instead of using the matching window. While the pixel-by-pixel method boost up the speed of matching, because of no using neighbor information, the correctness of the matching may not be better. To cover this point, we expand the matching path using character of disparity-space-image for using neighbor information. In addition, we devise the compensated matching module using the volume of the disparity space image in order to improve the accuracy of the match. Consequently, we can reduce mismatches at the disparity discontinuities and can obtain the more detailed and correct disparity map.

• Proceedings of the Korean Association of Geographic Inforamtion Studies Conference
• /
• 2004.03a
• /
• pp.511-516
• /
• 2004

수치표고모델, 정사영상과 같은 공간영상정보를 구축하기 위해서는 입체영상을 이동한 영상정합(image matching)의 과정이 필수적이며, 단영상 또는 스테레오 영상을 이용하여 대상물의 3차원 정보를 재구성하고 복원하는 기술은 사진측량 및 컴퓨터 비전 분야의 주요 연구 중의 하나이다. 본 연구에서는 화소값의 유사성과 상호관계성을 고려하는 MRF 모델을 이용하여 영상정합을 수행하였다. MRF 모델은 공간분석이나 물리적 현상의 전후관계(contextural dependencies)의 분석을 위한 확률이론의 한 분야로 다양한 공간정보를 통합할 수 있는 방법을 제공한다. 본 연구에서는 기준영상의 화소에 시차를 할당하는 접근 방법으로 확률모델의 일종인 마르코프 랜덤필드(MRF)모델에 기반한 영상정합기법을 제안하였고, 공간내 화소의 상호관계를 고려해주므로 대상물의 경계부분에서의 매칭 정확도를 향상시켰다. 영상정합문제에서의 MRF 기본가정은 영상 내 특정화소의 시차는 그 주위화소의 시차에 의한 부분정보에 따라 결정이 가능하다는 것이다. 깁스분포(gibbs distribution)를 사용하여 사후(posteriori) 확률값을 유도해내고, 이를 최대사후확률(MAP: Maximum a Posteriori)추정법을 이용하여 에너지함수를 생성하였다. 생성된 에너지함수의 최적화(Optimization)를 위하여 본 연구에서는 전역최적화기법인 multiway cut 기법을 사용하여 영상정합에 있어 에너지함수를 최소로 하는 이미지화소에 대한 시차레이블을 구하여 영상정합을 수행하였다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2019.06a
• /
• pp.238-239
• /
• 2019

현재 MPEG은 최대 6DoF(Degrees of Freedom) 사용자 운동시차를 지원함과 동시에 고해상도의 360VR 서비스를 제공하기 위한 영상 포맷, 부호화 등 요소기술에 대한 MPEG-I(Immersive) 표준화를 진행 중에 있다. 6DoF는 가상 공간 내 임의의 위치에서 운동시차를 제공하는 것으로 이를 획득 및 재현하기 위한 360VR 영상 표현 및 포맷에 대한 연구가 필수적으로 요구된다. 이에 본 논문은 제한된 공간 내 임의의 위치에서 사용자에게 자연스러운 6 자유도를 제공하기 위한 360VR 영상 포맷을 제안한다. 실험결과 제한된 공간 내에서 사용자에게 자연스러운 운동시차를 제공할 뿐만 아니라 향후 실사 환경에서도 획득 및 적용 가능성을 확인하였다.

• Korean Journal of Cognitive Science
• /
• v.14 no.1
• /
• pp.17-28
• /
• 2003

In order to provide natural images with a specified depth through three-dimensional display system, the stereo images should be similar to those projected from real environment as much as possible. Even when two persons see an identical scene, the binocular Parallax between two images of an object varies as a function of one's inter-pupilary distance (IPD). In this study, we investigated whether individual differences, such as IPD and accommodative vergence, would affect the perception of three dimensional scene provided by stereo-images. Results showed that a person's IPD is correlated with the limit of screen and binocular parallax for single vision, and affects the perceived depth of an object on fixation. More specifically, with longer IPD the limit of screen and binocular parallax for single vision is decreased, and the perceived depth is reduced. These results suggest that the screen and binocular parallax of an object should be calibrated with regard to users IPD to provide natural stereo-images with a specified depth and to Prevent double vision.

• Journal of Broadcast Engineering
• /
• v.25 no.5
• /
• pp.685-697
• /
• 2020

Immersive media videos, such as panorama and 360-degree videos, must provide a sense of realism as if the user visited the space in the video, so they should be able to represent the reality of the real world. However, in panorama and 360-degree videos, objects appear to overlap or disappear due to parallax between cameras, and such parallax distortion may interfere with immersion of the user's content. Accordingly, although many video stitching algorithms have been proposed to overcome parallax distortion, parallax distortion still occurs due to the low performance of the Object detection module and limitations of the Seam generation method. Therefore, this paper analyzes the limitations of the existing video stitching technology and proposes a method for detecting and correcting parallax distortion of video stitching using the LDPM (Local Differential Pixel Mean) image evaluation method that overcomes the limitations of the video stitching technique.

• KIPS Transactions on Software and Data Engineering
• /
• v.4 no.10
• /
• pp.465-472
• /
• 2015

We propose a novel plane detection in disparity space and evaluate its performance. Our method simplifies and makes scenes in disparity space easily dealt with by approximating various surfaces as planes. Moreover, the approximated planes can be represented in the same size as in the real world, and can be employed for obstacle detection and camera pose estimation. Using a stereo matching technique, our method first creates a disparity image which consists of binocular disparity values at xy-coordinates in the image. Slants of disparity values are estimated by exploiting a line simplification algorithm which allows our method to reflect global changes against x or y axis. According to pairs of x and y slants, we label the disparity image. 4-connected disparities with the same label are grouped, on which least squared model estimates plane parameters. N plane models with the largest group of disparity values which satisfy their plane parameters are chosen. We quantitatively and qualitatively evaluate our plane detection. The result shows 97.9%와 86.6% of quality in our experiment respectively on cones and cylinders. Proposed method excellently extracts planes from Middlebury and KITTI dataset which are typically used for evaluation of stereo matching algorithms.

• The KIPS Transactions:PartB
• /
• v.19B no.2
• /
• pp.113-122
• /
• 2012

This paper presents a new stereo matching technique which is based on the matching of feature windows and feature links. The proposed method uses the FAST feature detector to find image features in stereo images and determines the correspondences of the detected features in the stereo images. We define a feature window which is an image region containing several image features. The proposed technique consists of two matching steps. First, a feature window is defined in a standard image and its correspondence is found in a reference image. Second, the corresponding features between the matched windows are determined by using the feature link technique. If there is no correspondence for an image feature in the standard image, it's disparity is interpolated by neighboring feature sets. We evaluate the accuracy of the proposed technique by comparing our results with the ground truth of in a stereo image database. We also compare the matching accuracy and computation time with two conventional feature-based stereo matching techniques.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• fall
• /
• pp.124-125
• /
• 2021

최근 증강현실(AR), 가상현실(VR), 혼합현실(XR) 분야가 각광받고 있으며, 3차원 공간과 사물을 인식하여 다양한 콘텐츠 서비스를 제공하는 기술이 개발되고 있다[1]. 3차원 공간과 사물을 인식하기 위해 가장 널리 사용되는 방법은 RGB 카메라를 이용하는 것이다[2]. RGB 카메라를 이용하여 촬영한 영상을 분석한 후 분석된 결과를 이용하여 카메라와 환경의 관계를 추정한다. 시차는 사용자가 촬영한 복수의 이미지에서 특징점의 차이를 이용하여 계산된다. 실험적으로 구한 깊이에 대해 계산된 디스패리티에 시차 정보와 스케일링 정보를 더하여 3차원 특징점을 생성한다. 제안하는 알고리즘은 단일 모바일 디바이스에서 획득한 영상을 사용한다. 특징점 매칭을 기반으로한 디스패리티 추정과 시차조정 3D 특징점 생성이다. 실제 깊이 값과 비교했을 때, 생성된 3차원 특징점은 실측값의 10% 이내의 오차가 있음을 실험적으로 증명하였다. 따라서 제안하는 방법을 이용하여 유효한 3차원 특징점을 생성할 수 있다.

• Korean Journal of Optics and Photonics
• /
• v.18 no.4
• /
• pp.246-255
• /
• 2007

The floating image system (FIS) is a device to display input source in the space between fast surface of the display and an observer and it provides pseudo 3D depth to an observer when input source as real object or 2D image was displayed through the optical lens system in the FIS. The Advanced floating image system (AFIS) was designed to give more effective 3D depth than existing FIS by adding front and rear depth cues to the displayed stereogram, which it was used as input source. The magnitude of disparity and size of stereogram were strongly related each other and they have been optimized for presenting 3D depths in a non-optical lens systems. Thus, if they were used in optical lens system, they will have reduced or magnified parameters, leading to problem such as providing incorrect 3D depth cues to an observer. Although the size of stereogram and disparity were demagnified by total magnifying power of optical system, the viewing distance (VD) from the display to an observer and base distance (BD) for the gap between the eyes were fixed. For this reason, the quantity of disparity in displayed stereogram through the existing FIS has not kept the magnifying power to the total optical system. Therefore, we proposed the methods to provide correct 3D depth to an observer by compensating quantity of disparity in stereogram which was satisfied to keep total magnifying power of optical lenses system by AFIS. Consequently, the AFIS provides a good floating depth (pseudo 3D) with correct front and rear 3D depth cues to an observer.