• Journal of Broadcast Engineering
• /
• v.19 no.2
• /
• pp.148-157
• /
• 2014

Various techniques have been developed for efficient compression of stereoscopic 3D videos. Mixed-resolution based approach is one representative bit-rate saving method based on the characteristics of human visual system that the mixed-resolution stereoscopic videos are perceived close to the higher resolution. However, when the difference between the left and right image resolutions is bigger than a certain threshold level, it causes the perceived quality degradation of the 3D images. Subsequently, several researches tried to find the correlation between the difference in resolution and the level of the perceived quality degradation, but they conducted the experiments just considering the difference in resolution without considering the viewing distances, so thereby different results were retrieved from test to test. In this work, we calculated the optimal viewing distance based on the human visual system, and conducted the subjective tests with the calculated viewing distance. With the results, we demonstrate that the fixed and mobile hybrid 3DTV, which is based on mixed-resolution stereoscopic images, can provide the high quality 3D services.

• Smart Media Journal
• /
• v.2 no.4
• /
• pp.27-33
• /
• 2013

Multi-view video system provides both realistic 3D feelings and free-view navigation. But it is hard to transmit too huge data, so we send only two or three view images and generate intermediate view image using depth information. In this paper, we propose high quality multi-view image generation method from stereoscopic images. Since the stereo matching method does not provide accurate disparity values for all the pixels, especially at the occlusion area, we propose an occlusion handling method using the background pixels at first. We also apply a joint bilateral filtering to enhance the disparity map at the object boundary since it can affect the quality of synthesized images significantly. Finally, we can generate virtual view images at intermediate view positions using confidence map to reduce bad pixel and hole's error. Experimental results show the proposed method performs better than the conventional method.

• Journal of Broadcast Engineering
• /
• v.16 no.4
• /
• pp.596-601
• /
• 2011

In this paper, we propose a fast depth-image-based rendering method to generate a virtual view image in real-time using a graphic processor unit (GPU) for a 3D broadcasting system. Before the transmission, we encode the input 2D+depth video using the H.264 coding standard. At the receiver, we decode the received bitstream and generate a stereo video using a GPU which can compute in parallel. In this paper, we apply a simple and efficient hole filling method to reduce the decoder complexity and reduce hole filling errors. Besides, we design a vertical parallel structure for a forward mapping process to take advantage of the single instruction multiple thread structure of GPU. We also utilize high speed GPU memories to boost the computation speed. As a result, we can generate virtual view images 15 times faster than the case of CPU-based processing.

• Journal of the Korea Computer Graphics Society
• /
• v.22 no.3
• /
• pp.11-20
• /
• 2016

This paper introduces an effective method for generating 3D stereoscopic images that gives immersive 3D experiences to viewers using mobile-based binocular HMDs. Most of previous AR systems with monocular cameras have a common limitation that the same real-world images are provided to the viewer's eyes without parallax. In this paper, based on the assumption that viewers focus on the marker in the scenario of marker based AR, we recovery the binocular disparity about a camera image and a virtual object using the pose information of the marker. The basic idea is to generate the binocular disparity for real-world images and a virtual object, where the images are placed on the 2D plane in 3D defined by the pose information of the marker. For non-marker areas in the images, we apply blur effects to reduce the visual discomfort by decreasing their sharpness. Our user studies show that the proposed method for 3D stereoscopic image provides high depth feeling to viewers compared to the previous binocular AR systems. The results show that our system provides high depth feelings, high sense of reality, and visual comfort, compared to the previous binocular AR systems.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2012.11a
• /
• pp.42-43
• /
• 2012

최근 양안식 3D 디스플레이의 시청 안정성 문제가 대두됨에 따라, 어떠한 요인들이 시각피로와 시각적 불편함을 야기하는지 밝히는 연구의 필요성이 증가하고 있다. 시각적 불편함은 양안식 3D 영상에서 과도한 양안 시차, 양안 시차의 빠른 변화, 양안 불일치 등에 의해 야기될 수 있다. 그러나 시각적 불편함은 시각시스템의 복잡한 메커니즘에 의한 결과이므로 알려진 양안 시차 등의 요인 외에도 밝혀지지 않은 요인들이 더 존재할 수 있다. 본 논문은 기존 연구로부터 시각적 불편함과 관련 있을 것으로 추정되는 요인으로 시각자극의 너비와 시각적 불편함에 대한 민감도를 선택하였다. 이들의 영향을 밝히기 위한 실험으로서, 편안한 양안 시차 범위 내에서 시각자극의 너비와 시각적 불편함에 대한 민감도에 따라 양안 융합 시간이 어떻게 달라지는지를 관찰하였다. 실험 결과로부터 편안한 양안 시차 범위 내에서도 시각자극의 너비와 시각적 불편함에 대한 민감도에 따라 양안 융합 시간이 크게 달라짐을 확인할 수 있었다. 이러한 결과들은 시각자극의 너비가 주요한 시각적 불편함의 3D 콘텐츠 요인이 될 수 있음을 암시한다.

• Journal of Broadcast Engineering
• /
• v.13 no.5
• /
• pp.596-601
• /
• 2008

In this paper, we propose a new scheme to generate region-of-interest (ROI) enhanced depth maps in the hybrid camera system, which is composed of a low-resolution depth camera and a high-resolution stereoscopic camera. The proposed method creates an ROI depth map for the left image by carrying out a three-dimensional (3-D) warping operation onto the depth information obtained from the depth camera. Then, we generate a background depth map for the left image by applying a stereo matching algorithm onto the left and right images captured by the stereoscopic camera. Finally, we merge the ROI map with the background one to create the final depth map. The proposed method provides higher quality depth information on ROI than the previous methods.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2003.11a
• /
• pp.149-152
• /
• 2003

기존의 양안식 스테레오 디스플레이 시스템은 장면 내에 매우 큰 변이를 가지는 물체가 존재 할 경우에 시각피로를 유발하여 오랜 시간동안 시청하기가 어렵게 된다. 본 논문에서는 변이 기반 비대칭 필터링 기법을 제안하고, 이 기법의 시각 피로도에 미치는 영향을 주관적 평가를 통하여 고찰하며, 아울러 교차변이(crossed disparity) 및 비교차변이(uncrossed disparity)에 따른 시각 피로도에 미치는 영향의 변화 또한 고찰하였다. 실험 결과, 변이기반 비대칭 필터링은 시각 피로의 측면에서는 비교차변이만 존재하는 영상의 경우에는 원래의 스테레오 영상에 비해 큰 영향이 없거나, 오히려 필터링 수준에 따라 오히려 시각적 피로가 심하게 되는 결과를 나타내었다. 또한 교차변이의 경우에는 시파피로가 필터링 수준을 높임에 따라 조금씩 시각피로가 개선되는 결과를 나타내었다. 따라서, 비대칭 필터링에 의한 시각피로의 개선효과는 스테레오 영상 내 변이 종류와 그 크기, 시청자의 주시전 등 여러 요인에 따라 달라질 수 있음을 앞 수 있었다.

• Journal of the HCI Society of Korea
• /
• v.10 no.2
• /
• pp.65-71
• /
• 2015

In this paper, we present binocular augmented reality system with smartphones. With improvements of performance and resolution of recent smartphones, various virtual reality devices using smartphones and applications are appearing in the market. But the augmented reality system with smartphones are not that popular because of the lack of required technologies. In our work, we discuss about 3D mapping and tracking using computer vision. Also, we provide hybrid tracking using sensors in the smartphone which can handle the computer vision failure cases. Bare hand 3D interaction method in our system will be also presented.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2011.07a
• /
• pp.365-368
• /
• 2011

본 논문에서는 시청자의 색상 특성을 고려하여 양안식 영상에서의 색상 불일치를 예측하는 방법을 제안했다. 먼저 색상 불일치 예측을 위한 주관적 평가로 색상 민감도 평가를 수행했다. 기본 세 채널 색 R, G, B에 대해 각각의 색상의 오차 범위를 결정한 후, 이를 기반으로 관심도와 복잡도를 평가하여 보다 세밀한 주관적 평가를 수행했다. 실험 결과를 통해 제안한 방법이 기존의 색상의 품질을 평가하기 위해 사용하는 유클리디안 색 거리 계산 방법과 US & Canadian Government Printing Offices의 품질 수준 규격(Qulaity Level Specifications)을 이용한 방법보다 효율적으로 색상 불일치 여부를 평가함을 확인했다.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.25 no.5A
• /
• pp.688-695
• /
• 2000

We present a multi-view autostereoscopic display system based on volume holographic storage technique. In this proposed system, the interference pattern of spatial multiplexed plane reference and angular multiplexed plane object beams are recorded into a photorefractive crystal, which plays a role of guiding object beams of multi-view images into the desired persfective directions. For reconstruction, object beams containing the desired multi-view image information, which satisfy Bragg matching condition, are illuminated in the time-division multiplexed manner onto the crystal. Then multiple stereoscopic images are Projected to the display plane for autostereoscopic 3D viewing.