• Journal of Korea Society of Digital Industry and Information Management
• /
• v.8 no.3
• /
• pp.97-124
• /
• 2012

This paper analyzes qualitatively the stereo 3D content factors causing viewer's discomfort. For this, we perform a subjective test that each subject strokes a specific key whenever he (she) feels discomfort during watching a stereo 3D contents. Also we extract the data for the factors in the 3D contents to obtain their quantitative values and the amounts of the temporal changes. Those two sets of data are used to analyze the contents to find the factors which cause viewer's discomfort. The factors to be considered are the amount and the frequency of the disparity changes, story of the contents, situation or environments of a scene, movement and the position of the camera, color and luminance information as well as disparities themselves. We analyse the various strong and weak factors and their composites to find how much discomfort each factor or composite causes. We also show the situations and their related factors that causes less discomfort than the amount of their disparities.

• Journal of Broadcast Engineering
• /
• v.16 no.4
• /
• pp.596-601
• /
• 2011

In this paper, we propose a fast depth-image-based rendering method to generate a virtual view image in real-time using a graphic processor unit (GPU) for a 3D broadcasting system. Before the transmission, we encode the input 2D+depth video using the H.264 coding standard. At the receiver, we decode the received bitstream and generate a stereo video using a GPU which can compute in parallel. In this paper, we apply a simple and efficient hole filling method to reduce the decoder complexity and reduce hole filling errors. Besides, we design a vertical parallel structure for a forward mapping process to take advantage of the single instruction multiple thread structure of GPU. We also utilize high speed GPU memories to boost the computation speed. As a result, we can generate virtual view images 15 times faster than the case of CPU-based processing.

• The Journal of the Korea Contents Association
• /
• v.11 no.2
• /
• pp.178-185
• /
• 2011

The recent development of 3D and its application contents have made it possible for people to experience more various 3D contents such as 3D/4D, VR, 3D ride film, I-max, sensory 3D games at theme parks, large-scale exhibitions, 4D cinemas and Video ride. Among them, Video ride, a motion-based genre, especially is getting more popularity, where viewers are immersed in and get indirect experiences in virtual reality. In this study, the production process of the genre of sensory 3D image getting attention recently and ride film are introduced. In the material selection of 3D images, the space and the setting up which is suitable to the fierce movement of rides are studied and some examples of the realization of creative direction ideas and effective technologies using the functions of Stereo Camera which has been first applied to MAYA 2009 are also illustrated. When experts in this 3D image production create more interesting stories with the cultural diversity and introduce enhanced 3D production techniques for excellent contents, domestic relevant companies will be sufficiently able to compete with their foreign counterparts and further establish their successfully unique and strong domains in the image contents sector.

• Smart Media Journal
• /
• v.2 no.4
• /
• pp.27-33
• /
• 2013

Multi-view video system provides both realistic 3D feelings and free-view navigation. But it is hard to transmit too huge data, so we send only two or three view images and generate intermediate view image using depth information. In this paper, we propose high quality multi-view image generation method from stereoscopic images. Since the stereo matching method does not provide accurate disparity values for all the pixels, especially at the occlusion area, we propose an occlusion handling method using the background pixels at first. We also apply a joint bilateral filtering to enhance the disparity map at the object boundary since it can affect the quality of synthesized images significantly. Finally, we can generate virtual view images at intermediate view positions using confidence map to reduce bad pixel and hole's error. Experimental results show the proposed method performs better than the conventional method.

• ETRI Journal
• /
• v.38 no.1
• /
• pp.149-158
• /
• 2016

In the field of augmented reality technologies, commercial optical see-through-type wearable displays have difficulty providing immersive visual experiences, because users perceive different depths between virtual views on display surfaces and see-through views to the real world. Many cases of augmented reality applications have adopted eyeglasses-type displays (EGDs) for visualizing simple 2D information, or video see-through-type displays for minimizing virtual- and real-scene mismatch errors. In this paper, we introduce an innovative optical see-through-type wearable display hardware, called an EGD. In contrast to common head-mounted displays, which are intended for a wide field of view, our EGD provides more comfortable visual feedback at close range. Users of an EGD device can accurately manipulate close-range virtual objects and expand their view to distant real environments. To verify the feasibility of the EGD technology, subject-based experiments and analysis are performed. The analysis results and EGD-related application examples show that EGD is useful for visually expanding immersive 3D augmented environments consisting of multiple displays.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.4A
• /
• pp.239-249
• /
• 2012

Recently, the virtual view generation method using depth data is employed to support the advanced stereoscopic and auto-stereoscopic displays. Although depth data is invisible to user at 3D video rendering, its accuracy is very important since it determines the quality of generated virtual view image. Many works are related to such depth enhancement exploiting a time-of-flight (TOF) camera. In this paper, we propose a fast 3D scene capturing system using one TOF camera at center and two high-resolution cameras at both sides. Since we need two depth data for both color cameras, we obtain two views' depth data from the center using the 3D warping technique. Holes in warped depth maps are filled by referring to the surrounded background depth values. In order to reduce mismatches of object boundaries between the depth and color images, we used the joint bilateral filter on the warped depth data. Finally, using two color images and depth maps, we generated 10 additional intermediate images. To realize fast capturing system, we implemented the proposed system using multi-threading technique. Experimental results show that the proposed capturing system captured two viewpoints' color and depth videos in real-time and generated 10 additional views at 7 fps.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2013.06a
• /
• pp.293-295
• /
• 2013

최근 3D 비디오의 흥행과 더불어 사람들이 스테레오스코픽 비디오를 쉽게 접할 수 있게 되었다. 하지만 부적절한 스테레오 스코픽 비디오는 시청자로 하여금 어지럼증, 눈의 피로 등을 느끼게 할 수 있다. 따라서 비디오 컨텐츠를 분석하여 피로도를 예츨할 수 있는 지표의 개발이 필요하다. 스테레오스코픽 비디오에서 피로도를 유발시키는 원인은 여러 가지가 있으며, 본 논문에서는 비디오의 카메라 움직임 정보에 집중한다. 카메라의 흔들림은 심각한 멀미를 유발할 수 있다. 이는 스테레오스코픽 비디오에서 더욱 강렬하게 나타나게 된다. 우리는 스테레오스코픽 비디오의 흔들림을 측정하기 위해 3D 복원 기술을 사용한다. 특히, 좌안 비디오와 우안 비디오의 정보를 모두 활용하는 최적화된 알고리즘을 제안한다. 이를 통해 우리는 각 프레임의 카메라 위치와 방향 정보를 획득할 수 있다. 마지막으로 획득한 3차원 카메라 움직임 정보로부터 카메라의 흔들림을 잘 표현할 수 있는 점수를 계산한다.

• Journal of Digital Convergence
• /
• v.10 no.10
• /
• pp.283-288
• /
• 2012

3D is the one of the current world in the spotlight as part of the future earnings of the business sector. Existing flat 2D and stereoscopic 3D to change the 3D shape and texture make walking along the dimension of the real world and the virtual reality world by making it feel contemporary reality of coexistence good show. 3D for the interest of the people has been spreading throughout the movie which is based on a 3D Avata. 3D TV market of the current conglomerate of changes in the market pioneer in the 3D market, further leap into the era of the upgrade was. At the same time, however, the modern man of the world, if becoming a necessity in the smartphone craze new innovation in the IT market mobile phone market and also has made. A small computer called a smartphone enough, the ripple velocity and the aftermath of the innovation of the telephone, the Internet as much as to leave many issues. Smartphone smart phone is a mobile phone that can be several functions. The current iPhone, Android. In addition to a large number of Windows Phone smartphones are released. Above the overall prospects of the future and a business service model for 3D facial expression as input avatar virtual 3D character on camera on your smartphone camera to recognize a user's emotional expressions on the face of the person is able to synthetic synthesized avatars in real-time to other mobile phone users matching, transmission, and be able to communicate in real-time sensibility fused video communication services to the development of applications.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2010.07a
• /
• pp.234-236
• /
• 2010

본 논문에서는 한 장의 영상을 가상 카메라와 깊이맵을 이용하여 영상 내부를 네비게이션하는 입체 자유시점 비디오를 제안한다. 이 분야는 한장 또는 여러장의 사진 내부를 탐험하면서 애니메이션으로 볼 수 있게 하는 기술이다. 제안 방법은 전처리과정으로 전경 마스크, 배경영상, 및 깊이맵을 자동 및 수동 방법으로 구한다. 다음에는 영상 내부를 항해하면서 투영 영상들을 획득한다. 배경영상과 전객객체의 3D 모델링 데이터를 기반으로 가상 카메라의 3차원 공간 이동, yaw, pitch, rolling의 회전, look-around effect, 줌인 등의 다양한 카메라 기능을 활용하여 자유시점 비디오를 구현한다. 소프트웨어는 OpenGL 및 MFC Visual C++ 기반으로 구축되었으며, 실험영상으로 조선시대의 작품인 김홍도의 무이귀도를 사용하였고, 입체영상으로 제작되어 보다 실감있는 자유시점 콘텐츠를 제공한다.

• Journal of Broadcast Engineering
• /
• v.7 no.3
• /
• pp.211-218
• /
• 2002

This paper introduces the HD 3DTV camera and 3DTV receiver that are compatible with the ATSC HDTV broadcasting system. The developed 3DTV camera is based on stereoscopic techniques, and it has control function to control both left and right zoom lens simultaneously and to control the vergence. Moreover, in order to control the vergence manually and to eliminate the synchronization problem of the both images, the 3DTV camera has the 3DTV video multiplexing function to combine the left and right images into the single image. The developed 3DTV signal, and it has the various analog/digital interfaces. The performance of the developed system is confirmed by shooting the selected soccer game in 2002 FIFA KOREA/JAPANTM World Cup and by broadcasting the match. The HD 3DTV camera and receiver will be applied to the 3DTV industries such as 3D movie, 3D game, 3D image processing, 3DTV broadcasting system, and so on.