• Electronics and Telecommunications Trends
• /
• v.32 no.5
• /
• pp.39-48
• /
• 2017

Since the world's first 3D commercial film with red-blue glasses was introduced in 1922, remarkable progress has been made in the field of 3D video. 3D video content gained enormous popularity with the movie "Avatar," which greatly increased the sale of 3D TVs. This momentum has weakened owing to lack of 3D content. However, the recent trend of virtual reality (VR) and augmented reality (AR) made 360 VR video and 3D games using a head mounted display wide spread. All these experiences mentioned above require wearing glasses to enjoy 3D content. Super multi-view content technology, on the other hand, enables viewers to enjoy 3D content without glasses on a super multi-view display. In this article, we introduce the technologies used to make super multi-view content, interact with it, and author content, which are developed by ETRI.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.5
• /
• pp.2366-2395
• /
• 2018

Multi-view super-resolution (MVSR) refers to the process of reconstructing a high-resolution (HR) image from a set of low-resolution (LR) images captured from different viewpoints typically by different cameras. These multi-view images are usually obtained by a camera array. In our previous work [1], we super-resolved multi-view LR images via image fusion (IF) and blind deblurring (BD). In this paper, we present a new MVSR method that jointly realizes IF and BD based on an integrated energy function optimization. First, we reformulate the MVSR problem into a multi-channel blind deblurring (MCBD) problem which is easier to be solved than the former. Then the depth map of the desired HR image is calculated. Finally, we solve the MCBD problem, in which the optimization problems with respect to the desired HR image and with respect to the unknown blur are efficiently addressed by the alternating direction method of multipliers (ADMM). Experiments on the Multi-view Image Database of the University of Tsukuba and images captured by our own camera array system demonstrate the effectiveness of the proposed method.

• 한국정보디스플레이학회:학술대회논문집
• /
• 2009.10a
• /
• pp.505-508
• /
• 2009

The super multi-view (SMV) display and the high-density directional (HDD) display were proposed as a natural 3D display that is free from the visual fatigue caused by the accommodation-vergence conflict and provides smooth motion parallax. The multi-projection system, the flat-panel system, and the time-multiplexing system are used to construct the HDD displays. The recent progress of the HDD 3D display is reviewed.

• Journal of Broadcast Engineering
• /
• v.18 no.3
• /
• pp.463-473
• /
• 2013

In this paper, we propose a super-resolution (SR) image reconstruction algorithm using multi-view images. We acquire 25 images from multi-view cameras, which consist of a $5{\times}5$ array of cameras, and then reconstruct an SR image of the center image using a low resolution (LR) input image and the other 24 LR reference images. First, we estimate disparity maps from the input image to the 24 reference images, respectively. Then, we interpolate a SR image by employing the LR image and matching points in the reference images. Finally, we refine the SR image using an iterative regularization scheme. Experimental results demonstrate that the proposed algorithm provides higher quality SR images than conventional algorithms.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.10 no.10
• /
• pp.5129-5152
• /
• 2016

Multi-view super-resolution (MVSR) aims to estimate a high-resolution (HR) image from a set of low-resolution (LR) images that are captured from different viewpoints (typically by different cameras). MVSR is usually applied in camera array imaging. Given that MVSR is an ill-posed problem and is typically computationally costly, we super-resolve multi-view LR images of the original scene via image fusion (IF) and blind deblurring (BD). First, we reformulate the MVSR problem into two easier problems: an IF problem and a BD problem. We further solve the IF problem on the premise of calculating the depth map of the desired image ahead, and then solve the BD problem, in which the optimization problems with respect to the desired image and with respect to the unknown blur are efficiently addressed by the alternating direction method of multipliers (ADMM). Our approach bridges the gap between MVSR and BD, taking advantages of existing BD methods to address MVSR. Thus, this approach is appropriate for camera array imaging because the blur kernel is typically unknown in practice. Corresponding experimental results using real and synthetic images demonstrate the effectiveness of the proposed method.

• Broadcasting and Media Magazine
• /
• v.6 no.2
• /
• pp.84-101
• /
• 2001

In this paper, we present a primitive system design of a super multi-view(SMV) 3-D display system based on a focused light array(FLA) concept using reflective vibrating scanner array(ViSA). The parallel beam scanning using a vibrating scanner array is performed by moving left and right an array of curvature-compensated mirrors or diamond-ruled reflective grating attached to a vibrating membrane. The parallel laser beam scanner array can replace the polygon mirror scanner which has been used in the SMV 3-D display system based on the focused light array(FLA) concept proposed by Kajiki at TAO(Telecommunications) Advancement Organization). The proposed system has great advantages in the sense that it requires neither huge imaging optics nor mechanical scanning pals. Some mathematical analyses and fundamental limitations of the proposed system are presented. The proposed vibrating scanner array, after some modifications and refinements, may replace polygon mirror-based scanners in the near future.

• Journal of Broadcast Engineering
• /
• v.25 no.6
• /
• pp.954-964
• /
• 2020

In immersive media, the most important factor that provides immersion is depth information. Therefore, it is essential to obtain high quality depth information in order to produce high quality immersive media. In this paper we propose an algorithm to improve depth map, considering the segmentation of images and the relationship between multiple views in multi-view systems. The proposed algorithm uses a super-pixel segmentation technique to divide the depth map of the reference view into several segments, and project each segment into adjacent view. Subsequently, the depth map of the adjacent view is improved using plane estimation using the information of the projected segment, and then reversed to the reference view. This process is repeated for several adjacent views to improve the reference depth map by updating the values of the improved adjacent views and the initial depth map of the reference view. Through simulation, the proposed algorithm is shown to surpass the conventional algorithm subjectively and objectively.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.446-449
• /
• 2009

In this paper, we present a novel method for reconstructing a super-resolution image using multi-view low-resolution images captured for depth varying scene without requiring complex analysis such as depth estimation and feature matching. The proposed method is based on the iterative back projection technique that is extended to the 3D volume domain (i.e., space + depth), unlike the conventional superresolution methods that handle only 2D translation among captured images.

• Annual Conference of KIPS
• /
• 2015.10a
• /
• pp.1474-1476
• /
• 2015

무안경방식 초다시점 3D 영상을 재현하기 위해서는 초다시점 콘텐츠 및 3D 디스플레이 설계가 필수적이다. 본 논문은 무안경방식 초다시점 3D 디스플레이를 설계하기 위한 주요 인자들을 정의하고 이들 상호적인 관계를 이용하여 2D 디스플레이에서 초다시점 3D콘텐츠 정보를 재현하는 시스템을 개발함으로써 디바이스 설계자에게는 능동적으로 디스플레이를 설계할 수 있도록 하고, 콘텐츠 개발자는 실제 초다시점 디스플레이를 설계하지 않고도 시뮬레이션을 통하여 콘텐츠의 입체감을 가이드 할 수 있는 시스템을 제안한다.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.39C no.2
• /
• pp.130-138
• /
• 2014

In this paper, the SMV 3D display method using liquid crystal shutter glass(LCSG) and SPB has been proposed. The proposed SMV display can solve the resolution degradation problem of conventional multiview displays that using based time-multiplexing method. Also, observers fatigue due to the mismatch between accommodation and vergence problem of glass-type 3D displays and conventional multiview displays, can be improved using SMV 3D display method.