• Journal of information and communication convergence engineering
• /
• v.15 no.3
• /
• pp.193-198
• /
• 2017

In this study, we propose a three-dimensional (3D) visualization technique of occluded objects using integral imaging with a plenoptic camera. In previous studies, depth map estimation from elemental images was used to remove occlusion. However, the resolution of these depth maps is low. Thus, the occlusion removal accuracy is not efficient. Therefore, we use a plenoptic camera to obtain a high-resolution depth map. Hence, individual depth map for each elemental image can also be generated. Finally, we can regenerate a more accurate depth map for 3D objects with these separate depth maps, allowing us to remove the occlusion layers more efficiently. We perform optical experiments to prove our proposed technique. Moreover, we use MSE and PSNR as a performance metric to evaluate the quality of the reconstructed image. In conclusion, we enhance the visual quality of the reconstructed image after removing the occlusion layers using the plenoptic camera.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.22 no.2
• /
• pp.261-269
• /
• 2018

This paper presents a convenient method to estimate the internal parameters of plenoptic camera using CCD(charge-coupled device) camera model. The images used for plenoptic camera calibration generally use the checkerboard pattern used in CCD camera calibration. Based on the CCD camera model, the determinant of the plenoptic camera model can be derived through the relationship with the plenoptic camera model. We formulate four equations that express the focal length, the principal point, the baseline, and distance between the virtual camera and the object. By performing a nonlinear optimization technique, we solve the equations to estimate the parameters. We compare the estimation results with the actual parameters and evaluate the reprojection error. Experimental results show that the MSE(mean square error) is 0.309 and estimation values are very close to actual values.

• Journal of the Korea Computer Graphics Society
• /
• v.6 no.4
• /
• pp.15-22
• /
• 2000

One of the main research trends in image based modeling and rendering is how to implement plenoptic function. For this purpose, this paper proposes a novel approach based on a set of randomly placed panoramas. The proposed approach, first of all, adopts a simple computer vision technique to approximate omni-directional depth information of the surrounding scene, and then corrects/interpolates panorama images to generate an output image at a vantage viewpoint. Implementation results show that the proposed approach achieves smooth navigation at an interactive rate.

• Journal of the Korea Computer Graphics Society
• /
• v.6 no.1
• /
• pp.1-9
• /
• 2000

This paper proposes a novel 3D representation of a plenoptic function that uses cylindrical maps placed on a circle. The proposed representation has an advantage over the previous one, concentric mosaics, in that it can render an object looking inward as well as looking outward of an environment. We also present an effective rendering technique for the representation that fully utilizes the depth information estimated or given for the cylindrical maps. This technique allows us to render more accurate images with novel views than point sampling or bilinear interpolation, which has been used for concentric mosaics.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.22 no.3
• /
• pp.425-433
• /
• 2018

In this paper, we propose a super-resolution reconstruction algorithm for plenoptic images based on the reliability of disparity. The subperture image generated by the Flanoptic camera image is used for disparity estimation and reconstruction of super-resolution image based on TV_L1 algorithm. In particular, the proposed image reconstruction method is effective in the boundary region where disparity may be relatively inaccurate. The determination of reliability of disparity vector is based on the upper, lower, left and right positional relationship of the sub-aperture image. In our method, the unreliable vectors are excluded in reconstruction. The performance of the proposed method was evaluated by comparing to a bicubic interpolation method, a conventional disparity based method and dictionary based method. The experimental results show that the proposed method provides the best performance in terms of PSNR(Peak Signal to noise ratio), SSIM(Structural Similarity).

• Proceedings of the Korea Information Processing Society Conference
• /
• 2005.05a
• /
• pp.185-188
• /
• 2005

영상 기반 렌더링에서 평면에 투영된 사영 영상만을 가지고 3 차원 영상을 재구성 하는 여러 가지 모델링 기법들이 연구되어 왔다. 4D Plenoptic Function 을 사용하는 Light Field Rendering 이나 Lumigraph 방법은 여러 개의 영상으로 새로운 시점의 영상을 생성하는 기법이다. 이러한 방법은 사용자가 가상 세계에서의 항해를 가능하게 하고 2 차원의 정보만으로 3 차원 환경을 구성 할 수 있다. Concentric Mosaic, Plenoptic Stitching, Sea of Image 등은 Light Field 를 이용하여 사용자가 여러 가지 환경에서 항해할 수 있게 하는 기법이다. 특히 Takahashi 는 도시의 거리와 같은 대규모 환경에서의 항해에 관한 연구를 발표하였다. 단일 경로를 따라 파노라마 영상을 획득한 다음 Light Field 방법을 사용해서 새로운 시점의 영상을 생성한다. 하지만 대규모 환경에서 사용자가 이동할 수 있는 경로의 범위는 매우 넓고 경로를 따라 조밀하게 파노라마 영상을 획득해야 하기 때문에 데이터의 양이 많아지고 영상획득의 어려움이 있다. 이러한 단점으로 인하여 참조 영상의 네트워크 전송 시에 네트워크의 부하가 증가될 수 있다. 본 논문에서는 Takahashi 의 방법을 기본으로 파노라마 영상 모핑 방법을 이용하여 임의 시점 (Arbitrary View)의 영상을 렌더링 하는 방법을 제안한다. 파노라마 영상의 획득 간격을 비교적 크게 하면서 파노라마 영상 모핑 기법을 이용하여 중간 영상을 생성한 후 Takahashi 의 방법을 사용하여 임의 영상을 생성하는 방법이다. 적은 수의 파노라마 영상으로 비교적 좋은 임의 시점의 영상을 재구성 할 수 있었다.

• Journal of information and communication convergence engineering
• /
• v.12 no.2
• /
• pp.89-96
• /
• 2014

Here, we present a review of the proposals and advances in the field of three-dimensional (3D) imaging acquisition and display made in the last century. The most popular techniques are based on the concept of stereoscopy. However, stereoscopy does not provide real 3D experience, and produces discomfort due to the conflict between convergence and accommodation. For this reason, we focus this paper on integral imaging, which is a technique that permits the codification of 3D information in an array of 2D images obtained from different perspectives. When this array of elemental images is placed in front of an array of microlenses, the perspectives are integrated producing 3D images with full parallax and free of the convergence-accommodation conflict. In the paper we describe the principles of this technique, together with some new applications of integral imaging.

• Journal of the Korea Computer Graphics Society
• /
• v.7 no.2
• /
• pp.29-35
• /
• 2001

In general, image-based virtual environment is represented by panoramic images created by image mosaic algorithm. The cylindrical panoramic image supports the fixed-viewpoint navigation due to the constraints of construction. Shum proposed concentric mosaics to allow users to navigate freely within a circular area[10]. It is constructed by a sequence of images which is acquired from a regularly rotating camera. Concentric mosaics technique, proposed by Shum, is considered as 3D plenoptic function which is defined three parameters : distance, height and angle. In this paper, we suggest an effective method for creating concentric mosaics, in which we first align a set of strip images on the cylinder plane and stitch the aligned strips to build a panoramic image. The proposed method has no constraints such as regular panning motion of camera. Furthermore, our proposed method minimizes the use of interpolation image to create a novel view images from the concentric mosaics. It allows the result image on a novel view to have better quality with respect to the number of input images.