• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.20 no.7
• /
• pp.1369-1375
• /
• 2016

In this paper, we present a depth extraction method of integral imaging using correlation between elemental images with phase only filter. Integral imaging is a passive three-dimensional (3D) imaging system records ray information of 3D objects through lenslet array by 2D image sensor, and displays 3D images by using the similar lenslet array. 2D images by lenslet array have different perspectives. These images are referred to as elemental images. Since the correlation can be calculated between elemental images, the depth information of 3D objects can be extracted. To obtain high correaltion between elemental images effectively, in this paper, we use phase only filter. Using this high correlation, the corresponding pixels between elemental images can be found so that depth information can be extracted by computational reconstruction technique. In this paper, to prove our method, we carry out optical experiment and calculate Peak Sidelobe Ratio (PSR) as a correlation metric.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.20 no.1
• /
• pp.167-174
• /
• 2016

In this paper, we propose a generation of 2D elemental images for 3D objects using Kinect in 3D depth-priority integral imaging (DPII) display. First, we analyze a principle to pickup elemental images based on ray optics. Based on our analysis, elemental images are generated with both RGB image and depth image recorded from Kinect. We reconstruct 3D images from the elemental images with the computational integral imaging reconstruction technique and then compare various perspective images. To show the usefulness of the proposed method, we carried out the preliminary experiments. The experimental results reveal that our method can provide correct 3D images with full parallax.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.18 no.10
• /
• pp.2571-2578
• /
• 2014

In this paper, we propose a computational generation method of elemental images for time-multiplexed 3D integral imaging display based lens division. In the proposed method, we analyze the image formation between 3D object and elemental images based on ray optics. Based on the analyzed formation, we generate the elemental image set for time-multiplexed display. Positions of an object point picked up in proposed method is shifted for half size of lens divided from those in conventional method when generating elemental images. To show the usefulness of the proposed method, we carry out the preliminary experiments and present the results.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2012.05a
• /
• pp.155-157
• /
• 2012

In this paper, we propose a nonlinear 3D image correlator using computational reconstruction of 3D images based on integral imaging. In the proposed method, the elemental images for reference 3D object and target 3D object are recorded through the lens array. The recorded elemental images are reconstructed as reference plane image and target plane images using the computational integral imaging reconstruction algorithm and the nonolinear correlation between them is performed for object recognition. To show the usefulness of the proposed method, the preliminary experiments are carried out and the experimental results are presented compared with the conventional results.

• Journal of the Optical Society of Korea
• /
• v.19 no.4
• /
• pp.390-396
• /
• 2015

We propose a partial occlusion removal method for computational integral imaging reconstruction (CIIR) based on the usage of the exemplar based inpainting technique. The proposed method is an improved version of the original linear inpainting based CIIR (LI-CIIR), which uses the inpainting technique to fill in the data missing region. The LI-CIIR shows good results for images which contain objects with smooth surfaces. However, if the object has a textured surface, the result of the LI-CIIR deteriorates, since the linear inpainting cannot recover the textured data in the data missing region well. In this work, we utilize the exemplar based inpainting to fill in the textured data in the data missing region. We call the proposed method the neighboring elemental image exemplar based inpainting (NEI-exemplar inpainting) method, since it uses sources from neighboring elemental images to fill in the data missing region. Furthermore, we also propose an automatic occluding region extraction method based on the use of the mutual constraint using depth estimation (MC-DE) and the level set based bimodal segmentation. Experimental results show the validity of the proposed system.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.18 no.11
• /
• pp.2799-2804
• /
• 2014

In this paper, we suggest three-dimensional information extraction map system using integral imaging technique. Integral imaging can record multiple elemental images with different perspectives using a 2D image acquisition device with lenslet array. Using these images, integral imaging can obtain 3D information and display 3D image. In this paper, the position difference between elemental images can be obtained using summation of absolute difference (SAD), and then 3D information can be extracted. Therefore, this technique can find the height information of 3D objects.

• Journal of the Optical Society of Korea
• /
• v.18 no.4
• /
• pp.388-394
• /
• 2014

In this paper, we propose a three-dimensional (3D) image correlator by use of computational integral imaging reconstruction based on the modified convolution property of periodic functions (CPPF) for recognition of partially occluded objects. In the proposed correlator, elemental images of the reference and target objects are picked up by a lenslet array, and subsequently are transformed to a sub-image array which contains different perspectives according to the viewing direction. The modified version of the CPPF is applied to the sub-images. This enables us to produce the plane sub-image arrays without the magnification and superimposition processes used in the conventional methods. With the modified CPPF and the sub-image arrays, we reconstruct the reference and target plane sub-image arrays according to the reconstruction plane. 3D object recognition is performed through cross-correlations between the reference and the target plane sub-image arrays. To show the feasibility of the proposed method, some preliminary experiments on the target objects are carried out and the results are presented. Experimental results reveal that the use of plane sub-image arrays enables us to improve the correlation performance, compared to the conventional method using the computational integral imaging reconstruction algorithm.

• Korean Journal of Optics and Photonics
• /
• v.20 no.2
• /
• pp.94-101
• /
• 2009

A novel method for the reconstruction of 3D shape and texture from elemental images has been proposed. Using this method, we can estimate a full 3D polygonal model of objects with seamless triangulation. But in the triangulation process, all the objects are stitched. This generates phantom surfaces that bridge depth discontinuities between different objects. To solve this problem we need to connect points only within a single object. We adopt a segmentation process to this end. The entire process of the proposed method is as follows. First, the central pixel of each elemental image is computed to extract spatial position of objects by correspondence analysis. Second, the object points of central pixels from neighboring elemental images are projected onto a specific elemental image. Then, the center sub-image is segmented and each object is labeled. We used the normalized cut algorithm for segmentation of the center sub-image. To enhance the speed of segmentation we applied the watershed algorithm before the normalized cut. Using the segmentation results, the subdivision process is applied to pixels only within the same objects. The refined grid is filtered with median and Gaussian filters to improve reconstruction quality. Finally, each vertex is connected and an object-based triangular mesh is formed. We conducted experiments using real objects and verified our proposed method.

• The Journal of the Korea Contents Association
• /
• v.11 no.3
• /
• pp.9-17
• /
• 2011

Recently, with the advent of stereoscopic 3D TV, the activation of 3D stereoscopic content is expected. Research on 3D auto stereoscopic display has been carried out to relieve discomfort of 3D stereoscopic display. In this research, it is necessary to generate the elemental image from a lens array. As the number of lens in a lens array is increased, it takes a lot of time to generate the elemental image, and it will take more time for a large volume data. In order to improve the problem, in this paper, we propose a method to generate the elemental image by using OpenCL based on CUDA. We perform our proposed method on PC environment with one of Tesla C1060, Geforce 9800GT and Quadro FX 3800 graphics cards. Experimental results show that the proposed method can obtain almost 20 times better performance than recent research result[11].

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.10 no.4
• /
• pp.712-717
• /
• 2006

In this paper, a new integral imaging method with horizontal parallax only is proposed by modified use of elemental images pickuped from conventional integral imaging. The modified elemental images are obtained by magnifying single horizontal elemental image vertically and from which 3D images could be reconstructed. The proposed method can provide us large reduction of transmission information data for elemental images by eliminating the vertical parallax. The feasibility of our approach is experimentally demonstrated and its results are presented.