Browse > Article
http://dx.doi.org/10.3807/JOSK.2015.19.3.248

Computational Integral Imaging Reconstruction of a Partially Occluded Three-Dimensional Object Using an Image Inpainting Technique  

Lee, Byung-Gook (Institute of Ambient Intelligence, Division of Computer Information Engineering, Dongseo University)
Ko, Bumseok (Institute of Ambient Intelligence, Division of Computer Information Engineering, Dongseo University)
Lee, Sukho (Institute of Ambient Intelligence, Division of Computer Information Engineering, Dongseo University)
Shin, Donghak (Institute of Ambient Intelligence, Division of Computer Information Engineering, Dongseo University)
Publication Information
Journal of the Optical Society of Korea / v.19, no.3, 2015 , pp. 248-254 More about this Journal
Abstract
In this paper we propose an improved version of the computational integral imaging reconstruction (CIIR) for visualizing a partially occluded object by utilizing an image inpainting technique. In the proposed method the elemental images for a partially occluded three-dimensional (3D) object are recorded through the integral imaging pickup process. Next, the depth of occlusion within the elemental images is estimated using two different CIIR methods, and the weight mask pattern for occlusion is generated. After that, we apply our image inpainting technique to the recorded elemental images to fill in the occluding area with reliable data, using information from neighboring pixels. Finally, the inpainted elemental images for the occluded region are reconstructed using the CIIR process. To verify the validity of the proposed system, we carry out preliminary experiments in which faces are the objects. The experimental results reveal that the proposed system can dramatically improve the quality of a reconstructed CIIR image.
Keywords
Integral imaging; Elemental images; Occlusion removal; Image inpainting; 3D visualization;
Citations & Related Records
Times Cited By KSCI : 3  (Citation Analysis)
연도 인용수 순위
1 A. Stern and B. Javidi, "Three-dimensional image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-607 (2006).
2 J.-H. Park, K. Hong, and B. Lee, "Recent progress in three-dimensional information processing based on integral imaging," Appl. Opt. 48, H77-H94 (2009).   DOI
3 S.-H. Hong, J.-S. Jang, and B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express 12, 483-491 (2004).   DOI
4 D.-H. Shin, E.-S. Kim, and B. Lee, "Computational reconstruction technique of three-dimensional object in integral imaging using a lenslet array," Jpn. J. Appl. Phys. 44, 8016-8018 (2005).   DOI
5 D.-H. Shin, M.-W. Kim, H. Yoo, J.-J. Lee, B. Lee, and E.-S. Kim, "Improved viewing quality of 3-D images in computational integral imaging reconstruction based on round mapping model," ETRI J. 29, 649-654 (2007).   DOI   ScienceOn
6 D.-H. Shin and E.-S. Kim, "Computational integral imaging reconstruction of 3D object using a depth conversion technique," J. Opt. Soc. Korea 12, 131-135 (2008).   DOI   ScienceOn
7 H. Yoo, "Artifact analysis and image enhancement in threedimensional computational integral imaging using smooth windowing technique," Opt. Lett. 36, 2107-2109 (2011).   DOI   ScienceOn
8 J.-Y. Jang, J.-I. Ser, S. Cha, and S.-H. Shin, "Depth extraction by using the correlation of the periodic function with an elemental image in integral imaging," Appl. Opt. 51, 3279-3286 (2012).   DOI
9 J.-Y. Jang, D. Shin, and E.-S. Kim, "Optical three-dimensional refocusing from elemental images based on a sifting property of the periodic $\delta$-function array in integral-imaging," Opt. Express 22, 1533-1550 (2014).   DOI   ScienceOn
10 D.-H. Shin and H. Yoo, "Scale-variant magnification for computational integral imaging and its application to 3D object correlator," Opt. Express 16, 8855-8867 (2008).   DOI
11 D.-C. Hwang, D.-H. Shin, S.-C. Kim, and E.-S. Kim, "Depth extraction of three-dimensional objects in space by the computational integral imaging reconstruction technique," Appl. Opt. 47, D128-D135 (2008).   DOI
12 S.-C. Kim, S.-C. Park, and E.-S. Kim, "Computational integral-imaging reconstruction-based 3-D volumetric target object recognition by using a 3-D reference object," Appl. Opt. 48, H95-H104 (2009).   DOI
13 M. Cho and B. Javidi, "Three-dimensional visualization of objects in turbid water using integral imaging," J. Display Technol. 6, 544-547 (2010).   DOI   ScienceOn
14 M. Zhang, Y. Piao, and E.-S. Kim, "Occlusion-removed scheme using depth-reversed method in computational integral imaging," Appl. Opt. 49, 2571-2580 (2010).   DOI
15 D.-H. Shin, B.-G. Lee, and J.-J. Lee, "Occlusion removal method of partially occluded 3D object using sub-image block matching in computational integral imaging," Opt. Express 16, 16294-16304 (2008).   DOI
16 J.-Y. Jang, S.-P. Hong, D. Shin, B.-G. Lee, and E.-S. Kim, "3D image correlator using computational integral imaging reconstruction based on modified convolution property of periodic functions," J. Opt. Soc. Korea 18, 388-394 (2014).   DOI   ScienceOn
17 B.-G. Lee, Liliana, and D. Shin, "Enhanced computational integral imaging system for partially occluded 3D objects using occlusion removal technique and recursive PCA reconstruction," Opt. Commun. 283, 2084-2091 (2010).   DOI   ScienceOn
18 J.-J. Lee, B.-G. Lee, and H. Yoo, "Image quality enhancement of computational integral imaging reconstruction for partially occluded objects using binary weighting mask on occlusion areas," Appl. Opt. 50, 1889-1893 (2011).   DOI
19 J.-H. Jung, K. Hong, G. Park, I. Chung, J.-H. Park, and B. Lee, "Reconstruction of three-dimensional occluded object using optical flow and triangular mesh reconstruction in integral imaging," Opt. Express 18, 26373-26387 (2010).   DOI
20 J.-J. Lee, D. Shin, and H. Yoo, "Image quality improvement in computational reconstruction of partially occluded objects using two computational integral imaging," Opt. Commun. 304, 96-101 (2013).   DOI   ScienceOn
21 D. Garcia, "Robust smoothing of gridded data in one and higher dimensions with missing values," Comput. Stat. Data An. 54, 1167-1178 (2010).   DOI   ScienceOn
22 K. A. Patwardhan, G. Sapiro, and M. Bertalmio, "Video inpainting under constrained camera motion," IEEE Trans. Image Process. 16, 545-553 (2006).