Browse > Article
http://dx.doi.org/10.3807/JOSK.2015.19.4.390

Neighboring Elemental Image Exemplar Based Inpainting for Computational Integral Imaging Reconstruction with Partial Occlusion  

Ko, Bumseok (Department of Software Engineering, Division of Computer Information Engineering, Dongseo University)
Lee, Byung-Gook (Department of Software Engineering, Division of Computer Information Engineering, Dongseo University)
Lee, Sukho (Department of Software Engineering, Division of Computer Information Engineering, Dongseo University)
Publication Information
Journal of the Optical Society of Korea / v.19, no.4, 2015 , pp. 390-396 More about this Journal
Abstract
We propose a partial occlusion removal method for computational integral imaging reconstruction (CIIR) based on the usage of the exemplar based inpainting technique. The proposed method is an improved version of the original linear inpainting based CIIR (LI-CIIR), which uses the inpainting technique to fill in the data missing region. The LI-CIIR shows good results for images which contain objects with smooth surfaces. However, if the object has a textured surface, the result of the LI-CIIR deteriorates, since the linear inpainting cannot recover the textured data in the data missing region well. In this work, we utilize the exemplar based inpainting to fill in the textured data in the data missing region. We call the proposed method the neighboring elemental image exemplar based inpainting (NEI-exemplar inpainting) method, since it uses sources from neighboring elemental images to fill in the data missing region. Furthermore, we also propose an automatic occluding region extraction method based on the use of the mutual constraint using depth estimation (MC-DE) and the level set based bimodal segmentation. Experimental results show the validity of the proposed system.
Keywords
Integral imaging; Image inpainting; Bimodal segmentation; Occlusion removal; 3-D visualization;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 A. Stern and B. Javidi, "Three-dimensional image sensing, visualization, and processing using integral imaging," Proc. IEEE 94, 591-607 (2006).   DOI   ScienceOn
2 S.-H. Hong, J.-S. Jang, and B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Opt. Express 12, 483-491 (2004).   DOI
3 J.-H. Park, K. Hong, and B. Lee, "Recent progress in threedimensional information processing based on integral imaging," Appl. Opt. 48, H77-H94 (2009).   DOI
4 D.-H. Shin, E.-S. Kim, and B. Lee, "Computational reconstruction technique of three-dimensional object in integral imaging using a lenslet array," Jpn. J. Appl. Phys. 44, 8016-8018 (2005).   DOI
5 D.-H. Shin, M.-W. Kim, H. Yoo, J.-J. Lee, B. Lee, and E.-S. Kim, "Improved viewing quality of 3-D images in computational integral imaging reconstruction based on round mapping model," ETRI J. 29, 649-654 (2007).   DOI   ScienceOn
6 H. Yoo, "Artifact analysis and image enhancement in three-dimensional computational integral imaging using smooth windowing technique," Opt. Lett. 36, 2107-2109 (2011).   DOI   ScienceOn
7 D.-H. Shin and E.-S. Kim, "Computational integral imaging reconstruction of 3D object using a depth conversion technique," J. Opt. Soc. Korea 12, 131-135 (2008).   DOI   ScienceOn
8 J.-Y. Jang, D. Shin, and E.-S. Kim, "Optical three-dimensional refocusing from elemental images based on a sifting property of the periodic ${\delta}$-function array in integral-imaging," Opt. Express 22, 1533-1550 (2014).   DOI   ScienceOn
9 J.-Y. Jang, J.-I. Ser, S. Cha, and S.-H. Shin, "Depth extraction by using the correlation of the periodic function with an elemental image in integral imaging," Appl. Opt. 51, 3279-3286 (2012).   DOI
10 D.-H. Shin and H. Yoo, "Scale-variant magnification for computational integral imaging and its application to 3D object correlator," Opt. Express 16, 8855-8867 (2008).   DOI
11 C. Kim, S.-C. Park, and E.-S. Kim, "Computational integralimaging reconstruction-based 3-D volumetric target object recognition by using a 3-D reference object," Appl. Opt. 48, H95-H104 (2009).   DOI
12 D.-C. Hwang, D.-H. Shin, S.-C. Kim, and E.-S. Kim, "Depth extraction of three-dimensional objects in space by the computational integral imaging reconstruction technique," Appl. Opt. 47, D128-D135 (2008).   DOI
13 M. Cho and B. Javidi, "Three-dimensional visualization of objects in turbid water using integral imaging," J. Display Technol. 6, 544-547 (2010).   DOI   ScienceOn
14 B.-G. Lee, Liliana, and D. Shin, "Enhanced computational integral imaging system for partially occluded 3D objects using occlusion removal technique and recursive PCA reconstruction," Opt. Commun. 283, 2084-2091 (2010).   DOI   ScienceOn
15 J.-Y. Jang, S.-P. Hong, D. Shin, B.-G. Lee, and E.-S. Kim, "3D image correlator using computational integral imaging reconstruction based on modified convolution property of periodic functions," J. Opt. Soc. Korea 18, 388-394 (2014).   DOI   ScienceOn
16 M. Zhang, Y. Piao, and E.-S. Kim, "Occlusion-removed scheme using depth-reversed method in computational integral imaging," Appl. Opt. 49, 2571-2580 (2010).   DOI
17 D.-H. Shin, B.-G. Lee, and J.-J. Lee, "Occlusion removal method of partially occluded 3D object using sub-image block matching in computational integral imaging," Opt. Express 16, 16294-16304 (2008).   DOI
18 J.-J. Lee, B.-G. Lee, and H. Yoo, "Image quality enhancement of computational integral imaging reconstruction for partially occluded objects using binary weighting mask on occlusion areas," Appl. Opt. 50, 1889-1893 (2011).   DOI
19 J.-J. Lee, D. Shin, and H. Yoo, "Image quality improvement in computational reconstruction of partially occluded objects using two computational integral imaging," Opt. Commun. 304, 96-101 (2013).   DOI   ScienceOn
20 B.-G. Lee, B.-S. Ko, S.-H. Lee, and D. Shin, "Computational integral imaging reconstruction of a partially occluded threedimensional object using an image inpainting technique," J. Opt. Soc. Korea 19, 248-254 (2015).   DOI   ScienceOn
21 D. Garcia, "Robust smoothing of gridded data in one and higher dimensions with missing values," Comput. Stat. Data An. 54, 1167-1178 (2010).   DOI   ScienceOn
22 S.-H. Lee and J.-K. Seo, "Level set-based bimodal segmentation with stationary global minimum," IEEE Trans. Image Process. 15, 2843-2852 (2006).   DOI   ScienceOn
23 A. Criminisi, P. Perez, and K. Toyama, "Object removal by exemplar-based image inpainting," IEEE Trans. Image Process. 13, 1200-1212 (2004).   DOI   ScienceOn
24 T.-K. Ryu, B.-G. Lee, and S.-H. Lee, "Mutual constraint using partial occlusion artifact removal for computational integral imaging reconstruction," Appl. Opt. 54, 4147-4153 (2015).   DOI