Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Three-Dimensional Visualization Technique of Occluded Objects Using Integral Imaging with Plenoptic Camera

  • Lee, Min-Chul (Department of Computer Science and Electronics, Kyushu Institute of Technology) ;
  • Inoue, Kotaro (Department of Electrical, Electronic, and Control Engineering, IITC, Hankyong National University) ;
  • Tashiro, Masaharu (Department of Computer Science and Electronics, Kyushu Institute of Technology) ;
  • Cho, Myungjin (Department of Electrical, Electronic, and Control Engineering, IITC, Hankyong National University)
  • Received : 2017.09.04
  • Accepted : 2017.09.19
  • Published : 2017.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this study, we propose a three-dimensional (3D) visualization technique of occluded objects using integral imaging with a plenoptic camera. In previous studies, depth map estimation from elemental images was used to remove occlusion. However, the resolution of these depth maps is low. Thus, the occlusion removal accuracy is not efficient. Therefore, we use a plenoptic camera to obtain a high-resolution depth map. Hence, individual depth map for each elemental image can also be generated. Finally, we can regenerate a more accurate depth map for 3D objects with these separate depth maps, allowing us to remove the occlusion layers more efficiently. We perform optical experiments to prove our proposed technique. Moreover, we use MSE and PSNR as a performance metric to evaluate the quality of the reconstructed image. In conclusion, we enhance the visual quality of the reconstructed image after removing the occlusion layers using the plenoptic camera.

Keywords

References

  1. G. Lippmann, "La photographie integrale," Comptes Rendus de l'Academie des Sciences, vol. 146, pp. 446-451, 1908.
  2. S. H. Hong, J. S. Jang, and B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Optical Express, vol. 12, no. 3, pp. 483-491, 2004. https://doi.org/10.1364/OPEX.12.000483
  3. B. Javidi, R. Ponce-Diaz, and S. H. Hong, "Three-dimensional recognition of occluded objects by using computational integral imaging," Optics Letters, vol. 31, no. 8, pp. 1106-1108, 2006. https://doi.org/10.1364/OL.31.001106
  4. D. H. Shin and H. Yoo, "Image quality enhancement in 3D computational integral imaging by use of interpolation methods," Optics Express, vol. 15, no. 19, pp. 12039-12049, 2007. https://doi.org/10.1364/OE.15.012039
  5. H. Yoo and D. H. Shin, "Improved analysis on the signal property of computational integral imaging system," Optics Express, vol. 15, no. 21, pp. 14107-14114, 2007. https://doi.org/10.1364/OE.15.014107
  6. S. H. Hong and B. Javidi, "Distortion-tolerant 3D recognition of occluded objects using computational integral imaging," Optics Express, vol. 14, no. 25, pp. 12085-12095, 2006. https://doi.org/10.1364/OE.14.012085
  7. M. Cho and B. Javidi, "Three-dimensional tracking of occluded objects using integral imaging," Optics Letters, vol. 33, no. 23, pp. 2737-2739, 2008. https://doi.org/10.1364/OL.33.002737
  8. D. H. Shin, B. G. Lee, and J. J. Lee, "Occlusion removal method of partially occluded 3D object using sub-image block matching in computational integral imaging," Optics Express, vol. 16, no. 21, pp. 16294-16304, 2008. https://doi.org/10.1364/OE.16.016294
  9. B. G. Lee and D. H. Shin, "Enhanced computational integral imaging system for partially occluded 3D objects using occlusion removal technique and recursive PCA reconstruction," Optics Communications, vol. 283, no. 10, 2084-2091, 2010. https://doi.org/10.1016/j.optcom.2010.01.044
  10. M. Zhang, Y. Piao, and E. S. Kim, "Occlusion-removed scheme using depth-reversed method in computational integral imaging," Applied Optics, vol. 49, no. 14, pp. 2571-2580, 2010. https://doi.org/10.1364/AO.49.002571
  11. J. J. Lee, B. G. Lee, and H. Yoo, "Image quality enhancement of computational integral imaging reconstruction for partially occluded objects using binary weighting mask on occlusion areas," Applied Optics, vol. 50, no.13, pp. 1889-1893, 2011. https://doi.org/10.1364/AO.50.001889
  12. Z. Zhou, Y. Yuan, X. Bin, and Q. Wang, "Enhanced reconstruction of partially occluded objects with occlusion removal in synthetic aperture integral imaging," Chinese Optics Letters, vol. 9, no. 4, article ID. 041002, 2011.
  13. R. Ng, M. Levoy, M. Bredif, G. Duval, M. Horowitz, and P. Hanrahan, "Light field photography with a hand-held plenoptic camera," Computer Science Technical Report, vol. 2005, no. 2, pp. 1-11, 2005.
  14. R. Ng, "Digital light field photography," Ph.D. dissertation, Stanford University, CA, 2006.