Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

3D Visualization Technique for Occluded Objects in Integral Imaging Using Modified Smart Pixel Mapping

  • Lee, Min-Chul (Department of Computer Science and Electronics, Kyushu Institute of Technology) ;
  • Han, Jaeseung (Department of Electrical, Electronic, and Control Engineering, IITC, Hankyong National University) ;
  • Cho, Myungjin (Department of Electrical, Electronic, and Control Engineering, IITC, Hankyong National University)
  • Received : 2017.12.06
  • Accepted : 2017.12.20
  • Published : 2017.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose a modified smart pixel mapping (SPM) to visualize occluded three-dimensional (3D) objects in real image fields. In integral imaging, orthoscopic real 3D images cannot be displayed because of lenslets and the converging light field from elemental images. Thus, pseudoscopic-to-orthoscopic conversion which rotates each elemental image by 180 degree, has been proposed so that the orthoscopic virtual 3D image can be displayed. However, the orthoscopic real 3D image cannot be displayed. Hence, a conventional SPM that recaptures elemental images for the orthoscopic real 3D image using virtual pinhole array has been reported. However, it has a critical limitation in that the number of pixels for each elemental image is equal to the number of elemental images. Therefore, in this paper, we propose a modified SPM that can solve this critical limitation in a conventional SPM and can also visualize the occluded objects efficiently.

Keywords

References

  1. G. Lippmann, "La photographie integrale," Comptes Rendus de l'Academie des Sciences, vol. 146, pp. 446-451, 1908.
  2. R. Ng, M. Levoy, M. Bredif, G. Duval, M. Horowitz, and P. Hanrahan, "Light field photography with a hand-held plenoptic camera," Computer Science Technical Report, vol. 2005, no. 2, pp. 1-11, 2005.
  3. R. Ng, "Digital light field photography," Ph.D. dissertation, Stanford University, CA, 2006.
  4. F. Okano, H. Hoshino, J. Arai, and I. Yuyama, "Real-time pickup method for a three-dimensional image based on integral photography," Applied Optics, vol. 36, no. 7, pp. 1598-1603, 1997. https://doi.org/10.1364/AO.36.001598
  5. H. E. Ives, "Optical properties of a Lippmann lenticulated sheet," Journal of the Optical Society of America, vol. 21, no. 3, pp. 171-176, 1931. https://doi.org/10.1364/JOSA.21.000171
  6. N. Davies, M. McCormick, and L. Yang, "Three-dimensional imaging systems: a new development," Applied Optics, vol. 27, no. 21, pp. pp. 4520-4528, 1988. https://doi.org/10.1364/AO.27.004520
  7. H. Arimoto and B. Javidi, "Integral three-dimensional imaging with digital reconstruction," Optics Letters, vol. 26, no. 3, pp. 157-159, 2001. https://doi.org/10.1364/OL.26.000157
  8. Y. Hirayama, "One-dimensional integral imaging 3D display systems," in Proceedings of 3rd International Universal Communication Symposium (IUCS), Tokyo, Japan, pp. 141-145, 2009.
  9. S. H. Hong, J. S. Jang, and B. Javidi, "Three-dimensional volumetric object reconstruction using computational integral imaging," Optical Express, vol. 12, no. 3, pp. 483-491, 2004. https://doi.org/10.1364/OPEX.12.000483
  10. H. Yoo and D. H. Shin, "Improved analysis on the signal property of computational integral imaging system," Optics Express, vol. 15, no. 21, pp. 14107-14114, 2007. https://doi.org/10.1364/OE.15.014107
  11. M. Martinez-Corral, B. Javidi, R. Martinez-Cuenca, and G. Saavedra, "Formation of real, orthoscopic integral images by smart pixel mapping," Optics Express, vol. 13, no. 23, pp. 9175-9180, 2005. https://doi.org/10.1364/OPEX.13.009175
  12. J. H. Jung, J. Kim, and B. Lee, "Solution of pseudoscopic problem in Integral Imaging for real-time processing," Optics Letters, vol. 38, no. 1, pp. 76-78, 2013. https://doi.org/10.1364/OL.38.000076
  13. Y. Piao, M. Zhang, J. J. Lee, D. Shin, and B. G. Lee, "Orthoscopic integral imaging display by use of the computational method based on lenslet model," Optics and Lasers in Engineering, vol. 52, pp. 184-188, 2014. https://doi.org/10.1016/j.optlaseng.2013.06.012
  14. M. Zhang, Y. Piao, and E. S. Kim, "Occlusion-removed scheme using depth-reversed method in computational integral imaging," Applied Optics, vol. 49, no. 14, pp. 2571-2580, 2010. https://doi.org/10.1364/AO.49.002571
  15. B. Javidi, R. Ponce-Diaz, and S. H. Hong, "Three-dimensional recognition of occluded objects by using computational integral imaging," Optics Letters, vol. 31, no. 8, pp. 1106-1108, 2006. https://doi.org/10.1364/OL.31.001106
  16. S. H. Hong and B. Javidi, "Distortion-tolerant 3D recognition of occluded objects using computational integral imaging," Optics Express, vol. 14, no. 25, pp. 12085-12095, 2006. https://doi.org/10.1364/OE.14.012085
  17. M. Cho and B. Javidi, "Three-dimensional tracking of occluded objects using integral imaging," Optics Letters, vol. 33, no. 23, pp. 2737-2739, 2008. https://doi.org/10.1364/OL.33.002737
  18. D. H. Shin, B. G. Lee, and J. J. Lee, "Occlusion removal method of partially occluded 3D object using sub-image block matching in computational integral imaging," Optics Express, vol. 16, no. 21, pp. 16294-16304, 2008. https://doi.org/10.1364/OE.16.016294
  19. B. G. Lee and D. H. Shin, "Enhanced computational integral imaging system for partially occluded 3D objects using occlusion removal technique and recursive PCA reconstruction," Optics Communications, vol. 283, no. 10, 2084-2091, 2010. https://doi.org/10.1016/j.optcom.2010.01.044
  20. D. H. Shin and H. Yoo, "Image quality enhancement in 3D computational integral imaging by use of interpolation methods," Optics Express, vol. 15, no. 19, pp. 12039-12049, 2007. https://doi.org/10.1364/OE.15.012039

Cited by

  1. Free-view Pixels of Elemental Image Rearrangement Technique (FPERT) vol.17, pp.1, 2017, https://doi.org/10.6109/jicce.2019.17.1.60
  2. Augmented Reality Technology-based Dental Radiography Simulator for Preclinical Training and Education on Dental Anatomy vol.17, pp.4, 2019, https://doi.org/10.6109/jicce.2019.17.4.274